Creating a Sentiment Analysis Web App

Using PyTorch and SageMaker

Deep Learning Nanodegree Program | Deployment

---

Now that we have a basic understanding of how SageMaker works we will try to use it to construct a complete project from end to end. Our goal will be to have a simple web page which a user can use to enter a movie review. The web page will then send the review off to our deployed model which will predict the sentiment of the entered review.

Instructions

Some template code has already been provided for you, and you will need to implement additional functionality to successfully complete this notebook. You will not need to modify the included code beyond what is requested. Sections that begin with 'TODO' in the header indicate that you need to complete or implement some portion within them. Instructions will be provided for each section and the specifics of the implementation are marked in the code block with a # TODO: ... comment. Please be sure to read the instructions carefully!

In addition to implementing code, there will be questions for you to answer which relate to the task and your implementation. Each section where you will answer a question is preceded by a 'Question:' header. Carefully read each question and provide your answer below the 'Answer:' header by editing the Markdown cell.

Note: Code and Markdown cells can be executed using the Shift+Enter keyboard shortcut. In addition, a cell can be edited by typically clicking it (double-click for Markdown cells) or by pressing Enter while it is highlighted.

General Outline

Recall the general outline for SageMaker projects using a notebook instance.

1. Download or otherwise retrieve the data.
2. Process / Prepare the data.
3. Upload the processed data to S3.
4. Train a chosen model.
5. Test the trained model (typically using a batch transform job).
6. Deploy the trained model.
7. Use the deployed model.

For this project, you will be following the steps in the general outline with some modifications.

First, you will not be testing the model in its own step. You will still be testing the model, however, you will do it by deploying your model and then using the deployed model by sending the test data to it. One of the reasons for doing this is so that you can make sure that your deployed model is working correctly before moving forward.

In addition, you will deploy and use your trained model a second time. In the second iteration you will customize the way that your trained model is deployed by including some of your own code. In addition, your newly deployed model will be used in the sentiment analysis web app.

Step 1: Downloading the data

As in the XGBoost in SageMaker notebook, we will be using the IMDb dataset

Maas, Andrew L., et al. Learning Word Vectors for Sentiment Analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 2011.

%mkdir ../data
!wget -O ../data/aclImdb_v1.tar.gz http://ai.stanford.edu/~amaas/data/sentiment/aclImdb_v1.tar.gz
!tar -zxf ../data/aclImdb_v1.tar.gz -C ../data

mkdir: cannot create directory ‘../data’: File exists
--2020-06-28 05:57:03--  http://ai.stanford.edu/~amaas/data/sentiment/aclImdb_v1.tar.gz
Resolving ai.stanford.edu (ai.stanford.edu)... 171.64.68.10
Connecting to ai.stanford.edu (ai.stanford.edu)|171.64.68.10|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 84125825 (80M) [application/x-gzip]
Saving to: ‘../data/aclImdb_v1.tar.gz’

../data/aclImdb_v1. 100%[===================>]  80.23M  5.99MB/s    in 19s     

2020-06-28 05:57:23 (4.24 MB/s) - ‘../data/aclImdb_v1.tar.gz’ saved [84125825/84125825]

Step 2: Preparing and Processing the data

Also, as in the XGBoost notebook, we will be doing some initial data processing. The first few steps are the same as in the XGBoost example. To begin with, we will read in each of the reviews and combine them into a single input structure. Then, we will split the dataset into a training set and a testing set.

import sys
import os
import glob

def read_imdb_data(data_dir='../data/aclImdb'):
    data = {}
    labels = {}
    
    for data_type in ['train', 'test']:
        data[data_type] = {}
        labels[data_type] = {}
        
        for sentiment in ['pos', 'neg']:
            data[data_type][sentiment] = []
            labels[data_type][sentiment] = []
            
            path = os.path.join(data_dir, data_type, sentiment, '*.txt')
            files = glob.glob(path)
            
            for f in files:
                with open(f) as review:
                    data[data_type][sentiment].append(review.read())
                    # Here we represent a positive review by '1' and a negative review by '0'
                    labels[data_type][sentiment].append(1 if sentiment == 'pos' else 0)
                    
            assert len(data[data_type][sentiment]) == len(labels[data_type][sentiment]), \
                    "{}/{} data size does not match labels size".format(data_type, sentiment)
                
    return data, labels

data, labels = read_imdb_data()
print("IMDB reviews: train = {} pos / {} neg, test = {} pos / {} neg".format(
            len(data['train']['pos']), len(data['train']['neg']),
            len(data['test']['pos']), len(data['test']['neg'])))

IMDB reviews: train = 12500 pos / 12500 neg, test = 12500 pos / 12500 neg

Now that we've read the raw training and testing data from the downloaded dataset, we will combine the positive and negative reviews and shuffle the resulting records.

from sklearn.utils import shuffle

def prepare_imdb_data(data, labels):
    """Prepare training and test sets from IMDb movie reviews."""
    
    #Combine positive and negative reviews and labels
    data_train = data['train']['pos'] + data['train']['neg']
    data_test = data['test']['pos'] + data['test']['neg']
    labels_train = labels['train']['pos'] + labels['train']['neg']
    labels_test = labels['test']['pos'] + labels['test']['neg']
    
    #Shuffle reviews and corresponding labels within training and test sets
    data_train, labels_train = shuffle(data_train, labels_train)
    data_test, labels_test = shuffle(data_test, labels_test)
    
    # Return a unified training data, test data, training labels, test labets
    return data_train, data_test, labels_train, labels_test

train_X, test_X, train_y, test_y = prepare_imdb_data(data, labels)
print("IMDb reviews (combined): train = {}, test = {}".format(len(train_X), len(test_X)))

IMDb reviews (combined): train = 25000, test = 25000

Now that we have our training and testing sets unified and prepared, we should do a quick check and see an example of the data our model will be trained on. This is generally a good idea as it allows you to see how each of the further processing steps affects the reviews and it also ensures that the data has been loaded correctly.

print(train_X[80])
print(train_y[80])

What this movie fails from answering is how wrong this war is (and most US wars recently made only to get some oil).<br /><br />How many innocent civilian casualties there has been, how many lives perished and how blatantly stupid the perpetrators are.<br /><br />So, let me ask you - if American soldier kills women and children apart from enemy, its OK, but if government accidentally kills their own forces by deadly chemicals while killing many civilians as well, it is not? Your logic fails, gentleman.<br /><br />I'll give it 5 for the solid performance and 1 to everything else, 3 in total.
0

The first step in processing the reviews is to make sure that any html tags that appear should be removed. In addition we wish to tokenize our input, that way words such as entertained and entertaining are considered the same with regard to sentiment analysis.

import nltk
from nltk.corpus import stopwords
from nltk.stem.porter import *

import re
from bs4 import BeautifulSoup

def review_to_words(review):
    nltk.download("stopwords", quiet=True)
    stemmer = PorterStemmer()
    
    text = BeautifulSoup(review, "html.parser").get_text() # Remove HTML tags
    text = re.sub(r"[^a-zA-Z0-9]", " ", text.lower()) # Convert to lower case
    words = text.split() # Split string into words
    words = [w for w in words if w not in stopwords.words("english")] # Remove stopwords
    words = [PorterStemmer().stem(w) for w in words] # stem
    
    return words

The review_to_words method defined above uses BeautifulSoup to remove any html tags that appear and uses the nltk package to tokenize the reviews. As a check to ensure we know how everything is working, try applying review_to_words to one of the reviews in the training set.

# TODO: Apply review_to_words to a review (train_X[100] or any other review)
review_to_words(train_X[80])

['movi',
 'fail',
 'answer',
 'wrong',
 'war',
 'us',
 'war',
 'recent',
 'made',
 'get',
 'oil',
 'mani',
 'innoc',
 'civilian',
 'casualti',
 'mani',
 'live',
 'perish',
 'blatantli',
 'stupid',
 'perpetr',
 'let',
 'ask',
 'american',
 'soldier',
 'kill',
 'women',
 'children',
 'apart',
 'enemi',
 'ok',
 'govern',
 'accident',
 'kill',
 'forc',
 'deadli',
 'chemic',
 'kill',
 'mani',
 'civilian',
 'well',
 'logic',
 'fail',
 'gentleman',
 'give',
 '5',
 'solid',
 'perform',
 '1',
 'everyth',
 'els',
 '3',
 'total']

Question: Above we mentioned that review_to_words method removes html formatting and allows us to tokenize the words found in a review, for example, converting entertained and entertaining into entertain so that they are treated as though they are the same word. What else, if anything, does this method do to the input?

Answer: The method converts the text to lower case, splits the string into words and removes stop words from the words.

The method below applies the review_to_words method to each of the reviews in the training and testing datasets. In addition it caches the results. This is because performing this processing step can take a long time. This way if you are unable to complete the notebook in the current session, you can come back without needing to process the data a second time.

import pickle

cache_dir = os.path.join("../cache", "sentiment_analysis")  # where to store cache files
os.makedirs(cache_dir, exist_ok=True)  # ensure cache directory exists

def preprocess_data(data_train, data_test, labels_train, labels_test,
                    cache_dir=cache_dir, cache_file="preprocessed_data.pkl"):
    """Convert each review to words; read from cache if available."""

    # If cache_file is not None, try to read from it first
    cache_data = None
    if cache_file is not None:
        try:
            with open(os.path.join(cache_dir, cache_file), "rb") as f:
                cache_data = pickle.load(f)
            print("Read preprocessed data from cache file:", cache_file)
        except:
            pass  # unable to read from cache, but that's okay
    
    # If cache is missing, then do the heavy lifting
    if cache_data is None:
        # Preprocess training and test data to obtain words for each review
        #words_train = list(map(review_to_words, data_train))
        #words_test = list(map(review_to_words, data_test))
        words_train = [review_to_words(review) for review in data_train]
        words_test = [review_to_words(review) for review in data_test]
        
        # Write to cache file for future runs
        if cache_file is not None:
            cache_data = dict(words_train=words_train, words_test=words_test,
                              labels_train=labels_train, labels_test=labels_test)
            with open(os.path.join(cache_dir, cache_file), "wb") as f:
                pickle.dump(cache_data, f)
            print("Wrote preprocessed data to cache file:", cache_file)
    else:
        # Unpack data loaded from cache file
        words_train, words_test, labels_train, labels_test = (cache_data['words_train'],
                cache_data['words_test'], cache_data['labels_train'], cache_data['labels_test'])
    
    return words_train, words_test, labels_train, labels_test

# Preprocess data
train_X, test_X, train_y, test_y = preprocess_data(train_X, test_X, train_y, test_y)

Read preprocessed data from cache file: preprocessed_data.pkl

Transform the data

In the XGBoost notebook we transformed the data from its word representation to a bag-of-words feature representation. For the model we are going to construct in this notebook we will construct a feature representation which is very similar. To start, we will represent each word as an integer. Of course, some of the words that appear in the reviews occur very infrequently and so likely don't contain much information for the purposes of sentiment analysis. The way we will deal with this problem is that we will fix the size of our working vocabulary and we will only include the words that appear most frequently. We will then combine all of the infrequent words into a single category and, in our case, we will label it as 1.

Since we will be using a recurrent neural network, it will be convenient if the length of each review is the same. To do this, we will fix a size for our reviews and then pad short reviews with the category 'no word' (which we will label 0) and truncate long reviews.

(TODO) Create a word dictionary

To begin with, we need to construct a way to map words that appear in the reviews to integers. Here we fix the size of our vocabulary (including the 'no word' and 'infrequent' categories) to be 5000 but you may wish to change this to see how it affects the model.

TODO: Complete the implementation for the build_dict() method below. Note that even though the vocab_size is set to 5000, we only want to construct a mapping for the most frequently appearing 4998 words. This is because we want to reserve the special labels 0 for 'no word' and 1 for 'infrequent word'.

import numpy as np
from collections import Counter

def build_dict(data, vocab_size = 5000):
    """Construct and return a dictionary mapping each of the most frequently appearing words to a unique integer."""
    
    # TODO: Determine how often each word appears in `data`. Note that `data` is a list of sentences and that a
    #       sentence is a list of words.
    
    total_words = [word for movie_review in data for word in movie_review]
    
    count_of_words=[]
    
            
    word_count = dict(Counter(total_words)) # A dict storing the words that appear in the reviews along with how often they occur
    
    print(word_count)
    # TODO: Sort the words found in `data` so that sorted_words[0] is the most frequently appearing word and
    #       sorted_words[-1] is the least frequently appearing word.
    
    word_sort = sorted(Counter(total_words), key=Counter(total_words).get, reverse=True)
    
    word_dict = {} # This is what we are building, a dictionary that translates words into integers
    for idx, word in enumerate(word_sort[:vocab_size - 2]): # The -2 is so that we save room for the 'no word'
        word_dict[word] = idx + 2                              # 'infrequent' labels
        
    return word_dict

word_dict = build_dict(train_X)
#print(word_dict)
list(word_dict)[:5]

{'look': 10051, 'sonic': 13, 'boom': 102, 'special': 2258, 'effect': 3581, 'monster': 932, 'click': 82, 'back': 5133, 'button': 138, 'browser': 1, 'deathtrap': 46, 'written': 1616, 'ira': 53, 'levin': 38, 'sliver': 7, 'stepford': 9, 'wive': 105, 'rosemari': 74, 'babi': 770, 'stage': 935, 'play': 8730, 'adapt': 835, 'screen': 2799, '95': 69, 'movi': 51695, 'take': 6654, 'place': 3048, 'gorgeou': 368, 'home': 1957, 'playwright': 59, 'sidney': 180, 'bruhl': 12, 'michael': 1370, 'cain': 266, 'author': 494, 'fabul': 187, 'success': 1344, 'broadway': 243, 'last': 3158, '4': 1372, 'effort': 1047, 'flop': 152, 'horribl': 1418, 'aspir': 159, 'clifford': 23, 'anderson': 225, 'christoph': 424, 'reev': 133, 'attend': 279, 'write': 2096, 'workshop': 11, 'given': 1849, 'sydney': 57, 'sent': 395, 'copi': 741, 'tell': 3215, 'wife': 2140, 'myra': 42, 'dyan': 17, 'cannon': 91, 'sure': 3100, 'fire': 879, 'hit': 1497, 'good': 15360, 'enough': 3452, 'die': 2012, 'time': 16191, 'clever': 561, 'dialog': 915, 'numer': 274, 'twist': 1268, 'turn': 3880, 'plot': 6967, 'keep': 2520, 'entertain': 2827, 'begin': 2905, 'end': 9651, 'whole': 3080, 'cast': 4573, 'seem': 7220, 'reminisc': 214, 'anoth': 4325, 'fun': 2694, 'mysteri': 1416, 'sleuth': 45, 'worth': 2280, 'watch': 13940, 'rock': 1058, 'star': 4447, 'inx': 10, 'best': 6424, 'music': 4247, 'tv': 2786, 'seri': 3420, 'ever': 5999, 'greatest': 745, 'n': 331, 'roll': 666, 'song': 1916, 'perform': 5528, '15': 525, 'talent': 1787, 'singer': 353, 'also': 9156, 'opinion': 1056, 'heart': 1688, 'felt': 1528, 'feel': 5300, 'surpris': 2021, 'realiti': 1050, 'actual': 5065, 'made': 8362, 'shed': 100, 'tear': 506, 'happi': 1151, 'winner': 271, '13': 263, 'week': 662, 'televis': 932, 'competit': 164, 'view': 2193, 'audienc': 2675, 'got': 3583, 'know': 7514, 'becam': 697, 'familiar': 572, 'contest': 200, '30': 702, 'episod': 2629, 'remain': 846, 'like': 22799, 'friend': 3230, 'stranger': 236, 'compet': 294, 'show': 9878, 'fact': 3749, 'still': 5664, 'one': 27741, 'band': 627, 'ad': 788, 'emot': 1731, 'tension': 574, 'creat': 1683, 'wonder': 3639, 'record': 576, 'dvd': 2410, 'great': 9171, 'altern': 247, 'rememb': 2070, 'prime': 213, '7': 904, 'year': 6874, 'old': 4583, 'huge': 1006, 'comic': 1230, 'book': 2935, 'reader': 139, 'anyth': 2949, 'relat': 737, 'superhero': 139, 'anticip': 175, 'heavili': 180, 'result': 1052, 'howev': 3537, 'underwhelm': 32, 'awar': 326, 'emma': 203, 'peel': 29, 'diana': 101, 'princ': 317, 'stori': 13168, 'recent': 1089, 'come': 6747, 'return': 1174, 'amazonian': 4, 'form': 957, 'littl': 6435, 'action': 3694, 'bore': 2549, 'throughout': 1360, 'final': 3153, 'costum': 689, 'interest': 4893, 'idea': 2638, 'cheerlead': 31, 'saw': 3178, 'late': 1309, 'teen': 537, 'improv': 371, 'much': 9765, 'cathi': 36, 'lee': 817, 'crosbi': 61, 'thank': 1146, 'incred': 1194, 'act': 8794, 'better': 5749, 'script': 3342, 'rogu': 45, 'amazon': 77, 'decent': 1178, 'villain': 927, 'ricardo': 24, 'montalban': 9, 'togeth': 2247, 'think': 8913, 'built': 236, 'epic': 371, 'climax': 448, 'bland': 334, 'spi': 291, 'film': 48190, 'cross': 494, 'someon': 2363, 'never': 6484, 'seen': 6681, 'element': 1176, 'intrigu': 550, 'need': 3378, 'expand': 92, 'succeed': 283, 'forc': 1534, 'produc': 1870, 'go': 9305, 'draw': 471, 'board': 330, 'someth': 5122, 'faith': 514, 'bit': 3348, 'camp': 546, 'low': 1870, 'budget': 1933, 'pretti': 3665, 'cheap': 903, 'would': 12436, 'nice': 2312, 'avail': 419, 'comparison': 320, 'histor': 569, 'document': 144, 'even': 12906, 'superman': 311, 'noth': 4296, 'except': 1854, 'chri': 421, 'gene': 282, 'hackman': 62, 'see': 14111, 'curios': 124, 'sake': 255, 'inspir': 811, 'caution': 43, 'futur': 912, 'version': 2410, 'reason': 3206, 'came': 1673, 'across': 971, 'miss': 2160, 'marker': 20, 'recommend': 2290, 'although': 2537, 'well': 11042, 'known': 1081, 'gari': 272, 'cooper': 201, 'carol': 177, 'lombard': 33, 'con': 267, 'man': 6036, 'companion': 137, 'start': 4166, 'quit': 3841, 'light': 1555, 'becom': 3272, 'dramat': 799, 'coop': 44, 'first': 9062, 'plan': 850, 'use': 5123, 'daughter': 1312, 'extort': 15, 'sizabl': 12, 'amount': 597, 'cash': 258, 'brother': 1664, 'law': 609, 'upon': 859, 'meet': 1608, 'girl': 4064, 'disciplin': 56, 'subject': 938, 'elect': 135, 'troubl': 769, 'stay': 1260, 'straight': 869, 'narrow': 73, 'path': 247, 'drama': 1552, 'develop': 1595, 'shirley': 103, 'manag': 1529, 'steal': 603, 'scene': 10586, 'along': 1777, 'gundam0079': 1, 'trilog': 222, 'us': 3794, 'lot': 4778, 'sheer': 247, 'less': 2003, 'els': 2002, 'ova': 14, 'kinda': 275, 'opposit': 323, 'though': 4566, 'half': 2094, 'dozen': 299, 'fill': 917, 'thing': 8213, 'two': 6908, 'main': 2283, 'sequenc': 1609, 'believ': 3917, 'satisfi': 416, 'mani': 6688, 'gundam': 104, 'complet': 3035, 'readi': 341, 'civilian': 60, 'esquir': 58, 'fantast': 855, 'job': 2461, 'make': 15207, 'stand': 1463, 'side': 1490, 'war': 2394, 'bad': 9344, 'peopl': 9391, 'zeon': 8, 'human': 2262, 'rather': 2733, 'origin': 4044, 'depict': 663, 'second': 2309, 'rise': 403, 'evil': 1468, 'nazi': 304, 'anim': 2483, 'lol': 104, 'anti': 480, 'fan': 3370, 'read': 2762, 'alreadi': 1381, 'right': 3554, 'explain': 1042, 'alia': 23, 'comment': 1687, 'let': 2821, 'say': 7457, 'desert': 351, 'trail': 109, 'standard': 808, 'western': 798, 'stare': 209, 'three': 2297, 'stoog': 126, 'featur': 1903, 'carmen': 63, 'laroux': 1, 'semi': 211, 'juanita': 8, 'hear': 1050, 'mexican': 193, 'accent': 704, 'immedi': 542, 'recogn': 351, 'senorita': 3, 'rita': 80, 'classic': 2159, 'short': 2020, 'save': 1731, 'bell': 186, 'john': 2222, 'wayn': 243, 'get': 14141, 'moe': 65, 'howard': 260, 'charact': 14178, 'eddi': 347, 'chandler': 46, 'curli': 76, 'counterpart': 76, 'run': 2723, 'gag': 413, '53': 13, 'minut': 3739, 'skirt': 46, 'chase': 824, 'bulli': 161, 'endear': 158, 'suppos': 1924, 'guy': 4339, 'travel': 577, 'rodeo': 16, 'cowboy': 243, 'hold': 1054, 'box': 813, 'offic': 975, 'gunpoint': 18, 'prize': 124, 'money': 2370, 'proce': 88, 'rider': 99, 'settl': 200, '25': 202, 'cent': 90, 'dollar': 369, 'rob': 356, 'explan': 327, 'rip': 576, 'consid': 1585, 'hero': 1389, 'complic': 279, 'point': 4238, 'al': 379, 'ferguson': 12, 'sidekick': 127, 'larri': 183, 'fine': 1366, 'paul': 898, 'fix': 168, 'sheriff': 248, 'micah': 2, 'rifleman': 2, 'remaind': 48, 'kill': 3701, 'blame': 394, 'move': 2434, 'town': 1328, 'away': 2782, 'chang': 2062, 'name': 2917, 'smith': 496, 'jone': 408, 'whose': 986, 'sister': 1025, '2nd': 109, 'love': 9027, 'left': 2125, 'behind': 1280, 'appear': 2567, 'radiantli': 4, 'beauti': 3292, 'mari': 823, 'kornman': 8, 'grown': 252, 'younger': 504, 'day': 4013, 'member': 879, 'hal': 104, 'roach': 45, 'gang': 466, 'mega': 44, 'lame': 758, 'other': 1598, 'product': 2283, 'entir': 1993, 'differ': 3007, 'crew': 584, '1935': 34, 'extrem': 1473, 'weak': 908, 'technic': 513, 'staggeringli': 12, 'stock': 283, 'footag': 656, 'wide': 368, 'shot': 2998, 'fall': 2004, 'hors': 445, 'editor': 144, 'cut': 1520, 'ground': 459, 'frame': 430, 'cloth': 497, 'stunt': 286, 'liber': 222, 'none': 1032, 'remot': 359, 'convinc': 1012, 'midway': 27, 'ride': 630, 'cabin': 180, 'poss': 25, 'gallop': 12, 'toward': 922, 'cameraman': 52, 'follow': 2292, 'slow': 1207, 'pan': 189, 'whip': 113, 'reveal': 751, 'approach': 552, 'outsid': 653, 'stupid': 1888, 'director': 5120, 'manner': 575, 'leav': 2272, 'reposit': 1, 'camera': 1888, 'separ': 287, 'creativ': 474, 'foreground': 30, 'background': 719, 'child': 1324, 'receiv': 532, 'gift': 249, 'knew': 897, 'cover': 927, 'pathet': 490, 'almost': 3139, 'finish': 809, 'unfair': 81, 'review': 2184, 'without': 3268, 'trust': 382, 'suck': 750, 'truli': 1743, 'shock': 979, 'filmmak': 959, 'wane': 23, 'bee': 47, 'financ': 77, 'cost': 457, '20': 726, '000': 301, 'camcord': 71, 'cell': 222, 'phone': 401, 'skill': 549, 'scrip': 3, 'coupl': 1894, 'drunk': 311, 'fist': 131, 'part': 5247, 'ultra': 140, 'report': 452, 'tara': 65, 'woodley': 1, 'way': 8830, 'hunt': 422, 'unharm': 17, 'went': 1463, 'abandon': 288, 'hous': 2328, 'luckili': 130, 'furnish': 24, 'bottl': 113, 'liquor': 31, 'door': 557, 'step': 584, 'happen': 3624, 'ghost': 666, 'zombi': 1331, 'must': 3250, 'worst': 2731, 'histori': 1338, 'storysgt': 1, 'ben': 619, 'draper': 8, 'soldier': 773, 'exhaust': 80, 'poor': 1899, 'privat': 293, 'wilson': 200, 'sit': 1263, 'up': 277, 'dig': 216, 'grave': 228, 'collaps': 108, 'draperburi': 1, 'shallow': 273, 'sgt': 59, 'big': 3477, 'fiend': 51, 'lover': 688, 'reveng': 555, 'next': 1716, 'sort': 1684, 'murder': 2102, 'wake': 266, 'behalf': 35, 'b': 1306, 'horror': 3717, 'pre': 316, 'runner': 80, 'escap': 889, 'later': 2202, 'smash': 132, 'british': 901, 'thrill': 463, 'dare': 306, 'overkil': 21, 'set': 4116, 'subsequ': 167, 'protagonist': 384, 'whilst': 280, 'concentr': 190, 'surviv': 626, 'tri': 6357, 'reach': 558, 'sweden': 50, 'reli': 262, 'pure': 733, 'simpl': 1023, 'ye': 1551, 'dialogu': 1652, 'carri': 940, 'thru': 97, 'achiev': 578, 'aim': 325, 'handsom': 237, 'suspens': 1009, 'tick': 72, 'adventur': 773, 'work': 7101, 'perfectli': 637, 'adher': 26, 'thumb': 182, 'may': 3392, 'type': 1408, '10': 4289, 'jare': 64, 'diamond': 153, 'world': 3979, 'domest': 108, 'european': 340, 'account': 297, 'abl': 1259, 'steel': 169, 'invent': 328, 'complex': 548, 'machin': 464, 'third': 776, 'south': 472, 'africa': 212, 'far': 2978, 'north': 213, 'ran': 239, 'zulu': 13, 'tribe': 107, 'herd': 60, 'cattl': 75, 'plant': 171, 'crop': 54, 'lack': 1821, 'technolog': 290, 'econom': 91, 'artist': 897, 'key': 501, 'claim': 595, 'germ': 23, 'smallpox': 5, 'brought': 737, 'america': 738, 'black': 2123, 'slave': 174, 'biggest': 515, 'weapon': 316, '150': 32, 'defeat': 219, 'nativ': 305, 'warrior': 202, '400': 35, 'non': 898, 'militari': 464, 'african': 284, 'singl': 950, 'casualti': 28, 'either': 1866, 'case': 1706, 'conclud': 151, 'irrelev': 90, 'malaria': 8, 'stop': 1543, 'colon': 13, 'thousand': 298, 'affect': 428, 'real': 4741, 'number': 1413, 'today': 1282, 'catch': 647, 'help': 2828, 'halt': 42, 'eurpean': 1, 'hurt': 514, 'europ': 216, 'okay': 706, 'despit': 1364, 'massiv': 210, 'plagu': 206, 'eager': 99, 'dumb': 660, 'luck': 269, 'evid': 426, 'threaten': 290, 'overwhelm': 172, 'ricketi': 7, 'theori': 248, 'reluct': 82, 'admit': 738, 'mayb': 2340, 'sad': 1108, 'obviou': 1066, 'neo': 112, 'marxist': 24, 'contort': 10, 'prove': 937, '370': 1, 'air': 842, 'italian': 563, 'public': 664, 'earli': 1605, 'seventi': 129, 'myth': 91, 'attribut': 88, 'homer': 108, 'journey': 460, 'odysseu': 13, 'troy': 29, 'ancient': 237, 'minoan': 1, 'mycenaean': 1, 'civil': 273, 'told': 1063, 'list': 796, '500': 41, 'event': 1293, 'toke': 3, 'around': 3616, '1100': 4, 'bc': 19, '1969': 73, 'buy': 1007, 'find': 5449, 'sound': 2228, 'mono': 15, 'languag': 566, 'close': 1744, 'caption': 26, 'piti': 328, 'enjoy': 4353, 'masterpiec': 696, 'english': 987, 'subtitl': 248, 'problem': 2337, 'strongli': 222, 'comedi': 3686, 'sometim': 1281, 'wish': 1303, 'stack': 102, 'bill': 799, 'memori': 607, 'hunger': 30, 'disappear': 355, 'duo': 124, 'post': 600, 'credit': 1295, 'chuckl': 150, 'accomplish': 271, 'confus': 959, 'instead': 2190, 'random': 373, 'assort': 62, 'nois': 214, 'scream': 690, 'sequel': 1042, 'realli': 11736, 'necessari': 324, 'funni': 4288, 'turtl': 62, 'crawl': 84, 'trailer': 479, 'said': 2196, 'promot': 259, 'oh': 1450, 'market': 348, 'guess': 1565, 'rental': 228, 'store': 595, 'might': 2919, 'want': 6640, 'wear': 678, 'shade': 113, '1948': 52, 'favorit': 1421, 'betti': 254, 'grabl': 25, 'ravish': 43, 'grow': 659, 'dress': 636, 'dougla': 315, 'fairbank': 56, 'jr': 302, 'irresist': 44, 'dash': 125, 'hungarian': 37, 'silli': 965, 'fluffi': 30, 'eight': 222, 'import': 1103, 'men': 1915, 'women': 1827, 'give': 5792, 'awesom': 510, 'anymor': 333, 'femal': 1022, 'regret': 256, 'sinc': 2906, 'brian': 352, 'p': 350, 'nearli': 815, 'mean': 2961, 'serious': 1042, 'wrong': 1872, 'stroke': 84, 'folk': 462, 'goe': 2441, 'bonker': 16, 'insan': 339, 'could': 7921, 'count': 507, 'finger': 185, 'hey': 409, 'alway': 3243, 'toe': 65, 'usual': 1946, 'check': 1011, 'mtv': 86, 'award': 712, 'witti': 279, 'deliv': 1021, 'uniqu': 687, 'chewbacca': 17, 'win': 1008, 'life': 6640, 'exampl': 1554, 'justin': 100, 'timberlak': 68, 'seann': 14, 'william': 940, 'scott': 587, 'albiet': 4, 'laugh': 2926, 'stiffler': 4, 'american': 2618, 'pie': 154, 'dude': 207, 'car': 1505, 'simpli': 1965, 'coherr': 1, 'humor': 1592, 'stick': 650, 'sing': 939, 'danc': 1405, 'hell': 1032, 'curiou': 262, 'writer': 1814, 'jack': 945, 'sarah': 192, 'michel': 237, 'gellar': 30, 'extremli': 2, 'lord': 376, 'ring': 525, 'parodi': 317, 'alon': 1066, 'completli': 4, 'anyon': 2632, 'understand': 2132, 'regard': 477, 'luke': 259, 'kate': 301, 'hudson': 141, 'met': 289, 'joke': 1656, 'refer': 687, 'wast': 2229, 'caus': 1044, 'smile': 459, 'yet': 2753, 'harrison': 68, 'ford': 305, 'liner': 249, 'sens': 2416, 'perhap': 1681, 'figur': 1190, 'young': 3664, 'viewer': 2047, 'age': 1726, 'han': 84, 'solo': 108, 'indiania': 1, 'presid': 283, 'baffl': 73, 'deal': 1260, 'adrian': 55, 'brodi': 39, '19': 72, 'class': 1012, 'actor': 6876, 'academi': 298, 'speech': 264, '1': 2213, 'gollam': 1, 'visual': 1058, 'done': 3096, 'genuin': 511, 'free': 717, 'similar': 996, 'expect': 3007, 'per': 161, 'se': 52, 'pay': 924, 'tale': 956, 'betray': 187, 'lie': 632, 'sex': 1726, 'scandal': 69, 'everyth': 2323, 'definit': 1856, 'hollywood': 1920, 'blockbust': 235, 'probabl': 2874, 'nutshel': 47, 'kind': 3008, 'night': 2293, 'local': 1035, 'station': 379, 'sunday': 195, 'afternoon': 197, 'clich': 1047, 'line': 3458, 'sub': 387, 'par': 229, 'desir': 500, 'pretend': 267, 'pop': 524, 'player': 586, 'wors': 1468, 'averag': 730, 'found': 2608, 'fbi': 153, 'consider': 235, 'suitabl': 163, 'upbeat': 43, 'new': 4315, 'holiday': 180, 'pack': 386, 'hardesti': 11, 'drawn': 428, 'admir': 440, 'overal': 1434, 'photographi': 406, 'direct': 3794, 'repugn': 20, 'piec': 1981, 'propaganda': 203, 'mount': 70, 'portray': 1902, 'necess': 56, 'ingeni': 76, 'mind': 2354, 'brave': 227, 'bodi': 1199, 'fight': 2040, 'crime': 896, 'famili': 3454, 'strain': 105, 'husband': 1105, 'commit': 490, 'arguabl': 95, 'twee': 6, 'represent': 84, 'ideal': 209, 'exemplari': 15, 'swashbuckl': 35, 'danish': 69, 'yesterday': 119, 'gina': 73, 'lollobrigida': 14, 'disappoint': 1900, 'gotten': 286, 'impress': 1472, 'absurd': 403, 'unlik': 934, 'philipp': 37, 'de': 792, 'broca': 1, 'sadli': 575, 'predict': 1095, 'apart': 995, 'remark': 570, 'topic': 238, 'dimension': 267, 'strang': 1114, 'mechan': 181, 'uninspir': 161, 'fashion': 550, 'kept': 750, 'quickli': 639, 'sat': 290, 'wait': 1400, 'synth': 13, 'david': 1025, 'hasselhoff': 22, '80': 899, 'vengeanc': 94, 'witcheri': 14, 'co': 645, 'helm': 68, 'infam': 153, 'joe': 692, 'amato': 23, 'career': 1116, 'heaven': 355, 'small': 1648, 'miracl': 127, 'fabrizio': 4, 'laurenti': 3, 'sam': 457, 'raimi': 29, 'dead': 1883, 'itali': 153, 'dub': 480, 'la': 614, 'casa': 20, 'modest': 62, 'gore': 1055, 'groceri': 31, 'mix': 755, 'possess': 320, 'witchcraft': 60, 'bounc': 73, 'clueless': 73, 'wooden': 332, 'hilari': 1090, 'progress': 365, 'top': 1957, 'seriou': 989, 'wtf': 64, 'face': 2292, 'surprisingli': 466, 'gather': 190, 'malic': 14, 'unluckili': 3, 'glimps': 214, 'mild': 133, 'magic': 708, 'plu': 645, 'experienc': 249, 'depart': 277, 'latex': 13, 'red': 837, 'paint': 549, 'style': 1760, 'italo': 3, '100': 462, 'hand': 2221, 'shockingli': 53, 'vivid': 112, 'allow': 1026, 'sadist': 138, 'glee': 34, 'laughter': 247, 'obnoxi': 178, 'mangl': 21, 'misus': 31, 'sorri': 771, 'linda': 105, 'blair': 168, 'appar': 1226, 'woman': 2838, 'role': 4300, 'filmographi': 48, 'spend': 828, 'raini': 58, 'experi': 1548, 'least': 3112, 'rotten': 96, 'pound': 158, 'beat': 619, 'euro': 47, 'speak': 1129, 'everi': 3977, 'skewer': 15, 'sizeabl': 2, 'metal': 199, 'object': 368, 'bleed': 96, 'room': 1050, 'corridor': 59, 'truth': 805, 'realis': 279, 'especi': 2539, 'cult': 502, 'luminari': 5, 'jess': 203, 'franco': 98, 'gone': 754, 'overboard': 55, 'surreal': 242, 'atmospher': 901, 'reput': 219, 'succubu': 14, 'unfortun': 1562, 'aw': 1861, '76': 23, 'unless': 675, 'logic': 394, 'longer': 477, 'maraud': 5, 'practic': 467, 'talk': 2159, 'rubbish': 276, 'dull': 836, 'runtim': 32, 'taken': 986, 'difficulti': 148, 'locat': 711, 'posit': 858, 'trash': 556, 'skip': 392, 'almereyda': 2, 'nadja': 2, 'absolut': 1845, 'dreck': 81, 'asid': 486, 'moment': 2784, 'cinematographi': 983, 'nonstop': 20, 'materi': 827, 'harri': 730, 'particularli': 1079, 'haha': 32, 'forgiv': 255, 'pleas': 1253, 'eras': 54, 'hour': 2164, 'planet': 534, 'everyon': 2228, 'long': 3540, 'talki': 103, 'flat': 594, 'opaqu': 11, 'cusack': 141, 'eponym': 33, 'hotel': 412, 'engag': 578, 'answer': 626, 'mental': 542, 'breakdown': 65, 'depth': 570, 'freak': 285, 'thorough': 19, 'rework': 42, 'everyday': 167, 'bake': 81, 'theme': 1292, 'loss': 298, 'tack': 66, 'choic': 699, 'psycholog': 372, 'fulli': 426, 'embrac': 106, 'dunno': 24, 'buff': 200, 'disquiet': 5, 'ledg': 3, 'alarm': 86, 'crazi': 699, 'ladi': 1145, 'hammer': 152, 'crypt': 42, 'keeper': 41, 'duct': 10, 'five': 938, 'shine': 394, 'power': 1957, 'stephen': 342, 'king': 1036, 'reduc': 162, 'wow': 444, 'luci': 162, 'fulci': 114, 'bruno': 60, 'matti': 3, 'live': 4477, 'lucio': 33, 'ill': 400, 'took': 1100, 'witch': 423, 'equal': 642, 'fli': 695, 'head': 2075, 'bird': 229, 'spit': 113, 'acid': 102, 'hap': 9, 'mainli': 393, 'toxic': 44, 'gener': 2022, 'round': 376, 'applaus': 39, 'order': 1159, 'whoever': 202, 'pictur': 1968, 'latest': 201, 'releas': 1921, 'dupe': 32, 'contrari': 116, 'supernatur': 208, 'thriller': 1046, 'joanna': 34, 'mill': 154, 'person': 3274, 'eleven': 64, 'began': 318, 'haunt': 521, 'vision': 375, 'texa': 212, 'busi': 802, 'trip': 552, 'led': 330, 'hometown': 43, 'sall': 11, 'frequent': 256, 'terri': 132, 'stahl': 19, 'peter': 855, 'brien': 48, 'desper': 608, 'search': 517, 'mention': 1545, 'atroci': 208, 'hideou': 103, 'terribl': 1917, 'matter': 1373, 'choos': 378, 'adam': 409, 'sussman': 1, 'screenplay': 735, 'downright': 188, 'moron': 197, 'compel': 491, 'plain': 584, 'unpleas': 121, 'jumpstart': 5, 'quotat': 9, 'deserv': 1236, 'call': 2792, 'due': 918, 'foul': 117, 'slight': 139, 'chanc': 1204, 'hope': 2529, 'unbear': 146, 'cold': 577, 'freez': 89, 'stellar': 102, 'disast': 356, 'cours': 2520, 'agre': 779, 'assum': 423, 'pride': 158, 'medic': 193, 'attent': 940, 'unmistak': 29, 'crucifi': 15, 'asif': 1, 'kapadia': 7, 'test': 341, 'full': 1783, 'length': 362, 'foot': 285, 'learn': 1375, 'vastli': 62, 'duplic': 32, 'marcu': 41, 'nispel': 1, '2003': 116, 'chainsaw': 78, 'massacr': 166, 'kudo': 128, 'prais': 291, 'worthi': 364, 'jim': 492, 'sonzero': 1, 'puls': 38, 'fork': 26, 'titl': 1793, 'beyond': 866, 'question': 1333, 'imagin': 1547, 'doubt': 887, 'profit': 85, 'surpass': 92, 'parallel': 152, 'fluke': 20, 'previou': 630, 'grudg': 76, 'note': 1027, 'add': 1147, 'honestli': 453, 'embarrass': 528, 'theater': 1057, 'auditorium': 10, 'variou': 603, 'bogdanovich': 41, 'gazzara': 28, 'scatter': 46, 'affair': 419, 'hepburn': 72, 'brief': 403, 'passion': 449, 'earlier': 662, 'particip': 198, 'wider': 52, 'mere': 541, 'ancillari': 4, 'smack': 66, 'smug': 56, 'self': 1185, 'gratif': 14, 'mr': 1708, 'sail': 45, 'clear': 818, 'particular': 737, 'hazard': 21, 'sweet': 623, 'innoc': 609, 'paean': 10, 'altar': 19, 'worship': 76, 'ether': 29, 'mistak': 634, 'conced': 18, 'effacingli': 1, 'detect': 561, 'agenc': 79, 'involv': 1980, 'client': 65, 'minim': 143, 'lead': 2684, 'domin': 276, 'triumph': 151, 'target': 324, 'onward': 33, 'glow': 124, 'coax': 18, 'inanim': 15, 'optic': 19, 'equip': 107, 'benefit': 175, 'extra': 543, 'insight': 322, 'obtain': 102, 'publish': 118, 'collect': 562, 'essay': 47, 'princip': 174, 'uk': 230, 'bookstor': 15, 'soundtrack': 778, 'vari': 131, 'loui': 226, 'armstrong': 64, '1947': 30, 'york': 812, 'hall': 246, 'concert': 165, 'sinatra': 246, 'countri': 1086, 'latin': 97, 'eclect': 17, 'citi': 1283, 'golden': 259, 'boy': 2178, 'imag': 860, 'tarnish': 23, 'natur': 1541, 'restor': 177, 'recognis': 90, 'tour': 182, 'seller': 127, 'tragic': 376, 'misfir': 46, 'pain': 1129, 'dread': 372, 'unwatch': 119, 'snicker': 26, 'buri': 190, 'somewher': 483, 'pile': 247, 'putrid': 29, 'blubber': 10, 'lifeless': 65, 'humorless': 21, 'fluffer': 4, 'strong': 1096, 'porn': 368, 'industri': 447, 'shabbili': 8, 'mediocr': 408, 'grade': 487, 'exceedingli': 31, 'embarass': 10, 'offer': 1057, 'state': 1060, 'art': 1653, 'gay': 649, 'limit': 542, 'festiv': 466, 'circuit': 36, 'death': 2113, 'video': 1866, 'open': 2103, 'queer': 18, 'weekend': 216, 'brisban': 5, 'april': 103, '2002': 131, 'influenc': 367, 'alcohol': 225, 'consum': 106, 'preced': 70, 'cocktail': 45, 'parti': 668, 'gonna': 241, 'aussi': 63, 'rule': 482, 'mat': 33, 'afl': 1, 'trial': 217, 'match': 811, 'pick': 1078, 'cousin': 186, 'hoper': 3, 'drug': 771, 'loan': 29, 'shark': 185, 'dealer': 99, 'tini': 214, 'gangster': 356, 'anywher': 304, 'australian': 223, 'needless': 162, 'enmesh': 8, 'chao': 110, 'thought': 3773, 'tomorrow': 77, 'shunt': 3, 'frantic': 70, 'unravel': 82, 'profession': 437, 'shakespearean': 37, 'tobi': 58, 'malon': 81, 'put': 3132, 'sterl': 50, 'naiv': 228, 'support': 1505, 'batchelor': 3, 'ngoombujarra': 2, 'cop': 934, 'fast': 897, 'pace': 1156, 'often': 1601, 'worthwhil': 187, '60': 486, 'retain': 106, 'abil': 562, 'disturb': 639, 'confront': 287, 'blood': 1245, 'lost': 1555, 'ounc': 33, 'complain': 268, 'truman': 63, 'capot': 64, 'sourc': 264, 'fiction': 698, 'novel': 1130, 'central': 415, 'messag': 966, 'unsubtl': 18, 'true': 2333, 'ambigu': 141, 'detract': 114, 'refresh': 222, 'simplist': 103, 'manipul': 265, 'moral': 662, 'polit': 978, 'voic': 1482, 'unafraid': 8, 'viewpoint': 72, 'honest': 481, 'audac': 14, 'nonetheless': 163, 'disagre': 151, 'capit': 174, 'punish': 172, 'plenti': 655, 'terrif': 455, 'underr': 235, 'chill': 304, 'nihilist': 16, 'leader': 311, 'charisma': 138, 'hide': 419, 'robert': 1095, 'blake': 113, 'submiss': 33, 'conscienc': 77, 'obvious': 1168, 'terrifi': 219, 'there': 9, 'homoerot': 14, 'subtext': 61, 'sleek': 12, 'gritti': 201, 'documentari': 1074, 'score': 1203, 'quincey': 1, '9': 787, 'scienc': 556, '1973': 89, 'comfort': 259, 'rich': 626, '2022': 13, 'remind': 913, 'calcutta': 4, 'appreci': 852, 'charlton': 66, 'heston': 138, 'orson': 96, 'touch': 1284, 'capabl': 284, 'rang': 333, 'heroic': 135, 'torn': 154, 'corrupt': 265, 'rare': 759, 'food': 338, 'treat': 727, 'total': 1948, 'activ': 268, 'condon': 19, 'sweat': 73, 'drip': 85, 'condit': 251, 'famou': 771, 'certainli': 1462, 'foreshadow': 42, 'edward': 233, 'g': 472, 'robinson': 102, 'council': 32, 'elderli': 119, 'jew': 111, 'heavi': 506, 'thanatopsi': 1, 'dystopian': 15, 'hong': 191, 'kong': 271, 'temporari': 35, 'exodu': 7, 'tsui': 38, 'hark': 44, 'woo': 100, 'ringo': 23, 'lam': 32, '90': 635, 'output': 29, 'impact': 401, 'andrew': 298, 'lau': 20, 'alan': 351, 'mak': 4, 'partnership': 25, 'hk': 74, 'cinemat': 428, 'infern': 15, 'remad': 70, 'martin': 378, 'scorses': 71, 'knock': 308, 'fellow': 405, 'collabor': 114, 'duti': 155, 'fare': 241, 'bauer': 49, 'craig': 123, 'mitchel': 127, 'x': 328, 'file': 144, 'craft': 306, 'carter': 151, 'richard': 937, 'gere': 71, 'clair': 196, 'dane': 149, 'pair': 345, 'ala': 208, 'duchovni': 46, 'gillian': 73, 'belong': 286, 'feder': 54, 'investig': 451, 'bear': 445, 'arm': 425, 'employe': 94, 'protect': 314, 'servic': 286, 'chief': 237, 'ensur': 99, 'sexual': 1000, 'predat': 87, 'jurisdict': 8, 'safe': 275, 'societi': 707, 'serv': 615, 'henc': 155, 'shepherd': 67, 'tend': 353, 'flock': 69, 'suffer': 802, 'sick': 531, 'pervers': 95, 'propens': 5, 'violenc': 1091, 'character': 206, 'blatantli': 67, 'cosmet': 11, 'fox': 368, 'mulder': 20, 'errol': 86, 'babbag': 20, 'lone': 275, 'obsess': 488, 'quest': 188, 'doggedli': 7, 'harass': 53, 'tote': 17, 'fail': 1511, 'attempt': 1932, 'rescu': 338, 'pine': 38, 'shun': 34, 'colleagu': 106, 'march': 150, 'disguis': 159, 'retir': 162, 'deep': 658, 'disgust': 358, 'monitor': 61, 'qualm': 23, 'unorthodox': 21, 'method': 206, 'handl': 516, 'dish': 71, 'illeg': 102, 'preemptiv': 3, 'urg': 139, 'loath': 72, 'routin': 276, 'scan': 47, 'newspap': 139, 'tabloid': 25, 'clue': 347, 'seek': 426, 'closur': 45, 'salvat': 60, 'belief': 280, 'allison': 34, 'lowri': 6, 'ing': 54, 'nue': 8, 'replac': 349, 'meantim': 53, 'rope': 97, '18': 158, 'requir': 454, 'shenanigan': 31, 'dana': 83, 'sculli': 17, 'task': 218, 'disbeliev': 12, 'emptiv': 1, 'onto': 328, 'notion': 140, 'discharg': 12, 'cure': 138, 'temptat': 50, 'slowli': 412, 'desk': 45, 'administr': 48, 'discoveri': 128, 'fetish': 61, 'deviant': 16, 'eye': 2200, '8mm': 20, 'nicola': 81, 'cage': 334, 'snuff': 60, 'spotlight': 50, 'her': 61, 'correct': 305, 'soon': 1222, 'hip': 195, 'incorrect': 62, 'frequenc': 16, 'tight': 194, 'narr': 449, 'sprawl': 29, 'avril': 4, 'lavign': 3, 'cameo': 406, 'darken': 32, 'ware': 11, 'shophous': 1, 'akin': 67, 'se7en': 15, 'somerset': 18, 'raid': 59, 'doe': 24, 'bizarr': 529, 'insid': 622, 'linger': 92, 'somehow': 757, 'decid': 1786, 'enriqu': 4, 'chediak': 1, 'util': 98, 'trick': 357, 'recreat': 128, 'deepli': 320, 'steep': 23, 'ting': 15, 'brown': 310, 'doom': 196, 'gloom': 20, 'distract': 304, 'somewhat': 965, 'repetit': 154, 'flashback': 417, 'phile': 7, 'hard': 2681, 'favourit': 376, 'forth': 190, 'chemistri': 490, 'fogey': 2, 'heh': 19, 'prot': 37, 'exactli': 995, 'pull': 920, 'jake': 164, 'brokeback': 10, 'mountain': 320, 'astound': 72, 'grip': 249, 'father': 2206, 'son': 1506, 'underdog': 35, 'appeal': 748, 'middl': 969, 'magnific': 304, 'captiv': 245, 'rent': 1256, 'notch': 207, 'cg': 97, 'batman': 434, 'forev': 392, 'includ': 2020, 'romanc': 760, 'conflict': 425, 'motiv': 466, 'date': 883, '007': 19, 'penquin': 3, 'mutant': 98, 'robin': 249, 'tim': 309, 'drake': 89, 'comput': 541, 'nerd': 115, 'indigo': 1, 'soap': 304, 'opera': 429, 'kelli': 433, 'ripa': 3, 'rate': 2300, 'phantasm': 50, 'joker': 70, 'vs': 273, 'dracula': 121, 'smarter': 34, 'subzero': 9, 'god': 1271, 'eric': 266, 'kelso': 25, 'yeah': 462, '8th': 29, 'season': 1072, 'randi': 90, 'dumbass': 5, 'compar': 1068, 'cant': 207, 'funniest': 358, 'switch': 234, 'em': 158, 'cool': 998, 'fault': 344, 'anyway': 1230, 'alright': 185, '360': 20, 'circl': 166, 'abus': 398, 'dad': 511, 'kitti': 74, 'high': 2174, 'hyde': 97, 'favriout': 1, 'jacki': 243, 'donna': 116, 'grey': 165, 'garden': 177, 'amus': 710, 'mesmer': 94, 'amaz': 1563, 'edith': 52, 'sr': 33, 'bicker': 42, 'past': 1324, 'exist': 1057, 'dilapid': 16, 'mansion': 169, 'fifteen': 127, 'tragedi': 387, 'forget': 821, 'dement': 90, 'scientist': 477, 'girlfriend': 684, 'decapit': 63, 'bring': 1715, 'sleaz': 65, 'area': 453, 'perfect': 1778, 'ugli': 367, 'closet': 128, 'laughabl': 504, 'mask': 353, 'tie': 374, 'badli': 662, '3000': 81, 'flirt': 70, 'anthoni': 263, 'endur': 218, 'wade': 23, 'intens': 573, 'context': 264, 'repel': 44, 'tortur': 496, 'mayhem': 72, 'road': 470, 'broadli': 18, 'broad': 119, 'judi': 124, 'tenuta': 3, 'mink': 7, 'stole': 115, 'hooker': 71, 'drag': 523, 'queen': 388, 'purpos': 567, 'disori': 18, 'motion': 501, 'flick': 1629, 'bi': 20, 'poorli': 713, 'indi': 219, 'wealthi': 153, 'harvard': 22, 'radcliff': 2, 'chick': 322, 'constern': 7, 'strict': 55, 'ray': 407, 'milland': 30, 'syrupi': 13, 'sugari': 22, 'sappi': 98, 'battl': 795, 'kid': 3148, 'ryan': 224, 'neal': 46, 'waif': 14, 'librarian': 41, 'snobbish': 20, 'parent': 920, 'ridicul': 1154, 'ali': 41, 'macgraw': 6, 'social': 641, 'derelict': 8, 'filthi': 60, 'mouth': 456, 'marley': 30, 'devout': 22, 'cathol': 168, 'annoy': 1260, 'whimper': 21, 'champion': 95, 'yuppi': 32, '8': 897, 'oliv': 248, 'contribut': 256, 'medium': 144, 'genr': 1367, 'concern': 621, 'jafar': 20, 'panahi': 41, 'j': 426, 'l': 426, 'godard': 51, 'f': 510, 'truffault': 1, 'schemat': 6, 'trait': 81, 'directori': 125, 'automat': 118, 'critic': 1071, 'intellig': 902, 'alien': 702, 'convent': 296, 'offsid': 30, '2006': 163, 'creation': 174, 'gender': 105, 'subordin': 14, 'east': 171, 'asia': 59, 'gradual': 137, 'everybodi': 413, 'catchi': 91, 'shout': 156, 'issu': 725, 'calmli': 15, 'creep': 163, 'ultim': 769, 'hump': 14, 'convey': 341, 'egal': 2, 'illus': 67, 'utopia': 13, 'patern': 11, 'empow': 18, 'soccer': 101, 'nation': 536, 'teenag': 775, 'game': 1651, 'enter': 451, 'stadium': 52, 'cheer': 241, 'permit': 40, 'listen': 619, 'commentari': 347, 'undergo': 40, 'sever': 1663, 'humili': 109, 'situat': 1188, 'worri': 330, 'celebr': 378, 'detain': 15, 'outer': 105, 'cannot': 1096, 'suppress': 56, 'corner': 197, 'format': 215, 'patriarchi': 4, 'global': 114, 'dealt': 137, 'eas': 118, 'humour': 451, 'teas': 76, 'constantli': 416, 'garbag': 460, 'bob': 279, 'saget': 22, 'host': 208, 'dave': 124, 'coulier': 14, 'combin': 629, 'iq': 50, 'tawni': 2, 'kitaen': 1, 'recycl': 97, 'bin': 118, 'imit': 217, 'popey': 20, 'wash': 156, 'cartoon': 753, 'wedgi': 1, 'alanni': 1, 'morisett': 2, 'tv8': 1, 'chuck': 155, 'cleveland': 33, 'ohio': 27, 'heard': 1111, 'thesauru': 3, 'aid': 289, 'describ': 728, 'pointless': 519, 'merit': 201, 'bunch': 819, 'leftov': 17, 'session': 85, 'thrown': 409, 'blender': 9, 'aspect': 852, 'saturday': 222, 'mad': 664, 'color': 827, 'whatev': 734, 'afraid': 343, 'major': 1185, 'spike': 146, 'wee': 46, 'e': 797, 'serial': 450, 'killer': 1700, 'vinni': 47, 'leguizamo': 15, 'dionna': 3, 'mira': 42, 'sorvino': 38, 'relationship': 1327, 'ritchi': 69, 'adrien': 14, 'lifestyl': 126, 'mafia': 133, 'that': 345, '2': 2882, '3': 1898, 'provoc': 88, 'berkowitz': 27, 'colour': 248, 'satur': 40, 'etc': 1212, 'spatula': 12, 'contend': 61, 'yield': 19, 'multipl': 196, 'join': 377, 'spoon': 47, 'premis': 747, 'content': 414, 'near': 843, 'bare': 621, 'present': 1520, 'absorb': 154, 'odd': 701, 'ball': 388, 'rehash': 79, 'weird': 708, 'prequel': 98, 'remak': 686, 'mimick': 18, 'consist': 491, 'reject': 209, 'mostli': 941, 'horrend': 155, 'directli': 193, 'realiz': 1327, 'pilot': 358, 'excus': 503, 'margin': 70, 'erot': 208, 'nowher': 446, 'rais': 505, 'avoid': 994, 'space': 799, 'imdb': 704, 'select': 199, 'haiku': 11, 'tunnel': 88, '50': 594, 'ht': 1, 'nay': 14, 'pray': 116, 'tape': 369, 'ed': 344, 'paid': 358, 'reimburs': 4, 'miracul': 68, 'redeem': 465, 'unfunni': 268, 'mail': 102, 'friggin': 14, 'letter': 235, 'asinin': 21, 'printer': 9, 'embarras': 4, 'josh': 83, 'kornbluth': 40, 'turd': 66, '0': 232, 'sarafina': 10, 'normal': 770, 'perspect': 306, 'soweto': 6, 'riot': 100, '1976': 70, 'student': 752, 'sympathet': 239, 'victim': 816, 'white': 1551, 'govern': 469, 'sympathis': 27, 'violent': 560, 'shown': 994, 'photo': 181, 'accur': 349, 'aparthi': 2, 'apartheid': 40, 'potenti': 710, 'reliabl': 74, 'detail': 884, 'policeman': 75, 'classroom': 32, 'shoot': 1115, 'polic': 1105, 'armi': 474, 'aggress': 103, 'exagger': 197, 'school': 1732, 'execut': 680, 'street': 968, 'loot': 30, 'inform': 603, 'teacher': 391, 'arrest': 211, 'mum': 63, 'racist': 179, 'polici': 82, 'georg': 933, 'finlay': 22, 'spiritualist': 5, 'christian': 544, 'load': 311, 'seer': 2, 'argument': 180, 'atheist': 27, 'interview': 417, 'proper': 230, 'theologian': 4, 'priest': 262, 'stuff': 1181, 'nut': 162, 'wrote': 574, 'studi': 447, '1970': 296, 'christ': 183, 'conclus': 539, 'ego': 147, 'demon': 446, 'im': 92, 'stun': 499, 'care': 2124, 'soul': 562, 'jesu': 290, 'entic': 48, 'drum': 97, 'crash': 361, 'blade': 115, 'explor': 482, 'highway': 66, 'noir': 456, 'essenti': 425, 'neanderth': 9, 'kitch': 3, 'warn': 724, 'highli': 1147, 'forgotten': 353, 'overlook': 238, 'pass': 968, 'ted': 198, 'bogu': 65, 'bomb': 385, 'wherea': 149, 'popular': 643, '1991': 65, 'ago': 1033, 'landscap': 205, 'radic': 96, 'gangsta': 25, 'rap': 148, 'hop': 123, 'pearl': 103, 'jam': 64, 'nirvana': 8, 'grung': 6, 'seattl': 45, 'ozzi': 39, 'osbourn': 16, 'van': 509, 'halen': 2, 'gun': 872, 'rose': 273, 'outdat': 66, '91': 10, 'nobodi': 462, 'surfer': 58, 'excel': 2251, 'gremlin': 35, 'fate': 344, 'associ': 257, 'transit': 143, 'faster': 100, '00': 99, '1988': 77, '1989': 76, '2001': 160, '1995': 81, '1996': 107, 'wildli': 77, 'vinc': 56, 'lombardi': 4, 'ms': 350, 'togar': 23, 'woronov': 23, 'intend': 479, 'ban': 142, 'butt': 148, 'riff': 58, 'randal': 49, 'sole': 250, 'ramon': 115, 'footbal': 226, 'team': 935, 'vincent': 170, 'patten': 11, 'connect': 656, 'cute': 604, 'rambeau': 8, 'dey': 19, 'instant': 106, 'midnight': 178, '1980': 303, 'colleg': 509, 'uproari': 21, 'adult': 887, 'juvenil': 116, 'groaner': 5, 'jump': 677, 'energi': 324, 'tune': 343, 'rest': 1852, 'caught': 555, 'higher': 289, 'spoiler': 976, 'pg': 142, 'blown': 184, 'mood': 458, 'otherwis': 670, 'scari': 998, 'alik': 154, 'keenan': 13, 'ivori': 29, 'wayan': 57, 'smallest': 31, 'subtleti': 136, 'slasher': 539, 'comed': 319, 'gold': 295, 'un': 191, 'opportun': 482, 'former': 509, 'beverli': 76, 'hill': 397, '90210': 20, 'beg': 182, 'analysi': 88, 'wine': 57, '5': 1381, '75': 76, 'jungl': 204, 'walk': 1358, 'rocki': 97, 'cliff': 127, 'river': 344, 'lake': 255, 'pad': 139, 'nake': 437, 'bulg': 18, 'bloodi': 314, 'accompani': 197, 'breath': 303, 'reverb': 2, 'eurotrash': 7, 'gratuit': 244, 'flesh': 315, 'makeup': 210, 'cannib': 155, 'uncut': 74, 'hate': 1295, 'septemb': 92, '11': 369, 'basi': 170, 'alejandro': 21, 'gonz': 7, 'lez': 7, 'rritu': 7, 'segment': 391, 'offens': 269, 'youssef': 16, 'chahin': 18, 'pretenti': 294, 'palestinian': 50, 'suicid': 355, 'bomber': 44, 'suggest': 771, 'greater': 174, 'decenc': 39, 'whatsoev': 319, 'patienc': 81, 'paper': 281, 'tasteless': 77, 'dark': 1573, 'conneri': 94, 'fishburn': 69, 'redempt': 153, 'boot': 149, 'turnaround': 2, 'habit': 93, 'counterpoint': 24, 'sorta': 32, 'flipsid': 1, 'address': 183, 'paraphras': 35, 'norm': 82, 'inabl': 79, 'mundan': 91, 'sibl': 100, 'dysfunct': 91, 'daili': 168, 'current': 379, 'inevit': 228, 'destruct': 212, 'specif': 260, 'gambl': 94, 'wire': 111, 'verit': 31, 'genius': 39, 'hugh': 185, 'drive': 872, 'damn': 438, 'norman': 127, 'maclean': 36, 'occur': 394, 'anguish': 55, 'lifetim': 190, 'academ': 41, 'base': 1645, 'pseudo': 112, 'silent': 475, 'meant': 614, 'disjoint': 103, 'fragment': 45, 'respect': 917, 'imageri': 186, 'concept': 627, 'mother': 1597, 'standpoint': 41, 'doc': 143, 'savag': 168, 'bronz': 17, 'outta': 32, 'pulp': 117, 'magazin': 177, 'paperback': 14, 'lester': 72, 'dent': 12, 'kenneth': 116, 'robeson': 8, 'super': 500, 'assist': 278, 'expert': 218, 'field': 376, 'endeavor': 44, 'combat': 123, 'hokey': 71, '70': 732, 'ron': 183, 'tarzan': 292, 'eli': 67, 'tongu': 178, 'cheek': 126, 'campi': 195, 'flair': 79, 'corni': 263, 'cheesi': 672, 'stereotyp': 613, 'crummi': 32, 'fascin': 573, 'possibl': 1913, 'arnold': 148, 'schwarzenegg': 38, 'rumour': 25, 'modern': 964, 'spanish': 282, 'judg': 476, 'februari': 18, 'matthew': 129, 'lillard': 7, 'scar': 72, 'merchandis': 25, 'hire': 411, 'crook': 117, 'max': 216, 'jami': 129, 'onofrio': 5, 'valeria': 6, 'golino': 4, 'mark': 838, 'boon': 36, 'junior': 92, 'mar': 151, 'lust': 149, 'matt': 247, 'tamara': 6, 'smooth': 132, 'slick': 99, 'necro': 2, 'newcom': 77, 'accord': 311, 'site': 286, '1983': 95, 'charli': 446, 'sheen': 53, 'hot': 703, 'gave': 1216, 'adriann': 6, 'curri': 47, 'model': 400, 'glad': 451, 'knight': 121, 'angri': 337, 'seven': 360, 'month': 420, 'propos': 79, 'marri': 923, 'compani': 596, 'wed': 338, 'chain': 180, 'unnecessari': 307, 'stupidli': 29, 'shame': 743, 'break': 1101, 'marriag': 448, 'rush': 331, 'pitch': 216, 'fit': 866, 'within': 832, 'introduc': 549, 'dynamo': 7, 'jet': 142, 'li': 116, 'legend': 370, 'yuen': 21, 'ping': 20, 'coordin': 26, 'matrix': 197, 'rough': 200, 'edit': 1250, 'studio': 698, 'characterist': 109, 'francois': 6, 'yip': 6, '701': 1, 'goth': 28, 'overload': 19, 'explos': 293, 'focu': 509, 'physic': 536, 'favor': 324, 'tremend': 185, 'vertigo': 39, 'candl': 72, 'kim': 209, 'novak': 86, 'picnic': 32, 'kansa': 79, 'prairi': 23, 'salina': 4, 'alex': 232, 'stewart': 472, 'contrast': 305, 'greta': 32, 'garbo': 103, 'youth': 364, '40': 461, 'virgin': 233, 'electron': 67, 'boss': 468, 'broadcast': 160, 'ass': 290, 'reprimand': 7, 'underl': 18, 'rage': 162, 'ethnic': 100, 'minor': 491, 'choru': 99, 'sketch': 131, 'stretch': 293, 'ration': 100, 'chest': 107, 'wax': 83, 'carel': 90, 'romant': 879, 'contriv': 268, 'keener': 18, 'aquariu': 3, 'excess': 211, 'accid': 344, '1994': 65, 'fell': 357, 'rolf': 8, 'saxon': 28, 'talbot': 10, 'abroad': 38, 'london': 465, 'financi': 142, 'flamboy': 42, 'charm': 965, 'sylvia': 45, 'actress': 1588, 'julia': 189, 'phillip': 145, 'lane': 171, 'chose': 203, 'arrog': 147, 'outdo': 25, 'internation': 1, 'ormond': 4, 'preview': 171, 'transfer': 172, 'happili': 152, 'arriv': 514, 'distribut': 157, 'denzel': 143, 'washington': 273, 'debut': 292, 'envi': 58, 'angl': 399, 'derek': 155, 'guidanc': 28, 'turmoil': 60, 'antwon': 89, 'portrait': 165, 'basic': 1453, 'despair': 97, 'dr': 702, 'davenport': 18, 'sober': 50, 'subdu': 48, 'angst': 72, 'constrain': 12, 'dismiss': 101, 'patient': 268, 'doctor': 704, 'tate': 16, 'foster': 205, 'brutal': 485, 'older': 656, 'household': 91, 'molest': 57, 'bitter': 184, 'tast': 580, 'cheryl': 22, 'inde': 722, 'camper': 41, 'ador': 226, 'joy': 336, 'bryant': 20, 'novella': 22, 'nelson': 153, 'superb': 671, 'reunion': 155, 'unknown': 308, 'sentiment': 328, 'fisher': 129, 'accept': 781, '45': 126, 'crawford': 83, 'tone': 599, 'imposs': 538, 'england': 307, 'zero': 390, 'echo': 109, 'suddenli': 538, 'declar': 127, 'ludicr': 209, 'threw': 112, 'towel': 30, 'halfway': 173, 'hawk': 139, 'spoke': 91, 'trademark': 103, 'hawksian': 2, 'rat': 199, 'tat': 13, 'deliveri': 189, 'escort': 43, 'raft': 39, 'wartim': 46, 'patent': 38, 'bolton': 10, 'evad': 21, 'ii': 366, 'enlist': 72, 'court': 229, 'colonel': 106, 'dorothi': 142, 'lamour': 14, 'agent': 455, 'lynn': 40, 'overman': 4, 'bracken': 1, 'escapad': 25, 'train': 781, 'exercis': 145, 'malibu': 6, 'california': 189, 'paramount': 77, 'employ': 217, 'specialist': 24, 'butler': 88, 'flaccid': 12, 'scenario': 232, 'shift': 157, 'heroism': 28, 'born': 400, 'oddli': 160, 'veteran': 250, 'master': 729, 'sneer': 31, 'delight': 564, 'clarenc': 41, 'kolb': 3, 'radio': 299, 'curs': 231, 'error': 171, 'assign': 168, 'stan': 144, 'laurel': 123, 'hardi': 180, 'deservedli': 37, 'horn': 78, 'factori': 151, 'fourth': 178, 'crack': 253, 'olli': 96, 'quiet': 290, 'jame': 1069, 'finlayson': 15, 'plumb': 28, 'electr': 135, 'muddl': 91, 'repairman': 5, 'drink': 382, 'goat': 54, 'milk': 107, 'sea': 291, 'ocean': 121, 'practis': 13, 'trumpet': 45, 'hang': 444, 'window': 322, 'cord': 21, 'dock': 47, 'boat': 283, 'meanwhil': 249, 'front': 624, 'page': 465, 'nick': 300, 'grainger': 4, 'convict': 233, 'cramer': 14, 'sneak': 142, 'sleep': 568, 'chew': 126, 'drift': 87, 'morn': 272, 'demand': 294, 'eat': 621, 'spot': 574, 'fake': 532, 'string': 195, 'spaghetti': 58, 'chees': 164, 'belt': 95, 'bacon': 78, 'spong': 13, 'meatbal': 32, 'choke': 67, 'blow': 436, 'punch': 289, 'till': 213, 'prison': 682, 'tiniest': 12, 'mess': 809, 'quot': 297, 'comedian': 236, 'contradict': 84, 'recal': 286, 'tummi': 6, 'symbol': 329, 'darkheart': 5, 'nichola': 92, 'balanc': 256, 'ten': 851, 'dentist': 168, 'profess': 92, 'psycho': 263, 'ambul': 20, 'secreteri': 1, 'starter': 59, 'suprisingli': 3, 'everyman': 24, 'nightmar': 426, 'clean': 342, 'feinston': 50, 'blond': 390, 'cloud': 83, 'horizon': 46, 'nasti': 366, 'ir': 37, 'termin': 117, 'earl': 92, 'boen': 5, 'dirti': 337, 'pool': 165, 'cleaner': 36, 'teeth': 186, 'filter': 58, 'nutso': 2, 'yuzna': 25, 'stylish': 159, 'spinoff': 2, 'carpent': 167, 'pierr': 57, 'scanner': 27, 'corbin': 38, 'bernsen': 47, 'supris': 19, 'leagu': 196, 'newer': 65, 'dream': 1174, 'hoffman': 188, 'beuti': 4, 'micahel': 2, 'stadvec': 3, 'neighbourhood': 14, 'ken': 124, 'fore': 29, 'dawn': 157, 'sight': 396, 'virginya': 4, 'keehn': 4, 'prepar': 366, 'drill': 55, 'patho': 53, 'shrill': 38, 'donald': 191, 'moffat': 4, 'jeff': 309, 'bridg': 227, 'quarterback': 10, 'holli': 110, 'palanc': 79, 'pamela': 85, 'reed': 169, 'marvel': 312, 'fetch': 137, 'excit': 996, 'rambo': 116, 'emphasi': 101, 'plausibl': 122, 'nose': 191, 'dive': 104, 'stallon': 91, 'impregn': 16, 'mission': 303, 'fulfil': 159, 'invas': 103, 'usa': 164, 'commando': 49, 'scorpion': 47, 'cancel': 155, 'invulner': 13, 'fear': 751, 'word': 1817, 'wipe': 127, 'hundr': 300, 'enemi': 307, 'imprison': 58, 'sylvest': 20, 'pardon': 29, 'covert': 15, 'oper': 276, '1985': 63, 'arrang': 146, 'pow': 45, 'trap': 389, 'vietnam': 192, 'encourag': 187, 'mentor': 60, 'trautman': 6, 'crenna': 36, 'brainchild': 5, 'outfit': 178, 'marshal': 108, 'murdock': 8, 'charl': 409, 'napier': 16, 'contain': 765, 'rendezv': 11, 'chopper': 22, 'photograph': 395, 'knowledg': 304, 'resourc': 134, 'bao': 1, 'nickson': 1, 'discov': 849, 'exce': 19, 'implic': 79, 'captur': 852, 'treacher': 23, 'cardiff': 5, 'polish': 147, 'jerri': 382, 'goldsmith': 25, 'exhilar': 36, 'antic': 117, 'scant': 17, 'failur': 290, 'macho': 71, 'postur': 35, 'fals': 213, 'soulless': 31, 'suspenseless': 1, 'numbingli': 36, 'ronald': 60, 'reagan': 47, 'hyster': 184, 'communist': 127, 'contemporari': 236, 'lap': 41, 'commi': 32, 'bash': 125, 'fest': 147, 'transform': 329, 'undeserv': 23, 'nowaday': 167, 'necessarili': 180, 'loos': 445, 'inter': 49, 'web': 123, 'lose': 828, 'slash': 95, 'bed': 415, 'flee': 90, 'flashlight': 20, 'ok': 1017, 'solv': 234, 'secret': 745, 'depress': 482, 'neighbor': 239, 'creepi': 673, 'shutter': 6, 'piano': 126, 'hoard': 7, 'everywher': 190, 'mush': 17, 'besid': 481, 'worn': 88, 'uphil': 8, 'ingredi': 134, 'moonstruck': 38, 'homesick': 6, 'subplot': 208, 'labohem': 1, 'theatr': 359, 'hum': 91, 'amor': 71, 'repeat': 463, 'dog': 898, 'kick': 587, 'chrissi': 25, 'knife': 156, 'loretta': 68, 'ca': 25, 'professor': 224, 'project': 717, 'partial': 99, 'waystat': 2, 'vapid': 44, 'bar': 478, 'amateur': 252, 'jacob': 34, 'fenner': 1, 'thespian': 36, 'border': 205, 'audit': 110, 'valu': 1004, 'easi': 806, 'design': 745, 'ordinari': 271, 'push': 422, 'forward': 719, 'muck': 17, 'crap': 1054, 'sci': 658, 'fi': 660, 'sucker': 83, '1965': 40, 'clearli': 899, 'inept': 187, 'melodrama': 209, 'sexploit': 23, 'grindhous': 27, 'era': 635, 'fair': 503, 'undress': 35, 'complement': 54, 'lousi': 222, 'narrat': 423, 'awkward': 264, 'coffe': 107, 'shop': 360, 'lay': 178, 'excruci': 52, 'groundwork': 5, 'chop': 163, 'reaction': 386, 'misti': 49, 'ayer': 19, 'strip': 213, 'french': 790, 'panti': 28, 'continu': 1159, 'randomli': 85, 'among': 783, 'cigarett': 79, 'tap': 172, 'strike': 404, 'inhal': 8, 'apach': 7, 'sordid': 31, 'salli': 135, 'whorehous': 8, 'dope': 42, 'liter': 556, 'nail': 208, 'knit': 33, 'le': 227, 'stupend': 18, 'boozi': 7, 'dame': 68, 'accident': 246, 'har': 30, 'dee': 82, 'marque': 12, 'cinema': 1553, 'intellect': 37, 'feather': 42, 'advantag': 172, 'refus': 345, 'accustom': 24, 'divorce': 9, 'hat': 276, 'absent': 83, 'typic': 908, 'acquaint': 73, 'baker': 159, 'sherri': 34, 'misunderstood': 51, 'classi': 59, 'courtship': 13, 'irrit': 341, 'sabotag': 43, 'bicarbon': 2, 'soda': 14, 'ginger': 107, 'grand': 319, 'tradit': 488, 'dwindl': 17, 'irv': 41, 'berlin': 101, 'sprinkl': 38, 'fred': 303, 'navi': 162, 'astair': 132, 'roger': 373, 'masterclass': 4, 'stood': 133, 'brilliant': 1196, 'poignant': 156, 'voight': 111, 'flash': 266, 'cough': 28, 'sickli': 27, 'omin': 62, 'superbl': 126, 'risk': 215, 'aural': 18, 'outrag': 231, 'dri': 266, 'hardwar': 17, 'august': 58, 'migrain': 11, 'heat': 155, 'advanc': 275, 'euphor': 5, 'prudent': 4, 'blink': 54, 'mordem': 1, 'stevi': 12, 'intox': 25, 'harsh': 214, 'vampir': 684, 'sympathi': 219, 'ole': 19, 'dire': 125, 'slot': 38, 'drop': 524, 'dribbl': 22, 'lore': 29, 'headi': 11, 'tonic': 9, 'religi': 323, '2000': 170, 'johnni': 328, 'miller': 170, 'what': 85, 'cri': 770, 'tellytubbi': 1, 'frighten': 301, 'peek': 40, 'broken': 278, 'fenc': 82, 'alert': 103, '99': 119, 'individu': 409, 'express': 702, 'moodi': 111, 'wall': 505, 'mirror': 250, 'singular': 26, 'grant': 482, 'hole': 543, 'bone': 183, 'poem': 94, 'lynch': 293, 'cheat': 258, 'irrespons': 40, 'therefor': 345, 'linear': 66, 'eventu': 782, 'compos': 241, 'common': 515, 'thu': 418, 'distanc': 139, 'fantasi': 725, 'surfac': 211, 'build': 921, 'coher': 157, 'odditi': 34, 'isol': 164, 'spent': 536, 'enhanc': 172, 'scare': 741, 'circumst': 248, 'welcom': 268, 'candid': 115, 'battlefield': 51, 'earth': 929, 'pluto': 14, 'nash': 25, 'difficult': 695, 'awak': 116, 'pun': 108, 'resist': 180, 'mike': 288, 'robot': 375, 'provid': 995, 'creatur': 554, 'xeno': 2, 'invis': 227, 'assur': 143, 'centiped': 9, 'control': 697, 'resembl': 389, '1997': 83, 'chaotic': 46, 'blue': 531, 'empti': 307, 'insert': 130, 'pupil': 41, 'burn': 570, 'overwork': 13, 'blare': 18, 'revolv': 291, 'paranorm': 22, 'slater': 49, 'tough': 501, 'beater': 4, 'tshirt': 1, 'trench': 23, 'coat': 107, 'shave': 61, 'archaeologist': 34, 'reid': 86, 'dorff': 21, 'bark': 31, 'asham': 161, 'frankli': 256, 'illog': 105, 'text': 172, 'adnausem': 1, 'clumsi': 110, 'uwe': 102, 'boll': 145, 'disgrac': 102, 'shake': 194, 'simul': 51, 'center': 446, 'bullet': 233, 'quarter': 93, 'advis': 195, 'grab': 270, 'split': 191, 'tuscan': 1, 'sky': 350, 'dian': 105, 'tender': 134, 'lark': 10, 'invit': 252, 'realist': 842, 'notic': 793, 'wet': 100, 'boyfriend': 433, 'lunch': 58, 'amp': 14, 'ensembl': 152, 'paxton': 76, 'elizabeth': 175, 'brad': 176, 'paisley': 1, 'sceneri': 419, 'bright': 284, 'variat': 75, 'hello': 90, 'muddah': 1, 'male': 727, 'mistaken': 108, 'qualifi': 131, 'barn': 69, 'corral': 9, 'smoke': 277, 'travi': 46, 'canada': 139, 'hagar': 31, 'attitud': 327, 'behavior': 296, 'unfold': 252, 'empathi': 84, 'likabl': 398, 'shack': 41, 'reflect': 365, 'youngest': 74, 'edg': 517, 'seat': 309, 'raw': 181, 'authent': 238, 'ellen': 123, 'juno': 7, 'broader': 18, 'stone': 457, 'angel': 512, 'burnstyn': 4, 'swept': 66, 'hook': 275, 'sinker': 9, 'kari': 25, 'skogland': 2, 'capac': 52, 'renown': 36, 'cherish': 53, 'brilliantli': 248, 'stoney': 3, 'premier': 154, 'toronto': 67, 'bother': 655, 'ask': 1500, 'snip': 8, 'wretchedli': 6, 'arquett': 56, 'parker': 247, 'gamut': 32, 'park': 489, 'utterli': 454, 'behav': 191, 'certain': 764, 'willi': 224, 'useless': 132, 'mine': 355, 'timon': 109, 'pumba': 12, 'lion': 205, 'construct': 252, 'btw': 65, 'option': 115, 'xy': 2, 'rosencrantz': 4, 'guildenstern': 3, 'tom': 785, 'stoppard': 2, 'roth': 96, 'oldman': 7, 'hamlet': 147, 'mid': 318, '1950': 338, 'delv': 79, 'group': 1147, 'dani': 40, 'bound': 204, 'philosoph': 143, 'emerg': 240, 'hollow': 116, 'wolf': 142, 'worker': 294, 'shi': 142, 'advertis': 228, 'brand': 148, 'fedex': 4, 'audi': 6, 'convers': 357, 'stink': 163, 'commerci': 392, 'sec': 12, 'spare': 149, 'program': 379, 'sandra': 98, 'nine': 163, 'six': 388, 'despis': 80, 'casual': 103, 'h': 269, 'lamar': 7, '1999': 105, 'attract': 749, 'clown': 127, 'blast': 130, 'expend': 23, 'wild': 473, 'uselessli': 6, 'interior': 88, 'architectur': 42, 'tech': 82, 'lab': 137, 'pancak': 27, 'corps': 200, 'batter': 27, 'slather': 4, 'expos': 238, 'skin': 260, 'calcifi': 2, 'viru': 140, 'transmut': 4, 'ah': 118, 'transmit': 33, 'via': 169, 'lethal': 58, 'biolog': 43, 'pathogen': 4, 'gimm': 13, 'warp': 56, 'trek': 267, 'photon': 5, 'virus': 6, 'fright': 77, 'factor': 280, 'aliv': 464, 'cat': 657, 'viral': 3, 'thingamajig': 2, 'presum': 207, 'wagner': 77, 'inan': 107, 'trashi': 100, 'venu': 41, 'constru': 10, 'chaser': 4, 'flatter': 26, 'interst': 7, 'west': 477, 'distinguish': 89, 'transport': 117, 'denni': 193, 'hopper': 99, 'memoir': 42, 'clau': 80, 'santa': 278, 'claus': 26, 'allen': 408, 'starrer': 4, 'boast': 115, 'dobkin': 5, 'shanghai': 81, 'crasher': 19, 'virtual': 270, 'nari': 18, 'clumsili': 33, 'tread': 27, 'boorish': 19, 'vaughn': 43, 'vehicl': 297, 'fuzzi': 56, 'christma': 623, 'compris': 65, 'giamatti': 24, 'kevin': 289, 'spacey': 83, 'rachel': 194, 'weisz': 24, 'kathi': 55, 'bate': 68, 'estrang': 67, 'trevor': 18, 'peacock': 12, 'saint': 116, 'yuletid': 2, 'jade': 68, 'repo': 9, 'chicago': 92, 'wanda': 28, 'birthday': 140, 'eerili': 23, 'decad': 476, 'bail': 21, 'jail': 187, 'toy': 289, 'wrap': 230, 'pole': 83, 'reluctantli': 45, 'cynic': 232, 'clash': 82, 'elv': 18, 'perpetu': 84, 'cheeri': 16, 'effici': 73, 'arctic': 22, 'shut': 194, 'thin': 368, 'durat': 65, 'elf': 19, 'fruitcak': 2, 'vaugn': 2, 'coars': 34, 'tabl': 218, 'neuter': 10, 'dan': 300, 'fogelman': 1, 'underneath': 77, 'fat': 283, 'suit': 576, 'jolli': 37, 'icon': 194, 'fiddl': 17, 'unfunnili': 1, 'forgett': 206, 'slaver': 11, 'lollo': 5, 'slang': 24, 'term': 615, 'breast': 192, 'tastier': 3, 'morsel': 3, 'divin': 69, 'gerard': 93, 'philip': 179, 'deter': 25, 'palm': 63, 'thereaft': 39, 'gallic': 2, 'gestur': 85, 'swordplay': 22, 'minu': 77, 'faceti': 3, 'weari': 62, 'superior': 360, 'speaker': 57, 'occasion': 449, 'ooh': 23, 'virtuou': 17, 'fanfan': 22, 'seduc': 124, 'dear': 148, 'bagatel': 2, 'nineti': 88, 'logo': 38, 'jerk': 190, 'level': 1210, 'throw': 742, 'ship': 446, 'await': 111, 'unsuspect': 63, 'buyer': 19, 'weight': 150, 'independ': 403, 'pioneer': 63, 'lindenmuth': 2, 'amongst': 160, 'respons': 535, 'werewolf': 273, 'hereditari': 3, 'shapeshift': 5, 'crush': 190, 'grandmoth': 134, 'instal': 196, 'strongest': 70, 'lesbian': 266, 'envis': 32, 'lindemuth': 1, 'manbeast': 1, 'wood': 675, 'fella': 24, 'bitten': 69, 'beast': 205, 'danger': 587, 'sum': 297, 'justifi': 220, 'scalp': 5, 'smart': 418, 'coal': 44, 'heap': 73, 'vow': 43, 'bend': 92, 'beckham': 50, 'spite': 189, 'confess': 190, 'troublingli': 1, 'impli': 158, 'primarili': 104, 'geniu': 452, 'syd': 5, 'arc': 95, 'lurk': 77, 'beneath': 104, 'layer': 144, 'topsoil': 1, 'scratch': 130, 'clad': 68, 'display': 464, 'strength': 306, 'agil': 9, 'lara': 45, 'croft': 15, 'zhang': 37, 'ziyi': 16, 'keira': 27, 'knightley': 66, 'movement': 321, 'determin': 277, 'parmind': 12, 'nagra': 17, 'hackney': 77, 'adject': 18, 'lumin': 25, 'honesti': 99, 'bookish': 9, 'pact': 23, 'devil': 346, 'chadha': 6, 'bride': 185, 'prejudic': 108, 'sizzl': 22, 'neatli': 64, 'stodgi': 9, 'valley': 84, 'categori': 252, 'disavow': 6, 'flirtat': 13, 'hetero': 6, 'homosexu': 170, 'triangl': 69, 'structur': 282, 'precis': 153, 'pleasur': 370, 'seduct': 105, 'perfom': 2, 'coolest': 44, 'abhay': 28, 'soha': 22, 'himesh': 4, 'ahista': 6, 'danni': 347, 'glover': 143, 'toni': 582, 'danza': 25, 'joseph': 233, 'gordon': 253, 'levitt': 10, 'lloy': 1, 'basebal': 217, 'lloyd': 139, 'harden': 50, 'embitt': 17, 'guarante': 175, 'darl': 44, 'supposedli': 365, 'bohemian': 16, 'waterlog': 2, 'formula': 370, 'summer': 389, 'guido': 12, 'pc': 67, 'murphi': 215, 'taller': 13, 'cartoonish': 66, 'caricatur': 148, 'anybodi': 311, 'richi': 20, 'stomach': 181, 'accus': 204, 'integr': 178, 'crowd': 302, 'beard': 70, 'cliqu': 20, 'basketbal': 88, 'drivel': 125, 'furthermor': 106, 'ohhhh': 4, 'ahhhh': 3, 'emperor': 97, 'ceas': 44, 'niro': 100, 'cape': 63, 'schtick': 29, 'million': 541, 'wesley': 44, 'snipe': 61, 'conceit': 50, 'goodfella': 24, 'land': 592, 'taxi': 92, 'driver': 230, 'godfath': 137, 'turner': 123, 'technicolor': 80, 'reiter': 15, 'clara': 64, 'barton': 39, 'confeder': 34, 'reb': 18, 'rebel': 156, 'mojo': 9, 'jojo': 5, 'powerpuff': 4, 'sloppi': 127, 'period': 843, 'hamilton': 129, 'perri': 123, 'garfield': 46, 'yep': 60, 'psychic': 101, 'hilar': 68, 'ensu': 170, 'boredom': 142, 'meltzer': 1, 'crappi': 248, 'destroy': 569, 'neither': 537, 'afv': 2, 'jackalop': 1, 'over': 54, 'submit': 68, 'varieti': 194, 'guest': 206, 'olson': 5, 'twin': 210, 'drool': 40, 'sin': 221, 'promisingli': 13, 'heist': 76, 'awri': 44, 'rashomon': 6, 'lumet': 100, 'morph': 47, 'multi': 141, 'facet': 39, 'realm': 84, 'stud': 59, 'hyperbol': 16, 'seymour': 57, 'oftentim': 12, 'dwarf': 70, 'ethan': 92, 'hank': 245, 'adequ': 148, 'marisa': 48, 'tomei': 52, 'rel': 437, 'albert': 265, 'finney': 50, 'andi': 347, 'ami': 120, 'twilight': 89, 'illustri': 18, 'infus': 36, 'gem': 429, '250': 41, '248': 1, 'fernando': 32, 'fragata': 2, 'jo': 67, 'rio': 27, 'grilo': 1, 'abi': 2, 'feij': 1, 'leonel': 1, 'vieira': 2, 'tc': 5, 'diamantino': 3, 'costa': 20, 'portugues': 47, 'lampi': 1, 'da': 96, 'estrela': 2, 'herman': 56, 'pedro': 27, 'gome': 1, '28': 69, '07': 12, 'boa': 6, 'kung': 243, 'fu': 284, 'martial': 330, 'unbeliev': 563, 'gotta': 129, 'wizard': 122, 'asleep': 213, 'hurrah': 3, 'chivalri': 9, 'wind': 424, 'dab': 12, '1970i': 1, 'notabl': 293, '60i': 2, '70i': 4, '80i': 2, 'articl': 67, 'afterward': 183, 'intermin': 34, '115': 4, 'bloat': 27, 'lava': 14, 'flow': 261, 'oppress': 96, 'syllabu': 1, 'dismal': 71, 'claud': 69, 'laydu': 3, 'agoni': 55, 'indistinguish': 17, 'etern': 154, 'dreari': 89, 'ambricourt': 1, 'wretch': 81, 'persecut': 34, 'weirdo': 44, 'nosi': 13, 'pest': 7, 'grace': 424, 'indulg': 179, 'vagu': 220, 'bresson': 7, 'ice': 303, 'cream': 84, 'fanat': 111, 'schrader': 15, 'taxidriv': 1, 'bull': 113, 'sleeper': 42, 'ann': 542, 'margret': 13, 'bye': 74, 'birdi': 15, 'repris': 69, 'jason': 331, 'vanessa': 67, 'commend': 99, 'tyne': 12, 'chynna': 8, 'casablanca': 51, 'busey': 57, 'w': 262, 'surround': 391, 'jeep': 37, 'wagon': 34, 'domino': 103, 'pellet': 3, 'shooter': 40, 'held': 391, '300': 58, 'barman': 36, 'bewar': 73, 'writeup': 2, 'belgian': 25, 'frontman': 3, 'deu': 25, 'belgium': 26, 'innov': 154, 'album': 116, 'fame': 276, 'scale': 232, 'monick': 1, 'tamer': 18, 'intern': 372, 'breakthrough': 38, 'dilut': 29, 'songwrit': 27, 'musician': 154, 'provok': 226, 'uninterest': 211, 'friday': 201, 'antwerp': 19, 'qualiti': 1505, 'shortcom': 77, 'slightli': 541, 'loud': 438, 'enthral': 75, 'banana': 38, 'pepper': 63, 'pizza': 46, 'johni': 12, 'destini': 113, 'tarantino': 82, 'ost': 4, 'cd': 109, 'illustr': 160, 'weakest': 99, 'hardli': 613, 'flemmish': 2, 'sharp': 223, 'daerden': 1, 'moscow': 12, 'showdown': 85, 'supremaci': 35, 'bourn': 192, 'min': 122, 'russia': 79, 'madrid': 19, 'pari': 405, 'marocco': 1, 'damon': 90, 'inch': 54, 'ludlum': 8, 'deadli': 201, 'underpin': 23, 'polar': 56, 'breathtak': 168, 'ultimatum': 59, 'octan': 5, 'gasp': 70, 'branch': 52, 'off': 69, 'bond': 418, 'shaw': 100, '63': 17, 'greengrass': 21, 'breed': 103, 'delapid': 3, 'interact': 288, 'mailman': 7, 'porch': 12, 'cigar': 32, 'decor': 111, 'republ': 54, 'propel': 43, 'wheel': 99, 'sophomor': 46, 'bravo': 62, 'voyag': 110, '23': 57, 'tho': 52, 'vulcan': 25, 'tuvok': 7, 'diseas': 157, 'captain': 341, 'janeway': 17, 'conduit': 6, 'delta': 25, 'quadrant': 4, 'notifi': 11, 'borg': 39, 'visit': 504, 'scribbl': 9, 'math': 34, 'institut': 106, 'command': 287, 'shuttl': 32, 'ahead': 396, 'guid': 203, 'link': 198, 'argu': 210, 'brain': 601, 'disord': 86, 'facil': 74, 'increas': 124, 'assimil': 16, 'bett': 157, 'davi': 495, 'slutti': 25, 'viciou': 116, 'cockney': 42, 'waitress': 91, 'mildr': 115, 'spellbind': 19, 'lesli': 173, 'carey': 69, 'seal': 82, 'stardom': 60, 'unw': 9, 'pregnanc': 29, 'partner': 352, 'cad': 23, 'swine': 14, 'storylin': 822, 'pat': 152, 'quaint': 44, 'research': 320, 'lazi': 187, 'glaringli': 12, 'nuristani': 1, 'thirti': 203, '1890': 17, 'abdul': 3, 'rahman': 4, 'shah': 52, 'aghnaistan': 1, 'nomad': 20, 'aryan': 15, 'milenia': 1, 'tehran': 11, 'geographi': 21, 'strikingli': 33, 'larg': 784, 'predomin': 15, 'persian': 10, 'spoken': 169, 'iran': 93, 'afghanistan': 36, 'german': 614, 'arab': 103, 'guard': 265, 'hadha': 1, 'rujal': 1, 'mard': 9, 'nist': 1, 'indian': 527, 'princess': 205, 'quran': 3, 'ferdo': 2, 'jehaan': 2, 'afterword': 14, 'paradis': 77, 'distant': 124, 'cognat': 1, 'admittedli': 134, 'jehennan': 1, 'encount': 381, 'educ': 279, 'afghan': 10, 'wholli': 82, 'iranian': 55, 'tent': 57, 'bedouin': 4, 'carpet': 47, 'profil': 62, 'uncommon': 20, 'turban': 3, 'cleric': 7, 'initi': 431, 'greet': 65, 'ahlan': 1, 'wa': 5, 'sahlan': 1, 'kabul': 4, 'sandi': 41, 'dirt': 76, 'arid': 8, 'hindu': 25, 'kush': 1, 'absenc': 118, 'green': 465, 'scrub': 33, 'spring': 162, 'water': 703, 'nuristan': 1, 'levant': 34, 'misnam': 2, 'smaller': 105, 'labour': 44, 'contract': 156, 'broncho': 1, 'billi': 407, 'cheapi': 12, 'disput': 31, 'indig': 3, 'mildli': 174, 'fairli': 587, 'peco': 3, 'oater': 10, 'unit': 344, 'lampooneri': 2, 'interject': 11, 'favour': 123, 'lecher': 28, '1920': 77, 'loi': 72, 'neilson': 2, 'disclosur': 6, 'privileg': 52, 'befriend': 111, 'emin': 33, 'mustard': 9, 'buster': 84, 'keaton': 308, 'broke': 151, 'frozen': 50, 'funnier': 173, 'hospit': 384, 'varmint': 1, 'inherit': 112, 'saloon': 52, 'owner': 326, 'bequeath': 3, 'weakl': 10, 'tenderfoot': 3, 'legal': 121, 'heir': 44, 'hmmm': 50, 'bequest': 1, 'properti': 98, 'ownership': 13, 'decis': 353, 'crude': 206, 'weiner': 3, 'whiner': 10, 'audiard': 25, 'descript': 212, 'deaf': 90, 'univers': 592, 'secretari': 147, 'ignor': 565, 'frustrat': 339, 'reunit': 112, 'profund': 10, 'lip': 189, 'evolv': 116, 'observ': 277, 'emmanuel': 33, 'devo': 30, 'nomin': 420, 'actess': 1, 'cesar': 24, 'magistr': 10, 'prevent': 218, 'etud': 1, 'moeur': 1, 'ress': 2, 'witherspoon': 35, 'stylis': 17, 'triad': 48, 'chairman': 32, 'bribe': 27, 'track': 596, 'race': 495, 'tens': 157, 'expertli': 61, 'expans': 34, 'glori': 154, 'asian': 260, 'winc': 28, 'volum': 93, 'deeper': 177, 'murki': 50, 'feud': 31, 'underhand': 3, 'dept': 11, 'grew': 251, 'childhood': 360, 'talespin': 20, 'luften': 1, 'helt': 1, 'denmark': 30, 'chip': 65, 'dale': 32, 'ducktal': 10, 'forgiven': 63, 'slip': 144, 'edd': 2, 'hannah': 56, 'montana': 97, 'spirit': 778, 'tonight': 96, 'hid': 18, 'bank': 318, 'vividli': 60, 'user': 162, 'summari': 185, 'jon': 187, 'dustin': 58, 'ruinous': 1, 'frank': 488, '82': 23, 'imperson': 109, 'club': 466, 'persona': 143, 'bet': 287, 'mom': 382, 'seedi': 67, 'damag': 204, 'judgment': 82, 'courag': 192, 'compass': 97, 'humil': 19, 'packag': 116, 'trivia': 70, 'ratzo': 3, 'auto': 54, 'lo': 171, 'input': 20, 'cruis': 145, 'nightclub': 66, '26': 46, 'legit': 8, 'smell': 76, 'hue': 14, 'buck': 306, 'grandma': 57, 'incid': 176, 'kinki': 36, 'bedroom': 112, 'salari': 23, 'clariti': 45, 'deliver': 65, 'defin': 246, 'potent': 54, 'conquer': 70, 'sodom': 10, 'unapp': 46, 'friendship': 316, 'bewilder': 11, 'unasham': 8, 'devot': 176, 'oscar': 1007, 'firework': 33, 'rave': 140, 'brenda': 84, 'viccaro': 1, 'epitom': 62, 'nitti': 9, 'brink': 45, 'disreput': 3, 'pointedli': 5, 'quicker': 16, 'heartbroken': 16, 'schlesing': 19, 'chillingli': 12, 'waldo': 10, 'salt': 71, 'clairvoy': 17, 'proud': 188, 'maker': 657, 'compunct': 1, 'mamet': 44, 'fraught': 13, 'overton': 46, 'psychiatrist': 126, 'lure': 91, 'confid': 194, 'margaret': 119, 'lindsay': 75, 'crous': 34, 'sell': 414, 'driven': 239, 'discont': 10, 'resolv': 131, 'vulner': 131, 'hahn': 4, 'steven': 335, 'goldstein': 2, 'owe': 142, 'gambler': 35, 'interven': 36, 'mantegna': 29, 'charismat': 135, 'twenti': 330, 'slate': 33, 'card': 249, 'cadenc': 8, 'intricaci': 20, 'memor': 714, 'demonstr': 249, 'lesson': 407, 'urgenc': 36, 'relentless': 63, 'whether': 856, 'specul': 41, 'rivet': 118, 'lend': 121, 'nuanc': 134, 'willingli': 39, 'shadow': 318, 'outstand': 417, 'rigid': 33, 'roil': 2, 'calm': 93, 'exterior': 73, 'induc': 146, 'penetr': 38, 'dynam': 171, 'nussbaum': 1, 'joey': 128, 'lilia': 5, 'skala': 3, 'littauer': 1, 'walsh': 87, 'businessman': 83, 'ricki': 59, 'jay': 161, 'maci': 102, 'sergeant': 85, 'moran': 26, 'quintessenti': 50, 'calib': 84, 'dictionari': 18, 'cinematograph': 157, 'freddi': 310, 'franci': 92, 'eleph': 141, '19th': 77, 'centuri': 580, 'medicin': 54, 'thoma': 254, 'hung': 98, 'crimin': 537, 'stockpil': 2, 'prefer': 371, 'fresher': 7, 'maverick': 43, 'sleazebag': 5, 'fallon': 53, 'timothi': 118, 'broom': 16, 'consequ': 228, 'slum': 48, 'feebl': 54, 'jonathan': 99, 'pryce': 10, 'rea': 54, 'buddi': 367, 'bombast': 29, 'overact': 168, 'irish': 195, 'silver': 155, 'lagoon': 13, 'twiggi': 1, 'whore': 71, 'flower': 124, 'mee': 1, 'shillin': 1, 'julian': 87, 'sand': 81, 'anger': 226, 'anxieti': 48, 'dalton': 97, 'sewag': 8, 'overli': 249, 'caract': 3, 'hangov': 19, 'repres': 420, 'splatter': 125, 'abound': 63, 'anal': 30, 'probe': 27, 'c': 617, 'mon': 84, 'betacam': 2, 'troma': 60, 'moon': 302, 'prop': 157, '16': 157, 'elabor': 147, 'halloween': 244, 'k': 243, 'ton': 200, 'southwest': 16, 'monument': 65, 'kri': 52, 'slower': 47, 'watchabl': 311, 'divorc': 175, 'ruin': 565, 'boogeyman': 42, 'meaningless': 112, 'descent': 91, 'graviti': 38, 'intent': 604, 'inconsist': 127, 'bronson': 73, 'easili': 892, 'phoni': 90, 'obsolet': 24, 'will': 384, 'succumb': 41, 'falsifi': 2, 'hair': 594, 'dye': 24, 'pacifi': 6, 'jericho': 19, 'church': 428, 'subscrib': 21, 'supremacist': 7, 'teach': 315, 'spokesman': 5, 'principl': 105, 'sudden': 250, 'abrupt': 76, 'revers': 128, 'deniro': 82, 'nobl': 158, 'psychot': 123, 'paranoia': 93, 'void': 53, 'fleet': 87, 'assumpt': 52, 'ungodli': 9, 'stem': 41, 'constant': 292, 'irrat': 40, 'racism': 153, 'credibl': 316, 'preoccup': 15, 'inner': 211, 'ghetto': 62, 'sterotyp': 2, 'spout': 58, 'ebon': 6, 'phrase': 117, 'proudli': 36, 'racial': 113, 'slur': 8, 'reson': 84, 'empath': 38, 'understatedli': 2, 'cultur': 762, 'maintain': 210, 'ghetoiz': 1, 'canadian': 242, 'identifi': 207, 'ratio': 38, '85': 53, '1sound': 9, 'dolbi': 19, 'digitalfollow': 1, 'jessica': 171, 'jenna': 56, 'whishaw': 3, 'dour': 27, 'spark': 143, 'kindr': 11, 'immers': 76, 'mutual': 70, 'traumat': 83, 'intrud': 58, 'dom': 42, 'rothero': 1, 'digit': 161, 'rag': 49, 'feet': 236, 'quietli': 76, 'reward': 188, 'conserv': 115, 'rhi': 34, 'meyer': 87, 'coach': 129, 'teammat': 17, 'si': 20, 'schedul': 80, 'bfgw': 1, 'envelop': 47, 'kher': 14, 'crisi': 153, 'filler': 77, 'elsewher': 140, 'unexplor': 14, 'countdown': 14, 'hint': 314, 'vent': 28, 'climb': 150, 'wink': 42, 'static': 67, '1408': 5, 'spook': 29, 'signal': 64, 'wireless': 5, 'internet': 155, 'incontinu': 1, 'addit': 499, 'adrenalin': 39, 'freedom': 249, 'repress': 98, 'kline': 73, 'dispatch': 54, 'steve': 483, 'biko': 89, 'custodi': 37, 'attenborough': 75, '3200': 1, 'shorter': 66, 'sacrific': 167, 'revel': 212, 'turkish': 47, 'banyo': 1, 'nada': 25, 'zilch': 6, 'nil': 10, 'dislik': 257, 'jeez': 21, 'forsaken': 20, 'millionair': 87, 'earn': 235, 'sleazi': 169, 'focus': 491, 'whini': 57, 'junk': 195, 'r': 433, 'nuditi': 596, 'profan': 93, 'lincoln': 176, 'historian': 64, 'merril': 33, 'peterson': 37, 'amazingli': 174, 'wronghead': 2, 'dissert': 11, 'abraham': 93, 'frederick': 13, 'douglass': 7, 'tag': 132, 'gallagh': 14, 'interpret': 293, 'semin': 23, 'culmin': 79, 'phase': 61, 'authorship': 3, '1939': 76, 'mohawk': 6, 'stagecoach': 20, 'purblind': 1, 'perceiv': 83, 'triptych': 2, 'mythic': 56, 'revolutionari': 116, 'extend': 169, 'medit': 53, 'errand': 13, 'wilder': 152, 'manifest': 48, 'strive': 69, 'reconcil': 35, 'civiliz': 1, 'inmpuls': 1, 'howler': 15, 'trotti': 5, 'justic': 418, 'merci': 112, 'lawgiv': 1, 'teleplay': 10, 'sandburg': 2, 'biographi': 99, 'babe': 144, 'shu': 9, 'qi': 11, '6': 541, 'orient': 143, 'burglar': 15, 'candi': 293, 'vandebrouck': 1, 'amanda': 101, 'rove': 4, 'stinker': 117, 'shoddi': 83, 'fok': 1, 'wong': 59, 'jing': 2, 'photogen': 12, 'contempl': 96, 'zen': 20, 'oik': 2, 'dyer': 25, 'countrysid': 103, 'attack': 864, 'recov': 124, 'straighthead': 11, 'misogynist': 39, 'prude': 14, 'characteris': 74, 'unexplain': 74, 'unsaid': 6, 'properli': 167, 'shane': 25, 'meadow': 50, 'shoe': 176, 'ce': 4, 'sera': 2, 'jule': 64, 'naudet': 21, 'rooki': 67, 'firefight': 44, 'trade': 185, 'hanlon': 12, 'ladder': 78, 'inspect': 13, 'repair': 42, 'ga': 208, 'leak': 34, 'firehous': 7, 'airplan': 106, 'plane': 380, 'tower': 144, 'grizzli': 7, 'gori': 235, 'cb': 68, 'uncensor': 12, 'sale': 105, 'chariti': 33, 'devoid': 104, 'hail': 57, 'hitler': 309, 'newsweek': 5, 'peac': 270, 'ahem': 21, 'sack': 58, 'inaccur': 63, 'gentl': 122, 'tool': 146, 'honor': 251, 'legendari': 192, 'galigula': 1, '1000': 47, 'telli': 34, 'shelf': 103, 'sixti': 116, 'sarn': 37, 'coloss': 15, 'suprem': 72, 'untal': 29, 'preciou': 121, 'featurett': 40, 'similarli': 98, 'talentless': 32, 'geneviev': 3, 'inappropri': 107, 'facial': 185, 'bat': 223, 'twitter': 3, 'incap': 58, 'giler': 2, 'faux': 49, 'infant': 43, 'wool': 10, 'indic': 229, 'superfici': 143, 'breckinridg': 25, 'embodi': 60, 'mindless': 155, 'touchston': 9, 'vein': 88, 'vacuiti': 5, 'clunki': 50, 'senseless': 103, 'obtrus': 14, 'intrus': 51, 'clip': 263, 'brekinridg': 1, 'bottomless': 6, 'insuffici': 22, 'wit': 739, 'challeng': 428, 'nonexist': 37, 'wise': 421, 'slim': 52, 'introduct': 173, 'calamit': 4, 'flopperoo': 1, 'heck': 222, 'heel': 89, 'soupcon': 1, 'crackl': 21, 'brow': 57, 'zeu': 6, 'um': 53, 'oop': 34, 'wing': 256, 'licens': 56, 'agreement': 26, 'denigr': 17, 'poke': 105, 'outstrip': 2, 'cheesiest': 20, 'displeasur': 25, 'assassin': 223, 'eighti': 127, 'vauxhal': 1, 'belmont': 4, 'subaru': 1, 'imprezza': 1, 'prior': 192, 'so19': 1, 'cia': 124, 'children': 1515, 'implaus': 140, 'airport': 96, 'heathrow': 3, 'posher': 1, 'castl': 357, 'helicopt': 124, 'stair': 71, 'soil': 25, 'sway': 50, 'aftermath': 52, 'tire': 459, 'bonu': 97, 'befuddl': 17, 'sundanc': 53, 'uncomfort': 169, 'dedic': 152, 'treasur': 241, 'trove': 7, 'notwithstand': 37, 'pitt': 199, 'austrian': 28, 'climber': 22, 'shape': 273, 'unabash': 18, 'scriptwrit': 80, 'rosenstrass': 39, 'advers': 40, 'reichdeutch': 1, 'jewish': 164, 'lock': 337, 'pend': 6, 'deport': 12, 'aristocrat': 77, 'disown': 17, 'lena': 99, 'fischer': 17, 'mob': 165, 'gudarian': 1, 'rank': 274, 'reich': 14, 'detaine': 1, 'ostfront': 2, 'horrifi': 153, 'lest': 25, 'brutish': 15, 'bush': 150, 'imperi': 44, 'presenc': 416, 'offenc': 17, 'regrett': 31, 'der': 91, 'fuher': 2, 'fumbler': 1, 'fortun': 373, 'ruth': 122, 'respond': 111, 'arthur': 374, 'von': 184, 'eschenbach': 1, 'oppos': 167, 'holocost': 1, 'rebelli': 58, 'renam': 19, 'helga': 20, 'lehmann': 2, 'sieg': 32, 'mourn': 58, 'guis': 31, 'deem': 66, 'grandfath': 101, 'penguin': 53, 'winter': 242, 'lush': 78, 'franc': 290, 'fairi': 216, 'titular': 44, 'renard': 5, 'christen': 9, 'bertil': 4, 'noel': 24, 'beuneau': 1, 'japanes': 714, 'miscellan': 2, 'adversari': 33, 'eleg': 123, 'postcard': 14, 'overdr': 11, 'wist': 22, 'establish': 356, 'onset': 15, 'persist': 47, 'tame': 130, 'trace': 106, 'prey': 88, 'latter': 362, 'foe': 40, 'wolv': 35, 'embroil': 11, 'undergon': 10, 'attest': 16, 'bawl': 10, 'toddler': 29, 'goer': 100, 'resent': 59, 'meddl': 17, 'lean': 118, 'bruneau': 4, 'ugh': 58, 'owen': 98, 'token': 67, 'anaconda': 10, 'armageddon': 30, 'rocket': 150, 'rushmor': 7, 'lili': 175, 'taylor': 316, 'catherin': 143, 'zeta': 38, 'legitim': 67, 'bia': 47, 'belov': 178, 'stoltz': 34, 'nigel': 15, 'hawthorn': 10, 'dastardli': 16, 'sensit': 240, 'tissu': 41, 'whoa': 27, 'monday': 40, 'nugget': 17, 'thug': 149, 'bea': 7, 'beatric': 19, 'endlessli': 60, 'fave': 26, 'xanadu': 1, 'wanna': 158, 'flaw': 659, 'sentenc': 192, '747': 21, 'tip': 111, 'transmiss': 15, 'regist': 84, 'ruthless': 111, 'sensation': 22, 'neglect': 109, 'overwhelmingli': 20, 'sincer': 196, 'graham': 94, 'crusad': 41, 'freakish': 18, 'canon': 45, 'vote': 382, 'forthright': 5, 'pregnant': 178, 'boston': 71, 'pennsylvania': 9, 'speed': 304, 'sect': 13, 'protest': 114, 'bibl': 139, 'silverman': 48, 'compliment': 91, 'tch': 17, 'righteou': 37, 'struggl': 709, 'grandpa': 44, 'marbl': 22, 'channel': 548, 'immor': 42, 'rude': 89, 'loser': 228, 'keanu': 40, 'eg': 35, 'pube': 2, 'diarrhea': 9, 'troll': 32, 'dont': 74, 'eastwood': 139, 'hingl': 10, 'kirsten': 45, 'dunst': 43, 'overr': 115, 'izzard': 37, 'sympath': 100, 'mile': 383, 'daniel': 339, 'lewi': 276, 'christi': 165, 'cerebr': 67, 'palsi': 25, 'fricker': 28, 'conner': 5, 'mcanal': 15, 'cinemag': 6, 'seizur': 18, 'procedur': 39, 'coincid': 131, 'sid': 82, 'pink': 88, '200': 61, 'spider': 101, 'highlight': 370, 'wendi': 99, 'wu': 42, 'homecom': 18, 'yen': 7, 'temporarili': 22, 'buddhist': 19, 'monk': 128, 'shen': 18, 'blah': 195, 'dcom': 5, '3rd': 105, 'measur': 169, 'deliber': 171, 'overwatch': 1, 'advic': 262, 'twice': 387, 'mate': 202, 'climat': 84, 'media': 307, 'capitalist': 40, 'mode': 81, 'revisionist': 8, 'butcher': 128, 'bakersfield': 8, 'inclus': 63, 'theti': 1, 'leg': 296, 'dari': 2, 'rant': 91, 'killian': 12, 'stalker': 87, 'gladiat': 44, 'wwe': 76, 'buzz': 74, 'grisli': 36, 'core': 259, 'ostens': 45, 'ventur': 110, 'sven': 8, 'thorssen': 1, 'muscl': 70, 'arni': 45, 'bud': 134, 'mick': 51, 'fleetwood': 4, 'glossti': 1, 'thesp': 1, 'joan': 302, 'fontain': 72, 'victorian': 62, 'convincingli': 93, 'rushworth': 1, 'herbert': 55, 'cun': 39, 'calcul': 57, 'extraordinari': 173, 'banton': 2, 'lillian': 25, 'flora': 20, 'drab': 54, 'outlandish': 49, 'donovan': 15, 'despic': 73, 'aloof': 26, 'dessert': 21, 'shaki': 83, 'henri': 424, 'caron': 59, 'choreographi': 116, 'truckload': 9, 'awe': 119, 'ballet': 99, 'stunningli': 61, 'rhythm': 77, 'array': 47, 'singin': 31, 'rain': 319, 'moviego': 42, 'mileag': 8, 'harron': 44, 'styliz': 66, 'psych': 66, 'len': 52, 'immort': 99, 'curv': 34, 'recit': 68, 'statu': 265, 'prim': 11, 'valedictorian': 3, 'nashvil': 11, 'tennesse': 21, 'bondag': 67, 'sketchi': 20, 'bio': 49, 'pic': 37, 'notori': 187, 'instantli': 128, 'improp': 6, 'belabor': 10, 'applic': 30, 'sacr': 35, 'secular': 21, 'rambl': 97, 'splendid': 123, 'gretchen': 43, 'mol': 69, 'fool': 388, 'deni': 222, 'sport': 383, 'thick': 119, 'conceal': 46, 'intim': 100, 'thoroughli': 350, 'bravura': 18, 'comeback': 59, 'obscur': 181, 'devour': 38, 'bought': 458, 'adolesc': 112, 'dusti': 33, 'barber': 10, 'dime': 35, 'essenc': 138, 'conceiv': 168, 'liv': 24, 'tyler': 74, 'grate': 146, 'hasten': 10, 'sensual': 69, 'translat': 291, 'exhuber': 1, 'suspect': 519, 'disc': 139, 'legion': 54, 'chock': 47, 'uniniti': 14, 'paula': 63, 'klaw': 17, 'doorway': 27, 'scribe': 9, 'opin': 6, 'madonna': 111, 'cone': 7, 'brassier': 3, 'godmoth': 24, 'fetishwear': 1, 'kin': 14, 'russel': 236, 'logan': 81, 'lou': 124, 'patrick': 223, 'chan': 225, 'kober': 12, 'extraordinair': 8, 'tess': 44, 'traci': 182, 'griffith': 118, 'resurrect': 100, 'satan': 179, 'chamber': 58, 'marguerit': 2, 'arlen': 8, 'access': 165, 'rid': 122, 'kidnap': 281, 'ritual': 81, 'ceremoni': 66, 'mykelti': 3, 'williamson': 22, 'occult': 50, 'gate': 133, 'goofi': 168, 'leap': 113, 'toss': 134, 'quip': 36, 'furiou': 82, 'nadia': 24, 'bjorlin': 7, 'engin': 148, 'wager': 19, 'natasha': 39, 'screw': 182, 'priceless': 86, 'verdict': 55, 'lindsey': 42, 'lower': 257, 'pedest': 11, 'trobl': 1, 'disney': 755, 'shia': 24, 'labeouf': 18, 'stanley': 168, 'yelnat': 13, 'alredi': 2, 'daytim': 46, 'emmi': 44, 'jackson': 346, 'scarier': 39, 'releg': 24, 'talor': 2, 'dudley': 66, 'doright': 1, 'quigon': 1, 'liam': 56, 'neeson': 36, '13th': 85, 'queenish': 1, 'widmark': 155, 'fisticuff': 6, 'lengthi': 89, 'overdon': 120, 'sustain': 81, 'forbidden': 120, 'sf': 58, 'fifti': 148, 'sluggish': 20, 'extinct': 33, 'krell': 30, 'id': 63, 'relev': 186, 'allur': 55, 'tide': 59, 'countless': 136, 'lilli': 47, 'undiscov': 11, 'previous': 204, 'passag': 79, 'india': 179, 'aforement': 126, 'charlott': 98, 'gray': 127, 'acut': 18, 'cate': 25, 'blanchett': 5, 'sensibl': 149, 'share': 581, 'claudia': 18, 'karvan': 3, 'alli': 136, 'screenwrit': 230, 'laura': 166, 'boyd': 22, 'underst': 92, 'gandhi': 122, 'fighter': 150, 'stress': 148, 'territori': 143, 'dwell': 61, 'fortunetli': 3, 'anil': 58, 'kapoor': 115, 'feroz': 11, 'abbad': 1, 'khan': 102, 'akshay': 125, 'haril': 41, 'barrist': 12, 'overturn': 5, 'showcas': 162, 'formal': 36, 'footstep': 36, 'infatu': 35, 'alter': 168, 'repuls': 108, 'pursu': 182, 'unsuccess': 47, 'bigger': 268, 'tenur': 6, 'hidden': 342, 'darshan': 6, 'jariwala': 6, 'mk': 3, 'larger': 143, 'shefali': 19, 'chaya': 1, 'kasturba': 7, 'bhumika': 2, 'chawla': 15, 'candidatur': 1, 'techniqu': 286, 'picturis': 7, 'defiantli': 8, 'impati': 24, 'watcher': 75, 'occupi': 90, 'shakedown': 3, 'erika': 59, 'eleniak': 17, 'sexi': 453, 'larson': 9, 'endless': 235, 'shootout': 84, 'monoton': 83, 'earthquak': 31, 'blurri': 25, 'cgi': 329, 'spiritu': 163, 'perlman': 28, 'mumbo': 24, 'jumbo': 31, 'completist': 32, 'correctli': 82, 'fought': 81, 'bastard': 65, 'politician': 118, 'traitor': 41, 'culprit': 25, 'sentinel': 79, 'abund': 66, 'lick': 39, 'elev': 169, 'neat': 154, 'pete': 80, 'garrison': 17, 'kiefer': 22, 'sutherland': 160, 'eva': 139, 'longoria': 56, 'basing': 77, 'clark': 283, 'johnson': 197, '24': 144, 'height': 155, 'rebeecca': 1, 'donaldson': 3, 'lovabl': 153, 'comet': 28, 'nikki': 5, 'spoil': 399, 'coerc': 13, 'kimmi': 5, 'gibler': 2, 'dj': 59, 'ashley': 89, 'candac': 8, 'cameron': 124, 'bure': 4, 'st': 151, 'elsewer': 1, 'punki': 4, 'brewster': 18, 'raven': 53, 'jodi': 79, 'sweetin': 11, 'steph': 5, 'spacecamp': 11, 'lea': 16, 'thompson': 85, 'cabaret': 21, 'delay': 51, '20th': 122, 'anniversari': 31, 'astronaut': 70, 'carnegi': 1, 'mellon': 1, 'campu': 51, 'bsa': 1, 'scout': 24, 'astronomi': 2, 'badg': 16, 'blew': 101, 'wound': 243, 'willard': 27, 'rockwel': 23, 'astrotech': 1, 'stockhold': 2, 'closer': 206, 'degre': 256, 'four': 915, '1986': 75, 'endeavour': 11, 'zone': 161, 'cube': 151, 'taut': 45, 'claustrophob': 71, 'cypher': 62, 'tediou': 218, 'incompet': 125, 'grass': 60, 'insect': 58, 'stimul': 71, 'buse': 18, 'react': 164, 'blakey': 2, 'swear': 182, 'catchphras': 19, 'dick': 300, 'elat': 6, 'revolt': 100, 'digust': 1, 'curious': 53, 'ryder': 17, 'bb': 13, 'chines': 338, 'grodin': 12, 'bottom': 435, 'galaxi': 63, '999': 14, 'tetsuro': 5, 'gain': 264, 'aveng': 106, 'trophi': 24, 'hunter': 329, 'maetel': 10, 'exquisit': 86, 'kindergarten': 20, 'elementari': 31, 'seoul': 9, 'korea': 56, 'phenomen': 65, 'japan': 293, 'tumultu': 13, 'weekday': 11, '9pm': 5, 'resid': 220, 'divid': 80, 'enorm': 149, 'vast': 104, 'enigmat': 54, 'conductor': 48, 'spacefar': 1, '1979': 74, 'nostalg': 98, 'heartfelt': 75, 'embark': 64, 'manhood': 24, 'thailand': 47, 'exot': 106, 'luggag': 12, 'nab': 14, 'u': 482, 'brokedown': 16, 'palac': 86, 'arbitrari': 32, 'system': 410, 'pristin': 20, 'hamper': 27, 'smuggl': 47, 'bra': 36, 'systemat': 14, 'visitor': 77, 'utter': 306, 'blockhead': 4, 'nag': 21, 'alic': 199, 'backpack': 9, 'guilti': 198, 'unexpect': 253, 'beckinsal': 56, 'solid': 510, 'oversold': 2, 'hype': 214, 'immatur': 71, 'radar': 34, 'goodi': 53, 'pullman': 30, 'miscast': 170, 'lawyer': 246, 'wri': 28, 'diffid': 10, 'asset': 62, 'injustic': 51, 'tourist': 91, 'holodeck': 12, 'tng': 28, 'jarada': 6, 'contact': 200, 'greatli': 154, 'insult': 434, 'picard': 14, 'shortli': 122, 'safeti': 98, 'devic': 256, 'outwit': 14, 'mobster': 68, 'gangland': 8, 'unusu': 362, 'overexposur': 4, 'saccharin': 23, 'squirrel': 17, 'wisdom': 89, 'intoler': 56, 'pixar': 68, 'journalist': 147, 'owl': 55, 'unmask': 17, 'fraud': 47, 'optimist': 62, 'uplift': 94, 'brosnan': 128, 'aunt': 204, 'nostalgia': 91, 'recognit': 90, 'dicki': 11, 'nyc': 86, 'alison': 86, 'cristina': 35, 'brownston': 14, 'hallucin': 81, 'lerman': 3, 'sarandon': 55, 'inquiri': 10, 'saniti': 46, 'toll': 32, 'health': 138, 'unfamiliar': 46, 'sinist': 164, 'unreal': 99, 'angelo': 37, 'gil': 26, 'mell': 7, 'menac': 238, 'apprais': 5, 'wallach': 32, 'burgess': 40, 'meredith': 48, 'solicit': 9, 'jose': 51, 'ferrer': 22, 'kennedi': 111, 'ava': 22, 'gardner': 32, 'walken': 142, 'bereng': 39, 'goldblum': 63, 'orbach': 10, 'hickey': 6, 'balsam': 16, 'jeffrey': 108, 'konvitz': 7, 'dispos': 92, 'gonzo': 13, 'darkman': 33, 'iii': 135, 'appallingli': 23, 'unengag': 15, 'contempt': 71, 'spars': 37, 'camerawork': 19, '101': 52, 'sleepwalk': 72, 'soft': 301, 'startl': 88, 'squint': 6, 'roxann': 8, 'bigg': 18, 'dawson': 133, 'elanna': 3, 'klingon': 17, 'bumpi': 6, 'lighter': 65, 'bleach': 23, 'websit': 126, 'hood': 196, 'discuss': 397, 'lohan': 24, 'mc': 27, 'conaughey': 1, 'hammerhead': 38, 'puddl': 26, 'rudimentari': 18, 'moreov': 75, 'youtub': 61, 'lonelygirl15': 2, 'webcam': 3, 'amateurish': 222, 'afford': 139, 'mall': 109, 'bias': 80, 'zombiez': 4, 'edendal': 1, 'basement': 145, 'redneck': 67, 'vampyr': 19, 'slayer': 27, 'shepi': 3, 'scarecrow': 144, 'distinct': 182, 'pacino': 204, 'snack': 23, 'relax': 164, 'purchas': 215, 'cap': 78, 'ney': 6, 'ivi': 30, 'arsen': 16, 'poison': 139, 'juici': 26, 'adulteress': 7, 'fontainey': 1, 'foremost': 49, 'floor': 324, 'flatli': 8, 'alda': 10, 'wore': 98, 'lapaglia': 1, 'tedium': 37, 'neophyt': 5, 'shred': 70, 'virtu': 72, 'pom': 11, 'lyric': 163, 'sink': 187, 'beer': 168, 'doubl': 433, 'bondi': 8, 'gear': 107, 'pommi': 1, 'arti': 58, 'mackenzi': 8, 'barri': 147, 'flamin': 1, 'chat': 59, 'hord': 37, 'aborigin': 69, 'servant': 136, 'australia': 126, 'abo': 14, 'yacca': 1, 'ie': 64, 'farc': 126, 'bonser': 1, 'segal': 47, 'barrel': 87, 'fodder': 43, 'cardboard': 132, 'dooper': 1, 'squat': 12, 'stealth': 31, 'terrorist': 192, 'afghanastan': 1, 'duski': 3, 'swell': 50, 'foop': 1, 'swoop': 18, 'surplu': 9, 'mj': 35, 'ponder': 85, 'awesomen': 1, 'slay': 26, 'claymat': 20, 'clay': 58, 'anthropomorph': 7, 'rabbit': 104, 'pesci': 29, 'rohmer': 49, 'duke': 192, 'journal': 50, 'revolut': 198, 'stilt': 95, 'backdrop': 141, 'terror': 314, 'remov': 229, 'poverti': 133, 'spoilt': 24, 'unenlighten': 2, 'acclaim': 118, 'cabl': 285, 'dicken': 101, 'starv': 55, 'workhous': 5, 'fagin': 42, 'dodger': 24, 'sunset': 54, 'publicli': 19, 'syke': 37, 'growl': 33, 'passiv': 47, 'trebl': 3, 'bbc': 174, 'whitewash': 9, 'baggag': 15, 'condemn': 87, 'yellow': 113, 'peril': 85, 'seaman': 15, 'yukon': 17, 'miner': 51, 'correspond': 35, 'russo': 49, 'socialist': 38, 'encompass': 33, 'immigr': 109, 'pacif': 68, 'coast': 90, 'threat': 148, 'advoc': 31, 'cart': 19, 'ambit': 118, 'xenophob': 4, 'atroc': 76, 'pressur': 125, 'deterior': 55, 'prophet': 68, 'samuel': 46, 'bronston': 3, 'cagney': 124, 'spencer': 59, 'shea': 29, 'burlesqu': 24, 'tanaka': 11, 'leonard': 111, 'vantag': 6, '1905': 4, 'outlin': 80, 'manchu': 32, 'swing': 147, 'susan': 186, 'hayward': 34, 'charmian': 2, 'kittredg': 2, '1955': 48, 'virginia': 94, 'mayo': 5, 'clock': 128, 'reliev': 52, 'homo': 26, 'erotic': 31, 'lent': 30, 'inquisit': 11, 'cuba': 109, 'gigli': 19, 'steinmann': 3, 'unseen': 83, 'pleasantli': 124, 'nevertheless': 236, 'benefic': 8, 'ambiti': 129, 'jennif': 260, 'californian': 5, 'forgot': 178, 'trio': 114, 'exaggeratedli': 6, 'friendli': 196, 'suspici': 111, 'museum': 103, 'curat': 22, 'ernest': 44, 'keller': 29, 'introvert': 18, 'victoria': 233, 'amalgam': 16, 'cellar': 23, 'voyeur': 40, 'craze': 101, 'inbr': 26, 'unappet': 5, 'treatment': 246, 'chicken': 94, 'neg': 402, 'unpretenti': 25, 'modestli': 9, 'unsettl': 110, 'denouement': 51, 'promis': 607, 'lift': 198, 'lassick': 12, 'anxiou': 52, 'psychiatr': 35, 'charley': 25, 'cheswick': 1, 'flew': 38, 'cuckoo': 26, 'nest': 44, 'pervert': 95, 'furst': 11, 'handicap': 62, 'unnerv': 42, 'exploit': 497, '1952': 30, 'marion': 86, 'lorn': 19, 'stutter': 25, 'bumbl': 97, 'ubba': 1, 'bubba': 26, 'bewitch': 26, 'walter': 251, 'matthau': 156, 'verifi': 16, 'swedish': 112, 'rhapsodi': 11, 'hugo': 45, 'alfven': 1, 'southern': 180, 'peeper': 9, 'danzel': 2, 'clive': 55, 'copycat': 11, 'unpredict': 95, 'rebe': 1, 'eyebrow': 51, 'spectacl': 64, 'cecil': 64, 'hickock': 31, 'ellison': 6, 'buffalo': 89, 'jean': 375, 'calam': 27, 'jane': 662, 'quinn': 84, 'ebay': 38, 'elit': 77, 'gameplay': 25, 'addict': 261, 'restrict': 79, 'freelanc': 9, 'server': 5, 'softwar': 27, 'multiplay': 5, 'campaign': 85, 'onlin': 89, 'stagger': 47, 'wreck': 172, 'wormhol': 8, 'quid': 12, 'manual': 20, 'xplosiv': 1, 'v': 277, 'retarded': 2, 'faint': 70, 'sooooo': 20, 'goof': 72, 'mac': 39, 'sugar': 79, 'terranc': 2, 'crate': 15, 'secon': 1, 'retard': 186, 'byyyyyyyyeeee': 1, 'patronag': 3, 'luca': 149, 'lumag': 1, 'out': 74, 'kiddi': 63, 'ralph': 147, 'bakshi': 132, 'heyday': 26, 'synonamess': 1, 'botch': 44, 'rod': 78, 'rescueman': 1, 'pompou': 40, 'novic': 32, 'frivoli': 1, 'murkwood': 1, 'mor': 4, 'ought': 116, 'cull': 13, 'milder': 7, 'variant': 13, 'vh': 288, 'unavail': 24, 'interestingli': 69, 'selick': 1, 'fincher': 6, 'kaddiddlehopp': 2, 'col': 24, 'san': 220, 'knott': 19, 'whomev': 27, 'easier': 132, 'milton': 16, 'berl': 5, 'benni': 44, 'stitch': 46, '61': 11, 'fond': 132, '1971': 81, 'preconcept': 13, 'confirm': 114, 'flag': 70, 'wad': 4, 'manageress': 1, 'gallon': 15, 'neck': 166, 'staff': 112, 'custom': 118, 'intoxic': 1, 'heroin': 353, 'caress': 18, 'auction': 19, 'fascist': 70, 'degrad': 87, 'bruckhiem': 1, 'reclus': 26, 'ex': 468, 'upset': 201, 'upper': 160, 'warm': 365, 'blowup': 8, 'resolut': 152, 'gong': 18, 'snapshot': 21, 'promin': 107, 'unlucki': 35, 'norma': 32, 'marilyn': 54, 'lesser': 165, 'luckless': 3, 'stiller': 118, 'allegedli': 32, 'aniston': 43, 'jovial': 10, 'daredevil': 13, 'alleg': 64, 'gross': 237, 'regul': 19, 'chunder': 2, 'sweati': 21, 'shart': 1, 'hamburg': 31, 'dinner': 157, 'rancid': 27, 'kudrow': 20, 'odiou': 11, 'marci': 21, 'johnathan': 4, 'frake': 11, 'razor': 67, 'graduat': 122, 'drank': 11, 'tobacco': 19, 'canal': 23, 'joint': 57, 'blasphemi': 12, 'supermarion': 4, 'motor': 39, 'penelop': 53, 'disfigur': 33, 'thunderbird': 77, 'fab': 14, 'appropri': 309, 'royc': 11, 'finest': 278, 'motorcar': 3, 'jaguar': 8, 'own': 150, 'placement': 44, 'news': 331, 'sponsor': 42, 'futurist': 121, '1960': 197, 'function': 156, 'strictli': 129, 'overcom': 199, 'puppet': 146, 'stanislavski': 4, 'overplay': 38, 'kingsley': 37, 'zimmer': 14, 'thunder': 57, 'apollo': 40, 'commun': 555, 'kyrano': 3, 'outlet': 28, 'esp': 24, 'decept': 73, 'undetect': 14, 'defens': 102, 'pistol': 50, 'thudnerbird': 1, 'theatric': 262, 'nemesi': 75, 'cohort': 25, 'flight': 188, 'deviat': 27, 'sophist': 170, 'kip': 13, 'fuller': 83, 'kiss': 305, 'hypocrisi': 29, 'lunaci': 20, 'pickup': 42, 'pigeonhol': 6, 'contractor': 22, 'stealer': 15, 'thlema': 1, 'ritter': 136, 'stooli': 10, 'forti': 156, 'mainstream': 202, 'slapstick': 177, 'edgi': 86, 'seed': 126, 'sl': 2, 'darn': 81, 'relief': 246, 'crisp': 61, 'composit': 98, 'sunshin': 117, 'defici': 21, 'corn': 65, 'organis': 39, 'oppikoppi': 1, 'dismay': 34, 'regular': 295, 'raunchier': 1, 'wittier': 4, 'sa': 25, 'sista': 5, 'bling': 8, '1800': 28, 'randolph': 64, 'lil': 43, 'midriff': 5, 'blous': 21, 'stapl': 43, 'cowgirl': 20, 'dawg': 4, 'earp': 27, 'hug': 68, 'snow': 156, 'forese': 20, 'switzerland': 34, 'sen': 30, 'unik': 1, 'swiss': 40, 'sold': 162, 'vice': 98, 'versa': 47, 'nerv': 119, 'sometin': 1, 'spread': 138, 'zurich': 2, 'samir': 4, 'unorigin': 88, 'clint': 110, 'relaunch': 2, 'cv': 17, 'durst': 4, 'jude': 48, 'harlen': 6, 'maguir': 37, 'alittl': 3, 'unsur': 61, 'newman': 79, 'conrad': 65, 'paus': 108, 'delic': 83, 'lotr': 34, 'cthd': 2, 'moulin': 11, 'roug': 29, '1930': 223, 'conduct': 81, 'intensifi': 16, 'mend': 33, 'rariti': 32, 'lookout': 14, 'centr': 110, 'growth': 62, 'china': 188, 'burtynski': 24, 'neutral': 43, 'extern': 33, 'citizen': 200, 'offend': 217, 'fassbind': 56, 'wilki': 2, 'connoisseur': 18, 'marleen': 7, '1981': 70, 'maria': 175, 'braun': 18, 'lola': 59, 'dialect': 35, 'thesi': 20, 'antithesi': 16, 'synthesi': 11, 'instanc': 341, 'abolish': 6, 'concret': 27, 'underground': 175, 'ruler': 31, 'chiastic': 2, 'abstract': 49, 'scheme': 183, 'transcend': 75, '1975': 58, 'schmid': 22, 'priori': 2, 'controversi': 210, 'germani': 227, 'primit': 82, 'schema': 1, 'scrutin': 5, 'synthet': 13, 'ethic': 57, 'survivor': 186, 'deed': 97, 'ancestor': 43, 'exclud': 32, 'evalu': 52, 'strategi': 31, 'fienn': 30, 'nauseat': 52, 'russian': 342, 'null': 4, 'carrer': 16, '35': 96, 'transsexu': 18, 'process': 327, 'daisi': 89, 'idiot': 464, 'savant': 13, 'lassal': 12, 'intellectu': 251, 'slab': 9, 'diari': 74, 'danver': 9, 'enabl': 74, 'malefiqu': 9, 'creepiest': 21, 'grimi': 18, 'shadowi': 32, 'lovecraft': 8, 'valett': 15, '67': 9, 'domain': 27, 'bela': 94, 'lugosi': 195, 'fluid': 64, 'gland': 7, 'hag': 16, 'giant': 440, 'rossitto': 6, '1932': 48, 'plucki': 15, 'phenomenon': 71, 'soprano': 129, 'unfalt': 1, 'falco': 18, 'gandolfini': 43, 'sampl': 43, 'fierc': 52, '1454': 1, 'sorcer': 27, 'alar': 4, 'marnac': 4, 'naschi': 70, 'mistress': 96, 'mabil': 3, 'lancr': 5, 'lin': 41, 'lycanthropi': 5, 'execution': 11, 'betsab': 1, 'ruiz': 8, 'mauric': 41, 'roland': 26, 'vic': 34, 'suriani': 1, 'anc': 11, 'evok': 127, 'villa': 43, 'sade': 18, 'estat': 137, 'monasteri': 37, 'elvira': 155, 'cohen': 70, 'thor': 9, 'amulet': 7, 'demoniac': 1, '98': 43, 'tomb': 61, 'disclos': 32, 'brazil': 116, 'guzman': 24, 'unrel': 87, 'trauma': 64, 'closest': 94, 'rundown': 15, 'alongsid': 90, 'rodriguez': 48, 'hem': 7, 'entrench': 11, 'sexism': 21, 'finess': 19, 'pale': 78, 'drain': 97, 'feminin': 66, 'flavor': 67, 'compuls': 46, 'avenu': 26, 'nurtur': 23, 'negoti': 37, 'simplest': 27, 'enthusiast': 126, 'satisfact': 54, 'impetu': 15, 'undo': 19, 'luzhin': 46, 'defenc': 31, 'gorri': 11, 'insur': 90, 'satisfactori': 37, 'exacerb': 4, 'resort': 146, 'alexand': 122, 'turturro': 30, 'chess': 96, 'tournament': 30, 'seemingli': 347, 'cope': 105, 'subtl': 437, 'disenfranchis': 9, 'achil': 29, 'valentinov': 5, 'stuart': 80, 'reappear': 27, 'unwelcom': 15, 'disconcert': 24, 'formid': 33, 'oppon': 66, 'turati': 1, 'fabio': 8, 'sartor': 1, 'fourteen': 28, 'natalia': 16, 'emili': 125, 'watson': 86, 'textur': 54, 'forebod': 39, 'underli': 87, 'pastor': 43, 'weav': 77, 'unrush': 2, 'underplay': 18, 'heighten': 53, 'feign': 8, 'disastr': 73, 'impecc': 55, 'inadequaci': 10, 'geoffrey': 41, 'helfgott': 2, 'lidz': 1, 'unstrung': 1, 'thou': 23, 'fountain': 19, 'moonlight': 29, 'reserv': 111, 'outgo': 8, 'introspect': 34, 'importantli': 127, 'acceler': 19, 'geraldin': 26, 'vera': 52, 'stassard': 1, 'blyth': 12, 'ilya': 3, 'orla': 7, 'bradi': 110, 'anna': 251, 'tandi': 3, 'luigi': 12, 'petrucci': 1, 'santucci': 1, 'restrain': 84, 'sorrow': 64, 'inhuman': 43, 'cruelti': 74, 'inasmuch': 8, 'romp': 96, 'fade': 187, 'kay': 118, 'kyser': 11, 'unleash': 85, 'hackett': 6, 'rumor': 77, 'costello': 27, 'abbott': 30, 'pleasant': 236, 'inn': 24, 'brook': 234, 'homeless': 147, 'kane': 136, 'loung': 21, 'titan': 214, 'revil': 11, 'complaint': 216, 'mel': 119, 'sixteenth': 6, 'aunti': 23, 'pineappl': 8, 'ditzi': 15, 'valeri': 40, 'sabrina': 84, 'libbi': 11, 'grinder': 15, 'tooth': 95, 'stuntman': 23, 'mmmmm': 4, 'greg': 83, 'lombardo': 2, 'knot': 20, 'macbeth': 34, 'manhattan': 121, 'shakespear': 298, 'updat': 132, 'cleverli': 94, 'tribul': 42, 'yorker': 41, 'brooklyn': 106, 'neighborhood': 158, 'downtown': 35, 'loft': 12, 'ripper': 28, 'horrif': 171, 'abysm': 110, 'bernson': 3, 'dental': 36, 'cring': 174, 'madam': 31, 'zeroni': 2, 'hmmmmmmmmm': 1, 'bandit': 41, 'sir': 187, 'counsel': 29, 'warden': 53, 'stinki': 5, 'savini': 29, 'romero': 118, 'dusk': 20, 'lousiest': 4, 'plastic': 151, 'headlin': 43, 'stupidest': 34, 'boo': 65, 'someday': 69, 'shawshank': 27, 'waterfront': 31, 'analyz': 72, 'tid': 3, 'cafe': 34, 'bustelo': 2, 'reus': 17, 'cup': 136, 'grandson': 35, 'hispan': 39, 'foundat': 60, 'bonanza': 48, 'pernel': 8, 'whitak': 15, 'landon': 19, 'blocker': 10, '1964': 38, 'gunfight': 60, 'harmoni': 42, 'undoubtedli': 107, 'hijink': 16, 'hoss': 11, 'patriarch': 38, 'ranch': 56, 'canari': 7, 'mitch': 65, 'vogel': 4, 'delinqu': 31, 'preachi': 72, 'counter': 101, 'dragnet': 9, 'hawaii': 39, 'bandwagon': 16, 'mischief': 13, 'cartwright': 32, 'limp': 48, 'offici': 188, 'ponderosa': 11, 'drifter': 39, '1959': 61, 'declin': 101, '465': 1, 'spectacular': 250, 'wargam': 21, '2008': 81, 'zealous': 1, 'code': 266, 'realism': 279, '1990': 200, 'wave': 306, 'farmer': 99, 'mash': 48, 'mous': 168, 'ripley': 30, 'paragraph': 49, 'wiki': 6, 'entri': 191, '01': 29, 'broderick': 29, 'joshua': 40, 'tic': 14, 'tac': 5, 'fandom': 4, 'fay': 165, 'spain': 85, 'angela': 85, '1961': 21, 'fanzin': 3, 'eke': 6, 'bout': 51, 'uglier': 9, 'unmatch': 10, 'angelopoulo': 19, 'mastroianni': 38, 'moreau': 19, 'ilia': 12, 'logothethi': 1, 'gregori': 79, 'karr': 1, 'overshadow': 57, 'stanc': 55, 'khrysik': 1, 'albeit': 157, 'beforehand': 44, 'artwork': 68, 'sparingli': 4, 'greek': 122, 'albanian': 7, 'kurdish': 6, 'geordi': 5, 'bricklay': 2, 'lucki': 258, 'ale': 3, 'newcastl': 4, 'emet': 1, 'spall': 20, 'jimmi': 284, 'kindest': 4, 'crocodil': 111, 'spender': 2, 'auf': 1, 'wiedersehen': 1, 'pet': 202, 'appli': 170, 'stumbl': 224, 'slap': 227, 'inadequ': 23, 'sergio': 43, 'martino': 48, 'giallo': 120, 'wardh': 7, 'unforgett': 149, 'tail': 97, 'dario': 17, 'argento': 33, 'jewel': 82, 'crown': 85, 'profondo': 1, 'rosso': 1, 'payout': 3, 'edwig': 5, 'fenech': 6, 'hilton': 40, 'marino': 5, 'repeatedli': 119, 'anita': 48, 'strindberg': 12, 'chair': 181, 'bath': 161, 'nicolai': 13, 'ernesto': 10, 'gastaldi': 5, 'pitfal': 19, 'snippet': 45, 'waist': 34, 'instructor': 38, 'dangl': 25, 'carabin': 1, 'climbi': 1, 'lobotom': 7, 'colorado': 14, 'dolomit': 1, 'mogul': 17, 'swallow': 93, 'jedi': 64, 'saga': 108, 'jabba': 44, 'hut': 20, 'empir': 128, 'allianc': 59, 'tatooin': 10, 'pit': 133, 'slaveri': 46, 'scum': 31, 'tripl': 71, 'leia': 34, 'chewi': 7, 'endor': 16, 'deactiv': 3, 'shield': 70, 'lando': 18, 'darth': 52, 'vader': 74, 'beach': 216, 'vacat': 170, 'gape': 27, 'miser': 235, 'choppi': 76, 'happier': 36, 'yell': 191, 'smithereen': 9, 'worthless': 128, 'librari': 143, 'tripe': 78, 'seidelman': 3, 'columbo': 208, 'culp': 27, 'patricia': 73, 'crowley': 8, 'weaker': 62, 'blackmail': 89, 'misfortun': 67, 'olsen': 48, 'disgustingli': 18, 'imbecil': 27, 'artifici': 124, 'rib': 29, 'trier': 67, 'europa': 68, 'uncl': 347, 'purser': 2, 'luxu': 1, 'concious': 2, 'focuss': 7, 'werewolv': 59, 'hypnosi': 13, 'stride': 34, 'reproduct': 16, 'unnatur': 54, 'maughan': 3, 'viper': 8, 'fieri': 41, 'hatr': 122, 'withdrawn': 15, 'traffic': 68, 'oblivi': 47, 'multitud': 23, 'whistl': 36, 'send': 439, 'npr': 3, 'natgeo': 1, 'repackag': 7, 'sanit': 20, 'koyannisquatsi': 1, 'sic': 18, 'storytel': 204, 'gabriel': 117, 'scraggi': 2, 'hush': 22, 'hypnot': 87, 'wisconsin': 23, 'logand': 6, 'rori': 27, 'culkin': 40, 'bobbi': 148, 'cannaval': 11, 'hiv': 33, 'guardian': 59, 'collett': 56, 'armistead': 5, 'maupin': 7, 'stetner': 1, 'sew': 9, 'loop': 48, 'restaur': 138, 'collet': 5, 'chilli': 17, 'spolier': 1, 'moviepick': 1, 'tall': 121, 'reggi': 13, 'thiev': 61, 'hears': 18, 'karat': 57, 'liz': 37, 'behead': 29, 'midget': 58, 'sphere': 21, 'implant': 28, 'skull': 98, '1993': 82, 'unreleas': 10, 'anticlimact': 16, 'nonsens': 371, 'andrei': 21, 'chikatilo': 23, 'rostov': 8, '52': 17, 'obstruct': 10, 'soviet': 125, 'bureaucraci': 19, 'untouch': 32, 'silenc': 156, 'lamb': 52, 'inexperienc': 39, 'forens': 25, 'charg': 308, 'dumann': 4, 'docu': 12, 'societ': 32, 'diminish': 57, 'genit': 28, 'mutil': 61, 'wage': 34, 'inequ': 12, 'allah': 13, 'justif': 44, 'bahrain': 13, 'sima': 1, 'mobarak': 1, 'shahi': 1, 'shayesteh': 2, 'irani': 24, 'ayda': 1, 'sadeqi': 1, 'golnaz': 1, 'farmani': 1, 'mahnaz': 1, 'zabihi': 1, 'prosecut': 39, 'illumin': 45, 'muslim': 137, 'villag': 308, 'unwritten': 7, 'paternalist': 2, 'popul': 200, 'no': 3, 'bless': 120, 'smoochi': 3, 'insomnia': 55, 'quick': 341, 'autobiographi': 37, 'godbi': 1, 'resurfac': 11, 'sociopath': 37, 'caretak': 57, 'bruce': 393, 'gentli': 38, 'wont': 101, 'prefect': 3, 'zelnik': 2, 'hallway': 47, 'pensiv': 8, 'griev': 51, 'disappointingli': 17, 'atyp': 23, 'fluff': 71, 'imo': 59, 'boggi': 17, 'creek': 64, 'ecstat': 13, 'fauk': 1, 'bigfoot': 39, 'sneek': 1, 'monsoon': 6, 'tarp': 1, 'storm': 186, 'ya': 105, 'whop': 13, 'kargil': 9, 'exact': 201, 'cussword': 3, 'stretcher': 6, 'battalion': 13, 'miniscul': 10, 'weep': 42, 'synchron': 41, 'dupatta': 1, 'mockumentari': 28, 'upstag': 20, 'jab': 26, 'rpg': 21, 'gamer': 27, 'substanc': 230, 'snl': 97, 'skit': 138, '87': 16, 'katt': 6, 'audio': 113, 'delet': 78, 'rom': 30, 'wallpap': 12, 'easter': 18, 'egg': 74, 'menu': 36, 'healthi': 64, 'haggard': 25, 'gruesom': 180, 'sign': 503, 'downward': 42, 'ax': 30, 'lodg': 21, 'noon': 34, 'wannab': 134, 'townspeopl': 32, 'wastebasket': 3, '1956': 34, 'concho': 7, 'stinko': 4, 'geeki': 31, 'hopkin': 76, 'encod': 3, 'incess': 26, 'microcut': 1, 'unstabl': 48, 'unrecogniz': 19, 'weirdest': 14, 'uncovent': 1, 'unequ': 5, 'effortless': 29, 'motto': 9, 'percent': 37, 'kentucki': 33, 'fri': 101, 'bozo': 12, 'zucker': 23, 'pauli': 133, 'shore': 56, 'peni': 38, 'kman': 1, 'squirt': 19, 'semen': 14, 'carrot': 20, 'bag': 186, 'bikini': 67, 'gut': 231, 'mock': 120, 'satir': 389, 'muscular': 36, 'whenev': 270, 'stuck': 350, 'squar': 139, 'iron': 414, 'farrelli': 26, 'bodili': 17, 'buildup': 16, 'masturb': 53, 'bathroom': 117, 'ear': 205, 'leno': 36, 'duncan': 30, 'volunt': 53, 'karen': 116, 'nolin': 1, 'baywatch': 13, 'angelyn': 1, 'price': 335, 'reiser': 50, 'falk': 122, 'kleinman': 9, 'soever': 1, 'outcom': 132, 'shall': 133, 'blu': 16, 'dennehi': 10, 'pantalino': 2, 'fahey': 23, 'biz': 17, 'poetri': 92, 'ooz': 45, 'eon': 12, 'extent': 172, 'vocal': 94, 'credenc': 10, 'conspiraci': 146, 'sociolog': 21, 'epidem': 29, 'demi': 27, 'mond': 2, 'francisco': 123, 'decomposit': 5, 'pervad': 16, 'partli': 127, 'irit': 3, 'levi': 47, 'crusti': 18, 'garishli': 2, 'turandot': 4, 'motif': 44, 'sublim': 75, 'athey': 1, 'glorious': 22, 'minstrel': 14, 'walthal': 11, 'enact': 48, 'edgar': 95, 'poe': 74, 'noisi': 24, 'cement': 39, 'mixer': 2, '09': 8, 'inimit': 16, 'dramaturgi': 6, 'apposit': 6, 'childlik': 28, 'utopian': 9, 'rufu': 17, 'jorney': 2, 'orchestr': 62, 'winger': 32, 'panzerkreuz': 1, 'potemkin': 4, 'eraserhead': 14, 'aguirr': 3, 'wrath': 43, 'apocalyps': 48, 'soleil': 6, 'artsi': 74, 'fartsi': 8, 'defam': 6, 'ps': 51, 'raul': 28, 'unidentifi': 9, 'dictat': 90, 'el': 77, 'president': 7, 'dreyfuss': 45, 'parador': 15, 'sonia': 17, 'braga': 16, 'tkotsw': 1, 'sammi': 83, 'chace': 5, 'gravi': 8, 'corey': 52, 'hatian': 1, 'dinosaur': 210, 'dung': 33, 'superbabi': 4, 'theodor': 46, 'rex': 131, 'bust': 111, 'expens': 209, 'whoopi': 97, 'cave': 128, 'paycheck': 54, 'clone': 93, 'launch': 118, 'missil': 75, 'sun': 200, 'mankind': 90, 'kati': 46, 'coltran': 22, 'agit': 14, 'bite': 214, 'backseat': 17, 'monstros': 35, 'duck': 90, 'barney': 49, 'artisticli': 1, 'lucienn': 14, 'ascend': 19, 'prix': 21, 'beut': 1, 'louis': 90, 'esoter': 26, 'fa': 13, 'ade': 8, 'transgress': 11, 'mm': 23, 'andrea': 38, 'marschal': 2, 'yentl': 14, 'talmud': 2, 'avigdor': 5, 'hadass': 5, 'anschel': 5, 'consumm': 34, 'signific': 264, 'substitut': 87, 'papa': 30, 'streisand': 152, 'lipstick': 20, 'lash': 18, 'blush': 19, 'giveaway': 9, '1900': 21, 'unaccept': 19, 'weaken': 24, 'scrap': 31, 'thirdli': 21, 'wiser': 27, 'fuel': 73, 'lastli': 49, 'hater': 41, 'inject': 93, 'unworthi': 14, 'discourag': 27, 'unquot': 2, 'uneven': 111, 'burgi': 5, 'plight': 94, 'reproduc': 24, 'cram': 52, 'hostil': 62, 'yarn': 42, '1958': 47, 'tyron': 22, 'gloria': 52, 'talbott': 2, 'fowler': 3, 'goldberg': 123, 'madman': 43, 'labor': 89, 'betuel': 2, 'anem': 9, 'charit': 23, 'drown': 138, 'una': 21, 'deacon': 1, 'frost': 52, 'choreograph': 145, 'muerto': 10, 'predecessor': 104, 'unintellig': 35, 'heartach': 10, 'duffi': 4, 'ewe': 5, 'affleck': 66, 'hollywoodland': 4, 'venic': 22, 'ite': 2, 'sitcom': 211, 'workday': 3, 'rerun': 56, 'cc': 3, 'nope': 67, 'entireti': 60, 'network': 236, 'roadkil': 10, 'ringmast': 14, 'springer': 76, 'talkshow': 2, 'unresolv': 21, 'rightli': 46, 'auditor': 2, 'louuu': 1, 'siana': 1, 'aiello': 34, 'paymer': 4, 'bridget': 80, 'fonda': 112, 'zapatti': 7, 'recap': 29, 'sting': 37, 'letdown': 44, 'splash': 56, 'lemon': 33, 'pud': 14, 'superbad': 4, 'disreguard': 1, 'she': 20, 'underwear': 61, 'molli': 90, 'kirk': 114, 'dorki': 23, 'platon': 8, 'mishap': 34, 'afer': 2, 'raunchi': 45, 'largo': 17, 'winch': 12, 'karl': 78, 'roden': 2, 'antagonist': 70, 'kristin': 26, 'tomer': 3, 'sisley': 3, 'miki': 9, 'manojlov': 4, 'radivoj': 1, 'bukvic': 1, 'goran': 6, 'linguist': 10, 'croatian': 9, 'seasid': 25, 'island': 598, 'phantom': 90, 'merced': 12, 's500': 2, 'bmw': 6, 'limousin': 9, 'dazzl': 95, 'twine': 4, 'enlighten': 99, 'gloomi': 48, 'morbid': 75, 'reve': 23, 'jeroen': 20, 'krabb': 38, 'lectur': 76, 'literatur': 91, 'vlissingen': 3, 'railway': 26, 'amsterdam': 10, 'beautician': 4, 'christin': 73, 'halsslag': 2, 'ren': 25, 'soutendijk': 15, 'widow': 199, 'sphinx': 19, 'thom': 12, 'ln': 1, 'whiskey': 16, 'snoop': 34, 'reel': 134, 'vierd': 12, 'verhoeven': 119, 'dutch': 105, 'inconclus': 6, 'androgyn': 5, '4o': 1, 'homem': 2, '4th': 65, 'sullavan': 31, 'morgan': 275, 'budapest': 22, 'schoedsack': 3, 'migrat': 25, 'bakhtiari': 6, 'persia': 1, 'pastur': 12, 'pamper': 9, 'barefoot': 12, 'flip': 122, 'roberson': 3, 'damnat': 5, 'dodg': 60, 'lightn': 59, 'bolt': 45, 'bubbl': 104, 'entranc': 76, 'spew': 48, 'rehears': 78, 'venom': 67, 'jealou': 121, 'teri': 21, 'hatcher': 20, 'housew': 30, 'downey': 79, 'slimi': 71, 'smarmi': 36, 'snaki': 1, 'sycophant': 8, 'seaton': 5, 'celest': 39, 'talbert': 7, 'moriarti': 22, 'moorehead': 13, 'conspir': 29, 'grin': 74, 'aisl': 28, 'comedienn': 26, 'size': 201, 'caterpillar': 6, 'cocoon': 8, 'blossom': 59, 'joyou': 30, 'glorifi': 71, 'elisabeth': 25, 'shue': 32, 'babysit': 25, 'niec': 73, 'screwbal': 54, 'novela': 7, 'timeless': 128, 'spoof': 242, 'gooder': 8, 'crimelord': 2, 'rival': 217, 'moroni': 11, 'proof': 155, 'be': 130, 'meteor': 59, 'hatch': 32, 'prehistor': 31, 'plesiosaur': 7, 'jurass': 39, 'monstrou': 33, 'krige': 21, 'kraus': 21, 'newest': 21, 'tanya': 21, 'madchen': 8, 'amick': 15, 'allerg': 14, 'bestsellerist': 1, 'koontz': 2, 'barker': 46, 'jaw': 193, 'droppingli': 13, 'graveyard': 59, 'eeri': 155, 'candlelit': 1, 'gothic': 136, 'pollut': 50, 'potti': 20, 'tactic': 80, 'toilet': 144, 'vilifi': 9, 'rapist': 96, 'manur': 12, 'coup': 85, 'etat': 6, 'democrat': 42, 'literaci': 6, 'constitut': 64, 'slander': 5, 'openli': 43, 'repercuss': 17, 'dictatori': 4, 'gloat': 4, 'toppl': 12, 'venezuela': 32, 'reinstal': 1, 'fairytal': 36, 'explicit': 120, 'benevol': 13, 'chavez': 76, 'cadet': 21, 'snotti': 15, 'duh': 51, 'skate': 39, 'hockey': 32, 'olymp': 43, 'puke': 45, 'headach': 72, 'tween': 8, 'beal': 32, 'tibetan': 19, 'ghoul': 19, 'tacki': 83, 'penniless': 12, 'tensionless': 2, '1972': 97, 'inferior': 104, 'unfulfil': 21, 'recogniz': 76, 'carradin': 96, 'ireland': 115, 'domergu': 25, 'macaulay': 17, 'ham': 144, 'grind': 53, 'prevail': 53, 'rot': 68, 'delici': 113, 'downbeat': 38, 'bloodier': 6, 'flounder': 33, 'shudderi': 6, 'cue': 104, 'blandli': 12, 'rawk': 2, 'cook': 247, 'bowel': 20, 'mcbain': 31, 'snap': 98, 'deck': 51, 'clearenc': 1, 'rack': 59, 'bloodlust': 6, 'thirst': 22, 'joel': 81, 'garcia': 34, 'novelist': 51, 'paralyz': 19, 'disabl': 105, 'hike': 27, 'adjust': 59, 'raymond': 94, 'surli': 21, 'biker': 72, 'bloss': 9, 'forsyth': 51, 'divers': 131, 'substanti': 62, 'loyal': 102, 'helen': 152, 'laudabl': 3, 'stubborn': 39, 'neil': 134, 'jimenez': 4, 'micheal': 36, 'steinberg': 5, 'warmth': 86, 'disarm': 23, 'candor': 5, 'irrevoc': 5, 'motel': 46, 'poignanc': 30, 'wickedli': 25, 'earthi': 11, 'nocturn': 9, 'expedit': 82, 'uniformli': 65, 'zabriski': 40, 'dote': 17, 'amiabl': 33, 'pena': 5, 'compassion': 39, 'nurs': 161, 'grim': 195, 'testament': 85, 'astonish': 114, 'durabl': 4, 'abc': 125, 'tighter': 29, '74': 14, 'rippa': 1, 'loudli': 30, 'proclaim': 68, 'cinderella': 236, 'cheapen': 17, 'platform': 53, 'jia': 2, 'ke': 13, 'xiao': 10, 'differenti': 24, 'yimou': 8, 'chen': 39, 'kage': 1, 'cari': 109, 'victor': 240, 'mclaglen': 83, 'jaff': 27, 'gunga': 66, 'din': 84, 'lowest': 92, 'capric': 19, 'flawless': 126, 'altman': 114, 'candlelight': 9, 'boyhood': 15, 'blazer': 9, 'foreign': 275, 'biter': 6, 'estonian': 7, 'treasuri': 15, 'billion': 47, 'graini': 74, 'newli': 89, 'emancip': 11, 'baltic': 4, 'tallin': 3, 'fastest': 11, 'rafifi': 1, 'topkapi': 4, 'glossi': 46, 'unexcit': 22, '2004': 119, 'render': 180, 'ell': 4, 'acrobat': 29, 'lilith': 15, 'wander': 246, 'stab': 185, 'throat': 159, 'spectat': 46, 'secondari': 76, 'explod': 174, 'dishevel': 11, 'suspend': 130, 'disbelief': 175, 'suspicion': 77, 'galor': 30, 'misl': 13, 'gard': 40, 'vue': 9, 'jerom': 18, 'martinaud': 4, 'serrault': 11, 'inspector': 167, 'gallien': 4, 'lino': 6, 'ventura': 23, 'insector': 1, 'marchand': 9, 'eve': 119, 'rape': 559, 'wordi': 14, 'root': 297, 'clearer': 20, 'chantal': 2, 'romi': 27, 'schneider': 55, 'defend': 195, 'tea': 136, 'profound': 141, 'melanchol': 14, 'elsa': 45, 'passant': 1, 'souci': 1, 'antoin': 13, 'interlocutor': 1, 'hesit': 99, 'acknowledg': 109, 'abnorm': 16, 'lt': 39, 'judgement': 50, 'uncov': 82, 'fiendish': 11, 'shower': 186, 'groom': 42, '1967': 54, 'stark': 80, 'elmer': 37, 'gantri': 10, 'tin': 44, 'roof': 86, 'blackboard': 20, 'not': 16, 'darren': 83, 'renov': 21, 'toot': 13, 'handyman': 9, 'solac': 17, 'shoulder': 157, 'bargain': 110, 'resum': 69, 'matin': 27, 'scone': 1, 'butter': 20, 'motley': 21, 'bowler': 12, 'janean': 28, 'garofalo': 18, 'shovel': 38, 'rajah': 2, 'azariah': 1, 'spleen': 11, 'reuben': 25, 'pithi': 5, 'ident': 355, 'billionair': 13, 'collar': 58, 'menial': 10, 'neurot': 69, 'kinka': 4, 'usher': 31, 'franchis': 162, 'kaufman': 45, 'kundera': 12, 'tereza': 8, 'vital': 86, 'valid': 82, 'ize': 6, 'zealand': 47, 'spectacularli': 33, 'astut': 37, 'luxuri': 64, 'ferri': 58, 'stolen': 190, 'shortland': 4, 'dreamt': 8, 'gin': 8, 'salmonella': 1, 'primari': 106, 'autist': 27, 'carer': 3, 'blethyn': 16, 'hbo': 107, 'retail': 15, 'exorcist': 59, '14': 213, 'broomstick': 20, 'categor': 27, 'crappiest': 7, 'sane': 43, 'hotshot': 7, 'bachelor': 69, 'senat': 65, 'classmat': 54, 'aggi': 5, 'smitten': 33, 'fianc': 144, 'withstand': 27, 'rigor': 20, 'blitz': 11, 'banter': 68, 'nevermind': 17, 'elegantli': 17, 'personag': 8, 'krishna': 32, 'vamsi': 2, 'shakti': 23, 'desi': 29, 'sridevi': 4, 'nandini': 11, 'karisma': 19, 'tiku': 1, 'talsania': 1, 'jaspal': 1, 'bhatti': 3, 'shekhar': 22, 'sanjay': 15, 'raja': 20, 'jai': 18, 'gidwani': 1, 'ail': 26, 'deepti': 7, 'naval': 35, 'reachindia': 1, 'throng': 8, 'bu': 199, 'uncertain': 40, 'terrain': 25, 'frenzi': 53, 'harm': 121, 'havel': 1, 'narsimha': 7, 'nana': 32, 'patekar': 16, 'nandani': 1, 'tyrann': 15, 'insist': 209, 'harrow': 50, 'cruel': 183, 'wrench': 78, 'rural': 110, 'drawback': 41, 'ismail': 4, 'darbar': 3, 'item': 144, 'ishq': 16, 'kameena': 1, 'anu': 12, 'malik': 21, 'extract': 47, 'helpless': 80, 'bang': 153, 'uncouth': 5, 'hilt': 26, 'versatil': 54, 'packet': 3, 'pr': 26, 'praiseworthi': 9, 'shahrukh': 18, 'churn': 59, 'thump': 18, 'trim': 36, 'hitch': 47, 'shelv': 44, 'turkey': 189, 'incomprehens': 101, 'robbin': 87, 'celluloid': 108, 'blank': 153, 'morita': 23, 'thurman': 59, 'toenail': 10, 'sock': 49, 'drawer': 25, 'invigor': 12, 'geni': 75, 'shaggi': 51, 'shaq': 32, 'shear': 13, 'nba': 11, 'rapper': 31, 'glenn': 123, 'armament': 3, 'defus': 11, 'steadi': 74, 'twelv': 115, 'vernon': 25, 'denham': 2, 'saboteur': 9, 'maddern': 1, 'metamorphosi': 21, 'eastman': 7, 'bloke': 46, 'personif': 9, 'avid': 48, 'but': 9, 'gemser': 4, 'eloqu': 36, 'houseman': 19, 'verg': 62, 'scientif': 120, 'dna': 24, 'fund': 121, 'decod': 7, 'block': 166, 'untest': 1, 'serum': 55, 'borrow': 190, 'cronenberg': 14, 'rapid': 61, 'syndrom': 59, 'ruggero': 8, 'deodato': 9, 'inflict': 69, 'carrier': 44, 'monti': 62, 'unemploy': 48, 'sheffield': 10, 'oklahoma': 22, 'northern': 67, 'inhabit': 177, 'urban': 204, 'pub': 44, 'lookalik': 20, 'metropolitan': 15, 'taciturn': 11, 'grunt': 28, 'chatter': 22, 'choir': 50, 'peak': 137, 'district': 49, 'aerial': 20, 'pylon': 2, 'bleak': 127, 'wale': 21, 'gwynedd': 1, 'walker': 129, 'postlethwait': 2, 'vacuum': 18, 'astray': 15, 'gigant': 51, 'petticoat': 4, 'wwii': 158, 'cheaper': 34, 'jayn': 23, 'mansfield': 26, 'ampl': 48, 'lawrenc': 111, 'olivi': 107, 'marjori': 36, 'athon': 3, 'amateurishli': 12, 'tribut': 145, 'porno': 100, 'holocaust': 67, 'somebodi': 299, 'squeamish': 27, 'horrorfest': 14, 'gravedanc': 3, 'fizzl': 16, 'errat': 31, 'mi': 33, '12': 330, 'freshli': 16, 'patriot': 99, 'secondli': 104, 'nato': 4, 'contin': 46, 'columbu': 14, 'espisod': 2, 'boobi': 30, 'altho': 6, 'rebellion': 46, 'foment': 6, 'persuad': 69, 'meat': 129, 'splice': 49, 'montag': 138, 'forewarn': 23, 'pavlov': 8, 'palett': 36, 'thereof': 39, 'fatal': 227, 'patch': 55, 'misdirect': 17, 'coward': 56, 'farm': 129, 'cosbi': 14, 'deceiv': 40, 'categoris': 5, 'roux': 1, 'aliciann': 1, 'barnett': 5, 'babysitt': 37, 'rosali': 10, 'nordon': 1, 'rosalion': 1, 'cole': 134, 'conveni': 130, 'cemeteri': 65, 'rhyme': 70, 'ketchup': 21, 'biopic': 61, 'obtus': 9, 'uncharacterist': 19, 'spontan': 73, 'tee': 17, 'abe': 24, 'fray': 10, 'courtroom': 58, 'cunningli': 10, 'interrog': 45, 'juri': 57, 'tablespoon': 2, 'americana': 18, 'moder': 74, 'sarcasm': 52, 'recip': 39, 'overtli': 36, 'allud': 38, 'grain': 33, 'ministri': 12, 'ordain': 2, 'dilemma': 72, 'earthli': 14, 'mortal': 90, 'oblivion': 37, 'fresnay': 6, 'recuper': 8, 'omit': 37, 'scope': 104, 'singabl': 2, 'behold': 81, 'earliest': 44, 'plunder': 10, 'blackjack': 3, 'bearabl': 37, 'adder': 4, 'rowan': 20, 'atkinson': 10, 'minist': 76, 'lauri': 59, 'sensat': 94, 'dimwit': 24, 'edmund': 44, 'connor': 79, 'ward': 144, 'brillianc': 130, 'elton': 21, 'curti': 142, 'funer': 114, 'homag': 153, 'kurt': 149, 'ubc': 1, 'corpor': 197, 'flynn': 147, 'wilbank': 1, 'heather': 44, 'chimpanze': 13, 'bug': 285, 'monkey': 230, 'chimp': 46, 'hairi': 40, 'raffl': 5, 'lamp': 29, 'guzzl': 4, 'bellow': 15, 'jeanni': 5, 'soo': 28, 'pose': 184, 'windshield': 20, 'doer': 10, 'disclam': 1, 'certif': 21, 'januari': 34, 'wacki': 96, 'cautionari': 16, 'fresh': 399, 'brett': 49, 'spano': 6, 'steami': 35, 'janet': 46, 'jordan': 67, 'ladd': 13, 'cedar': 1, 'promptli': 60, 'loonier': 1, 'stabil': 15, 'attorney': 95, 'holland': 42, 'bent': 71, 'pig': 145, 'milli': 15, 'sap': 53, 'maitland': 3, 'entitl': 75, 'hefti': 17, 'spousal': 4, '17': 177, 'carrel': 23, 'columnist': 14, 'straighten': 16, 'juliett': 56, 'binoch': 31, 'radiant': 23, 'specimen': 10, 'hazi': 19, 'hearken': 9, 'starlet': 37, 'muffin': 6, 'breakfast': 67, 'sweetli': 20, 'unrealist': 240, 'nosey': 5, 'gossipi': 5, 'quirki': 185, 'roller': 81, 'coaster': 77, 'whimsic': 45, 'geek': 83, 'teari': 9, 'outweigh': 27, 'intercours': 22, 'watermelon': 7, 'melon': 6, 'evapor': 9, 'yawn': 93, 'corrobor': 5, 'nearest': 39, 'exposit': 84, 'sword': 231, 'basil': 33, 'rathbon': 31, 'foil': 67, 'jeanson': 3, 'zenda': 5, 'lollabrigida': 2, 'tad': 97, 'print': 255, 'lennon': 60, 'verbal': 82, 'spar': 21, 'mccartney': 20, 'landmark': 60, 'souffl': 4, 'repay': 15, 'fold': 40, 'jang': 14, 'pornographi': 47, 'blend': 200, 'pornograph': 50, 'aggressor': 6, 'hauntingli': 17, 'graphic': 442, 'underdevelop': 43, 'quench': 5, 'streak': 42, 'gojitm': 3, 'congeal': 2, 'stronger': 133, 'remember': 2, 'daftli': 1, 'underton': 48, 'understood': 179, 'taboo': 72, 'privi': 14, 'unev': 26, 'ana': 29, 'oliveira': 1, 'perman': 70, 'preposter': 80, 'odet': 3, 'impostor': 11, 'mass': 254, 'portug': 22, 'noisiest': 1, 'rui': 1, 'po': 25, 'hunki': 38, 'apathi': 13, 'est': 21, 'vie': 8, 'kara': 26, 'tasuiev': 6, 'renaiss': 72, 'firstli': 90, 'ilona': 20, 'geneticist': 1, 'avalon': 18, 'bislan': 5, 'aficionado': 22, 'meaning': 149, 'enrich': 22, 'parisian': 30, 'genet': 63, 'oldi': 19, 'replay': 64, 'mytholog': 74, 'bla': 23, 'briefli': 135, 'nakata': 7, 'jona': 5, 'mueller': 7, 'farfella': 2, 'kasbah': 1, 'affabl': 19, 'linklat': 21, 'naghib': 1, 'poster': 201, 'rourk': 47, 'marv': 3, 'paragon': 7, 'decay': 49, 'brio': 5, 'brim': 29, 'naughtier': 1, 'retort': 5, 'eragorn': 1, 'undemand': 21, 'specialti': 22, 'circul': 18, 'furi': 90, 'wolfman': 27, 'ranger': 123, 'saban': 8, 'spawn': 65, 'moss': 53, 'claw': 57, 'mvc2': 1, 'pinnacl': 31, 'ahahahahahaaaaa': 1, 'eh': 48, 'simpler': 37, 'loy': 59, 'examin': 195, 'cake': 107, 'mendenhal': 1, '12th': 13, 'allport': 2, 'norment': 1, 'bergenon': 1, 'ld': 39, 'mcneill': 1, 'fever': 119, 'unclean': 2, 'massachusett': 16, 'puritan': 18, 'payn': 44, 'kerri': 34, 'noonann': 1, 'coloni': 116, 'breach': 12, '1700': 5, 'approv': 88, 'shelley': 95, 'perci': 12, 'byron': 46, 'opium': 7, 'piper': 33, 'perabo': 9, 'violet': 19, 'stanford': 8, 'bullwinkl': 5, 'kindegarden': 1, 'gooey': 11, 'congeni': 7, 'cozi': 18, 'bachelorett': 4, 'cohes': 59, 'unflatt': 12, 'deborah': 38, 'su': 29, 'mcdermott': 38, 'sean': 263, 'protocol': 24, 'sunni': 81, 'kooki': 23, 'bimboesqu': 1, 'dignitari': 3, 'diplomat': 25, 'goldi': 53, 'hawn': 49, 'vomit': 79, 'poop': 28, 'samara': 1, 'yuck': 23, 'cantones': 7, 'vcd': 7, 'subcharact': 1, 'grossli': 38, 'irk': 13, 'wender': 19, 'spt11': 1, 'amerian': 1, 'religion': 262, 'lana': 27, 'hopeless': 102, 'reno': 40, 'descend': 105, 'ripe': 27, 'socket': 13, 'convolut': 128, 'coffin': 56, 'parad': 100, 'legaci': 80, 'spruce': 5, 'goos': 25, 'necklac': 19, 'invest': 137, 'miseri': 97, 'proxim': 12, 'oprah': 44, 'winfrey': 17, 'speilberg': 7, 'schlock': 70, 'corset': 10, 'rut': 15, 'rampag': 78, 'fur': 45, 'brazilian': 44, 'brighten': 18, 'sherlock': 46, 'holm': 196, 'snatch': 65, 'andr': 99, 'benjamin': 48, 'outkast': 3, 'strut': 33, 'standout': 76, 'liotta': 45, 'maniac': 137, 'macha': 12, 'sorter': 7, 'casino': 68, 'solitari': 23, 'compens': 97, 'amass': 5, 'diagnos': 21, 'incur': 14, 'ticket': 177, 'relent': 5, 'ploy': 29, 'loom': 37, 'zack': 21, 'avi': 9, 'elus': 29, 'humbl': 106, 'nod': 120, 'experiment': 102, 'preset': 1, 'underhanded': 1, 'intric': 71, 'puzzl': 144, 'garner': 110, 'rever': 50, 'junki': 44, 'magnolia': 33, 'canva': 30, 'shriek': 48, 'overwrought': 39, 'twit': 17, 'bedevil': 4, 'guilt': 145, 'pt': 7, 'overlong': 71, 'digress': 40, 'tableau': 6, 'cosmic': 20, 'scoff': 11, 'fabl': 50, 'converg': 14, 'biblic': 68, 'cadr': 4, 'devote': 19, 'aime': 12, 'mann': 124, 'blanca': 6, 'alba': 42, 'elimin': 109, 'downplay': 18, 'esteban': 14, 'tercero': 2, 'segundo': 3, 'pancha': 1, 'garc': 7, 'fundament': 80, 'unjustli': 19, 'schumak': 1, 'georgetown': 3, 'grad': 14, 'scrambl': 22, 'moor': 244, 'judd': 64, 'mccarthi': 50, 'emilio': 17, 'estevez': 4, 'sheedi': 26, 'mare': 18, 'winningham': 10, 'lang': 90, 'borzag': 16, 'celesti': 20, 'metaphor': 141, 'abel': 9, 'ganc': 2, 'roue': 2, 'heavenli': 38, 'comrad': 36, 'riffraff': 3, 'cassandra': 30, 'cookbook': 11, 'neighbour': 55, 'nicknam': 31, 'drunkard': 6, 'temper': 81, 'aplenti': 14, 'parton': 4, 'steer': 71, 'coccio': 14, 'cal': 57, 'rover': 8, 'awhil': 78, 'humphrey': 29, 'bogart': 56, 'mitchum': 61, 'tackl': 95, 'exposur': 88, 'thelma': 55, 'unglamour': 1, 'dirk': 18, 'benidict': 1, 'galact': 9, 'incorpor': 88, 'crow': 84, 'pimp': 46, 'juan': 52, 'fernandez': 11, 'hathaway': 6, 'stylishli': 13, 'kinjit': 7, 'thread': 120, 'psychoanalyt': 9, 'unrestrain': 10, 'instinct': 155, '43': 22, 'skg': 1, 'aviat': 14, 'brill': 4, 'mendl': 1, 'gage': 36, 'ballroom': 38, '57': 12, 'pix': 4, 'entertaingli': 1, 'snowman': 51, 'waaaaaaaaaaay': 1, 'becuz': 4, 'mason': 67, 'gunsmok': 5, '30pm': 3, 'regardless': 125, 'cybil': 31, 'shepperd': 2, 'mavi': 1, 'wig': 84, 'en': 76, 'rout': 84, 'morgu': 32, 'orchid': 18, 'lorenz': 17, 'seclud': 32, 'clutch': 37, 'monogram': 12, 'countess': 23, 'prima': 10, 'vermont': 15, 'tree': 279, 'grove': 7, 'vt': 1, 'airlin': 37, 'overnight': 33, 'gayer': 4, 'tribal': 23, 'tattoo': 50, 'bori': 64, 'karloff': 148, 'vollin': 3, 'surgic': 14, 'iren': 59, 'hind': 18, 'disapprov': 26, 'edmond': 14, 'bateman': 5, 'inexplic': 143, 'simon': 299, 'crotcheti': 5, 'vaudevil': 38, 'stanwyck': 161, 'knuckl': 20, 'instruct': 69, 'mixtur': 104, 'pvt': 6, 'snafu': 20, 'incorrectli': 10, 'panic': 123, 'demor': 1, 'baloney': 12, '65': 26, 'bumper': 9, 'sticker': 14, 'slogan': 7, 'suess': 6, 'analog': 44, 'balloon': 46, 'juic': 51, 'geisel': 5, '1943': 49, 'towner': 8, 'manic': 47, 'announc': 153, 'mug': 56, 'lemmon': 111, 'cillian': 36, 'mcadam': 49, 'we': 121, 'craven': 123, 'bump': 89, 'efx': 7, 'scariest': 62, 'changl': 2, 'prostitut': 197, 'phisiqu': 1, 'lens': 24, 'lexicon': 4, 'geisha': 57, 'destin': 126, 'cigarret': 1, 'messeng': 15, 'borin': 1, 'kowalkski': 2, 'viggo': 34, 'mortenson': 3, 'bulk': 64, 'vansish': 1, 'mystic': 113, 'priestli': 9, 'transfix': 16, 'skeptic': 75, 'smoki': 11, 'loues': 1, 'taught': 95, 'doorstep': 18, 'detest': 23, 'gerrit': 2, 'lerner': 21, 'zane': 70, 'busbi': 44, 'telegraph': 40, 'squash': 11, 'grape': 20, 'lampoon': 86, 'golddigg': 3, 'merk': 19, 'travesti': 84, 'backlash': 12, 'grub': 10, 'cycl': 68, 'bionic': 3, 'wopat': 4, 'bo': 157, 'reform': 47, 'moonshin': 9, 'dynamit': 48, 'arrow': 78, 'bow': 97, 'mcqueen': 64, 'denver': 36, 'pyle': 14, 'jessi': 34, 'sandwich': 34, 'chore': 50, 'earnest': 68, 'naivet': 25, 'gimmick': 96, 'buckl': 12, 'roar': 63, 'leer': 33, 'wisecrack': 44, 'bait': 63, 'incorrupt': 6, 'marijuana': 42, 'gawk': 11, 'buxom': 10, 'nubil': 19, 'consult': 31, 'poll': 8, 'imho': 44, 'simpson': 146, 'doll': 203, 'slut': 52, 'download': 58, 'pin': 129, 'restroom': 17, 'bach': 62, 'pratfal': 16, 'elicit': 45, 'conjur': 42, 'slurpe': 1, 'warner': 200, 'bro': 84, 'guantanamo': 7, 'bay': 93, 'schnook': 4, 'meg': 87, 'cuter': 13, 'mathematician': 11, 'glanc': 85, 'greas': 45, 'usernam': 2, 'grammat': 3, 'trend': 92, 'wholeheartedli': 20, 'filmgo': 4, 'palat': 28, 'palpabl': 32, 'ol': 64, 'championship': 85, 'bogglingli': 5, 'dummi': 31, 'mandatori': 36, 'quasi': 49, 'brag': 20, 'peg': 26, 'incept': 7, 'stir': 102, 'pattern': 97, 'templat': 19, 'emphas': 88, 'eagl': 54, 'hardcor': 102, 'lament': 41, 'deris': 18, 'profici': 16, 'blatant': 104, 'liberti': 79, 'koschmidd': 1, 'kaiserkel': 2, 'indra': 3, 'semprinni20': 1, 'semprinni': 1, 'lavish': 65, 'backbeat': 2, 'epstein': 5, 'caf': 33, 'flake': 4, 'mit': 1, 'milch': 2, 'bassi': 1, 'sutcliff': 2, 'bass': 33, 'guitar': 80, 'impresario': 7, 'resurg': 11, 'wealth': 109, 'ideolog': 66, 'confucian': 2, 'adopt': 162, 'discrimin': 33, 'discard': 34, 'ebert': 71, 'moni': 3, 'nomine': 45, 'sharon': 78, 'mystifi': 23, 'anchorman': 33, 'burgundi': 18, 'champ': 19, 'louder': 15, 'gel': 19, 'salvag': 58, 'unus': 13, 'benign': 13, 'maya': 31, 'rudolph': 24, 'disk': 26, 'ferrel': 54, 'exec': 39, 'jeremi': 142, 'clarkson': 19, 'stylist': 61, 'myriad': 28, 'maudlin': 19, 'infuri': 33, 'disneyesqu': 2, 'fatuou': 6, 'nasa': 26, 'misinform': 13, 'webber': 13, 'wrestl': 125, 'firm': 86, '1980i': 1, 'lib': 30, 'mown': 1, 'pacifist': 24, 'evildo': 4, 'insofar': 2, 'extens': 93, 'cujo': 5, '1978': 77, 'hound': 53, 'puppi': 74, 'fruit': 63, 'veget': 31, 'skipper': 11, 'coencid': 1, 'yvett': 9, 'mimieux': 6, 'counti': 50, 'snowbeast': 1, 'bonni': 57, 'ike': 6, 'eisenman': 1, 'vourag': 1, 'nanni': 34, 'tuff': 4, 'turf': 14, 'darker': 117, 'kerchev': 1, 'dalla': 47, 'enfold': 2, 'summeri': 5, 'spell': 256, 'purist': 35, 'unhurri': 2, 'languid': 11, 'carolina': 20, 'woefulli': 41, 'marc': 79, 'vall': 8, 'stalwart': 37, 'lass': 9, 'longest': 60, 'reign': 89, 'monarch': 27, 'portion': 143, 'ascent': 4, 'throne': 40, 'miranda': 58, 'richardson': 92, 'conroy': 30, 'blunt': 98, 'rupert': 48, 'bloom': 79, 'girlish': 12, 'royal': 118, 'digniti': 120, 'melbourn': 42, 'bettani': 14, 'matur': 251, 'royalti': 26, 'birth': 204, 'statement': 242, 'gradi': 38, 'harp': 37, 'etiquett': 6, 'cambodia': 32, 'zombief': 2, 'somnambulist': 5, 'insati': 16, 'appetit': 32, 'melodramat': 131, 'mediev': 54, 'wizardri': 9, 'potter': 65, 'nightli': 14, 'potato': 31, 'mfer': 1, 'mose': 26, 'bryan': 33, 'grit': 26, 'deluis': 28, 'dessic': 2, 'pharaoh': 16, 'tut': 3, 'regalia': 2, 'overdub': 11, 'equival': 90, 'lingo': 9, 'dyno': 2, 'excrement': 31, 'flush': 42, 'tequila': 7, 'corona': 2, 'poseiden': 1, 'apt': 51, 'unsightli': 3, 'unfriendli': 16, 'sicken': 67, 'cosgrov': 1, 'enforc': 81, 'yr': 32, 'drastic': 48, 'preserv': 85, 'recruit': 101, 'milquetoast': 10, 'cromwel': 24, 'acm': 7, 'racket': 18, 'carlisl': 26, 'inoffens': 17, '1942': 40, 'dreifuss': 1, 'snobbi': 17, 'diss': 13, 'uptight': 41, 'label': 133, 'britney': 42, 'spear': 55, 'oversupport': 1, '1945': 69, 'burden': 54, 'pertain': 12, 'wield': 69, 'ballantra': 1, '1953': 59, 'fabian': 8, '1951': 49, 'abort': 92, '1954': 32, 'beckon': 8, 'seafar': 4, 'gloriou': 104, 'flabbier': 1, 'maureen': 50, 'hara': 69, 'tomboyish': 3, 'buccan': 8, 'crave': 53, 'baddi': 88, 'pirat': 119, 'roc': 3, 'brasiliano': 2, 'gusto': 38, 'falworth': 1, 'vintag': 57, 'youngster': 57, 'overblown': 56, 'caribbean': 26, 'prolif': 37, 'kelley': 7, 'captor': 22, '1940': 160, 'swan': 18, 'briskli': 9, 'incident': 110, 'doug': 47, 'mcclure': 21, 'unpreced': 21, 'dust': 97, 'catalogu': 23, 'dross': 23, 'yvonn': 25, 'carlo': 68, 'doul': 1, 'crossbon': 1, 'yanke': 42, 'acquir': 97, 'marin': 116, 'dmytyk': 1, 'mutini': 17, 'afor': 12, 'tortuga': 1, 'cruella': 40, 'vil': 10, 'cruela': 1, 'recast': 9, 'parrot': 57, 'depardieu': 43, 'mulva': 5, 'sugercoma': 1, 'ape': 222, 'awaken': 119, 'hotter': 17, 'debbi': 55, 'rochon': 24, 'seaver': 13, 'bonejack': 2, 'mighti': 87, 'lbp': 2, '31': 28, 'syrup': 19, 'galleri': 56, 'promo': 36, 'salad': 15, 'fiilthi': 1, 'mcnasti': 2, 'feral': 7, 'bonesett': 3, 'skater': 27, 'magician': 66, 'macabr': 62, 'crane': 21, 'wilbur': 2, 'pen': 106, 'gallico': 12, 'torment': 119, 'besieg': 14, 'illusionist': 6, 'exhibit': 111, 'abruptli': 60, 'ross': 83, 'shove': 86, 'ransack': 5, 'rinaldi': 5, 'guignol': 9, 'improb': 78, 'landladi': 21, 'grotesqu': 92, 'yo': 26, 'fingerprint': 9, 'prentiss': 1, 'indescrib': 23, 'vile': 67, 'retali': 16, 'simultan': 85, 'cunningham': 58, 'antonio': 63, 'teff': 5, 'nutjob': 5, 'asylum': 78, 'deceas': 82, 'evelyn': 64, 'nutcas': 11, 'overrun': 11, 'adulteri': 40, 'gladi': 17, 'marina': 25, 'malfatti': 9, 'timberlan': 2, 'giacomo': 3, 'rossi': 9, 'suppli': 124, 'roberto': 16, 'maldera': 2, 'slaughter': 143, 'squeez': 56, 'agatha': 36, 'wheelchair': 55, 'volatil': 20, 'gulp': 12, 'sniff': 21, 'hebrew': 25, 'aplomb': 29, 'stalk': 178, 'brit': 76, 'unintent': 243, 'scoobi': 137, 'doo': 124, 'shambl': 41, 'casey': 19, 'kasem': 7, 'osteopath': 3, 'windman': 5, 'garcin': 1, 'ssst': 1, 'mondj': 1, 'dicht': 1, 'gr': 13, 'environ': 199, 'fungu': 3, 'mph': 23, '55': 20, 'hybrid': 61, 'yugo': 1, 'gm': 5, 'metro': 19, 'googl': 29, 'inconveni': 17, 'huh': 138, 'automobil': 31, 'certainti': 23, 'weather': 73, 'instrument': 91, 'june': 90, 'warmer': 9, 'yesteryear': 9, 'consensu': 22, '6th': 27, 'vers': 38, 'volcan': 6, 'errupt': 1, 'solar': 24, 'nino': 8, 'erad': 14, 'gospel': 34, 'implement': 37, 'vp': 5, 'aka': 195, 'exempt': 5, 'abid': 28, 'kyoto': 13, 'gnome': 7, 'endang': 15, 'uneasi': 48, 'lizard': 51, 'playboy': 62, 'leon': 107, 'phelp': 15, 'drew': 248, 'reckless': 46, 'momentarili': 23, 'herein': 25, 'bold': 110, 'delud': 27, 'idioci': 40, 'fearlessli': 3, 'heterosexu': 32, 'chungk': 5, 'crouch': 35, 'tiger': 109, 'trulli': 1, 'chiller': 45, 'askey': 35, 'stormi': 21, 'lighten': 45, 'rosi': 44, 'taino': 1, 'influenti': 40, 'puerto': 60, 'rican': 33, 'daddi': 109, 'ness': 23, 'lackawanna': 1, 'latina': 11, 'zoe': 27, 'saldana': 5, 'torr': 6, 'ravera': 1, 'melissa': 68, 'desousa': 1, 'courtesi': 47, 'disrespect': 58, 'fed': 92, 'atlanta': 15, 'houston': 29, 'notr': 12, 'esmeralda': 3, 'gringoir': 1, 'gap': 99, 'phoebu': 3, 'creator': 219, 'quasimodo': 6, 'frollo': 8, 'jehan': 1, 'opu': 30, 'dei': 3, 'alchemi': 6, 'hunchback': 20, 'section': 248, 'femm': 83, 'plasma': 10, 'blueray': 1, 'shell': 80, 'colbert': 28, 'blowsi': 2, 'leah': 9, 'vivian': 48, 'vanc': 81, 'ethel': 29, 'mertz': 1, 'gig': 56, 'understudi': 2, 'merman': 4, 'chambermaid': 4, 'suborn': 1, 'nefari': 21, 'heartedli': 12, 'puf': 13, 'furtiv': 3, 'linen': 7, 'storag': 19, 'penalti': 42, 'poetic': 109, 'margareth': 7, 'trotta': 20, 'unfairli': 31, 'coalesc': 7, 'genocid': 18, 'regim': 49, 'powerless': 17, 'weinstein': 8, 'jutta': 3, 'orthodox': 16, 'hitherto': 6, 'abey': 1, 'shivah': 1, 'proscript': 1, 'affluenc': 2, 'secur': 260, 'spous': 45, 'coldli': 11, 'lui': 67, 'fedja': 5, 'huet': 4, 'erupt': 45, 'queri': 6, 'fled': 21, 'gentil': 10, 'traips': 4, 'savior': 31, 'dori': 47, 'schade': 3, 'shaken': 24, 'seamlessli': 22, 'katja': 8, 'riemann': 12, 'pianist': 40, 'violinist': 5, 'feifel': 4, 'advent': 13, 'israel': 85, 'classif': 5, 'roundup': 2, 'confin': 98, 'piteous': 1, 'appel': 3, 'seiz': 31, 'shiva': 5, 'fetchingli': 1, 'svea': 3, 'lohd': 4, 'increasingli': 131, 'madmen': 9, 'homicid': 117, 'agenda': 86, 'euthanasia': 8, 'defect': 26, 'chronic': 22, 'invalid': 13, 'prod': 22, 'bustl': 11, 'rebuilt': 11, 'unifi': 16, 'recur': 42, 'themat': 56, 'heritag': 30, 'snare': 14, 'outlook': 32, 'catalyt': 1, 'trigger': 72, 'goebbel': 23, 'soire': 1, 'violin': 27, 'wondrou': 32, 'mold': 44, 'erich': 12, 'stroheim': 13, 'teuton': 9, 'paradigm': 11, 'virul': 12, 'semit': 22, 'goldenhagen': 1, 'accomplic': 28, 'endem': 6, '1933': 85, 'sprung': 10, 'beacon': 8, 'occas': 181, 'cramp': 35, 'undermin': 68, 'keen': 70, 'herbi': 18, 'dillon': 41, 'racer': 10, 'beatl': 85, 'wastag': 2, 'tb': 11, 'janin': 24, 'inbox': 1, 'trivial': 59, 'turaqistan': 6, 'tanker': 7, 'hauser': 21, 'disposit': 16, 'duff': 35, 'hoars': 3, 'lacklust': 79, 'inc': 39, 'blurb': 19, 'ustinov': 83, 'maggi': 106, 'malden': 40, 'morley': 12, 'newhart': 29, 'embezzl': 35, 'programm': 95, 'goal': 193, 'competitor': 28, 'slither': 10, 'whine': 93, 'badham': 2, 'lanter': 3, 'hacker': 22, 'outdid': 9, 'lingeri': 9, 'glass': 238, 'coif': 7, 'catwalk': 8, 'spin': 211, 'carnal': 27, 'elud': 23, 'cam': 32, 'maiden': 41, 'slavish': 1, 'aesthet': 78, 'surfeit': 4, 'grope': 10, 'swap': 34, 'orgi': 51, 'scrumptiou': 4, 'juli': 230, 'ashton': 20, 'tammi': 13, 'smear': 22, 'physiqu': 16, 'kitchen': 125, 'busti': 12, 'crystal': 93, 'catalina': 11, 'stringer': 2, 'spice': 77, 'ona': 5, 'zee': 5, 'frolic': 19, 'kyli': 12, 'waterfal': 34, 'jameson': 34, 'slade': 9, 'brunett': 41, 'diva': 30, 'tilt': 27, 'gerri': 19, 'pike': 24, 'swelter': 6, 'hose': 19, 'prospect': 52, 'tantal': 11, 'carrera': 8, 'achingli': 21, 'pant': 107, 'partit': 30, 'splashi': 12, 'concoct': 52, 'sm': 4, 'rg': 5, 'sbord': 1, 'fleshi': 5, 'gastronom': 1, 'naughti': 76, 'dop': 5, 'spatter': 4, 'mud': 43, 'greener': 11, 'grifter': 19, 'hallmark': 55, 'dim': 68, 'harmless': 72, 'patric': 16, 'boxer': 88, 'disqualifi': 8, 'foley': 32, 'dern': 42, 'subtli': 63, 'mastriosimon': 1, 'purs': 42, 'roommat': 111, 'overpow': 30, 'onstag': 15, 'farrah': 42, 'fawcett': 40, 'numb': 93, 'alfr': 103, 'woodard': 20, 'scarwid': 9, 'stuf': 54, 'fireplac': 27, 'anchor': 82, 'polut': 1, 'mislead': 95, 'cliffhang': 68, 'passeng': 94, 'dispens': 32, 'enclos': 5, 'immens': 163, 'fargo': 15, 'snowbound': 2, 'renni': 30, 'harlin': 40, 'juxtapos': 25, 'indiffer': 87, 'artific': 16, 'aboard': 37, 'plung': 37, 'theft': 34, 'avalanch': 28, 'sli': 50, 'gabe': 25, 'rescuer': 7, 'cavern': 13, 'pummel': 14, 'demis': 83, 'lithgow': 32, 'unconvinc': 190, 'hostag': 71, 'rooker': 30, 'mastermind': 41, 'unconsci': 57, 'careless': 32, 'precipit': 9, 'tug': 38, 'defi': 115, 'matine': 11, 'aircraft': 41, 'indoor': 28, 'unoffici': 15, 'vertic': 8, 'clinker': 6, 'masac': 1, 'moldi': 5, 'contracept': 7, 'commemor': 10, 'posh': 38, 'factual': 52, 'orca': 32, 'shamoo': 1, '1982': 60, 'embassi': 14, 'balconi': 32, 'argentina': 24, 'falkland': 3, 'gung': 38, 'ho': 126, 'britain': 153, 'collin': 53, 'woodward': 16, 'cubbi': 2, 'brocoli': 1, 'ditch': 36, 'tout': 26, 'pierc': 117, 'phonograph': 5, 'pout': 18, 'walkin': 10, 'eyeglass': 2, 'automot': 8, 'afterlif': 26, 'egyptiana': 1, 'materialist': 10, 'soup': 80, 'druid': 12, 'indecipher': 7, 'kalifornia': 40, 'hollywoodish': 3, 'odyssey': 59, 'wannabe': 8, 'forb': 39, 'flix': 10, 'autobiograph': 24, '1949': 42, 'newsreel': 21, 'willing': 19, 'helmut': 5, 'kirst': 2, 'remarqu': 6, 'chiaroscuro': 3, 'freeli': 30, 'leo': 98, 'genn': 5, 'emblemat': 4, 'alec': 81, 'fish': 241, 'marlon': 67, 'attach': 193, 'grier': 20, 'rendit': 102, 'havin': 1, 'movin': 4, 'coincident': 37, '1992': 53, 'boomerang': 10, 'mushroom': 25, 'jacket': 79, 'innuendo': 50, 'strangest': 32, 'slipstream': 11, 'interspers': 40, 'bodysnatch': 2, 'babbl': 36, 'anthem': 26, 'punchlin': 39, 'velvet': 30, 'backward': 92, 'alzheim': 7, 'ridicoulu': 1, 'thnik': 1, 'wahlberg': 19, 'burton': 153, 'metropolis': 1, 'hunker': 1, 'immin': 17, 'deflect': 10, 'flare': 38, 'matheson': 20, 'boyl': 79, 'et': 103, 'condo': 12, 'sooner': 72, 'smithe': 6, 'clunker': 29, 'press': 208, 'zani': 38, 'snif': 20, 'presidenti': 43, 'cano': 31, 'synonom': 1, 'tranquil': 15, 'banjo': 26, 'consciou': 79, 'disdain': 39, 'woodsman': 3, 'cracker': 49, 'banker': 20, 'ned': 183, 'beatti': 115, 'woodsmen': 3, 'supersed': 3, 'supposit': 2, 'turbo': 6, 'cargo': 23, 'cockpit': 6, 'orlean': 85, 'mardi': 18, 'gra': 21, 'credibilti': 1, 'yank': 41, 'umpteen': 7, 'publicis': 4, 'guidlin': 1, 'evacue': 9, 'curmudgeonli': 2, 'oakley': 7, 'beech': 8, 'billet': 4, 'illiter': 35, 'loneli': 77, 'transpir': 32, 'choirmast': 2, 'jerusalem': 14, 'zacharia': 3, 'lad': 43, 'mole': 57, 'flea': 38, 'farrel': 97, 'macdonald': 51, 'lisbeth': 3, 'searci': 3, 'yeller': 3, 'maren': 1, 'mayor': 102, 'mcchees': 2, 'mcdonald': 48, 'mayer': 24, 'munchkin': 3, 'lollipop': 6, 'seifeld': 1, 'shrink': 55, 'gal': 96, 'sal': 3, 'hayworth': 58, 'oz': 102, 'bramburi': 1, 'philli': 11, 'kent': 64, 'flimsi': 58, 'dopey': 38, 'gu': 56, 'sant': 33, 'visibl': 112, 'chosen': 232, 'languor': 10, 'klutzi': 3, 'misplac': 33, 'anyhow': 60, 'dean': 192, 'stockwel': 23, 'marilu': 9, 'henner': 12, 'gruff': 40, 'mcnamara': 10, 'nude': 203, 'guff': 5, 'steam': 99, 'incoher': 154, 'heath': 50, 'ledger': 39, 'medal': 34, 'groin': 22, '5000': 12, 'casper': 62, 'saddest': 34, 'lassi': 28, 'conan': 63, 'doyl': 53, 'organ': 259, 'plateau': 9, 'downhil': 96, 'strand': 97, 'cuddli': 16, 'ankylosaur': 1, 'tyrannosaur': 1, '1925': 11, 'email': 42, 'amitabh': 93, 'priyanka': 21, 'boman': 24, 'rajpal': 24, 'hindi': 59, 'shameless': 47, 'mallika': 2, 'vulgar': 106, 'himmesh': 1, 'reshmmiya': 1, 'vipul': 25, 'gujarati': 11, 'popstar': 3, 'govinda': 44, 'ghazal': 1, 'soooo': 27, 'den': 31, 'tredj': 1, 'gen': 47, 'posey': 76, 'hartley': 101, 'hdnet': 2, 'straitjacket': 5, 'appl': 64, 'brettschneid': 9, 'melvyn': 57, 'amok': 35, 'bertin': 4, 'wray': 31, 'otto': 53, 'niemann': 10, 'lionel': 55, 'atwil': 32, 'gleib': 1, 'dwight': 43, 'frye': 31, 'gussi': 7, 'schnappmann': 2, 'maud': 19, 'eburn': 13, 'cabinet': 21, 'caligari': 13, 'frankenstein': 92, 'laboratori': 54, 'bloodsuck': 25, 'thse': 1, 'strayer': 7, 'tint': 30, 'spooki': 128, 'opinon': 3, 'bane': 17, 'pb': 32, 'fastward': 1, 'weekli': 49, 'bidder': 9, 'http': 67, 'www': 69, 'johntop': 1, 'com': 231, 'harvey': 107, '20perr': 1, '20widow': 1, 'html': 16, 'rebound': 9, 'ivan': 30, 'reitman': 14, 'miscalcul': 11, 'uma': 67, 'jenni': 106, 'saunder': 6, 'repli': 97, 'nutti': 35, 'prozac': 6, 'breezi': 25, 'quirk': 44, 'squander': 39, 'bedlam': 6, 'lite': 21, 'lex': 64, 'luthor': 39, 'expectedli': 3, 'rainn': 12, 'whack': 65, 'dens': 36, 'perki': 27, 'fari': 21, 'inher': 88, 'unabl': 248, 'suffici': 77, 'bunni': 87, 'hare': 35, 'raisingli': 1, 'leporid': 3, 'gildersleev': 3, 'looney': 35, 'termit': 8, 'terrac': 10, 'refin': 39, 'diverg': 15, 'mathemat': 20, 'cotton': 24, 'wrinkl': 42, 'poppin': 32, 'squirm': 35, 'bagman': 9, 'stationari': 8, 'feat': 78, 'critiqu': 80, 'fuss': 38, 'tassi': 20, 'weer': 1, 'penis': 5, 'suffic': 93, 'hubbi': 35, 'tomato': 117, 'preteen': 14, 'eggnog': 3, 'sore': 107, 'donner': 30, 'shyster': 7, 'conman': 7, 'unremark': 34, 'henchmen': 44, 'kowalski': 13, 'tesmach': 1, 'melt': 168, 'langella': 9, 'undercurr': 24, 'brandon': 40, 'routh': 7, 'slightest': 122, 'bosworth': 20, 'pulitz': 17, 'marsden': 13, 'superpow': 31, 'yacht': 30, 'pantri': 2, 'flood': 60, 'haphazard': 25, 'dumbest': 52, 'meteorit': 22, 'dot': 46, 'kryptonit': 16, 'hillsid': 7, 'geddit': 4, 'schoolboy': 16, 'peer': 66, 'shuffl': 39, 'snail': 39, 'likewis': 89, 'fridg': 25, 'infect': 108, 'bladerunn': 8, '2054': 8, 'sharper': 7, 'nineteen': 14, 'eiffel': 9, 'couer': 1, 'cassella': 1, 'taglin': 23, 'businesswoman': 4, 'collid': 28, 'deer': 69, 'drunken': 123, 'devast': 106, 'payback': 13, 'calf': 18, 'francesca': 9, 'antoni': 12, 'byrn': 34, 'retrospect': 51, 'badder': 7, 'autograph': 18, 'toughi': 1, 'smoker': 9, 'maxim': 12, 'cassett': 15, 'memorex': 2, 'compil': 44, 'remix': 8, 'spock': 92, 'talo': 12, 'iv': 76, 'capt': 33, 'finagl': 1, 'mccoy': 78, 'senior': 68, 'talosian': 6, 'paralysi': 5, 'wylli': 2, 'sexist': 45, 'reliant': 8, 'unisex': 1, 'unkindli': 2, 'stargat': 83, 'sg': 49, 'tantrum': 19, 'neill': 68, 'asgard': 5, 'iri': 28, 'bakeri': 15, 'snooti': 9, 'mccormack': 10, 'deceit': 31, 'speechless': 34, 'smirk': 35, 'shadley': 1, 'thi': 18, 'dank': 7, 'sneakpreview': 1, 'mickey': 108, 'unimagin': 84, 'videotap': 48, 'row': 150, 'swamp': 42, 'statur': 35, 'duval': 94, 'deploy': 20, 'stain': 29, 'grisham': 16, 'egregi': 12, 'biliou': 5, 'boesman': 8, 'proverb': 9, 'robberi': 102, 'spiral': 74, 'assembl': 107, 'verv': 24, 'mute': 93, 'masterson': 62, 'burwel': 5, 'famous': 19, 'nbc': 60, 'brass': 28, 'costli': 7, 'roddenberri': 18, 'emb': 2, 'deepen': 19, '3012': 1, 'uss': 5, 'enterpris': 113, 'divert': 33, 'starbas': 5, 'urgent': 21, 'commodor': 8, 'mendez': 15, 'hijack': 49, 'pinch': 21, 'interdict': 1, 'starfleet': 16, 'vessel': 31, 'personnel': 26, 'appal': 163, 'shuttlecraft': 2, 'oxygen': 19, 'consign': 9, 'retriev': 66, 'occup': 64, 'beam': 42, 'starship': 41, 'irrevers': 22, 'reassum': 1, 'whereupon': 6, 'request': 60, 'tribun': 9, 'crippl': 81, 'encycloped': 1, 'inadmiss': 1, 'distress': 83, 'vina': 2, 'waylaid': 3, 'humanoid': 17, 'cranial': 4, 'vanish': 102, 'violat': 58, 'menageri': 7, 'eytan': 11, 'mini': 219, 'yossi': 9, 'jagger': 49, '1hr': 5, 'equiti': 1, 'isra': 67, 'ha': 184, 'buah': 5, 'toler': 185, 'tel': 36, 'aviv': 31, 'noam': 40, 'ohad': 6, 'knoller': 6, 'ashraf': 31, 'yousef': 7, 'sweid': 7, 'altogeth': 112, 'interplay': 39, 'housem': 2, 'unavoid': 18, 'vibrant': 68, 'minimum': 85, 'summar': 65, 'feh': 3, 'minimalist': 29, 'trainspot': 17, 'nervou': 97, 'affirm': 51, 'jerki': 39, 'piss': 9, 'trite': 153, 'rend': 7, 'grindston': 1, 'feed': 182, 'mow': 14, 'callous': 5, 'gainsbourg': 11, 'perfum': 11, 'alain': 30, 'chabat': 10, 'bernadett': 11, 'lafont': 4, 've': 3, 'lartigau': 2, 'robbi': 58, 'foray': 21, 'morbiu': 28, 'pidgeon': 22, 'prelud': 11, 'labyrinthin': 11, 'stronghold': 3, '1977': 64, 'sw': 6, 'anteced': 3, 'readili': 53, 'cruiser': 8, 'c57': 1, 'conundrum': 6, 'subconsci': 39, 'altair': 9, 'martian': 96, 'protector': 26, 'nielsen': 32, 'calendar': 13, '2200': 3, 'sleeker': 4, 'underachiev': 4, 'selma': 28, 'dancer': 265, 'becki': 24, 'stile': 52, 'telephon': 34, 'hustl': 29, 'underp': 10, 'brolin': 15, 'haggerti': 6, 'tickl': 26, 'proverbi': 33, 'funnybon': 1, 'orgu': 1, 'unscari': 7, 'outrun': 11, 'hebert': 3, 'beleiv': 5, 'complicatedli': 2, 'cryptic': 20, 'lacon': 14, 'mario': 99, 'caffari': 2, 'mustach': 45, 'ringer': 12, 'nintendo': 28, 'gorgeous': 14, 'fixat': 28, 'patti': 56, 'shepard': 57, 'retreat': 42, 'unhing': 46, 'wallow': 28, 'uneas': 20, 'artigot': 2, 'jarringli': 6, 'sporad': 34, 'unfocus': 22, 'semper': 1, 'scenic': 30, 'leisur': 21, 'morcillo': 2, 'sturdi': 16, 'ctor': 4, 'dreami': 50, 'affili': 18, 'info': 69, 'brentwood': 5, '92': 14, 'sought': 58, 'adamson': 13, 'steckler': 3, 'pantheon': 19, 'schlocki': 21, 'wari': 22, 'stewardess': 23, 'underw': 5, 'titil': 40, '71': 24, 'livingston': 26, 'nymphet': 3, 'indemn': 20, 'postman': 31, 'entangl': 24, 'slide': 102, 'seamless': 20, 'gaug': 18, 'offbeat': 59, 'screamingli': 6, 'wavelength': 7, 'homerian': 3, 'predica': 39, 'simpsonian': 1, 'diaper': 21, 'chasey': 11, 'lain': 23, 'hay': 86, 'inbreed': 4, 'feast': 67, 'entrail': 17, 'viel': 8, 'endmi': 1, 'fx': 122, 'trooper': 51, 'stead': 11, 'hm': 8, 'cr': 16, 'microphon': 27, 'scam': 47, 'supervisor': 13, 'zerneck': 1, 'sertner': 1, 'tommi': 113, 'medley': 14, 'gloss': 46, 'daltri': 1, 'townsend': 32, 'pinbal': 7, 'blaze': 58, 'chord': 29, 'chunk': 37, 'murri': 2, 'directv': 5, 'holi': 121, 'hoot': 61, 'verbos': 11, 'blackadd': 26, 'baldrick': 6, 'wellington': 33, 'macadd': 1, 'kipper': 1, 'salesman': 55, 'swordsman': 23, 'scotland': 84, 'steenburgen': 4, 'grinchi': 2, 'stanton': 13, 'gideon': 14, 'overcoat': 9, 'pedophil': 24, 'instil': 23, 'refuge': 45, 'capra': 29, 'obstacl': 74, 'jock': 54, 'cymbal': 2, 'mop': 11, 'bucket': 58, 'friction': 16, 'steepest': 1, 'scoop': 77, 'sigh': 54, 'fidget': 6, 'unwittingli': 27, 'maneuv': 21, 'friski': 5, 'nobleman': 13, 'woodi': 240, 'aggrav': 29, 'hurri': 52, 'ian': 132, 'mcshane': 29, 'jackman': 46, 'scarlett': 45, 'johansson': 50, 'maybe': 2, 'naked': 7, 'thanksgiv': 18, 'recount': 31, 'sceptic': 27, 'yard': 104, 'holloway': 13, 'bennett': 49, 'whereabout': 20, 'antholog': 67, 'discern': 69, 'succe': 167, 'refrain': 30, 'faultless': 11, 'cush': 70, 'ingrid': 62, 'duffel': 22, 'bloch': 11, 'hillyer': 19, 'denholm': 25, 'elliott': 54, 'schizophren': 27, 'engend': 11, 'nevil': 16, 'joss': 21, 'ackland': 19, 'waxwork': 15, 'remedi': 19, 'norton': 44, 'nyre': 8, 'porter': 63, 'harbour': 11, 'undeni': 87, 'agonis': 5, 'pertwe': 40, 'cloak': 50, 'irrefut': 8, 'liebmann': 3, 'diatrib': 17, 'macchio': 6, 'hash': 22, 'miniv': 3, 'thaw': 33, 'evacu': 28, 'lunat': 58, 'exclus': 82, 'intercal': 1, 'tableaux': 8, 'scenographi': 2, 'restraint': 51, 'pivot': 51, 'mise': 16, 'shrewdli': 7, 'flic': 15, 'exchang': 131, 'aura': 40, 'metamorphos': 8, 'deplor': 25, 'haughti': 9, 'pitiabl': 16, 'methodolog': 2, 'zealou': 11, 'exemplar': 7, 'soporif': 8, 'utmost': 23, 'economi': 45, 'scumbag': 21, 'nambi': 3, 'pambi': 2, 'liver': 15, 'mele': 6, 'bureaucrat': 25, 'gratifi': 17, 'dyke': 43, 'ugliest': 15, 'psychopath': 98, 'of': 20, 'hr': 24, 'hinglish': 4, 'akki': 8, 'moviee': 1, '120': 17, 'morocco': 10, 'physician': 19, 'baron': 50, 'gigolo': 24, 'stiff': 140, 'kitsch': 24, 'barbara': 243, 'pallid': 3, 'otherworldli': 17, 'shambler': 1, 'pretent': 7, 'percentag': 28, 'cretin': 15, 'fathom': 32, 'overrid': 17, 'corman': 70, 'tourneur': 19, 'mcquarri': 1, 'angi': 55, 'harmon': 30, 'bitchi': 43, 'demeanor': 43, 'unscath': 22, 'denis': 53, 'creepshow': 20, 'holbrook': 9, 'aghast': 12, 'expertis': 32, 'encor': 9, 'purgatori': 18, 'katelyn': 2, 'pathed': 1, 'hinson': 2, 'stream': 77, 'sob': 43, 'hillari': 24, 'lizzi': 19, 'sp': 21, 'problemat': 25, 'harriet': 59, 'hillard': 2, 'sailor': 88, 'hoofer': 6, 'bog': 43, 'hilliard': 31, 'lucil': 67, 'worldi': 1, 'brassi': 8, 'harder': 112, 'basket': 63, 'burst': 132, 'span': 101, 'debat': 126, 'gouch': 1, 'eyebal': 48, 'awkwardli': 28, 'vega': 150, 'moynahan': 12, 'sloppiest': 3, 'unromant': 4, 'sue': 91, 'kramer': 39, 'peach': 22, 'bowser': 10, 'roam': 50, 'n64': 13, '3d': 86, 'plat': 1, 'sm64': 1, 'kazooi': 2, 'tooie': 1, 'commonli': 22, '64': 31, 'pawn': 35, 'profoundli': 38, 'unhappi': 102, 'unsatisfi': 83, 'godli': 4, 'percept': 96, 'baseketbal': 33, 'everytim': 12, 'surefir': 8, 'frown': 16, 'surrealist': 32, 'dentistri': 6, 'primal': 33, 'perfectionist': 7, 'brunt': 9, 'quota': 10, 'omen': 90, 'newborn': 11, 'pup': 17, 'fornic': 9, 'damien': 21, 'liquid': 26, 'deriv': 139, 'malign': 21, 'lawnmow': 10, 'ecuador': 2, 'witchdoctor': 2, 'atop': 28, 'harrington': 10, 'rubi': 94, 'vain': 63, 'maid': 94, 'mutat': 54, 'beswick': 4, 'jekyl': 12, 'assault': 132, 'precinct': 10, 'perk': 15, 'disgruntl': 34, 'slugger': 3, 'doldrum': 5, 'harbor': 56, 'slump': 16, 'crumbl': 41, 'personifi': 27, 'ballplay': 5, 'barkin': 14, 'benicio': 18, 'del': 97, 'toro': 39, 'arbanvil': 1, 'affront': 7, 'aggriev': 2, 'infecti': 33, 'gown': 41, 'frickin': 5, 'alexandr': 67, 'veronika': 24, 'patron': 59, 'prone': 42, 'pretens': 83, 'savoir': 1, 'sprezzatura': 1, 'falutin': 1, 'incom': 33, 'corbett': 71, '1880': 9, 'groundbreak': 39, 'emerson': 10, 'quotabl': 25, 'bigotri': 17, 'rampant': 44, 'immun': 29, 'dingo': 27, 'knee': 63, 'thrive': 25, 'globe': 77, 'meryl': 83, 'streep': 103, 'pronunci': 9, 'fledgl': 6, 'troop': 109, 'swingblad': 1, 'poet': 57, 'speci': 97, 'irwin': 36, 'vieg': 1, 'haff': 3, 'oil': 151, 'rejenacyn': 1, 'pipe': 51, 'floresc': 2, 'alicia': 79, 'rown': 1, 'stomp': 42, 'burk': 61, 'hofman': 1, 'bradley': 21, 'chelsea': 14, 'alexandra': 40, 'broughton': 3, 'batch': 11, 'rodentz': 4, 'feldman': 5, 'serg': 4, 'rodnunski': 1, 'obligatori': 70, 'throughli': 16, 'dodgi': 39, 'neon': 27, 'messi': 70, 'nicer': 19, 'shire': 6, 'templ': 130, 'stove': 6, 'thinner': 33, 'mimic': 27, 'snt': 1, 'wept': 7, 'orang': 94, 'caw': 4, 'punk': 133, 'honour': 61, 'orlando': 39, 'ladiesman': 1, 'glenrowan': 5, 'snitch': 14, 'hopelessli': 74, 'garbl': 10, 'conquest': 42, 'tangenti': 9, 'scharzenfartz': 1, 'vaselin': 1, 'deanna': 58, 'durbin': 36, 'mgm': 199, '1936': 78, 'garland': 61, 'rewrot': 6, 'pump': 61, 'typograph': 2, 'penni': 80, 'digger': 38, 'lusciou': 27, 'matrimoni': 5, 'fixit': 5, 'energet': 65, 'avaric': 2, 'binni': 10, 'lyon': 15, 'winning': 9, 'slouch': 9, 'dither': 9, 'matron': 11, 'godfrey': 6, 'farceur': 3, 'mischa': 13, 'auer': 13, 'pill': 47, 'cyanid': 2, 'steril': 34, 'guild': 10, 'membership': 5, 'grod': 1, 'gackt': 49, 'exceed': 37, 'uncertainti': 30, 'crossov': 13, 'everseen': 1, '48hr': 2, 'thang': 3, 'referenc': 30, 'and': 8, 'richter': 8, 'plummet': 17, 'tori': 21, 'hack': 140, 'werent': 2, 'screech': 29, '83': 22, 'miramax': 16, 'bront': 61, 'eyr': 116, '73': 72, 'insipid': 72, 'crucial': 90, 'rochest': 157, 'behaviour': 78, '1850i': 1, 'interrupt': 107, 'stagi': 22, 'sorcha': 2, 'worldli': 26, 'literari': 76, 'jayston': 4, 'zelah': 43, 'impos': 76, 'magnet': 44, 'stern': 54, 'thornfield': 8, 'insol': 4, 'solicitud': 1, 'unsurpass': 12, 'outwardli': 10, 'dualiti': 10, 'modesti': 122, 'frailti': 28, 'indomit': 5, 'verbatim': 11, 'shorten': 41, 'unchang': 5, 'accuraci': 82, 'gypsi': 58, 'heartrend': 8, 'heartbreak': 97, 'sullivan': 193, 'rooney': 89, 'disslik': 1, 'unawar': 86, 'abank': 1, 'trinna': 2, '50th': 4, 'zoom': 71, 'connolli': 35, 'hohl': 8, 'glenda': 40, 'hoovervil': 4, 'courtney': 25, 'inton': 13, 'amplifi': 18, 'lull': 28, 'transpar': 52, 'wreak': 40, 'aquat': 6, 'hitchhik': 43, 'motorist': 9, 'textbook': 31, 'unmotiv': 19, 'ridden': 88, 'redund': 71, 'whatnot': 16, 'cannel': 3, 'broaden': 10, 'dabbl': 12, 'topless': 101, 'checker': 11, 'hiss': 19, 'ringwald': 24, 'deuc': 9, 'bigalow': 5, 'stipul': 4, 'mano': 41, 'hoo': 18, 'drove': 79, 'travolta': 43, 'replacdmetn': 1, 'sleigh': 3, 'bladck': 1, 'pejor': 4, 'primer': 9, 'unctuou': 4, 'handshak': 6, 'mart': 50, 'anodyn': 5, 'relig': 2, 'strife': 18, 'wexford': 2, 'belfast': 4, 'regurit': 1, 'boycott': 7, 'bigot': 30, 'traumatis': 8, 'innappropri': 2, 'ignimini': 1, 'precondit': 2, 'recours': 1, 'unrestrict': 1, 'carrey': 133, 'laid': 160, 'vanhook': 4, 'pour': 96, 'goon': 42, 'quentin': 59, 'dizzi': 40, 'warfar': 29, 'malcont': 4, 'vignett': 63, 'repudi': 5, 'ralphi': 13, 'hick': 54, 'irrever': 37, 'poorest': 26, 'sunglass': 20, 'sludg': 11, 'remnant': 12, 'howl': 66, 'transylvania': 22, 'coven': 17, 'babel': 9, 'anni': 125, 'mcenro': 8, 'weigh': 38, 'sybil': 31, 'invinc': 31, 'forest': 208, 'censor': 83, 'spinster': 25, 'dermot': 17, 'mulroney': 15, 'beau': 35, 'restat': 5, 'cricket': 22, 'tenko': 3, 'ulrica': 1, 'christina': 61, 'dominica': 3, 'latecom': 6, 'beaut': 11, 'plantat': 37, 'singapor': 15, 'snuggl': 4, 'monetari': 14, 'ingenu': 42, 'overbear': 48, 'stubbor': 2, 'hobgoblin': 47, 'rick': 105, 'sloan': 48, 'serrious': 1, 'warehous': 50, 'suction': 2, 'vaccum': 1, 'carv': 35, 'hydrochlor': 2, 'quantiti': 23, 'worm': 99, 'cavanagh': 13, 'halli': 9, 'eisenberg': 11, 'ty': 8, 'panitz': 1, 'doesnt': 19, 'cheech': 44, 'chong': 54, 'massag': 12, 'parlor': 18, 'curdl': 9, 'gorehound': 19, 'baldwin': 83, 'latino': 52, 'booth': 61, '900': 7, 'swayz': 28, 'allan': 40, 'quatermain': 18, 'ise': 7, 'soloman': 2, 'stanz': 3, 'isoyc': 3, 'ipoyg': 3, 'axe': 68, 'crotch': 25, 'haack': 6, 'misguid': 75, 'goddess': 32, 'roadi': 16, 'metallica': 4, 'ink': 19, 'tombston': 16, 'chocol': 42, 'mouss': 1, 'masquerad': 35, 'fece': 10, 'meir': 2, 'zarchi': 4, 'malcolm': 32, 'brotherli': 12, 'philadelphia': 35, 'slam': 81, 'dunk': 22, 'hurrican': 25, 'tearjerk': 27, 'er': 87, 'debacl': 31, 'miami': 63, 'dolphin': 11, 'abhorr': 20, 'psychologist': 60, 'eccentr': 128, 'storylif': 1, 'coliseum': 3, 'monaghan': 19, 'insomniac': 31, 'overlap': 21, 'bitch': 100, 'shit': 13, 'tepid': 32, 'cuisin': 6, 'steiner': 31, 'henna': 2, 'rins': 3, 'mst3k': 149, 'reviv': 120, 'wick': 125, 'electrocut': 41, 'servo': 11, 'snoozer': 13, 'stardust': 50, 'yvain': 16, 'sparkl': 62, 'cox': 132, 'movieoveral': 1, 'sightse': 2, 'saudi': 5, 'arabia': 18, 'bulgaria': 11, 'croatia': 12, 'slovenia': 9, 'stopov': 1, 'soak': 35, 'reda': 21, 'haj': 3, 'mule': 14, 'mecca': 14, 'opt': 55, 'pilgrimag': 14, 'arduou': 14, 'pal': 127, 'assert': 70, 'hari': 9, 'raya': 3, 'haji': 6, 'pilgrim': 4, 'claustrophobia': 20, 'congreg': 16, 'anglo': 19, 'tangl': 33, 'sigmund': 6, 'freud': 21, 'infanc': 11, 'livesey': 9, 'flemish': 10, 'congo': 12, 'congole': 1, 'workman': 6, 'gilbert': 66, 'luc': 43, 'gubbel': 1, 'refriger': 15, 'witt': 4, '1934': 56, 'digicron': 1, 'telecommun': 4, 'virolog': 1, 'braill': 2, 'keyboard': 35, 'tristan': 26, 'sienna': 6, 'fallen': 165, 'pfeiffer': 53, 'reclaim': 19, 'carribbean': 3, 'gervai': 10, 'trader': 33, 'bon': 38, 'jovi': 31, 'bliss': 53, 'sensationalist': 13, 'viabl': 17, 'disturbingli': 13, '571': 3, 'loather': 1, 'fugit': 38, 'bassing': 14, 'uhh': 1, 'catboy': 1, 'groan': 63, 'tesi': 5, 'amenabar': 10, 'horrifyingli': 7, 'creepfest': 1, 'anatomi': 28, 'torrent': 15, 'harper': 22, 'deadring': 1, 'chema': 1, 'fele': 1, 'martinez': 20, 'blind': 322, 'slew': 34, 'whodunnit': 16, 'cluster': 9, 'deduct': 14, 'feebli': 4, 'scent': 12, 'psychobabbl': 6, 'gibberish': 21, 'pueril': 27, 'sweep': 80, 'tantalisingli': 1, 'videodrom': 2, 'roguish': 9, 'catalyst': 22, 'carniv': 38, 'villian': 22, 'ammmmm': 1, 'daaaarrrkk': 1, 'heeeeaaarrt': 1, 'elvi': 154, 'presley': 25, 'coy': 16, 'sargent': 8, 'gruel': 18, 'sidebar': 5, 'rudi': 31, 'valle': 8, 'looser': 13, 'hipper': 5, 'broklynes': 3, 'confederaci': 2, 'dunc': 3, 'anamorph': 19, 'excruciatingli': 57, 'willem': 32, 'dafo': 49, 'stormar': 11, 'rebhorn': 1, 'lazar': 4, 'sooo': 22, 'pedofil': 1, 'tendenc': 78, 'cullen': 5, 'cobb': 24, 'pervas': 26, 'wyatt': 24, 'overdress': 2, 'pastim': 10, 'replenish': 5, 'tumbl': 31, 'regiment': 18, 'aquitan': 1, 'foretold': 3, 'majesti': 23, 'uniform': 118, 'adelin': 7, 'saber': 26, 'carriag': 19, 'marquis': 3, 'du': 49, 'pompadour': 3, 'ribald': 3, 'scamp': 2, 'swordfight': 10, 'tile': 7, 'blunder': 25, 'enthusiasm': 86, 'na': 42, 'francoi': 23, 'truffaut': 24, 'disparag': 8, 'cahier': 4, 'athlet': 73, '36': 23, 'cancer': 76, 'tulip': 22, 'acerb': 12, 'esteem': 42, 'whim': 26, 'loyalti': 89, 'sworn': 14, 'jacqu': 56, 'cineast': 8, 'chabrol': 14, 'outgrew': 2, 'childish': 120, 'condescens': 6, 'cognoscenti': 3, 'condescend': 37, 'demean': 35, 'viva': 18, 'honki': 11, 'tonk': 9, 'debra': 52, 'sissi': 90, 'evoc': 34, '1809': 1, 'hodgensvil': 1, '1865': 3, '1837': 3, 'log': 42, 'todd': 112, 'weaver': 39, 'departur': 69, 'congress': 24, 'quillan': 3, 'posterior': 10, 'meek': 46, 'prosecutor': 23, 'idealist': 52, 'springfield': 7, 'solicitor': 15, 'regularli': 53, 'clementin': 8, 'fort': 46, 'skil': 5, 'upright': 17, 'straightforward': 76, 'huston': 66, 'merkel': 3, 'illinoi': 25, 'massey': 48, 'vidal': 17, 'waterston': 13, 'nietzsch': 15, 'risqu': 24, 'redicul': 7, 'robe': 28, 'lorr': 37, 'rubber': 91, 'beth': 39, 'rehab': 15, 'tennyson': 2, 'collag': 23, 'sacker': 2, 'conaway': 9, 'connecticut': 26, 'florida': 106, 'clyton': 1, 'chad': 25, 'spill': 62, 'gavin': 17, 'mcgee': 5, 'slice': 125, 'everglad': 5, 'bewild': 39, 'splinter': 12, 'cellphon': 12, 'tina': 39, 'daphn': 35, 'zuniga': 18, 'sleepi': 40, 'dorm': 29, 'demolit': 22, 'hellrais': 18, 'entrap': 10, 'scrape': 44, 'fahrenheit': 4, 'unwav': 11, 'unsteadi': 4, 'environment': 40, 'unsustain': 1, 'pursuit': 95, 'nb': 5, 'varsiti': 2, 'ob101': 1, 'painter': 83, 'prerequisit': 12, 'nietzch': 4, 'vienna': 38, 'prestigi': 29, 'overdo': 25, 'spun': 21, 'tenant': 101, 'fitzgerald': 42, 'markham': 11, 'hairdo': 30, 'fanci': 146, 'virago': 1, 'dwelt': 4, 'complais': 2, 'huntingdon': 6, 'apolog': 107, 'lump': 37, 'flashpot': 1, 'shh': 1, '2031': 1, 'yak': 7, 'sheep': 46, 'uzi': 7, 'paintbal': 9, 'ineptitud': 25, 'stairwel': 9, 'deherrera': 1, 'karma': 15, 'walki': 3, 'stocki': 3, 'restless': 34, 'bowl': 105, 'secretli': 93, 'slavoj': 12, 'ek': 22, 'sophi': 62, 'reconstruct': 24, 'sith': 14, 'unanswer': 2, 'astra': 1, '05': 13, 'slovenian': 12, 'feverishli': 3, 'chaplin': 152, 'ventriloquist': 6, 'groucho': 4, 'marx': 37, 'chico': 23, 'harpo': 6, 'persuas': 38, 'scruffi': 10, 'hitchcock': 210, 'cumul': 9, 'tarkovski': 22, 'relentlessli': 54, 'intuit': 21, '58': 13, 'facad': 26, 'shatter': 72, 'intrins': 25, 'depriv': 28, 'lacan': 9, 'unread': 3, 'psychoanalyst': 10, 'melani': 15, 'fizz': 2, 'cinephilia': 1, 'annabel': 13, 'schofield': 4, 'hazzard': 37, '53m': 1, 'downmarket': 1, 'knoxvil': 25, 'gainey': 6, 'rosco': 33, 'weston': 10, 'eno': 6, 'tiresom': 94, 'burt': 167, 'reynold': 130, 'reliv': 36, 'hogg': 22, 'heckler': 3, 'chandrasekhar': 3, 'materialis': 7, 'needham': 7, 'georgia': 54, 'unattract': 63, 'perfunctori': 11, 'allig': 42, 'caiman': 2, 'nonmov': 1, 'limb': 55, 'miniatur': 36, 'underwat': 60, 'reptil': 21, 'swirl': 23, 'lit': 109, 'nighttim': 14, 'superstiti': 11, 'vacation': 4, 'unjustifi': 9, 'canoodl': 2, 'supermodel': 10, 'blasphem': 14, 'euroflick': 1, 'cathart': 15, 'crunch': 15, 'scarf': 19, 'dictatorship': 24, 'pro': 194, 'reissu': 11, 'nosham': 2, 'remast': 21, 'bemoan': 13, 'cheapli': 58, 'brando': 159, 'streetcar': 19, 'erstwhil': 10, 'nathan': 82, 'detroit': 52, 'simmon': 87, 'blain': 35, 'adelad': 1, 'superl': 37, 'stubbi': 16, 'clapton': 6, 'rockin': 19, 'sheldon': 9, 'pulley': 6, 'regi': 4, 'toomey': 3, 'arvid': 1, 'soooooo': 4, 'dice': 27, 'donut': 17, 'halestorm': 8, 'coleman': 36, 'vandalis': 2, 'picturesqu': 27, 'aimlessli': 28, 'crib': 15, 'chalkboard': 10, 'attic': 41, 'brochur': 6, 'nah': 18, 'shevelov': 1, 'wrought': 23, 'philander': 4, '1974': 64, 'topper': 12, 'duet': 35, 'fiasco': 40, 'neagl': 6, 'gyp': 5, 'nanett': 16, 'gall': 20, 'haul': 25, 'junkyard': 14, 'critter': 27, 'scurri': 14, 'tangent': 17, 'survey': 20, 'wreckag': 10, 'constraint': 46, 'alloy': 6, 'diner': 52, 'vacant': 19, 'spacecraft': 16, 'ingrat': 2, 'reconcili': 23, 'haircut': 36, 'kyle': 97, 'spandex': 11, 'dominatrix': 10, 'effemin': 28, 'vault': 54, 'brood': 74, 'vibe': 55, 'laden': 61, 'spine': 65, '21': 60, 'renyold': 4, 'proceed': 191, 'labouf': 2, 'appoint': 42, 'fictiti': 27, 'dam': 33, 'machismo': 12, 'intimid': 41, 'ronni': 51, 'riversid': 6, 'hillbilli': 48, 'imbr': 3, 'duell': 5, 'cock': 27, 'rifl': 101, 'inland': 8, 'fink': 3, 'jodorowski': 12, 'fando': 1, 'begotten': 4, 'pi': 26, 'tetsuo': 17, 'salom': 7, 'nuit': 9, 'avantegardist': 1, 'gadar': 5, 'bollywood': 169, 'sharma': 19, 'deol': 21, 'daft': 33, 'teesri': 3, 'aankh': 1, 'amisha': 2, 'patel': 3, 'eighth': 24, 'columbia': 52, 'whistler': 14, 'dix': 13, 'fortnight': 5, 'thwart': 37, 'slug': 96, 'duan': 6, 'penultim': 17, 'wimp': 30, 'lenor': 3, 'aubert': 2, 'blacki': 34, 'outing': 93, 'spray': 63, 'foam': 11, 'begun': 51, '700': 34, 'mp3': 3, 'disregard': 66, 'to': 21, 'retro': 40, 'laser': 45, 'speckl': 4, 'beep': 21, 'archer': 42, 'unprofession': 18, 'herald': 24, 'suchet': 9, 'poirot': 26, 'nile': 6, 'hippi': 168, 'groov': 41, 'tube': 93, 'witless': 33, 'nixon': 27, 'hoover': 38, 'waterg': 11, 'swipe': 20, 'beaver': 42, 'uranu': 6, 'fritz': 44, 'weed': 31, 'segu': 17, 'harold': 70, 'gleam': 14, 'memento': 13, 'sassi': 75, 'anew': 7, 'springsteen': 14, 'mpaa': 35, 'annal': 13, 'hungri': 77, 'jorja': 4, 'surrog': 33, 'payment': 34, 'nunn': 8, 'cadillac': 9, 'barr': 35, 'jymn': 2, 'magon': 1, 'grandmoffromero': 1, 'tenner': 3, 'wildcat': 8, 'baloo': 19, 'kit': 31, 'cloudkick': 6, 'louie': 14, 'cum': 51, 'rebecca': 35, 'webbi': 1, 'karnag': 2, 'kahn': 19, 'thembrian': 2, 'seaduck': 1, 'klang': 1, 'gummi': 7, 'gb': 4, 'ts': 6, 'extant': 3, 'archiv': 69, 'convoy': 6, 'submarin': 55, 'yeh': 5, 'quiver': 13, 'solidli': 24, 'campbel': 97, 'flander': 11, 'uber': 34, 'housewif': 72, 'indiscret': 6, 'snivel': 5, 'cuckold': 12, 'smiley': 11, 'wellworn': 1, 'flashi': 70, 'postmodern': 11, 'belliger': 6, 'leari': 34, 'blessedli': 2, 'masculin': 46, 'dump': 149, 'imaginari': 49, 'glamourpuss': 2, 'kidman': 74, 'kubrick': 133, 'femin': 26, 'fluster': 6, 'manli': 21, 'toast': 25, 'docket': 1, 'verisimilitud': 10, 'trendi': 36, 'flu': 17, 'ringlead': 5, 'skid': 18, 'offspr': 31, 'sara': 46, 'ansley': 1, 'munson': 4, 'frontal': 62, 'jonni': 25, 'leaflet': 4, 'compulsori': 9, 'moan': 47, 'piscopo': 17, 'roman': 118, 'grammar': 23, 'kitten': 30, 'misrepresent': 12, 'stapleton': 16, 'ducki': 4, 'unnot': 23, 'mississippi': 10, 'bison': 6, 'largest': 35, 'conservationist': 5, 'granger': 38, 'valiant': 20, 'meaner': 9, 'nastier': 7, 'gilsen': 1, 'calhern': 1, 'barbarian': 56, 'conqueror': 5, 'paget': 14, 'russ': 47, 'tamblyn': 17, 'halfbre': 2, 'nolan': 75, 'grizzl': 19, 'skinner': 14, 'gadget': 140, 'boob': 69, 'pigtail': 4, 'dabney': 12, 'cheif': 2, 'quimbi': 3, 'saldi': 1, 'mobil': 69, 'borderick': 1, 'wowser': 7, 'lacki': 2, 'keil': 1, 'herv': 3, 'villachez': 1, 'oddjob': 1, 'kato': 7, 'somethin': 4, 'woof': 2, 'colin': 68, 'firth': 12, 'strap': 43, 'grief': 80, 'darci': 12, 'muddi': 34, 'yankland': 1, 'paedophillia': 2, 'ghastli': 44, 'shocker': 45, 'dip': 46, 'dreamlik': 23, 'aton': 16, 'satisfactorili': 10, 'realtor': 6, 'gaunt': 12, 'arthriti': 3, 'sideshow': 9, 'unexpectedli': 79, 'chandu': 12, '34': 26, 'lemuria': 3, 'egypt': 44, 'nadji': 8, 'ubasti': 5, 'reincarn': 62, 'ossana': 1, 'thismovi': 3, 'itwors': 1, 'of10': 1, 'cluelessa': 1, 'icould': 1, 'hedidn': 1, 'docertain': 1, 'itbuilt': 1, 'howcan': 1, 'theprostitut': 1, '10minut': 2, 'itmak': 2, 'demension': 1, 'drawncharact': 1, 'stevebouchemi': 1, 'isay': 1, 'aheadth': 2, 'koen': 6, 'wauter': 7, 'beaten': 124, 'nie': 2, 'kneel': 8, 'plate': 65, 'skylin': 10, 'vestron': 3, 'paperhous': 32, 'thusli': 2, 'precoci': 17, 'mischiev': 33, 'rca': 6, 'newfound': 14, 'elliot': 37, 'spier': 6, 'editori': 12, 'hammi': 73, 'perplex': 45, 'arthous': 15, 'savor': 16, 'donni': 19, 'darko': 10, 'drek': 6, 'renew': 37, 'header': 3, 'solyari': 1, 'zizek': 85, 'reinvent': 21, 'breakumentari': 1, 'farley': 6, 'stake': 84, 'gangli': 5, 'cabo': 5, 'breakumentarion': 1, 'stray': 59, 'surgeri': 71, 'bled': 11, 'peculiar': 56, 'cherub': 7, 'seemli': 4, 'rusti': 35, 'machet': 23, 'pendragon': 4, 'circa': 43, 'ishtar': 13, 'regress': 16, 'booz': 41, 'glu': 60, 'lar': 41, 'woke': 35, 'deconstruct': 39, 'tricki': 30, 'countrymen': 7, 'distrust': 15, 'defianc': 15, 'zentropa': 20, 'dine': 32, 'mitropa': 1, 'railroad': 33, 'ss': 41, 'aachen': 1, 'capitul': 4, 'bavarian': 4, 'imprint': 18, 'hq': 6, 'bremen': 1, 'motorbik': 14, 'dvrd': 1, 'kazzam': 3, 'quicksand': 3, 'tar': 15, 'codi': 51, 'uncontrol': 31, 'mesak': 1, 'freeman': 188, '10mil': 1, 'collector': 65, 'alphabetti': 1, 'strangl': 51, 'locker': 38, 'shrug': 23, 'pois': 17, 'breakout': 15, 'pentagon': 12, 'litter': 32, 'pedestrian': 57, 'z': 103, 'thicker': 8, 'eureka': 7, 'impend': 42, 'ubiquit': 24, 'timer': 36, 'firebal': 12, 'burnt': 49, 'makeshift': 10, 'flame': 114, 'thrower': 6, 'mormon': 87, 'reenact': 18, 'hardship': 54, 'mumbl': 48, 'synthes': 28, 'nth': 6, 'stephani': 58, 'waiter': 32, 'foggi': 28, 'overcast': 1, 'luminesc': 11, 'downcast': 2, 'shabbi': 26, 'boni': 13, 'closeup': 54, 'greasi': 16, 'yuk': 19, 'desol': 41, 'dingi': 7, 'sequiteur': 1, 'epat': 1, 'bourgeoi': 21, 'shoo': 4, 'cctv': 8, 'truck': 192, 'adjac': 9, 'meter': 42, 'kiosk': 3, 'meticul': 24, 'sewer': 33, 'injuri': 75, 'rainfal': 5, 'fiber': 13, 'fingernail': 19, 'unguard': 4, 'residenti': 2, 'abduct': 55, 'unknowingli': 18, 'incrimin': 14, 'eal': 45, '1931': 36, 'intact': 52, 'chocolat': 19, 'part7': 1, 'extremelli': 2, 'didnt': 34, 'rmember': 1, 'hardest': 34, 'hadli': 2, 'bigtim': 3, 'elm': 87, 'classifi': 57, 'pakistani': 28, 'pakistan': 23, 'dutta': 5, 'shitti': 12, 'threadbar': 20, 'inordin': 11, 'overtak': 8, 'nanci': 228, 'rekindl': 22, 'homegrown': 3, 'spookhous': 1, 'frat': 42, 'annual': 31, 'pumpkin': 17, 'coot': 15, 'irritatingli': 14, 'strobe': 9, 'prologu': 53, 'gaggl': 9, 'cultist': 13, 'underact': 5, 'heidi': 10, 'jill': 62, 'kira': 15, 'shawl': 9, 'calori': 1, 'klunki': 1, 'discount': 35, 'filmatographi': 1, 'ny': 52, 'upsid': 56, 'anniyan': 2, 'kamal': 35, 'belli': 64, 'rajinikanth': 15, 'chandrmukhi': 1, 'jyotika': 1, 'namesak': 8, 'gautham': 7, 'kakka': 2, 'abviou': 1, 'thx': 6, 'injur': 72, 'lifelong': 30, 'behoov': 1, 'varga': 46, 'auteur': 51, 'tyro': 3, 'oft': 22, 'weepi': 15, 'symptom': 18, 'goodby': 57, 'incompat': 8, 'constip': 13, 'lifelessli': 2, 'marth': 6, 'mae': 50, 'uninhibit': 14, 'redgrav': 45, 'expressionless': 13, 'vill': 4, 'ze': 4, 'omelet': 3, 'rife': 13, 'garafolo': 3, 'castro': 45, 'shannon': 44, 'snowbal': 10, 'rudd': 38, 'nerdier': 1, 'deadpan': 36, 'frustratingli': 21, 'antz': 16, 'similiar': 4, 'grinch': 103, 'unbreak': 9, 'cinemtrophi': 1, 'powerhous': 24, 'alot': 52, 'synopsi': 111, 'feasibl': 7, 'crichton': 4, 'gynaecolog': 1, 'whisper': 45, 'psychodrama': 3, 'discomfit': 4, 'mast': 7, 'flay': 10, 'poignantli': 10, 'humdrum': 21, 'tawdri': 17, 'richest': 12, 'durant': 31, 'yer': 9, 'dant': 45, 'inferno': 19, 'pedantri': 1, 'shambol': 3, 'malici': 26, 'gleeful': 14, 'rene': 53, 'amid': 39, 'jolt': 36, 'liveli': 9, 'zip': 23, 'paralys': 2, 'tz': 2, 'emascul': 10, 'confound': 15, 'malevol': 33, 'stoical': 4, 'argentinean': 5, 'argentin': 16, 'az': 13, 'silverstein': 11, 'satyr': 1, 'so': 4, 'malo': 2, 'peretti': 9, 'luqu': 9, 'upgrad': 18, 'szifr': 2, 'taint': 32, 'tbn': 8, 'anway': 1, 'propoghanda': 1, 'omega': 25, 'dogma': 39, 'mexico': 185, 'foist': 11, 'glacier': 14, 'wildlif': 26, 'cub': 21, 'inhospit': 3, 'intercut': 25, 'crab': 26, 'wallet': 33, 'ymca': 3, 'shaker': 5, 'mib': 4, 'clandestin': 11, 'jrotc': 1, 'ineffect': 28, 'straw': 45, 'unwilling': 17, 'moralist': 22, 'chretien': 1, 'perciv': 1, 'ungal': 1, 'churl': 1, 'francophil': 3, 'arthuriophil': 1, 'etho': 6, 'replic': 32, 'handedli': 27, 'anch': 1, 'sayl': 2, 'outright': 64, 'berriault': 1, 'wilford': 9, 'brimley': 10, 'freder': 13, 'forrest': 53, 'horner': 11, 'stallion': 24, '1984': 84, 'matewan': 3, '1987': 83, 'roan': 1, 'inish': 1, 'foolish': 71, '1915': 16, 'weber': 17, 'hypocrit': 38, 'demil': 56, 'benchmark': 18, 'yevgeni': 2, 'daydream': 18, 'atlant': 46, 'overhead': 22, 'enrag': 33, 'musket': 9, 'alley': 79, '1912': 16, 'reginald': 26, '1916': 11, 'romantic': 39, 'beban': 7, 'curtain': 63, 'drape': 16, 'dissolv': 41, 'iris': 2, 'disharmoni': 3, 'naturalist': 27, 'dissolut': 13, 'disproportion': 5, 'corrigan': 5, 'breastfeed': 1, 'unwarr': 12, 'heal': 95, 'midnit': 2, 'recept': 43, '1962': 32, 'lucien': 12, 'ballard': 9, 'eugen': 91, 'louri': 1, 'raksin': 1, 'macliammoir': 3, 'diction': 14, 'agn': 21, 'evangelist': 15, 'overstay': 9, 'needlessli': 36, 'rivalri': 45, 'roo': 8, 'ransohoff': 1, 'nikolayev': 2, 'ita': 1, 'stall': 25, 'refug': 29, 'gettaway': 3, 'dumpster': 12, 'basseng': 5, 'unnecessarili': 44, 'stale': 90, '2017': 4, 'hairstyl': 38, 'schwarzeneggar': 3, 'escape': 19, 'amber': 30, 'conchita': 9, 'alonso': 11, 'totalitarian': 17, 'buzzsaw': 4, 'flamethrow': 8, 'fittingli': 10, 'wittic': 3, 'beefcak': 11, 'glaser': 7, 'det': 18, 'starski': 13, 'hutch': 9, 'nom': 3, 'plume': 1, 'bachman': 11, 'giggl': 93, 'cach': 4, 'billboard': 25, 'founder': 18, 'filmfestiv': 2, 'gershuni': 5, 'hindsight': 29, 'compromis': 83, 'cooki': 84, 'shoestr': 28, 'herz': 1, 'camilla': 12, 'woronow': 1, 'grimmer': 3, 'roeg': 33, 'cammel': 1, 'unclear': 48, 'splendidli': 21, 'interwoven': 20, 'guss': 2, 'catalog': 31, 'distributor': 60, 'decarlo': 7, 'prussian': 1, 'screwier': 1, 'montez': 2, 'prussia': 3, 'arizona': 34, 'cleve': 1, 'scottish': 93, 'breathtakingli': 17, 'kangwon': 8, 'provinc': 22, 'sang': 54, 'dosag': 2, 'ironi': 163, 'therein': 30, 'woe': 20, 'unsympathet': 55, 'offset': 21, 'hyper': 55, 'fallibl': 9, 'wallop': 17, 'tighten': 27, 'overus': 47, 'sidewalk': 63, 'overzeal': 9, 'goodnik': 4, 'tulli': 20, 'tierney': 76, 'sparki': 2, 'impuls': 57, 'thief': 158, 'watchman': 5, 'feloni': 1, 'moperi': 1, 'rubric': 4, 'macpherson': 1, 'prompt': 40, 'down': 70, 'cab': 53, 'ripost': 3, 'twitch': 29, 'preming': 73, 'pronounc': 64, 'lice': 4, 'monro': 45, 'saintli': 7, 'med': 22, 'bipolar': 10, 'muller': 20, 'popcorn': 112, 'peggi': 47, 'hain': 73, 'spoofi': 2, 'commissari': 4, 'meal': 63, 'dell': 20, 'henderson': 41, 'tinseltown': 9, 'yearn': 75, 'dashingli': 2, 'ralli': 37, 'vidor': 18, 'hart': 109, 'tilli': 29, 'homespun': 7, 'radiat': 70, 'ecolog': 20, 'berserk': 40, 'gaze': 53, 'oral': 29, 'bench': 29, 'garag': 44, 'scrappi': 30, 'bathet': 1, 'sleev': 42, 'playbook': 1, 'lebowski': 6, 'zooland': 6, 'thornton': 26, 'reccomend': 10, 'polem': 16, 'incis': 10, 'iraq': 85, 'agitprop': 4, 'leni': 2, 'reifenst': 1, 'laud': 23, 'valuabl': 97, 'goodtim': 6, 'invalu': 13, 'overt': 33, 'distort': 85, 'plural': 4, 'manchuria': 2, 'teeter': 15, 'underscor': 35, 'clog': 5, 'tenuou': 17, 'tran': 13, '49': 19, '90min': 5, 'stereo': 28, 'sped': 15, 'thet': 2, 'railrodd': 2, 'trackspeed': 1, 'nova': 6, 'scotia': 1, 'naomi': 16, 'watt': 22, 'mantl': 6, 'yahoo': 31, 'carlton': 21, 'chitti': 1, 'bacchu': 1, 'marsh': 21, 'clune': 1, 'ballarat': 1, 'eaten': 90, 'platoon': 34, 'gunman': 17, 'unreel': 1, 'unconnect': 12, 'ganzel': 4, 'dusenberri': 5, 'prettili': 3, 'glamor': 104, 'benson': 34, 'windup': 2, 'brightli': 21, 'patrol': 26, 'knockout': 20, 'hoechlin': 18, 'wack': 9, 'thicken': 14, 'shaft': 30, 'dodgebal': 6, 'superstar': 57, 'azaria': 34, 'burger': 17, 'lieb': 1, 'awok': 8, 'nekromantik': 15, 'todesk': 26, 'necrophilia': 10, 'invok': 24, 'fysic': 1, 'fragil': 68, 'buttgereit': 25, 'unevit': 1, 'grasp': 128, 'harvest': 41, 'schopenhauerian': 1, 'oldest': 71, 'pessimist': 23, 'maggot': 23, 'sieben': 1, 'tage': 1, 'woch': 2, 'siebenm': 1, 'letzt': 2, 'stunden': 1, 'reaper': 22, 'pluck': 25, 'ingemar': 2, 'bergman': 97, 'seventh': 36, 'sacrif': 63, 'lai': 5, 'cannabi': 8, 'reckon': 42, 'videograph': 4, 'swoon': 18, 'pushi': 8, 'solut': 106, 'airhead': 16, 'profesor': 3, 'boarder': 8, 'blither': 3, 'fruitless': 9, 'hoodlum': 30, 'vet': 78, 'sev7n': 1, 'haskel': 7, 'marti': 94, 'disservic': 29, 'dumber': 55, 'lindey': 1, 'pintili': 14, 'romania': 39, 'romanian': 41, 'brithish': 2, 'ceausescu': 4, 'connelli': 27, 'phenomena': 19, 'sasha': 16, 'outlaw': 72, 'ram': 76, 'gopal': 20, 'varma': 27, 'showi': 19, 'scarc': 49, 'suffoc': 24, 'katya': 7, 'pruner': 1, 'mortgag': 18, 'drugstor': 11, 'devin': 16, 'zodiac': 45, 'mo': 39, 'dusseldorf': 1, 'haarman': 5, 'btk': 33, 'jumbl': 41, 'quickest': 5, 'dsm': 5, 'gass': 9, 'davison': 4, 'bilko': 17, 'phil': 80, 'sacrilag': 1, 'peev': 11, 'zhivago': 9, 'scriptur': 30, 'legitimaci': 11, 'messiah': 20, 'baptiz': 5, '22': 78, 'baptist': 28, '38': 11, 'moonbeam': 1, 'pharise': 2, '39': 22, 'sermon': 24, 'expurg': 3, 'magdalen': 6, 'parabl': 26, 'prodig': 4, 'tax': 81, 'nazareth': 3, 'sonor': 3, 'hifi': 2, 'nov': 6, 'arcam': 1, 'dt': 4, 'rocker': 44, 'cynthia': 21, 'rothrock': 13, 'buntao': 1, 'syndic': 34, 'fran': 24, 'tumbuan': 1, 'horrid': 116, 'muldoon': 2, 'takeov': 11, 'fairchild': 8, 'government': 7, 'olm': 1, 'murdoch': 10, 'ridley': 22, 'kathleen': 50, 'dotti': 5, 'lightweight': 37, 'kaspar': 1, 'rankin': 7, 'superimposit': 4, 'masu': 1, 'inou': 4, 'janitor': 38, 'huddl': 9, 'pond': 40, 'swarm': 26, 'frenet': 35, 'applaud': 102, 'shrek': 43, 'loner': 51, 'gauntlet': 10, 'manni': 21, 'suce': 2, 'unheard': 21, 'debas': 13, 'pilger': 6, 'complicit': 6, 'inact': 5, 'citizenri': 6, 'do': 14, 'peckinpah': 42, 'rein': 14, 'coburn': 49, 'hershey': 21, 'quad': 4, 'paull': 3, 'panach': 20, 'lawman': 13, '1966': 43, 'southeastern': 2, 'tucson': 8, 'babysat': 1, 'walt': 63, 'hurley': 12, 'brace': 14, 'daryl': 17, 'retak': 8, 'greenstreet': 12, 'idol': 71, 'uvsc': 2, 'utah': 23, 'objection': 9, 'roughli': 51, 'misnom': 8, 'divis': 51, 'gulf': 16, 'correl': 13, 'quaker': 2, 'diversifi': 6, 'millennium': 38, 'heder': 15, 'napoleon': 37, 'typecast': 32, 'hee': 18, 'scyth': 5, 'institution': 8, 'liven': 25, 'laps': 43, 'baston': 2, 'chapter': 124, 'darma': 1, 'jj': 27, 'abram': 4, 'pacula': 9, 'civilis': 22, 'fascim': 2, 'hennessi': 8, 'ditz': 7, 'sagal': 8, 'bundi': 6, 'spade': 71, 'schooler': 24, 'vike': 45, 'nordic': 8, '84': 28, 'warlord': 24, 'odin': 8, 'barek': 6, 'rebirth': 20, 'pillag': 7, 'changer': 4, 'nostril': 27, 'picker': 29, 'bukowski': 6, 'carl': 110, 'zschere': 2, 'tramp': 46, 'vietnames': 29, 'chant': 42, 'epilept': 5, 'morri': 98, 'presto': 7, 'hokum': 19, 'biscuit': 12, 'jar': 124, 'squirti': 1, 'dildo': 11, 'hodg': 24, 'pave': 22, 'fadeout': 4, 'relish': 37, 'agon': 33, 'unedit': 18, 'midsumm': 4, 'unentertain': 7, 'hammond': 15, 'tinni': 7, 'coma': 51, 'nina': 64, 'constanc': 24, 'lila': 38, 'danci': 17, 'disrupt': 35, 'grandest': 5, 'butterfli': 47, 'needlepoint': 2, 'grander': 12, 'debilit': 4, 'sandbox': 3, 'superimpos': 24, 'razzi': 29, 'seppuku': 2, 'cassidi': 85, 'frankin': 1, 'spielberg': 154, 'franklin': 58, 'panoram': 10, 'hereinmi': 1, 'exam': 22, 'kickbox': 11, 'longinidi': 2, 'preach': 95, 'retire': 2, 'plug': 58, 'trojan': 22, 'gurkan': 1, 'ozkan': 1, 'ajax': 9, 'underworld': 73, 'theo': 36, 'kebab': 2, 'backyard': 35, 'brereton': 1, 'wrongli': 38, 'buggeri': 4, 'amidst': 53, 'dexter': 37, 'salik': 1, 'ninja': 128, 'unif': 4, 'condom': 16, 'pocket': 81, 'albino': 7, 'doncast': 1, 'di': 55, 'ecstasi': 36, 'blooper': 17, 'alexio': 1, 'paperweight': 2, '2i': 1, 'raider': 54, 'oyl': 5, 'distinctli': 37, 'bluto': 3, 'alarmingli': 5, 'entrust': 7, 'mascot': 4, 'bookend': 16, 'oblowitz': 3, 'mosquitoman': 1, 'passabl': 83, 'animatronix': 1, 'whale': 141, 'cloudi': 10, 'imax': 20, 'bluth': 19, 'nimh': 7, 'mermaid': 72, 'mistreat': 31, 'pitbul': 1, 'carfac': 35, 'default': 16, 'whippet': 3, 'dachshund': 2, 'itchi': 33, 'annemari': 7, 'cuti': 18, 'unlov': 12, 'uncharismat': 6, 'danki': 2, 'infest': 42, 'generos': 9, 'pastel': 8, 'draft': 56, 'strous': 1, 'kuenster': 1, 'gator': 16, 'ballad': 37, 'melliflu': 2, 'loni': 12, 'colli': 7, 'sire': 3, 'melba': 6, 'reilli': 8, 'judith': 15, 'barsi': 8, 'joyless': 11, 'gargantuan': 18, 'canin': 14, 'admittingli': 2, 'artistri': 51, 'youngish': 6, 'dungeon': 42, 'dragon': 245, 'retitl': 11, 'maze': 37, 'underag': 13, 'unprotect': 9, 'brainwash': 40, 'fewer': 37, 'elitist': 19, 'yawner': 6, 'vigilant': 52, 'fag': 11, 'quilt': 2, 'estim': 32, 'barrier': 35, 'webster': 25, 'ronda': 14, 'steamer': 7, 'skagway': 22, 'gannon': 47, 'shadi': 37, 'brush': 69, 'gunsling': 25, 'brennan': 39, 'meati': 17, 'soften': 27, 'mcintir': 34, 'incarn': 61, 'soapi': 14, 'antihero': 13, 'lancast': 17, 'cruz': 29, 'exit': 97, 'expuls': 7, 'rhonda': 22, 'ambush': 26, 'creed': 32, 'corin': 11, 'calvert': 9, 'rube': 13, 'boardwalk': 3, 'nameless': 19, 'commiser': 6, 'je': 48, 'apropo': 12, 'ck': 31, 'alfonso': 13, 'cuar': 5, 'coen': 30, 'natali': 114, 'portman': 37, 'pixi': 7, 'gyllenha': 28, 'regurgit': 19, 'elijah': 20, 'sandino': 8, 'moreno': 11, 'nolt': 70, 'ernst': 29, 'hemingway': 17, 'carver': 11, 'cheever': 1, 'uphold': 10, 'aiden': 12, 'underestim': 28, 'biograph': 43, 'pleasent': 2, 'salem': 31, 'dreamer': 20, 'tw': 1, 'these': 6, 'zelda': 28, 'roxi': 11, 'whoo': 3, 'freeload': 3, 'luster': 12, 'boil': 124, 'machiavellian': 8, 'speakeasi': 21, 'distilleri': 2, 'freight': 7, 'sear': 16, 'philosophi': 122, 'wouldnt': 10, 'taiwanes': 18, 'swore': 8, 'iti': 3, 'fatherli': 9, 'killjoy': 5, 'begley': 9, 'perpetr': 56, 'therapi': 51, 'thickhead': 2, 'exclam': 16, 'struck': 128, 'swim': 190, '10peac': 1, 'didi': 2, 'conn': 9, 'maxwel': 19, 'caulfield': 11, 'olivia': 53, 'newton': 21, 'rydel': 3, 'zmed': 3, 'zorro': 59, 'bicycl': 38, 'leather': 66, 'goggl': 10, 'pheiffer': 2, 'arden': 15, 'caesar': 38, 'dodi': 3, 'goodman': 52, 'faculti': 9, 'birmingham': 4, 'entail': 22, 'warili': 1, 'paw': 14, 'spasmod': 2, 'marathon': 36, 'tit': 56, 'treadmil': 7, 'shini': 37, 'nite': 13, 'pasdar': 10, 'silk': 28, 'filmak': 10, 'loach': 27, 'tow': 32, 'cnn': 13, 'monopoli': 13, 'tutsi': 2, 'tamil': 13, 'bosnian': 14, 'chilean': 15, 'palestin': 10, 'impass': 16, 'jnr': 11, 'safer': 17, 'contributor': 14, 'orign': 2, 'bastion': 8, 'madsen': 54, 'jog': 15, 'outdoor': 51, 'wyom': 27, 'sandler': 175, 'outburst': 40, 'heartless': 36, 'cheadl': 61, 'jada': 19, 'pinkett': 18, 'abyss': 19, 'es': 25, 'lullabi': 8, 'cloyingli': 1, 'volvo': 3, 'prius': 1, 'wendigo': 68, 'upstat': 11, 'dima': 1, 'battleship': 10, 'peccadillo': 3, 'glen': 20, 'ridg': 16, 'jersey': 58, 'matarazzo': 9, 'suburb': 42, 'lieuten': 36, 'cogent': 10, 'plaintiff': 4, 'tripp': 4, 'bosom': 11, 'interfer': 37, 'pago': 2, 'alterc': 3, 'neoten': 1, 'barg': 10, 'dolc': 4, 'vita': 8, 'climact': 93, 'reaffirm': 10, 'rhetor': 27, 'tawana': 1, 'brawley': 1, 'bogeymen': 2, 'seemd': 1, 'koch': 10, 'schlockmeist': 3, 'slink': 5, 'hollwyood': 1, 'lear': 12, 'inbound': 1, 'divvi': 3, 'operat': 35, 'conniv': 43, 'stash': 19, 'gale': 23, 'moros': 17, 'unto': 19, 'bogard': 8, 'wilk': 9, 'meloni': 13, 'higgin': 16, '49th': 3, 'shrivel': 6, 'petrifi': 18, 'maugham': 38, 'strickland': 10, 'sixpenc': 2, 'accentu': 30, 'mercenari': 27, 'selfish': 127, 'hale': 39, 'doormat': 5, 'haviland': 2, 'leigh': 76, 'heiress': 31, 'fog': 82, 'frisco': 3, 'brusqu': 6, 'joyc': 26, 'heth': 1, 'jigsaw': 40, 'campfir': 24, 'dork': 18, 'mannequin': 20, 'chic': 19, 'shotgun': 59, 'ceram': 2, 'aptli': 28, 'voodoo': 45, 'havoc': 56, 'barb': 27, 'nerdi': 38, 'headless': 10, 'torso': 27, 'tcm': 52, 'ive': 20, 'senso': 2, 'ossession': 38, 'visconti': 52, 'calamai': 15, 'giovanna': 50, 'massimo': 12, 'girotti': 13, 'gino': 48, 'nicholson': 113, 'glossier': 3, 'narna': 2, 'robber': 80, 'thrillingli': 2, 'persbrandt': 3, 'ach': 29, 'manuscript': 21, 'rainmak': 7, 'disconnect': 34, 'bind': 26, 'briefcas': 13, 'probat': 20, 'blaxploit': 31, 'devilri': 1, 'stunk': 30, 'delia': 36, 'therapist': 33, 'devilish': 27, 'sulki': 3, 'hammish': 1, 'villaronga': 9, 'aro': 8, 'slept': 40, 'subjug': 9, 'activist': 39, 'trump': 41, 'wrenchingli': 7, 'galvan': 7, 'fineman': 29, 'crutch': 18, 'rampl': 11, 'quint': 3, 'leaden': 20, 'soliloqui': 6, 'saddl': 61, 'bred': 14, 'enslav': 19, 'contradictori': 14, 'denounc': 15, 'runaway': 50, 'chago': 3, 'anonym': 48, 'unwil': 37, 'birthplac': 11, 'heliport': 1, 'forcibl': 13, 'fallaci': 17, 'artifact': 32, 'benq': 1, 'pe': 4, '8700': 1, 'diagon': 5, 'colouris': 1, 'teddi': 40, 'scrutini': 19, 'misadventur': 29, 'forlorn': 11, 'sardon': 29, 'dahl': 34, 'rounder': 10, 'deft': 23, 'yoakam': 6, 'oneself': 22, 'piscipo': 1, 'disintegr': 23, 'greed': 86, 'breakneck': 6, 'crank': 47, 'solimeno': 1, 'firearm': 11, 'aris': 67, 'marksman': 2, 'ak': 8, '47': 27, 'bolo': 11, 'yeung': 8, 'donkey': 14, 'faulk': 2, 'olympia': 31, 'dukaki': 38, 'q': 116, 'swift': 39, 'hercul': 20, 'sorbo': 3, 'thrust': 60, 'slipper': 26, 'drudgeri': 6, 'tremain': 12, 'lucif': 22, 'pushov': 3, 'justli': 15, 'catti': 7, 'cindi': 53, 'fondli': 24, 'ilen': 4, 'bibbidi': 7, 'bobbidi': 7, 'mmm': 11, 'concensu': 1, 'almighti': 44, 'irrepress': 7, 'payrol': 10, 'worshipp': 6, 'temperatur': 29, 'backer': 7, 'lobbi': 21, 'elia': 29, 'kazan': 64, 'eden': 22, 'mostel': 39, 'phobia': 18, 'wayi': 1, 'cola': 10, 'masterwork': 29, 'hubbard': 5, 'dianetitc': 1, 'reread': 9, 'ishmael': 4, '38k': 2, 'baltar': 5, 'mitochondri': 3, 'krush': 1, 'rappin': 4, 'stupa': 1, 'rhymin': 1, 'cking': 8, 'emce': 5, 'peebl': 6, 'bodybuild': 9, 'highest': 106, 'blondi': 8, 'raptur': 46, 'def': 18, 'overproduc': 3, 'spartan': 10, 'watchmen': 4, 'sendup': 3, 'jeanan': 1, 'garafalo': 2, 'kinnear': 60, 'lasser': 7, 'unseri': 2, 'heckerl': 7, 'ridgemont': 5, 'breez': 30, 'vermin': 14, 'dimitri': 17, 'vocabulari': 24, 'griffit': 1, 'dunn': 52, 'maurren': 1, 'merilu': 1, 'butku': 2, 'pappi': 14, 'staden': 24, 'smother': 24, 'blais': 49, 'calzon': 1, 'spiegel': 4, 'nikolaj': 6, 'waldau': 8, 'pseudonym': 15, 'shakespearian': 13, 'regal': 37, 'unwis': 18, 'norah': 7, '1500': 5, 'phycho': 2, 'spurt': 18, 'kwik': 1, 'ez': 3, 'don': 23, '4h': 1, 'barf': 16, 'jackass': 38, 'zillion': 16, 'deform': 35, 'gena': 44, 'refut': 10, 'existenti': 45, 'truest': 11, 'skeleton': 45, 'sunris': 57, 'tensiti': 2, 'hostel': 50, 'requiem': 14, 'leadership': 29, 'abba': 14, 'fractur': 20, 'mahatma': 24, 'scholarship': 26, 'islam': 51, 'hinduism': 7, 'mohanda': 5, 'karamchand': 4, 'gujarat': 1, 'reloc': 18, 'prickli': 8, 'versu': 109, 'oblig': 73, 'upto': 2, 'in': 48, 'nobil': 22, 'khanna': 23, 'lifespan': 4, 'despond': 8, 'caricaturish': 1, 'humanis': 3, 'abundantli': 7, 'alp': 7, 'campsit': 6, 'kenyon': 8, 'tyranu': 2, 'helmet': 53, 'stew': 13, 'undead': 64, 'demonicu': 22, 'armor': 46, 'brandish': 7, 'mummi': 115, 'andoheb': 3, 'zucco': 6, 'mehemet': 1, 'bey': 18, 'turhan': 5, 'oversea': 33, 'khari': 17, 'lon': 23, 'chaney': 28, 'lumber': 30, 'foran': 10, 'hanson': 25, 'wallac': 117, 'mummifi': 11, 'ananka': 1, 'desecr': 8, 'egyptian': 46, 'hideaway': 5, 'karnak': 1, 'tana': 2, 'subservi': 9, 'bide': 5, 'isobel': 5, 'elys': 5, 'knox': 34, 'covet': 15, 'carnag': 55, 'cornbal': 14, 'lous': 5, 'frolick': 8, 'torch': 56, 'engulf': 26, 'werner': 33, 'herzog': 17, 'hanek': 9, 'noe': 6, 'carmichael': 7, 'fetid': 6, 'addl': 12, 'infantil': 23, 'overst': 22, 'clockwork': 38, 'scroog': 101, 'instig': 14, 'rapidli': 62, 'polanski': 106, 'outcast': 40, 'isabel': 80, 'adjani': 13, 'melyvn': 1, 'decoy': 12, 'abscond': 6, 'pokemon': 93, 'detractor': 22, 'suicun': 4, 'celebi': 14, 'trainer': 27, 'ash': 63, 'pikachu': 14, 'brock': 29, 'johto': 1, 'pokebal': 2, 'meowth': 1, 'nephew': 99, 'cetera': 13, 'blindli': 20, '5th': 27, 'boffo': 4, 'iceberg': 35, 'tomba': 11, 'unzik': 1, 'leva': 2, 'antevleva': 1, 'palassio': 1, 'giusstissia': 1, 'retread': 27, 'circu': 72, 'cicu': 1, 'cleavag': 23, 'stella': 57, 'whitman': 15, 'racisim': 1, 'arson': 8, 'maltes': 19, 'falcon': 28, 'whodunit': 25, 'embellish': 24, 'wellesian': 3, 'hbc': 2, 'plaudit': 6, 'helena': 41, 'bonham': 46, 'mnd': 2, 'branagh': 186, 'proposit': 26, 'gingerbread': 16, 'eagerli': 50, 'cher': 68, 'woebegon': 3, 'chazz': 9, 'palminteri': 7, 'mazurski': 11, 'funk': 13, 'listless': 23, 'fraudul': 12, 'tressa': 3, 'platinum': 15, 'viktor': 4, 'burakov': 19, 'stephan': 9, 'autopsi': 22, 'demunn': 13, 'bukhanovski': 3, 'sydow': 27, 'union': 140, 'commissar': 2, 'bondarchuk': 8, 'veronica': 32, 'redfield': 15, 'trespass': 10, 'umbrella': 22, 'reak': 3, 'comfi': 8, 'dreamcast': 9, 'wierd': 7, 'scamper': 4, 'maggart': 2, 'slack': 36, 'rewind': 41, 'detmer': 20, 'prowl': 25, 'maserati': 1, 'wardrob': 67, 'rooftop': 18, 'antigon': 2, 'midler': 40, 'gaelic': 19, 'highland': 26, 'clearanc': 5, 'gaieti': 3, 'skye': 11, 'dose': 115, 'folklor': 27, 'innumer': 14, 'jansen': 17, 'corcoran': 3, 'sportsman': 2, 'keeslar': 1, 'dimens': 110, 'speedskat': 1, 'oval': 3, 'muder': 1, 'unsolv': 18, 'sportsmen': 1, 'shuck': 4, 'cimarron': 6, 'colt': 6, 'mustang': 9, 'appaloosa': 1, 'subtract': 20, 'melodi': 95, 'twentieth': 30, 'homeland': 23, 'eisner': 11, 'testosteron': 14, 'musclehead': 2, 'tx': 8, 'b4': 1, 'quaid': 75, 'dugout': 3, 'pitcher': 21, 'gushi': 3, 'fret': 13, 'paraplui': 1, 'cherbourg': 3, 'huit': 3, 'audrey': 66, 'tautou': 24, 'warren': 117, 'offshoot': 2, 'isthar': 1, 'spoileri': 2, 'columbin': 25, 'calvin': 30, 'robertson': 58, 'keuck': 2, 'clicheish': 2, 'foxx': 78, 'epp': 33, 'julio': 7, 'ramundo': 2, 'wednesday': 14, 'fee': 27, 'spacek': 22, 'leftist': 18, 'inescap': 20, 'redhead': 20, 'lambast': 9, 'volt': 5, 'clees': 27, 'implor': 16, 'genteel': 10, 'astrodom': 1, 'creak': 19, 'kellerman': 16, 'cort': 19, 'adler': 4, 'pollard': 5, 'showpiec': 4, 'distast': 49, 'misrepres': 10, 'streamlin': 14, 'timefram': 4, 'unmiss': 13, 'franka': 13, 'clooney': 55, 'hectic': 21, 'doze': 24, 'daunt': 9, 'inadvert': 52, '1st': 139, 'episdo': 1, 'makepeac': 9, 'cheney': 12, 'workgroup': 1, 'exxon': 3, 'sistin': 2, 'chapel': 10, '401k': 1, 'nord': 11, 'effortlessli': 41, 'stagey': 13, 'marcel': 48, 'carn': 15, 'suicide': 1, 'untrammel': 1, 'arletti': 6, 'zipper': 5, 'jouvet': 7, 'hdn': 1, 'sonni': 50, 'evergreen': 18, 'annabella': 5, 'aumont': 3, 'heurtebis': 1, 'perier': 1, 'sept': 14, 'bader': 2, 'tiff': 14, 'ewast': 1, 'boost': 50, 'censorship': 43, 'preen': 7, '480m': 1, 'gorg': 14, 'khang': 1, 'sanxia': 1, 'haoren': 1, 'dong': 13, 'baichwal': 3, 'pencier': 1, 'mettler': 3, 'noah': 33, 'weinzweig': 1, 'wuther': 12, 'luka': 68, 'accolad': 26, 'naziism': 1, 'hysteria': 29, 'wwi': 35, 'ancestri': 16, 'braveri': 34, 'hellman': 24, 'dresden': 4, 'firestorm': 3, 'rhine': 19, 'rhein': 2, 'wach': 3, 'bodo': 2, 'snob': 39, 'geograph': 25, 'suv': 23, 'goddard': 8, 'antonioni': 82, 'milwauke': 7, 'remer': 7, 'felon': 11, 'arn': 9, 'southpark': 3, 'cruddi': 9, '10jame': 1, 'johnston': 25, 'dali': 18, 'reactionari': 20, 'ascrib': 3, 'fundamentalist': 24, 'moslem': 15, 'theolog': 28, 'westboro': 2, 'milit': 16, 'scholar': 28, 'limbaugh': 2, 'flexibl': 13, 'cartwheel': 3, 'wilton': 7, 'hampshir': 7, 'bartold': 1, 'formerli': 28, 'morrow': 14, 'merri': 49, 'ander': 28, 'davalo': 3, 'isenberg': 1, '136': 3, 'freaki': 58, 'elga': 3, 'bethun': 2, 'igor': 30, 'kartalian': 2, 'roy': 228, 'monson': 6, 'milliagn': 1, '78': 15, 'milligan': 19, 'sank': 20, 'norden': 1, 'cane': 26, 'stung': 7, 'wasp': 17, 'piranha': 7, 'tank': 120, 'pirahna': 2, 'erm': 18, 'muffl': 11, 'duffer': 1, 'morani': 6, 'lamer': 13, 'cundey': 3, 'majest': 28, 'klineschloss': 2, 'punctur': 11, 'burgermist': 1, 'gustav': 9, 'schoen': 3, 'belmor': 4, 'burgermeist': 5, 'kook': 7, 'glieb': 1, 'emil': 39, 'frazer': 3, 'renfield': 4, 'tidbit': 14, 'canyon': 80, 'bulimia': 14, 'lohman': 9, 'diet': 29, 'diabet': 6, 'askew': 8, 'bulim': 9, 'secreci': 10, 'rosalba': 11, 'neri': 11, 'villai': 17, 'brawl': 44, 'terenc': 11, 'yuma': 19, 'cowardli': 39, 'tuco': 1, 'orphanag': 33, 'wheeler': 26, 'doorman': 3, 'snappi': 33, 'orphan': 67, 'travelogu': 14, 'honey': 39, 'incest': 48, 'pok': 21, 'lonli': 1, 'gullibl': 27, 'stoop': 36, 'bleep': 18, 'interpol': 10, 'soni': 19, 'que': 15, 'paz': 42, 'santi': 3, 'millan': 1, 'afloat': 23, 'rosario': 63, 'assail': 22, 'nullifi': 7, 'judici': 17, 'bizet': 9, 'deighton': 4, 'rewrit': 60, 'samson': 12, 'minefield': 4, 'frontier': 68, 'disorient': 4, 'comport': 2, 'clevemor': 1, 'diminut': 15, 'alistair': 9, 'sim': 23, 'gerbil': 2, 'lansburi': 38, 'eglantin': 13, 'apprentic': 34, 'emerliu': 1, 'tomlinson': 30, 'steak': 11, 'battlestar': 49, 'galactica': 51, 'cheeken': 2, 'ee': 4, 'zir': 2, 'chef': 43, 'zay': 1, 'zomez': 1, 'zo': 4, 'deesh': 1, 'bg': 9, 'shamelessli': 35, 'scifi': 60, 'semblanc': 44, 'imperfect': 26, 'lag': 18, 'infinit': 58, 'babylon': 16, 'digest': 56, 'adama': 14, 'unfeel': 10, 'artisan': 14, 'cater': 55, 'nich': 28, 'gump': 24, 'khoda': 1, 'majid': 2, 'majidi': 3, 'wo': 7, 'lok': 11, 'yam': 10, 'leung': 18, 'ka': 31, 'fai': 10, 'koo': 17, 'cheung': 39, 'siu': 21, 'suet': 3, 'tung': 29, 'kun': 2, 'invad': 79, 'ant': 109, 'nearbi': 109, 'unfinish': 32, 'undon': 21, 'chirin': 3, 'catharsi': 16, '7eventi': 6, '5ive': 6, 'throwback': 27, 'tedious': 16, 'momentum': 50, 'pulpi': 7, 'spunki': 16, 'rutger': 10, 'hauer': 5, 'slickli': 9, 'godzilla': 105, 'mortifi': 4, 'bunuel': 27, 'jordowski': 1, 'erudit': 9, 'educt': 1, 'taximet': 1, 'zoo': 31, 'gorilla': 52, 'amen': 13, 'gertrud': 31, 'boomer': 24, 'hubrist': 2, 'damnit': 2, 'biddi': 4, 'reg': 13, 'prematur': 28, 'dissemin': 7, 'retcon': 1, 'wand': 4, 'bsg': 63, 'cylon': 42, 'caprica': 45, 'olmo': 5, 'grayston': 4, 'rdm': 1, 'alisan': 6, 'mplex': 1, 'lewd': 8, 'vista': 25, 'seldom': 81, 'bullock': 27, 'graci': 20, 'deja': 23, 'vu': 26, 'cassi': 45, 'mayweth': 1, 'snooz': 21, 'premedit': 7, 'spree': 70, 'cite': 30, 'sccm': 1, 'allegori': 34, 'conspicu': 17, 'consumpt': 27, 'pedophilia': 11, 'freeway': 18, 'satellit': 34, 'geosynchron': 1, 'orbit': 27, 'orwellian': 10, 'turbul': 26, 'gwyneth': 52, 'paltrow': 95, 'easiest': 25, 'knightli': 25, 'melancholi': 44, 'gaskel': 1, 'austen': 92, 'samantha': 57, 'morton': 26, 'fourthli': 1, 'fifthli': 1, 'confusingli': 6, 'cheapest': 16, '21st': 62, 'fletcher': 14, 'mackinnon': 2, 'finland': 16, 'lorica': 1, 'tivo': 13, 'intertwin': 53, 'neve': 24, 'ullman': 19, 'bain': 15, 'unclutt': 2, 'dorfman': 11, 'mindset': 38, 'melod': 9, 'kristofferson': 49, 'combo': 28, 'esther': 75, 'minneapoli': 8, 'espeic': 1, 'dc': 24, 'navig': 24, 'strateg': 15, 'spidey': 7, 'snag': 17, 'warrant': 83, 'griffth': 2, 'triumphant': 13, 'chirp': 8, 'rustic': 8, 'apron': 8, 'vase': 9, 'tingwel': 4, 'companionship': 22, 'teamwork': 13, 'affection': 31, 'sag': 19, 'ramsey': 15, 'bittersweet': 49, 'anecdot': 25, 'malaysian': 3, 'yasmin': 14, 'ahmad': 37, 'sharifah': 4, 'aryana': 3, 'mohd': 3, 'syafi': 2, 'naswip': 3, 'ork': 19, 'gubra': 6, 'upbring': 38, 'mukhsin': 24, 'fistfight': 11, 'bike': 89, 'aftertast': 12, 'unfilt': 4, 'adulter': 24, 'neverend': 13, 'miyazaki': 84, 'yokai': 60, 'gamera': 57, 'kirin': 4, 'hmm': 49, 'takashi': 45, 'miik': 136, 'ichi': 35, 'katakuri': 3, 'omigod': 2, 'dramatis': 20, 'tils': 1, 'bafta': 28, 'havana': 21, 'adelaid': 30, 'keith': 88, 'brannigan': 4, 'blackton': 1, 'cyril': 7, 'mockridg': 1, '42': 27, 'fraction': 18, 'blur': 63, 'fatti': 18, 'preston': 80, 'joquin': 1, 'phoenix': 52, 'gilliam': 64, 'madelin': 20, 'stow': 33, 'christov': 1, 'plummer': 41, 'extraordinarili': 37, 'rite': 20, 'hotz': 3, 'rice': 51, 'gantlet': 2, 'guru': 43, 'pa': 45, 'niagara': 2, 'prayer': 41, 'undevelop': 34, 'absurdist': 18, 'wail': 21, 'sequit': 4, 'monoa': 2, 'prolong': 45, 'mastrosimon': 4, 'unveil': 20, 'reportedli': 37, 'bruis': 29, 'ace': 75, 'indign': 17, 'zp': 11, 'capsul': 35, 'tavoulari': 1, 'extran': 17, 'frechett': 18, 'daria': 40, 'halprin': 6, 'rotterdam': 5, 'jan': 84, '06': 14, 'hubbl': 1, 'nd': 5, 'simplif': 4, 'ch': 45, 'shyest': 1, 'thinker': 15, 'scuddamor': 13, 'hideous': 28, 'vindict': 14, 'jester': 20, 'tormentor': 21, 'ezra': 8, 'litten': 2, 'dugdal': 3, 'trot': 30, 'endearingli': 13, 'steadican': 1, 'groovi': 28, 'smatter': 11, 'tractor': 9, 'thirtyish': 1, 'siren': 37, 'carolin': 32, 'munro': 28, 'carmin': 3, 'iannaccon': 1, 'smartaleck': 2, 'pollack': 30, 'hartman': 30, 'meathead': 5, 'yeager': 6, 'manfredini': 4, 'rattl': 24, 'pudney': 1, 'marit': 34, 'lubitsch': 44, 'ninotchka': 9, 'auster': 20, 'envoy': 3, 'karin': 12, 'ski': 23, 'prioriti': 27, 'katherin': 29, 'fidel': 45, '1941': 35, 'cukor': 22, '1937': 33, 'camil': 15, 'behrman': 1, 'salka': 4, 'viertel': 3, 'oppenheim': 3, 'contempor': 1, 'griselda': 1, 'unflatteringli': 1, 'ruttenberg': 1, 'chica': 5, 'choca': 1, 'bono': 10, 'curio': 15, 'burstyn': 26, 'mathi': 8, 'jodel': 8, 'ferland': 9, 'cridit': 1, 'payoff': 52, 's01e01': 1, 'substant': 12, '2007': 110, 'significantli': 38, 'unrev': 4, 'hanger': 18, 'granddaddi': 4, 'vd': 10, 'nauseou': 15, 'shtick': 30, 'proselyt': 3, 'scarfac': 62, 'comb': 63, 'convention': 2, 'soderbergh': 83, 'che': 217, 'guevara': 46, 'bolivia': 34, 'bolivian': 15, 'sadder': 16, 'peasant': 41, 'worsen': 13, 'liabil': 12, 'militia': 11, 'bedtim': 12, 'gwen': 12, 'verndon': 1, 'amech': 15, 'guttenberg': 13, 'gilford': 2, 'cronyn': 2, 'fecal': 13, 'softcor': 24, 'finial': 1, 'draub': 1, 'emotionless': 26, 'woah': 9, 'uh': 72, 'arch': 43, 'shotti': 1, 'balki': 5, 'pinchot': 12, 'bronx': 25, 'cajun': 9, 'traver': 13, 'dreyfu': 16, 'sanitarium': 12, 'droll': 23, 'vamp': 29, 'entertainingli': 7, 'maclachlan': 6, 'oo': 3, 'err': 23, 'physcolog': 1, 'ott': 24, 'bodycount': 6, 'icant': 1, 'crimson': 19, 'campfest': 1, 'frog': 66, 'lepu': 1, '40am': 1, 'silliest': 17, 'unthreaten': 4, 'davidson': 19, 'shatner': 43, 'faintli': 6, 'bf': 2, 'skinnerfeel': 1, 'cantina': 6, 'suburban': 60, '1h': 3, 'minuet': 5, 'headey': 5, 'mish': 27, 'trippi': 22, 'freezer': 9, 'irregular': 6, 'rail': 41, 'subway': 60, 'abattoir': 1, 'cadav': 9, 'ry': 7, 'hei': 1, 'kitamura': 19, 'unansw': 51, 'clarifi': 26, 'korean': 144, 'dressler': 27, 'kindli': 45, 'polli': 60, 'detriment': 23, 'holier': 7, 'permut': 5, 'manga': 40, 'minded': 11, 'wrestler': 66, 'santo': 22, 'teleseri': 1, 'cadfil': 1, 'dynasti': 17, 'rejoic': 21, 'overdu': 13, 'gosh': 48, 'ivanna': 19, 'headstrong': 21, 'maven': 14, 'understat': 48, '1963': 48, 'jano': 16, 'dalmar': 7, 'quiney': 1, 'outskirt': 10, 'unspecifi': 5, 'feroci': 13, 'rakowski': 1, 'erna': 2, 'sch': 12, 'rer': 3, 'shadier': 2, 'olga': 13, 'cristiana': 1, 'galloni': 1, 'vacil': 6, 'decompos': 15, 'vat': 7, 'blackish': 2, 'hallucinatori': 4, 'bava': 31, 'merino': 3, 'emanuel': 8, 'quicki': 29, 'retromedia': 6, 'ingmar': 17, 'bergmanesqu': 2, 'bonus': 7, 'antagon': 10, 'stat': 5, 'penthous': 12, 'supertank': 2, 'hardbitten': 1, 'devon': 21, 'fluegel': 6, 'deprav': 50, 'peddler': 10, 'dearth': 6, 'souvenir': 8, 'simper': 12, 'trejo': 13, 'bulletproof': 9, 'depend': 252, 'dylan': 68, 'inflect': 18, 'inclin': 55, 'footer': 1, 'discombobul': 2, 'phonet': 3, 'archaic': 15, 'rome': 72, 'anachron': 25, 'juliu': 12, 'chimney': 34, 'machiavelli': 2, 'uncloud': 1, 'waver': 22, 'revert': 25, 'prepon': 6, 'kurtwood': 7, 'rupp': 8, 'topher': 10, 'stacey': 18, 'fumbl': 26, 'heartbreakingli': 7, 'pimpli': 1, 'wafer': 17, 'zippier': 1, 'kathryn': 68, 'grayson': 89, 'susi': 18, 'adept': 28, 'hoof': 9, 'sutton': 7, 'ragland': 3, 'ramirez': 8, 'britton': 13, 'impertub': 1, 'iturbi': 54, 'latch': 19, 'pomeranian': 3, 'mcmanu': 5, 'taster': 1, 'tibet': 22, 'heinrich': 5, 'harrer': 8, 'lhasa': 3, 'thewli': 13, 'dalai': 11, 'lama': 45, 'mao': 6, 'tse': 3, 'mandala': 1, 'buddha': 8, 'tailor': 50, 'aufschnait': 1, 'unimport': 21, 'psychiatri': 5, 'imparti': 13, 'incomprehend': 1, 'puppetri': 12, 'hobbi': 28, 'intervent': 29, 'neecessari': 1, 'japanam': 1, 'lego': 7, 'matador': 22, 'unsophist': 18, 'shephard': 3, 'camino': 2, 'bean': 74, 'dole': 8, 'speedo': 3, 'liaison': 25, 'tattersal': 3, 'vh1': 22, 'interviewe': 13, 'scof': 5, 'thankless': 25, 'reverend': 28, 'hi': 57, 'darkwolf': 25, 'althou': 2, 'prettymuch': 1, 'werewolfworld': 1, 'bloodlin': 3, 'aplu': 1, 'handycam': 3, 'horrortitl': 1, 'lung': 54, 'kiddin': 1, 'powerful': 1, 'celler': 1, 'thunderbolt': 5, 'lightfoot': 3, 'dolph': 86, 'lundgren': 93, 'detent': 23, 'repaint': 2, 'bloodsh': 39, 'axi': 12, 'espionag': 44, 'cisco': 2, 'renaldo': 4, 'parkyarkarku': 1, 'superbox': 1, 'ww2': 49, 'thunderossa': 1, 'exuber': 38, 'hooray': 19, 'mercer': 10, 'silhouet': 5, 'powel': 214, 'befal': 11, 'glamour': 30, 'duplicit': 10, 'allyn': 1, 'joslyn': 6, 'crafti': 17, 'heali': 13, 'feld': 3, 'mona': 25, 'sarcast': 61, 'mabel': 61, 'goofier': 2, 'quartet': 23, 'hampton': 21, 'jazz': 114, 'nevada': 25, 'pubesc': 15, 'illicit': 17, 'simplifi': 22, 'wangl': 4, 'cheezili': 1, 'slooooow': 1, 'vacuou': 31, 'tosh': 8, 'poppa': 7, 'oughta': 4, 'sooooooo': 2, 'terroris': 18, 'insecur': 61, 'dumbdown': 1, 'bazooka': 11, 'seafront': 2, 'lax': 8, 'burgl': 1, 'cod': 12, 'hitchcockian': 17, 'blower': 5, 'forecourt': 1, 'hollodeck': 1, 'dohhh': 1, 'theoret': 24, 'despatch': 1, 'uncoordin': 4, 'rr': 2, 'henstridg': 10, 'trampolin': 4, 'lb': 22, 'tard': 4, 'byw': 1, 'mdogg20': 1, 'prohibit': 23, 'mdogg': 1, 'waaaaay': 5, 'drssing': 1, 'desig': 1, 'zest': 14, 'paoli': 3, 'finch': 32, 'maximum': 46, 'unbalanc': 19, 'equat': 51, 'unfaith': 36, 'silberman': 3, 'gibb': 6, 'slimebal': 2, 'christa': 3, 'saul': 18, 'ruffalo': 7, 'plum': 12, 'phane': 8, 'rideau': 12, 'astonishingli': 36, 'roseaux': 3, 'sauvag': 3, 'junco': 1, 'silvestr': 4, 'chin': 28, 'presqu': 12, 'rien': 14, 'bastien': 2, 'lifshitz': 10, 'cann': 56, 'mathieu': 67, 'mie': 5, 'elka': 3, 'dric': 17, 'estiv': 1, 'fervent': 15, 'brownish': 3, 'luminos': 3, 'simplic': 91, 'surg': 14, 'exhibitionist': 4, 'brilliantin': 2, 'plagiar': 20, 'beavi': 10, 'butthead': 5, 'farewel': 35, 'ignobl': 4, 'criticis': 37, 'unwant': 23, 'accommod': 24, 'douch': 5, 'raiser': 4, 'hurl': 37, 'tempt': 101, 'syfi': 12, 'undecipher': 5, 'resili': 14, 'shard': 9, 'gallow': 12, 'covey': 4, 'waterloo': 10, 'superflu': 39, 'cruelli': 11, 'stepmoth': 42, 'stepsist': 22, '56': 20, 'seuss': 43, '1957': 43, 'obstin': 5, 'commonplac': 22, '123': 3, 'inflat': 26, 'underminedsomewhat': 1, 'betterus': 1, '105': 12, 'who': 18, 'exponenti': 7, 'hyperact': 13, 'oaf': 11, 'cheermeist': 2, 'whovil': 17, 'ninni': 1, 'consumer': 13, 'offensivelyhypocrit': 1, 'merchandisingcampaign': 1, 'redefin': 23, 'spuriou': 5, 'sheseem': 1, 'theirstock': 1, 'decemb': 41, 'handed': 4, '260': 2, 'myer': 103, 'tagalog': 6, 'conform': 30, 'improvis': 87, 'forbid': 33, 'spader': 16, 'mockeri': 37, 'libido': 19, 'denomin': 28, 'tigerland': 32, 'schumach': 33, 'riskiest': 2, 'klavan': 2, 'mcguther': 1, 'lessen': 19, 'uncompromis': 22, 'bozz': 24, 'counteract': 9, 'exasper': 24, 'louisiana': 19, 'supurb': 2, '16mm': 18, 'minuscul': 12, 'unmerci': 1, 'traine': 12, 'guin': 71, 'textil': 23, 'fabric': 81, 'indestruct': 18, 'janitori': 3, 'unanticip': 1, 'dullest': 9, 'projectionist': 7, 'flatmat': 7, 'cursor': 3, 'mortim': 14, 'landlord': 31, 'linchpin': 2, 'yootha': 2, 'scroung': 7, 'thame': 8, 'lard': 6, 'linney': 5, 'coke': 57, 'burgendi': 1, 'seth': 45, 'rogen': 13, 'rabid': 31, 'feminist': 99, 'erni': 46, 'sesam': 26, 'skepticl': 1, 'devist': 1, 'darkest': 32, 'facto': 5, 'inmat': 76, 'uncloth': 2, 'nippl': 31, 'whit': 17, 'sill': 3, 'raoul': 29, 'gentleman': 84, 'fysicali': 1, 'shakili': 2, 'malozzi': 1, 'mulli': 1, 'maddi': 29, 'christensen': 36, 'usag': 35, 'redlin': 11, 'proofread': 1, 'griffin': 28, 'merchant': 27, 'angu': 12, 'macfadyen': 1, 'ouroboro': 2, 'snake': 182, 'ravag': 22, 'hetfield': 1, 'ramp': 17, 'lmn': 8, 'syring': 4, 'mcgraw': 13, 'getaway': 27, 'depp': 20, 'sturgess': 2, 'rispoli': 2, 'underwood': 13, 'diabol': 42, 'adolf': 21, 'carlyl': 28, 'liev': 14, 'schrieber': 6, 'longtim': 33, 'haefengst': 1, 'emit': 16, 'wiesenth': 1, 'vee': 4, 'vin': 6, 'zi': 6, 'var': 3, 'fume': 12, 'cutout': 26, 'geli': 3, 'raubal': 2, 'speer': 6, 'jacobi': 18, 'inaccuraci': 64, 'hulk': 77, 'layout': 13, 'arkham': 2, 'afteral': 9, 'riddler': 11, 'emo': 6, 'croc': 46, 'gotham': 17, 'jewelri': 40, 'sh': 102, 'heartwarm': 68, 'condens': 31, 'scroll': 24, 'arama': 3, 'peru': 19, 'crock': 9, 'doodi': 9, 'huckster': 3, 'smithsonian': 2, 'coptic': 1, 'agey': 3, 'juda': 20, 'gnostic': 4, 'carbon': 25, 'dilig': 12, 'heret': 21, 'celestin': 14, 'propheci': 63, 'optim': 42, 'overpopul': 17, 'piffl': 6, 'evolut': 65, 'darwininan': 1, 'ager': 7, 'wiccan': 3, 'gerald': 29, 'aleist': 2, 'spirogol': 1, 'chalk': 32, 'streetwis': 14, 'spendthrift': 2, 'bucol': 5, 'telltal': 3, 'shae': 5, 'bootleg': 17, 'octob': 49, 'samhain': 18, 'pentagram': 5, 'he': 31, 'liciou': 2, 'downstair': 17, 'haggi': 3, 'chili': 4, 'abomin': 83, 'franki': 94, 'barbra': 58, 'greer': 3, 'fifth': 66, '1944': 59, '1s': 4, 'echanc': 1, 'appalachia': 2, 'shudder': 41, 'sneez': 10, 'egyptolog': 2, 'bernard': 75, 'fresson': 3, 'foxi': 15, 'lagaan': 4, 'pahe': 1, 'doghi': 7, 'criteria': 25, 'singularli': 15, 'sate': 6, 'ewel': 4, 'itch': 23, 'haddock': 3, 'freudian': 28, 'overflow': 11, 'adenin': 1, 'incendiari': 4, 'delux': 8, 'coloris': 1, 'sickeningli': 14, 'hur': 11, 'patronis': 13, 'port': 34, 'maddox': 11, 'authoritarian': 11, 'underwritten': 18, 'saddam': 4, 'petul': 13, 'trucul': 1, 'discipl': 15, 'overthrow': 20, 'shortest': 8, 'inglori': 4, 'basterd': 1, 'hoyt': 10, 'corki': 35, 'ouch': 17, 'sadden': 30, 'intro': 52, 'stagnant': 18, 'tenth': 20, 'slumber': 21, 'subgenr': 12, 'mullet': 26, 'misfit': 55, 'curr': 18, 'tougher': 20, 'taunt': 34, 'carraway': 2, 'starz': 12, 'seenact': 1, '10lame': 1, 'whiter': 4, 'touchi': 14, 'ida': 23, 'lupino': 25, 'walton': 15, 'mala': 15, 'incuri': 1, 'honk': 10, 'rev': 13, 'tod': 8, 'watchdog': 1, 'shahid': 50, 'gr88': 1, 'amrita': 61, 'rao': 26, 'hahk': 11, 'clerk': 81, 'fertil': 21, 'checkout': 12, 'nj': 7, 'tahou': 1, 'ode': 13, 'abject': 10, 'kingdom': 98, 'moovi': 10, 'sprout': 5, 'begat': 5, 'wasteland': 27, 'sorceri': 31, 'runt': 12, 'recaptur': 40, 'mangi': 3, 'rug': 54, 'bimbo': 52, 'pudgi': 7, 'svenson': 10, 'muscleman': 1, 'aluminum': 9, 'shurka': 2, 'mach': 14, 'udder': 3, 'earnestli': 9, 'moolah': 1, 'gullet': 1, 'talkin': 2, 'brie': 2, '8p': 6, 'hector': 35, 'olivera': 2, 'confuddl': 1, 'moocow': 10, 'whirl': 21, 'braveheart': 65, 'moosic': 2, 'mercilessli': 31, 'graft': 8, 'cheapo': 12, 'dixon': 94, 'scalis': 25, 'jigg': 4, 'riddl': 48, 'wtse': 1, 'donnelli': 7, 'martha': 73, 'cityscap': 12, '48': 37, 'credul': 16, 'leapt': 3, 'caucasian': 30, 'antiqu': 39, 'machina': 15, 'hapless': 68, 'exclaim': 22, 'pendant': 7, 'faceless': 21, 'orc': 15, 'serpent': 21, 'arirang': 2, 'akira': 26, 'kurosawa': 84, 'karaok': 9, 'shim': 6, 'sequituur': 1, 'preval': 35, 'koran': 5, 'bypass': 18, 'astronom': 10, 'rukh': 86, 'felix': 121, 'benet': 29, 'kingsford': 3, 'beulah': 7, 'lawton': 9, 'radium': 19, 'contamin': 36, 'devis': 38, 'antidot': 24, 'unfortuneatli': 2, 'kembl': 8, 'maladi': 2, '79': 25, 'ambianc': 43, 'orb': 4, 'ceil': 50, 'dp': 17, 'horni': 61, 'nekron': 8, 'juliana': 5, 'larn': 6, 'minion': 49, 'firekeep': 2, 'jarol': 2, 'sultri': 24, 'teegra': 5, 'frazetta': 18, 'conway': 9, 'gurney': 3, 'dinotopia': 3, 'kinkad': 4, 'figurin': 6, 'bradford': 26, 'rotoscop': 32, 'authorti': 1, '69': 10, 'beliv': 9, 'taekwondo': 6, 'maclain': 22, 'gutsi': 12, 'expel': 17, 'cuban': 65, 'shelter': 61, 'mist': 29, 'proport': 70, 'inexist': 3, '4000': 5, 'hiker': 15, 'snowi': 37, 'valium': 7, 'overdos': 20, 'penner': 1, 'mack': 42, 'eyeshadow': 2, 'unfilm': 15, 'shanti': 12, 'hocu': 5, 'pocu': 5, 'rollin': 14, 'mistakingli': 2, 'knob': 8, 'emiliu': 1, 'headmast': 14, 'bookman': 2, 'swinburn': 1, 'defunct': 10, 'chim': 4, 'chere': 1, 'enchant': 112, 'arkansa': 7, 'fouk': 2, 'vern': 21, 'stierman': 1, 'hirsut': 5, 'bejeeb': 1, 'shreveport': 1, 'mcdonnel': 9, 'shopgirl': 3, 'conformist': 7, 'ratchet': 11, 'siskel': 16, 'craftwork': 1, 'reinforc': 58, 'grammi': 5, 'pergado': 3, 'nun': 85, 'meda': 1, 'perilli': 1, 'bennah': 1, 'plod': 92, 'austin': 82, 'queue': 17, 'nuttiest': 1, 'edi': 111, 'normalci': 16, 'eustach': 31, 'overstyl': 2, 'banal': 95, 'concis': 16, 'ds9': 15, 'pegasu': 6, 'pot': 106, 'griffen': 1, 'fez': 26, 'sixth': 54, 'yugoslavia': 28, 'savala': 24, 'waaaaaay': 1, 'beret': 12, 'trainwreck': 9, 'flog': 9, 'ucm': 2, 'sauc': 10, 'drawl': 16, 'prissi': 17, 'rasberri': 1, 'aswel': 3, 'ninteen': 1, 'decidedli': 58, '0080': 4, 'izuruha': 2, 'berni': 28, 'wiseman': 5, 'requisit': 35, 'oav': 5, 'mecha': 21, 'likeabl': 57, 'philedelphia': 1, 'donor': 17, 'tassl': 2, 'spinal': 70, 'grail': 33, 'dissect': 24, 'apocalypt': 50, 'tuesday': 18, 'kendra': 1, 'dahmer': 55, 'gush': 20, 'magnifi': 12, 'laxman': 2, 'sharpest': 5, 'avidli': 8, 'heartwrench': 4, 'multipli': 21, 'couch': 76, 'withdraw': 21, 'novelti': 57, 'liquefi': 3, 'align': 22, 'tallest': 1, 'greeneri': 2, 'harman': 4, 'rudolf': 13, 'aranoa': 3, 'catagori': 1, 'lune': 2, 'sol': 22, 'glum': 7, 'goya': 3, 'disinterest': 27, 'beggar': 28, 'punter': 3, 'belter': 2, 'afar': 16, 'oven': 9, 'seagal': 165, 'pyrotechn': 13, '1998': 58, 'rig': 35, 'batteri': 21, 'akyroyd': 1, 'bathtub': 31, 'sedat': 18, '10p': 4, 'muni': 40, 'wang': 81, 'luis': 28, 'rainier': 2, 'olan': 8, 'stillm': 1, 'madder': 3, 'slain': 17, 'unnam': 32, 'armour': 16, 'cutaway': 9, 'thigh': 17, 'mwahaha': 1, 'shirt': 162, 'ambl': 13, 'bosannova': 1, 'bewilderedli': 1, 'tranc': 24, 'swagger': 13, 'stupor': 13, 'susannah': 24, 'raucou': 13, 'exud': 45, 'float': 146, 'farcic': 28, 'wherev': 43, 'einstein': 65, 'comprehens': 63, 'cheeki': 20, 'ericka': 1, 'knack': 34, 'hustler': 40, 'cherri': 23, 'sunda': 2, 'tenac': 6, 'afi': 25, 'coorain': 1, 'bodylin': 1, 'playground': 14, 'somersault': 16, 'overheard': 7, 'foyer': 3, 'loo': 14, 'obes': 19, 'mcdowel': 39, 'acadmey': 1, 'farther': 23, 'taiwan': 9, 'knockoff': 20, '2009': 45, 'habitat': 13, 'walru': 14, 'basso': 1, 'profundo': 1, 'solidifi': 13, 'gripe': 41, 'dir': 30, 'alastair': 13, 'fothergil': 4, 'linfield': 5, 'hussey': 12, 'hil': 1, 'adultri': 1, 'ne': 37, 'murray': 81, 'denison': 6, 'deciph': 20, 'dud': 104, 'riead': 3, 'strata': 8, 'hinder': 21, 'jonh': 1, 'asner': 8, 'dispar': 27, 'psp': 1, 'binder': 26, 'intrepid': 10, 'mccallum': 10, 'mcnee': 1, 'colico': 1, 'medallion': 4, 'phoenicia': 1, 'brigadoon': 14, 'stuffi': 21, 'infirm': 2, 'cling': 21, 'elder': 52, 'reawaken': 8, 'unglamor': 8, 'enchrench': 1, 'giddi': 20, 'freed': 40, 'liposuct': 1, 'derrek': 1, 'rooster': 7, 'hen': 5, 'aimless': 29, 'ineffectu': 16, 'conservatori': 9, 'studmuffin': 1, 'frail': 25, 'cactus': 1, 'macissac': 1, 'macleod': 1, 'mitzi': 7, 'kaptur': 4, 'mancuso': 8, 'gwynyth': 2, 'unreward': 4, 'annett': 15, 'scissor': 10, 'jeux': 1, 'enfant': 10, 'ameli': 19, 'darkli': 42, 'stockholm': 9, 'resound': 18, 'meh': 7, 'onyx': 1, 'lurid': 39, 'raindrop': 4, 'futurescap': 1, 'interweav': 13, 'surveil': 19, 'romola': 4, 'garai': 3, 'illona': 2, 'volckman': 18, 'archetyp': 45, 'butch': 60, 'renassainc': 1, 'eel': 14, 'basher': 3, 'sleepov': 7, 'caddyshack': 4, 'stripe': 30, 'dogpil': 1, 'flocker': 6, 'qa': 2, 'accumul': 19, 'forster': 9, 'comeupp': 17, 'seren': 32, 'arbuthnot': 2, 'josi': 25, 'lotti': 4, 'wilkin': 3, 'dester': 2, 'plowright': 14, 'foursom': 11, 'merg': 32, 'preordain': 3, 'molina': 23, 'broadbent': 13, 'newel': 5, 'shellshock': 1, 'desensit': 10, 'devalu': 4, 'catcher': 4, 'ghostli': 43, 'berryman': 10, 'sheppard': 21, 'olen': 17, 'pranc': 29, 'unteth': 2, 'winona': 13, 'kiddo': 2, 'deerfield': 4, 'signifi': 33, 'furnitur': 56, 'scoggin': 7, 'macshan': 1, 'jm': 4, 'telepath': 13, 'smutti': 4, 'brothel': 34, 'poorer': 18, 'annoyingli': 36, 'anorex': 12, 'impot': 28, 'talli': 5, 'liabl': 6, 'horvitz': 3, 'podium': 4, 'swank': 7, 'inflammatori': 1, 'penn': 76, 'innocu': 17, 'leash': 7, 'entiti': 31, 'beyonc': 14, 'jorg': 17, 'drexler': 3, 'bandera': 12, 'congratulatori': 6, 'upheav': 14, 'unrest': 13, 'promiscu': 30, 'encapsul': 15, 'intermingl': 10, 'monarchi': 11, 'duchess': 25, 'truffl': 2, 'rissol': 1, 'victoriain': 1, 'detach': 62, 'uninform': 12, 'avant': 33, 'hayao': 12, 'pazu': 30, 'beek': 14, 'sheeta': 30, 'paquin': 22, 'hamil': 37, 'muska': 11, 'clori': 19, 'leachman': 21, 'dola': 13, 'squawk': 5, 'erotica': 15, 'batwoman': 35, 'devito': 22, 'ogden': 7, 'stier': 8, 'elizondo': 11, 'sneaki': 17, 'oja': 1, 'hytner': 1, 'kenni': 37, 'bania': 1, 'seinfeld': 35, 'plastiqu': 1, 'vcr': 48, 'loathsom': 21, 'magnu': 19, 'pym': 26, 'mould': 16, 'incit': 18, 'baser': 3, 'kriegman': 1, 'chronicl': 88, 'cloverfield': 4, 'vaniti': 69, 'jindabyn': 10, 'commonsens': 2, 'ravin': 7, 'rear': 79, 'exorc': 22, 'splay': 3, 'grandpar': 37, 'surmis': 14, 'township': 5, 'wobbl': 27, 'northfork': 1, 'turbid': 2, 'petit': 35, 'yay': 22, 'manufactur': 58, 'drone': 62, 'starvat': 13, 'chomski': 24, 'yup': 26, 'hagan': 8, 'jaim': 11, 'pressli': 4, 'rust': 11, '66': 17, 'conni': 44, 'towni': 3, 'laziest': 3, 'overground': 1, 'marischka': 4, 'dreimaderlhau': 1, 'madchenjahr': 1, 'einer': 1, 'konigin': 1, 'anton': 68, 'profe': 1, 'mondi': 1, 'empress': 7, 'magda': 7, 'wenn': 1, 'weiss': 7, 'flieder': 1, 'wieder': 1, 'bluhn': 1, 'dover': 3, 'exalt': 4, 'kitschi': 14, 'iliad': 9, 'eastern': 85, 'dietrich': 36, 'boyer': 66, 'outshin': 20, 'liquer': 1, 'chartreus': 2, 'proustian': 1, 'anxious': 14, 'brightest': 22, 'byte': 2, 'berlinal': 3, 'almodovar': 15, 'graceland': 1, 'sacrilegi': 7, 'hulc': 16, 'dominick': 36, 'trashman': 1, 'amadeu': 8, 'pittsburgh': 16, 'daisenso': 3, 'beehiv': 7, 'tokyo': 63, 'firmli': 64, '180': 27, 'hine': 48, 'vancouv': 23, 'mesmeris': 15, 'ardent': 20, 'malamud': 7, 'mistrust': 8, 'mishkin': 1, 'belafont': 14, 'fanni': 30, 'kaminska': 4, 'accordingli': 18, 'kadar': 3, 'ruthi': 4, 'disobey': 14, 'pharmaci': 4, 'wrinkli': 5, 'quinci': 23, 'throttl': 9, 'quantum': 57, 'charlatan': 8, 'ramtha': 18, 'dispenza': 2, 'macro': 2, 'marle': 11, 'matlin': 16, 'bryson': 4, 'pufnstuf': 13, 'loooong': 6, 'flute': 26, 'witchi': 9, 'poo': 36, 'exil': 34, 'ma': 13, 'newbi': 21, 'soder': 1, 'guerilla': 13, 'fulgencio': 3, 'batista': 21, 'revolution': 10, 'bearbado': 1, 'stricken': 39, 'enchelada': 1, 'cabana': 2, 'fortress': 18, 'objectivist': 2, 'demian': 4, 'bichir': 7, 'sodebergh': 1, 'deleg': 6, 'posthum': 7, '1946': 44, 'ambient': 18, 'precursor': 23, 'chinatown': 24, 'clutter': 60, 'brogu': 6, 'fring': 24, 'feverish': 5, 'coin': 33, 'erik': 31, 'lonnrot': 4, 'scrawl': 4, 'eyewit': 10, 'zunz': 1, 'eccleston': 23, 'kabbalah': 1, 'perp': 6, 'triangular': 6, 'map': 90, 'flabbergast': 11, 'commission': 16, 'treviranu': 1, 'miguel': 14, 'sandov': 3, 'handcuff': 6, 'garzon': 1, 'hoola': 1, 'hoop': 18, 'rioter': 3, 'alphavil': 3, 'decrepit': 21, 'derang': 83, 'deflat': 8, 'uncanni': 50, 'masturbatori': 3, 'outtak': 26, 'diablo': 12, 'suxz': 1, 'azar': 2, 'trueba': 4, 'consol': 32, 'untold': 16, 'conservat': 7, 'vosloo': 9, 'looki': 1, 'viewabl': 8, 'glitch': 22, 'roughneck': 4, 'squad': 80, 'incurs': 3, 'natassia': 8, 'woeful': 29, 'trickl': 4, 'shainin': 1, 'harrelson': 16, 'afterthought': 28, 'underus': 33, 'debt': 81, 'colombo': 7, '911': 27, 'yea': 31, 'quiroz': 14, 'upe': 1, 'grill': 13, 'conjunct': 11, 'seedpeopl': 2, 'triffid': 2, 'dolt': 7, 'dandylion': 1, 'muppet': 145, 'tumblewe': 2, 'inkl': 15, 'daylight': 59, 'uv': 3, 'cow': 70, 'photosynthesi': 1, 'spaceship': 55, 'raze': 2, 'cobbler': 5, 'disus': 8, 'aldwych': 2, 'jubile': 1, 'chare': 3, 'gollum': 10, 'nutter': 4, 'polent': 1, 'ripoff': 55, 'quigley': 18, 'lackey': 10, 'unmark': 4, 'scold': 15, 'forg': 28, 'macintosh': 9, 'limo': 11, 'kart': 6, 'playng': 1, 'vr': 7, 'geyser': 5, 'swat': 27, 'tortilla': 2, 'pope': 31, 'wart': 18, 'abbot': 29, 'kell': 49, 'brendon': 5, 'ire': 5, 'aidan': 13, 'chagrin': 21, 'brendan': 73, 'homogen': 7, 'genndi': 1, 'tartakovski': 1, 'samurai': 131, 'celtic': 16, 'tomm': 2, 'havilland': 6, 'childbirth': 8, 'simplemind': 3, 'deftli': 26, 'disinherit': 2, 'disobedi': 5, 'suitor': 28, 'faucet': 6, 'buscemi': 28, 'dug': 28, 'peat': 2, 'gratitud': 22, 'tremor': 37, 'sawblad': 1, 'cripplingli': 1, 'engross': 93, 'kiera': 15, 'netflix': 60, 'lanquag': 1, 'schoolchildren': 6, 'eclips': 25, 'parter': 18, 'naylor': 2, 'grinchma': 1, 'sculptor': 14, 'goldsworthi': 65, 'icicl': 6, 'moistur': 1, 'serpentin': 7, 'transienc': 2, 'sculptur': 24, 'transitori': 4, 'ebb': 7, 'awestruck': 9, 'nourish': 5, 'battr': 2, 'coeur': 3, 'arret': 2, 'gill': 12, 'moustach': 26, 'encas': 7, 'gronski': 1, 'portli': 8, 'raquel': 19, 'welch': 37, 'flex': 9, 'blob': 124, 'aneta': 10, 'corsaut': 13, 'idyl': 28, 'suburbia': 25, 'joiner': 1, 'urich': 12, 'lucci': 13, 'chairperson': 1, 'valet': 10, 'lago': 10, 'tomich': 4, 'ballestra': 1, 'nuisanc': 13, 'sher': 1, 'uli': 6, 'lommel': 36, 'suzanna': 6, 'brainwav': 2, 'lacklustr': 16, 'blarney': 4, 'oirish': 4, 'snowmonton': 1, 'cooler': 27, 'fang': 17, 'kiel': 5, 'razer': 1, 'glove': 58, 'oat': 17, 'antifreez': 4, 'cartooni': 15, 'pu': 11, 'supspens': 1, 'derboil': 1, 'scorpiolina': 1, 'gover': 20, 'waltz': 22, 'algi': 7, 'pansi': 6, 'homophob': 26, 'liosa': 1, 'weld': 8, 'sync': 47, 'osd': 2, 'megazon': 8, 'robotech': 11, 'compon': 47, 'picki': 23, 'bubblegum': 10, 'scour': 7, 'macek': 8, 'pint': 10, 'credibilityy': 1, 'trodden': 8, 'leviti': 10, 'cowrit': 1, 'darstardi': 1, 'deceivingli': 2, 'goodal': 2, 'linn': 5, 'fairbrass': 2, 'chevi': 39, 'poker': 63, 'sebastian': 51, 'nr': 8, 'otro': 3, 'montreal': 10, 'dosen': 7, 'faggot': 4, 'malais': 9, 'unconform': 1, 'enunci': 13, 'overjoy': 7, 'terrifyingli': 13, 'ordeal': 56, 'foch': 33, 'cower': 13, 'ici': 39, 'patrician': 3, 'impecuni': 3, 'macreadi': 16, 'lowlif': 9, 'bot': 24, 'elain': 13, 'spongeworthi': 1, 'calmer': 4, 'nascar': 13, 'ameteurish': 1, 'mehmet': 3, 'erbil': 1, 'yilmaz': 1, 'goksal': 2, 'gani': 1, 'mujd': 1, 'cem': 1, 'karaca': 1, 'sumer': 1, 'tilmac': 1, 'gunshot': 40, 'hover': 14, 'melvil': 18, 'delon': 25, 'jarmusch': 14, 'desperado': 9, 'majorli': 6, '2fast': 1, '2furiou': 1, 'tobe': 36, 'hooper': 57, 'gnarli': 6, 'processor': 6, 'cordial': 8, 'disarmingli': 2, 'hedonist': 7, 'occident': 4, 'exert': 15, 'discreet': 9, 'vindhyan': 1, 'sarcophagu': 3, 'barbar': 24, 'rcc': 1, 'libidin': 4, 'prototyp': 41, 'obliqu': 7, 'pomp': 9, 'overconfid': 6, 'merl': 15, 'oberon': 22, 'bombard': 20, 'jerico': 2, 'petitiononlin': 5, 'gh1215': 5, 'thai': 29, 'telescop': 18, 'carpathian': 6, 'astro': 9, 'chemist': 11, 'radioact': 32, 'compound': 50, 'breck': 1, 'paranoid': 50, 'sombr': 16, 'puberti': 19, 'headley': 3, 'molass': 10, 'haphazardli': 12, 'laggard': 1, 'pamphlet': 6, 'hoodwink': 5, 'caper': 50, 'newlyw': 8, 'twisti': 21, 'mulcahi': 4, 'csi': 23, 'tenebr': 2, 'legibl': 1, 'pare': 13, 'postal': 17, 'seeley': 6, 'cohan': 3, 'brice': 6, 'hutton': 27, 'meeker': 17, 'sulli': 9, 'offstag': 4, 'ate': 33, 'vitaphon': 3, 'spat': 14, 'seeli': 1, 'pep': 3, 'vaud': 1, 'crowbar': 2, 'hippiest': 1, 'unprejud': 1, 'stuntwork': 3, 'quotient': 15, 'bolster': 9, 'mandi': 49, 'hitgirl': 1, 'interim': 5, 'ombudsman': 1, 'elector': 4, 'plotter': 3, 'bolivarian': 3, 'venezuelan': 24, 'democraci': 34, 'nip': 10, 'schoolish': 1, 'doomsday': 14, 'eotw': 1, 'slapdash': 10, 'amusingli': 31, 'deco': 16, '1968': 93, 'midseason': 1, 'sooki': 20, '1300': 3, 'bailout': 2, 'maudett': 1, 'lafayett': 3, 'firestart': 7, 'sematari': 36, 'camouflag': 13, 'keusch': 6, 'mandu': 1, 'therebi': 46, 'th': 28, 'toif': 1, 'shrunk': 14, 'moviemi': 1, '10rate': 5, 'trawl': 2, 'punt': 2, 'savour': 11, 'helo': 1, 'leetl': 1, 'northam': 51, 'cambridg': 7, 'liu': 64, 'flamenco': 32, 'saura': 27, 'iberia': 14, 'plank': 14, 'livelihood': 6, 'gaudi': 13, '987': 1, 'kidd': 10, 'glare': 66, 'lafanu': 2, 'woodland': 19, 'figment': 12, 'tempo': 23, 'strung': 46, 'selfishli': 4, 'apparit': 14, 'campground': 2, 'plymouth': 2, 'blueberri': 1, 'eighteen': 22, 'kimberley': 1, 'overwind': 1, 'preconceiv': 10, 'reopen': 11, 'budgetari': 15, 'crucifix': 16, 'vigor': 23, 'workmanlik': 11, 'everett': 42, 'lister': 7, 'boundari': 52, 'kilpatrick': 8, 'cresu': 2, 'bread': 76, 'yablan': 1, 'incarcer': 17, 'artemisia': 47, 'gentileschi': 11, 'retel': 44, 'valentina': 6, 'cervi': 6, 'arous': 54, 'freakout': 3, 'burg': 3, 'cuss': 20, 'reconnect': 9, 'stint': 20, 'detox': 1, 'glumli': 1, 'lugubri': 5, 'reek': 51, 'puni': 6, 'diffus': 7, 'transpos': 10, 'quatermass': 6, '666': 19, 'decreas': 10, 'relianc': 20, 'shaun': 39, 'zachari': 2, 'flane': 1, 'vonnegut': 51, 'sheryl': 16, 'resi': 1, 'crescendo': 13, 'arkin': 54, 'noos': 11, 'bing': 52, 'fav': 11, 'lachlin': 1, 'tyrannu': 9, 'summon': 33, 'willian': 4, 'rollerbal': 2, 'backlight': 3, 'whoppi': 4, 'fasten': 4, 'soaper': 6, 'trish': 25, 'megalomaniac': 13, 'statist': 26, 'zsa': 3, 'gabor': 4, 'holocol': 1, 'mortuari': 3, 'insensit': 23, 'sniffl': 2, 'clausen': 16, 'sonja': 14, 'angelina': 48, 'joli': 55, 'monica': 45, 'gayl': 7, 'graver': 3, 'uschi': 3, 'digart': 2, 'garver': 1, 'petti': 85, 'laputa': 53, 'claudett': 9, 'disprov': 10, 'mawkish': 17, 'cassavet': 71, 'catastroph': 53, 'histrion': 38, 'beverag': 10, 'hideout': 13, 'rippl': 8, 'glut': 6, 'nyu': 3, 'dropout': 4, 'clampett': 15, 'porki': 28, 'shopp': 1, 'scraggli': 7, 'chia': 3, 'liang': 18, 'sammo': 54, 'tightli': 48, 'banquet': 12, 'hui': 4, 'ying': 7, 'hsiao': 18, 'hou': 23, 'wirework': 7, 'apologist': 9, 'bestsel': 8, 'flier': 8, 'worldwid': 35, 'rub': 76, 'cleverest': 6, 'anticipatori': 1, 'incongru': 31, 'lacross': 3, 'linoleum': 3, 'piston': 2, 'stiletto': 1, 'pursuer': 17, 'trachea': 1, 'parachut': 11, 'forum': 42, 'worldfest': 2, 'reptilian': 12, 'gillman': 1, 'kat': 21, 'bunker': 27, 'unlock': 28, 'belushi': 87, 'gaffari': 2, 'holler': 9, 'hansel': 4, 'gretel': 3, 'assuredli': 6, 'eurohorror': 3, 'woulda': 12, 'pyrene': 2, 'occurr': 45, 'verdant': 1, 'org': 17, 'amc': 14, 'awol': 5, 'mississip': 2, 'decibel': 1, 'bumpkin': 9, 'goofbal': 10, 'obscen': 58, 'walston': 18, 'tamest': 2, '1938': 37, 'laurenc': 75, 'priggish': 3, 'technicolour': 8, 'silki': 1, 'dor': 10, 'pension': 17, 'regain': 51, 'ardour': 3, 'hoodi': 3, 'scuttl': 9, 'arthrit': 4, 'voluptu': 18, 'beguil': 12, 'resign': 31, 'lanchest': 17, 'gingold': 15, 'kovac': 19, 'proscrib': 2, 'beatnik': 8, 'fripperi': 1, 'spectrum': 33, 'raison': 7, 'etr': 7, 'belatedli': 7, 'thrash': 24, 'jenson': 2, 'henson': 21, 'hels': 21, 'winslow': 4, 'howe': 10, 'palooka': 1, 'noirish': 17, 'suuck': 1, 'irksom': 8, 'epilepsi': 4, 'roast': 28, 'prettier': 15, 'unconvent': 48, 'reflex': 21, 'saliv': 5, 'rung': 11, 'modu': 5, 'operandi': 5, 'inattent': 4, 'slit': 27, 'selleck': 12, 'unhealthi': 17, 'fanatic': 9, 'sox': 71, 'barki': 2, 'fend': 31, 'ood': 4, 'zed': 3, 'mower': 20, 'alvin': 70, 'bundl': 13, 'iowa': 31, 'refreshingli': 23, 'lyle': 27, 'cereal': 9, 'mildew': 1, 'nappi': 6, 'saxophon': 13, 'signatur': 44, 'jinn': 1, 'korda': 36, 'bluntli': 17, 'embarrassingli': 52, 'ericco': 1, 'itv': 7, 'pm': 21, 'zavaleta': 1, 'serrano': 8, 'spyl': 1, 'gateway': 12, 'leaki': 6, 'upstair': 47, 'abli': 27, 'delirium': 8, 'leotard': 5, 'montagu': 13, 'shorn': 5, 'expressway': 1, 'wither': 11, 'strangelov': 25, 'torranc': 21, 'hallorann': 6, '237': 6, 'bartend': 43, 'redrum': 6, 'keitel': 37, 'parishion': 3, 'brickman': 3, 'mcintosh': 3, 'rosetta': 12, 'lenoir': 6, 'odessa': 3, 'toon': 18, 'greedi': 91, 'piraci': 3, 'snoopi': 2, 'peanut': 25, 'zapar': 1, 'fudd': 10, 'polka': 3, 'plaid': 3, 'munch': 22, 'backsid': 14, 'minutia': 7, 'knive': 36, 'ciera': 2, 'payton': 7, 'catfight': 2, 'fondl': 19, 'rawandan': 2, 'furl': 2, 'rawanda': 3, 'comer': 28, 'imman': 1, 'schmaltz': 11, 'jacknif': 17, 'klembeck': 1, 'deputi': 61, 'depot': 4, 'spa': 9, 'demolish': 19, 'mingl': 8, 'sacrifici': 11, 'selfless': 15, 'darlen': 23, 'hysteric': 1, 'conanesqu': 1, 'excalibur': 5, 'shoah': 1, 'gojira': 5, 'brigad': 20, 'annex': 5, 'mainland': 19, 'tycoon': 27, 'bald': 51, 'saucer': 17, 'nippon': 2, 'nucyal': 1, 'ductwork': 1, 'imperialist': 13, '22d': 1, 'chintz': 1, 'nonfunct': 1, 'ghidorah': 7, 'toho': 6, 'fukuoka': 1, 'heretofor': 7, 'metalflak': 1, 'hydra': 2, 'microwav': 12, 'nuclear': 129, 'shipwreck': 8, 'revamp': 13, '23d': 1, 'ghidora': 2, 'joystick': 2, 'sumo': 3, 'flabbi': 8, 'masonri': 1, 'megumi': 1, 'odaka': 1, 'micki': 10, 'clinic': 66, 'revuls': 6, 'esqu': 29, 'meld': 25, 'whoope': 5, 'newbern': 10, 'juliet': 60, 'landua': 1, 'roundtre': 3, 'bluster': 11, 'incredul': 20, 'disillusion': 14, 'trepid': 15, 'ferrara': 5, 'uncommonli': 8, 'bemus': 23, 'huppert': 20, 'berkley': 17, 'barbi': 24, 'ele': 1, 'keat': 5, 'whalin': 1, 'demagog': 1, 'turgid': 32, 'slop': 15, 'republican': 45, 'meander': 92, 'intang': 6, 'indisput': 7, 'brazen': 11, 'slant': 26, 'consumerist': 4, 'acr': 23, 'eros': 2, 'methan': 2, 'predic': 8, 'prestig': 13, 'humanist': 21, 'eschew': 18, 'clap': 23, 'graph': 3, 'chart': 37, 'bandag': 13, 'tempera': 13, 'dullard': 8, 'gw': 3, 'rumin': 8, 'ussr': 16, 'dariu': 36, 'duchenn': 5, 'dystrophi': 7, 'aweigh': 35, 'doolittl': 25, 'torrid': 10, 'jalousi': 2, 'robust': 20, '36th': 7, 'shaolin': 34, 'peski': 16, 'manchurian': 14, 'bungl': 12, 'bamboo': 16, 'scaffold': 10, 'kar': 14, 'clamp': 5, 'gumbi': 6, 'dune': 23, 'typo': 5, 'napton': 4, 'sheet': 81, 'clump': 3, 'summat': 13, 'bananaman': 1, 'smurf': 12, 'snork': 1, 'moomin': 1, 'raccoon': 15, 'duckula': 1, 'busido': 1, 'alyc': 3, 'inexperi': 14, 'unment': 4, 'herm': 3, 'misunderstand': 60, 'interlud': 40, 'gershwin': 57, 'gardin': 15, 'collier': 6, 'lightheart': 40, 'footwork': 4, 'prefac': 14, 'reproach': 7, 'desenst': 1, 'soapbox': 5, 'skinni': 55, 'nc': 27, 'newpap': 1, 'titallit': 1, 'duel': 75, 'benkei': 16, 'yoshitsun': 5, 'gojo': 22, 'revis': 22, 'mappo': 1, 'heian': 1, 'mt': 8, 'fuji': 3, 'taira': 1, 'heik': 1, 'minamoto': 1, 'genji': 3, 'anarchi': 11, 'tenku': 2, 'goblin': 11, 'karuma': 1, 'clan': 75, 'buddhism': 10, 'shingon': 1, 'ki': 21, 'shanao': 6, 'tetsukichi': 1, 'scaveng': 12, 'diego': 48, 'maradona': 21, 'unbias': 14, 'holt': 44, 'mutia': 1, 'escarp': 4, 'womanis': 9, 'arlington': 14, 'bearer': 17, 'narrowli': 14, 'musclebound': 4, 'yodel': 4, 'cheetah': 11, 'weismul': 13, 'eensi': 1, 'weensi': 1, 'loin': 13, 'flap': 26, 'pygmi': 11, 'rhino': 15, 'ostrich': 4, 'trapez': 5, 'buford': 10, 'pusser': 16, 'jaekel': 1, 'doqui': 1, 'cheapjack': 3, 'thouroughli': 3, 'pryor': 28, 'gleason': 24, 'mania': 13, 'nighter': 1, 'wanton': 6, 'anarch': 8, 'lukewarm': 15, 'bettina': 7, 'hirsch': 16, 'munchi': 46, 'waterman': 23, 'korman': 13, 'stratton': 26, 'archaeolog': 20, 'stonework': 2, 'machu': 3, 'picchu': 3, 'nadin': 5, 'veld': 3, 'unsupervis': 3, 'dual': 24, 'pauciti': 4, 'imbu': 23, 'stepson': 6, 'stafford': 5, 'inconsider': 6, 'burnett': 17, 'wonki': 4, 'furbal': 3, 'gist': 16, 'sequitur': 9, 'klown': 8, 'temp': 19, 'clockwatch': 2, 'monologu': 93, 'isco': 1, 'disclaim': 23, 'harbing': 5, 'shelbi': 14, 'marlina': 1, 'shumak': 2, 'perm': 7, 'seventeen': 17, 'bellucci': 3, 'insincer': 8, 'grievou': 4, 'deprec': 13, 'faustino': 1, 'resnick': 1, 'mindi': 19, 'thorstenson': 1, 'lomena': 1, 'davonn': 1, 'bellan': 1, 'shearer': 27, 'stephenson': 4, 'churchil': 18, 'kerkhof': 2, 'kruishoop': 2, 'guernsey': 7, 'leopold': 34, 'acd': 2, 'mcinneri': 1, 'bloodbath': 47, 'cashmer': 1, 'sweater': 17, 'trenchcoat': 5, 'funki': 40, 'nilli': 5, 'cruncher': 1, 'amicu': 22, 'a2nd': 1, 'b3rd': 1, 'chloe': 45, 'dthe': 1, 'dunham': 4, 'foolishli': 25, 'polaris': 1, 'glasnost': 3, 'excis': 10, 'adel': 54, 'corp': 19, '32': 22, '1820': 3, 'naturedli': 1, 'stripper': 56, 'pol': 17, 'bakula': 17, 'brash': 33, 'shrift': 4, 'oooo': 5, 'bogi': 11, 'dien': 23, 'cocki': 37, 'finer': 16, 'ironsid': 32, 'bogrol': 1, 'gummo': 6, 'idia': 1, 'parinda': 4, 'elas': 1, 'skim': 20, 'soar': 30, 'bisleri': 1, 'hahah': 1, 'hitman': 10, 'waysid': 8, 'rin': 4, 'pertfectli': 1, 'barrymor': 88, 'soliloquy': 12, 'undercov': 39, 'croni': 21, 'uninvolv': 23, 'nonent': 2, 'rythm': 1, 'pshycolog': 1, 'particulari': 2, 'rainer': 35, 'rohtenburg': 1, 'guardsmen': 2, 'cobra': 26, 'winston': 41, 'mccurdi': 2, 'skulk': 4, 'leatherfac': 11, 'perro': 7, 'laughtrack': 2, 'punctuat': 37, 'noxiou': 2, 'narcot': 13, 'nauseatingli': 10, 'dunaway': 28, 'attain': 40, 'hundredth': 2, 'surgeon': 45, 'drat': 2, 'scarey': 1, 'teletubbi': 6, 'victori': 98, 'simpatico': 1, 'intermiss': 9, 'guerrilla': 36, 'campesino': 3, 'fledg': 17, 'cine': 7, 'spearhead': 9, 'bickford': 4, 'unmitig': 9, 'downer': 22, 'godless': 5, 'celebratori': 8, 'interv': 32, 'miniseri': 63, 'motorcycl': 62, '26th': 3, 'slog': 13, 'tyranni': 17, 'terrenc': 8, 'malick': 8, 'gestat': 1, 'bedknob': 17, 'jelli': 13, 'extinguish': 17, 'plata': 2, 'waaaay': 3, 'hipster': 7, 'hanna': 31, 'schygula': 2, 'hermann': 24, 'sirk': 93, 'postwar': 19, 'lisa': 186, 'lezli': 4, 'malta': 29, 'harridan': 1, 'backstori': 26, 'invari': 29, 'intermitt': 17, 'barcelona': 12, 'nsa': 5, 'diarrhoea': 1, 'insuffer': 33, 'cavali': 10, 'pon': 8, 'crass': 36, 'caricia': 1, 'maltreat': 2, 'idiota': 2, 'subnorm': 1, 'masochist': 45, 'cayetana': 1, 'guillen': 1, 'cuervo': 1, 'barrag': 21, 'pittanc': 1, 'maltin': 24, 'callou': 21, 'lurch': 24, 'shifti': 15, 'letharg': 23, 'complac': 11, 'scoundrel': 12, 'damsel': 45, 'breech': 7, 'codger': 7, 'stormhold': 6, 'betroth': 10, 'tristain': 4, 'espi': 1, 'primu': 3, 'secondu': 1, 'sextmu': 1, 'septimu': 3, 'voila': 3, 'clare': 15, 'lamia': 5, 'flemyng': 3, 'buston': 1, 'blith': 23, 'maher': 25, 'extremist': 17, 'evangel': 20, 'grabber': 7, 'yosemit': 2, 'daffi': 11, 'suav': 44, 'pecan': 1, 'sprinkler': 4, 'donat': 49, 'bewilderingli': 4, 'rachael': 13, 'languish': 12, 'refract': 4, 'hairdress': 14, 'shimmer': 8, 'prank': 77, 'alt': 11, 'ucla': 5, 'soror': 12, 'uncool': 7, 'bah': 10, 'humbug': 5, 'ap3': 3, 'damian': 13, 'anya': 3, 'omg': 23, 'caseman': 2, 'unflinch': 15, 'analys': 17, 'irreplac': 5, 'nadir': 20, 'circulatori': 2, 'baxter': 30, 'hemo': 10, 'glitzi': 11, 'lauter': 1, 'pompeo': 8, 'slowest': 7, 'scotti': 15, 'freakiest': 4, 'hissi': 5, 'slob': 32, 'bachlor': 1, 'comcast': 2, 'moviepass': 1, 'ongo': 38, 'excerpt': 25, 'deluca': 1, 'soylent': 61, 'curtail': 7, 'kibosh': 3, 'procreat': 3, 'bacteria': 4, 'petri': 2, 'malthusian': 1, 'subsist': 3, 'diver': 45, 'brashear': 47, 'musicianship': 1, 'tarentino': 6, 'bandai': 2, 'shin': 51, 'senki': 1, 'heero': 18, 'yuy': 3, 'hildreth': 1, 'deathscyth': 2, 'mcneil': 2, 'nasal': 13, 'trowa': 3, 'heavyarm': 1, 'kirbi': 9, 'somber': 34, 'quatr': 3, 'rebarba': 1, 'swail': 1, 'brine': 3, 'bona': 16, 'fide': 18, 'wufei': 2, 'relena': 5, 'darlian': 1, 'bailey': 28, 'zech': 10, 'merquis': 3, 'authorit': 12, 'drummond': 16, 'deviou': 29, 'staunch': 11, 'treiz': 6, 'kushrenada': 3, 'une': 10, 'contrastingli': 2, 'lucrencia': 1, 'noin': 3, 'maganac': 1, 'romerfel': 1, 'nt': 37, 'idri': 4, 'elba': 3, 'curl': 27, 'creaki': 14, 'pia': 44, 'zadora': 17, 'annen': 1, 'truncat': 13, 'backord': 1, '1840': 11, 'infinitum': 6, 'vibrat': 19, 'misjudg': 11, 'ardor': 2, 'misstep': 20, 'succinctli': 12, 'yike': 30, 'mccabe': 17, 'northwest': 27, 'soggi': 8, 'replet': 19, 'sorriest': 2, 'unearn': 1, 'alpha': 30, 'credenti': 23, 'wrangl': 8, 'contrapt': 11, 'oili': 8, 'purportedli': 10, 'barnyard': 7, 'vilmo': 4, 'zsigmond': 4, 'dishwat': 7, 'copiou': 23, 'windex': 2, 'missouri': 28, 'fdni': 4, 'nypd': 15, 'pragu': 20, 'autorenfilm': 1, 'cin': 12, 'musset': 1, 'doppelg': 1, 'nger': 1, 'wegen': 15, 'seeber': 3, '1913': 9, 'atlanti': 111, 'blom': 4, '1926': 10, 'lyduschka': 2, 'troublemak': 6, 'conceptu': 19, 'golem': 14, 'inaugur': 8, '41': 10, 'schindler': 28, 'benigni': 1, 'burrow': 31, '96': 21, 'wispi': 5, 'mister': 43, 'sumptuou': 22, 'cordel': 9, 'manica': 1, 'miscreant': 4, 'wrack': 12, 'oslo': 4, 'norwegian': 36, 'introductori': 13, 'indecis': 17, 'pleaser': 13, 'moodysson': 1, 'tillsamman': 1, 'aj': 9, 'romeo': 57, 'ittenbach': 7, 'premuto': 4, 'braindead': 15, 'data': 41, 'multitask': 2, 'upcom': 49, 'boldli': 16, 'dogfight': 8, 'granni': 20, 'appleg': 25, 'toboggan': 1, 'slope': 14, 'riiiight': 1, 'idiosyncrasi': 13, 'ungar': 21, 'madison': 46, 'carefre': 25, 'diametr': 5, 'disinfect': 2, 'meatloaf': 7, 'cabbag': 8, 'coleslaw': 4, 'unimpress': 45, 'hypochondriac': 11, 'sinus': 3, 'hellish': 12, 'puertorican': 9, 'nuyorican': 12, 'rico': 35, 'guinea': 53, 'kmart': 2, 'jcpenney': 1, 'ritz': 2, 'agricultur': 8, 'expresso': 1, 'retribut': 19, 'sledgehamm': 17, '2005': 140, 'bluescreen': 4, 'transceiv': 2, 'can': 46, 'deadset': 1, 'leach': 3, 'chekhov': 2, 'kalashnikov': 1, 'layman': 9, 'devolut': 1, 'humankind': 8, 'prep': 14, 'carlito': 74, 'slevin': 2, 'brigant': 8, 'nicki': 34, 'diddi': 5, 'leticia': 2, 'carito': 1, 'cst': 1, 'instantan': 4, 'tucci': 23, 'mightili': 13, 'humanli': 10, 'motherli': 9, 'shrew': 13, 'sleezebag': 1, 'howi': 5, 'coron': 32, 'misidentif': 1, 'carr': 56, 'schaffer': 8, 'oasi': 11, 'chrstian': 1, 'recess': 18, 'yeon': 12, 'jeon': 17, 'dunnit': 8, 'valv': 3, 'offhand': 10, 'augustu': 6, 'milverton': 25, 'lestrad': 4, 'bohem': 5, 'enamor': 15, 'botcher': 1, 'hardwick': 23, 'corneliu': 3, 'fudg': 14, '10th': 16, 'nickola': 2, 'serena': 4, '221': 1, 'alyn': 5, 'silsbi': 2, '430': 1, 'puzzlingli': 1, 'deepest': 43, 'foreman': 12, 'hurriedli': 10, 'metropoli': 37, 'behest': 7, 'jumpsuit': 4, 'bushi': 9, 'drillshaft': 1, 'mooch': 2, 'hospitalis': 4, 'chappi': 4, 'aargh': 4, 'phylli': 32, 'dy': 13, 'schoolteach': 8, 'wag': 7, 'remonstr': 1, 'testifi': 24, 'bangkok': 15, 'aardman': 12, 'blanket': 21, 'apatow': 10, 'undeclar': 3, 'raunch': 3, 'videogam': 8, 'malco': 9, 'fratboy': 2, 'mama': 61, 'grandmama': 2, 'loren': 51, 'espec': 1, 'poodl': 15, 'downsid': 39, 'electra': 13, 'furlong': 18, 'snot': 13, 'jordana': 6, 'spiro': 1, 'bice': 1, 'moncia': 2, 'ssooooo': 1, 'melo': 2, 'grimm': 15, 'contro': 2, 'versi': 1, 'ejacul': 10, 'identif': 16, 'whatsernam': 1, 'hairless': 4, 'spif': 1, '849': 1, 'fetishist': 14, 'kotm': 1, 'klotlma': 1, 'futil': 43, 'passer': 9, 'rateyourmus': 4, 'fedor8': 4, 'nepot': 15, 'luther': 18, 'luckett': 3, 'lagrang': 2, 'rogerson': 1, 'troup': 26, 'serendipit': 8, 'tempest': 27, 'grappl': 22, 'momma': 12, 'moll': 21, 'filmd': 1, 'mismatch': 37, 'colleen': 18, 'stratten': 25, 'hansen': 16, 'valentin': 85, 'lengthen': 8, 'bedfellow': 3, 'thunderstruck': 1, 'walli': 29, 'horseplay': 1, 'crackerjack': 5, 'mesh': 25, 'rarer': 10, 'deckchair': 1, 'placid': 16, 'teesh': 1, 'trude': 1, 'upstream': 3, 'lantana': 6, 'titter': 6, 'disillus': 28, 'rectifi': 14, 'swindl': 4, 'unreason': 21, 'pli': 12, 'michigan': 15, 'kallio': 9, 'appropori': 1, 'dolli': 23, '350': 7, 'duchonvey': 1, 'munda': 13, 'skimpi': 31, 'solino': 6, 'convert': 75, 'flatop': 1, 'prunefac': 3, 'gleann': 2, 'hedley': 4, 'tracey': 29, 'truehart': 2, 'korsmo': 7, 'forysth': 1, 'patinkin': 10, 'madona': 1, 'hollyoak': 1, 'kimmel': 6, 'infami': 7, 'bratti': 20, 'desu': 2, 'ronin': 10, 'dweller': 15, 'stepfath': 27, 'dodeskaden': 2, 'caminho': 1, 'vida': 13, 'trent': 31, 'onj': 1, 'crispin': 31, 'trout': 10, 'ritualist': 9, 'attun': 9, 'blackfoot': 2, 'pam': 40, 'coffi': 21, 'footnot': 11, 'dramaticis': 1, 'arthurian': 3, 'beowulf': 61, 'shroud': 21, 'guesswork': 1, 'derid': 8, 'minot': 6, 'rhode': 24, '2036': 9, 'outsmart': 19, 'harald': 3, 'eia': 1, 'scheie': 1, 'standstil': 3, 'granpa': 1, 'limelight': 15, 'overburden': 4, 'glitz': 18, 'handi': 39, 'mellow': 14, 'hunk': 39, 'twister': 34, 'salliwan': 2, 'yeoman': 6, 'barrow': 6, 'moth': 11, 'plywood': 4, 'cafeteria': 16, 'panel': 26, 'paig': 14, 'turrco': 1, 'caleb': 18, 'every1': 1, 'obey': 24, 'bam': 24, 'comprehend': 66, 'sleepless': 16, 'dishonour': 1, 'gesticul': 6, 'knicker': 10, 'garter': 2, 'whichev': 21, 'interfac': 10, 'disco': 48, 'bishop': 41, 'r2': 14, 'applianc': 15, 'screentim': 3, 'montros': 21, 'majai': 1, 'delus': 37, 'geologist': 7, 'hadley': 58, 'lauren': 63, 'bacal': 90, 'confer': 29, 'pretext': 19, 'jasper': 7, 'acapulco': 4, 'maryle': 22, 'palavra': 1, 'ao': 5, 'vento': 1, '97': 26, 'fanboy': 19, 'dicaprio': 26, 'compress': 18, 'ws': 1, 'artefact': 5, 'carnbi': 8, 'anthropologist': 17, 'asshol': 13, 'tenni': 19, 'cranbi': 1, 'powder': 26, 'muzzl': 7, 'samu': 3, 'aran': 1, 'vercetti': 1, 'squadron': 11, 'wienberg': 1, 'steadili': 21, 'conciev': 3, 'pinki': 10, 'sniper': 79, 'llosa': 3, 'zion': 10, 'triniti': 27, 'nearer': 10, 'wachowski': 10, 'net': 75, 'staircas': 32, 'cheri': 21, 'rebuild': 18, 'ps2': 9, 'wesker': 1, 'dench': 31, 'manikin': 2, 'cleo': 13, 'congratul': 63, 'spoilersalison': 1, 'halloran': 10, 'chazen': 4, 'jezebel': 7, 'constel': 10, 'sentinela': 1, 'maldito': 1, 'ob': 1, '02': 16, 'grendel': 49, 'lanoir': 2, 'qwak': 1, 'annihil': 18, 'granddaught': 32, 'drion': 1, 'lian': 15, 'chu': 21, 'lindon': 2, 'brute': 28, 'gwizdo': 10, 'timsit': 1, 'incipi': 1, 'extermin': 39, 'painstakingli': 14, 'kaleidoscop': 7, 'brick': 59, 'leaf': 21, 'sunlight': 20, 'treetop': 2, 'homeown': 4, 'abbi': 30, 'sporti': 4, 'soldierli': 1, 'hondura': 1, 'colcollin': 1, 'alphabet': 12, 'respit': 17, 'vivaci': 13, 'maharajah': 3, 'tam': 10, 'josephin': 9, 'heartstr': 13, 'alwina': 3, 'more': 18, 'pygmalion': 3, 'galatea': 1, 'peclet': 1, 'galland': 2, 'berkeley': 58, 'tunisia': 3, '1906': 4, 'ziegfeld': 5, 'folli': 25, 'foli': 3, 'berger': 5, 'negr': 1, 'revu': 20, 'monaco': 5, '68': 23, 'zouzou': 1, 'chevali': 3, 'prom': 116, 'schrage': 4, 'monett': 3, 'oddest': 9, 'wherein': 28, 'astral': 9, 'discomfort': 24, 'rainbow': 36, 'repertoir': 31, 'levinson': 20, 'va': 6, 'rize': 2, 'rees': 41, 'mulligan': 22, 'sharpshoot': 10, 'vandal': 12, 'wth': 3, 'glock': 1, 'reload': 35, 'biehn': 16, 'thunderdom': 2, 'colombian': 12, 'surrend': 56, 'colombia': 11, 'berth': 10, 'decompress': 1, 'nether': 5, 'hoya': 1, 'selv': 18, 'futher': 2, 'godhelpusal': 1, 'sollett': 19, 'whittak': 2, 'garrigan': 3, 'dishonest': 21, 'reprehens': 15, 'amin': 17, 'idi': 1, 'infidel': 39, 'reattach': 2, 'gungan': 2, 'bom': 1, 'dismemb': 24, 'tryst': 11, 'akiva': 2, 'goldsman': 1, 'uncar': 16, 'luana': 8, 'minerva': 3, 'urec': 3, 'luciano': 17, 'studder': 1, 'erat': 2, 'belieavablitli': 1, 'disrob': 12, 'utan': 3, 'rif': 10, 'trifl': 25, 'ish': 68, 'flutteri': 3, 'socialit': 18, 'mont': 16, 'tussl': 9, 'sander': 59, 'comatos': 24, 'timm': 5, 'dini': 5, 'dtv': 10, 'matsuda': 2, 'pengiun': 1, 'ruphert': 1, 'thorn': 54, 'duquesn': 3, 'bounti': 59, 'redesign': 2, 'pengium': 1, 'derail': 24, 'nightw': 4, 'bta': 8, 'penguim': 1, 'averi': 16, 'akosua': 3, 'busia': 3, 'netti': 9, 'noncompl': 1, 'winslett': 3, 'leonardo': 25, 'sunk': 44, 'dewitt': 4, 'bukat': 4, 'flown': 14, 'southhampton': 1, 'hockley': 3, 'alledgedli': 1, 'thursday': 14, 'starboard': 1, 'gash': 6, 'plea': 30, 'lifeboat': 16, 'brittl': 6, 'portay': 1, 'unsink': 7, 'ismay': 2, 'heroicli': 1, 'misportray': 1, 'strauss': 18, 'goggenheim': 1, 'sip': 10, 'brandi': 11, 'astor': 21, 'carpethia': 1, 'silverwar': 7, 'gymnasium': 6, 'suffrag': 1, 'seast': 1, 'holder': 13, 'constain': 1, '88': 31, 'aclear': 1, 'septun': 1, 'cintematographi': 1, 'cero': 4, 'cuatro': 1, 'reflexion': 5, 'tlahuac': 2, 'irak': 5, 'rwanda': 4, 'dishonesti': 5, 'tamal': 2, 'chivo': 1, 'cabr': 1, 'pendejo': 1, 'smartest': 15, 'yaphet': 15, 'kotto': 15, 'ofcours': 1, 'rad': 10, 'wounder': 2, 'admiss': 45, 'wal': 32, 'namer': 2, 'tropic': 25, 'nci': 1, 'pointlessli': 22, 'silicon': 12, 'havegotten': 1, 'expositori': 6, '81': 15, 'decim': 18, 'armani': 2, 'wiz': 11, 'eo': 3, 'moonwalk': 28, 'mckenzi': 17, 'loveabl': 17, 'donger': 1, 'sheila': 35, 'investor': 14, 'wb': 31, 'bromel': 6, 'shite': 6, 'voiceov': 11, 'chabon': 6, 'bechstein': 3, 'likelihood': 15, 'smoothest': 2, 'novello': 6, 'vincenzo': 42, 'santorini': 3, 'strongbear': 1, 'vlad': 6, 'locatair': 8, 'dyptic': 1, 'deneuv': 9, 'dissimilar': 9, 'tangibl': 16, 'kershaw': 8, 'strictest': 4, 'welfar': 17, 'vivisect': 3, 'vegetarian': 10, 'briberi': 4, 'simpleton': 13, 'downfal': 44, 'borden': 12, 'wellman': 2, 'ww11': 1, 'euphoria': 2, 'goodwil': 5, 'clayton': 16, 'carousel': 11, 'beeri': 30, 'bleari': 1, 'ulyss': 11, 'lta': 9, 'tustin': 2, 'lakehurst': 3, 'afb': 2, 'reconnaiss': 2, 'laundri': 25, 'nap': 23, 'siddon': 2, 'woolnough': 1, 'houswiv': 1, 'wishi': 7, 'washi': 7, 'supersofti': 1, 'skywalk': 32, 'supervillain': 2, 'superact': 1, 'superfun': 1, 'supersadlysofti': 1, 'superlam': 2, 'patchwork': 9, 'kidder': 3, 'spiderman': 29, 'ironman': 1, 'superwoman': 4, 'smilla': 2, '77': 29, 'degener': 54, 'strengthen': 21, 'evolutionari': 4, 'genitalia': 14, 'misbegotten': 8, 'gert': 6, 'frobe': 1, 'goldfing': 4, 'champagn': 13, 'lsd': 22, 'litani': 10, 'p9fo': 1, 'shampoo': 8, 'ummm': 10, 'turnup': 1, 'cardin': 20, 'ars': 15, 'dora': 8, 'gratuiti': 3, 'thirteen': 32, 'narnia': 10, 'coathang': 1, 'pinpoint': 11, 'piaf': 7, 'mollifi': 3, 'lulu': 24, 'charlia': 2, 'antonin': 3, 'augusto': 7, 'bandini': 4, 'ogl': 22, 'bygon': 17, 'pandora': 14, 'kino': 13, 'stalag': 5, 'luft': 4, 'gestapo': 10, 'wayyyi': 1, 'bellhop': 4, 'het': 3, 'gouden': 2, 'ei': 2, 'spoorloo': 7, 'grot': 8, 'egon': 15, 'axel': 20, 'chronolog': 43, 'koolhoven': 3, 'yall': 2, '4am': 5, '9am': 1, 'broil': 3, 'rheostat': 5, 'desmond': 11, 'wedg': 12, 'region': 99, 'dismantl': 10, 'cbc': 34, 'handbook': 6, 'ism': 15, 'specifi': 15, 'vouch': 6, 'permeat': 34, 'baghdad': 13, 'ingram': 14, 'veight': 1, 'bahgdad': 1, 'vieght': 1, 'dupre': 2, 'tanner': 15, 'stephini': 1, '1692': 5, 'putnam': 7, 'baseless': 7, 'parri': 5, 'loreen': 3, 'seventeenth': 4, 'garb': 15, 'accost': 8, 'advisor': 11, 'cabot': 10, 'bert': 45, 'gob': 12, 'unaffect': 11, 'ddl': 2, 'dublin': 24, 'policewoman': 9, 'sudow': 1, 'redford': 45, 'shiveri': 2, 'admonit': 1, 'mastershot': 1, 'obvers': 1, 'spatial': 11, 'isaiah': 5, 'dickish': 1, 'kirkpatrick': 2, 'paperclip': 1, 'chunki': 13, 'gumbal': 1, 'toxi': 1, 'theatrego': 1, 'thinn': 12, 'handler': 6, 'hawaiian': 18, 'kono': 1, 'lumpi': 9, 'nguyen': 7, 'flicker': 36, 'takai': 1, 'sansabelt': 1, 'veddi': 1, 'tuba': 3, 'jeannot': 3, 'szwarc': 4, 'kushton': 1, 'hyland': 5, 'gaffney': 2, 'joann': 10, 'underway': 12, 'visionari': 32, 'outdon': 9, 'shook': 29, 'shantytown': 10, 'bulldoz': 15, 'lesotho': 1, 'treason': 15, 'zimbabw': 4, 'aros': 4, 'til': 33, 'mover': 5, 'segreg': 16, 'drench': 19, 'nimoy': 16, 'reinvigor': 4, 'magnavis': 2, 'betamax': 3, 'mileston': 26, 'compact': 12, 'quintess': 3, 'predisposit': 2, 'starkli': 11, 'partisan': 5, 'swastika': 9, 'boringli': 13, 'bangster': 1, 'duster': 3, 'kerchief': 4, 'horsi': 2, 'rewritten': 10, 'aluminium': 11, 'ciao': 3, 'boggl': 49, 'prune': 8, '40min': 3, 'salcedo': 1, 'maka': 1, 'czech': 45, 'samot': 2, 'recombin': 1, 'ond': 7, 'ej': 7, 'neurobiolog': 1, 'hanka': 11, 'plumber': 7, 'petr': 4, 'jakub': 5, 'matchmak': 8, 'vesna': 1, 'slavic': 12, 'macedonia': 3, 'barmaid': 4, 'czechia': 1, 'ufo': 26, 'lenka': 2, 'magnitud': 22, 'wilcox': 20, 'hrpuff': 2, '46': 11, 'dial': 33, 'policemen': 42, 'righteous': 17, '35mm': 14, 'bjork': 15, 'gee': 39, 'cannibalist': 22, 'botanist': 2, 'glandular': 6, 'valuat': 2, 'boogyman': 2, 'mutch': 3, 'sixteen': 43, 'parol': 27, 'circular': 17, 'crossbow': 19, 'ricochet': 5, 'monet': 5, 'peripher': 18, 'paulin': 48, 'aquart': 1, 'derrier': 1, 'prognath': 1, 'plump': 28, 'haenel': 7, 'saunter': 2, 'swish': 7, 'paradox': 28, 'blacher': 6, 'dumpi': 8, 'ungainli': 6, 'trickier': 1, 'schtup': 2, 'unashamedli': 8, 'fellatio': 5, 'narcissist': 32, 'soi': 6, 'disant': 2, 'hymen': 1, 'boit': 1, 'loosen': 12, 'involuntari': 5, 'servitud': 5, 'overrip': 5, 'wallflow': 4, 'dumbfounded': 1, 'noisom': 1, 'mystiqu': 17, 'strangler': 29, 'prc': 13, 'planch': 2, 'middleton': 11, 'narciss': 15, 'tango': 40, 'bloodthirsti': 26, 'ragtag': 7, 'ravensback': 1, 'casio': 8, 'gorefest': 5, 'combust': 13, 'wherebi': 12, 'heinous': 3, 'anytim': 54, 'sideswip': 2, 'mire': 15, 'tailspin': 3, 'cultiv': 16, 'notorieti': 30, 'latent': 8, 'insidi': 11, 'geer': 18, 'caprici': 7, 'precari': 12, 'vindic': 14, 'pertin': 11, 'charad': 14, 'nationwid': 3, 'discontent': 1, 'spur': 31, 'bevi': 18, 'purveyor': 9, 'focal': 12, 'vicari': 17, 'queasi': 4, 'surf': 156, 'sharpli': 23, 'saffron': 16, 'urbaniak': 6, 'montgomeri': 22, 'elina': 4, 'wensohn': 2, 'istanbul': 12, 'steroid': 12, 'gawki': 12, '28th': 3, '1895': 8, 'lumi': 13, 'sorti': 7, 'usin': 5, 'ciotat': 1, 'haver': 10, 'dailey': 4, 'unconcern': 6, 'atrophi': 1, 'scowl': 20, 'nightmarish': 48, 'riotou': 10, 'neglig': 24, 'conscious': 80, 'dormant': 9, 'isham': 2, 'filmscor': 1, 'loophol': 13, 'ampute': 7, 'certifi': 12, 'recertifi': 1, 'derat': 1, 'unalloy': 2, 'purpl': 117, 'redicula': 1, 'corri': 2, 'tyre': 3, 'qvc': 2, 'heavier': 7, 'tan': 24, 'waterworld': 6, 'costner': 31, 'lopez': 49, 'engval': 1, 'showgirl': 32, 'mindblow': 2, 'labotim': 1, 'sophmor': 3, 'mommi': 29, 'sterner': 2, 'internalist': 1, 'dissectionist': 1, 'councellor': 3, 'warpath': 2, 'plead': 44, 'crapper': 3, 'leech': 9, 'hartmen': 1, 'setup': 74, 'jealousi': 61, 'proto': 11, 'colorless': 11, 'bamboozl': 8, 'ignit': 28, 'consuelo': 3, 'craydon': 1, 'throe': 10, 'thalberg': 7, 'chooser': 1, 'vale': 3, 'autopilot': 9, 'yech': 3, 'messang': 1, 'spellbound': 16, 'kleenex': 14, 'pettit': 1, 'sung': 77, 'byrd': 3, 'nekeddo': 1, 'bur': 2, 'ddo': 1, 'recoil': 11, 'cactu': 7, 'baptism': 9, 'eileen': 24, 'gossip': 38, 'mccree': 1, 'thorni': 2, 'sauci': 13, 'lakesid': 4, 'vineyard': 2, 'infront': 2, 'hellooooo': 1, 'rosanna': 26, 'brainer': 16, 'rgen': 8, 'prochnow': 12, 'doodlebop': 19, 'ooout': 1, 'aboooot': 1, 'whacki': 5, 'jazmin': 1, 'hottiebu': 1, 'bbc3': 2, 'bbc1': 7, 'bbc2': 6, 'licenc': 8, 'lenni': 19, 'uproar': 12, 'unexpected': 2, 'baba': 12, 'reili': 2, 'mod': 15, 'daltrey': 3, 'entwistl': 3, '2am': 4, 'hajj': 3, '223': 1, 'baccalaur': 1, 'saudia': 1, 'bromid': 1, 'belgrad': 11, 'mustafa': 1, 'nercessian': 2, 'retic': 8, 'burqa': 1, 'damascu': 3, 'mosqu': 12, 'hagia': 1, 'sophia': 45, 'isma': 2, 'ferroukhi': 3, 'bask': 6, 'rasuk': 10, 'nott': 9, 'michelangelo': 8, 'recurr': 8, 'underlin': 35, 'ecliss': 3, 'francesco': 5, 'uomini': 2, '27': 47, 'ornella': 2, 'muti': 2, 'unsuit': 19, 'noteworthi': 52, 'swimsuit': 12, 'cinemalaur': 1, 'prong': 3, 'whaaaaa': 1, 'manslaught': 8, 'spitfir': 8, 'md': 10, 'tramel': 13, 'bi1': 3, 'unchalleng': 11, 'setback': 15, 'bi2': 2, 'snore': 31, 'creater': 1, 'guil': 7, 'sexless': 7, 'yakuza': 25, 'rythmic': 1, 'planifi': 1, 'international': 1, 'mannheim': 2, 'heidelberg': 4, 'zelenka': 2, 'geniou': 3, 'knoflikari': 1, 'regina': 21, 'ziegler': 3, 'stitzer': 11, 'typifi': 8, 'castmemb': 1, 'adorn': 12, 'romani': 7, 'sexahol': 1, 'backfir': 17, 'naiveti': 17, 'riski': 29, 'cathryn': 7, 'bradshaw': 12, 'hanif': 6, 'kureishi': 12, 'impressionist': 29, 'pyramid': 21, 'horu': 12, 'fruition': 15, 'avert': 11, 'substandard': 14, 'oversex': 15, 'gunk': 6, 'aeroplan': 4, 'fission': 1, 'peschi': 1, 'jf': 2, 'oswald': 14, 'jfk': 20, 'comm': 10, 'icar': 2, 'ennio': 13, 'morricon': 17, 'buffoon': 34, 'hornophobia': 3, 'toyland': 2, 'girth': 5, 'benefici': 7, 'depon': 1, 'saith': 1, 'texan': 27, 'gammon': 3, 'zilcho': 1, 'acquit': 28, 'hinterland': 3, 'jeer': 7, 'cajol': 5, 'cesspool': 10, 'bwp': 1, 'halperin': 20, 'atom': 47, 'whirlwind': 14, 'pillow': 24, 'fullest': 14, 'gauguin': 2, 'wmd': 2, 'aaron': 48, 'fascism': 28, 'souler': 3, 'chhaya': 2, 'cinemagandhi': 1, 'transplant': 70, 'jobi': 4, 'hayden': 31, 'anakin': 24, 'olin': 17, 'amityvil': 11, 'poltergeist': 13, 'heartbeat': 13, 'spectr': 10, 'marshi': 1, 'woken': 11, 'carnivor': 7, 'laugher': 6, 'dirtiest': 7, 'fenway': 9, '86': 35, 'eliv': 1, 'inquir': 11, 'ahh': 19, 'freakin': 17, 'hollyweird': 3, 'been': 8, 'wuzz': 1, 'unforgiv': 49, 'gawd': 17, 'plagiarist': 2, 'unsettlingli': 3, 'overpaid': 8, 'broker': 11, 'gerd': 1, 'squirrelli': 1, 'cohabit': 4, 'bff': 4, 'raffin': 6, 'overstuf': 3, 'ballsi': 3, 'pea': 7, 'zither': 1, 'friedkin': 9, 'signorellistar': 1, 'mcclurgplot': 1, 'fallwel': 6, 'knocker': 4, 'changin': 1, 'intelligentsia': 4, 'salut': 26, 'eater': 55, 'excommun': 7, 'absolv': 6, 'circumv': 3, 'chruch': 1, 'stigmata': 13, 'melang': 10, 'carolingian': 4, 'driscol': 10, 'weller': 23, 'addi': 10, 'mara': 12, 'shannyn': 4, 'sossman': 2, 'heresi': 3, 'benno': 2, 'furmann': 1, 'helgeland': 9, 'scattershot': 3, 'monochromat': 4, 'infer': 10, 'gerrard': 4, 'harlow': 61, 'gabl': 70, 'garri': 20, 'badger': 8, 'hurst': 9, 'tucker': 35, 'gentlemen': 59, 'deadliest': 4, 'shiver': 33, 'rotj': 16, 'insignific': 51, 'yoda': 31, 'bobba': 4, 'fett': 5, 'ewok': 44, 'stormtroop': 15, 'revealedi': 1, 'debunk': 17, 'tantamount': 7, 'obi': 20, 'wan': 42, 'kenobi': 9, 'hmmmmmmmmmmmm': 1, 'cogniz': 2, 'vine': 9, 'disadvantag': 14, 'outnumb': 8, 'blaster': 8, 'annakin': 10, '135': 6, 'nitpicki': 1, 'meritori': 2, 'hallam': 25, 'myle': 13, 'woolf': 6, 'griswold': 9, 'cobbl': 16, 'nastiest': 7, 'laserdisc': 6, 'ci': 6, 'hayek': 16, 'kirkin': 1, 'arturo': 6, 'burial': 45, 'snatcher': 19, 'glide': 17, 'scarywhi': 1, 'sparinglytak': 1, 'slime': 16, 'sfx': 27, 'movieth': 1, 'doa': 4, 'timeexpect': 1, 'tonn': 7, 'herg': 20, 'tintin': 25, 'gladaitor': 1, 'receiev': 1, 'baz': 2, 'lurhmann': 1, 'gosford': 10, 'highpoint': 9, 'gilligan': 33, 'harsher': 4, 'stanywck': 1, 'infomerci': 19, 'dullllllllllll': 1, 'interisland': 1, 'tinsel': 6, 'urin': 33, 'fart': 81, 'rediscov': 25, 'pigeon': 25, 'kavner': 13, 'reni': 5, 'santoni': 1, 'shandl': 1, 'charmless': 7, 'depressingli': 15, 'chute': 8, 'shittttttttttttttti': 1, 'setbound': 1, 'letterbox': 9, 'siphon': 1, 'pong': 10, 'jaclyn': 1, 'desanti': 1, 'shiner': 6, 'calson': 6, 'harmlessli': 4, 'escal': 44, 'roh': 1, 'repent': 20, 'exoner': 8, 'yakima': 6, 'canutt': 8, 'uncredit': 37, 'tot': 12, 'compositor': 2, 'hundstag': 21, 'austria': 22, 'tumor': 11, 'queu': 3, 'shapeless': 7, 'evel': 4, 'samberg': 12, 'chou': 21, 'gander': 8, 'plonk': 5, 'kinski': 44, 'joachim': 4, 'fuchsberg': 4, 'arendt': 1, 'lowitz': 1, 'wildest': 16, 'tastin': 1, 'campy': 2, 'scroungi': 1, 'gunnar': 8, 'toker': 4, 'ashor': 7, 'tre': 7, 'holton': 1, 'kaufmann': 4, 'avin': 1, 'effectu': 2, 'lobster': 5, 'jumpi': 24, 'souli': 2, 'sportswrit': 3, 'evan': 62, 'strode': 14, 'homework': 28, 'laughton': 8, 'supplant': 5, 'daoist': 2, 'cleans': 27, 'dao': 1, 'nofth': 1, 'gish': 7, 'purest': 14, 'bathhous': 15, 'daoism': 1, 'unstyl': 1, 'sacred': 1, 'dichotomi': 11, 'unparallel': 10, 'honeymoon': 41, 'alltim': 2, 'trampl': 16, 'underfoot': 2, 'geneva': 12, 'sovereignti': 1, 'unapologet': 15, 'zwick': 7, 'pret': 2, 'testi': 4, 'duchaussoy': 4, 'mariangela': 1, 'melato': 2, 'unconvincingli': 9, 'cf': 9, 'varney': 4, 'tweed': 5, 'approxim': 50, 'bete': 7, 'muer': 1, 'chariot': 13, 'everard': 2, 'devastatingli': 6, 'oftenli': 1, 'oakland': 23, 'fuck': 3, 'eskimo': 22, 'misread': 3, 'obeis': 2, 'bankabl': 11, 'cropper': 4, 'gigantismos': 1, 'contemp': 1, 'tuou': 1, 'latterday': 1, 'yewbenight': 1, 'amurrika': 1, 'upsmanship': 1, 'edna': 12, 'ferber': 2, 'cristo': 5, 'alimoni': 10, 'bodyguard': 45, 'acosta': 4, 'rieckhoff': 2, 'huze': 1, 'herold': 1, '1896': 5, 'tatum': 18, 'vallon': 2, 'corinn': 22, 'calvet': 10, 'flippen': 20, 'elam': 11, 'suitcas': 14, 'cahil': 29, 'theurgist': 1, 'remuner': 2, 'wrist': 45, 'summarili': 8, 'jackhamm': 5, 'prosper': 25, 'nonspecif': 1, 'inexcus': 20, 'amnesia': 22, 'lupin': 17, 'jigen': 2, 'fujiko': 6, 'goemon': 2, 'zenigata': 2, 'patchi': 12, 'coverag': 36, '1928': 26, 'elinor': 25, 'glyn': 4, 'talmadg': 3, 'larocqu': 1, 'leatric': 6, 'estel': 12, 'louella': 9, 'parson': 68, 'adore': 3, 'aileen': 11, 'pringl': 3, 'swanson': 29, 'sennett': 10, 'bebe': 8, 'maar': 3, 'crossfir': 2, 'virtuoso': 8, 'solvang': 7, 'camerawoman': 2, 'lamm': 8, 'starr': 23, 'sisterli': 2, 'quarrel': 16, 'mistakenli': 21, 'proprietor': 14, 'swede': 9, 'lelia': 3, 'goldoni': 4, 'vicki': 37, 'tub': 27, 'crept': 8, 'keyhol': 3, 'peep': 35, 'temptingli': 1, 'quietu': 1, 'appris': 1, 'infiltr': 29, 'sed': 8, 'demarol': 1, 'febuari': 1, '24th': 3, 'wazoo': 2, 'dreamwork': 24, 'cutesi': 17, 'rowdi': 14, 'rhythmic': 11, 'vol': 14, 'fraser': 16, 'incessantli': 12, 'coxism': 1, 'jd': 6, 'zach': 22, 'prat': 1, 'chemic': 57, 'sexton': 3, 'commenc': 19, 'compart': 9, 'incomplet': 26, 'lightship': 1, 'fardeen': 6, 'esha': 8, 'meghna': 1, 'gulzar': 2, 'iconographi': 5, 'asthet': 1, 'slacker': 36, 'difer': 2, 'buffett': 2, 'alpo': 2, 'brycer': 2, 'scape': 7, 'florenc': 18, 'nightingal': 5, 'feedback': 13, 'concur': 15, 'precict': 1, 'capshaw': 29, 'indiana': 56, 'chamberlain': 76, 'parcel': 6, 'doctress': 1, 'preternatur': 3, 'tribesmen': 4, 'kei': 32, 'denial': 40, 'mallepa': 5, 'sho': 50, 'vocalist': 5, 'mizer': 3, 'ciel': 4, 'vii': 9, '93': 20, '170': 2, 'whittl': 3, 'unredeem': 12, 'philomath': 1, 'banish': 17, 'liar': 48, 'vodka': 11, 'greenhous': 15, 'zonk': 4, 'alexia': 1, 'weirdli': 20, 'heaton': 23, 'chomiak': 2, 'fido': 84, 'grumpi': 36, 'habitu': 11, 'nooo': 7, 'bmacv': 1, 'chemotherapi': 3, 'animaniac': 4, 'harnel': 1, 'tress': 5, 'macneil': 4, 'welker': 5, 'patb': 1, 'guitarist': 16, 'krugger': 2, 'baltimor': 23, 'greenaway': 38, 'purposeless': 2, 'augment': 12, 'hearti': 22, 'doggi': 23, 'hagen': 30, 'heheh': 1, 'dreaful': 1, 'android': 27, 'dermott': 1, 'ahoy': 5, 'eleanor': 33, 'skelton': 13, 'lahr': 10, 'dorsey': 11, 'orchestra': 48, 'boof': 1, 'gorshin': 12, 'newmar': 12, 'robocop': 26, 'retart': 2, 'boorman': 22, 'boogi': 47, 'stripteas': 13, 'mckinney': 9, 'atual': 1, 'tiglon': 1, 'cinemax': 21, 'cremat': 14, 'prepubesc': 4, 'forgo': 5, 'andretti': 6, 'roadster': 6, 'mapl': 5, 'rep': 14, 'giller': 1, 'threesom': 24, 'unfathom': 22, 'thinli': 27, 'veil': 33, 'eco': 6, 'impenetr': 11, 'nausicaa': 20, 'aquafresh': 3, 'potenc': 3, 'ang': 44, 'gama': 1, 'walmart': 18, 'risen': 12, 'waster': 18, '2hour': 3, 'progression': 1, 'unfound': 9, 'infrequ': 11, 'fairfax': 7, 'memphi': 13, 'calitri': 4, 'patton': 30, 'delroy': 4, 'lindo': 4, 'giovanni': 18, 'ribisi': 15, 'caan': 24, 'olyph': 4, 'horsepow': 1, 'porsch': 17, '998': 1, 'overstock': 1, 'mucho': 4, 'bruckheim': 35, 'lace': 54, 'scattergun': 1, 'sena': 2, 'halicki': 5, 'fuell': 8, 'ream': 8, 'mope': 11, 'rosenberg': 5, 'oldboy': 3, 'tae': 3, 'kwon': 6, 'anniston': 5, 'seymor': 1, 'splendor': 20, 'andthey': 1, 'videostor': 9, 'entendr': 13, 'fatalist': 11, 'schnaa': 10, 'guidelin': 20, 'umberto': 8, 'curmudgeon': 6, 'desica': 2, 'milan': 12, 'prancer': 3, 'hawkin': 13, 'throb': 19, 'peevish': 4, 'wentworth': 20, 'louisa': 4, 'penri': 6, 'overhear': 13, 'musgrov': 2, 'interchang': 13, 'proprieti': 6, 'premium': 9, 'hoyden': 2, 'hamstrung': 5, 'silverston': 20, 'newsgroup': 2, 'verducci': 4, 'shelton': 15, 'minus': 5, 'brimston': 3, 'marm': 3, 'lender': 5, 'theresa': 22, 'dorca': 2, '5year': 1, 'glop': 5, 'ichikawa': 3, 'somegoro': 2, 'goo': 37, 'edo': 4, 'courtesan': 6, 'sumida': 1, 'nakamura': 4, 'za': 2, 'kabuki': 12, 'jink': 7, 'acquitt': 3, 'keef': 10, 'brasel': 4, 'eschelon': 1, 'pang': 33, 'undertak': 64, 'municip': 3, 'passageway': 7, 'forman': 9, 'tomboy': 16, 'pinciotti': 2, 'sanest': 1, 'theorist': 17, 'burkhardt': 1, 'prettiest': 5, 'midg': 4, 'algerian': 4, 'woven': 34, 'abstain': 4, 'interbre': 1, 'umpteenth': 8, 'ikwydl': 2, 'hewitt': 24, 'brainless': 55, 'unspeak': 25, 'floridian': 2, 'pavement': 13, 'razdan': 3, 'vrajesh': 2, 'hirje': 2, 'saurabh': 2, 'kurush': 1, 'deboo': 1, 'tehmul': 1, 'bombay': 10, 'gustad': 4, 'shrine': 15, 'ghoulish': 8, 'skinhead': 15, 'kissi': 3, 'betcha': 7, 'smarti': 3, 'gigglesom': 1, 'pear': 10, 'zigfield': 1, 'timid': 26, 'looter': 4, 'mussolini': 14, 'il': 35, 'duce': 3, 'marcello': 12, 'octavia': 4, 'labeija': 1, 'anji': 1, 'xtravaganza': 2, 'howdoilooknyc': 1, 'jehovah': 7, 'psychoanalysi': 4, 'll': 1, 'osoph': 1, 'leeway': 7, 'unprov': 1, 'semant': 4, 'snowhit': 1, 'gahannah': 1, 'cockamami': 1, 'tpgtc': 1, 'hog': 26, 'delusion': 21, 'madhous': 7, 'hallucinogen': 9, 'vagina': 19, 'menstruat': 10, 'zizekian': 1, 'terminolog': 10, 'uneduc': 30, 'impression': 22, 'perkin': 29, 'misinterpret': 18, 'solari': 16, 'throwaway': 33, 'palma': 110, 'dogvil': 10, 'bleedin': 4, 'oxymoron': 6, 'articul': 35, 'unobserv': 4, 'looni': 42, 'incas': 3, 'gabba': 2, 'guttersnip': 1, 'sacarst': 1, 'verhoven': 2, 'tannhaus': 2, 'batti': 14, 'elegiac': 7, 'sheffer': 20, 'brotherconflict': 1, 'conciel': 1, 'unforssen': 1, 'wike': 1, 'sheeba': 4, 'alahani': 3, 'alohalani': 1, 'hungari': 15, 'sonnenschein': 2, 'upwardli': 6, 'eldest': 27, 'ww': 24, 'hapsburg': 1, 'kinet': 18, 'pastich': 27, 'tatsuhito': 9, 'shihito': 1, 'shinjuku': 8, 'ultraviol': 2, 'polarisdib': 12, 'cobern': 1, 'gunpowd': 10, 'ammo': 12, 'horridli': 4, 'hoarder': 1, 'dippi': 11, 'discord': 7, 'resignedli': 1, 'unhousebroken': 1, 'dax': 10, 'prattl': 4, 'spasmo': 1, 'yul': 15, 'brynner': 17, 'crumpl': 5, 'toxin': 4, 'vial': 10, 'lowli': 14, 'dinki': 2, 'aloud': 19, 'rumbl': 24, 'peck': 85, 'zombifi': 9, 'funnili': 14, 'lmao': 4, 'fetu': 11, 'squeal': 21, 'grenad': 33, 'thirsti': 21, 'lyu': 4, 'waterford': 3, 'mckellar': 2, 'exotica': 2, 'lindi': 43, 'clavel': 1, 'nairn': 1, 'moyl': 1, 'synops': 4, 'successor': 27, 'pleasanc': 15, 'hendri': 3, 'jilt': 9, 'electrifi': 27, 'dissatisfi': 15, 'bayldon': 3, 'portmanteau': 2, 'nineteenth': 14, 'isolation': 2, 'jingoist': 7, 'claptrap': 18, 'madama': 1, 'zinger': 6, 'kilter': 14, 'fillion': 4, 'propag': 7, 'starla': 1, 'parley': 1, 'larval': 2, 'gunn': 10, 'winsom': 8, 'wheelsi': 2, '29': 25, 'dreamcatch': 4, 'anathema': 3, 'luhzin': 2, 'helper': 24, 'endors': 33, 'irl': 1, 'beef': 36, 'rethought': 1, 'lander': 9, 'jaundic': 3, 'gregg': 7, 'tiredli': 1, 'allyson': 6, 'hornaday': 2, 'gum': 32, '152': 1, 'slitter': 1, 'hussi': 2, 'mojav': 4, 'hamlin': 7, 'henley': 4, 'basia': 1, 'hern': 1, 'jeremey': 2, 'lelliott': 1, 'roadsid': 7, 'detour': 18, 'klenhard': 4, 'sandstorm': 4, 'neutron': 2, 'forthcom': 19, 'implicit': 13, 'della': 41, 'trunk': 28, 'have': 1, 'chucki': 25, 'exemplifi': 31, 'tropa': 1, 'unanim': 11, 'bope': 1, 'ascertain': 11, 'monford': 1, 'haa': 13, 'scheffer': 2, 'bawdi': 13, 'midday': 4, 'boogen': 1, '1929': 19, 'mueto': 1, 'interestig': 2, 'licit': 2, 'gutter': 26, 'braini': 13, 'easygo': 9, 'grisbi': 24, 'sour': 53, 'choppili': 2, 'rootless': 4, 'inveter': 3, 'forestal': 1, 'worldlier': 1, 'haddonfield': 5, 'pleasenc': 8, 'nightfal': 3, 'loomi': 17, 'repertori': 4, 'infal': 7, 'caller': 15, 'derren': 1, 'asda': 1, 'ppl': 11, 'templar': 22, 'archeologist': 6, 'trod': 6, 'troublesom': 16, 'dopplegang': 2, 'blacken': 6, 'forehead': 26, 'panther': 20, 'thunderstorm': 8, 'friendsth': 1, 'misgiv': 10, 'toad': 17, 'bannacheck': 1, 'vinyl': 13, 'elan': 1, 'mumford': 2, 'unwit': 7, 'synanomess': 1, 'smoother': 6, 'kristopherson': 2, 'gaynor': 3, 'winslet': 31, 'hobo': 14, 'sitter': 10, 'doordarshan': 1, 'gubbarr': 1, 'sweeter': 7, 'doel': 1, 'shayan': 6, 'munshi': 8, 'draggi': 8, 'int': 9, 'premchand': 3, 'prolli': 5, 'infin': 13, 'taim': 8, 'borough': 11, 'brighton': 8, 'greenwich': 13, 'beennew': 1, 'rustbelt': 1, 'futureist': 1, 'yule': 1, 'latham': 10, 'compli': 8, 'jaqu': 7, 'tati': 7, 'jour': 11, 'te': 34, 'bourgeoisi': 7, 'erod': 6, 'happenst': 21, 'trounc': 7, 'pore': 6, 'beatin': 1, 'discrep': 15, 'normandi': 2, 'awsom': 9, 'panama': 19, 'wuss': 14, 'cpl': 1, 'upham': 1, 'aggres': 1, 'boiler': 16, 'conpsiraci': 1, 'antitrust': 7, 'visag': 11, 'psychedel': 48, 'kollo': 6, 'visor': 5, 'golli': 8, 'napolean': 8, 'manish': 1, 'katana': 9, 'metaphys': 35, 'tadanobu': 15, 'asano': 21, 'barren': 23, 'ryu': 7, 'daisuk': 3, 'kagemusha': 4, 'heiki': 1, 'zenith': 11, 'shinto': 1, 'maestro': 15, 'sogo': 7, 'ishii': 11, 'mcgavin': 36, 'kolchack': 4, 'billow': 5, 'sullen': 19, 'grrrrrrrrrr': 1, 'kia': 3, 'sportag': 1, 'stereoscop': 2, 'yum': 14, 'margolin': 4, 'purrrrrrrrrrrrrrrr': 1, 'goodnight': 24, 'anextrem': 2, 'dhl': 1, 'aquawhit': 1, 'rockstar': 12, 'yowza': 2, 'sartain': 10, 'atol': 3, 'magnat': 10, 'gulch': 4, 'affluent': 25, 'nymphomaniac': 20, 'platt': 7, 'merriman': 1, 'blowjob': 2, 'hedi': 35, 'mockabl': 1, 'christer': 1, 'raspberri': 6, 'ilk': 30, 'ratso': 75, 'rizzo': 37, 'schelsing': 1, 'ribbon': 14, 'finn': 8, 'brotherhood': 20, 'camra': 2, 'wcw': 16, 'sanchez': 15, 'tygr': 1, 'especiali': 3, 'unfourtunatli': 1, 'honer': 1, 'suss': 1, 'loaf': 16, 'arther': 1, 'dw': 10, 'adhd': 3, 'rocko': 2, 'philo': 44, '72': 12, 'curtiz': 25, 'pallett': 4, 'spoleto': 1, 'emilia': 12, 'spasm': 6, 'dirtier': 7, 'ambival': 16, 'incestu': 46, 'patholog': 21, 'escapist': 31, 'stelvio': 2, 'cipriani': 2, 'noteworthili': 1, 'sputter': 11, 'vainli': 7, 'saleswoman': 2, 'wittiest': 7, 'sweeni': 5, 'windom': 1, 'stationhous': 1, 'handcuf': 8, 'implicitli': 5, 'mst': 21, 'lovejoy': 5, 'tso': 3, 'tsing': 18, 'terrestri': 10, 'mstie': 4, 'riffer': 1, 'settlement': 11, 'cubbyhol': 1, 'montmart': 1, 'sweepingli': 3, 'windmil': 10, 'kikuno': 7, 'fusanosuk': 1, 'naught': 6, 'ryosuk': 3, 'menacingli': 7, 'au': 12, 'contrair': 2, 'sautet': 1, 'corneau': 6, 'rie': 3, 'python': 56, '357': 1, 'painstak': 7, 'superintend': 8, 'ferrot': 6, 'yve': 11, 'montand': 12, 'opardi': 1, 'stefania': 5, 'sandrelli': 2, 'ganay': 1, 'oi': 7, 'rier': 3, 'inexor': 16, 'pedant': 9, 'stifl': 23, 'scenarist': 11, 'boulang': 3, 'nard': 1, 'deperson': 1, 'orl': 1, 'an': 7, 'pernici': 7, 'hadfield': 2, 'tlog': 1, 'fawlti': 10, 'scarili': 5, 'singlehandedli': 10, 'interf': 18, 'flourish': 43, 'harmonis': 1, 'bridegroom': 5, 'freq': 1, 'docudrama': 19, 'adventist': 7, 'schepsi': 1, 'petersburg': 3, 'tram': 3, 'excret': 6, 'overreact': 5, 'bookcas': 3, 'teensthat': 1, 'copul': 7, 'pod': 34, 'helplessli': 8, 'crapfest': 11, 'reclam': 3, 'brighter': 21, 'stamp': 41, 'berat': 26, 'harpi': 10, 'grimac': 15, 'planner': 7, 'castrat': 15, 'psychosi': 17, 'indirect': 8, 'psh': 2, 'lutz': 9, 'vartan': 11, 'hhaha': 1, 'spastic': 6, 'pieish': 1, 'janosch': 1, 'sperm': 15, 'uninterrupt': 11, 'rah': 1, 'cacophoni': 9, 'tsunami': 10, 'weir': 31, 'stoic': 33, 'gunplay': 12, '20m': 1, 'looonnnggg': 1, 'hoax': 14, 'rajasthan': 3, 'jaipur': 2, 'amer': 2, 'afgani': 1, 'rajasthani': 2, 'untangl': 3, 'siodmak': 18, 'ella': 34, 'impromptu': 15, 'franchot': 29, 'elisha': 36, 'raconteur': 1, 'gaol': 4, 'governor': 33, 'multin': 7, 'sparrow': 5, 'satisfyingli': 6, 'niggl': 6, 'thatcherit': 3, 'roosevelt': 23, 'farentino': 3, 'charac': 1, 'misdemeanour': 2, 'widdo': 2, 'benedict': 12, 'keyston': 22, 'kop': 4, 'dogberri': 1, 'rylanc': 1, 'mcteer': 8, 'capucin': 3, 'cavalri': 28, 'foresight': 5, 'iik': 1, 'chauffeur': 23, 'sniffish': 1, 'gielgud': 55, 'underztand': 1, 'scourg': 6, 'ifit': 1, 'meth': 17, 'quizzic': 2, 'ruper': 1, 'delicaci': 7, 'klein': 22, 'melinda': 38, 'rae': 17, 'newsom': 3, 'dramedi': 9, 'treacl': 2, 'tidi': 21, 'shelli': 27, 'muse': 32, 'cyborg': 89, 'huck': 3, 'sadler': 6, 'widescreen': 70, 'carlin': 12, 'filth': 71, 'sholay': 46, 'leeli': 1, 'bhansani': 1, 'ajay': 46, 'raj': 69, 'nishabd': 2, 'cheeni': 4, 'kum': 3, 'jhoom': 6, 'barabar': 3, 'abhishek': 9, 'heyi': 1, 'babyy': 1, 'rosari': 3, 'bead': 25, 'defintli': 2, 'supermarket': 41, 'lorrain': 6, 'packi': 1, 'tftc': 6, 'traynor': 2, 'unstopp': 29, 'harem': 14, 'ottoman': 3, 'safiya': 1, 'gillain': 2, 'desca': 1, 'emul': 32, 'supersoldi': 3, 'badguy': 5, 'lop': 3, 'pane': 6, 'costar': 25, 'burlinson': 5, 'rowland': 61, 'sigrid': 4, 'pouter': 1, 'downgrad': 11, 'mononok': 19, 'ashitaka': 1, 'chihiro': 2, 'haku': 3, 'hiasashi': 1, 'leicest': 3, 'bart': 39, 'craftsmanship': 16, 'shepperton': 2, 'elstre': 1, 'boreham': 1, 'bray': 7, 'yor': 2, 'sousa': 6, 'donnel': 16, 'reprint': 5, 'monthli': 6, 'particl': 17, 'voluntari': 2, 'bureau': 27, 'practition': 11, 'nausea': 19, 'lemesuri': 1, 'inebri': 6, 'audibl': 20, 'mjh': 11, 'culpabl': 6, 'goug': 16, 'handheld': 10, 'andrewjlau': 1, 'yi': 10, 'unmysteri': 1, 'spelt': 2, 'gooni': 14, 'kutcher': 15, 'valderamma': 1, 'mila': 5, 'kuni': 6, 'sage': 14, 'overemot': 4, 'typefac': 1, 'blecch': 2, 'cro': 2, 'magnon': 1, 'ampli': 7, 'sequela': 1, 'bim': 1, 'gavriil': 1, 'troyepolski': 1, 'stanislav': 1, 'rostotski': 1, 'darki': 2, 'nebraska': 9, 'fonner': 1, 'theindepend': 1, 'blondel': 44, 'einstien': 3, 'hudsuck': 2, 'proxi': 9, 'princeton': 7, 'lawrencevil': 1, 'hopewel': 1, 'blindsight': 1, 'everest': 5, 'sabriy': 7, 'tenberken': 3, 'weihenmay': 2, 'summit': 8, 'lhakpa': 1, 'ri': 10, 'altitud': 8, 'oversimplifi': 3, 'frigid': 14, 'lug': 9, 'beggin': 2, 'slashervil': 1, 'faintest': 4, 'decommiss': 1, 'dormitori': 8, 'vipco': 3, 'rm': 7, 'nicht': 2, 'angelica': 7, 'shirtless': 10, 'arkli': 1, 'charistmat': 1, 'kwan': 4, 'nul': 1, 'tait': 3, 'foi': 5, 'homm': 3, 'espac': 2, 'fascinatingli': 6, 'hom': 9, 'sloppili': 11, 'measli': 10, 'hahahahhahhaha': 1, 'muncher': 1, 'yu': 13, 'gi': 44, 'ornament': 9, 'fuhrer': 7, 'tryout': 7, 'grittier': 7, 'acedemi': 1, 'crazili': 5, 'sanatorium': 8, 'seeker': 15, 'dashiel': 9, 'hammett': 13, 'shumlin': 5, 'hostess': 24, 'outspoken': 5, 'expon': 3, 'matriarch': 13, 'brancovi': 4, 'teck': 4, 'coulouri': 16, 'umber': 1, 'impedi': 10, 'emannuel': 1, 'disturbia': 1, '2010': 12, 'ili': 3, 'boring': 3, 'madhur': 15, 'bhandarkar': 22, 'mumbai': 21, 'glam': 12, 'atul': 11, 'kulkarni': 14, 'sandhya': 8, 'mrudul': 1, 'konkona': 6, '140': 15, 'lightest': 2, 'coleen': 2, 'tolstoy': 16, 'kidnapp': 26, 'rolex': 4, 'delicatessen': 4, 'lapd': 19, 'summaris': 13, 'mandy62': 1, 'unkind': 9, 'mez': 3, 'pereira': 14, 'curriculum': 6, 'cosa': 3, 'hacen': 2, 'midlif': 10, 'eduard': 6, 'agito': 2, 'toola': 3, 'shunack': 1, 'wanderd': 1, 'engilsh': 1, 'minka': 1, 'perish': 22, 'isotop': 5, 'quarri': 12, 'kilogram': 2, 'ergo': 6, 'duuh': 1, 'pronto': 5, 'wayward': 23, 'turpin': 6, 'langdon': 4, 'shag': 16, 'incens': 6, 'accessori': 8, 'showtim': 33, 'discretionari': 1, '1am': 2, 'espn': 3, 'freshman': 28, 'dorkish': 1, 'coital': 1, 'caffey': 1, 'wicker': 31, 'agap': 10, 'glitter': 22, 'grrrr': 2, 'mosh': 4, 'rjt': 1, 'renner': 6, 'languidli': 4, 'bloodless': 24, 'nebbishi': 3, 'lookin': 9, 'sicko': 12, 'sorrier': 1, 'gaci': 1, 'gein': 2, 'charcter': 1, 'juiliett': 1, 'tarr': 7, 'nuttier': 3, 'nekkid': 8, 'rpm': 6, 'jeeper': 10, 'creeper': 19, 'mcallist': 7, 'attir': 21, 'scanti': 2, 'stonewash': 1, 'crain': 20, 'kaminski': 3, 'bedridden': 3, 'coil': 4, 'milo': 67, 'kumar': 82, 'deathstalk': 35, 'builder': 15, 'tolkien': 39, 'displeas': 9, 'cornish': 4, 'oddbal': 39, 'trevethyn': 4, 'horticultur': 1, 'lucr': 10, 'creditor': 5, 'rapport': 17, 'outlandishli': 2, 'hydropon': 1, 'luchino': 12, 'dieget': 3, 'terra': 5, 'trema': 2, 'snuck': 14, 'forefath': 4, 'sica': 18, 'gian': 1, 'domenico': 2, 'scala': 3, 'aldo': 5, 'tonti': 3, 'rossellini': 10, 'fellini': 49, 'signpost': 6, 'reaganom': 1, 'valor': 5, 'tyrant': 18, 'purcel': 3, 'mongol': 7, 'sergei': 10, 'bodrov': 4, 'potyomkin': 1, 'pseud': 3, 'gladli': 31, 'probobl': 2, 'gibson': 55, 'lawn': 40, 'farnsworth': 42, 'mclean': 4, '1914': 18, 'pendleton': 17, 'refund': 36, 'taker': 39, 'gnatpol': 5, 'flutist': 1, 'reciproc': 7, 'unsavori': 19, 'barest': 7, 'besmirch': 3, 'phyllida': 5, 'mobi': 18, 'ahab': 13, 'haden': 8, 'milliard': 2, 'smokey': 11, 'chimera': 5, 'propagand': 4, 'testimoni': 34, 'backwood': 38, 'unrespons': 3, 'toothless': 12, 'voter': 36, 'keneth': 3, 'crighton': 2, 'shredder': 9, 'madoona': 1, 'spanki': 10, 'cutest': 17, 'maison': 6, 'lami': 1, 'roderick': 3, 'debucourt': 1, 'madelein': 48, '1839': 3, '89': 25, 'tenniel': 1, 'jot': 7, 'nought': 3, 'husk': 6, 'alucard': 1, 'stu': 4, 'incognito': 4, 'calibr': 29, 'sprocket': 4, 'sugiyama': 13, 'acadami': 1, 'mensroom': 1, 'watanab': 15, 'workmat': 3, 'shawn': 37, 'wolsk': 4, 'dabbi': 2, 'admitt': 6, 'nabor': 8, 'intestin': 39, 'breaker': 24, 'leverag': 6, 'untempt': 1, 'qualif': 11, 'simba': 39, 'slurp': 9, 'rafiki': 10, 'hakuna': 12, 'matata': 12, 'pumbaa': 58, 'vereen': 5, 'sombrero': 3, 'homemad': 18, 'tentacl': 14, 'jen': 15, 'unconscion': 1, 'skein': 1, 'vatican': 14, 'techno': 28, 'priesthood': 5, 'omnipres': 11, 'disaffect': 3, 'referenti': 11, 'leopard': 14, 'fashionista': 1, 'fallafel': 1, 'richer': 26, 'dinoshark': 2, 'tylo': 12, 'blog': 15, 'horrormoviejourn': 1, 'blogspot': 9, 'vicious': 16, 'klansmen': 1, 'clyde': 42, 'tolson': 1, 'cohn': 21, 'silvestar': 1, 'muriel': 39, 'myrna': 45, 'zuzz': 2, 'architect': 40, 'driller': 4, 'walerian': 5, 'borowczyk': 15, 'loki': 2, 'merim': 1, 'broadhurst': 3, 'lisabeth': 1, 'hummel': 3, 'impoverish': 19, 'marqui': 33, 'teau': 10, 'ursin': 1, 'purport': 26, 'sirpa': 4, 'bestial': 25, 'phallu': 3, 'tisk': 2, 'showbiz': 11, 'pino': 20, 'donaggio': 6, 'dickinson': 39, 'frightworld': 5, 'veng': 33, 'cleaver': 10, 'treacheri': 12, 'katharin': 12, 'bloodrayn': 11, 'dipsh': 1, 'recoup': 5, 'noodl': 24, 'littlefield': 8, 'whi': 4, 'how': 7, 'upfront': 6, 'gaptooth': 1, 'overpr': 4, 'cdn': 1, 'sift': 4, 'relic': 27, 'afflict': 27, 'discriminatori': 1, 'hesseman': 9, 'stigma': 12, 'nami': 1, 'bp': 2, 'bootstrap': 2, 'vicissitud': 4, 'jobless': 5, 'graboid': 8, 'unprepar': 11, 'thermomet': 4, 'gaa': 2, 'lowbrow': 14, 'snyaps': 1, 'tome': 10, 'housekeep': 23, 'straddl': 8, 'pancho': 6, 'kohner': 3, 'grandchildren': 16, 'wretched': 5, 'volleybal': 9, 'dreadful': 1, 'crocteas': 1, 'baraka': 6, 'poof': 7, 'predilect': 7, 'excurs': 23, 'nosed': 4, 'unquestion': 30, 'intimaci': 30, 'occhipinti': 1, 'rivero': 3, 'frenchi': 3, 'lobo': 6, 'mace': 19, 'macist': 2, 'cavewoman': 1, 'claudio': 9, 'simonetti': 1, 'coda': 12, 'beefi': 6, 'unfett': 5, 'burrough': 23, 'ds': 8, 'marlow': 12, 'utop': 1, 'mcfadden': 1, 'trekki': 5, 'seismic': 2, 'crest': 3, 'asturia': 1, 'lettuc': 5, 'parisienn': 2, 'tatti': 6, 'aint': 7, 'halv': 15, 'mcdemor': 1, 'personia': 1, 'goate': 5, 'lordi': 32, 'nader': 4, 'snippit': 1, 'stapp': 1, 'sled': 8, 'cori': 8, 'monteith': 5, 'harlequin': 9, 'cullum': 2, 'emeri': 6, 'stettner': 8, 'airwav': 11, 'travail': 14, 'ulterior': 12, 'teacup': 5, 'teborg': 1, 'longinotto': 2, 'dangli': 3, 'definatley': 2, 'evr': 2, 'masterpeic': 3, 'herb': 18, 'erb': 4, 'cuz': 14, 'ther': 10, 'dissent': 9, 'juror': 4, 'steiger': 8, 'pawnbrok': 5, 'holden': 32, 'wintri': 6, 'octogenarian': 5, 'fatigu': 20, 'thickli': 2, 'fratern': 25, 'cautiou': 13, 'victimless': 1, 'codepend': 3, 'foolproof': 3, 'busboy': 2, 'gram': 53, 'delin': 8, 'innat': 25, 'jenkin': 17, 'embattl': 4, 'oedip': 10, 'sheesh': 19, 'wim': 8, 'uc': 8, 'strait': 20, 'doco': 8, 'yawnarooni': 1, 'veidt': 23, 'index': 9, 'pearli': 5, 'pinup': 11, 'stag': 11, 'replica': 14, 'tabloidesqu': 1, 'etch': 21, 'sui': 3, 'generi': 1, 'chimpnaut': 2, 'outset': 41, 'marki': 18, 'saturn': 14, 'kilomet': 4, 'decre': 7, 'rainforest': 4, 'klieg': 3, 'pec': 2, 'whiteboy': 1, 'characterless': 5, 'crookedli': 1, 'orangutan': 9, 'interspeci': 2, 'klutz': 3, 'minc': 13, 'greystok': 7, 'thade': 9, 'kaka': 2, 'splendifer': 2, 'pota': 8, 'disench': 6, 'cavepeopl': 1, 'anthropocentr': 1, 'apex': 12, 'anus': 1, 'stupefi': 9, 'fervor': 9, 'mongoloid': 7, 'unpopular': 20, 'chitter': 1, 'primo': 6, 'chewer': 1, 'thaddeu': 3, 'hebetud': 4, 'incogniz': 2, 'mutter': 22, 'tamper': 16, 'lasergun': 1, 'misanthropi': 3, 'estella': 3, 'ulul': 1, 'gandalf': 26, 'almghandi': 2, 'cowardic': 9, 'transvestit': 36, 'sauron': 9, 'saurau': 2, 'aragorn': 23, 'ulrik': 1, 'scotch': 9, 'strunzdumm': 1, 'wormtong': 1, 'dourif': 24, 'grmpfli': 1, 'understori': 1, 'weirder': 13, 'crabtre': 2, 'paddl': 6, 'headfirst': 2, 'karo': 4, 'butthorn': 4, 'whup': 2, 'technician': 13, 'devan': 4, 'oooh': 9, 'macgyv': 11, 'whaaaa': 1, 'noooo': 4, 'infrar': 3, 'minnesota': 11, 'rubbl': 18, 'ttm': 1, 'unrelentingli': 7, 'rephras': 5, 'badass': 18, 'bale': 12, 'polt': 1, 'ur': 9, 'obbsess': 1, 'gf': 7, 'adorbl': 1, 'plimpton': 8, 'honorari': 8, 'uncompel': 6, 'capraesqu': 1, 'whimsi': 12, 'scintil': 7, 'revisit': 58, 'freebi': 3, 'lamarr': 35, 'kiesler': 3, 'machati': 9, 'horseback': 24, 'legendarili': 4, 'tccandler': 1, 'candler': 2, 'rewir': 1, 'yash': 13, 'aditya': 26, 'chopra': 24, 'crorepati': 1, 'crore': 4, 'saif': 35, 'kareen': 1, 'amu': 1, 'konkana': 8, 'sensharma': 1, 'flurri': 8, 'goop': 6, 'idl': 27, 'bounci': 14, 'cosmo': 22, 'atlantian': 16, 'tier': 18, 'keyboardist': 4, 'nighi': 17, 'drummer': 41, 'groupi': 16, 'aubrey': 12, 'fumblingli': 1, 'reignit': 5, 'screwi': 3, 'flamboyantli': 5, 'pip': 9, 'tireless': 4, 'clement': 4, 'frenai': 3, 'bristl': 8, 'bittersweetli': 1, 'tatter': 11, 'evanesc': 4, 'bid': 37, 'seriocom': 3, 'hing': 20, 'bedder': 1, 'wader': 1, 'tayback': 3, 'rasputin': 4, 'cauldron': 8, 'bethani': 24, 'hardbodi': 4, 'approx': 8, 'kove': 3, 'schill': 4, 'nighti': 2, 'vogu': 28, 'logist': 3, 'osa': 6, 'safari': 16, 'woolsey': 8, 'muir': 7, 'martini': 5, 'bwana': 1, 'pert': 11, 'ingrati': 10, 'congorilla': 3, 'penchant': 28, 'conjoin': 3, 'jodhpur': 3, 'pith': 4, 'scat': 10, 'lamest': 20, 'standbi': 5, 'insinu': 22, 'unfail': 3, 'subtler': 6, 'craftier': 1, 'masteri': 25, 'mankiewicz': 18, 'outrightli': 1, 'tact': 12, 'negat': 15, 'trueness': 4, 'missionari': 22, 'natti': 2, 'tux': 4, 'elop': 5, 'piteou': 1, 'mitig': 4, 'admonish': 5, 'denot': 11, 'shrewd': 18, 'zeal': 9, 'sinner': 7, 'placat': 5, 'chow': 32, 'endi': 1, 'byu': 4, 'heber': 1, 'brigham': 16, 'oratori': 4, 'hyrum': 5, 'haze': 27, 'sabr': 10, 'dooku': 2, 'bink': 11, 'chancellor': 6, 'cobweb': 18, 'doggon': 2, 'unrecogn': 4, 'meli': 6, 'lumier': 26, 'unadorn': 2, 'ossif': 1, 'ruptur': 8, 'decentr': 1, 'subvers': 39, 'workplac': 11, 'stingi': 6, 'gambit': 12, 'heartili': 26, 'shyamalan': 7, 'pee': 56, 'sysnuk3r': 1, 'haplessli': 1, 'blacktop': 2, 'alfredo': 9, 'camaraderi': 18, 'boyish': 30, 'prankster': 10, 'liverpool': 13, 'superstardom': 7, 'harharhar': 1, 'oedipu': 5, 'dissuad': 7, 'nifti': 38, 'unecessari': 1, 'sublimin': 18, 'traumatisingli': 1, 'prieti': 2, 'salman': 65, 'rani': 18, 'preiti': 18, 'nakhra': 1, 'childless': 3, 'lorenzo': 28, 'purifi': 5, 'pinto': 7, '99p': 3, 'clincher': 5, 'hellbre': 1, 'chod': 1, 'awwwww': 1, 'shaka': 7, 'cachet': 2, 'sinclair': 19, 'mandela': 7, 'mungo': 1, 'on': 7, 'multifacet': 5, 'suspiria': 7, 'scissorhand': 2, 'projector': 21, 'unfurnish': 2, 'immeasur': 9, 'shani': 8, 'pestil': 10, 'goblet': 3, 'anthropophagu': 1, 'chooper': 1, 'niko': 1, 'impal': 37, 'reap': 10, 'deill': 1, 'anbthoni': 1, 'barataria': 1, 'lafitt': 12, '1812': 1, 'redcoat': 5, 'cede': 5, 'statesmanship': 1, 'inger': 7, 'corsia': 8, 'dumbril': 9, 'mathew': 9, 'hull': 12, 'onslow': 1, 'jeffri': 9, 'bernstein': 13, 'freshen': 2, 'grigg': 2, 'nozaki': 1, 'moyer': 5, 'jensen': 4, 'nelli': 9, 'manley': 1, 'westmor': 2, 'peavey': 2, 'cinemathequ': 5, 'cinemascop': 9, 'artisti': 1, 'insititu': 1, 'embroid': 5, 'grandios': 25, 'rapt': 5, 'alein': 1, 'unarm': 14, 'snide': 12, 'vidocq': 2, 'antoinett': 8, 'florid': 2, 'heav': 19, 'potboil': 22, 'unmemor': 14, 'estrogen': 2, 'encyclopedia': 10, 'krafft': 1, 'ebe': 2, 'magoo': 6, 'raspi': 10, 'oversaw': 4, 'gadgetmobil': 8, 'skittl': 4, 'manchest': 18, 'audianc': 2, 'occaision': 3, 'roald': 5, 'schwartzman': 17, 'elw': 4, 'roslyn': 2, 'edison': 51, 'stv': 4, 'magnum': 26, 'forethought': 3, 'tipoff': 1, 'unruli': 9, 'gearhead': 3, 'afro': 26, 'squelch': 2, 'lunar': 7, 'modul': 17, 'transcript': 8, 'discomus': 1, 'giorgio': 12, 'morod': 7, 'gangstermovi': 1, 'ankl': 23, 'boddhist': 1, 'trickeri': 12, 'expressionist': 32, 'sweetheart': 43, 'pajama': 7, 'bambino': 7, 'calend': 4, 'op': 15, 'assin': 1, 'apprehend': 11, 'copper': 22, 'inconsequent': 1, 'elbow': 10, 'unferth': 3, 'omiss': 19, 'pagan': 23, 'zemecki': 15, 'trinket': 4, 'redmon': 4, 'compellingli': 16, 'twiddl': 2, 'vigalondo': 7, 'tightest': 1, 'uniti': 19, 'uel': 10, 'reassur': 26, 'conchata': 5, 'notebook': 21, 'lovitz': 7, 'exp': 2, 'wastrel': 8, 'vex': 6, 'unduli': 6, 'gretorex': 1, 'shill': 8, 'pleasaunc': 1, 'gent': 7, 'extrav': 1, 'chapeaux': 1, 'beaux': 3, 'knowl': 15, 'cedric': 46, 'redoubt': 3, 'bilg': 22, 'mccarthyism': 3, 'monger': 6, 'renounc': 5, 'hogwash': 12, 'forego': 10, 'arin': 2, 'crumley': 1, 'buic': 1, 'undecid': 6, 'nestl': 6, 'dandi': 72, 'raunchili': 2, 'perenni': 23, 'libe': 3, 'jeopardi': 26, 'satisi': 1, 'sturg': 17, 'craftsman': 9, 'pier': 22, 'clift': 7, 'fling': 34, 'hodder': 11, 'vorhe': 5, 'warhol': 60, 'jonestown': 24, 'portland': 5, 'vodaphon': 1, 'trolley': 7, 'shugoro': 5, 'yamamoto': 8, 'ramshackl': 12, 'akria': 1, 'kurasowa': 5, 'criterion': 25, 'kurasow': 1, '33': 33, 'filmic': 28, 'allegor': 20, 'pretagonist': 1, 'nacho': 29, 'marta': 4, 'belengu': 1, 'jockey': 12, 'gauzi': 3, 'petto': 7, 'springtim': 6, 'jani': 13, 'joplin': 7, 'whiz': 16, 'moriar': 3, 'loveliest': 3, 'navel': 7, 'auspic': 3, 'adrienn': 15, 'bernic': 7, 'derogatori': 8, 'pinkerton': 3, 'imbroglio': 2, 'reestablish': 2, 'uncrit': 11, 'jox': 22, 'haldeman': 3, 'heinlein': 11, 'steakley': 1, 'mightiest': 2, 'herakl': 1, 'harryhausen': 8, 'duuum': 1, 'nudg': 18, 'untergang': 10, 'vehement': 8, 'lynchian': 14, 'r18': 1, 'poolman': 3, 'anesthet': 4, 'suderland': 1, 'somesuch': 1, 'manson': 28, 'curb': 16, 'ssp': 1, 'beetleborg': 1, 'kyd': 5, 'bomberg': 1, 'patio': 2, 'flung': 13, 'dino': 33, 'lowel': 15, 'ganz': 9, 'babaloo': 4, 'mandel': 9, 'hornbi': 8, 'gemmel': 1, 'hedg': 16, 'devincenti': 1, 'veer': 37, 'overweight': 31, 'ion': 6, 'dobler': 1, 'unforc': 7, 'chap': 19, 'wring': 15, 'fey': 18, 'lousier': 1, 'smidgen': 5, 'recoveri': 15, 'offto': 1, 'suspensewith': 1, 'morein': 1, 'estherlook': 1, 'todo': 10, 'solik': 1, 'roleoutsid': 1, 'formak': 1, 'begandrop': 1, 'starslik': 1, 'firstrat': 1, 'atth': 3, '25yr': 1, 'zatoichi': 33, 'katsu': 28, 'mamoru': 6, 'oshii': 23, 'tachiguishi': 7, 'quirkier': 2, 'otaku': 12, 'subcultur': 7, 'culinari': 4, 'dai': 2, 'nipponjin': 1, 'superlivem': 2, 'tuck': 17, 'shinji': 7, 'higuchi': 4, 'kenji': 5, 'kawai': 3, 'autom': 4, 'spenni': 7, 'papel': 1, 'undesir': 8, 'franciosa': 11, 'jamrom4': 1, 'heed': 27, 'bellyach': 1, 'creasi': 52, 'pita': 34, 'quinnel': 2, 'flashili': 1, 'coolli': 9, 'dakota': 31, 'radha': 18, 'ticotin': 4, 'giancarlo': 15, 'giannini': 14, 'magick': 7, 'vener': 14, 'hermion': 9, 'bianca': 8, 'queeni': 8, 'holroyd': 6, 'shep': 11, 'steadfast': 5, 'pyewacket': 7, 'darrin': 3, 'unfunniest': 5, 'dresdel': 1, 'supervis': 20, 'lascivi': 16, 'undersid': 5, 'suscept': 7, 'chiefli': 11, 'bannist': 21, 'aquarium': 18, 'joyous': 4, 'wholesal': 7, 'fiendishli': 1, 'maxx': 9, 'kieth': 3, 'skerritt': 10, 'putz': 4, '11th': 29, 'corwardli': 1, 'clifton': 9, 'borderlin': 36, 'wingham': 1, 'familar': 4, 'natal': 3, 'nkosi': 1, 'sikelel': 1, 'iafrika': 1, 'flouresc': 2, 'highschool': 10, 'rohinton': 3, 'mistri': 4, 'nuev': 1, 'reina': 1, 'dresler': 2, 'shrewish': 4, 'flanneri': 8, 'wove': 5, 'evenhanded': 1, 'zealot': 12, 'madden': 18, 'hauteur': 1, 'prose': 14, 'hayse': 4, 'cheesebal': 6, 'skew': 19, 'cinephil': 12, 'openmind': 1, 'dominion': 8, 'bonapart': 3, 'gunship': 1, 'buaku': 4, 'endulg': 1, 'mariachi': 2, 'taqueria': 1, 'testicl': 7, 'ferdinand': 6, 'gottschalk': 5, 'arena': 29, 'refere': 19, 'karn': 6, 'enumer': 4, 'knockdown': 1, 'mchugh': 16, 'tenement': 10, 'breastfe': 2, 'philistin': 4, 'empathis': 13, 'waffl': 12, 'yadda': 26, 'marrow': 11, 'suckingli': 1, 'alani': 3, 'gordano': 1, 'unquench': 2, 'descriptor': 1, 'clench': 11, 'argh': 8, 'darkw': 7, 'harddriv': 1, 'liken': 15, 'hyroglyph': 1, 'picasso': 10, 'woodgrain': 1, 'workmanship': 4, 'sheepskin': 1, 'baloop': 1, 'blueish': 1, 'possiblei': 1, 'galipeau': 11, 'demostr': 2, 'trapper': 8, 'coservationist': 1, 'schepisi': 13, 'rhidian': 2, 'unblemish': 1, 'lakin': 1, 'tgif': 5, 'bop': 16, 'shay': 5, 'berfield': 1, '29th': 3, 'occlud': 1, 'wholesom': 50, 'nathaniel': 7, 'wikipedia': 21, 'omar': 49, 'kristi': 20, 'rappaport': 6, 'ardolino': 6, 'twinkl': 14, 'cusp': 7, 'overstep': 4, 'gracious': 6, 'howz': 3, 'humourless': 13, 'springboard': 6, 'barfli': 3, 'trudg': 14, 'clarissa': 8, 'canton': 3, 'prosthet': 22, 'glo': 5, 'bullsh': 5, 'barbeau': 12, 'tomaselli': 1, 'terrier': 9, 'boozer': 3, 'anonimul': 1, 'danub': 3, 'bucharest': 6, 'mice': 62, 'illogic': 1, 'rearrang': 12, 'pscychosexu': 2, 'meurent': 1, '2047': 1, 'erwin': 9, 'erhardt': 1, 'gala': 2, 'customari': 19, 'sidesplit': 4, 'ditto': 27, 'mechnic': 1, 'cavort': 13, 'horvarth': 1, 'sugerman': 1, 'hotti': 31, 'coyl': 2, 'delect': 17, 'doozi': 11, 'poifect': 1, 'onboard': 5, 'stasi': 6, 'malfunct': 8, 'loleralacartelort7890': 1, 'honeycomb': 3, 'stainless': 3, 'phenol': 1, 'resin': 1, 'ioniz': 1, 'gamma': 3, 'dosimet': 1, 'rem': 1, 'leukemia': 8, 'swigert': 1, 'pancreat': 3, 'roosa': 1, 'intel': 2, 'amberson': 7, 'godaw': 13, 'overdevelop': 2, 'baroqu': 12, 'arkadin': 2, 'inconsequenti': 28, 'traffick': 23, 'classiest': 2, 'upscal': 12, 'quadrupl': 7, 'cheta': 1, 'gourd': 6, 'tolland': 1, '25yo': 2, 'rko': 37, 'doubtless': 18, 'incent': 9, 'nicol': 87, 'pegg': 58, 'prodigi': 24, 'nyt': 1, 'twing': 4, 'slush': 2, 'gh': 1, 'lindstrom': 1, 'gulpilil': 9, 'dreamtim': 2, 'ramif': 10, 'unobtrus': 11, 'bafflement': 3, 'clinch': 7, 'workahol': 11, 'gym': 33, 'workout': 20, 'jiggl': 7, 'paraphernalia': 4, 'kibitz': 3, 'oldish': 2, 'mcclane': 4, 'recrudesc': 1, 'lani': 2, 'thierri': 7, 'belmondo': 7, 'loup': 2, 'dobermann': 3, 'mediat': 5, 'groen': 2, 'futurama': 4, 'guervara': 1, 'ditsi': 13, 'whing': 3, '94': 15, 'defec': 9, 'windscreen': 6, 'delani': 4, 'bravado': 18, 'sadi': 12, 'neptun': 3, 'chauvinist': 16, 'plastici': 1, 'overexpos': 6, 'ratbatspidercrab': 1, 'puppeti': 1, 'residenthazard': 5, 'disingenu': 12, 'fearsom': 10, 'beckinsel': 1, 'midst': 50, 'sheridan': 44, 'carmilla': 16, 'syberia': 1, 'lafontain': 2, 'jingl': 7, 'eyelid': 11, 'sod': 14, 'mismarket': 2, 'toughest': 13, 'crud': 18, 'weasel': 11, 'mazovia': 5, 'outbreak': 32, 'angkor': 5, 'wat': 5, 'armand': 16, 'louqu': 21, 'arci': 6, 'teru': 2, 'shimada': 1, 'buna': 2, 'disscus': 1, 'uni': 9, 'poni': 26, 'handmad': 2, 'undercut': 20, 'beleagu': 11, 'sham': 10, 'radioland': 1, 'flyer': 8, 'redirect': 4, 'soundstag': 13, 'poopi': 3, 'exhal': 5, 'deliri': 56, 'lude': 2, 'imploringli': 1, 'balk': 7, 'puttingli': 1, 'labori': 14, 'prosero': 1, 'unforgiven': 6, 'sourli': 1, 'esai': 11, 'baller': 2, 'depalma': 30, 'newcomb': 35, 'advert': 27, 'treatis': 6, 'commerc': 5, 'evinc': 7, 'jettison': 13, 'spheeri': 1, 'charmingli': 18, 'rona': 4, 'brat': 59, 'straighter': 1, 'flashier': 3, 'tardi': 5, 'frock': 6, 'sauriou': 1, 'warlik': 4, 'kraggartian': 1, 'skinkon': 1, 'cordarabi': 1, 'flagship': 6, 'mcgann': 2, 'learnt': 23, 'shoehorn': 9, 'auton': 2, 'sprang': 4, 'overhaul': 4, 'estabrook': 1, 'dimensionless': 2, 'marsha': 20, 'cinnderella': 1, 'analyt': 9, 'blinker': 5, 'chipper': 5, 'bologna': 2, 'boweri': 13, 'mime': 28, 'bromwel': 8, 'keisha': 4, 'latrina': 2, 'natella': 2, 'earpeirc': 1, 'dragoon': 12, 'dart': 16, 'wingli': 1, 'morphin': 9, 'mordor': 5, 'engl': 17, 'broadest': 3, 'yoakum': 4, 'speck': 7, 'phht': 1, 'coulda': 6, 'spaz': 3, '100yard': 1, 'plusth': 1, 'ariel': 71, 'triton': 16, 'ursula': 46, 'morgana': 35, 'trident': 12, 'rematch': 5, 'sebastien': 4, 'beno': 4, 'poelvoord': 4, 'fancier': 5, 'magritt': 1, 'sprint': 5, 'anwar': 1, 'flawlessli': 24, 'sugest': 2, 'activest': 1, 'posess': 1, 'ghidrah': 3, 'colossu': 3, 'teleprompt': 7, 'tyranasauru': 1, 'ennui': 10, 'feux': 1, 'succo': 5, 'stefano': 5, 'cassetti': 2, 'bret': 22, 'favr': 1, 'headlight': 28, 'carjack': 5, 'isild': 1, 'besco': 2, 'needi': 16, 'schoolgirl': 16, 'obstinaci': 3, 'jeniff': 2, 'rewound': 9, 'drinkin': 3, 'backstag': 28, 'ubber': 1, 'scath': 16, 'bludgeon': 15, 'altmanesqu': 2, 'marian': 8, 'palest': 1, 'tiffani': 22, 'musiqu': 2, 'vainer': 1, 'thomson': 10, 'gazarra': 6, 'effus': 3, 'daffodil': 1, 'delphin': 1, 'seyrig': 1, 'marienbad': 4, 'presbyterian': 6, 'hymn': 6, 'remick': 5, 'hoe': 8, 'frivol': 13, 'impud': 7, 'unhappili': 15, 'supplement': 9, 'leitmotif': 7, 'sweetest': 16, 'zier': 10, 'opportunist': 17, 'aztec': 41, 'shaman': 8, 'further': 12, 'vaudevillian': 10, 'stif': 3, 'lawless': 19, 'distraught': 29, 'nuke': 26, 'larocca': 6, 'paparazzi': 4, 'mercurio': 5, 'hast': 24, 'hateabl': 5, 'gentlemanli': 8, 'roughhous': 2, 'judo': 5, 'macarthur': 98, 'shortchang': 8, 'acompl': 1, 'bigwig': 10, 'sphincter': 2, 'workaday': 2, 'sanctimoni': 17, 'garcea': 2, 'vacanta': 2, 'mugur': 2, 'mih': 2, 'escu': 2, 'doru': 2, 'octavian': 3, 'dumitru': 2, 'dumin': 2, 'ora': 2, 'sase': 2, 'reconstituirea': 2, 'lenght': 6, 'niki': 8, 'ardelean': 6, 'leas': 21, 'dietrichson': 8, 'distractingli': 3, 'neff': 16, 'eggar': 14, 'bochco': 5, 'barnabi': 8, '1894': 5, 'operetta': 7, 'vestig': 4, 'raina': 4, 'wealthiest': 4, 'bulgarian': 10, 'bedraggl': 2, 'torren': 9, 'drainpip': 2, 'hone': 21, 'villier': 1, 'cellan': 1, 'bluntschli': 3, 'switzer': 1, 'tore': 17, 'gunmen': 7, 'ayurved': 3, 'healer': 14, 'wealthier': 2, 'aleopath': 1, 'preacher': 44, 'dall': 6, 'gcse': 5, 'demonis': 3, 'untru': 33, 'remit': 1, 'clenteen': 3, 'mors': 40, 'hutchinson': 7, 'bristol': 12, 'salo': 5, 'dehuman': 13, 'remors': 32, 'catiii': 8, 'mater': 8, 'wilpow': 1, 'hypoth': 2, 'hypothesi': 7, 'courtyard': 14, 'tonnerr': 1, 'epigram': 3, 'limitless': 4, 'labyrinth': 30, 'contemporan': 5, 'toth': 2, 'slipperi': 9, 'chipe': 1, 'dehner': 4, 'millican': 2, 'untim': 23, 'bolder': 2, 'camu': 4, 'cora': 8, 'ember': 1, 'cutter': 58, 'clu': 7, 'gulag': 6, 'smight': 4, 'gulagh': 1, 'milner': 5, 'colbi': 7, 'mcgoohan': 3, 'salmi': 1, 'bruck': 1, 'ferrari': 22, 'merc': 3, 'hummer': 7, 'mutt': 10, 'megalodon': 3, 'unsensation': 1, 'mn': 4, 'hopalong': 16, 'rustler': 5, 'coppola': 42, 'hoppi': 1, 'carridin': 3, 'lovemak': 13, 'priyadarshan': 20, 'kyonki': 1, 'dhavan': 3, 'herapheri': 1, 'malam': 1, 'garam': 11, 'masala': 21, 'londonesqu': 1, 'santel': 2, 'gruver': 3, 'enthus': 6, 'stamo': 14, 'nerdbomb': 1, 'oreo': 5, 'spoilersa': 2, 'overview': 17, 'englund': 43, 'dishearten': 7, 'haaaaaaaaaaaaaarr': 1, 'pantomim': 10, 'transatlant': 2, 'breckin': 9, 'kananga': 1, 'roseann': 14, 'wittili': 4, 'ked': 4, 'instan': 1, 'scallop': 2, 'grovel': 2, 'regroup': 6, 'dodo': 9, 'spoilersin': 2, 'sartr': 7, 'cleanli': 10, 'slobbish': 2, 'norri': 41, '3dvd': 1, 'deke': 5, 'cred': 8, 'xx': 5, 'scalpel': 14, 'piedra': 6, 'invers': 8, 'salazar': 9, 'trajectori': 10, 'cervera': 5, 'adela': 4, 'antonia': 7, 'leir': 4, 'najwa': 3, 'nimri': 3, 'maricarmen': 3, 'centimet': 1, 'busco': 1, 'crimen': 1, 'ferpecto': 1, 'entr': 9, 'vivir': 1, 'sonar': 1, 'hongo': 1, 'sarg': 5, 'booker': 37, 'tujunga': 1, 'oregon': 18, 'trombon': 7, 'duhllywood': 1, 'dui': 1, 'irration': 2, 'doodo': 1, 'mascouri': 1, 'ageless': 6, 'lumley': 5, 'keach': 6, 'ceaseless': 5, 'consent': 25, 'wehrmacht': 3, 'provenc': 2, 'vichi': 1, 'mistral': 2, 'loooonnnnng': 1, 'alonzo': 6, 'bodden': 1, 'leaud': 11, 'ois': 8, 'lebrun': 9, 'cruelest': 2, 'inhibit': 16, 'monogami': 5, 'talkiest': 3, 'audaci': 16, 'forerunn': 11, 'nouvel': 11, 'reverber': 8, 'labrun': 1, 'unbroken': 4, 'lovingli': 34, 'procur': 9, 'lucid': 18, 'pakeezah': 19, 'scratchi': 10, 'dubai': 3, 'meena': 15, 'kumari': 14, 'necessit': 4, 'puriti': 17, 'feelgood': 14, 'peerless': 3, 'ghulam': 6, 'moham': 7, 'incompar': 21, 'lata': 9, 'mangeshkar': 5, 'thare': 1, 'rahiyo': 1, 'wondrous': 2, 'rafi': 2, 'westernis': 2, 'rigueur': 2, 'bhangra': 1, 'tao': 4, 'genesi': 17, 'evangelion': 11, 'kanwar': 3, 'divya': 7, 'bharti': 4, 'rishi': 7, 'chubbi': 27, 'swollen': 4, 'piglet': 3, 'bachchan': 56, 'mithun': 1, 'chakraborti': 1, 'madhuri': 9, 'dixit': 4, 'deepika': 1, 'sneha': 1, 'ullal': 1, 'engrav': 4, 'aamir': 5, 'bazillion': 2, 'grader': 40, 'syllabl': 9, 'deterr': 6, 'lobotomi': 11, 'rayner': 2, 'unfit': 10, 'seldomli': 2, 'haigh': 2, 'sideway': 23, 'brazenli': 5, 'phenomin': 2, 'scorcese': 2, 'bloodlet': 9, 'issei': 1, 'takahashi': 6, 'toru': 6, 'tezuka': 2, 'yudai': 2, 'yamaguchi': 3, 'espresso': 5, 'zu': 40, 'xena': 6, 'misleadingli': 2, 'lesley': 13, 'lem': 4, 'seclus': 4, 'crater': 28, 'residu': 10, 'friendlier': 2, 'dissatisfact': 5, 'jgl': 1, 'reunif': 1, 'pennant': 8, 'omnisci': 5, 'overs': 7, 'boner': 5, 'dk': 1, 'anaheim': 4, 'cinci': 2, '18th': 34, 'mcconaughey': 18, 'tambor': 9, 'julianna': 4, 'lonni': 9, 'zorich': 1, 'carney': 9, 'sheild': 1, 'liza': 33, 'minelli': 13, 'coco': 5, 'lavin': 1, 'kermit': 32, 'rowlf': 3, 'waldorf': 2, 'scooter': 14, 'janic': 18, 'statler': 1, 'beaker': 5, 'fozzi': 4, 'piggi': 22, 'floyd': 25, 'lew': 11, 'goelz': 1, 'zoot': 6, 'beuregard': 1, 'bunsen': 2, 'hunnydew': 1, 'whittemir': 1, 'rational': 10, 'lewinski': 2, 'scorn': 27, 'duper': 6, 'cuaron': 5, 'whelm': 4, 'yasnaya': 1, 'polyana': 1, 'abstin': 3, 'mirren': 15, 'chertkov': 2, 'steward': 12, 'bulgakov': 4, 'mcavoy': 4, 'parini': 1, 'bolshevik': 4, 'ghandi': 8, 'unpick': 1, 'ravel': 2, 'nothing': 17, 'unsurprisingli': 17, 'apprehens': 14, 'lather': 3, 'meagr': 6, 'giammati': 1, 'cipher': 11, 'haim': 29, 'bouzaglo': 12, 'someway': 6, 'synecdoch': 2, 'tempor': 14, 'wowzer': 2, 'thirdspac': 1, 'b5': 6, 'inventor': 28, 'bluf': 2, 'birnley': 4, 'portent': 10, 'hearsay': 4, 'frighteningli': 15, 'macdougal': 4, 'dighton': 2, 'mackendrick': 10, 'tonal': 14, 'adroitli': 3, 'downturn': 3, 'jeani': 14, 'sewane': 1, 'sofa': 13, 'progrmmer': 1, 'teal': 19, 'expiat': 3, 'neis': 2, 'unearth': 19, 'simira': 6, 'ziva': 3, 'rodann': 3, 'superhuman': 18, 'ra': 26, 'tet': 10, 'egyptin': 1, 'numar': 9, 'alvaro': 1, 'guillot': 1, 'farradi': 2, 'prescott': 6, 'babesti': 1, 'cairo': 12, '1902': 6, 'pepin': 3, 'cyber': 18, 'tracker': 13, 'gunfir': 26, 'jewelleri': 2, 'westchest': 3, 'ordinarili': 11, 'breathlessli': 6, 'quibbl': 36, 'embed': 14, 'cashier': 17, 'pocahonta': 2, 'bambi': 17, '1001': 2, 'patt': 1, 'cinemaniak': 1, 'backbon': 27, 'lasset': 2, 'amigo': 10, 'microcosmo': 1, 'flik': 14, 'synchro': 2, 'phoney': 7, 'forefront': 13, 'ranier': 1, 'lan': 20, 'famin': 19, 'locust': 11, 'derrick': 8, 'jarryd': 3, 'madra': 4, 'lazerov': 7, 'ashford': 8, 'wilco': 2, 'dishonor': 11, 'glasgow': 6, 'fleetingli': 5, 'dearli': 16, 'anastasia': 19, 'drizella': 6, 'workload': 3, 'elig': 13, 'macguffin': 4, 'fantas': 16, 'eavesdrop': 3, 'impract': 7, 'indec': 4, 'dubiou': 62, 'zing': 7, 'argentinian': 13, 'gael': 9, 'bernal': 4, 'uppermost': 1, 'agentin': 1, 'valkyri': 8, 'indigen': 13, 'romanticis': 4, 'asthma': 4, 'fatherless': 1, 'soapdish': 11, 'okabasho': 1, 'classless': 5, 'feudal': 14, 'lever': 13, 'farnworth': 2, 'dibnah': 1, 'bromwich': 1, 'bedsit': 1, 'finnish': 29, 'kabare': 1, 'lampela': 2, 'rakastin': 1, 'ep': 10, 'toivoista': 1, 'naista': 1, 'joki': 3, 'jussi': 1, 'donoghugh': 2, 'mondo': 9, 'felin': 16, 'fad': 12, 'hula': 12, 'rootboy': 1, 'telstar': 2, 'anka': 4, 'larain': 3, 'herschel': 21, 'zerelda': 4, 'archangel': 3, 'onscreen': 14, 'pillar': 14, 'unchristian': 1, 'mainstay': 12, 'churchgoer': 1, 'hoitytoity': 1, 'deathb': 17, 'wittenborn': 4, 'mami': 15, 'gummer': 20, 'newport': 7, 'cottag': 16, 'haverford': 1, 'motherhood': 9, 'bisexu': 18, 'entardec': 1, 'eventid': 1, 'kreinbrink': 2, 'exploitist': 1, 'fin': 6, 'unborn': 32, 'novemb': 33, 'jammin': 2, 'jitterbug': 6, 'archi': 31, 'gojn': 1, 'mili': 4, 'silhouett': 26, 'allend': 16, 'evas': 5, 'scandinavian': 13, 'wiggl': 12, 'gaff': 12, 'kfc': 2, 'slavishli': 2, 'flak': 7, 'execr': 25, 'sheik': 8, 'salaam': 11, 'castrol': 1, 'skyscrap': 8, 'landmin': 1, 'tumbler': 3, 'liceman': 4, 'iggi': 1, 'writh': 24, 'poston': 3, 'fireman': 10, 'cleanup': 2, 'viabil': 2, 'debri': 13, 'firemen': 21, 'ignorantli': 7, 'val': 46, 'rehuman': 1, 'ofsocieti': 1, 'downtrodden': 13, 'glimmer': 24, 'demonin': 1, 'fangirl': 4, 'camui': 2, 'thundercat': 2, 'stench': 11, 'disburs': 1, 'wayland': 4, 'swindler': 6, 'halliwel': 1, 'atley': 1, 'astricki': 1, 'chi': 14, 'mcbrde': 1, 'castlebeck': 1, 'drycoff': 1, 'commot': 4, 'indescib': 1, 'fawn': 13, 'sleazebal': 4, 'tashi': 2, 'philanthrop': 2, 'hagerthi': 3, 'honolulu': 2, 'macra': 3, 'bariton': 6, 'wyman': 2, 'bedsid': 10, 'starlift': 7, 'biller': 1, 'kitross': 1, 'osborn': 11, 'contractu': 13, 'extol': 6, 'sparsest': 1, 'flail': 14, 'delorean': 1, 'flux': 7, 'capacitor': 1, 'mishandl': 12, 'rewatch': 22, 'iconoclast': 7, 'coz': 13, 'watsoev': 1, 'inborn': 1, 'convinced': 1, 'wicked': 5, 'megan': 30, 'kosovo': 6, 'momsen': 14, 'metaldud': 1, 'corpsifi': 1, 'crue': 3, 'retch': 5, '10www': 2, 'hazel': 25, 'cass': 7, 'barti': 6, 'silla': 1, 'trowel': 3, 'zap': 18, 'cherryr': 1, 'htm': 4, 'prowess': 23, 'impart': 15, 'gleefulli': 21, 'ardh': 6, 'satya': 10, 'dilip': 2, 'chitr': 2, 'pald': 2, 'mein': 10, 'napunsaktha': 1, 'doosr': 1, 'paurush': 1, 'aur': 8, 'teek': 1, 'tarazu': 1, 'kaant': 2, 'needl': 36, 'smita': 9, 'patil': 8, 'om': 30, 'puri': 29, 'restur': 1, 'ricci': 22, 'std': 4, 'loincloth': 8, 'siani': 2, 'glickenhau': 5, 'philippin': 24, 'filipino': 20, 'argo': 2, 'kuryakin': 2, 'thrush': 5, 'copter': 6, 'bole': 3, 'seawat': 2, 'lom': 2, 'curt': 11, 'jurgen': 9, 'darbi': 5, 'whisk': 22, 'flint': 7, 'oc': 9, 'cile': 6, 'sidelin': 18, 'remarri': 14, 'spoilersit': 1, 'couleur': 6, 'thigpen': 3, 'stairway': 23, 'niven': 58, 'liveliest': 2, 'mariu': 12, 'unreport': 3, 'oversight': 11, 'garish': 21, 'emer': 4, 'pressburg': 18, 'leev': 4, 'frasier': 9, 'loggia': 24, 'herrmann': 7, 'lifeforc': 7, 'shadix': 2, 'charmer': 13, 'dchen': 6, 'picken': 3, 'clovi': 15, 'dolenz': 1, 'yummi': 17, 'cob': 6, 'protrud': 2, 'pencil': 21, 'picket': 7, 'landi': 22, 'maximimum': 1, 'hipotet': 1, 'hipocresi': 1, 'segun': 1, 'coster': 1, 'sellout': 4, 'frostbit': 1, 'margaux': 10, 'bancroft': 12, 'sow': 13, 'schapel': 1, 'corbi': 4, 'indonesia': 8, 'moist': 7, 'outlay': 2, 'indefens': 2, 'gorga': 1, 'rake': 14, 'reban': 9, 'gutless': 4, 'tudor': 15, 'chirila': 6, 'marano': 1, 'jacquelin': 12, 'magnanim': 3, 'yon': 3, 'francin': 11, 'grue': 1, 'yawk': 3, 'doth': 2, 'clergi': 6, 'chump': 10, 'oxford': 13, 'overexcit': 1, 'lowensohn': 2, 'coverbox': 1, 'plato': 15, 'damm': 89, 'spontani': 1, 'outag': 4, 'sabertooth': 13, 'maul': 8, 'beasti': 7, 'plush': 10, 'googli': 3, 'besot': 12, 'nooki': 3, 'bulb': 26, 'tuition': 7, 'primros': 1, 'steamship': 3, 'strumpet': 3, 'appet': 8, 'traditionalist': 6, 'ro': 6, 'gopher': 3, 'pooh': 3, 'jughead': 1, 'beetl': 51, 'abras': 14, 'marg': 7, 'thorsen': 3, 'rhee': 1, 'fnnish': 1, 'frenchmen': 5, 'scarlet': 49, 'myopic': 5, 'ratatouil': 2, 'tingl': 14, 'char': 14, '9of10': 1, 'underbelli': 21, 'neuromanc': 1, 'infrastructur': 3, 'bartlebi': 4, 'scriven': 1, '1850': 6, 'scofield': 3, 'scarecreow': 1, 'wah': 6, 'dalarna': 1, 'cotten': 13, 'whet': 5, 'globalis': 2, 'halliburton': 4, 'saran': 1, 'wateri': 12, 'pulpit': 3, 'imposit': 4, 'bluenos': 1, 'sensuous': 2, 'coquettish': 3, 'guileless': 2, 'egalitarian': 5, 'hangup': 2, 'portabl': 9, 'lamplit': 1, 'prurienc': 1, 'seminarian': 2, 'poncho': 3, 'foliag': 7, 'whenc': 6, 'joie': 8, 'vivr': 8, 'breakdanc': 15, 'hiphop': 5, 'mic': 13, 'animat': 2, 'dichen': 2, 'lachman': 2, 'ayacoatl': 2, 'populac': 20, 'lenin': 5, 'sai': 10, 'quoi': 2, 'businessmen': 16, 'rabbl': 7, 'smurfett': 1, 'cocain': 46, 'snort': 20, 'intak': 5, 'ungrat': 11, 'tiananmen': 2, 'klick': 2, 'sabu': 37, 'bellocchio': 2, 'mafiosi': 4, 'unperturb': 2, 'giullia': 3, 'muster': 30, 'unquiet': 2, 'upatz': 1, 'marushka': 1, 'detmar': 2, 'hippo': 6, 'gazel': 4, 'pialat': 7, 'gueul': 2, 'ouvert': 1, 'amour': 18, 'loulou': 7, 'rugbi': 6, 'inexpress': 7, 'restart': 10, 'foudr': 1, 'boreanaz': 13, 'lanc': 63, 'valenteen': 1, 'glamoris': 2, 'shoplift': 5, 'funhous': 12, 'esthet': 9, 'iwuetdid': 1, 'parasit': 39, 'mcgarten': 1, 'cormack': 2, 'desireless': 1, 'sergent': 3, 'proudest': 1, 'matriach': 1, 'wellingtonian': 1, 'akerston': 1, 'sausag': 10, 'rima': 2, 'wiata': 1, 'blackberri': 2, 'sorbet': 1, 'despar': 1, 'balm': 4, 'electrician': 10, 'lyn': 4, 'dorday': 1, 'tart': 15, 'tooltim': 1, 'narcisst': 2, 'bun': 7, 'bonfir': 9, 'thud': 11, 'rous': 46, 'geraldo': 4, 'rivera': 7, 'pompos': 4, 'irr': 3, 'versibl': 3, 'zola': 5, 'ermey': 2, 'leto': 3, 'wiper': 4, 'clavier': 12, 'poir': 10, 'chazel': 2, 'bujeau': 2, 'gialli': 14, 'undisput': 16, 'dello': 5, 'pistilli': 5, 'alberto': 17, 'mendoza': 2, 'athen': 10, 'hock': 6, 'grapewin': 6, 'trotter': 6, 'frawley': 11, 'bertram': 3, 'indefin': 3, 'squabbl': 14, 'hypercub': 7, 'flippin': 5, 'starfuck': 2, 'starstruck': 5, 'burlesk': 2, 'raci': 17, 'sashay': 2, 'enoy': 1, 'funnni': 1, 'teem': 6, 'unsatisfactori': 14, 'navajo': 3, 'ky': 4, 'pinetre': 1, 'appaerantli': 1, 'deton': 14, 'shank': 12, 'jaffa': 11, 'aaaarrgh': 1, 'couldnt': 7, 'shoudln': 1, 'recomend': 13, 'scarciti': 5, 'phibe': 6, 'harshli': 13, 'egger': 1, 'stanwick': 2, 'noonan': 11, 'leavitt': 2, 'deano': 1, 'bakk': 1, 'selena': 1, 'coomb': 3, 'collus': 4, 'burgeon': 15, 'wonderland': 61, 'aberr': 6, 'kilmer': 40, 'ruffin': 2, 'imaginit': 1, 'garth': 11, 'merengi': 1, 'bollock': 1, 'handgun': 11, 'holster': 3, 'seasick': 5, 'dustbin': 8, 'uninstruct': 1, 'astrolog': 3, 'marlen': 35, 'deitrich': 1, 'mmmm': 4, 'breakup': 18, 'undynam': 1, 'jonah': 10, 'inert': 15, 'foregon': 6, 'oath': 12, 'starbuck': 11, 'embalm': 4, 'maritim': 1, 'kolchak': 78, 'windi': 6, 'macgavin': 1, 'capano': 11, 'unambiti': 1, 'uninhabit': 2, 'vest': 16, 'siberian': 7, 'finnegan': 3, 'accru': 5, 'clime': 4, 'lavishli': 1, 'indochin': 4, 'klebold': 3, 'machineri': 28, 'hhe2': 3, 'hhe1': 2, 'hhe': 1, 'becker': 11, 'binocular': 17, 'earshot': 3, 'pedigre': 15, 'girlhood': 2, 'transmogrifi': 1, 'inebriationit': 1, 'totem': 6, 'colourless': 9, 'kimbal': 2, 'hiatu': 9, 'unpromis': 4, '1927': 17, 'staid': 9, 'arlett': 2, 'marchal': 2, 'dupont': 6, 'predatori': 12, 'haldan': 3, 'truax': 2, 'demograph': 32, 'someplac': 18, 'mockingbird': 8, 'sondhemim': 1, 'storygot': 1, 'giddili': 7, 'headli': 7, 'cb4': 10, 'cundieff': 5, 'bangvil': 1, 'normand': 5, 'banquo': 1, 'elsen': 1, 'sirti': 6, 'beo': 2, 'fisherman': 23, 'spookfest': 1, 'stargaz': 2, 'whitlock': 4, 'nandjiwarra': 2, 'amagula': 4, 'wain': 2, 'didgeridoo': 1, 'indict': 20, 'tomo': 1, 'akiyama': 1, 'keko': 4, 'superheroin': 3, 'numbl': 1, 'pubic': 5, 'gibney': 4, 'pfiefer': 2, 'midwest': 12, 'getgo': 1, 'welk': 2, 'rearveiw': 1, 'digicorp': 21, 'thursbi': 11, 'spokesmen': 1, 'topsi': 2, 'turvi': 2, 'dagger': 32, 'trivil': 2, 'takeshi': 5, 'skipabl': 1, 'ifc': 11, 'gitmo': 1, 'walnut': 3, 'mousi': 10, 'oceanfront': 1, 'burguess': 1, 'mil': 9, 'nube': 1, 'hernandez': 18, 'commodif': 1, 'graciou': 9, 'whoosh': 5, 'vicodin': 2, 'handwrit': 6, 'hairlin': 4, 'hahaha': 13, 'willow': 12, 'ahhh': 5, 'crone': 9, 'tavern': 19, 'wench': 12, 'lusti': 12, 'sculleri': 3, 'greensward': 1, 'rowen': 1, 'widen': 11, 'mwah': 2, 'schoolroom': 2, 'unappeal': 1, 'unison': 4, 'phallic': 15, 'hallo': 2, 'ow': 8, 'summersisl': 11, 'aaaaah': 1, 'goddammit': 4, 'thorazin': 2, 'supercili': 4, 'weightwatch': 1, 'eeee': 2, 'xs': 1, 'beahan': 2, 'goddamn': 10, 'aaah': 1, 'hurtl': 7, 'fireproof': 1, 'volptuou': 1, 'eeeee': 1, 'yellowish': 1, 'sepia': 15, 'anarchist': 5, 'czarist': 4, 'poalher': 2, 'sigourney': 14, 'vicin': 7, 'manoj': 18, 'agraw': 2, 'pardesi': 1, 'babu': 11, 'filmth': 3, 'ranih': 1, 'sardarji': 1, 'maharashtrian': 1, 'okayamongst': 3, 'thatz': 1, 'nirmal': 2, 'pandey': 10, 'tinnu': 1, 'anand': 18, 'satish': 2, 'kaushik': 2, 'paresh': 26, 'tanaaz': 1, 'greec': 23, '5yo': 1, 'mouriki': 1, 'lambropoul': 1, 'hatzisavva': 2, 'marishka': 2, 'wisp': 5, 'buggi': 17, 'isbn': 2, 'dur': 2, '1830': 5, 'mammi': 12, 'magna': 4, 'shnieder': 1, 'hoven': 1, 'rhett': 1, '03': 7, 'ada': 29, 'lovelac': 8, 'pseudosci': 5, 'hershman': 1, 'leeson': 2, 'glom': 2, 'coer': 1, 'winsor': 3, 'mccay': 2, 'nemo': 17, 'ladislaw': 1, 'starewicz': 11, 'frogland': 1, '1922': 27, 'stopper': 8, 'jabber': 5, 'excitedli': 3, 'rabi': 13, 'froth': 5, 'pataki': 8, 'ratman': 1, 'wincott': 11, 'peacekeep': 2, 'brigitt': 24, 'matthia': 8, 'suceed': 1, 'nurseri': 15, 'coolish': 1, 'callahan': 35, 'bestow': 12, 'bulldog': 18, 'coastal': 22, 'paulo': 15, 'luridli': 3, 'framework': 31, '44': 22, 'automag': 1, 'excitingli': 5, 'lalo': 3, 'schfrin': 1, 'surte': 7, 'steeli': 11, 'sondra': 52, 'senselessli': 6, 'glassili': 1, 'audri': 7, 'neenan': 6, 'scummi': 6, 'dillman': 8, 'agreeabl': 11, 'popwel': 5, 'joaquin': 9, 'jinx': 12, 'mikey': 5, 'leoni': 8, 'tang': 14, 'powerglov': 3, 'loosest': 6, 'vocat': 5, 'braincel': 4, 'ocd': 2, 'retent': 8, 'suppl': 3, 'sisto': 7, 'kasdan': 17, 'balboa': 2, 'zasu': 2, 'arbuckl': 11, 'fyi': 8, 'sasquatch': 39, 'abominib': 1, 'saterday': 2, 'touchdown': 4, 'playoff': 5, 'unders': 1, 'kicker': 17, '6000': 3, 'infertil': 4, 'apostl': 3, 'extraterrestri': 9, 'dysney': 1, 'toaster': 9, 'rejuven': 14, 'elfman': 9, 'vinci': 13, 'puh': 8, 'landmass': 1, 'mahogani': 5, 'ptsd': 5, 'organz': 1, 'despot': 10, 'bureacraci': 2, 'suraj': 5, 'barjatya': 20, 'rajshre': 2, 'albani': 2, 'renn': 8, 'hounfor': 1, 'insupport': 1, 'fightfest': 2, 'grieco': 20, 'ming': 25, 'merciless': 22, 'ferryman': 3, 'laplanch': 1, 'sop': 3, 'hereaft': 5, 'chasten': 5, 'ulmer': 5, 'faust': 11, 'flirtati': 17, 'ta': 47, 'midterm': 1, 'stabl': 33, 'everlast': 14, 'woulnd': 1, 'bahumbag': 1, 'infight': 5, 'spotti': 11, 'unevenli': 5, 'bashki': 7, 'tourett': 3, 'hobbit': 26, 'frodo': 26, 'baggin': 2, 'rosenman': 4, 'samwis': 3, 'legola': 6, 'ringwraith': 5, 'saruman': 6, 'aruman': 5, 'wile': 6, 'incertitud': 1, 'temptress': 10, 'inconst': 3, 'casnoff': 2, 'administ': 8, 'grifasi': 1, 'enraptur': 8, 'inamorata': 1, 'kasnoff': 1, 'lovebird': 8, 'uninvent': 5, 'fremantl': 3, 'lustreless': 1, 'neath': 1, 'seductress': 13, 'swimmer': 15, 'halop': 2, 'glean': 12, 'vo': 3, 'smarmiess': 1, 'labut': 14, 'mumu': 2, 'scorces': 22, 'dang': 11, 'leele': 1, 'sobieski': 1, 'epilogu': 23, 'kibbe': 12, 'marvin': 43, 'enlarg': 10, 'eject': 16, 'truss': 4, 'rafter': 6, 'vanquish': 10, 'benton': 14, 'nora': 46, 'ephron': 4, 'celin': 37, 'kon': 3, 'tiki': 4, 'unkempt': 8, 'roughshod': 3, 'dome': 19, 'frosti': 24, 'mochcinno': 3, 'moxi': 10, 'unwash': 11, 'plethora': 22, 'canist': 7, 'aqua': 6, 'velva': 3, 'unceremoni': 12, 'unmed': 3, 'schizophrenia': 12, 'cbtl': 2, 'gila': 2, 'swill': 11, 'hokier': 1, 'cheesier': 7, 'carno': 1, 'polchek': 1, 'broson': 1, 'bullfight': 14, 'disagr': 19, 'mural': 5, 'neurolog': 4, 'neuron': 4, '20yr': 1, 'papillon': 4, 'guillotin': 21, 'aristo': 1, '1794': 1, 'keester': 2, 'santini': 2, 'assesd': 1, 'bakersfeild': 1, 'truley': 1, 'peed': 7, 'railli': 19, 'goin': 20, 'sayer': 4, 'unrequit': 9, 'darin': 2, 'getz': 4, 'ipanema': 1, 'synergi': 7, 'magneto': 2, 'xavier': 7, 'xmen': 2, 'wolverin': 35, 'sabretooth': 40, 'bersek': 1, 'x2': 5, 'stryker': 5, 'dej': 1, 'adamantium': 3, 'loweri': 10, 'girdl': 3, 'batmobil': 14, 'pouch': 2, 'cowl': 5, 'flopsi': 2, 'mopsi': 4, 'batlik': 1, 'counterfiet': 1, 'flammabl': 2, 'careen': 6, 'despict': 1, 'modifi': 18, 'penitentiari': 8, 'rald': 6, 'laroch': 7, 'laudenbach': 7, 'querett': 10, 'rataud': 7, 'cornillac': 7, 'mal': 24, 'fiqu': 19, 'jeu': 3, 'belphegor': 1, 'sinai': 1, 'dracht': 2, 'poehler': 14, 'clinton': 25, 'arcadia': 2, 'soppi': 10, 'actreesess': 1, 'ewan': 32, 'mcgregor': 30, 'sacchi': 2, 'colgat': 2, 'whiten': 1, 'nymph': 18, 'gingiv': 1, 'rash': 14, 'tcp': 1, 'baaaaaad': 2, 'meanest': 8, 'sulk': 12, 'thee': 20, 'hutson': 6, 'xplanat': 1, 'petrol': 10, 'slappin': 1, 'endeth': 3, 'minnelli': 58, 'hobson': 18, 'spermikin': 1, 'miscarriag': 16, 'foetu': 6, 'insemin': 2, 'womb': 6, 'subotski': 1, 'pavillion': 2, 'hander': 2, 'gaiman': 17, 'mirrormask': 3, 'tristran': 1, 'faeri': 7, 'diaz': 40, 'gaslight': 4, 'edinburgh': 23, 'gogo': 3, 'dau': 4, 'undertaken': 4, 'necronomicon': 6, 'getr': 2, 'umt': 2, 'nden': 2, 'vampiro': 5, 'lesbo': 11, 'cultish': 5, 'cucumb': 4, 'vampyro': 2, 'reynaud': 6, 'culti': 2, 'flamingo': 8, 'pecker': 46, 'harken': 7, 'polyest': 14, 'kali': 26, 'mata': 9, 'durga': 3, 'smashan': 1, 'maa': 5, 'santeria': 1, 'vodou': 1, 'stifler': 25, 'ap': 7, 'levenstein': 3, 'trey': 26, 'airman': 3, 'townsel': 1, 'arganaut': 1, 'squeak': 11, 'francophon': 1, 'prism': 2, 'colonis': 4, 'moribund': 3, 'cameroon': 14, 'cyberpunk': 7, 'hench': 1, 'everlovin': 1, 'runyon': 13, 'lemondrop': 1, 'grandeur': 27, 'insouci': 3, 'carat': 2, 'xvi': 2, 'fisheri': 1, 'deathli': 13, 'garber': 9, 'shipbuild': 2, 'undersea': 6, 'motionless': 9, 'sunken': 14, 'southampton': 5, 'decaprio': 2, 'collis': 19, 'upgerard': 1, 'shiftless': 2, 'tomeaning': 1, 'apathet': 15, 'offon': 5, 'orperhap': 1, 'gotsecret': 1, 'hisdeath': 1, 'garard': 1, 'sbasic': 1, 'intelligentpsycholog': 1, 'yankov': 6, 'compleat': 3, 'parodist': 1, 'lightli': 35, 'kata': 4, 'dob': 5, 'dakar': 14, 'assuag': 2, 'undi': 27, 'lwr': 4, 'caldicott': 1, 'x5': 2, 'lisbon': 6, 'toughen': 2, 'epo': 5, 'pavey': 1, 'crossword': 7, 'taco': 6, 'harlem': 35, 'insul': 5, 'enclav': 1, 'unspectacular': 5, 'schwarznegg': 1, 'whitney': 12, 'habil': 1, 'unscrupul': 22, 'shortliv': 1, 'cavemen': 28, 'geico': 11, 'sucki': 8, 'committe': 27, 'subterranean': 9, 'prosaic': 12, 'drearili': 5, 'varhola': 1, 'skirmish': 6, 'burlap': 2, 'yumiko': 1, 'shaku': 1, 'unpolit': 2, 'muldar': 1, 'marvik': 1, 'spurn': 11, 'medusan': 7, 'ambassador': 20, 'phaser': 1, 'limbo': 17, 'beetch': 2, 'adrift': 9, 'broach': 6, 'airlock': 1, 'minton': 12, 'disloy': 1, 'thooughli': 1, 'filmabl': 3, 'dalloway': 4, 'disloyalti': 2, 'innsbruck': 1, 'oppressor': 12, 'unpunish': 3, 'girli': 23, 'nikla': 3, 'nyqvist': 11, 'bracelet': 10, 'hictcock': 1, 'aberystwyth': 1, 'despaaaaaair': 1, 'caveman': 19, 'byington': 6, 'jargon': 12, 'fuckwood': 1, 'seberg': 29, 'myl': 2, 'demongeot': 4, 'kerr': 33, 'sunnier': 2, 'rinal': 1, 'laurent': 5, 'martita': 1, 'sado': 11, 'interconnect': 15, 'badland': 6, 'moneymak': 4, 'forecast': 4, 'jupit': 7, 'rothschild': 5, 'co2': 2, 'voluntarili': 5, 'pickford': 68, 'illegitim': 12, 'redo': 7, 'plainli': 21, 'hersholt': 7, 'lett': 2, 'cuddl': 11, 'italiana': 1, 'wai': 35, 'fendiando': 1, 'cinecitta': 1, 'fod': 3, 'quella': 1, 'sporca': 1, 'storia': 1, 'nel': 7, 'crucifixion': 10, 'populist': 11, 'guliano': 1, 'gemma': 7, 'egoist': 3, 'manco': 1, 'uomo': 2, 'chuncho': 1, 'qui': 1, 'sabe': 1, 'pueblo': 2, 'almeria': 2, 'romolo': 2, 'guerriri': 1, 'absurdli': 24, 'django': 13, 'faccia': 2, 'juxtaposit': 19, 'stealthi': 2, 'debitag': 1, 'cruse': 1, 'potteri': 2, 'molder': 2, 'mymovi': 3, '21849907averag': 1, '21849889for': 1, '21849890': 1, 'threshold': 16, 'starsmadhvi': 1, 'expo': 3, 'p3': 2, 'noncommerci': 1, 'mridul': 7, 'madhvi': 5, 'stork': 4, 'eleni': 1, 'karaindr': 1, 'emerald': 6, 'arvan': 3, 'socio': 18, 'balkan': 18, 'ancestr': 5, 'discours': 17, 'hellen': 2, 'dantesqu': 1, 'telemachu': 3, 'orat': 5, 'ithaca': 2, 'linesmen': 2, 'byzantin': 1, 'stylit': 1, 'abod': 6, 'ascetic': 1, 'madli': 30, 'alpert': 2, 'sayid': 2, 'jarrah': 1, 'sawyer': 13, 'faraday': 1, 'jin': 7, 'asshat': 1, 'eko': 1, 'discredit': 23, 'wi': 4, 'seftel': 8, 'insultingli': 16, 'fatten': 1, 'eattheblind': 1, 'ransom': 29, 'chisel': 9, 'takingli': 4, 'darwin': 9, 'swoozi': 4, 'kurtz': 8, 'jokingli': 7, 'idiosyncrat': 18, 'wryness': 1, 'whoop': 15, 'crust': 14, 'abracadabrantesqu': 1, 'mandat': 8, 'doctoress': 1, 'fusion': 9, 'pollak': 18, 'provinci': 15, 'humblest': 2, 'fairer': 2, 'mcfli': 3, 'dada': 3, 'freakshow': 1, 'parfrey': 1, 'grasshopp': 26, 'swaztika': 2, 'unplan': 3, 'raf': 10, 'supertext': 1, 'courier': 9, 'guffaw': 15, 'nan': 13, 'pragmat': 10, 'perch': 8, '6200': 1, 'ft': 15, 'taho': 6, 'clemen': 6, 'twain': 15, 'hearst': 16, 'mackay': 2, '1860': 7, 'boomtown': 3, 'duello': 1, 'irbi': 3, 'shipment': 15, 'bullion': 3, 'vc': 1, 'miriam': 15, 'hayn': 5, 'bulett': 2, 'shoulda': 6, 'proflig': 2, 'artemi': 1, 'tong': 8, 'seep': 13, 'moze': 1, 'kor': 17, 'mengel': 1, 'auschwitz': 10, 'monder': 1, 'nectar': 1, 'ined': 1, 'sami': 1, 'advan': 1, 'bethlehem': 2, 'perma': 2, 'beastli': 7, 'heinou': 20, 'sicki': 4, 'unholi': 15, 'goldfield': 1, 'superfluo': 1, 'sluttish': 6, 'lunkhead': 6, 'dogear': 1, 'yucki': 4, 'nunchuck': 2, 'permiss': 31, 'ostentati': 4, 'palpit': 1, 'yah': 3, 'bulki': 7, 'thoughtless': 13, 'braddock': 2, 'pinocchio': 6, 'blander': 3, 'rasp': 3, 'mortensen': 32, 'squir': 19, 'fingertip': 5, 'oak': 11, 'wizardi': 1, 'mckellen': 5, 'presen': 1, 'nazgul': 6, 'rohan': 2, 'howerv': 1, 'halfl': 1, 'kont': 1, 'theoden': 1, 'elrond': 2, 'smeagol': 1, 'balrog': 5, 'hobbitslord': 1, 'embeth': 9, 'davidtz': 9, 'harrold': 11, 'spunk': 11, 'avatar': 8, 'clobber': 4, 'malform': 4, 'prudish': 14, 'uneth': 8, 'warmli': 14, 'unprocess': 1, 'eggert': 8, 'humong': 8, 'gilson': 6, 'searcher': 11, 'alpin': 2, 'skier': 4, 'damiano': 1, 'damiani': 2, 'hamish': 4, 'beaton': 15, 'constabl': 14, 'byne': 11, 'bubon': 9, 'inocul': 6, 'epidemiologist': 1, 'investigatori': 2, 'blackout': 15, 'barbera': 12, 'bel': 24, 'geddi': 2, 'skelet': 9, 'athletic': 9, 'reasembl': 1, 'responsibilti': 1, 'lembach': 9, 'kopin': 8, 'elmor': 9, 'frankenheim': 12, 'councilwoman': 1, 'upstand': 3, 'squalor': 19, 'cranni': 3, 'scheider': 18, 'uebermensch': 1, 'discrib': 1, 'sso': 1, 'misir': 1, 'georgian': 10, 'georgi': 11, 'danelia': 14, 'goryuy': 3, 'tillier': 1, '1801': 1, '1844': 1, 'oncl': 1, 'manett': 1, 'grusiya': 2, 'wachtang': 1, 'kikabidz': 2, 'mimino': 2, 'levan': 1, 'federico': 4, 'leonid': 1, 'gaiday': 1, 'paraszhanov': 1, 'sovsem': 2, 'propashchiy': 2, 'amrarcord': 1, 'tragicomedi': 5, 'seryozha': 2, 'huckleberri': 2, 'shagayu': 1, 'moskv': 1, 'afonya': 1, 'osenniy': 1, 'marafon': 1, 'autumn': 20, 'dza': 2, 'lind': 4, 'recollect': 32, 'endow': 28, 'morrison': 12, 'salton': 1, 'launiu': 5, 'splenda': 1, 'twitchi': 6, 'sharif': 23, 'bum': 55, 'gild': 5, 'jaunti': 5, 'percol': 4, 'muzak': 2, 'sahara': 6, 'camel': 26, 'wili': 13, 'genii': 3, 'ineptli': 20, 'synonym': 18, 'clearcut': 1, 'healthili': 2, 'neuros': 10, 'antithet': 2, 'winchest': 67, 'visualis': 2, 'outgrown': 5, 'weoponri': 1, 'undifferenti': 2, 'fiance': 9, 'defraud': 2, 'proven': 15, 'custer': 19, 'extremi': 4, 'dickey': 9, 'aintri': 2, 'bereft': 11, 'baranski': 5, 'whovier': 2, 'carreyesqu': 1, 'dumont': 4, 'twentynin': 1, 'empower': 13, 'splat': 7, 'talia': 15, 'lugaci': 3, 'undergradu': 7, 'boatload': 6, 'hormon': 27, 'rockarol': 1, 'eliza': 15, 'spiv': 5, 'blackmarket': 2, 'lawson': 10, 'whiff': 12, 'tijuana': 2, 'anh': 2, 'purer': 2, 'ellipt': 7, 'carax': 8, 'icki': 12, 'heckl': 8, 'yugi': 3, 'atem': 1, 'yami': 3, 'seto': 1, 'kaiba': 1, 'leez': 4, 'abridg': 12, 'littlekuriboh': 1, 'darryl': 26, 'mork': 8, 'blacksmith': 4, 'jerker': 19, 'bragana': 8, 'giusepp': 9, 'mayweath': 5, 'haywood': 2, 'gosl': 5, 'rodney': 41, 'dangerfield': 23, 'bifff': 1, 'brussel': 4, 'martel': 9, 'nitwit': 9, 'vonbraun': 1, 'sexo': 11, 'pudor': 1, 'lagrima': 1, 'dionn': 1, 'marionett': 6, 'izat': 1, '1892': 3, 'alexi': 20, 'pugilist': 5, 'egomaniac': 8, 'stupifyingli': 1, '12383499143743701': 1, 'uhf': 7, 'deux': 11, 'spacewalk': 1, 'halliday': 3, 'marshmorton': 3, 'manor': 30, 'kegg': 7, 'wodehous': 28, 'publicist': 15, 'twirl': 11, 'decker': 4, 'groener': 2, 'rotat': 23, 'repetiti': 15, 'croon': 13, 'indebt': 4, 'ff': 6, 'dementia': 13, 'tnt': 11, 'buzaglo': 4, 'stakeout': 2, 'ensconc': 6, 'unreli': 5, 'filmomet': 1, 'lambert': 28, '60ti': 1, 'glacial': 11, 'burglari': 7, 'glint': 3, 'statut': 5, 'miya': 16, 'wuhrer': 16, 'freshmen': 8, 'kristoff': 2, 'myia': 1, 'deflow': 6, 'trucker': 8, 'plow': 4, 'unattend': 2, 'holdup': 2, 'boutiqu': 2, 'myri': 1, 'colbet': 1, 'martyn': 1, 'tray': 9, 'melin': 1, 'bartha': 4, 'kiesch': 1, 'nobel': 16, 'buffer': 5, 'baloi': 1, 'bedchamb': 8, 'warwick': 10, 'shauvian': 1, 'aymler': 1, 'inquisitor': 2, 'stogumb': 1, 'dauphin': 10, 'dipasqual': 2, 'libertini': 1, 'undivid': 3, 'xizao': 2, 'jelaousi': 1, 'looooooong': 1, 'homeward': 20, 'thingi': 12, 'eurovis': 9, 'hella': 3, 'inconceiv': 13, 'tandem': 11, 'eardrum': 4, 'pimpl': 6, 'smog': 6, 'rottentomato': 3, 'fleapit': 2, 'riba': 4, 'passport': 18, 'communion': 9, 'stalin': 17, 'remembr': 8, 'badmouth': 3, 'burliest': 1, 'dion': 5, 'wellb': 1, 'knuckler': 2, 'nikhil': 14, 'advani': 16, 'kal': 7, 'karan': 2, 'johar': 5, 'cursorili': 1, 'linkag': 4, 'ayesha': 6, 'takia': 5, 'neater': 1, 'juhe': 4, 'ayesh': 1, 'vidya': 7, 'balan': 6, 'bhagam': 1, 'bhag': 1, 'unpardon': 1, 'rakhi': 2, 'sawant': 2, 'esra': 1, 'pata': 1, 'nahin': 2, 'sovi': 1, 'indirectli': 22, 'govt': 7, 'keath': 1, 'overdrawn': 5, 'daysthi': 1, 'bonnevil': 1, 'shakingli': 1, 'univer': 1, 'sudser': 1, 'portrayl': 1, 'nympho': 4, 'progeni': 6, 'colburn': 1, 'scuba': 9, 'finlett': 1, 'saner': 1, 'nokitofa': 1, 'schygulla': 14, 'klau': 17, 'lowitsch': 1, 'scuffl': 10, 'desni': 2, 'lilo': 6, 'pempeit': 1, 'frau': 3, 'ehmk': 1, 'hildegard': 5, 'knef': 6, 'hildi': 1, 'ossi': 8, 'inaud': 9, 'irishman': 11, 'outback': 8, 'temecula': 2, 'priestley': 8, 'elkjaer': 1, 'laudrup': 1, 'francescoli': 1, 'uruguay': 3, 'platini': 1, 'linek': 3, 'rummenigg': 1, 'butragu': 1, 'socrat': 2, 'abovement': 1, 'katrina': 4, 'polygami': 6, 'centerpiec': 15, 'donlevi': 7, 'darwel': 2, 'darnel': 5, 'zina': 1, 'mme': 5, 'meyler': 1, 'debutant': 11, 'dubiel': 1, 'overcaut': 1, 'discret': 11, 'duran': 11, 'rahad': 1, 'paradiso': 6, 'smartli': 15, 'bracho': 2, 'thinkfilm': 1, 'surpr': 1, 'althogh': 1, 'sanka': 2, 'statham': 19, 'pussi': 20, 'carolyn': 4, 'scarri': 1, 'berrymor': 1, 'guilherm': 1, 'pretensi': 1, 'workabl': 11, 'audiocassett': 1, 'delanci': 1, 'hg': 9, 'vijay': 17, 'flavia': 51, '15th': 7, 'unyield': 4, 'geld': 3, 'sti': 6, 'piou': 7, 'anachronist': 16, 'hearten': 6, 'islamist': 1, 'thumbnail': 2, 'nunsploit': 14, 'carelessli': 14, 'segel': 4, 'duperrey': 1, 'ineleg': 3, 'wasson': 1, 'masoch': 8, 'kernel': 8, 'relearn': 1, 'hohokam': 1, 'ahah': 1, 'boulder': 16, 'bogosian': 4, 'vitavetavegamin': 1, 'arnaz': 5, 'stiltedli': 2, 'emmenth': 2, 'rumpl': 5, 'guinn': 3, 'litel': 2, 'philand': 8, 'americn': 1, 'cookoo': 1, 'unpleasantli': 4, 'starslet': 1, 'communistophobia': 1, 'mcintyr': 20, 'buffooneri': 7, 'fleme': 34, 'bendix': 11, 'tijuco': 2, 'xica': 24, 'silva': 13, 'dispossess': 4, 'slake': 2, 'joao': 2, 'fernand': 1, 'superstit': 7, 'panavis': 8, 'monowhilst': 2, 'castelnuovo': 3, 'libertin': 2, 'gaubert': 2, 'serato': 1, 'duma': 3, 'aux': 3, 'camelia': 2, 'deforrest': 2, 'freewheel': 5, 'radley': 2, 'metzger': 4, 'sarno': 22, 'paramet': 16, 'enrico': 16, 'sabbatini': 1, 'piero': 2, 'piccioni': 1, 'lickerish': 1, 'judder': 1, 'doh': 4, 'newswomen': 1, 'ventil': 2, 'virgina': 4, 'manchild': 1, 'iedereen': 1, 'beroemd': 1, 'moh': 12, 'screwfli': 8, 'cigarrett': 1, 'ackroyd': 8, 'satiat': 8, 'aneurysm': 3, 'vladimir': 4, 'nabokov': 10, 'fia': 1, 'ceo': 17, 'paratroop': 4, 'fraulein': 9, 'doktor': 15, 'deutschland': 3, 'benz': 2, 'potion': 15, 'albright': 6, 'hy': 1, 'averback': 1, 'trelkovski': 35, 'crassli': 4, 'trelkovksi': 1, 'gunna': 3, 'bauraki': 5, 'dwar': 3, 'dempsey': 2, 'mif': 2, 'pastri': 2, 'caffein': 7, 'vinegar': 5, 'baurki': 1, 'godnow': 1, 'tuskan': 3, 'behr': 9, 'roswel': 3, 'sofia': 28, 'carson': 34, 'temer': 5, 'enerv': 7, 'unsung': 13, 'spanglish': 9, 'arbi': 3, 'carwash': 2, 'silberl': 15, 'phedon': 3, 'papamichael': 3, 'rhea': 8, 'receptionist': 11, '103': 6, 'dreamgirl': 12, 'deadbeat': 12, 'infuriatingli': 5, 'stadl': 2, 'tenderli': 5, 'misbehav': 3, 'afm': 2, 'swinger': 10, 'peet': 24, 'compost': 3, 'toppan': 2, 'maelstrom': 5, 'alloc': 5, 'unaccomplish': 1, 'bentley': 17, 'screenact': 1, 'dvx': 1, '100b': 1, 'currenc': 9, 'lemac': 1, 'borkowski': 1, 'verac': 7, 'cronni': 1, 'accrut': 1, 'sillier': 13, 'toymak': 4, 'evict': 17, 'larva': 4, 'kenitalia': 1, 'whee': 1, 'neith': 1, 'delpi': 16, 'inquest': 4, 'readership': 1, 'reindeer': 16, 'merlin': 20, 'darlann': 3, 'belzer': 8, 'hitcher': 4, 'jist': 3, 'darthvad': 1, 'hmmmm': 16, 'stupifi': 3, 'afterwhil': 1, 'ginga': 1, 'tetsud': 1, 'rintaro': 2, 'leiji': 5, 'matsumoto': 10, 'ge999': 5, 'harlock': 4, 'emeralda': 1, 'tochir': 1, 'oyama': 2, 'tetsur': 11, 'hoshino': 1, 'masako': 5, 'nozawa': 1, 'goku': 1, 'ikeda': 1, 'katsuhiro': 1, 'otomo': 1, 'rinatro': 1, 'earhol': 1, 'shecker': 1, 'belat': 9, 'unabridg': 2, 'ipod': 6, 'gravita': 14, 'coldest': 6, 'berta': 1, 'plotless': 5, 'monotoni': 12, 'bowman': 7, 'dv': 23, 'environmentalist': 9, 'font': 8, '2090': 1, '66er': 1, 'o1': 1, 'blockad': 5, 'cradl': 45, 'mahiro': 1, 'maeda': 1, 'morpheu': 13, 'enantiodromia': 1, 'krull': 2, 'koestler': 1, 'calvado': 2, 'vive': 7, 'tabac': 1, 'parisien': 4, 'byrrh': 1, 'gruenberg': 2, 'premi': 1, 'tibbett': 1, 'alias': 3, 'wozzeck': 1, 'gunther': 5, 'himmelstoss': 2, 'paxin': 17, 'englishwoman': 3, 'mukerje': 1, 'brahamin': 1, 'petiot': 19, 'expression': 17, 'nosferatu': 10, 'wordless': 10, 'sharpen': 12, 'concierg': 9, 'underpass': 3, 'kern': 6, 'disembodi': 3, 'imperturb': 1, 'contemptu': 4, 'victrola': 1, 'vaccin': 2, 'maeder': 1, 'headquart': 16, 'surann': 2, 'gabbl': 2, 'stager': 1, 'debel': 1, 'playmat': 11, 'cunard': 1, 'britann': 1, 'dawkin': 7, 'posa': 2, 'voorhe': 12, 'playstat': 8, 'isabella': 11, 'rosselinni': 1, '25million': 1, 'jacqui': 1, 'maxin': 4, 'chaperon': 4, 'amo': 27, 'guttman': 2, 'cinevista': 1, 'hess': 20, 'mufla': 1, 'hoyberg': 1, 'aki': 2, 'avni': 1, 'isreali': 1, 'acc': 2, 'guisepp': 1, 'pambieri': 1, 'emi': 15, 'chai': 4, 'bitto': 1, 'albertini': 1, 'tasti': 39, 'bummer': 7, 'staller': 3, 'mancori': 1, 'nico': 5, 'fidenco': 1, 'parlay': 3, 'suncoast': 2, 'xi': 3, 'englishman': 25, 'pritam': 5, 'urmila': 19, 'puroo': 3, 'vajpai': 1, 'rashid': 7, 'punjabi': 11, 'mussalmaan': 1, 'sandhali': 1, 'sinha': 1, 'lajjo': 2, 'suri': 3, 'ramchand': 1, 'priyanshu': 2, 'chattarje': 1, 'triloki': 1, 'mughal': 1, 'azam': 1, 'banara': 1, 'backslap': 1, 'commiss': 32, 'playright': 1, 'ith': 1, 'truer': 15, 'frisson': 4, 'colett': 3, 'bridesmaid': 1, 'atkin': 17, 'gyula': 2, 'pado': 2, 'kaczmarek': 1, 'lajo': 7, 'koltai': 5, 'drewbi': 2, 'brittani': 19, 'tj': 1, 'birch': 4, 'carrington': 4, 'rockumentari': 3, 'gwynn': 26, 'munster': 22, 'bombshel': 27, 'townsfolk': 27, 'chameleon': 7, 'bonafid': 4, 'vitameatavegamin': 1, 'upturn': 1, 'absorpt': 6, 'stoicism': 7, 'tutor': 21, 'mtf': 4, 'ji': 19, 'hoon': 19, 'compat': 10, 'kwong': 1, 'ailment': 10, 'contagi': 7, 'lina': 5, 'wertmuel': 1, 'windswept': 1, 'stagnat': 5, 'napkin': 6, 'screener': 7, 'geeeee': 1, 'od': 7, 'uppiti': 6, 'invert': 8, 'rottweil': 4, 'loader': 5, 'thinge': 2, 'dumbland': 19, 'hertzfeldt': 2, 'lummox': 2, 'faulti': 21, 'gettysburg': 7, 'crudest': 5, 'harrowingli': 2, 'waddl': 8, 'manhol': 4, 'crevic': 3, 'mcmahon': 23, 'havn': 2, '7th': 19, 'waz': 1, 'isveri': 1, 'woodstock': 16, 'wavi': 3, '1918': 10, 'tuberculosi': 8, 'hawai': 3, 'plantag': 2, 'kana': 1, '1907': 4, 'mifun': 6, 'toshiro': 8, 'benshi': 1, 'merd': 5, 'vigo': 5, 'cocteau': 6, 'maddin': 10, 'lavant': 1, 'breathless': 35, 'here': 27, 'lovelorn': 5, 'magnif': 3, 'inward': 7, 'bowi': 23, 'softli': 10, 'jenuet': 1, 'gondri': 1, 'ephemer': 18, 'mai': 12, 'celibaci': 2, 'celib': 2, 'pvc': 2, 'nauseum': 11, 'wynorski': 4, 'brethern': 1, 'chrissak': 4, 'cormon': 1, 'demm': 22, 'kaplan': 5, 'pyun': 19, 'heatseek': 1, 'podg': 16, 'atwood': 5, 'booni': 1, 'paxson': 3, 'coo': 8, 'ooooof': 1, 'roladex': 1, 'midsect': 3, 'smokin': 5, 'asimov': 12, 'c3po': 8, 'prospero': 5, 'interlop': 6, 'revolta': 1, 'thuggi': 4, 'pledg': 21, 'chalont': 1, 'jianjun': 1, 'dalmatian': 27, 'megaton': 3, 'wasnt': 16, 'havent': 9, 'srk': 12, 'aishwarya': 9, 'rai': 7, 'aishu': 2, 'hangout': 6, 'scantili': 33, 'kamina': 4, 'cyd': 8, 'resuscit': 4, 'usaf': 3, 'fllow': 1, 'airmen': 3, 'radford': 5, 'jimi': 2, 'dougray': 7, 'felic': 8, 'radish': 1, 'inscrib': 2, 'branka': 1, 'katic': 1, 'bloor': 1, 'upward': 24, 'bathsheba': 31, 'judah': 5, 'rabgah': 1, 'uriah': 12, 'kieron': 6, 'alight': 8, 'drought': 14, 'joab': 1, 'israelit': 1, 'rebuk': 4, 'verdon': 7, 'michal': 4, 'kingship': 1, 'bushman': 7, 'ark': 24, 'goliath': 9, 'masterli': 5, 'chester': 28, 'gould': 19, 'overtur': 5, 'trueheart': 2, 'mahoney': 18, 'sondheim': 6, 'counterfeit': 5, 'jackpot': 3, 'sergiu': 5, 'karamzin': 1, 'ev': 2, 'pander': 24, 'drss1942': 1, 'australlian': 1, '14th': 21, 'manate': 2, 'vendetta': 17, 'boerner': 3, '1hour': 2, '34th': 5, 'sexiest': 19, 'cinego': 1, 'bhansali': 1, 'prescrib': 6, 'filmi': 14, 'bollwood': 1, 'mohabbatein': 3, 'henceforth': 9, 'ingrain': 3, 'goosebump': 10, 'lotteri': 18, 'dough': 21, 'demoralis': 3, 'hassel': 1, 'barrack': 6, 'contravent': 1, 'unbecom': 5, 'intead': 1, 'brake': 19, 'catwoman': 16, 'creepier': 15, 'missi': 17, 'adio': 3, 'companero': 3, 'callaghan': 5, 'ironhead': 4, 'hehe': 8, 'horsesho': 2, 'fantasticfantasticfantast': 1, 'aristid': 4, 'massaccesi': 1, 'aahhh': 1, 'paulson': 5, 'strathairn': 23, 'reedu': 1, 'coney': 6, 'clientel': 1, 'congression': 5, 'scapegoat': 10, 'guinever': 6, 'hasti': 14, 'mott': 4, 'hopfel': 2, 'kindl': 6, 'treati': 16, 'chug': 5, 'smut': 14, 'fotog': 1, 'murrow': 4, 'bookmark': 1, 'uncannili': 5, 'shirk': 2, 'torgoff': 2, 'amercian': 1, 'brawn': 3, 'whoos': 1, 'doen': 1, 'acuiti': 2, 'booh': 1, 'contagonist': 1, 'poteni': 1, 'caspar': 2, 'som': 7, 'booti': 16, 'booooy': 1, 'telekinet': 4, 'filmgoer': 10, 'xxxxviii': 1, 'smoosh': 1, 'freakishli': 5, 'cylind': 6, 'diann': 9, 'worryingli': 1, 'houellebecq': 5, 'elucid': 6, 'harel': 6, 'bakewel': 8, 'raddick': 1, 'wtaf': 1, 'sawtooth': 2, 'dooley': 21, 'hairbrain': 1, 'dubieti': 1, 'pointer': 8, 'clise': 1, 'kanal': 4, 'speedi': 19, 'baio': 13, 'rigeur': 2, 'cowork': 17, 'grudgingli': 12, 'adulthood': 29, 'pariah': 7, 'restauranteur': 2, 'kindheart': 3, 'rift': 14, 'bama': 1, 'eldon': 1, 'hensley': 5, 'ardala': 4, 'valmar': 1, 'calkin': 1, 'tuska': 1, 'wexler': 4, 'hausman': 1, 'meekli': 3, 'keeff': 7, 'weissmul': 30, 'ator': 2, 'dieterl': 4, 'rossen': 1, 'siegel': 12, 'transposit': 4, 'dareu': 2, 'stig': 9, 'gabriella': 13, 'vicar': 13, 'siv': 6, 'nykvist': 4, 'frida': 8, 'hallgren': 6, 'ylva': 1, 'loof': 1, 'stefan': 33, 'nilsson': 6, 'paalgard': 1, 'dresser': 7, 'badit': 1, 'spetemb': 1, 'oakhurt': 1, 'wtn': 1, 'washboard': 2, 'ab': 22, 'sevier': 8, 'sax': 13, 'badif': 1, 'flaunt': 14, 'withheld': 6, 'apoge': 2, 'soloist': 7, 'wright': 53, 'defil': 5, 'beethoven': 12, 'changel': 13, 'demeanour': 7, 'gnaw': 12, 'rodent': 16, 'tibor': 1, 'ticak': 1, 'lafia': 1, 'sternest': 1, 'lager': 4, 'jasmin': 14, 'bleeth': 6, 'gurgl': 5, 'benita': 3, 'hume': 10, 'bystand': 18, 'paramour': 12, 'dimli': 10, 'frenchman': 31, 'conduc': 9, 'phew': 5, 'terrfic': 1, 'slightyli': 1, 'subvert': 16, 'imper': 9, 'steart': 1, 'cattleman': 4, 'afoul': 13, 'nothwest': 1, 'piggish': 1, 'dano': 3, 'ripsnort': 1, 'comraderi': 2, 'jobson': 9, 'annud': 1, 'gliss': 1, 'dat': 6, 'wiskey': 1, 'nix': 3, 'odysessi': 1, 'stoner': 27, 'somtim': 1, 'hamster': 7, 'mettl': 6, 'carrol': 30, 'croquet': 1, 'cha': 2, 'aji': 1, 'disengorg': 1, 'laudatori': 2, 'pooki': 1, 'rescind': 3, 'spurrier': 2, 'dissaud': 1, 'soulplan': 1, 'tarot': 14, 'maguffin': 1, 'proffer': 4, 'patter': 11, 'calvero': 1, 'stammer': 15, 'strombel': 10, 'muckrak': 1, 'cardiac': 3, 'styx': 3, 'ferryboat': 2, 'hade': 7, 'pranski': 7, 'querul': 4, 'lyman': 14, 'sabbat': 1, 'idiom': 6, 'ritzi': 2, 'contretemp': 2, 'stiffli': 6, 'borscht': 2, 'plebeian': 2, 'allus': 42, 'grieg': 6, 'beckert': 1, 'mandelbaum': 1, 'adair': 2, 'alma': 7, 'aphrodit': 6, 'founddesper': 1, 'vid': 2, 'sanderson': 7, 'rubberi': 9, 'whisperi': 1, 'adr': 2, 'automaton': 3, 'partak': 13, 'sadomasochist': 4, 'hannib': 13, 'lecter': 10, 'tobey': 14, 'skeet': 13, 'ulrich': 18, 'caviezel': 2, 'wilkinson': 3, 'belisario': 2, 'airwolf': 17, 'jag': 16, 'mia': 33, 'orwel': 27, '37': 15, 'bandi': 2, 'eurasia': 1, 'canteen': 5, 'proteg': 6, 'corleon': 34, 'pasta': 7, 'garret': 3, 'doppelgang': 25, 'chiaroschuro': 1, 'shadowless': 1, 'fortel': 1, 'romcom': 5, 'consort': 2, 'sexili': 3, 'margoly': 2, 'paterson': 2, 'tlb': 1, 'gymnast': 40, 'corkscrew': 2, 'primetim': 6, 'elena': 9, 'rum': 4, 'plotlin': 37, 'risibl': 13, 'modin': 24, 'linder': 5, 'miachel': 1, 'unger': 17, 'dreamquest': 3, 'erron': 13, 'horac': 7, 'greeley': 2, 'steamboat': 6, 'toothpick': 3, 'beatrix': 1, 'cottontail': 2, 'weaponri': 20, 'willpow': 7, 'hickok': 20, 'anomali': 14, 'checkentertain': 1, 'checkcamera': 1, 'checkrestrict': 1, 'barcod': 3, 'sanction': 11, 'checkan': 1, 'checkcomput': 1, 'checkjail': 1, 'conscienti': 9, 'objector': 1, 'checkflag': 1, 'brew': 29, 'checkthen': 1, 'ea': 2, 'consul': 5, 'blindingli': 6, 'valhalla': 3, 'backstab': 15, 'stockard': 2, 'hilter': 2, 'unoppos': 2, 'letterman': 10, 'disneynatur': 3, 'hd': 14, 'philharmonik': 1, 'munna': 1, 'bhai': 7, 'mbb': 2, 'lagg': 1, 'raho': 3, 'sux': 3, 'prob': 3, 'indigest': 4, 'tush': 3, 'nudi': 11, 'nudist': 8, 'ramrodd': 2, 'beausoleil': 2, 'uncivil': 2, 'helloooo': 1, 'stander': 3, 'idrissa': 8, 'ouedraogo': 6, 'scorer': 1, 'hogti': 1, 'miswrot': 1, 'misfilm': 1, 'vandamm': 1, 'rohm': 12, 'adolph': 14, 'nazism': 11, 'himmler': 3, 'conspic': 1, 'storyboard': 14, 'receipt': 7, 'documentarian': 10, 'hypothermia': 4, 'rebutt': 2, 'thatcher': 12, 'belinda': 6, 'neccesari': 1, 'britfilm': 1, 'predeccesor': 3, 'tether': 5, 'viscer': 40, 'housesitt': 3, '2020': 2, 'saharan': 2, 'diagnosi': 17, 'mignard': 3, 'rodolph': 2, 'pauley': 1, 'pierrot': 4, 'lippmann': 1, 'withhold': 9, 'yanni': 1, 'lespert': 2, 'quebecoi': 4, 'leolo': 1, 'elgin': 1, 'visa': 10, 'salesladi': 1, 'uranium': 5, 'startlingli': 9, 'ranc': 5, 'velociraptor': 4, 'preumabl': 1, 'jusass': 1, 'flatul': 10, 'schmaltzi': 15, 'practicli': 2, 'yoko': 13, 'ono': 3, 'allthough': 2, 'adien': 1, 'performac': 6, 'adriana': 5, 'carmella': 4, 'malaprop': 4, 'albacor': 1, 'deifi': 2, 'hammerstein': 9, 'guetari': 13, 'awoken': 2, 'tra': 3, 'unpalat': 6, 'bharat': 3, 'matondkar': 5, 'punjab': 2, 'downstream': 4, 'sediment': 7, 'hydraul': 5, 'sacramento': 3, 'gravel': 10, 'tributari': 1, 'wheat': 4, 'brent': 48, 'gabbi': 22, 'thar': 2, 'dod': 2, 'camo': 1, '1800mph': 1, 'vulpin': 1, 'snowmobil': 1, 'tarka': 1, 'otter': 2, 'snuf': 4, 'foreknowledg': 1, 'wainwright': 4, 'jarvi': 10, 'cocker': 4, 'mcgarrigl': 1, 'kd': 2, 'heyerdahl': 7, 'aku': 2, 'peruvian': 23, 'polynesia': 6, 'gp': 6, 'cheh': 15, 'highwat': 2, 'keighley': 2, '69th': 1, 'alamo': 26, 'quebec': 10, '18aeddi': 1, 'remi': 15, 'unicorn': 9, 'subscript': 6, 'rackham': 1, 'outgrow': 4, 'colorist': 1, 'rouser': 5, 'amatuerish': 2, 'dollop': 7, 'kendi': 1, '112': 6, 'firsthand': 7, 'screwdriv': 6, 'diesel': 10, 'propog': 1, 'decri': 5, 'predispos': 5, 'hussein': 5, 'symptomat': 5, 'destitut': 4, 'doctrin': 14, 'deign': 6, 'condi': 1, 'unthink': 21, 'vitriol': 6, 'bipartisan': 1, 'overlit': 1, 'eyesight': 9, 'coddl': 6, 'overdirect': 1, 'homoerotica': 1, 'ranma': 28, 'dragonbal': 5, 'acedmi': 1, 'uncaptur': 1, 'secaucu': 1, 'tepper': 11, 'influx': 3, 'smoothli': 34, 'lefler': 3, 'necheyev': 1, 'hf': 9, 'waaaaaayyyi': 1, 'kreuger': 3, 'serl': 19, 'cheeseburg': 4, 'sewn': 8, 'disastor': 1, 'tmnt': 14, 'lair': 23, 'iter': 5, 'turtledom': 1, 'glue': 25, 'chum': 13, 'oxi': 1, 'liongat': 1, 'lionsgat': 6, 'hickish': 2, 'creepili': 10, 'saranadon': 1, 'wlaken': 1, 'firefli': 16, 'arsehol': 2, 'chestburst': 2, 'muco': 3, 'akelli': 1, 'toreal': 1, 'perrineau': 1, 'benatato': 1, 'probi': 6, 'vernacular': 9, 'emphasis': 11, 'filmwork': 3, 'reiner': 14, 'wtc1': 3, 'portico': 1, 'wtc2': 2, 'trembl': 10, 'monolith': 5, 'giuliani': 4, 'cornishman': 1, 'riscorla': 1, 'riefenstahl': 4, 'traditon': 1, 'resnai': 18, 'hiroshima': 13, 'shimmi': 3, 'nihil': 11, 'metrosexu': 2, 'lisp': 11, 'lithp': 1, 'serpico': 9, 'brasco': 4, 'ballpark': 6, 'glib': 19, 'rotflmao': 2, 'schmuck': 7, 'percuss': 6, 'suzann': 47, 'earmark': 7, 'parentag': 3, 'chanceri': 7, 'dilatori': 1, 'apoplect': 1, 'renter': 10, 'weberian': 1, 'micawb': 6, 'jarndyc': 13, 'soliti': 4, 'ignoti': 4, 'collinwood': 15, 'chet': 2, 'synovi': 1, 'morti': 26, 'prejud': 14, 'friendliest': 2, 'fethard': 1, 'veto': 3, 'sloooow': 2, 'howzbout': 1, 'falter': 23, 'carthag': 3, 'nauvoo': 4, 'expositor': 1, 'aback': 9, 'newbold': 1, 'cranki': 14, 'methodist': 5, 'candic': 16, 'bergen': 17, 'dea': 4, 'canvas': 7, 'harchard': 1, 'gehrig': 5, 'salti': 5, 'exorbit': 2, 'affin': 21, 'richar': 2, 'thong': 5, 'cognac': 15, 'devotedli': 1, 'eisenhow': 11, 'antheil': 3, 'rustl': 6, 'symphoni': 18, 'cheyenn': 14, 'overtop': 1, 'puzo': 6, '54': 23, 'clubber': 1, 'phillipp': 8, 'rubel': 7, 'motown': 2, 'raskin': 3, 'forgav': 4, 'nooooo': 4, 'hoopla': 5, 'mockingli': 2, 'gimmicki': 16, 'downscal': 2, 'sandrich': 5, 'roberta': 11, 'crewmat': 2, 'spinsterish': 1, 'makeov': 15, 'kewpi': 4, 'shipmat': 4, 'dowdi': 14, 'fundrais': 3, 'shipboard': 1, 'intriguingli': 3, 'creami': 2, 'satin': 7, 'winningli': 7, 'zesti': 5, 'viril': 12, 'soundi': 1, 'lunceford': 1, 'poultri': 1, 'joni': 2, 'ulu': 1, 'grosbard': 1, 'shote': 1, 'blanch': 11, 'nottingham': 1, 'gisborn': 1, 'friar': 7, 'blemish': 7, '40th': 4, 'marksmanship': 1, 'irasc': 10, 'sierra': 25, 'madr': 9, 'hoov': 4, 'stamped': 10, 'carcass': 8, 'hunch': 10, 'lott': 3, 'protract': 18, 'xxx': 8, 'looooooooong': 1, 'bertolucci': 6, 'bade': 3, 'miyan': 2, 'chote': 1, 'shola': 2, 'shabnam': 2, 'aankhen': 6, 'saajan': 2, 'chale': 2, 'sasur': 1, 'deewana': 4, 'mastana': 2, 'haseena': 2, 'manjayegi': 1, 'gyarah': 1, 'robotboy': 8, 'corniest': 4, 'toothbrush': 10, 'abishek': 1, 'townfolk': 4, 'fortitud': 5, 'everand': 1, 'chile': 32, 'desent': 1, 'beforeth': 1, 'atmo': 1, 'thereedit': 1, 'tinker': 16, 'grubbi': 8, 'trouser': 18, 'roster': 12, 'interrel': 3, 'gulliv': 4, 'steampunk': 1, 'feisti': 28, 'topmost': 1, 'irredeem': 10, 'gainax': 8, 'devolv': 14, 'hisaishi': 10, 'rescor': 4, 'rerecord': 1, 'critial': 1, 'fluctuat': 7, 'pricelessli': 2, 'jal': 2, 'cel': 4, 'iubit': 1, 'dintr': 1, 'pamanteni': 1, 'preda': 2, 'dove': 23, 'fearless': 27, 'etienn': 5, 'girardot': 8, 'lockhart': 8, 'nat': 21, 'salesmen': 4, 'wilfr': 9, 'timelin': 16, 'loyalist': 15, 'campel': 3, 'pooch': 9, 'agust': 2, 'virtuos': 9, 'cleef': 9, 'pou': 3, 'cheang': 6, 'cambodian': 22, 'yue': 3, 'pei': 11, 'wook': 7, 'unflinchingli': 4, 'fraca': 6, 'diy': 5, 'ceasarean': 1, 'larnia': 1, 'jett': 2, 'rink': 2, 'badmen': 1, 'goad': 5, 'spartacu': 7, 'voltag': 9, 'stilted': 1, '600': 16, 'storywis': 5, 'glutton': 7, 'deject': 5, 'panorama': 13, 'platter': 7, 'incubu': 23, 'washroom': 4, 'madagascar': 7, 'coozeman': 5, 'beta': 32, 'talley': 5, 'olympiad': 2, 'beauteou': 2, 'vixen': 28, 'persever': 23, 'dilli': 6, 'kleptomaniac': 5, 'pinnochio': 3, 'lynda': 10, 'crystin': 2, 'rainbeaux': 5, 'lemora': 2, 'engagingli': 5, 'tak': 4, 'fujimoto': 2, 'cale': 6, 'dolor': 12, 'moonbeast': 2, 'begrudgingli': 2, 'serlingesq': 1, 'giornata': 4, 'particolar': 3, 'ettor': 14, 'scola': 18, 'antonietta': 12, 'jaco': 7, 'dormael': 7, 'huitiem': 1, 'amanhec': 1, 'manhunt': 11, 'valliant': 1, 'pabst': 22, 'weil': 1, 'brecht': 5, 'lenya': 2, 'aa': 5, 'pap': 18, 'dingman': 3, 'aerosol': 3, 'vapoor': 4, 'stinkeroo': 2, 'msf2000': 1, 'wearer': 2, 'zifferedi': 1, 'usd': 2, '50usd': 1, 'caddi': 5, 'fussi': 11, 'professori': 4, 'toupe': 8, 'copier': 2, 'henchman': 39, 'intramur': 3, 'louvr': 6, 'purvey': 4, 'rimless': 1, 'peacoat': 1, 'denim': 5, 'housemann': 1, 'negro': 10, 'scatman': 16, 'crother': 15, 'wrestlemania': 32, 'cena': 47, 'washout': 3, 'actionless': 1, 'casket': 5, 'wwf': 24, 'effi': 10, 'svengali': 2, 'anika': 4, 'noni': 13, 'temperament': 11, 'egotist': 29, 'unlimit': 15, 'sinnui': 2, 'yauman': 2, 'songl': 3, 'ching': 26, 'ling': 21, 'choi': 13, 'taoist': 11, 'scarv': 4, 'yin': 8, 'loudest': 8, 'laemle': 1, 'witchblad': 4, 'pappa': 19, 'calhoun': 16, 'marybeth': 3, 'cogan': 3, 'anselmo': 12, 'pedophiliac': 2, 'micro': 14, 'repairmen': 1, 'quintet': 6, 'lucia': 8, 'amamor': 1, 'titian': 1, 'cataclysm': 14, 'dahlia': 17, 'pacio': 4, 'retrac': 3, 'spate': 8, 'clef': 4, 'bugsi': 4, 'intersect': 19, 'formosa': 3, 'goldwyn': 14, 'concuss': 5, 'gilmor': 10, 'dougherti': 1, 'ecosystem': 5, 'gilda': 7, 'chapeau': 3, 'coleseum': 1, 'thatlast': 1, 'theyar': 1, 'ashort': 1, 'oftoday': 1, 'thatoverwhelm': 1, 'togo': 1, 'dumbvril': 1, 'ahapless': 1, 'ifyou': 2, 'cableor': 1, 'tashan': 45, 'banner': 23, 'acharya': 10, 'gadhvi': 1, 'dhoom': 18, 'rajnik': 4, 'wordli': 1, 'kareena': 41, 'ibrahim': 2, 'teeni': 17, 'eyedot': 1, 'actuali': 4, 'wendt': 30, 'markedli': 6, 'reduct': 5, 'shohei': 10, 'enrol': 7, 'macca': 1, 'scous': 1, 'regga': 5, 'caustic': 7, 'buoy': 6, 'oeuvr': 18, 'indonesian': 8, 'balines': 2, 'mango': 5, 'teller': 31, 'deb': 4, 'muss': 4, 'rascal': 11, 'statutori': 3, 'burli': 6, 'brawni': 2, 'ebulli': 3, 'cantanker': 7, 'rambuncti': 4, 'nob': 2, 'upswept': 1, 'sticki': 19, 'heatwav': 4, 'slag': 6, 'launcher': 20, 'cristoph': 1, 'cheeta': 6, 'iphigenia': 18, 'stackhous': 3, 'confederci': 1, 'murpi': 1, 'wiley': 7, 'pachyderm': 1, 'cholera': 6, 'censur': 4, 'oddpar': 2, 'spongebob': 8, 'burp': 5, 'lololol': 1, 'kangaroo': 1, 'kiddish': 3, 'dimmsdal': 1, 'nickelodeon': 18, 'transcendent': 9, 'katha': 1, 'upanishad': 1, 'zanuck': 17, 'darrel': 7, 'sojourn': 4, 'himalayan': 6, 'webb': 15, 'templeton': 3, 'cathedr': 17, 'duffl': 1, 'nobler': 2, 'kinder': 4, 'dramamin': 2, 'durrel': 1, 'alexandria': 2, 'gurinda': 2, 'chada': 1, 'heahthrow': 1, 'bhamra': 4, 'peacemak': 3, 'blight': 9, 'reec': 6, 'hounslow': 1, 'harrier': 1, 'interced': 5, 'anupam': 13, 'shaheen': 1, 'stevenson': 38, 'bamrha': 1, 'panjabi': 1, 'taz': 2, 'geez': 19, 'trandgend': 1, 'querel': 1, 'petra': 7, 'kant': 8, 'fanfict': 1, 'fifi': 6, 'pott': 17, 'angsti': 5, 'cogsworth': 2, 'aoki': 9, 'toyoko': 1, 'tamako': 2, 'verneuil': 5, 'parallax': 4, 'condor': 9, 'volney': 1, 'i': 3, 'oracl': 7, 'cursori': 13, 'jellyfish': 6, 'cardiotox': 1, 'neurotox': 1, 'dermatonecrot': 1, 'humiliatingli': 2, 'indol': 5, 'synacur': 1, 'unsentiment': 10, 'lachrymos': 4, 'weighti': 10, 'huntley': 10, 'mesuri': 3, 'bounder': 3, 'toff': 2, 'underproduc': 1, 'boult': 7, 'militarist': 8, 'hagerti': 3, 'brattiest': 1, 'rudest': 1, 'ghajini': 4, 'moreokay': 1, 'jawani': 2, 'diwanireview': 1, 'emraan': 10, 'hashmi': 5, 'hrishita': 2, 'bhatt': 5, 'celina': 6, 'jaitleycringeworthi': 1, 'loopholesdirect': 1, 'footpath': 3, 'mahesh': 5, 'celi': 33, 'shug': 8, 'pugh': 2, 'beaubian': 1, 'corrin': 7, 'reedi': 2, 'underf': 2, 'stockbrok': 5, 'workweek': 1, 'camilo': 1, 'mejia': 2, 'rugged': 1, 'peabodi': 3, 'waylan': 1, 'fedora': 6, 'bogey': 8, 'diplomaci': 6, 'cyru': 3, 'redblock': 1, 'bernhard': 17, 'gaspingli': 1, 'scathingli': 6, 'boskovich': 2, 'mattei': 37, 'robowar': 1, 'altro': 1, 'trintign': 4, 'bowen': 8, 'hak': 6, 'wui': 1, 'baton': 15, 'immateri': 5, 'hotwir': 1, 'blabla': 1, 'craptast': 5, 'befoul': 3, 'swampi': 2, 'unbeknownst': 21, 'spank': 11, 'outdoorsman': 3, 'inbre': 6, 'spri': 3, 'breeder': 5, 'chihuahua': 3, 'gasolin': 13, 'sexpot': 9, 'foxtrot': 1, 'tomfooleri': 2, 'weid': 4, 'straughan': 1, 'weidstraughan': 1, 'formul': 25, 'prez': 6, 'jhonni': 1, 'delauis': 1, 'registrar': 3, 'abahi': 1, 'metcalf': 7, 'morrisey': 7, 'renoir': 32, 'marai': 8, 'manouvr': 1, 'rutina': 3, 'nelsan': 1, 'elli': 36, 'whycom': 1, 'dodder': 2, 'sy': 9, 'buffi': 43, 'avers': 13, '70mm': 3, 'blenheim': 3, 'edwardian': 8, 'nitpick': 28, 'claudiu': 9, 'ophelia': 14, 'brier': 8, 'poloniu': 6, 'horatio': 9, 'apotheosi': 3, 'inauthent': 7, 'notepad': 1, 'ringl': 2, 'barnum': 3, 'hrothgar': 6, 'resiz': 1, 'facilit': 14, 'cornrow': 1, 'sideburn': 3, 'unintend': 16, 'heorot': 5, 'nors': 5, 'pinta': 2, 'catapult': 15, 'snit': 1, 'footprint': 4, 'dispel': 15, 'quart': 2, 'triag': 1, 'rasta': 3, 'boooooooo': 1, 'hairspray': 10, 'liqueur': 1, 'vagari': 3, 'emblazon': 3, 'warbeck': 5, 'spore': 9, 'asteroid': 4, 'loopi': 12, 'hancock': 5, 'immortel': 4, 'khufu': 1, 'you': 1, 'espous': 9, 'bangladesh': 5, 'qur': 2, 'surrah': 2, 'polytheist': 1, 'hellfir': 2, 'hadith': 4, 'urf': 3, 'shar': 1, 'ia': 8, 'modernist': 9, 'indiscrimin': 12, 'reparte': 12, 'bejebe': 1, 'r2d2': 4, 'ripstein': 3, 'godot': 1, 'lujan': 1, 'agustin': 2, 'cockfight': 3, 'asthmat': 6, 'nogal': 3, 'nobli': 5, 'dona': 3, 'undisciplin': 3, 'larner': 3, 'unform': 4, 'margotta': 4, 'chutzpah': 6, 'squashi': 2, 'dumbfound': 13, 'fuse': 26, 'firod': 15, 'horoscop': 2, 'if': 6, 'belittl': 15, 'diagram': 4, 'enya': 3, 'odor': 4, 'shimmeringli': 2, 'intertitl': 13, 'typist': 4, 'soundless': 1, 'unsurpris': 5, 'fluent': 14, 'pauper': 6, 'dilettant': 4, 'grabovski': 2, 'murnau': 8, 'fairground': 4, 'column': 27, 'sanctum': 1, 'unresist': 1, 'unknow': 10, 'watersid': 1, 'franz': 24, 'toma': 9, 'overween': 2, '6b': 2, 'melfi': 7, 'vanilla': 56, 'hangin': 3, 'subsid': 8, 'pork': 11, 'harvet': 1, 'clous': 4, 'hoi': 1, 'meng': 5, 'shekel': 1, 'singleton': 29, 'weclom': 1, 'cheesey': 6, 'burgad': 18, 'provo': 19, 'deadfal': 1, 'lenz': 9, 'ironist': 1, 'dispensationalist': 1, 'nightrelev': 1, 'dispensation': 1, 'dvdtalk': 1, '3199': 1, 'romano': 31, 'kattan': 25, 'dougi': 1, 'usurp': 5, 'unskil': 3, 'conting': 10, 'ai': 18, 'animatrix': 5, 'tantalis': 5, 'hazlehurst': 9, 'friel': 18, 'caton': 12, 'popularli': 3, 'prudenc': 2, 'xperiment': 1, 'filthier': 1, 'astronaust': 1, 'sach': 6, 'emmett': 2, 'induct': 5, 'zhou': 5, 'redux': 3, 'statesid': 2, 'animalist': 2, 'pervi': 5, 'roz': 16, 'demond': 3, 'encino': 1, 'barbecu': 12, 'reborn': 7, 'by': 2, 'hastili': 17, 'honda': 9, '204': 1, 'jaeckel': 2, 'medina': 1, 'latitud': 2, 'flank': 4, 'phoniest': 4, 'nic': 21, 'independancd': 1, 'grrr': 3, 'hammock': 4, 'turk': 5, 'agnu': 1, 'schrim': 1, 'coscarelli': 4, 'legro': 3, 'supress': 2, 'burketsvil': 1, 'hough': 9, 'cassevet': 3, 'erin': 10, 'torrenti': 4, 'downpour': 3, 'omnipot': 7, 'casevett': 1, 'luncheon': 3, 'phlegmat': 2, 'smacko': 1, 'meretrici': 5, 'venal': 7, 'galen': 5, 'weitz': 6, 'interraci': 12, 'sctv': 16, 'crouther': 1, 'roi': 4, 'faison': 3, 'extravaganza': 26, 'pedal': 5, 'sonte': 8, 'wham': 12, 'levit': 8, 'skyward': 4, 'halo': 5, 'wreath': 2, 'honcho': 5, 'coolidg': 2, 'germann': 2, 'loaner': 1, 'muhammad': 2, 'busload': 2, 'quandari': 7, 'switcheroo': 1, 'jamshi': 1, 'sharifi': 1, 'ruck': 2, 'naff': 10, 'apc': 1, 'outstay': 5, 'minigun': 1, 'suzi': 18, 'kendal': 15, 'fr': 13, 'ulein': 9, 'ocar': 2, 'seiner': 1, 'gypo': 60, 'guadalcan': 13, 'helsig': 1, 'sancho': 1, 'luna': 16, 'rodrigo': 2, 'cristian': 3, 'fuent': 1, 'zoey': 5, 'mccrari': 1, 'dissip': 17, 'corpul': 7, 'erect': 31, 'kirsti': 9, 'harland': 1, 'godfri': 1, 'lexington': 2, 'freekin': 1, 'apiec': 3, 'wathc': 1, 'linearli': 2, 'asynchron': 1, 'sequenti': 7, 'blurt': 9, 'hospic': 1, 'bejewel': 1, 'steamrol': 6, 'flatten': 8, 'dweeb': 8, 'ungrac': 3, 'perimet': 3, 'rapproch': 3, 'phelan': 1, 'spirta': 1, 'stickler': 3, 'valour': 1, 'onslaught': 10, 'latifah': 3, 'camryn': 1, 'manheim': 1, 'wilosn': 1, 'playhous': 9, 'maladjust': 2, 'pornstar': 2, 'glitchi': 1, 'microsoft': 8, 'piddl': 3, 'catchem': 1, 'barter': 3, 'iota': 11, 'tacular': 2, 'agonizingli': 10, 'civic': 13, 'riddanc': 2, 'timmi': 58, 'reanim': 14, 'bub': 2, 'tarman': 1, 'mattter': 1, 'twofac': 2, 'clayfac': 3, 'jeunet': 8, 'poulain': 3, 'guillaum': 4, 'canet': 1, 'gan': 2, 'pasar': 1, 'barca': 2, 'k11': 2, 'reintegr': 3, 'forag': 1, 'noooooooooooooooooooo': 1, 'schmidt': 18, 'marketplac': 12, 'aquaman': 6, 'smallvil': 27, 'feb': 4, 'fanfilm': 1, 'scrawni': 13, 'collora': 17, 'spackler': 1, 'golfer': 3, 'nore': 2, 'asap': 9, 'explicitli': 24, 'cameroonian': 3, 'pidgin': 4, '3lb': 1, 'neurlog': 1, 'anatom': 5, 'unintelligbl': 1, 'schitzoid': 1, 'untradit': 2, 'hypnotis': 5, 'laker': 2, 'ary': 2, 'considin': 5, 'pantoliano': 9, 'hellboy': 1, 'scener': 1, 'revenu': 14, 'busch': 2, 'williamsburg': 3, 'norfolk': 4, 'redevelop': 2, 'rollercoast': 4, 'unmanag': 2, 'canova': 1, 'harborfest': 1, 'bryden': 2, 'delan': 2, 'flambard': 1, 'senil': 14, 'crossroad': 13, 'newey': 5, 'golf': 38, 'screwey': 9, 'moot': 11, 'smudg': 7, 'elektra': 6, 'yeaaah': 2, 'bennif': 1, 'coca': 9, 'flem': 19, 'tm': 4, 'laptop': 10, '249': 1, 'westland': 1, 'lynx': 2, 'lockhe': 1, 'ah56a': 1, 'pusher': 3, 'fuselag': 2, '275': 3, 'rotari': 1, '222': 2, 'outfield': 14, 'roddi': 23, 'tonga': 2, 'arabian': 15, 'motiff': 1, 'vizier': 7, 'duprez': 14, 'rozsa': 10, 'fidoi': 1, 'robinon': 1, 'nervi': 1, 'jones': 6, 'conelley': 1, 'delug': 6, 'bueller': 11, 'amaturish': 1, 'berlingsk': 1, 'tidend': 1, 'walburn': 1, 'maxford': 1, 'welsh': 18, 'arrowhead': 1, 'trike': 1, 'ivay': 2, 'wareham': 1, 'dorset': 1, 'mindlessli': 12, 'bogdanavich': 1, 'cthulhu': 1, 'utilis': 17, 'foretel': 9, 'selznick': 5, 'unrecommend': 2, 'mariann': 18, 'entwin': 13, 'occid': 1, 'syntax': 1, 'scrat': 14, 'coronari': 3, 'carotid': 1, 'hyperventil': 2, 'dredg': 7, 'clung': 2, 'griever': 3, 'cattlemen': 2, 'fanfar': 9, 'yogi': 5, 'reccomen': 1, 'trampa': 8, 'tsh': 3, 'krueger': 46, 'pleasingli': 9, 'forestri': 2, 'premonit': 10, 'ziltch': 1, 'hassl': 17, 'ulli': 13, 'modicum': 23, 'impun': 2, 'squeaki': 16, 'familiarli': 4, 'homey': 6, 'pleasantvil': 8, 'emptili': 1, 'thoughtlessli': 3, 'commod': 9, 'classism': 1, 'negativist': 1, 'seidl': 19, 'viennes': 11, 'lumbl': 4, 'rapoport': 1, 'nit': 21, 'theron': 22, 'purr': 5, 'hayenga': 3, 'inarticul': 9, 'straithern': 1, 'omaha': 6, 'equilibrium': 6, 'where': 6, 'earnt': 2, 'antichrist': 21, 'unassum': 11, 'regan': 8, 'sweeney': 12, 'kavanah': 1, 'qc': 1, 'magorian': 3, 'waqt': 28, 'bakvaa': 1, 'k3g': 1, 'baghban': 1, 'amitji': 1, 'bw': 4, 'trivialis': 2, 'wacko': 17, 'ut': 2, 'puff': 16, 'kotex': 4, 'iffi': 4, 'boondock': 5, 'aaaaaaah': 1, 'mead': 2, 'pinhead': 5, 'eacb': 1, 'rigoli': 1, 'dorrit': 2, 'nickelbi': 2, 'rigg': 11, 'dedlock': 14, 'aristocraci': 13, 'smallwe': 4, 'selina': 2, 'shoppingm': 1, 'shud': 1, '51': 20, 'sigur': 2, 'monke': 4, 'etcetera': 12, 'tenfold': 2, 'colagrand': 14, 'cantaloup': 2, 'involuntarili': 3, 'neurologist': 1, 'sutra': 2, 'rethink': 17, 'isaac': 24, 'positron': 1, 'bard': 17, 'avon': 3, 'shakewspear': 1, 'heavyweight': 29, 'corbet': 9, 'liveri': 3, 'flaherti': 13, 'flavin': 2, 'longshormen': 1, 'serio': 9, 'loder': 4, 'lebeau': 3, 'grappler': 1, 'pug': 3, 'stein': 19, 'mazurki': 3, 'unpolish': 4, 'brawler': 1, 'gazett': 1, 'tor': 7, '1887': 1, 'kaal': 2, 'indel': 20, 'ankhen': 1, 'charecter': 1, 'gujerati': 1, 'appeas': 26, 'finaci': 1, 'natyam': 1, 'bachachan': 1, 'sharukh': 1, 'chamcha': 1, 'rakoff': 2, 'balthasar': 1, 'sair': 4, 'ryecart': 6, 'rickman': 6, 'tybalt': 6, 'spacebal': 10, 'celia': 14, '168': 4, 'zeffirelli': 13, 'geriatr': 10, 'luhrmann': 2, 'playth': 10, 'unerot': 7, 'bloodbank': 1, 'iterpret': 1, 'bracco': 9, 'imperioli': 9, 'chianes': 6, 'galatica': 1, 'cyclon': 6, 'yelp': 4, 'gailard': 6, 'knacker': 2, 'mistim': 2, '108': 7, 'copyright': 26, 'nettl': 2, 'poppi': 3, 'beauseigneur': 1, 'existentialist': 7, 'amend': 20, 'ourt': 1, 'ticker': 1, 'septic': 3, 'halpin': 1, 'egghead': 3, 'feierstein': 1, 'sinu': 5, 'claudin': 4, 'barretto': 1, 'aquino': 1, 'pinoy': 2, 'stank': 10, 'sayang': 1, 'thinnest': 4, 'hatter': 3, 'tybor': 1, 'phocion': 1, 'fiona': 28, 'marivaux': 4, 'leontin': 1, 'agi': 9, 'trope': 11, 'injustis': 1, 'mcguir': 14, 'prollif': 1, 'musicli': 1, 'deardon': 1, 'reassign': 2, 'larceni': 3, 'lolli': 4, 'heywood': 4, 'bonehead': 10, 'talkier': 1, 'dostoyevski': 6, 'amateurist': 2, 'homevideo': 1, 'mcbeal': 8, 'kasey': 3, 'himalaya': 13, 'weihenmey': 1, 'sabin': 4, 'assess': 27, 'unsubtli': 2, 'og': 1, 'superlow': 1, 'somwhat': 1, 'notis': 1, 'happend': 1, '30min': 7, 'ultrabor': 1, 'imean': 1, 'ubertal': 1, 'whatch': 1, 'somon': 1, 'glans': 1, 'timber': 6, 'bian': 4, 'unspoken': 16, 'anorak': 2, 'arp': 1, 'lcc': 1, 'impedimenta': 1, 'sandbag': 2, 'wv': 3, 'unspoil': 4, 'gase': 4, 'stanislofski': 1, 'migen': 2, 'plummi': 2, 'peachum': 1, 'blitzstein': 3, 'bowdleris': 3, 'vittorio': 10, 'storaro': 2, 'strummer': 13, 'epsilon': 1, 'blip': 6, 'earthl': 10, 'despoil': 2, '475': 1, 'sharkboy': 1, 'lavagirl': 1, 'linz': 5, 'pox': 3, 'preschool': 6, 'clownhous': 1, 'salva': 8, 'streetlamp': 2, 'ahhhhhh': 2, 'denard': 6, 'contrera': 2, 'francen': 3, 'licata': 2, 'voyeurist': 11, 'fou': 1, 'posehn': 2, 'bobcat': 2, 'goldthwait': 2, 'schrab': 1, 'channel101': 1, 'defer': 6, 'huiti': 3, 'cuasi': 1, 'phantasmagor': 3, 'veneer': 18, 'pascal': 7, 'duquenn': 7, 'auteuil': 8, 'magnifiqu': 1, 'ginti': 10, 'squib': 8, 'rollick': 10, 'urichfamili': 1, 'spacesuit': 1, 'parapsychologist': 3, 'armoura': 3, 'claiborn': 1, 'overse': 15, 'heeeeeer': 2, 'intermix': 2, 'clunk': 6, 'hardwood': 1, '1921': 8, 'smackdown': 8, 'kendrick': 12, 'mnm': 8, 'boyz': 11, 'mercuri': 31, 'mvp': 18, 'chokeslam': 7, 'benoit': 35, 'chavo': 13, 'guerrero': 18, 'suplex': 9, 'vikki': 1, 'cruiserweight': 9, 'yang': 17, 'jbl': 5, 'richmond': 8, 'jawbreak': 3, 'manoeuvr': 5, 'miz': 10, 'batistabomb': 1, 'bosnia': 15, 'stripclub': 3, 'fleed': 1, 'lund': 6, 'cecilia': 18, 'bergqvist': 1, 'jugd': 1, 'popistasu': 3, 'puya': 2, 'escadril': 1, 'tab': 11, 'aleck': 7, 'all': 5, 'stockad': 1, 'infantri': 8, 'hollywierd': 1, 'digbi': 1, 'snook': 5, 'chenoweth': 7, 'mcbride': 11, 'jeweleri': 5, 'swoosi': 2, 'obituari': 2, 'forlani': 10, 'showmanship': 6, 'pickpocket': 30, 'manageri': 3, 'gentler': 5, 'lydia': 10, 'saxophonist': 4, 'bower': 3, 'hollywwod': 1, 'jonesi': 4, 'brows': 26, 'duchovney': 3, 'californ': 1, 'serbia': 17, 'consecr': 2, 'defrock': 4, 'morand': 7, 'sssssssssssooooooooooooo': 1, 'corporat': 3, 'aciton': 1, 'ick': 8, 'sib': 1, 'zoologist': 2, 'sapien': 4, 'cabbi': 6, 'invisibil': 2, 'cutoff': 1, 'volcano': 16, 'profus': 10, 'ilm': 3, 'piana': 3, 'duckl': 15, 'soulseek': 1, 'descens': 1, 'pj': 12, 'snarli': 1, 'deede': 5, 'mosquito': 7, 'ladyhawk': 1, 'wichita': 8, 'squish': 8, 'perchanc': 2, 'fiver': 4, 'blitzer': 1, 'hmmmmmmm': 2, 'ordel': 1, 'nastassja': 17, 'oddysey': 2, '6pm': 2, 'madelen': 1, 'knowingli': 15, 'tachigui': 3, 'retsudendirector': 1, 'toshio': 2, 'suzuki': 5, 'mako': 5, 'hyodo': 1, 'katsuya': 2, 'terada': 2, 'koichi': 2, 'yamadera': 3, 'consolid': 2, 'trendsett': 1, 'reconstitut': 5, 'shinya': 1, 'tsukamoto': 1, 'yomiuri': 1, 'ghibli': 10, 'nhk': 2, 'beli': 11, 'bebop': 1, 'soba': 1, 'ramen': 1, 'gyudon': 1, 'deposit': 22, 'yoshinoya': 1, 'andrez': 1, 'librarianship': 1, 'laggan': 1, 'henpeck': 6, 'devda': 2, 'fedar': 1, 'festoon': 1, 'ornat': 4, 'tapestri': 11, 'pageantri': 3, 'frontbench': 1, 'quentessenti': 1, 'gaper': 1, 'dishum': 2, 'leonin': 2, 'narasimhan': 1, 'gawker': 1, 'afilm': 2, 'andperhap': 1, 'solaris': 1, 'thisfilm': 4, 'givesth': 1, 'ofu': 1, 'aventurera': 1, 'tremayn': 7, 'rt': 1, 'donot': 1, 'teta': 2, 'spici': 9, 'saltshak': 1, 'hmmmmm': 1, '16th': 12, 'hahahah': 1, 'yamasaki': 1, 'hideo': 12, 'ringu': 16, 'hongurai': 1, 'mizu': 1, 'soko': 1, 'ju': 22, 'oodishon': 1, 'flavour': 19, 'fluiditi': 9, 'sunbath': 1, 'arbu': 1, 'unseemli': 5, 'dvr': 13, 'ayat': 5, 'sidestep': 5, 'avigail': 1, 'akhra': 6, 'concess': 13, 'harangu': 6, 'akra': 1, 'muezzin': 1, 'transliter': 3, 'tweak': 18, 'quin': 6, 'isnt': 13, 'shecki': 5, 'moskowitz': 3, 'reboot': 10, 'reintroduc': 5, 'export': 14, 'ninth': 16, 'hartnel': 1, 'phlegm': 1, 'choler': 2, 'exhort': 2, 'garnel': 1, 'bile': 5, 'wolff': 6, 'burbank': 6, 'conven': 2, 'corrug': 1, 'snuggli': 2, 'darian': 5, 'verst': 1, 'jerman': 2, 'akcent': 1, 'poisen': 1, 'airphon': 1, 'spork': 1, 'snakebit': 1, 'sofcor': 1, 'ede': 1, 'fitzpatrick': 5, 'annna': 1, 'serendip': 7, 'soulmat': 4, 'withstood': 4, 'braugher': 5, 'pembleton': 4, 'bayliss': 5, 'charliz': 14, 'lupe': 4, 'valdez': 1, 'velez': 1, 'madeth': 1, 'castth': 1, 'beforei': 1, 'sucksdo': 1, 'skimp': 7, 'nutrit': 5, 'ladybug': 8, 'atta': 2, 'garrett': 14, 'ranft': 2, 'heimlich': 5, 'mahin': 1, 'andersonvil': 2, 'curtiss': 1, 'wiliam': 2, 'caa': 1, 'althea': 1, 'photojourn': 3, 'happierabroad': 2, 'htmit': 1, 'wumast': 1, '160': 6, 'pointi': 10, 'incapac': 2, 'hommag': 3, 'lustig': 10, 'derisori': 4, 'badalamenti': 5, 'bondian': 1, 'rickl': 4, 'armaggeddon': 1, 'overhyp': 8, 'savvi': 25, 'landau': 17, 'starri': 6, 'spookili': 3, 'goldman': 3, 'dickerson': 2, 'armin': 9, 'meuller': 1, 'clubberin': 2, 'pillman': 1, 'badd': 2, 'ddp': 1, 'jobber': 2, 'hogan': 37, 'plunda': 1, 'dirrti': 1, 'sangster': 1, 'firefal': 1, 'sentri': 4, 'becuas': 2, 'corder': 2, 'segway': 4, 'natashia': 1, 'begli': 1, 'vampress': 1, 'urbania': 2, 'sugarplam': 1, 'montford': 11, 'backup': 15, 'toolbox': 24, 'durokov': 1, 'fetisov': 14, 'cameraderi': 1, 'wimpi': 25, 'wimpiest': 4, 'studli': 8, 'neilsen': 4, 'cryer': 3, 'matheisen': 1, 'darr': 1, 'mornel': 1, 'shortfal': 2, 'karmic': 4, 'deaden': 4, 'similitud': 1, 'sobrieti': 3, 'suni': 2, 'grous': 2, 'murvyn': 4, 'vye': 4, 'ti': 10, 'recon': 4, 'berkoff': 8, 'spetznatz': 2, 'lovin': 9, 'thrice': 2, 'cassavett': 14, 'thevillagevideot': 1, 'commishion': 1, 'ohara': 1, 'pileggi': 3, 'wiseguy': 9, 'divulg': 15, 'menschkeit': 2, 'yiddish': 10, 'outclass': 4, 'conjectur': 1, 'spiel': 6, 'scrupul': 8, 'composur': 10, 'yoke': 4, 'spurlock': 4, 'kkk': 8, 'tensionth': 1, 'lungren': 6, 'tia': 17, 'gainsbrough': 1, 'sg1': 13, 'othello': 87, 'colman': 54, 'shangri': 2, 'heldar': 3, 'carton': 12, 'rassendyl': 1, 'hasso': 13, 'hampden': 1, 'iago': 26, 'kanin': 9, 'tarintino': 2, 'masssacr': 2, 'unjust': 13, 'ogr': 39, 'shone': 14, 'televisu': 1, 'biangl': 1, 'plasticin': 3, 'gromit': 9, 'seedier': 7, 'maryland': 9, 'gadgetini': 1, 'pallet': 2, 'overwritten': 6, 'jello': 5, 'atheism': 3, 'schmoe': 2, 'pentecost': 2, 'corinthian': 3, 'unproven': 2, 'khouri': 38, 'broinowski': 10, 'boricua': 2, 'implod': 5, 'meditteranean': 1, 'platitud': 16, 'impervi': 6, 'sundri': 6, 'vladi': 3, 'hossein': 4, 'carasso': 2, 'octopu': 13, 'ock': 8, 'symbiot': 4, 'chiaki': 8, 'kuriyama': 7, 'henchgirl': 1, 'ryunosuk': 3, 'kamiki': 3, 'nuyen': 1, 'chakushin': 2, 'ari': 8, 'ochiai': 1, 'saimin': 1, 'telecast': 6, 'yumi': 2, 'renji': 1, 'ishibashi': 5, 'arli': 10, 'jover': 8, 'anglais': 6, 'musseum': 1, 'scurril': 1, 'aknowledg': 1, 'keyser': 1, 'soze': 3, 'spradl': 6, 'steadfastli': 5, 'toil': 11, 'fickl': 10, 'ahn': 2, 'nationalist': 21, 'dibb': 1, 'rudyard': 10, 'kipl': 26, 'archibald': 16, 'macchesney': 9, 'ballantin': 15, 'emalin': 1, 'stebbin': 2, 'anycas': 2, 'underscript': 1, 'higham': 1, 'effac': 4, 'madg': 14, 'kagan': 7, 'lyne': 2, 'kandic': 5, 'stroh': 6, 'deirdr': 2, 'portaray': 1, 'terresti': 2, 'copywrit': 2, 'horobin': 1, 'warmheart': 1, 'tamp': 2, 'halfheart': 2, 'langoria': 1, 'splainin': 1, 'mashal': 1, 'puckett': 2, 'prowler': 1, 'beautiful': 2, 'everytown': 17, 'barnstorm': 1, 'technocrat': 4, 'luddit': 3, 'briefest': 7, 'margareta': 1, 'mediterranean': 14, 'widespread': 8, 'chapman': 8, 'helmsmen': 1, 'perus': 7, 'kamerdaschaft': 1, 'comradeship': 7, 'ters': 9, 'smetim': 1, 'overgrown': 4, 'immemori': 1, 'baddiel': 2, 'variabl': 17, 'extrovert': 10, 'inexpens': 7, 'borrough': 1, 'mcculley': 1, 'g8': 1, 'protean': 2, 'paleontologist': 3, 'brainstorm': 1, 'geoprg': 1, 'starlett': 1, '08': 11, 'matern': 13, 'marquett': 1, '63rd': 1, 'kedzi': 1, 'meer': 1, 'bvd': 1, 'hiyao': 1, 'totoro': 4, 'kikki': 1, 'poser': 5, 'pazo': 1, 'jebidia': 1, 'perfet': 1, 'pax': 5, 'dollman': 4, 'helmer': 17, 'lemorand': 3, 'carafot': 1, 'ilan': 2, 'crystina': 8, 'cowper': 1, 'crutchley': 1, 'rykov': 2, 'plessi': 1, 'saknussemm': 1, 'doorknob': 7, 'chiba': 55, 'shihomi': 1, 'kingpin': 11, 'golgo': 1, 'docil': 11, 'mistuharu': 1, 'misawa': 1, 'yogurt': 2, 'anayway': 1, 'punster': 1, 'mitt': 4, 'publishist': 1, 'portal': 14, 'acquart': 5, 'florain': 10, 'curvi': 5, 'syncrhron': 1, 'naissanc': 6, 'pieuvr': 6, 'lolita': 18, 'fata': 2, 'chummi': 5, 'orgasm': 20, 'chastis': 9, 'afterglow': 1, 'tadpol': 3, 'byproduct': 6, 'symbiosi': 2, 'miri': 1, 'mudd': 1, 'rand': 8, 'submerg': 17, 'paraday': 1, 'zippo': 4, 'buick': 3, 'doughnut': 5, 'begrudg': 6, 'maddeningli': 7, 'hilbrand': 3, 'netherland': 18, 'terrificli': 2, '3k': 6, 'boylen': 1, 'viii': 5, 'elainor': 1, 'acquitan': 1, 'sturm': 3, 'und': 3, 'stultifi': 5, 'quicksilv': 2, 'parliament': 13, 'ascens': 10, 'peal': 4, 'synthesis': 3, 'paramed': 8, 'bereav': 8, 'lambada': 1, '4500': 1, '7300': 2, '3500': 1, 'roeh': 1, 'porcelain': 5, 'pullov': 1, 'mullholland': 5, 'condominium': 2, 'simmer': 14, 'waterwork': 2, 'plaster': 26, 'gucci': 3, 'stuntpeopl': 1, 'satanist': 16, 'luciferian': 1, 'schwartzeneggar': 1, 'mariah': 5, 'scylla': 1, 'charybdi': 1, 'eumaeu': 1, 'swineherd': 1, 'sandal': 12, 'acorn': 6, 'scrabbl': 2, 'nuptial': 4, 'bwitch': 1, 'railsback': 6, 'orwell': 1, 'schweiger': 6, 'strewn': 9, 'befel': 3, 'tibetian': 2, '17th': 18, 'unearthli': 3, 'eek': 4, 'sterno': 2, 'laureen': 1, 'zarah': 1, 'leander': 2, 'instabl': 8, 'rutil': 1, 'chignon': 1, 'lifelik': 8, 'schwimmer': 11, 'bachmann': 1, 'alibi': 21, 'adgth': 2, 'watership': 5, 'charleton': 8, 'biao': 4, '607': 3, 'leprechaun': 7, 'lithium': 2, 'darwinian': 2, 'fittest': 3, 'topnotch': 5, 'node': 3, 'pratt': 8, 'borgnin': 15, 'fufil': 2, 'elson': 2, 'westworld': 2, 'pollin': 6, 'sulu': 3, 'counterbalanc': 4, 'misconcept': 17, 'scion': 4, 'eton': 1, 'gannex': 1, 'amorph': 3, 'ruthlessli': 16, 'overtaken': 5, 'stalki': 1, 'airbrush': 3, 'upstart': 10, 'giordano': 5, 'mag': 15, 'painkil': 2, 'rediscoveri': 7, 'batcav': 7, 'brewer': 2, 'rickabi': 1, 'waggon': 5, 'meriweth': 2, 'connot': 11, 'nickel': 6, 'demot': 5, 'seraph': 1, 'buf': 3, 'boundless': 8, 'ehhh': 1, 'goldfish': 11, 'sorcia': 1, 'braid': 4, 'esmerelda': 1, 'pontif': 13, 'unscientif': 4, 'aggravatingli': 1, 'dispers': 8, 'pilfer': 5, 'kennif': 1, 'angor': 1, '60ish': 1, 'zombiefi': 4, 'dunnno': 1, 'manana': 1, 'irrepar': 6, 'citywid': 1, '110': 15, 'twinki': 2, 'devgan': 30, 'arjun': 18, 'manna': 2, 'wembley': 7, 'vimbley': 1, 'asin': 15, 'bharatnatyam': 1, 'offi': 2, 'misspel': 3, 'dacasco': 2, 'kuei': 3, 'bosch': 3, 'coolio': 8, 'precept': 1, 'scwarz': 1, '6ft': 1, '2in': 1, 'merlot': 2, 'anywho': 3, 'baretta': 5, 'addendum': 7, 'dar': 8, 'montazuma': 1, 'fld': 3, 'few': 3, 'housework': 7, 'polygamist': 1, 'sanctiti': 6, 'mariel': 10, 'massochist': 1, 'intercom': 2, 'windowless': 4, 'spinozean': 1, 'cabal': 18, 'millenni': 3, 'menzi': 14, 'zeitgeist': 10, 'cathrin': 3, 'multiplex': 20, 'photograpi': 1, 'projectil': 8, 'arteri': 3, 'lotta': 6, 'solips': 2, 'presumpt': 7, 'tortuous': 3, 'deiti': 9, 'beretta': 1, 'franko': 1, 'almoust': 1, 'highburi': 1, 'woodhous': 12, 'mantel': 1, 'gobbl': 11, 'thyself': 1, 'croydon': 1, 'prof': 7, 'mindf': 3, 'stonewal': 4, 'roulett': 10, 'tete': 4, 'ineffici': 5, 'abu': 40, 'graib': 1, 'alexa': 8, 'stefaniuk': 2, 'farcelik': 1, 'stopwatch': 2, 'revelatori': 9, 'huggi': 3, 'condescendingli': 2, 'automak': 6, 'gedd': 20, 'vaughan': 5, 'rye': 5, 'caveat': 8, 'enchantress': 1, 'blvd': 4, 'croissant': 1, 'lait': 2, 'tykwer': 11, 'faubourg': 9, 'melchior': 5, 'beslon': 4, 'sylvain': 6, 'chomet': 6, 'triplett': 2, 'bellevil': 4, 'putner': 1, 'yoland': 5, 'untroubl': 2, 'nobuhiro': 3, 'suwa': 4, 'parfait': 1, '14iem': 1, 'arrondiss': 14, 'margo': 10, 'martindal': 6, 'herringbon': 1, 'emblaz': 1, 'ensweat': 1, 'pilcher': 2, 'polonia': 1, 'headmistress': 12, 'nancherrow': 3, 'brideshead': 5, 'dewi': 5, 'cataton': 10, 'tyson': 24, 'blier': 17, 'gabin': 2, 'discurs': 2, 'prolix': 1, 'snorer': 4, 'cairn': 2, 'twig': 11, 'reidelsheim': 3, 'frith': 4, 'stump': 12, 'scotian': 1, 'breadth': 8, 'goldworthi': 1, 'ferdi': 22, 'deduc': 16, 'cheddar': 1, 'goeth': 1, 'maman': 16, 'putain': 14, 'fulsom': 3, 'aud': 14, 'milieu': 22, 'flinch': 9, 'arrant': 1, 'authori': 3, 'dissoci': 5, 'transcrib': 6, 'cluck': 1, 'iben': 1, 'hjejl': 1, 'tu': 5, 'tambien': 3, 'overract': 1, 'mocumentari': 5, 'nwh': 9, 'whitey': 2, 'cundeif': 1, 'fym': 1, 'folki': 1, 'damion': 2, 'richli': 38, 'isildur': 1, 'wraith': 8, 'unmad': 3, 'woodthorp': 2, 'schole': 2, 'lovey': 4, 'dovey': 4, 'woolgath': 1, 'hardwork': 12, 'hickman': 1, 'tingler': 8, 'dammit': 7, 'sopist': 1, 'duli': 15, 'disband': 3, 'sissorhand': 1, 'zooey': 5, 'deschanel': 7, 'wonderfal': 5, 'garp': 3, 'annik': 7, 'borel': 11, 'daniela': 14, 'protago': 1, 'beck': 20, 'dallianc': 8, 'ancona': 4, 'unscript': 8, 'jibe': 9, 'britannia': 2, 'encrypt': 11, 'sxsw': 10, 'rigger': 2, 'multimedia': 6, 'rougher': 5, 'deadlin': 8, 'trusti': 13, 'keeler': 35, 'geometri': 4, 'cupid': 12, 'somet': 1, 'reicher': 1, 'rosenstra': 1, 'baro': 5, 'ritterkreuz': 1, 'sass': 4, 'booor': 2, 'addison': 10, 'sidenot': 6, 'mozart': 9, 'phd': 10, 'shonda': 2, 'rhime': 2, 'deadwood': 8, 'ola': 2, 'sirico': 7, 'zandt': 6, 'gualtieri': 1, 'silvio': 16, 'godsend': 2, '1202': 1, '1201': 1, 'blanze': 1, 'hologram': 7, 'teleport': 16, 'afoot': 8, 'pixel': 3, 'personnal': 1, 'wasteof': 1, 'bittoo': 1, 'ofhistor': 1, 'studentpolit': 1, 'iwa': 3, 'frontalnud': 1, 'verboten': 4, 'automaticnc': 1, 'filmsin': 1, 'occassion': 4, 'madeit': 1, 'loudand': 1, 'ofparodi': 1, 'sexscen': 1, 'isclumsi': 1, 'fakedcunnilingu': 1, 'aninterview': 1, 'commentarybi': 1, 'thepivot': 1, 'prurient': 8, 'standardthat': 1, 'mustse': 1, 'sequen': 1, 'paccino': 1, 'starlight': 5, 'passionless': 8, 'tampon': 7, 'jambalaya': 2, 'hana': 4, 'subset': 2, 'coattail': 3, 'tsai': 13, 'stroll': 29, 'pushup': 1, 'posterchild': 1, 'mattress': 7, 'makeout': 2, '285': 1, 'consecut': 17, '356': 1, 'kiyoshi': 3, 'kairo': 2, 'shyer': 2, 'shyness': 5, 'berner': 1, 'brahm': 2, 'stoll': 2, 'uhum': 1, 'jt': 7, 'seeth': 16, 'ucsd': 1, 'vigoda': 2, 'barnabu': 1, 'foxworth': 6, 'beesley': 3, 'mikel': 14, 'renay': 2, 'revit': 6, 'mangler': 4, 'hangman': 5, 'fangoria': 10, 'lorna': 22, 'doon': 13, 'hornblow': 10, 'forsyt': 3, 'teleprint': 1, 'dyslexia': 1, 'conveyor': 9, 'carnosaur': 23, 'rodger': 23, 'halston': 1, 'undoubt': 9, 'cloy': 13, 'sistahood': 1, 'afican': 2, 'buppi': 1, 'superfli': 3, 'peddl': 8, 'ghettois': 1, 'tvm': 11, 'until': 5, 'suba': 4, 'villard': 2, '74th': 4, 'aggrand': 2, 'ovat': 12, 'panick': 13, 'apologis': 15, 'skullduggeri': 7, 'wetback': 1, 'towelhead': 7, 'fallout': 11, 'thalmu': 4, 'rasulala': 4, 'stupidili': 1, 'protray': 1, 'vehic': 1, 'paki': 1, 'nwa': 13, 'kasi': 2, 'condieff': 3, 'thourough': 2, 'rec': 3, 'moseley': 1, 'moto': 25, 'bosley': 6, '100th': 6, 'beagl': 1, 'conkl': 1, 'reforg': 1, 'narsil': 1, 'galadriel': 5, 'huorn': 1, 'hornburg': 1, 'lyndon': 8, 'symphon': 8, 'strider': 2, 'boromir': 7, 'priscilla': 9, 'gondor': 2, 'shelob': 2, 'faramir': 1, 'eowyn': 2, 'denethor': 1, 'palatir': 1, 'hackenstein': 30, 'diller': 5, 'unrat': 33, 'monik': 11, 'distaff': 5, 'chopsocki': 2, 'scuzzi': 5, 'mugger': 7, 'bod': 11, 'hooligan': 31, 'rebuf': 2, 'beatdown': 2, 'punchi': 3, 'diehl': 5, 'microcosm': 7, 'tmc': 2, 'nichol': 25, 'ruffian': 3, 'mcphillip': 13, 'margot': 8, 'birnam': 1, 'extravag': 30, 'kerrigan': 5, 'propagandist': 9, 'loesser': 8, 'kokanson': 1, 'givney': 1, 'veda': 1, 'fugu': 3, 'tinhorn': 2, 'permnanet': 1, 'cleopatra': 15, 'scot': 23, 'gaffer': 4, 'puller': 2, 'slamdunk': 1, 'jie': 2, 'tsang': 4, 'wei': 21, 'flit': 8, 'charlen': 3, 'fuzz': 9, 'solomon': 21, 'isla': 6, 'overcam': 10, 'luthorcorp': 2, 'plaza': 3, 'ac': 10, 'deknight': 3, 'leaguer': 1, 'agless': 1, 'quivvl': 1, 'expols': 1, 'rememeb': 3, 'swam': 4, 'nock': 1, 'joyner': 2, 'quaien': 5, 'firepow': 8, 'mindhunt': 1, 'missabl': 2, 'lockjaw': 2, 'whitebread': 2, 'leprosi': 4, 'thon': 6, 'coalit': 6, 'pych': 1, 'strausmann': 2, 'meatlock': 1, 'backstabb': 1, 'theseglow': 1, 'stkink': 1, '80min': 1, 'friendswho': 1, 'havegiven': 1, 'qissi': 3, 'jeanett': 24, 'francessca': 1, 'promen': 1, '0ne': 1, 'volit': 3, 'jesuit': 2, 'homeboy': 2, 'usc': 8, 'cornel': 11, 'nondenomin': 1, 'storefront': 1, 'ph': 6, 'wheaton': 1, 'chesterton': 2, 'papal': 3, 'encycl': 1, 'judaism': 6, 'ferment': 6, 'citat': 3, 'indochina': 1, 'hullabaloo': 3, 'kumbl': 4, 'teir': 1, 'dq': 4, 'overtim': 7, 'ppv': 31, 'dibias': 24, 'neidhart': 1, 'koko': 9, 'bossman': 3, 'yokozuna': 10, 'tito': 29, 'santana': 10, 'zukhov': 1, 'volkoff': 3, 'bushwhack': 17, 'meanac': 1, 'castlevania': 1, 'darkl': 8, 'gillen': 9, 'eet': 1, 'robotron': 1, 'comp': 1, 'xma': 8, 'headstart': 1, 'subdivis': 3, 'mofu': 1, 'denman': 1, 'babcock': 2, 'morin': 1, 'booboo': 1, 'gyrat': 10, 'unibomb': 1, 'torchi': 4, 'blane': 2, 'fetal': 3, 'mound': 8, 'mento': 2, 'tourism': 9, 'michelangleo': 1, 'raphel': 1, 'donatello': 1, 'disembowel': 11, 'salient': 6, 'textual': 3, 'geo': 1, 'syrianna': 1, 'arcturu': 1, 'astrog': 1, 'actingerrat': 1, 'andavoid': 1, 'historicsink': 1, 'pacingproblem': 1, 'yada': 25, 'playtim': 5, 'appealingli': 6, 'brianjonestownmassacr': 1, 'confect': 12, 'bjm': 21, 'lineup': 16, 'playback': 8, 'alumni': 13, 'denizen': 13, 'preppi': 12, 'gion': 1, 'meltdown': 8, 'mint': 9, 'fragmentari': 5, 'disneyland': 13, 'sachar': 9, 'lebouf': 1, 'soto': 9, 'strasberg': 4, 'aleisa': 3, 'macne': 1, 'kimmellfifteen': 1, 'alaska': 16, 'tribeca': 13, 'gershon': 14, 'kettl': 5, 'raggedi': 26, 'jamestown': 4, 'intergroup': 1, 'twerp': 5, 'tambourin': 1, 'gade': 8, 'hoyo': 7, 'insepar': 10, 'nelkin': 4, 'leibman': 7, 'swishi': 1, 'sisson': 1, 'patchett': 1, 'tars': 1, 'scatolog': 10, 'teinowitz': 1, 'ververgaert': 1, 'browder': 6, 'claudi': 2, 'relay': 22, 'miaoooou': 1, 'trainor': 9, 'devious': 2, 'cathod': 3, 'snazzi': 3, 'spillan': 5, '20mn': 1, 'heur': 1, 'moin': 2, 'horsey': 2, 'doillon': 1, 'decaun': 2, 'zem': 1, 'rochefort': 6, 'kitchi': 4, 'campier': 1, 'nuveau': 1, 'goldhunt': 1, 'hidalgo': 3, 'blackhat': 1, 'porcupin': 6, 'mainfram': 5, 'tonelessli': 1, 'escul': 1, 'chrisma': 1, 'slid': 3, 'skylight': 2, 'corvett': 4, 'hotrod': 2, 'bonaduc': 1, 'pov': 27, 'smg': 2, 'patsi': 21, 'cline': 4, 'giroux': 2, 'pettyjohn': 4, 'nonchalantli': 11, 'catatonia': 1, 'blooded': 1, 'sling': 14, 'sierr': 1, 'peyton': 6, 'govind': 9, 'nihalani': 8, 'velankar': 5, 'shafi': 1, 'inamdar': 2, 'sadashiv': 7, 'amrapurkar': 8, 'rama': 19, 'shetti': 10, 'dharmendra': 3, 'amrish': 8, 'filmfar': 6, 'hewlett': 17, 'meerkat': 9, 'womanhood': 6, 'precipic': 1, 'nastassia': 2, 'cranium': 1, 'vay': 2, 'meanc': 1, 'pouti': 8, 'andromeda': 8, 'nigeria': 5, 'colton': 6, 'luogi': 1, 'arabella': 6, 'anaren': 3, 'jaci': 1, 'barc': 1, 'bogdanov': 1, 'pfeh': 1, 'cluemast': 1, 'thunk': 4, 'quiz': 11, 'fastard': 1, 'rebroadcast': 4, 'collegi': 4, 'syria': 3, '242': 2, 'antisemit': 1, 'laemml': 2, 'soister': 1, 'hesitatingli': 1, 'fulton': 5, '50ish': 1, 'vaseekaramaana': 1, 'paiyan': 1, 'theist': 1, 'kite': 13, 'hurdl': 4, 'hermit': 14, 'rehman': 6, 'gobblygook': 1, 'l0': 1, 'netwav': 1, 'jc': 13, 'slo': 8, 'fortuit': 6, 'rendez': 2, 'vou': 4, 'fender': 8, 'accidente': 1, 'ramboesqu': 2, 'bullpen': 1, 'pheasant': 3, 'staccato': 3, 'mannix': 2, 'gatekeep': 2, 'gusher': 1, 'mckee': 12, 'fairhair': 1, 'socki': 6, 'sheng': 3, 'misc': 1, 'sexier': 13, 'soho': 6, 'neglige': 1, 'chequ': 8, 'badiel': 1, 'forsa': 2, 'jochen': 1, 'ruinat': 1, 'prejudici': 4, 'wlaschiha': 3, 'puccini': 2, 'tolliv': 1, 'kalen': 1, 'thalman': 3, 'conti': 4, 'jefferi': 17, 'kaylen': 1, 'nessun': 3, 'dorma': 3, 'birtwhistl': 1, 'prunella': 3, 'saurian': 1, 'trainabl': 3, 'ivanho': 2, 'pimpernel': 5, 'puhleassssse': 1, 'fletch': 1, 'woodchuck': 2, 'fellowship': 16, 'mote': 2, 'pippin': 4, 'merrili': 3, 'lute': 2, 'strum': 3, 'tunic': 5, 'leper': 2, 'bruinen': 1, 'gimli': 3, 'treebeard': 3, 'bombadil': 3, 'yossarian': 1, 'heller': 4, 'pluss': 4, 'uncomplet': 2, 'droid': 12, 'hutt': 7, 'dagobah': 1, 'calamari': 1, 'furri': 30, 'palpatin': 9, 'quo': 19, 'vadi': 6, 'nero': 6, 'klaus': 1, 'bandaur': 1, 'murmur': 4, 'kimberli': 17, 'squatter': 6, 'manhandl': 10, 'mcleod': 7, 'phaoroh': 1, 'ceasar': 10, 'toga': 2, 'varela': 3, 'inflight': 1, 'rippner': 12, 'macadam': 2, 'ubiqut': 1, 'sexegenarian': 2, 'aja': 15, 'tastelessli': 4, 'peculiarli': 5, 'mariett': 10, 'lans': 2, 'moorhead': 2, 'spacemen': 1, 'oct': 5, 'loosey': 1, 'goosey': 1, 'ferox': 2, 'drumbeat': 1, 'mclagen': 3, 'aflam': 2, 'eduardo': 12, 'ciannelli': 8, 'marco': 19, 'ricca': 2, 'gilberto': 1, 'estev': 3, 'freir': 1, 'anisio': 6, 'mariana': 6, 'ximen': 1, 'miklo': 22, 'scrupl': 5, 'dachsund': 1, 'statuesqu': 7, 'perla': 5, 'cristal': 4, 'quash': 3, 'zabalza': 9, 'villasenor': 1, 'unatmospher': 1, 'advanceoth': 1, 'strident': 12, 'emphat': 14, 'laufther': 1, 'thouch': 1, 'moremor': 1, 'abunch': 1, 'gimp': 4, 'tum': 4, 'unninja': 1, 'tutti': 3, 'frutti': 2, 'hoffmann': 5, 'pessim': 5, 'floweri': 5, 'dishwash': 7, 'dignifi': 32, 'yugoslav': 6, 'graffiti': 26, 'trebor': 15, 'maratonci': 5, 'trce': 5, 'pocasni': 5, 'krug': 5, 'balkanski': 1, 'spijun': 1, 'otac': 1, 'sluzbenom': 1, 'putu': 1, 'eder': 1, 'minigenr': 1, 'inflex': 7, 'amrican': 1, 'teeve': 6, 'gomer': 3, 'twaddl': 9, 'ryo': 4, 'colonialist': 3, 'hasslehoff': 2, 'dh': 7, 'lipper': 2, 'postscript': 7, 'appendag': 5, 'thumper': 3, 'pimlico': 28, 'rutherford': 8, 'baddeley': 2, 'summertim': 11, 'ugart': 2, 'renault': 1, 'ilsa': 6, 'lazslo': 1, 'bressart': 12, 'schildkraut': 15, 'grownup': 7, 'tomawka': 1, 'ontario': 14, 'consuelor': 1, 'sigel': 2, 'counten': 4, 'chari': 12, 'zenia': 31, 'dismember': 14, 'doabl': 2, 'earley': 3, 'bulletin': 9, '395': 1, 'joist': 1, 'fil': 2, 'maclaughlin': 2, 'thuge': 4, 'polymath': 1, 'geolog': 4, 'epoch': 7, 'homoerotic': 6, 'heurist': 2, 'tannen': 1, 'hominid': 2, 'vaitongi': 1, 'samoa': 1, 'saratoga': 1, 'dehavilland': 3, 'farragin': 1, 'empahh': 1, 'pinjar': 19, 'urmilla': 3, 'bajpai': 9, 'danniel': 1, 'snarl': 20, 'linu': 3, 'mucki': 1, 'bolero': 5, 'abanaz': 2, 'panto': 1, 'witchfind': 4, 'paunchi': 1, 'dinghi': 1, 'landfal': 1, 'sakura': 16, 'preachiest': 1, 'disarma': 4, 'apparatchik': 3, 'reaganesqu': 1, 'jefferson': 20, 'confisc': 11, 'gilchrist': 7, 'mounti': 14, 'dancehal': 2, 'cahoot': 7, 'gigi': 20, 'namast': 3, 'singh': 22, 'kinng': 1, 'devgn': 1, 'baja': 1, 'shankar': 4, 'eshaan': 1, 'rannvijay': 1, 'brinda': 2, 'parekh': 2, 'rhoda': 14, 'blindfold': 10, 'springwood': 15, 'bengal': 3, 'lancer': 2, 'bugl': 7, 'changruputra': 1, 'maurya': 1, 'tract': 11, 'roedel': 8, 'bushwack': 3, 'renegad': 25, 'geurilla': 1, 'jayhawk': 6, 'uproot': 3, 'roadblock': 7, 'bender': 20, 'krycek': 2, 'groggi': 2, 'harlan': 7, 'hydrogen': 7, 'bladder': 3, 'baloon': 2, 'hermin': 1, 'hex': 2, 'asher': 5, 'necrom': 14, 'lori': 18, 'lillith': 5, 'cato': 11, 'unwarili': 2, 'jeanin': 1, 'reissuer': 1, 'wilhelm': 11, 'warecki': 1, 'marja': 3, 'janina': 1, 'unrepent': 8, 'hodgepodg': 17, 'heartland': 16, 'polaroid': 2, 'homestead': 9, 'pearc': 4, 'untap': 4, 'reformatori': 1, 'cuttingli': 1, 'tillman': 4, 'frf': 2, 'clam': 3, 'apricot': 1, 'dietrickson': 2, 'swath': 13, 'macmurray': 43, 'git': 2, 'incant': 2, 'gook': 4, 'morphosynthesi': 1, 'devoy': 1, 'stroud': 2, 'gail': 26, 'didia': 1, 'kearn': 1, 'molinaro': 2, 'surrel': 1, 'alden': 7, 'pathologist': 5, 'nowicki': 2, 'dogg': 8, 'impair': 14, 'mi5': 6, 'airlift': 11, 'sunroof': 1, 'holdal': 1, 'veloc': 1, 'sanctuari': 7, 'sinis': 9, 'mcandrew': 7, 'swig': 11, 'stoppabl': 1, 'gleeson': 10, 'inlay': 1, 'karnstein': 1, 'rehir': 1, 'drac': 2, 'examp': 1, 'simulacra': 1, 'lacanian': 7, 'jungian': 3, 'elmo': 11, 'stef': 1, 'benji': 6, 'megalon': 3, 'radiohead': 2, 'huffman': 3, 'unground': 1, 'tenenbaum': 3, 'junebug': 2, 'hypothet': 7, 'parakeet': 3, 'flattest': 3, 'girlpow': 1, 'pohler': 1, 'dratch': 8, 'oodl': 5, 'snarki': 6, 'redd': 8, 'mccain': 4, 'nbtn': 1, 'flatson': 1, 'jetsom': 1, '10x': 3, 'sharkbait': 1, 'octav': 2, 'paolo': 13, 'pasolini': 37, 'unfruit': 2, 'hungama': 10, 'hera': 15, 'pheri': 13, 'hunchul': 1, 'chupk': 6, 'dhol': 10, 'idiocraci': 3, 'kunal': 5, 'khemu': 3, 'yadav': 22, 'sharman': 5, 'joshi': 6, 'tusshar': 4, 'tanushre': 7, 'blanc': 19, 'superchick': 6, 'wingin': 1, 'swingin': 3, 'layov': 2, 'germaphob': 3, 'flasher': 1, 'veg': 1, 'astrologist': 1, 'jillson': 3, 'digard': 1, 'chesticl': 1, 'laff': 3, 'hobgobblin': 1, 'paltri': 16, 'augusta': 7, 'debaucheri': 6, 'contessa': 1, 'teresa': 12, 'guiccioli': 1, 'ravenna': 2, 'pisa': 2, 'gravit': 6, 'missolonghi': 1, 'gamba': 1, '1816': 2, 'plainspoken': 3, 'nike': 4, 'stoneheng': 3, 'englebert': 6, 'humperdink': 2, 'hyena': 15, 'jocelyn': 1, 'tighti': 2, 'whiti': 1, 'enchilada': 2, 'inbetween': 4, 'sbase': 1, 'ididn': 1, 'browni': 4, 'crahan': 1, 'denton': 4, 'duka': 2, 'guggenheim': 2, 'stix': 6, 'dickensian': 2, 'peppi': 4, 'compton': 5, 'expres': 1, 'corto': 1, 'guanajuato': 1, 'grafic': 1, '2d': 13, 'unexperienc': 4, 'bendi': 1, 'hai': 19, 'huuuuuuuarrrrghhhhhh': 1, 'hindenburg': 4, 'haaga': 1, 'mcdowal': 10, 'conglomer': 8, 'proxat': 1, 'usb': 1, 'prostat': 3, 'doosi': 1, 'katzman': 2, 'beak': 1, 'blowtorch': 3, 'refurbish': 2, 'batfan': 1, 'pyar': 14, 'mohan': 8, 'blacklist': 12, 'vivek': 3, 'oberoi': 3, 'saathiya': 1, 'thialnd': 1, 'bitterli': 17, 'casavett': 1, 'unvalid': 1, 'amidala': 2, 'ludicros': 2, 'biggi': 13, 'mite': 5, 'incl': 1, 'ozric': 1, 'snobberi': 10, 'churlish': 4, 'rauol': 1, 'dryfu': 1, 'meringu': 2, 'wqasn': 1, 'berrisford': 1, '332960073452': 1, 'unexpurg': 2, 'shashi': 3, 'waheeda': 1, 'ranjit': 3, 'prakash': 8, 'megastar': 1, 'disey': 1, 'mileu': 2, 'unmarri': 9, 'lasso': 1, 'vang': 1, 'sooth': 14, 'lumpiest': 1, 'odder': 2, 'jonathon': 10, 'burr': 22, 'deben': 7, 'imm': 1, 'schmo': 3, 'veterinarian': 5, 'whinni': 4, 'emmerich': 4, 'devlin': 5, 'virgini': 1, 'ledoyen': 2, 'udo': 10, 'kier': 8, 'aldofo': 1, 'thunderbal': 5, 'alida': 5, 'valli': 5, 'horst': 4, 'nicolosi': 1, 'saro': 1, 'upheld': 3, 'donal': 2, 'mccann': 3, 'cleanest': 4, 'pg13': 3, 'bullshit': 23, 'casanova': 16, 'satyricon': 4, 'rosentrass': 1, 'gymkata': 17, 'sypnopsi': 1, 'claric': 3, '8pm': 2, 'staci': 23, 'unshaken': 1, 'dewey': 13, 'awa': 3, 'zumhof': 1, 'okerland': 1, 'resneck': 1, 'georgeou': 1, 'garvin': 9, 'ringsid': 6, 'mispronounc': 4, 'gusset': 1, 'piledriv': 1, 'bockwinkl': 1, 'trongard': 1, 'lobe': 4, 'baddest': 10, 'gagn': 4, 'jumpin': 3, 'brunzel': 1, 'dropkick': 3, 'blackwel': 4, 'puhleeeez': 1, 'critis': 3, 'humorist': 11, 'sadism': 17, 'crytal': 1, 'lynd': 6, 'manger': 4, 'ewwww': 3, 'rabitt': 1, 'flunk': 6, 'grunberg': 4, 'darkroom': 2, 'journeyman': 3, 'dollhous': 2, 'pumkinhead': 1, 'mansquito': 1, 'hallucinationmi': 1, 'larissa': 2, 'codenam': 9, 'besson': 2, 'nikita': 8, 'orenth': 1, 'ponytail': 4, 'lacuna': 1, 'nattukku': 1, 'oru': 1, 'nallavan': 1, 'padayappa': 2, 'hibern': 5, 'tajmah': 1, 'kadal': 1, 'arjuna': 1, 'paarthal': 1, 'paravasam': 1, 'swasa': 1, 'katr': 1, 'vandicholai': 1, 'chinnarasu': 1, 'chandramukhi': 2, 'sivaji': 1, 'mofo': 3, 'midgetorgi': 1, 'incredi': 1, 'pressley': 3, 'pur': 3, 'awash': 4, 'nebula': 6, 'jung': 15, 'monochrom': 14, 'farlan': 7, 'memorabilia': 6, 'palo': 1, 'alto': 1, 'lawyerli': 1, 'antipod': 1, 'interlock': 2, 'nestor': 5, 'cantillana': 7, 'sylvio': 1, 'antonella': 5, 'solitud': 18, 'shalt': 3, 'explanatori': 7, 'overdid': 3, 'storyplot': 1, 'supernanni': 1, 'dd': 5, 'alexanad': 1, 'ashoka': 2, 'gandhian': 1, 'jaihind': 1, 'outward': 13, 'orthodoxi': 3, 'orthopraxi': 1, 'durang': 2, 'flighti': 8, 'stridenc': 1, 'ignatiu': 3, 'rabbi': 7, 'imam': 1, 'veriti': 2, 'ofcors': 1, 'trashcan': 2, 'notif': 2, 'breakin': 10, 'jamaican': 4, 'beani': 2, 'stepper': 8, 'flirti': 4, 'meagan': 1, 'keyshia': 1, 'rocsi': 1, 'deray': 1, 'carla': 87, 'lunchtim': 3, 'cassel': 34, 'whitehous': 4, 'untyp': 4, 'aaargh': 4, 'elsewis': 1, 'bonjour': 4, 'tristess': 4, 'sagan': 6, 'attemp': 1, 'garunte': 1, 'breather': 3, 'smelt': 2, 'barricad': 18, 'hardnut': 1, 'lamebrain': 1, 'abuzz': 2, 'bathous': 1, 'archeolog': 2, 'dufu': 2, 'artificat': 1, 'gizmo': 10, 'kyer': 1, 'shindig': 3, 'beset': 12, 'swami': 1, 'giggli': 7, 'rehabilit': 12, 'jap': 11, 'tojo': 4, 'quantrel': 1, 'rode': 15, 'mull': 4, 'shadowland': 2, 'fenton': 26, 'crucibl': 4, 'photograhi': 1, 'piqu': 8, 'alissia': 2, 'libr': 13, 'reguera': 3, 'nez': 6, 'wrest': 6, 'esqueleto': 1, 'chancho': 1, 'papercut': 1, 'afield': 3, 'dreyer': 6, 'cockili': 1, 'penal': 8, 'painterli': 6, 'cloudscap': 1, 'monsieur': 6, 'ennobl': 2, 'hessler': 4, 'cambreau': 2, 'vagin': 2, 'besties4lyf': 1, 'unse': 2, 'kneal': 2, 'caroon': 1, 'blag': 1, 'mete': 4, 'unaccount': 6, 'stinson': 1, 'parkin': 10, 'kevloun': 1, 'kruger': 14, 'giddeon': 1, 'reset': 7, 'timeworn': 1, 'pierson': 3, 'predefin': 1, 'softer': 10, 'concurr': 4, 'burnish': 4, 'loggin': 1, 'megalomania': 3, 'naha': 1, 'gargoyl': 6, 'gulfax': 6, 'incontrol': 1, 'snout': 3, 'expatri': 5, 'umm': 15, 'exorcismo': 2, 'storybook': 7, 'elen': 1, 'smilethey': 1, 'rhytmic': 1, 'upperhand': 1, 'qotsa': 1, '20minut': 1, 'menij': 1, 'praisenonetheless': 1, 'cornier': 2, 'butant': 7, 'fessenden': 12, 'spredako': 1, 'oti': 17, 'boz': 6, 'bertrand': 6, 'jeann': 17, 'camion': 1, 'carrefour': 1, 'valseus': 8, 'vals': 1, 'trustworthi': 10, 'chopstick': 5, 'kimono': 4, 'epyon': 2, 'anagram': 2, 'sputnik': 13, '1561': 1, 'annul': 2, 'montano': 7, 'cebuano': 4, 'panaghoy': 7, 'bisaya': 1, 'nipongo': 1, 'excursionist': 1, 'laughfest': 1, 'melvin': 19, 'brettschnied': 1, 'gnat': 4, 'rarefi': 7, 'schieder': 4, 'inaccess': 8, 'incenser': 1, 'coleridg': 6, '1798': 3, 'rime': 5, 'pogani': 1, 'schoolmast': 1, 'dasilva': 3, 'squalid': 8, 'puyn': 1, 'cheezi': 20, 'beautifulest': 1, 'proust': 9, 'recherch': 5, 'perdu': 2, 'principali': 1, 'proclam': 4, 'albertin': 1, 'balzac': 6, 'signif': 1, 'rousset': 1, 'swann': 3, 'charlu': 1, 'odett': 3, 'botticelli': 3, 'fallow': 7, 'puck': 3, 'sart': 1, 'clot': 1, 'retrouv': 1, 'perturb': 6, 'genett': 1, 'baudelair': 3, 'comtemporari': 1, 'bankrupt': 22, 'laird': 16, 'crump': 2, 'rodder': 5, 'nonpluss': 3, 'gelatin': 5, 'bopper': 8, 'gft': 10, 'mh': 1, 'dunsmor': 1, 'callipygian': 1, 'zann': 1, 'jalal': 2, 'brigg': 17, 'newslett': 3, 'hep': 3, 'loathesom': 1, 'troubadour': 4, 'listlessli': 2, 'troubi': 3, 'picquer': 1, 'condecens': 1, 'foywond': 1, 'offscreen': 12, 'tromp': 2, 'cushi': 2, 'pubert': 2, 'vaugier': 4, 'unidiomat': 1, 'ditti': 7, 'undertast': 1, 'timbr': 3, 'vexingli': 1, 'throati': 2, 'unconstruct': 1, 'roset': 1, 'zaragoza': 1, 'craggi': 9, 'balbao': 1, 'parlanc': 1, 'kristen': 19, 'legd': 2, 'chistoph': 1, 'kessler': 16, 'laughlin': 7, 'grayc': 9, 'remorseless': 3, 'pere': 8, 'brummi': 1, 'substori': 1, 'chandon': 8, 'jolson': 6, '500000': 1, 'mcnabb': 4, 'bossi': 9, 'velma': 8, 'magowan': 2, 'dunstan': 1, 'gonnab': 1, 'mammoth': 20, 'schlong': 3, 'domk': 2, 'zori': 3, 'uncomput': 1, '0s': 1, 'tinier': 1, 'rna': 2, 'cornea': 2, 'mulrooney': 1, 'farmiga': 2, 'charactur': 1, 'delawar': 5, 'goodlo': 1, 'homophobia': 12, 'wrecker': 1, 'mauri': 5, 'povich': 1, 'cupertino': 1, 'danielsen': 1, 'fig': 4, 'tokenist': 1, 'headphon': 12, 'mantra': 10, 'overambiti': 1, 'workandi': 1, 'sackvil': 1, 'baggins': 1, 'misheard': 1, 'voicework': 2, 'midpoint': 3, 'mulroni': 2, 'airdat': 1, 'hazmat': 1, 'heflin': 26, 'bainter': 2, 'stagestruck': 1, 'chestnut': 13, 'floradora': 1, 'hoschna': 1, 'lyricist': 6, 'harbach': 1, 'eggerth': 2, 'farfetch': 2, 'gerolmo': 4, 'ghoststori': 1, 'rk': 4, 'ghayal': 1, 'daminihi': 1, 'khake': 5, 'crapthi': 1, 'betterth': 1, 'lengthyajay': 1, 'subtleth': 1, 'thign': 1, 'drawneven': 1, 'outdirect': 1, 'okayajay': 1, 'pankaj': 1, 'dumbstruck': 3, 'stratham': 3, 'gnash': 4, 'essex': 10, 'gawf': 1, 'raliegh': 2, 'hothead': 2, 'intercept': 8, 'thrifti': 2, 'pucci': 2, 'dryer': 8, 'reav': 1, 'navada': 1, 'phibb': 1, 'taryn': 4, 'unlearn': 3, 'rapaport': 9, 'tyra': 8, 'phair': 1, 'roughest': 1, 'deull': 1, 'slicker': 14, 'underpaid': 3, 'versac': 2, 'theoriz': 8, 'dicey': 2, 'rs': 5, 'coyot': 22, 'roundabout': 6, 'luckiest': 3, 'perdit': 25, 'bakalienikoff': 1, 'frazier': 6, 'villaini': 12, 'gendarm': 1, 'mccrea': 6, 'screamer': 7, 'mcgovern': 24, 'ingwast': 1, 'urghh': 1, 'ammateur': 1, 'definatey': 1, 'nomenclatur': 2, 'thieveri': 4, 'unbelieveabl': 1, 'striven': 1, 'handbag': 6, 'broodi': 3, 'stubbl': 1, 'paedophilia': 7, 'housebound': 2, 'bankruptci': 12, 'underplot': 1, 'overplot': 2, 'enrapt': 2, 'myrtl': 49, 'uncalculatedli': 1, 'daringli': 6, 'corrod': 3, 'countercultur': 4, 'airspac': 2, 'hallow': 5, 'macromedia': 2, 'newground': 4, 'musculatur': 1, 'fresco': 3, 'florentin': 3, 'volumin': 1, 'rawal': 18, 'rimi': 3, 'dekho': 2, 'bantam': 3, 'stinger': 4, 'raptor': 29, 'kisna': 1, 'kazaam': 22, 'eminem': 2, 'linkin': 1, 'lancashir': 2, 'neighbourli': 1, 'naughton': 5, 'goldeney': 14, 'villan': 4, 'bartendar': 1, 'campiest': 1, 'guiness': 28, 'greenwood': 23, 'thesig': 10, 'daze': 22, 'tardli': 1, 'easthampton': 2, 'megabuck': 2, 'tensdoorp': 1, 'easthamptom': 1, 'woom': 1, 'reflector': 1, 'handkerchief': 7, 'harpsichord': 3, 'aslyum': 1, 'apolit': 2, 'dispassion': 11, 'unsubdu': 1, 'unescap': 2, 'definet': 6, 'molecular': 4, 'reorgan': 2, 'cara': 11, 'ozark': 3, 'dollmak': 1, 'tofu': 3, 'jasna': 1, 'stefanov': 1, 'handwork': 1, 'bijel': 1, 'fnm': 1, 'amic': 5, 'unwillingli': 7, 'cowhand': 2, 'larcen': 2, 'prospector': 9, 'genial': 10, 'foppish': 5, 'presumptu': 5, 'hickam': 14, 'riley': 26, 'rocketri': 4, 'catalan': 5, 'urib': 5, 'viaj': 2, 'peninsula': 8, 'iberica': 1, 'overdramatic': 1, 'evp': 10, '372': 1, 'lux': 4, 'bemusedli': 2, 'swiftli': 12, 'gerog': 3, 'charter': 12, 'edmonton': 2, 'alberta': 6, 'airforc': 1, 'canibalis': 1, 'basilisk': 5, 'jaja': 1, 'imodium': 1, 'rawson': 2, 'thurber': 2, 'lunchroom': 2, 'notat': 1, 'psychedelicrazi': 1, 'saranden': 1, 'envol': 1, 'squirlyem': 1, 'steepl': 3, 'artilleri': 11, 'workprint': 1, 'hemsley': 1, 'clevon': 2, 'skinamax': 1, 'maytim': 1, 'debonair': 13, 'matronli': 2, 'zord': 1, 'completley': 3, 'survil': 1, 'byhimself': 1, 'probali': 1, 'journo': 2, 'documentri': 2, 'underclass': 5, 'camadri': 1, 'storyvil': 2, 'greenhorn': 1, 'fordian': 1, 'dunde': 17, 'valedict': 1, 'cid': 4, 'bushfir': 1, 'manhat': 1, 'girlfight': 21, 'violant': 2, 'healthier': 3, 'tewksburi': 3, 'cortney': 1, 'baaaad': 1, 'eroticu': 1, 'spiderbab': 1, 'trubshaw': 1, 'sofaer': 3, '59': 5, 'philologist': 2, 'unnotic': 2, 'farscap': 9, 'trekker': 4, 'holliman': 7, 'daniella': 9, 'polanksi': 3, 'tarasco': 1, 'losco': 1, 'blab': 2, 'utilitarian': 2, 'geometr': 12, 'shipyard': 4, 'koyaanisqatsi': 10, 'varieg': 1, 'dockyard': 2, 'symmetr': 4, 'athena': 5, 'hemi': 4, 'yugoslavian': 4, 'vannoord': 2, 'nlthe': 1, 'nl': 2, 'compendium': 2, 'langley': 7, 'naunton': 3, 'wilfrid': 3, 'aylmer': 3, 'verger': 9, 'hayter': 6, 'parish': 2, 'hordern': 6, 'tobacconist': 2, 'kelada': 5, 'jest': 5, 'morel': 5, 'culver': 5, 'lifer': 8, 'michen': 5, 'roost': 2, 'miyoshi': 7, 'umeki': 12, 'miiko': 3, 'taka': 10, 'yochobel': 1, 'newscast': 9, 'gravest': 1, 'dreg': 11, 'sike': 10, 'unsulli': 3, 'untri': 2, 'feu': 1, 'follet': 1, 'entomologist': 2, 'tisserand': 5, 'clouzot': 3, 'rouen': 3, 'maupass': 6, 'myron': 13, 'copenhagen': 6, 'mulher': 1, 'certo': 1, 'ponto': 1, 'kibbutz': 28, 'lifethi': 1, 'calv': 2, 'kibbutznikim': 1, 'misogyni': 19, 'cultism': 1, 'allegi': 11, 'overseen': 4, 'sheilah': 3, 'bunk': 9, 'salaci': 18, 'funnest': 5, 'capitalis': 6, 'rainstorm': 7, 'umbrag': 6, 'clanci': 4, 'ebenez': 14, 'monoxid': 2, 'msted': 1, 'aladdin': 8, 'djinn': 5, 'yew': 1, 'stapelton': 1, 'ding': 12, 'dogtown': 3, 'peralta': 17, 'boogeyboard': 1, 'southeast': 7, 'blimp': 10, 'aircrew': 1, 'kevnjeff': 1, 'ehl': 2, 'cackl': 15, 'maniti': 1, 'corenblith': 1, 'ryack': 1, 'slyli': 5, 'xbox': 4, 'darro': 3, 'cristiano': 3, 'landfil': 11, 'cama': 6, 'gato': 6, 'caio': 2, 'blat': 3, 'mouldi': 1, 'soberingli': 1, 'andersen': 5, 'leila': 17, 'winemak': 1, 'haht': 1, 'heah': 2, 'unwrap': 4, 'duchovoni': 4, 'sensationalis': 7, 'excav': 6, 'anubi': 3, 'phosphor': 1, 'just': 1, 'magnifisc': 1, 'wonderful': 3, 'carni': 3, 'vy': 9, 'taffi': 10, 'overcook': 5, 'lieu': 11, 'thing1': 1, 'sodden': 4, 'firewood': 2, 'bitva': 1, 'kosmo': 1, 'ue': 2, 'korolev': 5, 'nkvd': 1, 'glushko': 1, 'mishin': 1, 'gagarin': 3, 'db': 2, 'chevett': 1, 'kraakman': 3, 'nanouk': 1, 'johanna': 3, 'ter': 3, 'steeg': 1, 'obscura': 5, 'yokhai': 2, 'andromedia': 1, 'tpm': 2, 'tadashi': 13, 'sato': 10, 'sunekosuri': 2, 'rile': 4, 'akuzi': 1, 'overlay': 6, 'veeringli': 1, 'northang': 4, 'abbey': 24, 'freindship': 1, 'sanditon': 1, 'regenc': 11, 'clergyman': 6, 'garrul': 1, 'chide': 7, 'surnam': 9, 'mediaev': 2, 'gauch': 5, 'twentysometh': 6, 'ruffianli': 1, 'thatch': 8, 'serb': 28, 'bleh': 2, 'heathcliff': 8, 'hindley': 2, 'hendrix': 22, 'whitworth': 2, 'heigl': 11, 'blameless': 3, 'chomp': 16, 'hugger': 3, 'maim': 5, 'more4': 1, 'weeni': 4, 'ave': 7, 'censu': 1, 'highbrow': 8, 'beart': 3, 'jgar': 3, 'morrissey': 16, 'grapefruit': 3, 'jg': 4, 'mensa': 3, '00015': 1, 'lint': 4, 'noggin': 7, 'ack': 2, 'hemorrhag': 6, 'supersentiment': 1, 'unload': 7, 'garson': 21, 'dugan': 8, 'dobson': 11, 'bobrick': 2, 'duggan': 6, 'ohhh': 8, 'grump': 2, 'twang': 10, 'slapi': 1, 'crypton': 1, 'boringlan': 1, 'beirut': 6, 'edgier': 6, 'lue': 1, 'leggag': 1, 'tomi': 2, 'cantinfla': 1, 'unblat': 1, 'phieffer': 1, 'probalbi': 1, 'stricter': 1, 'cougar': 2, 'levelhead': 1, 'floozi': 12, 'fixer': 4, 'revist': 1, 'deplet': 5, 'succinct': 8, 'unambigu': 3, 'futuris': 1, 'underpopul': 1, 'bourbon': 6, 'celeri': 4, 'euthenas': 1, 'fauna': 3, 'longev': 11, 'uncheck': 3, 'puffi': 8, 'evertytim': 1, 'peepl': 2, 'spineless': 13, 'heeellllo': 1, 'aloi': 5, 'munich': 9, 'eckart': 1, 'hanfstaengl': 4, 'fuehrer': 3, 'yeti': 78, 'travelodg': 1, 'childishli': 12, 'icc': 1, 'petwe': 1, 'br': 2, 'cke': 1, 'enthusiam': 1, 'demo': 9, 'reoccur': 6, 'entourag': 14, 'abductor': 5, 'curser': 1, 'conson': 1, 'salesmanship': 1, 'nondescript': 12, 'remar': 4, 'distend': 2, 'kafkaesqu': 4, 'lodger': 9, 'deverel': 1, 'gregson': 5, '8763': 1, 'cm': 2, 'schiller': 3, 'misde': 6, 'mallori': 14, 'gq': 2, 'latinamerica': 1, 'lowlevel': 1, 'lowpric': 1, 'shiztz': 1, 'arnetia': 2, 'sparklingli': 2, '42nd': 22, 'disneyf': 2, 'funiest': 1, 'reali': 3, 'bartram': 10, 'juggl': 15, 'apollonia': 12, 'flashdanc': 13, 'luv': 5, 'cudo': 1, 'endemol': 2, 'kidney': 13, 'embaras': 1, 'bostwick': 7, 'takeaway': 1, 'druggi': 8, 'syriana': 11, 'friz': 4, 'freleng': 5, 'gonzalez': 12, 'mckimson': 1, 'tweeti': 3, 'duller': 9, 'cojon': 6, 'enyclopedia': 1, 'ramgop': 8, 'aag': 26, 'veeru': 5, 'watertank': 1, 'clang': 7, 'sushmita': 8, 'devi': 4, 'mohanl': 14, 'prashant': 19, 'nisha': 17, 'kothari': 14, 'ghunghroo': 1, 'hema': 1, 'malini': 1, 'basanti': 9, 'babban': 17, 'gabbar': 13, 'sarkar': 8, 'bhatur': 1, 'daag': 2, 'kurasawa': 7, 'bagdad': 31, 'jaffar': 31, 'akward': 2, 'blalock': 7, 'jism': 2, 'aaaaatch': 1, 'kah': 1, 'rebar': 6, 'geiger': 7, 'supervillian': 1, 'phsycot': 1, 'pasti': 6, 'britcom': 4, 'mccaffrey': 1, 'scriptwis': 2, 'authoris': 2, 'acced': 4, 'dof': 1, 'sthi': 1, 'extric': 4, 'disabus': 3, 'misapprehens': 1, 'dooblebop': 1, 'masami': 1, 'hata': 1, 'suzu': 1, 'schaech': 14, 'hotlin': 2, 'ruse': 13, 'schertler': 1, 'memama': 3, 'ludvig': 3, 'borga': 4, 'jannetti': 4, 'babyfac': 3, 'intercontinent': 10, 'doink': 5, 'lawler': 13, 'akeem': 1, 'luger': 12, 'wwwf': 1, 'summerslam': 6, 'jogger': 4, 'frankenfish': 1, 'larenz': 2, 'lymon': 3, 'nunez': 11, 'lela': 1, 'berri': 34, 'vivica': 2, 'statuari': 1, 'diri': 1, 'fransisco': 4, 'susanah': 1, 'casett': 1, 'fopington': 1, 'bannen': 8, 'dev': 28, 'zeenat': 7, 'aman': 5, 'pageant': 10, 'bespectacl': 4, 'chirpi': 4, 'mumtaz': 4, 'pard': 2, 'posses': 3, 'sumamr': 1, 'ungrasp': 2, 'flinston': 3, 'boobytrap': 2, 'grungi': 11, 'multicultur': 4, 'wessel': 1, 'neapolitan': 2, 'fishwif': 1, 'yearli': 10, 'groaningli': 1, 'willoughbi': 4, 'smelli': 8, 'toledo': 2, 'chross': 1, 'hawkey': 1, 'barroom': 4, 'vanner': 1, 'pepe': 4, 'footlight': 26, 'playgirl': 2, 'unbeknown': 4, 'bojangl': 3, 'unrehears': 4, 'fargan': 1, 'glynni': 1, 'vendor': 9, 'sudi': 1, 'd2': 5, 'recor': 2, 'plop': 4, 'seediest': 2, 'apon': 1, 'capo': 5, 'voyer': 1, 'freshest': 3, 'livia': 5, 'boundri': 2, 'klienfelt': 1, 'carltio': 1, 'anynom': 1, 'clouseau': 9, 'frill': 10, 'gwenn': 2, 'traill': 1, 'greyfriar': 1, 'angeliqu': 5, 'trant': 3, 'followup': 3, 'spinel': 2, 'glaze': 9, 'shlock': 8, 'sorceress': 4, 'wooki': 3, 'dalek': 5, 'butterfac': 1, 'ocron': 3, 'kilometr': 1, 'tolerantli': 1, 'eyelash': 2, 'clanger': 1, 'kiwi': 5, 'surrey': 1, 'fraudster': 1, 'cornwel': 3, 'queda': 1, 'wendel': 5, 'duplex': 4, 'softporn': 1, 'krista': 11, 'nell': 31, 'eurosleaz': 1, 'birdman': 1, 'chihuahuawoman': 1, 'poseur': 2, 'pendul': 1, 'felinni': 1, 'transamerica': 1, 'tay': 8, 'garnett': 2, 'blooey': 1, 'barclay': 13, 'lewton': 17, 'rosetto': 1, 'hollaway': 1, 'lonesom': 8, 'murderess': 8, 'pulchritudin': 1, 'vampiress': 7, 'parslow': 2, 'omnibu': 10, 'whick': 1, 'antarctica': 8, 'libel': 3, 'spottiswood': 1, 'calgari': 1, 'kenn': 1, 'borek': 1, 'rl': 4, 'reinhold': 16, 'sloppier': 2, 'merrideth': 1, 'denic': 1, 'bloodstorm': 1, 'subspeci': 2, 'bollix': 1, 'showstop': 1, 'chais': 2, 'legisl': 2, 'pilmark': 2, 'lene': 1, 'poulsen': 1, 'dreamstat': 1, 'longwind': 1, 'allevi': 8, 'lodi': 1, 'srathairn': 1, 'smoulder': 5, 'henreid': 1, 'deaththreat': 1, 'powerdril': 1, 'cauffiel': 2, 'buress': 1, 'bleedmedri': 1, 'hottub': 1, 'audiovisu': 2, 'lowpoint': 4, 'bullsey': 6, 'pestilenti': 1, 'sicili': 7, 'sicilian': 9, 'expedi': 6, 'massironi': 1, 'littizzetto': 1, 'overestim': 3, 'gigilo': 1, 'bonin': 1, 'privaci': 12, 'doin': 2, 'benefactor': 8, 'samey': 2, 'mssr': 2, 'newt': 2, 'misanthrop': 9, 'screed': 4, 'pko': 1, 'eulog': 12, 'donoghu': 2, 'thsi': 2, 'flixmedia': 1, 'interperson': 8, 'squillion': 1, 'spinner': 2, 'philanthropist': 5, 'blanka': 1, 'sledg': 17, 'outrid': 1, 'kinmont': 2, 'amish': 5, 'kobe': 2, 'vortex': 13, 'fidani': 6, 'spiritist': 1, 'testa': 5, 'ferro': 1, 'pelicula': 1, 'lazio': 1, 'ingenuo': 1, 'dementi': 1, 'americain': 3, 'comporta': 1, 'fugac': 1, 'renzo': 1, 'arbor': 5, 'ugghhh': 2, 'coogan': 6, 'bluff': 11, 'interceptor': 4, 'kutchek': 2, 'napalm': 10, 'arliss': 5, 'pyrokinet': 1, 'unbeknownest': 2, 'pyro': 2, 'preoccupi': 8, 'acapella': 2, 'canto': 8, 'kriemhild': 35, 'siegfri': 20, 'attila': 12, 'diger': 8, 'bechlarn': 2, 'tronj': 9, 'adalbert': 1, 'schlettow': 1, 'hun': 17, 'bechlar': 1, 'nibelungen': 13, 'solstic': 2, 'giselh': 1, 'gernot': 1, 'guhther': 1, 'os': 6, 'nibelungo': 1, 'vingan': 2, 'kriemshild': 1, 'hooch': 5, 'aiken': 9, 'lemoni': 2, 'snicket': 2, 'hert': 1, 'monstroid': 1, 'rapp': 8, 'hailston': 1, 'rationalist': 4, 'arcan': 14, 'fleshpot': 1, 'boffin': 2, 'loonytoon': 1, 'poppingli': 2, 'cardiovascular': 1, 'jost': 3, 'vacano': 2, 'landslid': 2, 'giacchino': 1, 'flashforward': 3, 'nanavati': 7, 'zivagho': 1, 'creme': 6, 'doubli': 13, 'champaign': 2, 'bullshot': 1, 'physicist': 13, 'electro': 3, 'whiplash': 3, 'gingrich': 1, 'gonif': 1, 'kotch': 1, 'morland': 2, 'sak': 8, 'hollist': 3, 'sabra': 2, 'fowl': 2, 'unqualifi': 3, 'prizzi': 10, 'partanna': 4, 'maeros': 1, 'consequenti': 2, 'picturewa': 1, 'entelechi': 1, 'bartley': 4, 'donnacha': 4, 'briain': 3, 'overaggress': 1, 'prada': 6, 'apeal': 1, 'feal': 1, 'goodrich': 8, 'shemp': 27, 'accordion': 2, 'hotch': 3, 'potch': 3, 'surya': 2, 'nerukku': 1, 'ner': 1, 'acp': 2, 'anbuselvan': 1, 'midwestern': 9, 'acn': 4, 'shortag': 21, 'bungalow': 5, 'flaki': 7, 'overag': 2, 'wellit': 1, 'realisticeven': 1, 'lifei': 1, 'homefor': 1, 'lennart': 3, 'kink': 9, 'gaga': 2, 'liberac': 2, 'misguidedli': 2, 'crooner': 3, 'sophisticatedli': 1, 'watersh': 5, 'berman': 13, 'titu': 4, 'marriott': 3, 'chro': 1, 'sig': 4, 'ruman': 2, 'dysfunctin': 1, 'guruk': 1, 'desai': 8, 'raghupati': 1, 'raghava': 1, 'callow': 3, 'yaowwww': 1, 'hte': 1, 'itun': 4, 'bruan': 1, 'agin': 4, 'stool': 11, 'falsiti': 3, 'macdowel': 19, 'imelda': 5, 'staunton': 6, 'phonu': 1, 'bolognu': 1, 'horticulturalist': 2, 'havarti': 1, 'limburg': 1, 'mausoleum': 4, 'velveeta': 2, 'werdegast': 1, 'hjalmar': 1, 'poelzig': 1, 'cartoonist': 10, 'slowmot': 1, 'filmhistori': 1, 'propper': 1, 'miraglio': 1, 'madwoman': 2, 'bouchet': 14, 'hummabl': 5, 'wurzburg': 1, 'ugo': 3, 'pagliai': 1, 'hilda': 15, 'coe': 20, 'barrot': 1, 'wrede': 1, 'multidimension': 4, 'gyneth': 1, 'abolition': 1, 'powaqqatsi': 3, 'immobil': 5, 'assing': 1, 'frankfurt': 3, 'katharina': 6, 'hartmann': 7, 'sukowa': 7, 'horticulturist': 2, 'tcheki': 2, 'karyo': 3, 'ryker': 8, 'eleventh': 4, 'gravedigg': 11, 'gloomier': 2, 'crashingli': 2, 'harburg': 2, 'adieu': 6, 'lachlan': 2, 'sibbl': 1, 'fishey': 1, 'mutin': 2, 'americian': 1, '30am': 2, 'carnival': 2, 'misshapen': 1, 'irreconcil': 3, 'andru': 2, 'idaho': 9, 'taskmast': 1, 'draconian': 4, 'incorrig': 3, 'hellion': 6, 'contour': 3, 'flinti': 3, 'hedlund': 1, 'songsmith': 1, 'horseshit': 1, 'fintail': 1, 'brita': 1, 'bissel': 2, 'bobb': 2, 'augi': 2, 'mclovin': 1, 'mintz': 3, 'plass': 3, 'cyclop': 9, 'sedgwick': 6, 'adroit': 5, 'haley': 19, 'kansan': 2, 'rosina': 2, 'rinaldo': 2, 'lyda': 2, 'roberti': 1, 'harmonica': 4, 'heisei': 2, 'godzillasauru': 1, 'tristar': 2, 'slobber': 5, 'lamont': 8, 'sanford': 4, 'scenc': 1, 'existi': 1, 'glamou': 1, 'nage': 5, 'troi': 11, 'theyu': 1, 'tha': 10, 'overabund': 5, 'dixi': 5, 'runnin': 3, 'gurl': 2, 'haun': 4, 'forceabl': 1, 'phoeb': 4, 'kopsa': 1, 'klerk': 1, 'verili': 1, 'ulcer': 2, 'levittown': 1, 'firebrand': 2, 'congresswoman': 3, 'gahagan': 1, 'robard': 8, 'zomcom': 6, 'coffinand': 1, 'aloha': 3, 'sufic': 1, 'fraidi': 4, 'dinnerladi': 2, 'acquiesc': 3, 'hierarchi': 10, 'brion': 3, 'hypnotist': 9, 'bizarro': 6, 'peppermint': 4, 'baa': 1, 'schroeder': 7, 'lanki': 9, 'woodrel': 1, 'backwat': 6, 'unionist': 2, 'interpos': 3, 'unglamoris': 1, 'mamooth': 1, 'hazenut': 1, 'munchausen': 5, 'zazu': 2, 'derita': 1, 'besser': 3, 'partisanship': 1, '3am': 6, 'cspan': 1, 'kusturica': 39, 'talladega': 1, 'acupat': 1, 'eod': 13, '131': 3, 'stigg': 2, 'herek': 2, 'techi': 4, 'mordrid': 27, 'kabal': 11, 'prophesi': 5, 'pantsuit': 1, 'sickl': 3, 'gingerdead': 1, 'penpush': 1, 'entomolog': 2, 'mongoos': 1, 'js': 2, 'theoffic': 1, 'farrago': 5, '14yr': 1, 'onion': 12, 'filament': 1, 'gaea': 1, 'poland': 15, 'notar': 1, 'margarin': 3, 'handov': 3, 'tampax': 1, 'sharkish': 1, 'dominiqu': 15, 'corsair': 4, 'urdu': 4, 'municipalian': 4, 'henni': 4, 'youngman': 3, 'horizont': 5, 'rtd': 1, 'nagurski': 5, 'acetylen': 1, 'steev': 1, 'philadelpia': 1, 'yan': 5, 'gangfight': 1, 'shiu': 1, 'schizoid': 2, '70th': 3, 'wotw': 2, 'reddish': 3, 'retrograd': 4, 'pomad': 1, 'larder': 1, 'abbrevi': 6, 'bauman': 2, 'artilleryman': 2, 'lathrop': 1, 'overindulg': 6, 'nightlif': 5, 'flynt': 1, 'pillori': 3, 'uncomprehend': 4, 'hackeri': 1, 'andress': 5, 'coutard': 1, 'seneg': 4, 'egyptologist': 9, 'parchment': 1, 'epicent': 1, 'schaffner': 5, 'softest': 2, 'shrieff': 1, 'abigail': 26, 'meercat': 3, 'funney': 3, 'ae': 36, '60th': 2, 'jun': 11, 'jong': 13, 'crazier': 16, 'milyang': 10, 'seminar': 11, '6k': 2, '4k': 2, '2k': 2, 'hwd': 1, 'glyllenhal': 1, 'geena': 3, 'msr': 1, 'onetim': 3, 'watertight': 1, 'galindo': 3, 'compatriot': 5, 'mauricio': 5, 'fiercest': 2, 'alejandra': 3, 'uttermost': 1, 'filo': 1, 'caballo': 1, 'armouri': 3, 'gallindo': 2, 'bogeyman': 9, 'kruegar': 1, 'crossbre': 4, 'majorett': 2, 'palmer': 16, 'ctu': 3, 'scaryt': 1, 'knok': 1, '819': 1, 'physiolog': 5, 'earphon': 2, 'spiventa': 4, 'farmhous': 8, 'driveway': 10, 'cortez': 37, 'transcriptionist': 1, 'pdf': 4, '109': 5, 'godspe': 1, 'himmelen': 6, 'ammunit': 14, 'spotter': 2, 'hairshirt': 1, 'sheba': 3, 'babett': 12, 'indebted': 2, 'cantor': 4, '127': 1, 'brideless': 6, '128': 3, 'submittedjay': 1, 'caviti': 6, 'chickenpox': 1, 'centric': 2, 'desdemona': 22, 'priorit': 2, 'dun': 13, 'rachford': 1, 'rd': 10, 'soupi': 2, 'hoydenish': 1, 'westlak': 2, 'attourney': 2, 'antediluvian': 1, 'bizzzzar': 1, 'kinear': 3, 'kaig': 2, 'angrili': 12, 'nitrou': 3, 'oxid': 3, 'molar': 1, 'hygien': 4, 'frankenstien': 1, 'cortner': 1, 'illiteraci': 11, 'tuna': 5, 'guillermo': 7, 'eisenstein': 11, 'aronofski': 4, 'ordet': 1, 'akshey': 3, 'neha': 8, 'dupia': 3, 'preetam': 1, 'anthropolog': 4, 'tamilyn': 1, 'tomita': 3, 'norway': 20, 'viet': 14, 'cong': 3, 'nva': 1, 'strada': 3, 'shockumenari': 1, 'indispens': 1, 'minimis': 5, 'verbatum': 1, 'ualiti': 1, 'lanza': 39, 'aria': 13, 'caruso': 38, 'rafael': 13, 'asi': 1, 'dayan': 1, 'tali': 2, 'pangborn': 3, 'salon': 13, 'butterworth': 7, 'murph': 1, 'hiltz': 6, 'malcom': 10, 'whay': 1, '2013': 1, 'seadli': 1, 'vip': 5, 'shiri': 8, 'applebi': 11, 'singelton': 1, 'advertisementsfor': 1, 'recrimin': 2, 'displac': 15, 'dorn': 7, 'goren': 1, 'isabov': 1, 'prefigur': 2, 'talkingpublicist': 1, 'itsmoment': 1, 'pointcount': 1, 'longand': 1, 'movieunfortun': 1, 'forgetfulgirlfriend': 1, 'wisest': 2, 'drafte': 5, 'blowhard': 5, 'convalesc': 3, 'brokenheart': 1, 'gweneth': 1, 'braintrust': 1, 'greenlight': 17, 'woooooosaaaaaah': 1, 'twentyf': 1, '9th': 16, 'diem': 2, 'flabbergastingli': 1, 'brundag': 2, 'filmcrit': 3, 'confuci': 1, 'mulholland': 15, 'mancini': 5, '169': 2, 'royston': 12, 'vasey': 12, 'tubb': 6, 'edwrad': 1, 'chastiti': 11, 'briss': 2, 'chinneri': 3, 'geoff': 7, 'tipp': 2, 'noseble': 4, 'sobr': 2, 'simil': 3, 'mcguffin': 6, 'hatti': 14, 'lustr': 3, 'metalstorm': 1, 'forbad': 3, 'hadda': 1, 'billyclub': 1, 'alotta': 1, 'vagabond': 8, 'wino': 3, 'nickelodean': 1, 'giss': 2, 'teagu': 2, 'fium': 1, 'caimano': 1, 'isola': 1, 'degli': 2, 'pesc': 1, 'montagna': 1, 'dio': 3, 'cannibal': 1, 'pufnstuff': 3, 'witchiepoo': 2, 'undergrad': 3, 'ciano': 3, 'edda': 1, 'mandarin': 7, 'dolemit': 16, 'gon': 1, 'mayn': 5, 'infantalis': 1, 'rou': 1, 'orientalist': 1, 'inscrut': 7, 'bayonet': 3, 'unti': 4, 'hel': 1, 'quarantin': 7, 'sar': 5, 'guttur': 8, 'hydrospher': 1, 'cupboard': 13, 'psoriasi': 1, 'voucher': 3, 'supplementari': 3, 'creepazoid': 1, 'oy': 9, 'foo': 17, 'agnost': 9, 'machism': 1, 'houseboat': 10, 'elizabethtown': 2, 'apostroph': 2, 'unneed': 10, 'telekinesi': 5, 'brunel': 3, 'zonfeld': 1, 'towney': 1, 'morlar': 2, 'delilah': 4, 'doff': 2, 'egan': 24, 'trundl': 1, 'weigang': 5, 'vaterland': 2, 'nook': 4, 'sila': 7, 'rosetti': 2, 'tranni': 1, 'schaefer': 2, 'mcparland': 2, 'henchwoman': 3, 'yubari': 1, 'animatron': 14, 'spierlberg': 1, 'sorrel': 2, 'shroyer': 1, 'dissappoint': 5, 'mvie': 1, 'kralik': 17, 'klara': 10, 'matuschek': 22, 'pirovitch': 5, 'vada': 5, 'pepi': 7, 'katona': 3, 'simplypatholog': 1, 'secondsthrough': 1, 'evenbriefli': 1, 'figt': 1, 'madcap': 9, 'amelia': 6, 'earhart': 2, 'aviatrix': 1, 'arzner': 2, 'frankau': 1, 'schlessing': 1, 'cammi': 1, 'bouncer': 4, 'outcri': 5, 'cyndi': 4, 'lauper': 2, 'harl': 4, 'najimi': 7, 'wagter': 2, 'hu': 4, 'benja': 1, 'bruijn': 1, 'hensema': 2, 'appart': 2, 'mirth': 3, 'horiibl': 1, 'adaptaion': 2, 'riser': 2, 'fonterbra': 1, 'schramm': 4, 'individualist': 4, 'lovelif': 1, 'abm': 3, 'lenghten': 1, 'dodesukaden': 1, 'shipley': 6, 'stubbornli': 7, 'manitoba': 5, 'manawaka': 3, 'shackl': 5, 'bram': 13, 'zeger': 1, 'groovin': 5, 'orkli': 3, 'tamakwa': 3, 'counsellor': 4, 'walkman': 3, 'moos': 11, 'toothpast': 3, 'winterbottom': 2, 'vespa': 1, 'extas': 4, 'widest': 3, 'deutsch': 1, 'fecund': 3, 'vertov': 2, 'golightli': 1, 'telefilm': 6, 'corkymet': 1, 'alin': 9, 'macmahon': 15, 'linden': 13, 'blandick': 3, 'tyke': 5, 'patterson': 9, 'dobi': 3, 'collinson': 1, 'spirt': 2, 'cringer': 1, 'ocker': 2, 'crocker': 5, 'hatchard': 1, 'caregiv': 2, 'hottest': 28, 'password': 4, 'appolina': 1, 'aninm': 1, 'wierdo': 2, 'lecarr': 7, 'karla': 3, 'mcmurti': 1, 'glaudini': 1, 'assant': 3, 'gaudini': 1, 'arggh': 1, 'nooooooo': 3, 'feeder': 1, 'noce': 2, 'heterogen': 2, 'garrel': 2, 'duvivi': 7, 'paniqu': 1, 'castel': 5, 'violett': 1, 'nozi': 1, 're': 7, 'muscic': 1, 'lybia': 1, 'gadafi': 1, 'videodisc': 3, 'waterboy': 2, 'elizabethan': 8, 'cartland': 4, 'thenc': 2, 'elast': 3, 'vashon': 2, 'crewman': 1, 'ensnar': 5, 'untrustworthi': 4, 'auburn': 3, 'obliter': 13, 'scorch': 10, 'breathi': 1, 'frothi': 10, 'yonica': 10, 'lanford': 2, 'stimuli': 2, 'tessi': 3, 'regener': 13, 'meighan': 3, 'sidetrack': 7, 'enliven': 16, 'droningli': 1, 'appolonia': 7, 'katelin': 4, 'thescreamonlin': 1, 'observantli': 1, 'explic': 3, 'lowood': 8, 'soad': 1, 'pared': 4, 'invierno': 1, 'pablo': 13, 'fortunant': 1, 'dragonlord': 4, 'raph': 2, 'sculpt': 6, 'plastron': 1, 'andra': 1, 'graze': 5, 'smugli': 5, 'lilt': 4, 'astoundingli': 16, 'tila': 1, 'gaydar': 1, 'operahous': 1, 'cya': 2, 'indiscretionari': 1, 'standoffish': 2, 'xu': 9, 'hzu': 1, 'bigelow': 23, 'gandofini': 2, 'valco': 14, 'dryli': 4, 'morningstar': 1, 'duchovani': 1, 'nigh': 15, 'heyijustleftmycoatbehind': 1, 'curvac': 4, 'melton': 4, 'balder': 1, 'bustiest': 2, 'stealthili': 4, 'hah': 9, 'desilva': 3, 'nothingcon': 1, 'everythingplot': 1, 'tzc': 2, 'craptacular': 3, 'bajillion': 1, 'smalltown': 3, 'panhandl': 7, 'riviera': 4, 'gait': 4, 'ule': 5, 'leith': 7, 'shari': 1, 'airborn': 6, 'jasn': 1, 'brenna': 1, 'horrror': 1, 'hamm': 7, 'syntact': 1, 'epithet': 4, 'orneri': 5, 'boister': 12, 'mclendon': 1, 'vangard': 1, 'condol': 3, 'huntsvil': 2, 'vanguard': 4, 'v2': 2, 'redston': 1, 'booster': 5, 'grissom': 2, 'doofu': 3, 'karadz': 2, 'sdp': 2, 'referendum': 2, 'secess': 1, 'idap': 2, 'alija': 1, 'izetbegov': 3, 'stth': 1, 'kampf': 1, 'coexist': 6, 'fikret': 1, 'abdic': 4, 'bluesi': 2, 'hammin': 1, 'tenaci': 8, 'stave': 4, 'aneur': 2, 'kneecap': 3, 'littlest': 4, 'squirmer': 2, 'silverfox': 2, 'coldblood': 1, 'headbutt': 3, 'retold': 7, 'readjust': 4, 'windsor': 11, 'bandstand': 2, 'cello': 4, 'leven': 10, 'bigley': 2, 'sharaff': 2, 'deerhunt': 4, 'alvira': 1, 'bomba': 1, 'lettieri': 5, 'federal': 1, 'rey': 14, 'hogu': 1, 'kojak': 7, 'paco': 6, 'aragon': 2, 'boleyn': 5, 'facin': 2, 'acur': 1, 'predominantli': 13, 'thereon': 3, 'bs': 18, 'whopper': 3, 'almeida': 5, 'torqu': 3, 'knockabout': 5, 'overbearingli': 1, 'stoopid': 2, 'sudetanland': 1, 'hoist': 7, 'petard': 1, 'background2': 1, 'presson': 6, 'stageplay': 2, 'rubik': 4, 'inventinv': 1, 'neatnik': 2, 'messiest': 2, 'gees': 2, 'aristocat': 1, 'gnashingli': 1, 'blandest': 4, 'darlington': 2, 'erlynn': 1, 'deran': 3, 'serafian': 1, 'sarafian': 5, 'stoker': 7, 'roemenian': 1, 'teppish': 1, 'emigr': 16, 'anbuchelvan': 1, 'jyothika': 2, 'pandia': 2, 'jeevan': 2, 'itfa': 1, 'balaji': 1, 'devadharshini': 1, 'jeyaraj': 2, 'bgm': 1, 'rajasekhar': 1, 'hein': 1, 'kaakha': 8, 'hairdew': 1, 'cornfield': 10, 'gorier': 6, 'gymnastix': 1, 'indetermin': 3, 'bespeak': 1, 'raskolnikov': 1, '232': 3, 'sd': 4, '231': 1, '233': 2, 'settler': 6, 'squaw': 5, 'corsican': 1, 'footmat': 1, 'carpetbagg': 2, 'foresay': 1, 'dalli': 3, 'gracia': 17, 'comiti': 1, 'boobaci': 1, 'rollneck': 1, 'procrastin': 6, 'pliant': 1, 'jailhous': 5, 'creol': 6, 'identikit': 2, 'gingernut': 1, 'motorway': 3, 'stiffest': 1, 'iroquoi': 2, 'grasper': 1, 'nitro': 6, 'yonfan': 1, 'edif': 2, 'taipei': 1, 'takeko': 4, 'grievanc': 6, 'unmov': 8, 'homebas': 1, 'lightyear': 2, 'mammari': 3, 'av': 3, 'playlist': 1, 'glb': 1, 'sc': 7, 'holcomb': 6, 'edgerton': 4, 'ks': 10, 'radianc': 2, 'audley': 3, 'malefic': 2, 'rooten': 2, 'jaq': 8, 'phipp': 3, 'verna': 3, 'felton': 4, 'vibranc': 6, 'hardback': 2, 'ley': 1, 'herod': 3, 'bajo': 1, 'mam': 3, 'tambi': 2, 'coronel': 4, 'tien': 1, 'quien': 1, 'escriba': 1, 'rquez': 3, 'compadr': 1, 'hmv': 4, 'bodysurf': 1, 'rincon': 2, 'kalama': 1, 'downingtown': 2, 'phoenixvil': 3, 'scales': 2, 'bellevu': 1, 'blackpool': 1, 'nerdish': 3, 'lordli': 2, 'whammi': 6, 'barrett': 19, 'hoopl': 1, 'rutl': 1, 'blodwyn': 1, 'steeley': 1, 'extreamli': 1, 'wrassl': 1, 'sweeper': 4, 'mre': 1, 'rook': 6, 'cept': 2, 'courtland': 6, 'visayan': 9, 'understorey': 1, 'daghang': 1, 'salamat': 1, 'manoy': 1, 'pequ': 1, 'gallaga': 1, 'oro': 15, 'visaya': 1, 'alo': 1, 'noli': 1, 'tanger': 4, 'walentin': 3, 'frit': 10, 'helmuth': 1, 'alertwalentin': 1, 'jorgen': 4, 'bhi': 1, 'kisi': 2, 'laath': 1, 'maro': 3, 'jyaada': 1, 'musalmaan': 1, 'hindustaan': 1, 'loc': 11, 'mera': 4, 'hukum': 1, 'shobha': 1, 'mcgrath': 11, 'scacchi': 5, 'puckish': 1, 'geller': 6, 'soooooooo': 3, 'unshaven': 4, 'smuggler': 12, 'congressman': 8, '917': 1, 'kool': 9, 'dous': 9, 'guyana': 4, 'vaccaro': 12, 'levar': 1, 'crappest': 1, 'medv': 4, 'popsicl': 3, 'orchard': 2, 'godforsaken': 2, 'contemperan': 1, 'sebastain': 3, 'keri': 1, 'sexualis': 2, 'daneil': 1, 'perv': 8, 'rn': 2, 'fantasis': 4, 'isl': 23, 'eighteenth': 2, 'mirai': 3, 'shounen': 1, 'shita': 1, 'takahata': 2, 'cellist': 1, 'arigat': 1, 'sensei': 1, 'farreley': 1, 'superbug': 1, 'avarici': 6, 'chromosom': 4, 'illeana': 2, 'comedown': 2, 'plaincloth': 3, 'tash': 1, 'brophi': 5, 'furlough': 3, 'dyspept': 3, 'macbrid': 2, 'backlot': 5, 'conlin': 3, 'alberni': 1, 'willock': 1, 'nailbit': 1, 'boar': 5, 'snorefest': 1, 'leeri': 4, 'dewaer': 10, 'miou': 10, 'hankerchief': 1, 'lofti': 9, 'adeptli': 8, 'ladykil': 5, 'physcedel': 1, 'dinosuar': 4, 'chickbox': 2, 'resel': 2, 'ariauna': 6, 'exhook': 1, 'schoiol': 1, 'inexhaust': 2, 'nco': 2, 'smirkish': 1, 'losch': 3, 'valentino': 15, 'shiek': 1, 'crockzilla': 1, 'lovelock': 1, 'padm': 3, 'nooooooooooooooooooooo': 1, 'killshot': 1, 'unair': 4, 'melros': 10, 'meager': 16, 'koji': 6, 'knucklefac': 2, 'kui': 5, 'stuntmen': 5, 'asphalt': 5, 'childthi': 1, 'envisag': 4, 'dilwal': 1, 'dulhaniya': 2, 'jayeng': 2, 'anilji': 2, 'multistarr': 1, 'abhor': 4, 'juhi': 15, 'sohail': 7, 'rahul': 3, 'rahoooooool': 1, 'videsi': 1, 'sallu': 1, 'aish': 3, 'eunuch': 2, 'smooch': 5, 'nikhilji': 1, 'numerolog': 3, 'yianni': 1, 'zougan': 1, 'exagg': 1, 'politiki': 1, 'kouzina': 1, 'blogg': 1, 'misperceiv': 1, 'stalkfest': 1, 'ballgam': 5, 'fortyish': 1, 'baldri': 1, 'spinsterhood': 1, 'buoyant': 6, 'dejectedli': 3, 'fini': 9, 'anai': 2, 'nin': 2, 'outpost': 10, 'excori': 3, 'chipmunk': 4, 'messili': 3, 'poxi': 1, 'westway': 2, 'pasadena': 5, 'isd': 1, '225': 2, 'loes': 1, 'elogi': 2, 'medeiro': 4, 'gentlest': 1, 'newsreport': 1, 'goverment': 1, 'flippant': 16, 'presuppos': 1, 'portugu': 1, 'shaven': 5, 'chaleuruex': 1, 'sur': 10, 'overthrown': 4, 'czechoslovakia': 9, 'renou': 1, 'avec': 1, 'enfanc': 2, 'histoir': 2, 'capa': 1, 'negra': 1, 'cancao': 1, 'lisboa': 1, 'loeb': 4, 'sempl': 2, 'mcpherson': 4, 'vicker': 2, 'mich': 5, 'macliamm': 3, 'viz': 4, 'lowish': 1, 'fibber': 1, 'flagwav': 1, 'hooey': 5, 'wyli': 1, 'boogaloo': 2, 'unfun': 1, 'larraz': 10, 'beaumont': 7, 'vail': 2, 'jimini': 3, 'scranton': 2, 'luva': 4, 'ofter': 1, 'watchtow': 5, 'charger': 7, 'barmitzvah': 1, '185': 2, 'aerodynam': 5, 'hahahaha': 6, 'melnik': 1, 'wooh': 1, 'klemper': 6, 'donen': 6, 'bedazzl': 5, 'collen': 1, 'pancrea': 2, 'vito': 5, 'fictiv': 2, 'unsaf': 6, 'grouch': 7, 'grouchi': 5, 'quieter': 10, 'gallipolli': 1, 'jerilderi': 3, 'benella': 1, 'sash': 1, 'costanza': 2, 'kenan': 2, 'rakeesha': 1, 'osama': 18, 'miagi': 1, 'ethiopian': 1, 'aida': 5, 'intergalact': 8, 'kol': 8, 'jailbreak': 2, 'gynoid': 2, 'electromagnet': 2, 'emphysema': 2, 'teagan': 3, 'lineback': 2, 'lifter': 2, 'soid': 4, 'asuka': 3, 'veeeeeeeeri': 1, 'avent': 1, 'bowersock': 1, 'teaser': 19, 'azoic': 1, 'sodeberg': 1, 'redid': 2, 'maoist': 3, 'khrushchev': 2, 'groundbrak': 1, 'nra': 5, 'kgb': 17, 'oligarchi': 1, 'konchalovski': 6, 'siberiad': 2, 'tarkosvki': 1, 'cosmopolitan': 8, 'andron': 1, 'baaaaad': 3, 'klich': 1, 'thre': 3, 'didact': 19, 'seam': 22, 'anticlimax': 2, 'wackier': 2, '101st': 2, 'euthan': 3, 'fleischer': 19, 'tchaikovski': 14, 'mcinn': 4, 'seachang': 1, 'beje': 1, 'mongolia': 5, 'yey': 1, 'killbot': 2, 'foulkrod': 5, 'antiwar': 2, 'clarinet': 2, 'columbian': 4, 'bellicos': 5, 'bois': 1, 'moi': 11, 'dalmer': 1, 'cardz': 1, 'musta': 3, 'grade2': 1, '10qualiti': 4, 'sensereplay': 1, 'oj': 12, 'bullhorn': 6, 'agutt': 2, 'telemarket': 1, 'mang': 11, 'kipp': 4, 'overh': 5, 'beseech': 1, 'pitchfork': 8, 'ghosthous': 6, 'renumb': 1, 'clansmen': 4, 'glaswegian': 1, 'kilt': 5, 'killbil': 1, 'ferula': 3, 'gringo': 7, 'jetson': 3, 'flintston': 5, 'manuel': 10, 'gomez': 29, 'median': 2, 'parado': 1, 'hoy': 1, 'pued': 1, 'ser': 1, 'gran': 4, 'dia': 3, 'serrat': 1, 'hortensia': 2, 'belen': 3, 'valeriana': 1, 'preclud': 9, 'pardo': 2, 'sacristan': 1, 'wedlock': 6, 'lazaru': 4, 'racheal': 4, 'garberina': 2, 'propster': 1, 'decoff': 1, 'wsj': 1, 'tinkli': 2, 'blore': 6, 'scalisi': 1, 'sleazier': 7, 'nayland': 7, 'elixir': 7, 'kwouk': 7, 'entrepreneur': 14, 'khanabadosh': 2, 'aladin': 1, 'kalish': 1, 'basest': 2, 'nbodi': 1, 'cu': 10, 'albuquerqu': 12, 'juke': 4, 'tirad': 12, 'whisker': 6, 'randoph': 1, 'letti': 6, 'ore': 7, 'arrogantli': 7, 'gramp': 4, 'crimefight': 3, 'sametim': 1, 'beginn': 13, 'unreview': 1, 'imamura': 14, 'gonzal': 6, 'inarritu': 10, 'samira': 6, 'makhmalbaf': 9, 'pinochet': 6, 'kissing': 6, 'wtc': 26, 'gitai': 4, 'desperatli': 1, 'lelouch': 9, 'tanov': 5, 'srebrenica': 4, 'nair': 15, 'brannagh': 5, 'fortinbra': 3, 'readin': 2, 'kerala': 1, 'ladakh': 2, 'chois': 1, 'recogniton': 1, 'scfi': 1, 'berton': 3, 'klondik': 8, '1899': 2, 'untam': 5, 'pelli': 1, 'chilkat': 1, 'gunbelt': 2, 'mantelpiec': 1, '1898': 6, 'frogmarch': 1, 'jurisprud': 1, 'nightstalk': 1, 'eri': 5, 'greenback': 2, 'aam': 15, 'babaganoosh': 1, 'impost': 3, 'dissapoint': 10, 'plaintiv': 1, 'como': 6, 'euphemist': 2, 'fishnet': 1, 'cardo': 5, 'lafferti': 1, 'kolden': 1, 'spindli': 3, 'morril': 1, 'monetarili': 2, 'partridg': 6, 'ruben': 17, 'kincaid': 5, 'under': 3, 'baloer': 1, 'poitier': 13, 'houghton': 2, 'sulfur': 3, 'marton': 2, 'weem': 4, 'wasabi': 1, 'dmd': 4, 'uhm': 9, 'entereth': 1, 'cont': 10, 'hilltop': 1, 'keir': 4, 'dullea': 3, 'frankensci': 1, 'mayeda': 12, 'muscat': 2, 'shogun': 21, 'kosugi': 9, 'tenchu': 6, 'milfun': 1, 'kabuto': 4, 'osaka': 2, 'kusugi': 1, 'menag': 4, 'ascot': 1, 'causal': 7, 'stefanson': 2, 'aggh': 1, 'eser': 1, 'antarct': 3, 'beachwear': 1, 'pumpkinhead': 3, 'coconut': 3, 'okaymatthau': 1, 'pakula': 3, 'naysay': 10, 'r1': 7, 'bianchi': 5, 'unfortuanitli': 1, 'ingest': 7, 'carnotaur': 1, 'baur': 1, 'ukulel': 5, 'gramophon': 1, 'qe2': 3, 'warbl': 11, 'tubbi': 1, 'tain': 1, 'chandeli': 3, 'gauz': 2, 'katzenjamm': 1, 'fdr': 6, 'britian': 4, 'tottenham': 3, 'insens': 3, 'steet': 2, 'seijun': 1, 'pelham': 2, 'liebman': 5, 'alabama': 15, 'vandenberg': 1, 'toothach': 7, 'schnoz': 1, 'unlaw': 4, 'liota': 2, 'horton': 16, 'wildmon': 1, 'hahahahaha': 4, 'polchak': 1, 'specki': 1, '104': 8, 'thirteenth': 8, 'yehweh': 1, 'internecin': 2, 'nabakov': 2, 'sincron': 2, 'joaquim': 4, 'noland': 6, 'tablet': 2, 'enigma': 19, 'een': 1, 'palestijn': 1, 'graff': 1, 'appearantli': 1, 'stepehn': 1, 'ulis': 8, 'jordi': 6, 'molla': 5, 'martina': 6, 'leonor': 7, 'watl': 7, 'sumatra': 4, 'biga': 6, 'clotheslin': 4, 'stanza': 2, 'virgil': 8, 'seawe': 1, 'sheesi': 1, 'cooli': 6, 'afew': 1, 'frwl': 6, 'octopussi': 1, 'lektor': 1, 'kerim': 1, 'feirstein': 1, 'rosa': 12, 'klebb': 2, 'moneypenni': 1, 'rappel': 2, 'cuff': 7, 'tuxedo': 9, 'aston': 4, 'db5': 1, 'golding': 1, 'pasqualino': 1, 'keenli': 9, 'dubious': 2, 'devianc': 6, 'karva': 2, 'frier': 1, 'prick': 8, 'skanki': 4, 'grisoni': 1, 'loudmouth': 6, 'journeymen': 5, 'maladolescenza': 2, 'psychosexu': 3, 'reservoir': 12, 'dibello': 2, 'inertia': 3, 'twa': 1, 'timonn': 1, 'piccin': 1, 'friedo': 2, 'urucow': 1, 'uruk': 1, 'pupsi': 2, 'telehobbi': 1, 'rackarol': 1, 'schleimli': 1, 'fondu': 1, 'parlour': 7, 'euphem': 9, 'undefin': 9, 'metasonix': 1, 'modular': 1, 'maccullum': 1, 'plexiglass': 2, 'mendanasso': 1, 'pelt': 12, 'geezer': 14, 'origion': 1, 'reced': 8, 'shortsighted': 1, 'discer': 1, 'newspaperman': 1, 'grinnag': 3, 'apeman': 1, 'motorcyclist': 3, 'conri': 1, 'emhardt': 1, 'wynn': 10, 'bieri': 2, 'fiedler': 7, 'nemes': 4, 'gull': 2, 'unlight': 1, 'elicot': 7, 'mcg': 1, 'unwholesom': 3, 'seago': 1, 'unherald': 7, 'arbit': 2, 'unterton': 1, 'misato': 1, 'crybabi': 3, 'psyciatr': 1, 'those': 2, 'macross': 8, 'mospeada': 2, 'taekwon': 1, 'internalis': 5, 'xtase': 1, 'caeser': 2, 'chink': 7, 'eerier': 1, 'expound': 9, 'plath': 5, 'hassett': 3, 'choco': 8, 'clarmont': 1, 'bailsman': 1, 'zere': 1, 'cushion': 8, 'howel': 7, 'jennile': 1, 'centaur': 2, 'girlishli': 1, 'penvensi': 2, 'styrofoam': 10, 'aslan': 4, 'deari': 2, 'banshe': 5, 'speedway': 3, 'bigscreen': 1, 'swoosh': 2, '30th': 10, 'aniversi': 2, 'brini': 5, 'poppen': 1, 'unwind': 6, 'dilettantish': 1, 'daimond': 1, 'maladroit': 3, 'excon': 1, 'casel': 1, 'psychodramat': 2, 'valueless': 2, 'fransico': 1, 'befit': 12, 'turiqistan': 1, 'tamerlan': 10, 'litterali': 1, 'bbq': 4, 'rumiko': 3, 'inu': 2, 'yasha': 2, '161': 2, 'saotom': 3, 'genma': 8, 'panda': 12, 'tendo': 2, 'dojo': 1, 'fetter': 1, 'conor': 13, 'petunia': 3, 'paranoiac': 5, '4eva': 1, 'yoshi': 2, 'suckiest': 1, 'shitfac': 1, 'gunpointi': 1, 'dalmat': 14, 'furrier': 3, 'gruner': 17, 'headlock': 1, 'grunner': 1, 'fulbright': 6, 'jihadist': 2, 'fogg': 1, 'uncurb': 1, 'disassoci': 4, 'bizzar': 3, 'whiney': 5, 'chandeler': 1, 'wether': 1, 'ariet': 2, 'ero': 6, 'ramazzotti': 1, 'unbridl': 9, 'empathet': 11, 'hickori': 9, 'dickori': 7, 'kolya': 3, 'millionth': 2, 'shropshir': 1, 'glob': 3, 'hungrili': 4, 'heffer': 3, 'eastend': 5, 'ebsen': 5, 'indianis': 1, 'tabu': 12, 'repoir': 1, 'raincoat': 2, 'kajawari': 1, 'yoshiaki': 2, 'hentai': 2, 'ecchi': 1, 'helumi': 1, 'worsl': 1, 'newark': 1, 'kushiata': 1, 'masanori': 4, 'toshiya': 1, 'maruyama': 1, 'otami': 3, 'hattori': 2, 'tsuiyuki': 1, 'sasaki': 4, 'toshiyuki': 1, 'mitowa': 1, 'majyo': 1, 'tsuyako': 1, 'olajima': 1, 'suhoski': 1, 'hardiman': 1, 'noriko': 23, 'mayumi': 1, 'umeda': 1, 'exorcis': 4, 'stunner': 9, '0079': 1, 'newtyp': 1, 'amuro': 1, 'zaku': 1, 'benard': 1, '0083': 2, '22h45': 1, 'daen': 1, 'stevson': 1, 'caviar': 1, 'oyster': 2, 'swit': 2, 'burghoff': 2, 'farr': 4, 'unintrus': 2, 'primarilli': 1, 'sushi': 5, 'swankiest': 1, 'julien': 10, 'connel': 13, 'suzett': 5, 'kensit': 2, 'overcompens': 3, 'unrememb': 2, 'tish': 2, 'bitchin': 1, 'rhineston': 1, 'particuarli': 2, 'computeranim': 1, 'cheoreographi': 1, 'vaibhavi': 1, 'vishal': 6, 'sufi': 1, 'dil': 16, 'haara': 3, 'capsaw': 1, 'aroundexcel': 1, '0r': 1, 'iam': 3, 'etebari': 4, 'mccormick': 8, 'hederson': 1, 'lookinland': 1, 'marcia': 3, 'scrapbook': 3, 'sieger': 2, 'dominik': 1, 'graf': 5, 'fsb': 1, 'sanata': 1, 'missfortun': 1, 'slapper': 2, 'genui': 1, 'technofest': 1, 'dragstrip': 3, 'blaisdel': 3, 'pharoah': 3, 'nefretiri': 1, 'baxtor': 1, 'morena': 3, 'baccarin': 2, 'kiley': 15, 'peephol': 2, 'jannsen': 2, 'driva': 9, 'loafer': 6, 'ama': 1, 'lv': 3, 'vaccarro': 1, 'hotdog': 4, 'tulan': 1, 'conspiratori': 3, 'czerni': 5, 'compensatori': 1, 'sector': 11, 'trill': 7, 'grandaddi': 2, 'yipe': 4, 'baili': 2, 'sturgeon': 4, 'kusturika': 1, 'coral': 2, 'harrass': 2, 'lideo': 3, 'suiter': 1, 'aykroyd': 16, 'jobyna': 1, 'ralston': 1, 'brigitta': 4, 'chiara': 2, 'zanni': 1, 'shriner': 2, 'waltzer': 1, 'licenti': 1, 'dain': 4, 'mckenna': 15, 'redress': 5, 'coburg': 2, 'whig': 5, 'figurehead': 7, 'statesmanlik': 1, 'unconstitut': 1, 'dynast': 2, 'regent': 12, 'provis': 3, 'infel': 1, 'chessboard': 3, 'hanoverian': 1, 'demur': 14, 'dra': 1, 'fetischist': 1, 'moviemak': 5, 'lybbert': 4, 'rejoin': 5, 'nuremberg': 8, 'leprachaun': 1, 'carrott': 2, 'magrud': 6, 'doss': 4, 'standup': 22, 'razrukha': 1, 'colloqui': 5, 'bricki': 1, 'sharikov': 5, 'abet': 17, 'altruist': 7, 'gwangwa': 1, 'heftili': 1, 'yeaworth': 4, '4d': 1, 'dinosauru': 1, '12a': 3, 'naacp': 2, 'sharpton': 2, 'madea': 3, 'horsesh': 1, 'pebbl': 3, 'testicularli': 1, 'fredrick': 1, 'undertook': 2, 'maloney': 4, 'dinsdal': 2, 'giada': 8, 'deathi': 1, 'ramsay': 4, 'tt0077713': 1, 'toothsom': 2, 'manderley': 1, 'barmi': 3, 'crumpet': 2, 'whitti': 1, 'cobbleston': 2, 'speir': 2, 'plunk': 6, 'claymor': 4, 'm60': 1, 'skippi': 10, 'handelman': 1, '27th': 3, 'whedon': 1, 'scavo': 1, 'mervyn': 6, 'leroy': 10, '1924': 14, 'dossier': 1, 'skullcap': 1, 'illicitli': 1, 'preeti': 1, 'madhura': 1, 'tyaga': 1, 'amara': 1, 'ganesh': 2, 'pooja': 9, 'ondu': 1, 'sari': 4, 'murthi': 1, 'jayant': 1, 'kaikini': 1, 'yograj': 1, 'bhat': 1, 'infract': 2, 'cruso': 3, 'agonisingli': 2, 'unformula': 1, 'silverlak': 3, 'counselor': 18, 'movingli': 4, 'hatta': 2, 'duress': 6, 'undisclos': 1, 'sender': 4, 'tabatabai': 1, 'endr': 1, 'llskapsresan': 1, 'centered': 3, 'remodel': 1, 'unaccustom': 2, 'blueprint': 3, 'zigzaggi': 1, 'redon': 12, 'greenlit': 4, 'tortuou': 12, 'fromag': 2, 'pukey': 1, 'matic': 2, 'misstak': 1, 'scen': 1, 'simpathet': 2, 'chechen': 2, 'clownifi': 1, 'shinobi': 7, 'oboro': 1, 'gennosuk': 2, 'hotarubi': 1, 'tenzen': 1, 'curtin': 2, 'welll': 1, '442nd': 1, 'tamlyn': 2, 'hiraizumi': 1, 'nisei': 1, 'cluelessli': 2, 'bolger': 2, 'para': 11, 'encircl': 2, 'weathervan': 1, 'pterodactyl': 5, 'filmstock': 1, 'lid': 7, 'gorylici': 1, 'factli': 4, 'handsaw': 2, 'anethesia': 1, 'sabella': 8, 'guillam': 3, 'moira': 3, 'nala': 3, 'kappa': 3, 'phi': 1, 'schorr': 1, 'nuf': 2, 'yolu': 1, 'gutterbal': 1, 'wahtev': 1, 'omc': 1, 'bijita': 1, 'immacul': 16, 'helin': 3, 'cowen': 1, 'gargan': 2, 'coteri': 2, 'waldeman': 2, 'ziggi': 5, 'elman': 2, 'evidenc': 18, 'buzzel': 1, 'cotang': 1, 'cartoonishli': 2, 'drowsili': 1, 'angular': 8, 'halitosi': 1, 'nicotin': 4, 'martyr': 12, 'blackbelt': 1, 'barley': 5, 'livestock': 8, 'yippe': 1, 'peta': 7, 'taxpay': 3, 'airship': 8, 'atc': 1, 'usn': 1, 'gethseman': 1, 'cahulawasse': 5, 'handbasket': 1, 'tranquillo': 1, 'paura': 2, 'grandad': 3, 'bullard': 1, 'krypton': 3, 'saver': 2, 'labirinto': 1, 'interleav': 2, 'winfield': 12, 'rump': 1, 'laughless': 2, 'azumi': 38, 'lydon': 3, 'sot': 1, 'alfons': 2, 'simm': 8, 'migr': 6, 'fungicid': 2, 'defenceless': 2, 'merest': 1, 'crayon': 11, 'metr': 2, 'mendaci': 3, 'wascavag': 1, 'connerey': 1, 'glimcher': 4, 'ifan': 9, 'mallet': 8, 'tritter': 9, 'prescript': 4, 'trittor': 1, 'mytho': 7, 'tenuous': 2, 'jaemin': 3, 'sumin': 3, 'kirg': 1, 'pallbear': 7, 'amelior': 2, 'strawberri': 12, 'transylvanian': 5, 'johannson': 1, 'mayberri': 6, 'supernaturalthat': 1, 'panamanian': 3, 'beckett': 17, 'cartel': 5, 'kerch': 6, 'rudeboy': 2, '1910': 9, 'overlaid': 5, 'shetland': 2, 'ashenden': 2, 'trueli': 9, 'tipper': 3, 'ragman': 2, 'weinbauer': 3, 'inconsol': 3, 'lp': 4, 'fastway': 8, 'strictur': 1, 'jur': 1, 'keren': 1, 'greendal': 10, 'carlson': 11, 'exotic': 3, 'michll': 1, 'yeoh': 2, 'favourti': 1, 'derri': 7, 'savil': 2, 'enquiri': 3, 'savageri': 11, 'widgeri': 1, 'pak': 5, 'gaston': 6, 'bredeston': 2, 'graciela': 1, 'nilson': 1, 'caro': 4, 'hydro': 9, 'dolan': 4, 'frizzi': 3, 'pisspoor': 1, 'skinemax': 4, 'salin': 2, 'analyst': 9, 'unbal': 4, 'steadicam': 7, 'osment': 4, 'irvin': 6, 'nichlolson': 1, 'krutcher': 1, 'southerland': 2, 'sherwood': 6, 'upriv': 1, 'hatchet': 15, 'emiss': 1, 'trudi': 15, 'siobhan': 8, 'juggernaut': 5, 'dorado': 5, 'dede': 3, 'netherworld': 4, 'thornburi': 1, 'banist': 2, 'scrimm': 2, 'campus': 4, 'airway': 2, 'javelin': 4, 'disrepair': 3, 'cogburn': 1, 'rockford': 5, 'flyboy': 2, 'taxidermi': 3, 'nyfd': 2, 'ment': 5, 'speredako': 3, 'surperb': 1, 'raffi': 4, 'dogm': 8, 'nemec': 11, 'pinter': 10, 'schaeffer': 3, 'branaugh': 9, 'gangbust': 2, 'haywir': 3, 'shopworn': 4, 'resmblanc': 1, 'aft': 2, 'acces': 1, 'unflyabl': 1, 'incapacit': 8, 'pooper': 1, 'pepoir': 4, 'specialis': 7, 'confidant': 6, 'memorialis': 1, 'saltwat': 4, 'dudett': 2, 'congest': 5, 'hickox': 7, 'dower': 3, 'ceylon': 12, 'loveday': 1, 'mudg': 1, 'nettleb': 1, 'rosamund': 2, 'allthrop': 1, 'jitteri': 4, 'solidest': 1, 'elfort': 1, 'zuckerman': 6, 'afflect': 1, 'gv': 1, 'rectal': 3, 'mincemeat': 2, 'cuddi': 2, 'lawsuit': 13, 'vicadin': 1, 'reveri': 6, 'partin': 1, 'tomlin': 4, 'unmet': 1, 'rouveroy': 3, 'ghilli': 3, 'slauther': 1, 'wnat': 1, 'iff': 2, 'sailfish': 1, 'antebellum': 3, '1861': 4, 'auti': 1, '1854': 2, 'fe': 4, 'jeb': 2, '1859': 5, 'insurrect': 3, '1863': 3, 'partick': 1, 'rork': 1, 'ganster': 2, 'paramilitari': 7, 'bianlian': 5, 'zhu': 8, 'flom': 1, 'funnist': 1, 'manicur': 9, 'bothersom': 11, 'fi9lm': 1, 'magicfest': 1, 'nipar': 2, 'phenom': 3, 'discontinu': 8, 'mariska': 1, 'hargitay': 1, 'speakman': 3, 'insular': 5, 'sharia': 2, 'whew': 15, 'mateo': 2, 'pixil': 2, 'wladyslaw': 4, 'dragonfli': 16, 'donnybrook': 2, 'maccay': 1, 'spicier': 1, 'bfi': 2, 'lamberto': 14, 'animos': 12, 'motorcross': 1, 'swich': 1, 'tonka': 2, 'sylvi': 5, 'blai': 6, 'aimant': 3, 'overstat': 10, 'crumbi': 4, 'inneundo': 1, 'dialgou': 1, 'yano': 5, 'schuer': 1, 'scratchier': 1, 'aheadthi': 1, 'continuum': 8, 'cameramen': 10, 'fester': 12, 'galloway': 1, 'phainomena': 1, 'chaingun': 2, 'ambidexter': 1, 'clyve': 1, 'fp': 13, 'absentmindedli': 1, 'bridgeport': 1, 'johnathon': 4, 'keppel': 2, 'mort': 5, 'convida': 1, 'ar': 11, 'amercan': 1, 'decameron': 12, 'misshapenli': 1, 'disjointed': 1, 'fruedian': 1, 'serviceman': 6, 'barron': 4, 'bonsai': 1, 'schoolhous': 2, 'altaira': 6, 'aguilera': 1, 'minidress': 2, 'leut': 1, 'embecil': 1, 'shiti': 1, 'pfft': 2, 'lameass': 1, 'hillbil': 1, '2more': 1, 'malinski': 2, 'bellini': 5, 'appr': 1, 'toretton': 1, 'emmannuel': 1, 'seigner': 2, 'moroccan': 4, 'georgeann': 1, 'fatso': 2, 'hanki': 9, 'misstat': 1, 'rabin': 2, 'crockett': 15, 'braggin': 1, 'jacinto': 7, 'texican': 1, 'siesta': 5, 'nekojiru': 1, 'fantasia': 5, 'nyaako': 4, 'nyatta': 3, 'dreamscap': 10, 'phatasm': 1, 'egdi': 1, 'nahhh': 1, 'extracurricular': 2, 'perschi': 1, 'kosti': 1, 'induni': 1, 'zzzzz': 1, 'sanitori': 1, 'scabbi': 1, 'reenter': 2, 'atton': 2, '9i': 1, 'geoeffri': 1, 'bluray': 2, 'hektor': 1, 'moravia': 1, 'delanda': 1, 'domen': 1, 'rosati': 1, 'verdi': 5, 'malplac': 2, 'sprightli': 8, 'ku': 8, 'klux': 6, 'klan': 7, 'disinform': 3, 'forse': 1, 'oedpiu': 1, 'omfg': 2, 'vowel': 2, 'dentur': 6, 'wrightli': 1, 'poolguy': 1, 'treviss': 1, 'drippi': 5, 'stagebound': 4, 'peahi': 1, 'decipher': 2, 'noll': 15, 'lotion': 1, 'romulan': 2, 'zephram': 1, 'cochran': 3, 'pleasee': 2, 'boriac': 1, 'transfus': 11, 'kerbi': 2, 'cateress': 1, 'meshugaa': 1, 'mowbray': 10, 'bingley': 1, 'bushel': 4, 'kaldwel': 1, 'moxham': 1, 'chih': 1, 'leong': 2, 'slaughterhous': 23, 'macgregor': 20, 'enamour': 4, 'calligraphi': 5, 'sargeant': 6, 'chintzi': 9, 'sparkli': 2, 'dufi': 4, 'concord': 7, 'manet': 2, 'utrillo': 2, 'rousseau': 4, 'gogh': 3, 'toulous': 3, 'lautrec': 4, 'bodysuit': 2, 'braggadocio': 1, 'montmartr': 9, 'lise': 12, 'swooningli': 1, 'sein': 11, 'nimbl': 7, 'turnstil': 2, 'tari': 5, 'dekker': 6, 'faction': 17, 'burti': 2, 'rogel': 2, 'kristel': 15, 'hessman': 2, 'wkrp': 3, 'kafka': 6, 'grubach': 1, 'prozess': 1, 'hypnothis': 1, 'mysterios': 1, 'bombsur': 1, 'lifeblood': 1, 'calvinist': 2, 'dhawan': 7, 'ellington': 9, 'liszt': 3, 'brisson': 22, 'oaki': 14, 'hiroyuki': 5, 'tagawa': 3, 'fattish': 1, 'ng': 8, 'exup': 1, 'duc': 11, 'pulcheri': 1, 'propiti': 1, 'uncolour': 1, 'panopli': 2, 'eaker': 1, 'mountbatten': 6, 'shoei': 1, '1200': 4, 'triumphantli': 6, 'blackbriar': 4, 'treadston': 3, 'paddi': 4, 'vosen': 4, 'vigour': 6, 'wormi': 2, 'ultimtum': 1, 'hatton': 13, 'lusitania': 3, 'munit': 1, 'novarro': 6, 'hobart': 5, 'edyth': 1, 'reedit': 2, 'keither': 1, 'longeria': 1, 'zimmerfram': 1, 'rater': 6, '12m': 2, '11m': 1, 'bap': 2, 'dudikoff': 11, 'endured1': 1, 'millinium': 1, 'peuril': 1, 'haggl': 3, 'paganist': 1, 'summerisl': 4, 'ic': 8, 'rodman': 3, 'sooraj': 16, 'prem': 20, 'deewani': 1, 'vivah': 34, 'barjatyagot': 1, 'app': 4, 'kaun': 7, 'kiya': 8, 'poonam': 12, 'ajnab': 2, 'anjan': 1, 'chichi': 1, 'roa': 1, 'kajol': 5, 'vishk': 3, 'mujh': 4, 'haq': 4, 'bestest': 2, 'funnel': 5, 'roeper': 9, 'foibl': 12, 'neurosi': 11, 'aout': 1, 'mert': 1, 'busta': 11, 'ado': 14, 'blech': 7, 'wittl': 1, 'fro': 8, 'freddyshoop': 1, 'mikhali': 1, 'cacoyanni': 12, 'euripid': 12, 'calcha': 2, 'auli': 1, 'giorgo': 1, 'agamemnon': 10, 'kazako': 6, 'clytemnestra': 3, 'tatiana': 4, 'papamosch': 4, 'papamosk': 1, 'menalau': 1, 'caravan': 9, 'hewn': 5, 'theodoraki': 3, 'menelau': 1, 'filicid': 1, 'kinsey': 2, 'snowstorm': 4, 'stamina': 3, 'adventuresom': 4, 'seamen': 2, 'raver': 3, 'kapur': 10, 'momsem': 1, 'zukov': 1, 'zine': 1, 'mobocraci': 1, 'malt': 4, 'persev': 5, 'frazzl': 3, 'photocopi': 1, 'evang': 1, 'browbeat': 3, 'dickian': 1, 'gjon': 2, 'landsburi': 2, 'mcdoak': 13, 'propon': 5, 'gaynigg': 5, 'supplier': 8, 'ultramodern': 2, 'splitter': 2, 'clairedycat': 1, 'kebbel': 1, 'spenc': 4, 'mainsequ': 1, 'aquila': 1, 'gameshow': 7, 'gamezon': 1, 'aya': 8, 'ueto': 8, 'bijomaru': 1, 'marylin': 4, 'dimaggio': 8, 'predigest': 1, 'mushi': 14, 'unamerican': 1, 'exhibition': 1, '10not': 2, 'druten': 5, 'warlock': 16, '163': 4, 'hoki': 3, 'disturbingth': 1, 'usur': 1, 'shylock': 1, 'unperceiv': 1, 'threequel': 1, 'fiji': 4, 'valalola': 1, 'smalltim': 4, 'fossil': 6, 'jurassik': 2, 'ataqu': 1, 'flaubert': 2, 'wooohooo': 1, 'pshaw': 1, 'quel': 4, 'dweebi': 2, 'kerouac': 2, 'orphe': 1, 'ikuru': 1, 'kobayashi': 10, 'kaidan': 1, 'teshigahara': 1, 'suna': 1, 'onna': 3, 'worhol': 1, 'tt0077247': 1, 'casamajor': 3, 'bertanzoni': 1, 'distil': 6, 'balthazar': 1, 'layabout': 7, 'clippi': 1, 'bassey': 1, 'routemast': 1, 'porridg': 2, 'spotless': 2, 'fruiti': 4, 'danon': 1, 'ilenia': 1, 'lazzarin': 1, 'kao': 1, 'nobu': 2, 'mattolini': 1, 'tommaso': 1, 'patresi': 1, 'tortoni': 1, 'spacer': 1, 'zima': 2, 'hobb': 6, 'austrailia': 2, 'zeland': 1, 'restructur': 4, 'vitametavegamin': 1, 'proyect': 1, 'tep': 2, 'greco': 3, 'holograph': 5, 'taro': 2, 'shogo': 6, 'kawada': 1, 'toshi': 6, 'uncorrupt': 1, 'flowless': 1, 'wich': 9, 'betrail': 1, 'subatom': 5, 'poppycock': 4, 'remotest': 3, 'maitlan': 1, 'witten': 1, 'plagiaris': 3, 'matricul': 1, 'constantin': 8, 'superce': 1, 'carmela': 7, 'tablecloth': 2, 'swerl': 3, 'trina': 5, 'ladylik': 2, 'finnerti': 4, 'ensign': 7, 'glitxi': 1, 'cinematograpi': 2, 'tragidian': 1, 'thisworld': 1, 'mafioso': 9, 'cheesecak': 9, 'riedelsheim': 7, 'unend': 11, 'episop': 1, 'madcat': 1, 'slinki': 6, 'kadi': 3, 'lmotp': 3, 'zomg': 1, 'roflmao': 2, 'umecki': 1, 'helluva': 10, 'corker': 3, 'congruiti': 1, 'unvarnish': 2, 'slender': 8, 'thrall': 2, 'primat': 4, 'mckay': 15, 'slotnick': 2, 'randl': 5, 'momentari': 9, 'agrandiz': 1, 'nambla': 2, 'poindext': 1, 'erica': 21, 'freckl': 6, 'sleeveless': 4, 'thermo': 2, 'ewww': 5, 'dolman': 5, 'databas': 11, 'spilt': 1, 'visin': 1, 'amoeba': 4, 'naura': 3, 'mohr': 18, 'kruschen': 5, 'blabber': 6, 'hungov': 3, 'nostradamu': 2, 'warzon': 1, 'brainiac': 7, 'zod': 4, 'dec': 3, 'jive': 9, 'wilona': 2, 'toti': 1, 'uptown': 1, 'bleakest': 3, 'lotto': 2, 'niqu': 2, 'janssen': 8, 'kleinfeld': 4, 'rocco': 7, 'mikhalkov': 2, 'aleksei': 2, 'zhestokij': 1, 'unizhenny': 1, 'oskorblyonny': 1, 'sibiriada': 1, 'kurochka': 1, 'ryaba': 1, 'rialto': 2, 'chopin': 3, 'hrr': 1, 'haut': 6, 'crim': 2, 'codfish': 1, 'formfit': 1, 'oscil': 4, 'ib': 3, 'ashleigh': 4, 'dassin': 10, 'vivaldi': 2, 'hoffer': 1, 'rififi': 1, 'stalingrad': 7, 'cautious': 4, 'lithuania': 1, 'latvia': 2, 'adjoin': 4, 'cote': 4, 'spaciou': 6, 'hexagon': 1, 'octagon': 2, 'petal': 5, 'fax': 5, 'sainthood': 2, 'aptitud': 9, 'obedi': 11, 'indeped': 1, 'sainik': 1, 'savannah': 11, 'clunkier': 2, 'famk': 3, 'smilodon': 4, 'recklessli': 5, 'uncred': 2, 'sweey': 1, 'wildfir': 2, 'sanechao': 1, 'wurman': 2, 'laini': 3, 'gabel': 7, 'puma': 3, 'plesantli': 1, 'bankrol': 9, 'risdon': 1, 'torm': 4, 'decca': 3, 'petrillo': 1, 'strikebreak': 1, 'markland': 1, 'firetrap': 1, 'armpit': 10, 'thugge': 11, 'broek': 3, 'granzow': 2, 'manon': 3, 'bauchau': 1, 'bala': 1, 'fraggl': 10, 'pictori': 9, 'iberian': 1, 'peninsular': 1, 'adiego': 1, 'touchingli': 8, 'luj': 6, 'leadenli': 3, 'filial': 1, 'zvyagvatsev': 1, 'turgenev': 1, 'karamazov': 2, 'sokurov': 4, 'beig': 6, 'moshkov': 1, 'potepolov': 1, 'floppi': 7, 'dint': 7, 'capitol': 10, 'wrapper': 2, 'cq': 7, 'sodomi': 3, 'lactat': 1, 'sanitari': 2, 'astronuat': 1, 'lira': 2, 'melti': 2, 'worden': 2, 'barracuda': 3, 'centerfold': 5, 'discplin': 1, 'undeservedli': 11, 'arisen': 5, 'rightw': 1, 'junta': 2, 'mahoganoy': 1, 'underserv': 1, 'rennaiss': 1, 'relentlessi': 1, 'cunti': 1, 'mizz': 2, 'dialoug': 9, 'uncondit': 13, 'plater': 3, 'beiderbeck': 1, 'expcept': 1, 'davoli': 2, 'mihaela': 1, 'radulescu': 1, 'iscariot': 1, 'mclaughlin': 5, 'wildfel': 3, 'yorkshir': 10, 'womenfolk': 3, 'cheekbon': 3, 'uncharit': 2, 'puchas': 1, 'ehh': 3, 'pcp': 2, 'kerkor': 1, 'elong': 7, 'forthegil': 1, 'ravetch': 1, 'shillab': 1, 'animal': 1, 'learner': 4, 'haiti': 3, 'losey': 8, 'chucklethi': 1, 'lob': 8, 'tarrentino': 5, 'louch': 6, 'tangier': 3, 'regin': 1, 'almira': 1, 'hayl': 1, 'rafaela': 1, 'ottiano': 1, 'myrtil': 1, 'duk': 6, 'nonchal': 8, 'samaritan': 2, 'placidli': 2, 'putresc': 1, 'fishermen': 6, 'seo': 1, 'yoo': 1, 'suk': 1, 'romper': 3, 'megalopoli': 1, 'israelo': 1, 'nota': 1, 'bene': 6, 'jell': 7, '45am': 1, 'cosi': 4, 'whitfield': 4, 'roasli': 1, 'pickl': 5, 'gangbang': 6, 'muffler': 1, 'davinci': 4, 'repast': 3, 'danoota': 1, 'spigott': 1, 'streeb': 1, 'greebl': 1, 'superthunderstingcar': 1, 'ludwig': 4, 'bargo': 2, 'loudhail': 1, 'humphri': 5, 'rushton': 5, 'parkinson': 2, 'kaabe': 1, 'yamada': 7, 'youji': 1, 'yoshinaga': 5, 'sayuri': 19, 'shoufukutei': 1, 'tsurub': 1, 'yuunagi': 1, 'machi': 6, 'cadi': 11, 'lia': 5, 'kleber': 1, 'mendon': 1, 'filho': 1, 'transgen': 2, 'preorder': 1, 'fant': 7, 'valjean': 9, 'javert': 7, 'fantin': 5, 'cosett': 7, 'thenardi': 3, 'eponin': 7, 'gavroch': 2, 'enjolra': 3, 'brimmer': 9, 'easel': 1, 'strafe': 2, 'emissari': 3, 'breweri': 3, 'asafrika': 1, 'bambaataa': 1, 'grandmast': 5, 'dd2': 2, 'dd5': 4, 'jokey': 7, 'father2': 1, 'annoying3': 1, 'faked4': 1, 'annoying5': 1, 'badwhat': 1, 'playing4': 1, 'servicemen': 8, 'supermen': 3, 'dawid': 1, 'buffoonish': 7, 'conmen': 2, 'ramya': 1, 'krishnan': 1, 'raveena': 4, 'daud': 1, 'khoobsurat': 2, 'asrani': 2, 'angrezon': 1, 'zamaan': 1, 'jailer': 3, 'pyaar': 4, 'chhote': 1, 'miyaan': 1, 'bihari': 1, 'makhna': 2, 'viju': 1, 'jaayen': 1, 'botox': 4, 'putti': 4, 'ealli': 1, 'ankylosauru': 1, 'ryh': 1, 'summerle': 1, 'cartridg': 4, 'karyn': 9, 'kusama': 6, 'semest': 14, 'sandro': 5, 'calderon': 5, 'santiago': 12, 'tirelli': 2, 'faze': 4, 'pall': 7, 'elisa': 2, 'bocanegra': 1, 'marisol': 2, 'barbour': 3, 'salesgirl': 3, 'donlan': 7, 'lampidorra': 3, 'omni': 2, 'ruffl': 3, 'shmear': 1, 'qe': 1, 'crewmemb': 1, 'bullcrap': 1, 'fetus': 4, 'sbardellati': 1, 'chalic': 8, 'munkar': 9, 'kaira': 2, 'oghri': 1, 'brooker': 1, 'unillumin': 1, 'dreamland': 4, 'eq': 1, 'neato': 2, 'retina': 6, 'ladisla': 1, 'vitagraph': 2, 'antenna': 4, 'mandibl': 2, 'dru': 3, 'argufi': 1, 'monsignor': 1, 'unbil': 6, 'burner': 9, 'rivit': 1, 'hight': 4, 'hilarai': 1, 'loveli': 9, 'aaa': 9, 'hysterion': 1, 'afest': 1, 'hedgehog': 4, 'wetter': 1, 'yawnerooni': 1, 'unrefin': 2, 'milieux': 1, 'kathak': 2, 'latrin': 4, 'pulver': 3, 'unsupport': 3, 'smush': 1, 'cryptozoolog': 1, 'unscienc': 1, 'chemystri': 1, 'cryptologist': 1, 'aznabl': 1, 'malleabl': 2, 'broccoli': 1, 'sulley': 2, 'alcatraz': 12, 'hyung': 3, 'lawston': 2, 'eu': 3, 'meu': 4, 'irm': 1, 'nossa': 1, 'namorada': 2, 'lustili': 1, 'booie': 1, '2044': 1, 'unappreci': 12, 'fbl': 1, 'malaysia': 2, 'millar': 10, 'mcilroy': 2, '800': 6, 'yore': 7, 'desire': 4, 'lim': 2, 'waa': 1, 'depreci': 3, 'naiviti': 1, 'gielguld': 1, 'hiccup': 9, 'peng': 2, 'brethren': 6, 'zorba': 3, 'anspach': 2, 'buttercream': 1, 'thuglif': 1, 'subfunct': 1, 'yucca': 1, 'ghod': 2, 'hickham': 3, 'insectoid': 3, 'stratospher': 8, 'rosalind': 10, 'mcdaniel': 2, 'unturn': 6, 'roadhous': 3, 'wuhl': 10, 'wadsworth': 1, 'longfellow': 2, 'blackploit': 1, 'structuralist': 3, 'tendenti': 3, 'reappropri': 1, 'revision': 8, 'paglia': 1, 'damp': 7, 'dobb': 7, 'conscript': 8, 'urchin': 5, 'lennox': 2, 'continent': 10, 'kodak': 3, 'foxhunt': 1, 'effigi': 2, 'redwood': 2, 'rrh': 1, 'randel': 10, 'deafen': 5, 'byplay': 3, 'deathlin': 4, 'latinamerican': 1, 'caridad': 1, 'akim': 1, 'tamiroff': 1, 'soubrett': 1, 'trelli': 1, 'repos': 3, 'development': 1, 'laundromat': 4, '206': 4, 'url': 3, 'turaquistan': 2, 'shariff': 2, 'pipelin': 4, 'turquistan': 1, 'turaqui': 1, 'stoke': 3, 'vane': 3, 'playwrit': 2, 'lldoit': 1, 'unfavor': 2, 'cagey': 5, 'folksi': 8, 'uncompromisingli': 4, 'clubhous': 3, 'metephor': 1, 'hoboken': 1, 'rfd': 3, 'whelan': 3, 'basra': 8, 'jafa': 3, 'motherland': 3, 'florist': 1, 'cubitt': 9, 'colm': 11, 'feor': 7, 'vocalis': 2, 'outpour': 2, 'contrit': 4, 'norrland': 2, 'pollock': 2, 'sjoholm': 1, 'meadowland': 1, 'soprana': 1, 'moltisanti': 2, 'boca': 3, '510': 1, '511': 1, '512': 1, '513': 1, 'cusamano': 2, 'nrj': 1, 'whpat': 1, 'madtv': 1, 'borstein': 1, 'gab': 6, 'vertigin': 3, 'feeli': 4, 'rondo': 4, 'istvan': 2, 'szabo': 2, 'gimmickri': 5, 'llkick': 1, 'lleven': 1, 'whenyou': 1, 'makeyour': 1, 'justdumb': 1, 'grosser': 1, 'theytri': 1, 'theyhav': 1, 'frankenhim': 4, 'friendkin': 1, 'nananana': 1, 'peroxid': 3, 'cannonbal': 8, 'stroker': 11, 'docksid': 5, 'ullswat': 1, 'cyclist': 3, 'chinamen': 1, 'hitchcocki': 1, 'hannayesqu': 1, 'essi': 1, 'persson': 1, 'hpd2': 2, 'kurupt': 6, 'conjug': 4, 'follywood': 2, 'angelfir': 1, 'ny5': 1, 'jbc33': 1, 'fye': 2, 'wil': 10, 'vacantli': 2, 'zamprogna': 1, 'leann': 1, 'adachi': 1, 'cali': 2, 'blackfac': 4, 'takei': 2, 'gluttoni': 1, 'coutland': 1, 'trenholm': 12, 'subpar': 11, 'objectif': 2, 'allright': 1, 'enzo': 7, 'littler': 1, 'shaloub': 5, 'meanial': 1, 'banishs': 1, 'mikail': 2, 'recant': 2, 'hubert': 4, 'selbi': 6, 'edel': 11, 'tralala': 2, 'miscu': 6, 'keepin': 1, 'saki': 6, 'ryoko': 5, 'yonekura': 3, 'shingo': 1, 'tsurumi': 1, 'penuri': 2, 'fastidi': 7, 'guttenburg': 1, 'nolti': 1, 'bowden': 9, 'crackpot': 9, 'freighter': 1, 'dethaw': 1, 'snowdud': 1, 'pheonix': 2, 'succul': 3, 'behemoth': 7, 'caiano': 2, 'adolfo': 1, 'anulka': 2, 'daubeney': 1, 'waxman': 3, 'bessi': 9, 'guietari': 1, 'gershwyn': 1, 'elkaim': 6, 'onomatopo': 1, 'clack': 5, 'unobtain': 1, 'monstrous': 6, 'sakal': 1, 'naish': 5, 'mikael': 4, 'helg': 7, 'bonzai': 5, 'keel': 8, 'tacoma': 2, 'huski': 5, 'gallo': 3, 'doorless': 1, 'skeptico': 3, 'coffer': 3, '04': 7, 'drusilla': 2, 'genoris': 1, 'sequest': 3, 'quack': 4, 'quak': 5, 'patricid': 2, 'tolkein': 2, 'stub': 8, 'recompens': 2, 'winckler': 1, 'mammarian': 1, 'natividad': 3, 'croix': 2, 'tura': 1, 'satana': 1, 'bardot': 8, 'fellat': 2, 'cockazilla': 1, 'megalung': 1, 'papier': 8, 'saggi': 6, 'sheri': 3, 'ooga': 1, 'hooter': 2, 'massacessi': 2, 'ewa': 3, 'aulin': 2, 'ravensbr': 2, 'balad': 1, 'picturesscott': 1, 'flimsiest': 5, 'woolrich': 7, 'preemin': 1, 'criss': 4, 'bredel': 2, 'outcrop': 3, 'stainton': 2, 'hawtrey': 3, 'fantafestiv': 1, 'fluoresc': 7, 'suspenc': 3, 'choicest': 2, 'geopolit': 6, 'fess': 5, 'brisk': 23, 'rane': 1, 'deadpool': 4, 'obe': 1, 's1': 2, 'cianelli': 4, 'oust': 5, 'masti': 4, 'nene': 1, 'amit': 1, '114': 2, 'kazuo': 6, 'gaira': 3, 'komizu': 7, 'tailermi': 1, 'gotcha': 5, 'macisaac': 2, 'giornat': 1, 'unflashi': 1, 'hypermodern': 1, 'mastrionani': 1, 'writen': 1, 'quirkiest': 1, 'skittish': 2, 'americanis': 3, 'amolad': 1, 'firmament': 1, 'misconceiv': 5, 'obtrud': 3, 'acclam': 1, 'whiteflokati': 1, 'hotmail': 3, 'eildon': 2, 'nannyish': 1, 'viscera': 6, 'blanchard': 4, 'marguli': 3, 'bludhaven': 1, 'pengi': 1, 'valencia': 2, 'neva': 3, 'candidaci': 2, 'televison': 2, 'pitti': 2, 'shadyac': 7, 'superspe': 1, 'soundbit': 1, 'unprovok': 3, 'leathal': 1, 'piemak': 3, 'cholat': 1, 'emmerson': 3, 'monstervis': 9, 'bargin': 2, 'rattlesnak': 9, 'texel': 1, 'fairminded': 1, 'kneejerk': 2, 'conservativ': 1, 'evenhand': 1, 'vampira': 5, 'theda': 1, 'bara': 3, 'signorelli': 2, 'pmrc': 2, 'oingo': 1, 'boingo': 1, 'fixx': 1, 'seagul': 2, 'macarena': 3, 'poepl': 1, 'ummmph': 2, 'twasn': 1, 'herebi': 3, 'frencifi': 1, 'holfern': 1, 'minni': 4, 'sewel': 7, 'encrust': 2, 'galvatron': 1, 'autobot': 2, 'bobo': 2, 'operish': 1, 'caucas': 1, 'sardo': 3, 'numspa': 3, 'rankl': 6, 'inwatch': 1, 'eeeeh': 1, 'mb': 3, 'groundhog': 6, 'silverstonesqu': 1, 'oland': 2, 'auditori': 4, 'laserlight': 1, 'razzmatazz': 1, 'clunkili': 2, 'sidearm': 3, 'weas': 2, 'contextualis': 1, 'primordi': 5, 'rationalis': 2, 'yakusho': 2, 'hideko': 1, 'kishikawa': 1, 'tamiyo': 3, 'kusakari': 3, 'dansu': 5, 'masayuki': 2, 'suo': 7, '06th': 1, 'comigo': 1, 'somo': 1, 'nadi': 1, 'fictionalis': 5, 'cheerless': 2, 'limpli': 2, 'nanj': 1, 'fredi': 2, 'torrenc': 9, 'enshrin': 3, 'ayn': 2, 'rentalrack': 1, 'youssefa': 1, 'smolder': 9, 'sines': 2, 'mantaga': 1, 'fischter': 2, 'ullrich': 1, 'mantagna': 1, 'dillion': 1, 'pepsi': 9, 'bfg': 16, 'hambley': 2, 'clonker': 2, 'snozzcumb': 2, 'pluse': 6, 'whizzpop': 2, 'hofd': 2, 'doii': 1, 'captivatingli': 2, 'pemberton': 6, 'unexplod': 2, 'burgandian': 1, 'coupon': 7, 'flagrantli': 6, 'whitehal': 3, 'bugundian': 4, 'mcdevitt': 2, 'estrada': 2, 'farga': 1, 'landa': 4, 'unenthusiast': 4, 'neorealist': 5, 'dhia': 1, 'christiani': 3, 'marginalis': 3, 'nubo': 1, 'hatsumo': 2, 'mameha': 6, '576': 1, 'evenli': 11, 'interlac': 8, 'faudel': 1, 'youn': 1, 'witcheepoo': 1, 'witchypoo': 1, 'kathmandu': 7, 'pujari': 3, 'monter': 2, 'jasbir': 5, 'burman': 15, 'sachin': 1, 'asha': 2, 'bhosl': 2, 'dum': 7, 'kanchi': 2, 'manfish': 2, 'bromfield': 6, 'jori': 6, 'tessa': 3, 'prendergast': 1, 'alita': 1, '2019': 2, 'koto': 3, 'reeduc': 1, 'aclu': 2, 'sheepish': 2, 'collera': 1, 'kaczorowski': 1, 'hearn': 10, 'movietheatr': 1, 'hightow': 7, 'stiffer': 2, 'slimmer': 3, 'macguyv': 1, 'opportunit': 1, 'circumspect': 2, 'stollen': 1, 'everyway': 2, 'reimann': 2, 'luxembourg': 4, 'juliann': 5, 'katz': 5, 'leipzig': 1, 'skateboard': 16, 'leafi': 2, 'inutter': 1, 'palmentari': 1, 'jir': 3, 'cek': 1, 'vladim': 1, 'dlouh': 1, 'jedna': 2, 'ruka': 4, 'netlesk': 1, 'majorca': 2, 'majorcan': 1, 'dissens': 1, 'riker': 16, 'muldaur': 4, 'pulaski': 4, 'singaporean': 3, 'spielbergian': 2, 'adag': 6, 'voy': 1, 'silbi': 1, 'segregationist': 1, 'fleisher': 4, 'snobbism': 1, 'travers': 12, 'carib': 7, 'tundra': 1, 'wildfowl': 1, 'sidelight': 2, 'morcheeba': 1, 'parati': 1, 'janeiro': 4, 'coastlin': 2, 'coartship': 1, 'frak': 1, 'roslin': 3, 'frakkin': 2, 'h2g2': 1, 'moreso': 7, 'reassess': 4, '1836': 3, 'seguin': 1, 'padilla': 2, 'orderli': 6, 'brigand': 4, '1855': 2, 'benito': 8, 'juarez': 15, 'guatamala': 2, 'fannin': 2, 'goliad': 1, 'precaut': 7, '1838': 1, 'militarili': 4, 'undu': 9, '1846': 3, '1853': 3, 'gadsden': 1, 'porfirio': 1, 'staten': 3, 'chicl': 1, 'schemer': 4, 'cumbersom': 3, 'fact2': 1, 'islandbut': 1, 'hooten': 5, 'brutu': 3, 'down2': 1, 'model3': 1, 'skimpier': 4, 'criminey': 2, 'lazer': 3, 'bhodi': 3, 'ahhhhhhhhh': 1, 'sudio': 1, 'lutt': 2, 'centrepiec': 3, 'bord': 1, 'atleast': 3, 'superst': 1, 'disapoint': 4, 'donig': 1, 'posest': 1, 'paro': 1, 'latt': 6, 'gilli': 4, 'cuthbert': 13, 'schwarzman': 1, 'defeatist': 2, 'pincher': 2, 'stepmom': 2, 'mst3000': 8, 'dramaturg': 1, 'itwould': 1, 'sensuou': 12, 'giver': 6, 'manicheist': 1, '1911': 3, 'westpoint': 1, 'sayonara': 15, 'uninvit': 6, 'bixbi': 6, 'trumperi': 1, 'someincred': 1, 'tortois': 3, 'wirefram': 1, 'washo': 2, 'bilal': 10, 'nikopol': 2, 'overreach': 3, 'sheehan': 5, 'czar': 2, 'dissi': 1, 'ba': 13, 'wurth': 1, 'clownish': 6, '270': 3, 'peplo': 2, 'illuder': 1, 'verb': 3, 'luder': 1, 'stemmin': 1, 'lipsync': 2, 'headband': 1, 'hicock': 1, 'cellmat': 2, 'capper': 3, '134': 3, 'buoyanc': 1, 'antibiot': 1, 'extrapol': 3, 'postmodernist': 1, 'embolden': 2, 'rancher': 13, 'boyc': 2, 'ato': 1, 'essandoh': 1, 'kort': 2, 'flattop': 2, 'wristwatch': 2, 'opul': 11, 'acoust': 9, 'dazzlingli': 3, 'pent': 6, 'irat': 6, 'spoilersthi': 1, 'nikolai': 7, 'gogol': 3, 'viy': 4, 'estonia': 7, 'ukrainian': 2, 'khoma': 1, 'pullitz': 2, 'berkhoff': 2, 'castlevil': 2, 'lembit': 1, 'ulfsak': 1, 'liziti': 1, 'nikolaev': 1, 'kerosen': 1, 'genova': 7, 'deodatto': 1, 'labrador': 1, 'mcgowan': 2, 'bingo': 4, 'plotwis': 6, 'landov': 1, 'faci': 2, 'menfolk': 1, 'imbib': 3, 'bonnet': 7, 'jacksi': 1, 'wittgenstein': 2, 'sodomis': 2, 'gor': 6, 'blimey': 4, 'guv': 1, 'exasperatedli': 1, 'neighborrhood': 1, 'skerrit': 2, 'makin': 4, 'rwint': 1, 'ogend': 1, 'gitt': 2, 'droney': 1, 'roqu': 3, 'halorann': 1, 'froze': 5, 'apal': 3, 'kubrik': 1, 'dode': 6, 'kobayaski': 1, 'konishita': 1, 'rokkuchan': 2, 'clicketi': 1, 'weeper': 3, 'eastmancolor': 1, 'takemitsu': 1, 'ikiru': 4, 'chime': 12, 'dainti': 2, 'soxer': 1, 'baumer': 4, 'galli': 3, '1million': 1, 'floraki': 1, 'stavro': 3, 'cl': 12, 'wainright': 2, 'orton': 5, 'crux': 9, 'wean': 6, 'mediacorp': 1, 'raintre': 1, 'larryjoe76': 1, 'pissibl': 1, 'anklet': 1, 'ciggi': 1, 'upchuck': 2, 'garloupi': 1, 'amuck': 3, 'crikey': 3, 'alka': 2, 'seltzer': 5, 'mencia': 21, 'frenchwoman': 1, 'vivien': 12, 'predestin': 3, 'demonico': 2, 'kang': 9, 'iu': 1, 'auspici': 9, 'skitter': 3, 'popkin': 1, 'mailbox': 5, 'curfew': 3, 'swinson': 4, 'theissen': 4, 'plier': 6, 'eyesor': 3, 'solett': 1, 'tendulkar': 2, 'sadahiv': 1, 'nihlan': 1, 'naseeruddin': 4, 'grist': 4, 'zapper': 2, 'kimbl': 8, 'rendal': 6, 'minogu': 8, 'sega': 8, 'shipp': 1, 'arcad': 10, 'hrm': 1, 'saskatchewan': 5, 'tought': 4, 'adjustin': 1, 'outther': 1, 'granola': 2, 'logger': 1, '1d': 2, 'blase': 2, 'adriat': 1, 'madperson': 1, 'floodlight': 1, 'confidenti': 24, 'salkow': 3, 'helmsman': 4, 'hoast': 2, 'baaad': 3, 'ehsaan': 2, 'devgun': 3, 'merylstreep': 1, 'bekim': 2, 'fehmiu': 2, 'brandauer': 4, 'aeneid': 1, 'eneid': 1, 'apologet': 5, 'unchart': 12, 'sharkman': 2, 'gci': 2, 'nfny40': 1, 'kinnepoli': 1, 'finster': 2, 'bugg': 1, 'adob': 3, 'eggbert': 1, 'dosn': 1, 'jumper': 7, 'reverand': 4, 'blather': 2, 'bashevi': 2, 'turntabl': 3, 'skinless': 1, 'erland': 1, 'lidth': 1, 'rethwisch': 1, 'kai': 2, 'daisen': 1, 'shitless': 1, 'methamphetamin': 1, 'kenner': 4, 'yoshida': 5, 'oncom': 5, 'dartboard': 1, 'marenghi': 1, 'darkplac': 1, 'boosh': 1, 'jermi': 1, 'dyson': 4, 'gatiss': 3, 'shearsmith': 3, 'beati': 5, 'historicali': 1, 'lional': 1, 'subterfug': 9, 'tenderloin': 2, 'barmen': 1, 'lemoin': 4, 'zaroff': 7, 'orloff': 3, 'monaca': 1, 'muslmana': 1, 'florinda': 11, 'bolkan': 10, 'hexploit': 1, '1600': 7, 'misdemeanor': 2, 'falvia': 1, 'gianfranco': 6, 'mingozzi': 3, 'piovani': 6, 'sevizia': 1, 'paperino': 1, 'marietta': 1, 'parkersburg': 4, 'partier': 1, 'outr': 2, 'buckaroo': 6, 'banzai': 8, 'meara': 2, 'wheedl': 2, 'forslani': 1, 'jeanean': 2, 'zellweg': 5, 'stolid': 9, 'jenif': 8, 'birdcag': 4, 'kel': 10, 'businesslik': 3, 'kneed': 1, 'mewl': 2, 'feckless': 7, 'poopchev': 1, 'pommel': 4, 'prise': 2, 'derman': 1, 'reunuin': 1, 'cessat': 2, 'surfboard': 6, 'khrystyn': 2, 'haje': 3, 'kotea': 4, 'luri': 1, 'galligan': 2, 'hubri': 5, 'neverland': 5, 'soma': 1, 'bullfrog': 3, 'kayyyi': 1, 'christmassi': 1, 'taft': 11, 'lethargi': 4, 'bakesfield': 1, 'purg': 4, 'surer': 2, 'crueler': 4, 'unadulter': 7, 'frankel': 2, 'kori': 1, 'bendan': 1, 'guffman': 1, 'wheez': 4, 'catskil': 2, 'heron': 2, 'hobbl': 6, 'tonsil': 1, 'orion': 1, 'caldwel': 3, 'motorboat': 3, 'wickerman': 4, 'thtdb': 1, 'wishlist': 1, 'interlink': 2, 'cutthroat': 4, 'rolesth': 1, 'chuke': 2, 'sanam': 2, 'loopholesth': 1, 'hav': 2, 'triangleeveryth': 1, 'dthere': 1, 'notedirect': 1, 'mediocreamongst': 1, 'ranvijay': 4, 'shayn': 3, 'whitish': 1, 'ghostlik': 1, 'wooooooooohhhh': 1, 'schmanci': 1, 'allot': 15, 'resoundingli': 4, 'morgon': 1, 'overrus': 1, 'proog': 6, 'tassel': 1, 'pcm': 1, 'ugc': 1, 'uuhhhhh': 1, 'tlc': 2, 'turpentin': 1, 'manila': 2, 'mmff': 1, 'lusterio': 1, 'bikay': 1, 'duroy': 1, 'gether': 2, 'copolla': 2, 'filmdom': 8, 'giallio': 1, 'sanguinusa': 1, 'tornado': 42, 'highjli': 1, 'usherett': 1, 'lowdown': 2, 'melida': 1, 'dieter': 5, 'bohlen': 7, 'picaresqu': 5, 'roomi': 2, 'attitiud': 1, 'manniquen': 1, 'boe': 16, 'bellwood': 1, 'documentedli': 1, '2012': 3, 'weinberg': 6, 'merian': 2, 'reevalu': 4, 'jesmind': 2, 'sikh': 4, 'bilb': 1, 'manucci': 3, 'whittington': 2, 'delmer': 3, 'foxhol': 3, 'mariiin': 1, '1889': 1, 'hiram': 3, 'drago': 11, 'pedilla': 1, 'casserol': 2, 'digg': 6, 'kirschner': 1, 'cokehead': 1, 'lorraina': 1, 'bobbitt': 1, 'griswald': 4, 'rami': 10, 'klane': 1, 'imogen': 2, 'palin': 2, 'looker': 8, 'diario': 3, 'moretti': 11, 'pietro': 2, 'englishmen': 4, 'typhoid': 1, 'ballerina': 5, 'quinten': 1, 'tarrantino': 1, 'dampen': 4, 'obstreper': 1, 'warpaint': 1, 'checkpoint': 13, 'teasingli': 2, 'sadeghi': 1, 'tehrani': 1, 'safar': 1, 'samandar': 2, 'mohamad': 1, 'kheirabadi': 1, 'spiffi': 3, 'reportag': 1, 'rit': 2, 'offisd': 1, 'coquett': 1, 'prieuv': 2, 'snub': 5, 'nirothi': 1, 'niel': 11, 'rotorscop': 1, 'ticklish': 1, 'ripner': 7, 'lighthous': 5, 'crythin': 3, 'gifford': 5, 'drablow': 5, 'gosselaar': 2, 'amel': 1, 'necrophiliac': 3, 'roofi': 1, 'jacobson': 1, 'fixin': 1, 'insp': 5, 'zell': 1, 'chivalr': 4, 'hecht': 12, 'perrault': 3, 'graceless': 1, 'vicey': 1, 'osir': 1, 'fanfaberi': 1, 'tytu': 1, 'andronicu': 1, 'zant': 2, 'kielberg': 1, 'zimmermann': 3, 'noethen': 2, 'heino': 3, 'ferch': 3, 'indefinit': 4, 'chariss': 8, 'disentangl': 1, 'loveless': 13, 'chaplinesqu': 2, 'aaip': 1, 'dipstick': 1, 'dipper': 1, 'waddlesworth': 2, 'macaw': 3, '102': 19, 'tightwad': 1, 'sponser': 1, 'mercial': 2, 'ravi': 6, 'tandon': 1, 'jawab': 1, 'rajkumar': 3, 'santoshi': 7, 'damini': 1, 'pukar': 1, 'lajja': 1, 'aryeman': 3, 'ashok': 3, 'mehta': 2, 'ordin': 3, 'moughal': 1, 'ist': 2, 'betsi': 20, 'sharyn': 3, 'moffett': 3, 'rookeri': 1, 'spam': 6, 'clearhead': 1, 'emori': 20, 'parnel': 7, 'beserk': 1, 'moviesi': 1, 'pycho': 1, 'soultendieck': 1, 'mew': 5, 'unassur': 3, 'locken': 3, 'comteg': 1, 'silliph': 1, 'mothbal': 3, 'humpti': 2, 'shikoku': 3, 'priestess': 11, 'fumiko': 2, 'sayori': 5, 'gluey': 1, 'myspac': 7, 'locoformovi': 3, 'hoff': 2, 'scupper': 2, 'hickland': 4, 'swordfish': 4, 'pulsat': 9, 'shazza': 1, 'lexu': 1, 'fanu': 3, 'trinian': 3, 'cunnilingu': 4, 'ashcroft': 2, 'roxburi': 5, 'dissapiont': 1, 'mainten': 4, 'brosnon': 1, 'tt1337580': 1, 'bdwi': 1, 'mcafe': 3, 'nx': 4, 'jolen': 4, 'subcommand': 3, 'mcgaw': 2, 'stoddard': 3, 'peachi': 6, 'aeon': 3, 'multivers': 1, 'dainiken': 1, 'cryo': 1, 'rotweil': 1, 'browna': 1, 'ordo': 1, 'templi': 1, 'truce': 2, 'cutleri': 5, 'demigod': 2, 'foothil': 2, 'olympu': 1, 'yc': 2, 'dvorian': 1, 'boyar': 1, 'hermitag': 1, 'etv': 1, 'nepolean': 1, 'wererabbit': 1, 'astroboy': 1, 'innard': 9, 'delbert': 4, 'manmohan': 6, 'parvarish': 2, 'naseeb': 2, 'gjsthi': 1, 'ko': 11, 'dard': 2, 'hota': 1, 'cringeth': 1, 'carricatur': 1, 'moredirect': 1, 'okayamitabh': 1, 'laawari': 1, 'satyen': 1, 'kapuu': 1, 'nirupa': 3, 'dara': 5, 'spoilersth': 2, 'muchli': 1, 'imom': 2, 'fembot': 2, 'almightli': 2, 'lexi': 11, 'unpersuas': 1, 'bresslaw': 3, 'maynard': 5, 'onrun': 1, 'hopkirk': 1, 'idealolog': 1, 'premarit': 1, 'crushingli': 1, 'armatur': 6, 'gofer': 4, 'claviu': 1, '740': 1, 'avalo': 1, 'autism': 6, 'rasmuss': 1, 'kamikaz': 3, 'crucif': 2, 'part1': 4, 'swartz': 1, 'stauffer': 1, 'nautic': 2, 'revivifi': 1, 'entomb': 3, 'reefer': 12, 'chee': 1, 'toh': 1, 'footwear': 4, 'garfunkel': 2, 'menc': 1, 'kutuzov': 1, 'alessio': 1, 'dolittl': 6, 'motherf': 1, 'styler': 1, 'manfredi': 3, 'outsourc': 8, 'mismanag': 3, 'steelwork': 2, 'timey': 1, 'unfoil': 1, 'druther': 1, 'knighthood': 4, 'prepoir': 1, 'telfair': 1, 'avignon': 1, 'tellegen': 1, 'bernhardt': 1, 'farrar': 1, 'boardman': 2, 'pitiless': 3, 'katina': 8, 'overbit': 3, 'malkovich': 9, 'tolbukhin': 4, 'asesino': 1, 'milimet': 1, 'viceversa': 1, 'guatemala': 4, 'documentalist': 1, 'offfic': 1, 'circumstanti': 6, 'jeopard': 7, 'unalien': 2, 'coulardeau': 9, 'sorbonn': 11, 'teil': 1, 'cegid': 2, 'sabato': 9, 'miyamoto': 1, 'televangel': 1, 'voltron': 3, 'shuddup': 2, 'nowcheer': 1, 'itll': 1, 'slowdown': 2, 'caballero': 1, 'jarjar': 1, 'flunki': 3, 'vomitum': 1, 'exhum': 4, 'castaway': 9, 'ketchim': 1, 'fangl': 3, 'hoariest': 1, 'govno': 2, 'prereleas': 1, 'efenstor': 2, 'yeardley': 4, 'unrecognis': 7, 'bolam': 2, 'alun': 2, 'redman': 2, 'lothario': 5, 'pickett': 1, 'pendanski': 2, 'campmat': 1, 'winkler': 17, 'fussbudget': 1, 'unbelief': 4, 'asphyxi': 1, 'convuls': 6, 'khleo': 4, 'greenlak': 1, 'barlow': 2, 'elya': 1, 'squid': 11, 'kasch': 2, 'zig': 2, 'zag': 3, 'brenden': 1, 'psychotherapist': 2, 'augusten': 3, 'kaedin': 1, 'dushku': 12, 'sagemil': 11, 'dillus': 2, 'montel': 2, 'nav': 1, 'unhumor': 2, 'sleepaway': 17, 'hairbal': 1, 'seahunt': 2, 'fobbi': 1, 'crackhead': 2, 'imprec': 1, 'rectitud': 3, 'relevantli': 1, 'puss': 11, 'connipt': 2, 'busybodi': 2, 'strick': 7, 'barefac': 1, 'forlornli': 1, 'kraft': 7, 'tristram': 3, 'shandi': 1, 'scholarli': 5, 'psychopathia': 1, 'sexuali': 1, 'aaaahhhhhhh': 1, 'handout': 1, 'oyelowo': 1, 'malahid': 1, 'coarsen': 1, 'tirelessli': 1, 'lucinda': 5, 'dryzek': 1, 'alyson': 7, 'caleigh': 1, 'baldli': 1, 'cacophon': 3, 'flakey': 1, 'liverpudlian': 1, 'sluggishli': 3, 'nebul': 6, 'unappetis': 1, 'nauseam': 6, 'hamlisch': 3, 'acl': 2, 'meta': 7, 'reductivist': 1, 'grampa': 3, 'foss': 7, 'dancin': 3, 'saigon': 2, 'redlich': 3, 'nexu': 2, 'setter': 3, 'kretschmann': 2, 'imprest': 2, 'jeter': 7, 'toto': 22, 'phat': 5, 'penney': 1, 'cellulit': 1, 'skank': 5, 'retool': 3, 'utlim': 2, 'xxth': 2, 'domini': 6, 'vapour': 1, 'claudel': 1, 'anatol': 2, 'massenet': 1, 'imperish': 1, 'outliv': 8, 'disson': 2, 'registr': 10, 'carnet': 1, 'bal': 3, 'boriest': 1, 'groundskeep': 1, 'hemmitt': 1, 'zungia': 1, 'lapinski': 1, 'mccallist': 2, 'rawail': 1, 'hulchul': 4, 'cog': 8, 'quartier': 20, 'quatier': 1, 'quai': 8, 'gurind': 3, 'tuileri': 9, 'bastil': 6, 'castellitto': 5, 'lachais': 8, 'parc': 6, 'monceau': 6, 'ludivin': 4, 'sagnier': 4, 'choisi': 3, 'pigal': 5, 'hoskin': 9, 'fete': 2, 'seydou': 3, 'boro': 7, 'ssa': 2, 'cyclic': 4, 'victoir': 6, 'gaspard': 3, 'ulliel': 4, 'psychokinet': 2, 'tootsi': 5, 'puzzler': 3, 'hoari': 5, 'trini': 8, 'alvarado': 8, 'featherweight': 3, 'riddick': 1, 'multimillion': 1, 'cringeworthi': 9, 'mechanik': 1, 'puposelessli': 1, 'salma': 12, 'nielson': 6, 'rino': 4, 'silvestro': 3, 'ning': 2, 'qian': 3, 'thew': 3, 'lordship': 1, 'noblemen': 2, 'longhair': 1, 'palefac': 3, 'perfidi': 2, 'chieftain': 8, 'fopperi': 1, 'argyl': 6, 'mistook': 2, 'killearn': 4, 'splite': 1, 'booooooooo': 1, 'thornway': 10, 'ekin': 10, 'cheng': 16, 'mou': 1, 'gamecub': 2, 'farcri': 1, 'diavolo': 2, 'klum': 3, 'nadanova': 1, 'nanobot': 1, '10i': 3, 'oth': 1, 'bewitchingli': 2, 'novac': 1, 'inconvenienc': 1, 'marsali': 1, 'movieyup': 1, 'tribilist': 1, '1930sstereotyp': 1, 'dearz': 1, 'meduim': 1, 'briggitta': 1, 'fantastico': 1, 'slovik': 6, 'nam': 20, 'eoe': 1, 'kp': 1, 'teleflick': 1, 'parse': 1, 'torti': 1, '3pm': 1, 'pigsti': 2, 'tarantula': 4, 'miriad': 1, 'kep': 1, 'offcours': 2, 'whih': 1, 'itelf': 1, 'spescial': 1, 'ospenskya': 1, 'gday': 1, 'animalplanet': 1, 'hypoderm': 3, 'yeeeowch': 1, 'grabbin': 1, 'queensland': 3, 'koala': 1, 'sommerset': 1, 'contempori': 1, 'maughm': 1, 'popularist': 2, 'moveabl': 1, 'hemingwayit': 1, 'oph': 1, 'ls': 2, 'boulevard': 9, 'brioch': 2, 'fatherland': 3, 'podalyd': 3, 'descour': 1, 'bekhti': 1, 'mareno': 1, 'daycar': 1, 'schmitz': 4, 'coixet': 5, 'buschemi': 1, 'louver': 1, 'conon': 1, 'snowwhit': 1, 'naruto': 3, 'inuyasha': 2, 'shonen': 1, 'fanatasi': 2, 'herngren': 2, 'beecham': 1, 'doctrinair': 2, 'headlong': 4, 'carpathia': 3, 'claremont': 4, 'cigliutti': 1, 'razzl': 5, 'waylay': 2, 'snakeeat': 2, 'clampet': 1, 'caca': 2, 'boldest': 1, 'kida': 8, 'infact': 2, 'rydstrom': 1, 'aitd': 2, 'portfolio': 7, 'pretenc': 5, 'cinemablend': 2, 'php': 3, '209': 1, 'showthread': 1, 'threadid': 1, '21699': 1, 'greenish': 2, 'weedi': 2, 'vultur': 3, 'bradburi': 16, '98minut': 1, 'reconsid': 18, 'keifer': 6, 'polygraph': 5, 'tsk': 1, 'lept': 1, 'stingray': 3, 'brozzi': 2, 'drewitt': 2, 'buckley': 4, 'poacher': 2, 'szubanski': 2, '1876': 6, 'millard': 23, 'mcnalli': 24, 'waco': 15, 'duryea': 35, 'tuscosa': 1, 'doucett': 2, 'yowlachi': 2, 'coctail': 1, 'assay': 2, 'heterai': 1, 'sappho': 1, 'fei': 4, 'lensman': 17, 'metroid': 1, 'forgon': 2, 'droopi': 1, 'primev': 5, 'tampopo': 2, 'wisbar': 3, 'supernova': 7, 'averagey': 1, 'handrail': 1, 'signalman': 4, 'borefest': 3, 'upris': 7, 'nervous': 15, 'talkd': 1, 'whathavey': 1, 'valleyspeak': 1, 'loogi': 1, 'airheaded': 2, 'witter': 2, 'unstrain': 1, 'sightli': 1, 'rereleas': 1, 'rohled': 1, 'rotter': 1, 'tsiang': 3, 'crowel': 1, 'rollo': 7, 'fantasyfilmfest': 1, 'raunchiest': 2, 'rapidshar': 1, 'verma': 10, 'deepa': 1, 'sudhir': 1, 'mishra': 2, 'magisteri': 1, 'stucco': 3, 'rocail': 1, 'riproar': 1, 'synchronis': 4, 'stamper': 1, 'purloin': 1, 'schoolkid': 2, 'defac': 3, 'unidimension': 1, 'cunda': 1, 'concha': 1, 'various': 4, 'metalhead': 1, 'mortadello': 1, 'filemon': 1, 'postino': 2, 'spinsterdom': 1, 'buena': 3, 'bongo': 4, 'guantanamera': 1, 'clubgoer': 1, 'spanner': 2, 'walpurgi': 2, 'morsheba': 1, 'xiv': 2, 'clamor': 4, 'fryer': 2, 'backu': 4, 'herren': 7, 'shintaro': 15, 'unshowi': 1, 'rentar': 1, 'mikuni': 1, 'nishimura': 1, 'magobei': 2, 'hanzo': 43, 'yuko': 1, 'hamada': 1, 'satsuo': 1, 'remenb': 1, 'stereorever': 1, 'masterpiece10': 1, 'alchem': 2, 'rectangl': 2, 'dooki': 5, 'borowcyzk': 1, 'unhitt': 1, 'wusa': 3, 'insurmount': 10, '1824': 3, 'wahhhhh': 1, 'boohooo': 1, 'tylenol': 3, 'codein': 1, 'superstor': 3, 'housesit': 1, 'rembrandt': 2, 'robson': 13, 'armada': 3, 'appreciat': 1, 'titain': 1, 'drumlin': 1, 'noch': 4, 'ciego': 1, 'peasantri': 2, '1473': 1, 'iceland': 11, 'loisaida': 1, 'altagracia': 3, 'freestyl': 1, 'aheheh': 2, 'florey': 4, 'happiest': 8, 'hoffa': 2, 'genealog': 1, 'este': 1, 'lauder': 1, 'thirtysometh': 2, 'bood': 1, 'phesht': 1, 'hoosier': 4, 'blythen': 2, 'bassett': 13, 'mudbank': 1, 'diahann': 3, 'coilit': 1, 'meisner': 2, 'telemovi': 5, 'halifax': 1, 'expenditur': 3, 'aleksandar': 1, 'bercek': 1, 'emir': 7, 'stribor': 4, 'iraqi': 16, 'twofold': 3, 'harronhow': 1, 'jed': 35, 'lancom': 1, 'commer': 1, 'jacuzzi': 3, 'chequer': 1, 'frisbe': 5, 'trippl': 1, 'plex': 5, 'haddofield': 1, 'boogeman': 1, 'bracket': 11, 'burgomeist': 1, 'kleinschloss': 1, 'samoan': 9, 'unamus': 3, 'gnarl': 1, 'fernandel': 1, 'gavra': 5, 'lambraki': 1, 'aveu': 1, 'artur': 2, 'stalinist': 2, 'suckfest': 3, 'haystack': 2, 'vaporis': 2, 'mortar': 7, 'callan': 6, 'hillman': 1, 'pettet': 1, 'jordach': 1, 'cleavon': 2, 'goga': 1, 'tessier': 2, 'kirkland': 24, 'preponder': 4, 'sentai': 6, 'mmpr': 4, 'zyurang': 1, 'charleston': 6, 'qu': 1, 'toi': 2, 'lucinenn': 1, 'tulsa': 7, 'rumblefish': 1, 'stotz': 1, 'mohican': 5, 'intertwain': 1, 'macedonian': 5, 'labina': 1, 'mitevska': 1, 'jiri': 4, 'machacek': 4, 'innermost': 9, 'goofu': 1, 'svu': 3, 'janel': 5, 'busfield': 7, 'sj': 5, 'berg': 5, 'ingela': 2, 'olsson': 3, 'ilva': 1, 'holmfrid': 1, 'rahm': 1, 'hkel': 1, '132': 2, 'teorema': 1, 'areakt': 1, 'koenig': 1, 'chekov': 1, 'aster': 3, 'jorian': 1, 'excelsior': 4, 'symbiont': 1, 'beachhead': 1, 'confusathon': 1, 'boardroom': 8, 'musa': 3, 'pone': 2, 'hyperkinet': 3, 'marmorstein': 2, 'deathless': 4, 'tt0073891': 1, 'mosfilm': 1, 'trough': 12, 'bushido': 5, 'sanada': 2, 'mifum': 1, 'engrish': 5, 'exterem': 2, 'relatonship': 1, 'saath': 10, 'apk': 1, 'actal': 1, 'martix': 1, 'excactli': 1, 'spectecular': 1, 'etheryth': 1, '5min': 2, 'liason': 4, 'erroy': 1, 'enterieur': 1, 'mideav': 1, 'hellebard': 1, 'hourli': 2, 'giardello': 9, 'gumsho': 2, 'mayerl': 2, 'extravagantli': 4, 'popinjay': 2, 'austro': 1, 'mittel': 1, 'comensur': 1, 'stupefyingli': 3, 'oooomph': 1, 'mame': 6, 'lancelot': 3, 'spratt': 1, 'ruritanian': 1, 'buffa': 1, 'mirag': 11, 'sascha': 7, 'horler': 1, 'farinacci': 1, 'diaget': 1, 'alexanderplatz': 1, 'miez': 1, 'fleadh': 1, 'drizzl': 2, 'juryalthough': 1, 'pungent': 7, 'oder': 3, 'stroptomycin': 2, 'microb': 3, 'chaparon': 2, 'etvorka': 1, '4m': 2, '4w': 1, 'rower': 1, 'coxswain': 1, 'bhoomika': 4, 'sushant': 2, 'fotp': 1, 'popcultur': 1, 'luftwaff': 4, 'wanderng': 1, 'foppington': 2, 'nordham': 1, 'firecrack': 6, 'gondek': 1, 'hennenlott': 1, 'pittman': 1, 'beverley': 4, 'pedicab': 9, 'egomania': 2, 'fossilis': 2, 'baught': 1, 'charactersmi': 1, 'flack': 12, 'tastic': 5, 'everrrryon': 1, 'baboon': 2, 'unawkward': 1, 'ojah': 1, 'dilbert': 2, 'loosli': 2, 'worl': 1, 'worsel': 1, 'thuy': 5, 'anaesthet': 3, 'turgidli': 1, 'spiceworld': 1, 'airtim': 3, 'dibley': 5, 'woodwork': 9, 'kinship': 4, 'sandt': 1, 'wadd': 3, 'blacksploit': 4, 'bucktown': 6, 'jujitsu': 1, 'kickin': 3, 'vacanc': 3, 'aretha': 6, 'blacula': 3, 'imbalanc': 2, 'sensori': 5, 'gormless': 8, 'immit': 2, 'ungrammat': 1, 'susbtitut': 1, 'frownland': 6, 'glazen': 1, 'sickenli': 1, 'bronstein': 4, 'sovjet': 1, 'commut': 8, 'symona': 2, 'bonifac': 2, 'corrado': 2, 'kelsey': 3, 'conklin': 5, 'lorch': 1, 'lynton': 1, 'tyrrel': 1, 'heini': 2, 'bess': 4, 'cocoa': 3, 'krystal': 2, 'dominican': 13, 'szalinski': 3, 'pankin': 2, 'bartlett': 5, 'portobello': 10, '117': 5, 'videocassett': 2, 'booger': 3, 'omigosh': 2, 'kade': 4, 'mapoth': 1, 'clea': 2, 'gange': 1, 'upruptli': 1, 'anyday': 3, 'diehard': 3, 'gnp': 1, 'versacorp': 1, 'entrepreneuri': 2, 'organiz': 1, 'accusatori': 2, 'kwame': 2, 'livin': 6, 'workin': 2, 'walgreen': 3, 'wanderlust': 1, 'milf': 4, 'metabol': 2, 'softi': 5, 'loch': 5, 'dillemma': 1, 'basiclli': 1, 'harveri': 2, 'strage': 1, 'mankin': 1, 'pathway': 3, 'sri': 5, 'lanka': 4, 'eboni': 3, 'teak': 1, 'jale': 1, 'mcmillan': 2, 'blandish': 1, 'tacitli': 1, 'overarch': 3, 'brennen': 3, 'soong': 1, 'vengenc': 2, 'absens': 1, 'devlop': 1, 'elbaor': 1, 'watchoski': 1, 'casomai': 4, '116': 5, 'soundgarden': 2, 'gurante': 2, 'ashura': 8, 'izumo': 7, 'tsubaki': 1, 'yojiro': 1, 'takita': 1, 'onmyoji': 2, 'neul': 3, 'kyeong': 2, 'hyeong': 1, 'eff': 2, 'hookin': 1, 'nevermor': 4, 'balsa': 6, 'teenish': 2, 'spookiest': 2, 'eeeekkk': 1, 'classicist': 2, 'offshor': 2, 'mediocreland': 1, 'pp': 2, 'untrain': 5, 'widowhood': 2, 'bambini': 1, 'guardano': 1, 'telefoni': 1, 'spagnolo': 6, 'elio': 2, 'marcuzzo': 2, 'menti': 1, 'roma': 14, 'citt': 1, 'aperta': 1, 'sciusci': 1, 'brume': 1, 'moko': 1, 'paesan': 1, 'viscontian': 1, 'suoi': 1, 'fratelli': 1, 'guillaumm': 1, 'romulu': 4, 'bana': 9, 'kodi': 1, 'smit': 1, 'mcphee': 1, 'raimond': 2, 'gaita': 1, 'unremittingli': 5, 'hardass': 3, 'undertow': 4, 'bri': 3, 'comin': 4, 'morbidli': 9, 'glorif': 6, 'polson': 2, 'swimfan': 2, 'chard': 6, 'obfusc': 2, 'asl': 4, 'oralist': 1, 'wallbang': 1, 'stepin': 11, 'fetchit': 14, 'radiofreccia': 5, 'romagna': 2, 'freccia': 3, 'raptu': 1, 'cubbyhous': 1, 'chandni': 5, 'longshot': 4, 'gelf': 1, 'slitheen': 3, 'tamsin': 1, 'barrowman': 2, 'blighti': 3, 'thriteen': 2, 'tennant': 2, 'catholic': 7, 'pieti': 2, 'brechtian': 1, 'pucel': 1, 'cauchon': 2, 'walbrook': 3, 'machievellian': 1, 'niccolo': 1, 'perin': 4, '14afear': 1, 'blackburn': 2, '88min': 1, 'tappin': 1, 'likemind': 1, 'undistinguish': 11, 'franfreako': 1, 'nfl': 3, 'nhl': 1, 'haur': 1, 'butcheri': 3, 'ver': 3, 'nica': 5, 'fabi': 2, 'cond': 2, 'riva': 5, 'lillo': 2, 'javier': 5, 'pilar': 3, 'zorrilla': 2, 'tazmainian': 1, 'werewold': 1, 'nuttbal': 1, 'costel': 1, 'metalbeast': 1, 'mostof': 1, 'atrend': 1, 'thankfuli': 1, 'samaha': 1, 'hellbound': 2, 'belch': 10, 'chix': 1, 'reshovski': 1, 'carhart': 2, 'shor': 1, '261k': 1, 'bartel': 11, 'brewski': 1, 'kempo': 1, 'koreatown': 1, 'uncultur': 2, 'homi': 1, 'remmi': 2, 'xenophobia': 5, 'leonida': 2, 'sparta': 1, 'eragon': 2, 'discustingli': 1, 'masterb': 1, 'soderberg': 3, 'benecio': 1, 'splittingli': 4, 'nanadini': 1, 'narasimha': 6, 'vamshi': 1, 'tigress': 1, 'fiza': 3, 'sensitis': 1, 'uncoupl': 1, 'gilley': 18, 'jalapeno': 1, 'alderson': 1, 'augur': 1, 'neuromuscular': 1, 'hyundai': 1, 'andreef': 2, 'illogicalin': 1, 'greatth': 1, 'entersth': 1, 'abruptlydirect': 1, 'goodakshay': 1, 'elsejohn': 1, 'nargi': 4, 'neetu': 2, 'rte': 2, 'krisana': 4, 'matiss': 4, 'latvian': 2, 'archivist': 2, 'michaelango': 1, 'kelemen': 2, 'southerli': 1, 'dateless': 2, 'balderdash': 2, 'sellar': 3, 'magilla': 1, 'diddl': 2, 'jurra': 1, 'sloggi': 2, 'semana': 5, 'rard': 8, 'commerici': 1, 'warmest': 1, 'whe': 1, 'abyssm': 2, 'letourneau': 8, 'vili': 2, 'cimino': 5, 'reconcept': 1, 'deadlock': 3, 'filmfour': 4, 'blot': 6, 'flagrant': 4, 'bergin': 8, 'breakingli': 3, 'cooley': 3, 'melisa': 1, 'lanisha': 15, 'joycelyn': 6, 'unemot': 16, 'unconsid': 1, 'greengass': 1, 'narcolepsi': 5, 'parenthood': 5, 'durden': 2, 'budakon': 1, 'arkush': 4, 'ving': 6, 'pilat': 6, 'relgiou': 1, 'flaviu': 1, 'josephu': 2, 'turco': 1, 'tal': 2, 'palminterri': 2, 'joyrid': 8, 'dreadcentr': 1, 'razorfriendli': 1, 'arsonist': 4, 'dearden': 1, 'grippingli': 1, 'dumblain': 1, 'outperform': 3, 'dechif': 1, 'laundrett': 4, 'messier': 1, 'alwin': 1, 'kuchler': 1, 'unhesitatingli': 1, 'galumph': 1, 'noisier': 2, 'spiritless': 3, 'withnail': 6, 'apidistra': 1, 'hasan': 3, 'covertli': 2, 'deli': 1, 'auggi': 3, 'triumphalist': 1, 'mikeandvicki': 1, 'apallonia': 1, 'appallonia': 1, 'citizenship': 1, 'fernandina': 2, 'tami': 3, 'devest': 1, 'paci': 1, 'explet': 15, 'homili': 5, 'bullitt': 2, 'dvda': 1, 'bachar': 1, 'cartman': 3, 'kablooey': 2, 'teletyp': 3, 'krisner': 1, 'poolsid': 3, 'mcraney': 3, 'spririt': 1, 'leninist': 2, 'coulter': 2, 'thenewamerican': 1, 'tna': 1, 'vo12no18': 2, 'hasta': 2, 'luego': 1, 'goldmemb': 2, 'bouncier': 1, 'solemn': 13, 'dragonballz': 1, 'digimon': 2, 'rote': 2, 'unpremedit': 1, 'epitomis': 4, 'hastey': 1, 'freeview': 1, 'pritchard': 2, 'dainton': 2, 'stinkbomb': 2, 'undersold': 1, 'tbere': 1, 'mishmash': 16, 'jiggi': 1, 'pneumonia': 2, 'disassembl': 3, 'cor': 5, 'schulmaedchenreport': 1, 'vey': 5, '3p': 3, 'ppp': 3, 'imperfectionist': 1, 'finito': 1, 'humpdorama': 1, 'seitz': 2, 'emmili': 1, 'haydon': 1, 'aha': 8, 'dearest': 11, 'consiglieri': 1, 'anjolina': 1, 'ecstaci': 1, 'rizla': 1, 'manvil': 5, 'horrifingli': 1, 'guevera': 1, 'ribaldri': 1, 'swordsmen': 3, 'plympton': 1, 'aug': 3, 'ped': 2, 'jorma': 1, 'taccon': 1, '50k': 1, 'archiolog': 1, 'catolog': 1, 'archiologist': 1, 'wern': 1, 'geronimo': 11, 'heronimo': 3, 'bello': 12, 'undefeat': 1, 'unforeseen': 4, 'unstructur': 3, 'astin': 8, 'addam': 4, 'gangreen': 1, 'clambak': 1, 'brobdingnagian': 1, 'shrewsburi': 3, 'unisol': 28, '2500': 1, 'forgetaboutit': 1, 'outmod': 2, 'lickin': 2, '1138': 2, 'heavyhand': 1, 'reputedli': 3, 'greenberg': 3, 'murkili': 1, 'stygian': 1, 'recapitul': 2, 'lauderdal': 2, 'rozel': 1, 'facsimil': 3, 'goggin': 1, 'cadbi': 2, 'reportedi': 1, 'complicitor': 1, 'ahm': 4, 'corlan': 1, '750': 11, 'handpick': 3, 'marolla': 7, 'bergdorf': 5, 'eikenberri': 7, 'slovenli': 4, 'ointment': 4, 'maximilian': 6, 'schell': 10, 'keillor': 2, 'yaaay': 2, 'erit': 1, 'fl': 5, 'envahisseur': 1, 'yale': 6, 'ballot': 4, 'asseri': 3, 'gardenia': 14, 'reink': 2, 'qute': 1, 'annonym': 1, 'perforamnc': 1, 'doeesn': 1, 'mcaff': 1, 'kudisch': 5, 'stubli': 1, 'happpi': 1, 'taht': 2, 'nwhere': 1, 'friendless': 5, 'remiss': 4, 'hardboil': 3, 'parkey': 1, 'fooey': 1, 'breviti': 10, 'nascent': 9, 'riveria': 1, 'sequin': 4, 'misogamist': 1, 'clocker': 1, 'johney': 1, 'wordplay': 4, 'seper': 3, 'koechner': 4, 'paleolith': 1, 'elaps': 6, 'fbp': 1, 'yorgo': 1, 'miscarrag': 2, 'bus': 1, 'disapear': 1, 'playgroud': 1, 'trape': 1, 'litl': 1, 'samuari': 1, 'galleon': 3, 'slimey': 2, 'samuaraitast': 1, 'glaucoma': 1, 'centauri': 1, 'cheroke': 3, 'bont': 15, 'pitzali': 3, 'maruschka': 9, 'rashamon': 1, 'ozjepp': 1, 'pothol': 3, 'hulu': 6, 'treesben': 1, 'conversationth': 1, 'palati': 2, 'deskther': 1, 'giff': 1, 'rector': 1, 'marla': 4, 'chicaneri': 3, 'sternwood': 1, 'summa': 2, 'halsey': 2, 'sud': 4, 'noiromet': 1, 'bagger': 2, 'entreat': 1, 'petroleum': 2, 'division': 1, 'fastbal': 2, 'moritz': 5, 'bleibtreu': 4, 'metschurat': 4, 'unbeat': 11, 'roper': 7, 'filmstrip': 2, 'hartford': 3, 'tolling': 10, 'landown': 9, 'unsavouri': 5, 'villainesqu': 1, 'garm': 2, 'wwwwwwwaaaaaaaaaaaayyyyyyyyyyy': 1, 'gorili': 1, 'chesti': 4, 'loncrain': 1, 'farrow': 5, 'tahitian': 2, 'naef': 1, 'venezia': 2, 'bella': 5, 'stillman': 1, 'leitch': 1, 'vieria': 1, 'othenin': 2, 'girard': 3, 'montesi': 3, 'taggert': 1, 'embryo': 2, 'burnout': 2, 'adv': 17, 'disqualif': 7, '10the': 6, 'niedhart': 2, 'snuka': 2, 'ddt': 5, '10hulkamaniac': 1, 'hacksaw': 1, 'bigbossman': 1, 'tugboat': 2, 'hulkamaniac': 2, 'zhukov': 2, 'mercanari': 1, 'forearm': 6, 'adnan': 1, 'guerrerro': 1, 'okerlund': 1, '10overal': 4, 'encorew': 1, 'baaaaaaaaaaaaaad': 1, 'mccord': 8, 'lipgloss': 1, 'nishaabd': 1, 'mehbooba': 7, 'icehol': 2, 'eviscer': 6, 'venn': 1, 'chien': 5, 'andal': 3, 'rgv': 17, 'snoozefest': 4, 'lapain': 1, 'delerium': 1, 'bightman': 1, 'furtado': 1, 'chritma': 1, 'whytefox': 1, 'condoleeza': 2, 'rumsfeld': 3, 'barack': 3, 'obama': 4, 'delaru': 1, 'maccarthi': 2, 'unreform': 1, 'strongpoint': 2, 'dpp': 5, 'carp': 4, '100min': 2, 'instinctivli': 1, 'gaurente': 2, 'sneeri': 2, 'turncoat': 5, 'qaulen': 1, 'mathurin': 3, 'kinnison': 1, 'kabbal': 1, 'theosophi': 1, 'crosscut': 2, 'desplechin': 7, 'bleakli': 1, 'namedrop': 2, 'carley': 2, 'reinterpret': 5, 'waner': 1, 'nanak': 1, 'enuff': 2, 'goldmin': 7, 'blakewel': 1, 'bootlegg': 1, 'precod': 6, 'shintar': 4, 'zat': 5, 'misumi': 2, 'itami': 2, 'aoi': 1, 'nakajima': 1, 'midori': 2, 'bogdonavitch': 1, 'paedophiliac': 1, 'faraway': 8, 'volent': 1, 'indoctrin': 11, 'comedygenr': 1, 'honkong': 1, 'nye': 4, 'lookit': 2, 'cmt': 2, 'sedan': 4, 'footloos': 3, 'bodyswerv': 1, 'farnham': 2, 'slomo': 2, 'fallin': 1, 'slipshod': 7, 'salubri': 1, 'ruggedli': 5, 'beff': 1, 'dernier': 1, 'tournant': 1, 'foreseen': 6, 'mane': 3, 'leger': 1, 'giner': 1, 'jenk': 2, 'astrid': 7, 'allwyn': 2, 'jazzi': 13, 'crinkli': 1, 'upish': 1, 'complementari': 6, 'luz': 3, 'riverton': 1, 'skagg': 1, 'sandefur': 1, 'stickney': 4, 'spangl': 3, '75m': 1, 'ditka': 1, 'ryne': 1, 'sandberg': 1, 'genina': 1, 'tograph': 1, 'nee': 1, 'unproduct': 3, 'strangul': 10, 'firelight': 3, 'gudrun': 2, 'glower': 4, 'supertroop': 1, 'congrat': 11, 'lavel': 4, 'candidli': 3, 'danson': 1, 'cadilac': 1, 'arcand': 4, 'manfr': 10, 'sloth': 21, 'nippi': 2, 'dandelion': 2, 'uninfect': 1, 'unflag': 3, 'thespic': 1, 'rausch': 1, 'trumillio': 1, 'dunlay': 1, 'slambang': 1, 'cutsey': 1, 'hemispher': 4, 'peyot': 3, 'upa': 4, 'exlus': 1, 'probabilist': 1, 'stoichast': 1, 's2': 1, 'herculean': 4, 'toothi': 2, 'lebanon': 3, 'bakhtyari': 1, 'karun': 1, 'malcomson': 4, 'alessandra': 4, 'torresani': 1, 'crystallin': 3, 'mormondom': 1, 'ldssingl': 1, 'lemonad': 3, 'buttergeit': 1, 'olaf': 3, 'constrict': 6, 'megadeth': 3, 'overachiev': 1, 'auh': 1, 'knighteley': 1, 'alf': 2, 'edulcor': 1, 'plinki': 1, 'sequal': 7, 'corny': 1, 'porretta': 1, 'oatmeal': 8, 'liddl': 1, 'sceam': 1, 'sependip': 1, 'dreamworld': 4, 'paprika': 1, 'cinnamon': 2, 'menes': 1, 'ukranian': 2, 'myrnah': 1, 'connecticutt': 1, 'catchier': 1, 'donavon': 2, 'lalouch': 1, 'voil': 4, 'cavett': 4, 'devoutli': 3, 'backroad': 1, 'slaughterman': 1, 'asst': 2, 'earthworm': 2, 'tennapel': 2, 'bulgi': 1, 'jarman': 1, 'conker': 2, 'transito': 1, 'cornflak': 3, '35pm': 1, 'directivo': 1, 'inves': 1, 'hbo2': 1, '1919': 6, 'prescient': 11, 'sacha': 2, 'kicha': 1, 'streptomycin': 1, 'vi': 12, 'jovan': 1, 'acin': 1, 'ebt': 4, 'tripwir': 1, 'defo': 10, 'misaki': 1, 'ito': 1, 'mya': 3, 'moonrak': 3, 'inventori': 4, 'mi6': 2, 'woolworth': 2, 'storesairwolf': 1, 'flashpoint': 5, 'pavarotti': 37, 'enid': 3, 'blyton': 1, 'airsoft': 1, 'crusher': 1, 'southerrn': 1, 'barnwel': 1, 'demystifi': 2, 'affectionn': 1, 'prisinor': 1, 'electecut': 1, 'transgender': 1, 'viscous': 2, 'tokla': 1, 'vestigi': 1, 'deadhead': 1, 'manifesto': 4, '20p': 1, 'furrow': 2, 'koyuki': 2, 'matsujun': 1, 'yori': 1, 'dango': 1, 'fukushima': 1, 'jewison': 11, 'fiddler': 3, 'highjink': 1, 'weightlift': 2, 'swung': 6, 'mcinal': 1, 'goriest': 5, 'nevski': 5, 'sleepaped': 1, 'montserrat': 1, 'liberia': 1, 'complimentari': 7, 'zebra': 4, 'swahili': 2, 'skool': 1, 'indefatig': 3, 'ragazza': 1, 'perfetta': 1, 'magnani': 2, 'langa': 1, 'poutili': 1, 'olden': 1, 'cavegirl': 3, 'assest': 1, 'whuppin': 2, 'vulkin': 1, 'fer': 4, 'shure': 1, 'whate': 2, 'grout': 1, 'zippi': 7, 'cringingli': 1, 'graveston': 4, 'crreeepi': 1, 'aaww': 1, 'dans': 7, 'glug': 2, 'spiki': 2, 'determinist': 1, '106': 5, 'beefheart': 1, 'imped': 5, 'wryli': 4, 'perestroika': 5, 'fanclub': 1, 'sostrong': 1, 'charactersprogress': 1, 'brownshirt': 1, 'thuggish': 5, 'jena': 3, 'telford': 1, 'putzi': 1, 'hanfstaengel': 1, 'lunk': 1, 'haid': 1, 'kaiser': 5, 'baggi': 6, 'porker': 1, 'mp': 6, '5s': 1, 'socomm': 1, 'fn': 3, '92f': 1, 'tec': 3, 'breathabl': 2, 'pensacola': 4, 'hotb': 2, 'pensacolian': 2, 'cellach': 4, 'northmen': 1, 'iona': 3, 'frilli': 2, 'doodl': 22, 'showroom': 5, 'sothern': 3, 'cinerama': 2, 'redden': 1, 'contextu': 8, 'makoto': 1, 'watanb': 1, 'actingwis': 1, 'masatoshi': 2, 'nagas': 2, 'tradition': 1, 'ag': 6, 'strove': 5, 'dharma': 2, 'tricia': 3, 'tanak': 1, '469': 1, 'seater': 6, 'hyuck': 7, 'doobi': 1, 'sabbato': 1, '001': 3, 'laughomet': 1, 'hardiest': 1, 'ungallantli': 1, 'buchinski': 1, 'slav': 1, 'unforgettablefor': 1, 'it11': 1, 'outstandingpeac': 1, 'applecart': 1, 'ziab': 4, 'lahem': 1, 'superposit': 1, 'ezzat': 1, 'allayli': 1, 'prfession': 1, 'lahm': 1, 'errant': 4, 'customis': 2, 'bossel': 1, 'toungu': 1, 'abr': 4, 'ojo': 4, 'kongfu': 1, 'scenes': 1, 'moiv': 1, 'fonz': 3, 'nuremburg': 4, 'institutionalis': 5, 'arado': 1, 'heinkel': 1, 'messerschmitt': 2, 'ballist': 6, 'anywhoo': 1, 'elanor': 1, 'agrama': 1, 'berlusconi': 1, 'reba': 2, 'iijima': 1, 'unauthor': 1, 'uncal': 6, 'hod': 1, 'handiwork': 1, 'weverka': 1, 'campfield': 1, 'felissa': 2, 'bacterium': 1, 'crise': 12, 'speedboat': 2, 'rosebud': 5, 'porteau': 1, 'cove': 6, 'stylu': 1, 'bridal': 2, 'knucklehead': 5, 'quadrophenia': 4, 'hesh': 2, 'bucco': 1, 'ladyfriend': 1, 'boitano': 1, 'agbayani': 1, 'dismount': 2, 'ioc': 1, 'barbarash': 2, 'dodd': 4, 'huband': 1, 'cubic': 5, 'increment': 5, 'ceaselessli': 1, 'longstand': 3, 'ganem': 1, 'comiccon': 1, 'gazook': 2, 'celeb': 12, 'dooooooooooom': 1, 'mauritania': 1, 'lysol': 1, 'shi77er': 1, 'chilton': 1, 'folksforget': 1, 'scorpio': 3, 'rmftm': 1, 'carbin': 2, 'hombr': 10, 'doooor': 1, 'conelli': 1, 'hollinghurst': 1, 'seced': 3, 'blonder': 8, 'hodet': 1, 'vannet': 1, 'elis': 5, 'midt': 1, 'obsurdli': 1, 'gret': 3, 'dukaka': 1, 'hathcock': 3, '7mm': 1, 'unconfirm': 3, 'usmc': 4, 'idk': 4, 'otherwisedon': 1, 'draskov': 1, 'unceas': 2, 'corros': 5, 'matthu': 1, 'realti': 1, 'catalunya': 3, 'jamon': 4, 'timeli': 1, 'shroeder': 1, 'sebastiaan': 3, 'zinta': 6, 'preem': 1, 'theopoli': 3, 'dort': 1, 'canuck': 2, 'nymphomania': 4, 'mambo': 6, 'idli': 3, 'anticompetit': 1, 'lycanthrop': 9, 'venessa': 2, 'baragrey': 2, 'lindoi': 1, 'blacker': 2, 'communin': 1, 'bizar': 1, 'rnberg': 1, 'xylophon': 6, 'nibelungenli': 3, 'kremhild': 1, 'mu': 4, 'lochlyn': 7, 'chandra': 7, 'darcey': 1, 'nicklodeon': 1, 'farel': 3, 'afirm': 1, 'excut': 1, 'mtm': 3, 'medico': 1, 'prostrat': 2, 'organist': 2, 'chast': 3, 'unrestrainedli': 1, 'patina': 1, 'courthous': 3, 'threlki': 2, 'grazzo': 1, 'pantang': 1, 'vasectomi': 2, 'chowder': 3, 'simialr': 1, 'shakey': 1, 'sprite': 7, 'cloutish': 1, 'pricey': 3, 'hallelujah': 5, 'configur': 5, 'subsequenet': 1, 'girldfriend': 1, 'kochak': 5, 'pneumon': 10, 'fitch': 5, 'poldi': 10, 'oner': 1, 'imprimatur': 1, 'shrinkag': 1, 'parasomnia': 4, 'lcd': 3, 'ameriac': 1, 'markup': 1, 'lenzi': 3, 'frear': 2, 'hovi': 2, 'azadi': 4, 'daei': 2, 'delor': 7, 'chachi': 2, 'sickest': 10, 'ind': 3, 'cinemagraph': 1, 'bayless': 1, 'partway': 2, 'dirg': 2, 'rolaid': 1, '1873': 5, 'ooookkkk': 1, 'hyer': 2, 'gam': 4, 'undergar': 3, 'beeb': 2, 'ersatz': 9, 'ineluct': 1, 'morass': 3, 'sandbagg': 1, 'ipcress': 1, 'richert': 2, 'kegan': 3, 'durn': 8, 'paiva': 1, 'lalli': 1, 'rabbet': 2, 'mercantil': 1, 'harlotri': 1, 'loumier': 1, 'rublev': 3, 'hecq': 1, 'daughterli': 1, 'grandfatherli': 2, 'hud': 3, 'hode': 1, 'linak': 3, 'simonson': 6, 'protoplasm': 3, 'telepathi': 3, 'howland': 2, 'jalopi': 3, 'hallen': 11, 'amput': 9, 'snugli': 5, 'fuurin': 1, 'doorbel': 1, 'maiko': 2, 'miyako': 1, 'wana': 1, 'shitter': 1, 'overgener': 1, 'uncompl': 6, 'slyvest': 1, 'gadg': 2, 'rettig': 1, 'agonia': 1, 'partirdg': 1, 'softbal': 4, 'rosey': 2, 'primatologist': 1, 'shaggier': 1, 'rosier': 1, 'undul': 2, 'congressmen': 1, '1040': 2, '1040a': 1, 'ober': 6, 'merkl': 3, 'rv': 15, 'g1': 3, 'photojournalist': 2, 'innkeep': 3, 'schoolfriend': 1, 'faat': 5, 'kine': 5, 'ousman': 1, 'semben': 2, 'semeben': 1, 'crewson': 4, 'bissonnett': 4, 'wholovesthesun': 1, 'mccaughan': 1, 'portastat': 1, 'stopkewich': 1, 'coulson': 1, 'carload': 1, 'mchatti': 2, 'gossett': 8, 'highwayman': 2, 'keoni': 1, 'oflineag': 1, 'livesand': 1, 'hospitald': 1, 'wonderfulsurpris': 1, 'fromer': 1, 'wrotein': 1, 'filmmov': 1, 'waterd': 8, 'andunsentiment': 1, 'oncefunni': 1, 'wasextraordinarili': 1, 'hasveri': 1, 'gorki': 1, 'pacierkowski': 1, 'whilhelm': 1, 'biro': 4, 'malleson': 8, 'sultan': 9, 'halima': 2, 'cork': 2, 'zoltan': 2, 'messel': 1, 'vert': 4, 'choral': 4, 'spacious': 1, 'proletarion': 1, 'facism': 1, 'maslin': 14, 'synagogu': 4, 'loglin': 1, 'khmer': 3, 'sarong': 1, 'dystopia': 2, 'newspeak': 1, 'farligt': 1, 'rflutet': 1, 'hult': 1, 'approxamitli': 1, 'chastiz': 1, 'starchi': 3, 'dandyish': 1, 'kennel': 18, 'congruent': 3, 'larroz': 1, 'stayin': 1, 'tuneless': 3, 'luau': 2, 'lashel': 3, 'unreliev': 1, 'bonner': 1, 'barrimor': 1, 'hijinx': 2, 'yippeee': 1, 'dunderhead': 2, 'scrunch': 2, 'kohl': 2, 'gameel': 1, 'rateb': 1, 'shahin': 1, 'sacrileg': 4, 'prinz': 2, 'coprophagia': 1, 'gomorrah': 1, 'bruskott': 1, 'haysbert': 2, 'daggett': 4, 'unknowledg': 1, 'synaps': 10, 'nu': 11, 'boaz': 2, 'blablabla': 2, '1909': 7, 'cask': 4, 'amontillado': 3, 'koyla': 2, 'challiya': 1, 'discomfitur': 1, 'zappa': 6, 'cheepni': 1, 'ewald': 1, 'grumpiest': 1, 'difford': 2, 'fictit': 1, 'fanatst': 1, 'hapli': 1, 'beano': 4, 'baggot': 1, 'glamouresqu': 1, 'jokest': 2, 'hughi': 2, 'lovel': 10, 'shand': 1, 'dickman': 2, 'scientalog': 1, 'fickman': 1, 'landri': 4, 'rampantli': 1, 'rombero': 1, 'alosio': 2, 'friedman': 9, 'unnervingli': 5, 'goy': 4, 'palomar': 2, 'inroad': 1, 'langford': 3, 'cancun': 2, 'artless': 6, 'prowlin': 1, 'wussi': 8, 'nogerelli': 1, 'sweatshirt': 3, 'gracelessli': 1, 'dingbat': 1, 'slobbi': 2, 'costen': 1, 'inmho': 1, 'wen': 7, 'bejard': 1, 'deshimaru': 1, '210': 2, 'aforesaid': 2, 'chatti': 8, 'obdur': 1, 'lauen': 1, 'luiz': 1, 'kirshner': 8, 'vonneguti': 1, 'courrier': 1, 'erno': 1, 'metzner': 1, 'matchless': 2, 'nonpareil': 4, 'ja': 6, 'baltimorean': 2, 'turnout': 1, 'jodha': 1, 'akbar': 4, 'jetski': 1, 'bhaiyyaji': 8, 'beng': 2, 'bahiyyaji': 1, 'necklin': 2, 'hemlin': 1, 'kumr': 1, 'gretzki': 1, 'siam': 8, '1862': 2, 'synch': 11, 'marni': 3, 'moppet': 3, 'baubl': 3, 'stringi': 1, 'schizo': 1, 'spokesperson': 3, 'glitzier': 1, 'houck': 1, 'lockwood': 3, 'kascier': 1, 'lu': 2, 'sitka': 3, 'morissey': 1, 'birney': 5, 'bibi': 4, 'osterwald': 1, 'audra': 1, 'lindley': 1, 'interfaith': 1, 'airi': 1, 'gritter': 1, 'screwup': 1, '15min': 1, 'pollyanna': 4, 'intelleg': 1, 'servent': 1, 'exept': 1, 'blackend': 1, 'bacharach': 4, 'hedwig': 4, 'hitchcockomet': 1, 'sullenli': 1, 'personnali': 2, 'kiki': 26, 'sandu': 7, 'lidl': 1, 'wunderkind': 4, 'vador': 1, '3po': 5, 'spazz': 3, 'deveraux': 9, 'dorkiest': 2, 'miraglia': 19, 'usci': 1, 'coproduct': 2, 'dama': 4, 'rossa': 3, 'uccid': 2, 'sett': 3, 'tazer': 2, 'recopi': 1, 'cheez': 3, 'thicket': 1, 'dinah': 2, 'kosleck': 8, 'shawle': 2, 'goodwin': 3, 'bafflingli': 3, 'stoni': 5, 'tlp': 3, 'peterbogdanovichian': 1, 'brava': 2, 'festa': 1, 'abut': 5, 'gozilla': 1, 'toli': 1, 'kywildflower16': 1, 'offal': 7, 'thiessen': 6, 'quoter': 1, 'bumblebum': 1, 'flipper': 8, 'pickin': 3, 'cowment': 1, 'fumig': 1, 'hemmingway': 1, 'electronica': 3, 'citythi': 1, 'definitley': 2, 'ec': 6, 'ooki': 1, 'esposito': 15, 'gazonga': 1, 'rader': 3, 'tenor': 14, 'felisberto': 1, 'cheep': 3, 'stauffenberg': 1, 'networth': 1, 'lolanyon': 1, 'weve': 1, 'dowdel': 1, 'kastner': 2, 'insu': 1, 'neufeld': 1, 'atlantean': 7, 'maysl': 12, 'gentrif': 1, 'bouvier': 13, 'onassi': 6, 'pirouett': 4, 'smtm': 2, 'catalysi': 1, '1886': 2, 'prizefight': 3, 'convientantli': 1, 'cussler': 1, 'diomed': 1, 'breda': 1, 'bianco': 5, 'annunziata': 1, 'lupo': 2, 'donati': 2, 'vincenzoni': 2, 'destructo': 1, 'orchidea': 1, 'riz': 3, 'ortolani': 3, 'syncop': 2, 'outerspac': 8, 'bankcrupci': 1, 'emotion': 6, 'sicker': 3, 'upend': 3, 'mcgiver': 2, 'barnard': 1, 'gov': 4, 'prescienc': 1, 'elster': 3, 'birthmark': 3, 'unacknowledg': 2, 'barrat': 4, 'alphons': 6, 'ethier': 7, 'kolker': 4, 'nietzschean': 4, 'statesman': 3, 'stationmast': 1, 'mongrel': 3, 'bedelia': 2, 'lembeck': 1, 'bimalda': 1, 'parineeta': 2, 'sarat': 1, 'shekar': 1, 'piyu': 1, 'rekha': 4, 'nri': 5, 'iyer': 3, 'volken': 1, 'lipman': 1, 'darkon': 2, 'lioniz': 1, 'dustier': 1, 'oskar': 5, '451': 3, 'suburbanit': 4, 'tomorrowland': 1, 'serbian': 48, 'zavet': 6, 'douanier': 1, 'yaitat': 1, 'cbn': 2, 'azuma': 2, 'kazuma': 2, 'toyo': 1, 'pantasia': 2, 'tsukino': 1, 'azusagawa': 1, 'kawachi': 1, 'kyousuk': 1, 'kanmuri': 1, 'shigeru': 5, 'haschiguchi': 1, 'greencard': 1, 'feibleman': 1, 'weakli': 10, 'quizz': 3, 'completionist': 3, 'aarp': 2, 'nebbish': 3, 'dobel': 1, 'itiner': 1, 'swearengen': 1, 'lilian': 3, 'manxman': 2, 'dimpl': 5, 'goten': 1, 'podunk': 1, 'elk': 6, 'deput': 2, 'armitag': 5, 'steadman': 2, 'cronjag': 1, 'bluegrass': 4, 'hobbiton': 1, 'gentlemanlik': 1, 'heartthrob': 9, 'eglimata': 3, 'ketti': 1, 'konstadin': 1, 'kavogianni': 1, 'vassili': 1, 'haralambopoulo': 1, 'athinodoro': 1, 'prousali': 1, 'nikolaidi': 1, 'ant1': 1, 'animi': 1, 'holliday': 10, 'ryszard': 1, 'janikowski': 1, 'hbk': 11, '5wwf': 4, 'championshiptaka': 1, 'michinoku': 2, 'aguila': 2, 'chyna': 7, '5mix': 1, 'mero': 3, 'sabl': 8, 'goldust': 2, 'tko': 1, 'shamrock': 4, 'ref': 11, '5dumpster': 1, 'championshipcatcu': 1, '5the': 1, 'nosiest': 1, '5bottom': 1, 'radiu': 4, 'chrstma': 1, 'mishevi': 1, 'scheitz': 1, 'storszek': 1, 'cheater': 2, 'medem': 2, 'paola': 1, 'tedesco': 1, 'tramonti': 1, 'morgia': 1, '2080': 1, '2070': 1, 'snappili': 1, 'newsman': 4, 'updik': 1, 'quixot': 4, 'adabt': 1, 'simplyfi': 1, 'aubuchon': 2, 'speedili': 1, 'shriekfest': 2, 'atleas': 1, 'unbor': 1, 'unmarysuish': 1, 'hieroglyph': 4, 'martyrdom': 6, 'taliban': 5, 'goa': 16, 'uld': 15, 'apophi': 8, 'millennia': 3, 'mayan': 6, 'briton': 6, 'camelot': 1, 'giza': 2, 'sgc': 4, 'baal': 1, 'ori': 10, 'minutesi': 1, 'dukey': 2, 'flyswatt': 2, 'jaimi': 1, 'henkin': 1, 'jana': 1, 'howlingli': 3, 'spaci': 1, 'polnareff': 1, 'sonya': 2, 'salomaa': 2, 'grauer': 3, 'aquir': 1, 'microfilm': 22, 'overshoot': 2, 'ossessioneluchino': 1, 'batho': 4, 'grang': 3, 'nanosecond': 4, 'icf': 2, 'scalli': 1, 'matey': 1, 'bugaloo': 2, 'ithought': 1, 'hayak': 2, 'sunspot': 2, 'pothead': 4, 'puppetmast': 1, 'impel': 3, 'videozon': 1, 'garment': 7, 'maroni': 1, 'defiant': 14, 'toccata': 1, 'chasm': 10, 'cloke': 1, 'neworlean': 1, 'seami': 6, 'eartha': 9, 'kitt': 11, 'cuttrel': 1, 'bioterror': 2, 'mjyoung': 1, 'jete': 2, 'fleabag': 2, 'unshak': 5, 'poundingli': 1, 'adcox': 1, 'possesor': 1, 'possessor': 1, 'castorini': 7, 'cammareri': 4, 'handless': 1, 'hyman': 5, 'snowmen': 2, 'notl': 2, 'cooker': 3, 'moonlit': 1, 'schultz': 7, 'enzym': 1, 'fastforward': 4, 'wheedon': 1, 'fines': 1, 'iliopulo': 3, 'monosyllab': 4, 'cinenephil': 1, 'meow': 8, 'mstk3': 1, 'handedadapt': 1, 'incolleg': 1, 'thecathol': 1, 'broadsid': 3, 'orinterest': 1, 'allgam': 1, 'topen': 1, 'antisoci': 4, 'swinginest': 1, 'viscounti': 1, 'neoreal': 8, 'bleat': 1, 'denier': 2, 'cnd': 1, 'rhetorician': 2, 'atticu': 2, 'stalem': 3, 'reassuringli': 1, 'dmz': 2, '38th': 3, 'tocsin': 1, 'foulata': 1, 'gagoola': 1, 'ksm': 2, 'kukuanaland': 1, 'volkswagon': 1, 'dostoyevki': 1, 'drea': 2, 'dematteo': 2, 'ratner': 5, '67th': 2, 'almond': 1, 'ruefulli': 1, 'nakedli': 1, 'failproof': 1, 'entrain': 1, 'backroom': 2, 'balloonist': 1, 'modot': 1, 'gamekeep': 1, 'blankli': 3, 'helipad': 1, 'blackmi': 1, 'unman': 3, 'hurray': 2, 'turnbul': 1, 'lyoko': 1, 'freakazoid': 2, 'jetpack': 1, 'xlr': 1, 'kiva': 1, 'jospeh': 1, 'calleia': 1, 'ceder': 1, 'moronov': 1, 'rw': 2, 'lowlight': 3, 'reem': 6, 'cosmato': 4, 'adman': 2, 'satyagrah': 2, 'vinessa': 1, 'skosh': 1, 'epiphani': 13, 'borehamwood': 1, 'facilti': 1, 'kerkorian': 1, 'balli': 3, 'bludhorn': 1, 'lattuada': 1, 'gwyenth': 2, 'howit': 1, 'sevigni': 6, 'sibrel': 17, 'whistleblow': 2, 'disproven': 3, 'zohra': 1, 'lampert': 1, 'obscess': 1, 'teenageri': 1, 'bacio': 4, 'natascha': 5, 'mcelhon': 7, 'woywood': 2, 'nikolett': 2, 'baraba': 2, 'hendrick': 3, 'haes': 3, 'nosbusch': 4, 'brauss': 2, 'cazenov': 2, 'actio': 1, 'ambushe': 1, 'lexa': 2, 'doig': 2, 'zelina': 4, 'stepp': 1, 'messr': 3, 'panzram': 14, 'gaddi': 1, 'minn': 2, 'enticingli': 1, 'sweatin': 1, 'elfried': 1, 'jelinek': 1, 'orthograph': 1, 'kohut': 1, 'authoress': 3, 'pendulum': 5, 'hither': 1, 'thither': 1, 'gravelli': 5, 'elrika': 2, 'cherchez': 1, 'panki': 2, 'lovesick': 4, 'swain': 14, 'lacer': 7, 'expati': 1, 'shoenumb': 1, 'magnifici': 3, 'orco': 6, 'soavi': 2, 'charel': 5, 'trifiri': 2, 'boswel': 3, 'gautier': 1, 'roundtabl': 1, 'stearn': 1, 'exploratori': 3, 'anesthesia': 9, 'foal': 1, 'colleh': 1, 'fossey': 6, 'boundlessli': 1, 'styalis': 1, 'underemploy': 2, 'irrespect': 8, 'jaregard': 1, 'imtiaz': 1, 'shivam': 3, 'megha': 6, 'delhi': 8, 'dheeraj': 1, 'ankush': 10, 'pardey': 1, 'dekhiy': 1, 'notti': 2, 'earthier': 2, 'saawariya': 2, 'jama': 1, 'masjid': 1, 'connaught': 1, 'rickshaw': 4, 'fixtur': 3, 'reshammiya': 3, '050': 1, 'refri': 1, 'sprit': 2, 'zeffrelli': 1, 'ciaran': 9, 'chaplain': 5, 'contravert': 1, 'plonker': 1, 'plexigla': 1, 'incidentali': 1, 'candlestick': 3, 'fishi': 2, 'kazoo': 2, 'sparkler': 1, 'vapor': 6, 'ottawa': 6, 'handili': 1, 'lyndsay': 1, 'athenean': 1, '850': 1, 'approxiamt': 1, '1050': 1, 'mora': 4, 'serafinowicz': 1, 'rhind': 3, 'tutt': 3, 'linehan': 2, 'bombeshel': 1, 'teabag': 1, 'cj': 7, 'hennessey': 5, 'lexx': 1, 'blakes7': 2, 'fjernsynsteatret': 1, 'nrk': 1, 'blindpassasj': 4, 'stowaway': 2, 'ge': 3, 'bringsv': 3, 'bazar': 1, 'syvsoversken': 1, 'dystr': 1, 'frokost': 1, 'dramatist': 7, 'caprino': 1, 'klypa': 1, 'polo': 5, 'ibsen': 3, 'bj': 2, 'floberg': 1, 'johannesen': 1, 'stbye': 1, 'marner': 6, 'mab': 3, 'furnac': 7, 'reommend': 1, 'feint': 3, 'unattun': 1, 'leastthi': 1, 'everythingeveri': 1, 'proportionth': 1, 'enjoyeddavid': 1, 'okaygovinda': 1, 'kader': 6, 'gulshan': 2, 'stoo': 1, 'pid': 1, 'dagon': 3, 'intl': 2, 'groundless': 3, 'roto': 3, 'kristoferson': 2, 'bab': 10, 'lorden': 1, 'tobin': 6, 'mordant': 1, 'morven': 1, 'gata': 1, 'andalucia': 1, 'unpaid': 4, 'havnt': 2, 'channel4': 1, 'commercisli': 1, 'diologu': 2, 'sceenplay': 2, 'beforehav': 1, '99the': 1, 'misconstru': 4, 'leguizano': 1, 'tigerthi': 1, 'callar': 4, 'warholian': 1, 'morvern': 20, 'trinidad': 1, 'swanki': 3, 'reardon': 1, 'sawa': 14, 'maronna': 3, 'doren': 7, 'quarterfin': 1, 'rakishli': 1, 'nicaragua': 2, 'rextasi': 1, 'bolan': 11, 'reservedli': 1, 'creasey': 3, 'tantalizingli': 1, 'quell': 7, 'unequivoc': 10, 'elsi': 3, 'furo': 1, 'nuff': 14, 'hackensack': 1, 'samotari': 2, 'ondricek': 2, 'septej': 1, 'foodstuff': 1, 'mellowi': 1, 'forseeabl': 2, 'deportivo': 1, 'qv': 3, 'sandpap': 3, 'dramtic': 1, 'thereabout': 3, 'illusionari': 1, 'escher': 4, 'graaff': 6, 'impish': 2, 'livien': 8, 'bandmat': 1, 'waaay': 4, 'terkovski': 5, 'choul': 6, 'franken': 1, 'proctolog': 2, 'vilgot': 3, 'sjoman': 11, 'chacho': 1, 'boxcar': 1, 'sellon': 1, 'akst': 1, 'ammanda': 1, 'shellen': 1, 'overdramat': 4, 'mxpx': 1, 'akroyd': 4, 'berzier': 1, 'unenjoy': 3, 'fartman': 1, 'cupidgrl': 1, 'schwarzenbach': 1, 'fragrant': 2, 'aroma': 2, 'unliken': 1, 'solemnli': 3, 'errr': 1, 'artic': 1, 'defrost': 2, 'gammera': 19, 'skyrocket': 3, 'wolfen': 3, 'intru': 11, 'atari': 9, 'intellivis': 1, 'workforc': 4, 'coronet': 8, 'gough': 14, 'jeongg': 1, 'kenney': 2, 'righetti': 1, 'ohtherwis': 1, 'lugia': 9, 'deoxi': 1, 'miko': 7, 'mammal': 6, 'likeli': 1, 'brookmyr': 5, 'godamnaw': 1, 'parablan': 1, 'eliot': 5, 'floss': 3, 'verbiag': 4, 'seamu': 1, 'deasi': 1, 'pd': 6, 'toadi': 4, 'heft': 1, 'gosha': 22, 'chambara': 7, 'superbit': 1, 'examplea': 1, '230lb': 1, '160lb': 1, '105lb': 1, 'rhymesanoth': 1, 'illusori': 1, 'supper': 6, 'worldview': 4, 'shashonna': 3, 'rotund': 1, 'mufti': 1, 'wooli': 1, 'cowley': 1, 'nyro': 2, 'bustier': 1, 'kabala': 1, 'hammeress': 1, 'manjrekar': 1, 'chappu': 1, 'constrictor': 5, 'orangutang': 1, 'caucasin': 1, 'strangli': 1, 'eww': 3, 'suchlik': 2, 'ci2': 2, 'paedophil': 7, 'flippantli': 1, 'trenton': 2, 'spool': 3, 'unquest': 3, 'gianni': 6, 'galecki': 1, 'pomerantz': 1, 'fedevich': 1, 'gottfri': 5, 'fait': 1, 'bleek': 6, 'happenin': 1, 'torpid': 5, 'trifecta': 1, 'taverni': 3, 'detector': 5, 'unmann': 1, 'okej': 1, 'thadblog': 1, 'wascal': 1, 'wabbit': 2, 'thad': 2, 'onlook': 5, 'unzombiefi': 1, 'precautionari': 1, 'bodic': 4, 'merlet': 1, 'vegtigri': 1, 'reviczki': 1, 'play2': 1, 'using3': 1, 'nemark': 1, 'dou': 2, 'baguett': 2, 'nostra': 1, 'inwardli': 5, 'g2': 1, 'drainboard': 1, 'g3': 1, 'robt': 1, 'fredo': 2, 'banco': 1, 'vaticani': 1, 'guilliani': 1, 'leavenworth': 2, 'rutledg': 4, 'versprechen': 1, 'ingersol': 2, 'amnesiac': 5, 'universalsoldi': 1, 'downsiz': 2, 'supercomput': 3, 'bonzo': 1, 'dagwood': 1, 'masonit': 1, 'mundanc': 1, 'jole': 4, 'flavorsom': 4, 'effervesc': 7, 'mayfield': 10, 'ratti': 3, 'lonett': 6, 'dwan': 2, 'dorian': 4, 'harewood': 2, 'dovetail': 6, 'blithesom': 1, 'surmount': 5, 'uner': 3, 'givin': 1, 'ctx': 2, 'onu': 1, 'delmar': 9, 'croasdel': 1, 'stevo': 1, 'fielder': 3, 'vitamin': 3, 'healthiest': 1, 'smker': 1, 'ventimiglia': 1, 'curatola': 1, 'proval': 2, 'sciorra': 2, 'iler': 1, 'schirripa': 1, 'sixtyish': 2, 'flitter': 3, 'lineal': 1, 'candlesho': 2, 'expir': 14, 'alumnu': 1, 'onasi': 2, 'hellenlott': 1, 'natwick': 2, 'yicki': 1, 'kiedi': 1, 'corben': 1, 'berbson': 1, 'destino': 1, 'telepathet': 1, 'adulhood': 1, 'silverado': 3, 'bethsheba': 1, 'nathali': 6, 'keena': 1, 'stoumen': 1, 'yasbeck': 4, 'essenay': 1, 'effet': 4, 'interferingli': 1, 'shonki': 4, 'sommer': 9, 'sternli': 1, 'morrisett': 3, 'santostefano': 1, 'maddonna': 1, 'girlfrin': 1, 'madigan': 6, 'hearth': 5, 'parsimoni': 3, 'pninson': 1, 'devenish': 1, 'murkier': 1, 'intension': 1, 'nicklebi': 3, 'tulkinhorn': 3, 'woodcourt': 2, 'rouncewel': 3, 'guppi': 3, 'hortens': 6, 'vhole': 4, 'skimpol': 1, 'ritt': 2, 'ismael': 12, 'showman': 10, 'magnoli': 1, 'cavallo': 1, 'thorin': 1, 'grafitti': 2, 'bachstag': 1, 'raff': 2, '6ey': 1, 'titti': 5, 'quida': 1, 'parenthesi': 1, 'christo': 1, 'kellogg': 4, 'blackwat': 1, 'turiquistan': 1, 'shipman': 7, 'tuyl': 1, 'atv': 1, 'mountainsid': 5, 'shameful': 1, 'videomarket': 1, 'multimillionair': 3, 'religios': 4, 'titanium': 3, 'blotch': 3, 'crosser': 2, 'readout': 2, 'wringer': 2, 'teflon': 2, 'doreen': 3, 'rovner': 1, 'kuala': 1, 'lumpur': 1, 'cowritten': 1, 'bostid': 1, 'twitti': 2, 'schoolmat': 7, 'wol': 1, 'denigh': 1, 'cobblepot': 1, 'costanzo': 1, 'batgirl': 10, 'efrem': 2, 'zimbalist': 4, 'motb': 1, 'definetli': 9, 'suze': 1, 'negrophil': 1, 'macinn': 2, 'fop': 5, 'hoplit': 1, 'disarray': 5, 'forefing': 1, 'shoemak': 2, 'bellum': 1, 'restaurateur': 2, 'teenkil': 1, 'peacetim': 5, 'timeslip': 1, 'optimum': 2, '138': 4, 'raper': 1, 'clearest': 2, 'emblem': 2, 'backstreet': 5, '1h30': 2, 'espisito': 1, 'notld': 1, 'drexel': 1, 'palmawith': 1, 'oedepu': 2, 'wallraff': 1, 'photowis': 1, 'filon': 11, 'bevilaqua': 1, 'hucklebarney': 1, 'gismont': 1, 'signor': 1, 'arfrican': 1, 'influence': 1, 'expung': 1, 'sickroom': 1, 'hothous': 2, 'legrand': 2, 'maxenc': 1, 'josett': 1, 'fiftieth': 1, 'absente': 5, 'mctell': 1, 'shemekia': 1, 'copeland': 6, 'einstain': 1, 'shaquil': 7, 'granter': 1, 'uggghh': 1, 'lenienc': 1, 'ezekiel': 1, 'contradictorili': 2, 'obscuringli': 1, 'nineveh': 1, 'bloodedli': 1, 'kedrova': 1, 'marblehead': 3, 'lizzett': 1, 'woodfin': 1, 'chiefton': 1, 'krupa': 6, 'spazzi': 2, 'vela': 1, 'rda': 4, 'dictioari': 1, 'crododil': 1, 'noell': 3, 'navokov': 3, 'absentmind': 1, 'nastasya': 4, 'telegram': 3, 'criminalth': 1, 'breat': 1, 'keey': 3, 'civl': 1, 'riverboat': 3, 'carrillo': 4, 'sherman': 29, '190': 1, 'camazotz': 6, 'pinku': 2, 'yoshio': 3, 'appelag': 1, '250000': 1, 'feyder': 9, 'garwin': 1, 'doubtlessli': 9, 'grittiest': 3, 'barbarella': 6, 'mikl': 2, 'jaglon': 2, 'foyt': 1, 'cognis': 1, 'extemporis': 1, 'anouk': 2, 'subsum': 3, 'apotheosis': 1, 'bosh': 1, 'kinsella': 3, 'barabarian': 1, 'painlessli': 1, 'amrutl': 1, 'aatish': 4, 'phoren': 2, 'ishwar': 14, 'sumi': 1, 'aavjo': 2, 'vhala': 2, 'malishu': 3, 'seesaw': 2, 'mujhs': 1, 'shaadi': 6, 'karogi': 1, 'bewafaa': 2, 'bandekartrivia': 1, 'excellent22nd': 1, 'thrum': 1, 'tidal': 6, 'stupefact': 1, 'crabb': 2, 'hygienist': 3, 'washingtonian': 1, 'standish': 2, 'hitchock': 1, 'bloodiest': 3, 'quantril': 6, 'encroach': 13, 'mackeson': 1, 'adamantli': 5, 'guiri': 1, 'warfel': 1, 'schism': 3, 'denero': 1, 'decerebr': 1, 'hamburglar': 1, 'scrotum': 2, 'willona': 3, 'vilma': 1, 'backula': 4, 'muser': 1, 'inning': 3, 'eeeeeek': 1, 'rawl': 3, 'u2': 3, 'extramur': 1, 'punkster': 1, 'jabberwocki': 1, 'slunk': 1, 'dingl': 2, 'worrisom': 1, 'gourmet': 2, 'lightsab': 3, 'stolz': 6, 'unratedx': 1, 'reallllllllli': 1, 'checklist': 7, 'actingso': 1, 'milkman': 2, 'tranvestit': 1, 'unattain': 4, 'adul': 6, 'beaudin': 2, 'rivett': 2, 'unsurviv': 1, 'postpon': 5, 'aditiya': 1, 'bachan': 7, 'sumitra': 6, 'mitali': 4, 'shultz': 1, 'yasushi': 1, 'akimoto': 1, 'trenchant': 5, 'dispirit': 2, 'discreetli': 4, 'yanqui': 1, 'defun': 1, 'eifel': 1, 'thermal': 2, 'lotsa': 4, 'zeke': 4, 'eman': 10, 'shortcut': 6, 'doyleluv': 1, 'elsinor': 2, 'glider': 2, 'sailplan': 3, '50i': 1, 'graziano': 1, 'unkiddi': 1, 'squeazi': 1, 'uninterestingth': 1, 'jobspleas': 1, 'melbourneh': 1, 'flatland': 1, 'copland': 1, 'a10': 1, 'redub': 3, 'mindedli': 1, 'favortit': 1, 'slouchi': 1, 'pouchi': 1, 'disorgan': 9, 'kouf': 1, 'grumbl': 5, 'tualli': 1, 'fectli': 1, 'formless': 4, 'visiteur': 16, 'montmirail': 4, 'jacquouil': 2, 'frenegond': 2, 'lemerci': 12, 'bourgeois': 2, 'trampi': 1, 'cooter': 2, 'gwb': 1, 'strutter': 2, 'smirker': 1, 'slammer': 5, 'unives': 1, 'unenvi': 3, 'novacain': 1, '35min': 1, 'charo': 5, 'lipo': 1, 'munci': 3, 'toonami': 1, 'sailormoon': 1, 'yorick': 2, 'baruchel': 1, 'poona': 1, 'tanga': 1, 'upshot': 2, 'templario': 1, 'alfri': 1, 'cathars': 2, 'insignia': 1, 'jarrel': 3, 'reat': 1, 'pettiett': 1, 'rubbishi': 5, 'cule': 1, 'inargu': 3, 'panicki': 1, 'midair': 2, 'ddlj': 4, 'lamhey': 1, 'kapor': 1, 'aapkey': 2, 'kappor': 1, 'sonali': 4, 'ocassion': 1, 'anniveseri': 1, 'landesberg': 2, 'danaza': 1, 'macabra': 5, 'insubordin': 4, 'larami': 6, 'coonskin': 20, 'reef': 10, 'carmack': 2, 'vandervoort': 2, 'tomason': 1, 'audrina': 1, 'patridg': 1, 'perez': 13, 'viequ': 1, '2hr': 4, 'dan7': 1, 'eschatolog': 3, 'unsound': 1, 'mckeever': 1, 'xander': 5, 'jcvd': 1, 'playschool': 2, 'sudsi': 3, 'farenheight': 1, 'makepeas': 1, 'rowsdow': 1, 'f1': 2, 'contra': 10, 'gpa': 2, 'lumpen': 2, 'grana': 1, 'downtim': 2, '5hr': 5, 'relas': 1, 'acual': 2, 'unselfish': 2, 'monsta': 1, 'merrier': 2, 'emeliu': 2, 'weighil': 4, 'snart': 3, 'aerob': 7, 'forgottenmayb': 1, 'marianbad': 1, 'brasil': 1, 'laughedonli': 1, 'betaken': 1, 'meantto': 1, 'atthem': 1, 'sillyflaw': 1, 'shootin': 3, 'matiko': 2, 'rim': 10, 'elseher': 1, 'barbet': 6, 'maitress': 1, 'maladriot': 1, 'himmel': 1, 'ber': 4, 'iman': 1, 'mcculler': 1, 'invocu': 3, 'pointth': 1, 'hagel': 1, 'whorribl': 1, 'uunivers': 1, 'halter': 4, 'plo': 1, 'smedley': 2, 'schooner': 2, 'electrifyingli': 3, 'flub': 10, 'sinuous': 1, 'walon': 4, 'semaphor': 3, 'perrin': 3, 'patrolman': 5, 'firebomb': 3, 'reshot': 1, 'cooder': 2, 'mraovich': 28, 'caster': 2, 'belknap': 1, 'excercis': 3, 'firmer': 2, 'catgirl': 1, 'cannibl': 1, 'zomedi': 1, '7600': 1, 'jug': 4, 'earwax': 1, 'befor': 1, 'scripter': 2, 'rodolfo': 3, 'shellack': 1, 'diamnd': 1, 'alothugh': 1, 'clio': 4, 'avoc': 2, 'provision': 1, 'thomsett': 3, 'myddleton': 1, 'cookeri': 1, 'burchil': 1, 'parasol': 2, 'bingham': 1, 'beryl': 4, 'wideboy': 1, 'somer': 7, 'eshley': 1, 'lascher': 2, 'spellman': 2, 'loyd': 2, 'buchholz': 2, 'townsmen': 2, 'steffen': 6, 'immediaci': 6, 'dag': 1, 'mockney': 2, 'ix': 4, 'minesweep': 1, 'expectkey': 1, 'medusa': 4, 'clout': 8, 'stepdaught': 2, 'faddish': 1, 'noriaki': 1, 'yuasa': 1, 'davitz': 4, 'nuthous': 2, 'zak': 1, 'scarlatina': 1, 'unfortanetley': 1, 'ragnardock': 1, 'slovak': 2, 'miscegen': 1, 'katsumi': 3, 'austrialian': 1, 'actelon': 1, 'morter': 1, 'sondr': 3, 'squeemish': 1, 'p7': 1, 'orgazmo': 2, 'vulgur': 1, 'obscenc': 1, 'eggotist': 1, 'thier': 8, 'imi': 1, 'jayden': 1, 'burrito': 2, 'bati': 1, 'sequoia': 1, 'vachon': 2, 'kosher': 5, 'esophagu': 4, 'jubil': 7, 'promulg': 1, 'karel': 1, 'zeman': 4, 'amg': 1, 'zemen': 3, 'zubeidaa': 2, 'karima': 1, 'hmmmmmm': 1, 'haulocast': 2, 'riiiiiiight': 1, 'hdtv': 5, 'pwt': 1, 'densiti': 6, 'dmd2222': 1, 'verizon': 1, 'javo': 2, 'sussanah': 1, 'ciarin': 1, 'plz': 6, 'nvm': 1, 'catharin': 2, 'happyend': 1, 'anchorwoman': 3, 'stirba': 21, 'showerman': 4, '150k': 1, 'mmel': 1, 'catacomb': 3, 'auch': 1, 'unendur': 8, 'klaymen': 1, 'calloway': 3, 'waller': 3, 'harmann': 1, 'cratchit': 17, 'ree': 6, 'holywel': 3, 'langrish': 1, 'gutteridg': 1, 'whalley': 1, 'spinach': 1, 'huey': 3, 'auderi': 1, 'fs': 1, 'sharpl': 1, 'tennese': 2, 'sissili': 1, 'larrikin': 1, 'gregari': 1, 'dangerman': 1, 'lachi': 1, 'hulm': 1, 'lieg': 1, 'gad': 4, 'buttock': 6, 'malarkey': 3, 'outsiz': 2, 'poffysmoviemania': 2, 'jurado': 4, 'hoopin': 1, 'hollerin': 1, 'tripplehorn': 2, 'adriano': 3, 'origami': 2, 'benfica': 2, 'fc': 5, 'porto': 3, 'smorsgabord': 1, 'metacrit': 2, 'vovchenko': 1, 'bivalv': 1, 'oompah': 1, 'scaredi': 2, 'hurd': 2, 'goitr': 3, 'iodin': 1, 'documentarist': 3, 'eszterha': 4, 'billionar': 1, 'hightli': 1, 'imp': 7, 'rrratman': 1, 'jellybean': 10, 'supercop': 1, 'mcginley': 4, 'sisk': 1, 'repugnantli': 1, 'mulgrew': 3, 'sushma': 1, 'nepalp': 1, 'gurkha': 1, 'nepali': 2, 'gekko': 2, 'gg': 1, 'starl': 2, 'beltway': 1, 'crematorium': 1, 'comedyactor': 1, 'comedyloos': 1, 'rumpelstiltskin': 2, 'sat1': 3, 'rtl': 3, 'laugther': 1, 'maroon': 4, 'ploteven': 1, 'keg': 2, 'shya': 1, 'northwet': 1, 'patoot': 1, 'yb': 1, 'esq': 4, 'cumenteri': 1, 'especialment': 1, 'ere': 3, 'dominicano': 1, 'flatiron': 2, 'flutter': 8, 'werecat': 1, 'catman': 1, 'anabel': 1, 'pediatrician': 1, 'jardyc': 1, 'ladti': 1, 'oli': 1, 'sentimentalis': 2, 'drinker': 4, 'yvan': 5, 'attal': 5, 'shunji': 1, 'iwai': 1, 'yelchin': 4, 'thirlbi': 2, 'ohana': 2, 'ligabu': 7, 'caracht': 1, 'erk': 2, 'anywhozitz': 1, 'escargot': 1, 'burdock': 1, 'boilerpl': 1, 'huntress': 3, 'xico': 3, 'figueroa': 2, 'tiomkin': 4, 'aquatania': 1, 'balu': 1, 'neumann': 4, 'painless': 3, 'councilor': 5, 'unprincipl': 2, 'artlessli': 1, 'paley': 3, 'rawhid': 11, 'pawnshop': 1, 'specter': 9, 'amphibian': 1, 'yardsal': 1, 'draza': 1, 'milhalovitch': 3, 'chetnik': 2, 'soro': 1, 'icg': 2, 'sarajevo': 2, 'wimpol': 1, 'neckti': 4, 'odlli': 1, 'austreim': 1, 'torpedo': 13, 'bough': 1, 'apprenticeship': 2, 'reeler': 10, 'lehrman': 1, 'exhibitor': 2, 'dandifi': 1, 'm15': 1, 'giggolo': 1, 'moustafa': 1, 'lebanes': 3, 'falafel': 2, 'menopaus': 3, 'gentrifi': 1, 'patrik': 1, 'frayz': 1, 'gogool': 1, '95th': 1, 'spiderwoman': 1, 'taxfre': 1, 'milosev': 5, 'hagu': 2, 'citizenx': 7, 'limbic': 5, 'lilililililii': 1, 'interurban': 1, 'politic': 4, 'stymi': 6, 'militiaman': 1, 'cornerston': 6, 'gorbunov': 4, '5yr': 2, 'aleksandr': 2, 'unsub': 1, 'expediti': 2, 'quantico': 1, 'edelman': 7, 'unkil': 2, 'iwo': 3, 'jima': 3, 'lovestruck': 3, 'inez': 2, 'leve': 2, 'edwin': 7, 'abolitionist': 2, 'shon': 2, 'greenblatt': 2, 'talalay': 8, 'legiunea': 1, 'str': 1, 'daneliuc': 7, 'ntarea': 2, 'niei': 2, 'positiv': 1, 'negativ': 1, 'tenet': 6, 'nuthin': 3, 'cursa': 1, 'proba': 1, 'microfon': 1, 'toarea': 1, 'vulpi': 1, 'croaziera': 1, 'glissando': 1, 'mundi': 1, 'udi': 1, 'tammuz': 1, 'jitter': 4, 'liman': 1, 'newswrit': 2, 'disenchant': 2, 'csoka': 2, 'shimizu': 12, 'cineplex': 6, 'cockroach': 14, 'hickcock': 10, 'cayenn': 1, 'ammon': 1, 'navid': 1, 'negahban': 1, 'schmidtt': 1, 'corncob': 3, 'dialoqu': 2, 'phonebooth': 1, 'gr8': 2, 'fillmor': 5, 'solvent': 2, 'horsemanship': 4, 'cazal': 3, 'majd': 2, 'katel': 1, 'djian': 1, 'fowzi': 1, 'guerdjou': 1, 'hadj': 1, 'forsak': 3, 'ghina': 1, 'ognianova': 1, 'mustapha': 1, 'grocer': 2, 'crisscross': 1, 'bregov': 5, 'pando': 1, 'perth': 2, 'shostakovich': 1, 'philharmon': 2, 'desplat': 3, 'jarr': 4, 'nuovo': 1, 'deleru': 1, 'loving': 1, 'margaretta': 4, 'henrikson': 2, 'vw': 5, 'mhmmm': 1, 'pictogram': 1, 'mned': 1, '1917': 10, 'naboomboo': 1, 'ablaz': 3, 'revivalist': 2, 'cassini': 5, 'schwarzenneg': 1, 'hermanidad': 1, 'debussi': 2, 'ronstadt': 1, 'bayou': 2, 'mildest': 2, 'polygam': 1, 'bruiser': 1, 'chancer': 3, 'sportsmanship': 2, 'hermandad': 2, 'hyperspac': 2, 'unharvest': 3, 'silag': 2, 'maiz': 1, 'planetari': 4, 'tron': 7, 'catlik': 2, 'distanti': 3, 'panegyr': 2, 'versail': 8, 'yvelin': 6, 'invidi': 1, 'prichard': 2, 'cada': 1, 'riordan': 1, 'schlatter': 3, 'dowl': 1, 'dike': 1, 'scaarrryyi': 1, 'unnattract': 2, 'greydon': 8, 'backslid': 1, 'ww3': 2, 'canning': 3, 'pandemonium': 5, 'fakey': 4, 'alecki': 4, 'zefferelli': 6, 'aliti': 1, 'jealous': 3, 'aver': 1, 'thumbscrew': 1, 'garrard': 2, 'steinem': 2, 'splendini': 4, 'woodman': 3, 'giligan': 1, 'bussinessmen': 1, 'waimea': 1, 'unfortunatli': 4, 'yun': 9, 'totali': 2, 'tai': 2, 'booklet': 6, 'enjoi': 1, 'reaccount': 1, 'wahington': 2, 'ambienc': 3, 'crimefilm': 1, 'severn': 2, 'darden': 2, 'updyk': 1, 'moniqu': 10, 'marmelstein': 1, 'montagn': 4, 'reisman': 1, 'dumbo': 7, 'dipti': 1, 'wwwaaaaayyyyy': 1, 'crissak': 1, 'unorgan': 2, 'pell': 2, 'devilishli': 3, 'neccessarili': 1, 'walther': 3, 'mathau': 4, 'enterrrrrr': 1, 'byner': 2, 'hopcraft': 4, 'carston': 3, 'krook': 2, 'esterhas': 1, 'ttss': 1, 'hepton': 6, '171': 1, 'windbreak': 1, 'irretriev': 4, 'poach': 1, '637': 1, 'unwel': 1, 'saval': 1, 'doctornappy2': 1, 'payer': 4, 'bais': 3, 'blige': 1, 'undescrib': 1, 'tilda': 9, 'swinton': 11, 'comotos': 1, 'terrifiy': 1, 'boogey': 8, 'gruant': 1, 'cider': 4, 'desegreg': 2, 'tidwel': 1, 'hereth': 2, 'megahit': 2, 'goombah': 2, 'stethoscop': 2, 'antipasto': 1, 'manicotti': 2, 'escarol': 2, 'melenzana': 1, 'mullinyan': 1, 'scarol': 1, 'manigot': 1, 'antidepress': 2, 'wirtanen': 2, 'echelon': 10, 'insectish': 1, 'simian': 6, 'dombasl': 1, 'blankman': 4, 'rodrigez': 1, 'occassionali': 2, 'rosann': 3, 'eibon': 1, 'finder': 6, 'halfwit': 1, 'bosomi': 1, 'vallett': 2, 'placenta': 2, 'lovecraftian': 4, 'prolaps': 1, 'switchblad': 5, 'purb': 1, 'wolfi': 2, 'mimzi': 3, 'mascara': 8, 'eyelin': 7, 'kevyn': 1, 'thibeau': 1, 'thionit': 1, 'radelyx': 1, 'fairborn': 2, 'marissa': 2, 'buzzkirk': 1, 'chewbaka': 1, 'boskon': 1, 'starblaz': 1, 'xylon': 1, 'worzel': 1, 'tweeness': 1, 'wilmington': 1, 'carper': 3, 'sternberg': 12, 'meister': 2, 'grimmest': 1, 'unsubstanti': 4, 'papua': 4, 'tobia': 18, 'schneebaum': 18, 'yamika': 1, 'thomajan': 2, 'rua': 1, 'norliss': 7, 'scarab': 1, 'occultist': 4, 'arrrghhhhhh': 1, 'sargoth': 2, 'gadabout': 1, 'caligula': 8, 'jovovich': 2, 'cuhligyooluh': 1, 'asti': 1, 'caligulaaaaaaaaaaaaaaaaa': 1, 'caaaaaaaaaaaaaaaaaaaaaaligulaaaaaaaaaaaaaaaaaaaaaaa': 1, 'ennia': 1, 'caligola': 1, 'j00': 1, 'maki': 2, 'j00nalo': 1, 'trillion': 3, 'tazmanian': 1, 'dorito': 1, 'tasmanian': 2, 'fineri': 2, 'freebird': 13, 'hailsham': 1, 'dambust': 1, 'easyrid': 1, 'sarducci': 4, 'runic': 4, 'eir': 2, 'eireann': 2, 'hibernia': 2, 'icier': 2, 'greenland': 2, 'tranliter': 2, 'inscript': 5, 'leviathan': 3, 'indo': 3, 'deific': 2, 'kashakim': 4, 'powersourc': 2, 'hyperdr': 2, 'm4': 1, 'pickman': 1, 'boomslang': 3, 'afrikaan': 2, 'credo': 2, 'leaner': 3, 'grower': 2, 'millimet': 6, 'tactlessli': 1, 'empt': 2, 'newsstand': 1, 'windbag': 1, 'minna': 2, 'gombel': 2, 'deel': 2, 'stuggl': 1, 'mortgan': 1, 'sabrian': 1, 'westbridb': 1, 'westbridg': 2, 'krusti': 1, 'uuuuuugggghhhhh': 1, 'krofft': 2, 'appi': 2, 'yanki': 1, 'putin': 1, 'flatley': 3, 'desenex': 1, 'seibert': 1, 'scareless': 1, 'keital': 1, 'lymph': 2, 'purpli': 1, 'gumption': 3, 'henriett': 1, 'essendon': 1, 'pokey': 2, 'tuni': 1, 'antsi': 2, 'tunisian': 2, 'dawdl': 3, 'x4': 1, 'queensburi': 1, 'talker': 4, 'rizwan': 1, 'abbasi': 1, 'pico': 1, 'fitzroy': 1, 'terriost': 1, 'stoogephil': 1, 'cucaracha': 2, 'senor': 3, 'haltingli': 2, 'upsw': 1, 'hegemon': 2, 'vilif': 2, 'mechanis': 3, 'teapot': 2, 'brella': 2, 'sheek': 1, 'tokugawa': 8, 'fatcheek': 1, 'babylonian': 1, 'scars': 1, 'yoshiyuki': 1, 'kuroda': 1, 'daimajin': 1, 'majin': 1, 'gozu': 4, 'izoo': 1, 'inhi': 2, 'logon': 2, 'amrohi': 9, 'sumptou': 1, 'chalo': 7, 'dildar': 2, 'mohammad': 3, 'madan': 2, 'barsaat': 1, 'bigha': 1, 'zameen': 1, 'hava': 1, 'dastak': 1, 'guddi': 1, 'aan': 1, 'pyasa': 1, 'kagaz': 1, 'phool': 3, 'sahib': 4, 'kabuliwallah': 1, 'abhimaan': 1, 'sujatha': 1, 'umrao': 3, 'jaan': 4, 'barsat': 1, 'raat': 1, 'naya': 1, 'daur': 1, 'manzil': 1, 'mahal': 1, 'jugnu': 1, 'naam': 3, 'ogilvi': 4, 'flounc': 5, 'asbesto': 3, 'argonaut': 2, 'pussycat': 4, 'boer': 1, 'gobl': 2, 'musn': 2, 'warship': 5, 'ironclad': 3, 'forepeak': 1, 'thunderchild': 6, 'timbo': 5, 'malarki': 2, 'pounder': 2, 'limber': 2, 'frig': 4, 'nearsid': 1, 'weybridg': 1, 'blackmoon': 2, 'headupyourass': 1, 'irishmen': 1, 'aaker': 2, 'jetti': 1, 'undeath': 1, 'me': 9, 'vre': 4, 'idiomat': 1, 'reactor': 10, 'pliabl': 1, 'zb1': 2, 'zb3': 3, '4x': 2, 'stockler': 6, 'monomaniac': 1, 'mineo': 1, 'carandiru': 1, 'lavoura': 1, 'arcaica': 1, 'proibido': 1, 'proibir': 1, 'goddaw': 1, 'dogmat': 6, 'eaton': 4, 'carti': 1, 'rivi': 3, 'blackwood': 22, 'overprais': 4, 'meiji': 5, 'hofst': 2, 'tter': 2, 'dubber': 2, 'nuddi': 1, 'boddhisatva': 1, 'receptacl': 4, 'rummag': 9, 'battleground': 4, 'schiff': 4, 'intimatelook': 1, 'forgetsocieti': 1, 'hugebrood': 1, 'persu': 3, 'rathermundainli': 1, 'mazl': 1, 'afellini': 1, 'isalmost': 1, 'dishesgrow': 1, 'shepranc': 1, 'baboushka': 1, 'likeheaddress': 1, 'wenev': 1, 'hintthat': 1, 'stillbeauti': 1, 'slive': 1, 'littleedi': 2, 'herearli': 1, 'andeven': 1, 'singsalong': 1, 'ison': 2, 'promic': 1, 'amodel': 1, 'tofind': 1, 'romanticbliss': 1, 'deliverscen': 1, 'incrediblycandid': 1, 'unpretenci': 1, 'remarcablesinc': 1, 'kennethang': 1, 'puce': 1, 'sworth': 1, 'slighter': 3, 'vend': 3, 'probarli': 1, 'hideshi': 1, 'hino': 1, 'dardano': 3, 'sacchetti': 3, 'huhuhuhuhu': 1, 'krimi': 9, 'pretzel': 3, 'hasnt': 1, 'probibl': 1, 'trouper': 1, 'dickenson': 4, 'rober': 3, 'socal': 3, 'mercedez': 1, 'qauntiti': 1, 'royalist': 2, 'hrithek': 1, 'pffffft': 1, 'pluckish': 1, 'eadi': 5, 'landhold': 1, 'jawsish': 1, 'whisperish': 1, 'compliant': 3, 'woosh': 1, 'mexicano': 1, 'arriba': 1, 'trompetto': 1, 'warthog': 7, 'gamorrean': 1, 'roseanna': 2, 'korti': 2, 'couteri': 2, 'silo': 5, 'skeritt': 1, 'ovid': 2, 'faulkner': 6, 'fightclub': 1, 'mccort': 4, 'dem': 2, 'nio': 1, 'doga': 3, 'rutkay': 3, 'photoshop': 3, 'yt': 1, 'bufford': 7, 'svenon': 1, 'hilli': 3, 'armistic': 1, 'lectern': 2, 'winder': 1, 'hitlerian': 1, 'putsch': 1, 'hoffbrauhau': 1, 'brigid': 1, 'shaughnessi': 1, 'zeppelin': 4, 'thankyou': 5, 'declaim': 6, 'nono': 1, 'carico': 1, 'eplos': 1, 'youv': 1, 'dirig': 1, 'corbomit': 2, '2oo4': 1, '2oo5': 1, '197o': 1, 'herlihi': 7, '188o': 1, 'thermonuclear': 4, 'brigadi': 1, 'marcher': 3, 'underfund': 2, '193o': 1, 'reactiv': 4, 'straightforwardli': 3, 'slushi': 3, 'seraphim': 1, 'sigrist': 1, 'scepter': 3, 'shilpa': 1, 'fluentli': 4, 'rangi': 6, 'renu': 1, 'setna': 1, 'walmington': 1, 'deolali': 1, 'bombadi': 3, 'layton': 3, 'gunner': 17, 'sugden': 2, 'lah': 2, 'dah': 6, 'clegg': 2, 'ashwood': 2, 'wallah': 6, 'shafeek': 3, 'punka': 1, 'babar': 2, 'tuskege': 1, 'mst3': 1, 'afganistan': 4, 'refuel': 3, 'cic': 1, 'jacobb': 1, 'contect': 1, 'comdey': 2, 'wrost': 1, 'hoaxi': 1, 'standoff': 3, 'collater': 4, 'peckinpaugh': 2, 'moneyi': 1, 'bogmeist': 1, 'tribbl': 3, 'manouev': 1, 'ramadi': 1, 'swanberg': 4, 'incoveni': 1, 'havehav': 1, 'joemantegna': 1, 'deeplydisturb': 1, 'wof': 1, 'vehicular': 5, 'jostl': 7, 'disengag': 4, 'geeeeeetttttttt': 1, 'itttttttt': 1, 'philp': 1, 'sincerest': 4, 'imbal': 4, 'artel': 1, 'ru': 5, 'blowingli': 1, 'horibbl': 1, 'huzzah': 2, 'gingeral': 1, 'rinn': 1, '8ftdf': 1, 'meadowval': 2, 'majelewski': 2, 'bresnahan': 1, 'sodium': 1, 'pri': 10, 'buza': 2, 'pearson': 4, 'misbehaviour': 1, 'kossak': 2, 'kossack': 1, 'jannuci': 1, 'venantini': 12, 'venantino': 7, 'moro': 1, 'wez': 1, 'triller': 2, 'patrica': 3, 'gaberi': 1, 'distiguish': 1, 'pittsburg': 1, 'gorgou': 1, 'leisen': 13, 'marihuana': 2, 'chorion': 1, 'maclaglen': 2, 'raciest': 2, 'viewmast': 1, 'torchon': 2, 'pote': 1, 'hader': 2, 'immensli': 1, 'tossup': 3, 'ein': 3, 'nachtmusik': 1, 'libber': 1, 'symposium': 3, 'protractor': 1, 'watter': 1, 'comandant': 1, 'caudillo': 1, 'thirbl': 2, 'natail': 1, 'favo': 1, 'rabli': 1, 'bloodsport': 4, 'poohwhat': 1, 'overcharg': 1, '7now': 1, 'dealership': 2, 'atle': 2, 'ecclesten': 1, 'rectum': 3, 'cinder': 4, 'tl': 1, 'deficit': 8, 'tromavil': 3, 'aftereffect': 2, 'sleazefest': 2, 'gettin': 2, 'seaboard': 2, 'beack': 1, 'ecchhhh': 1, 'sceanrio': 1, 'reamk': 1, 'dwivedi': 6, 'partion': 1, 'panjab': 1, 'chatterje': 1, 'businesstig': 1, 'shere': 2, 'schnass': 1, 'dostoyevskian': 1, '17it': 1, 'popularis': 2, 'killersmost': 1, 'overfil': 2, 'scagnetti': 1, 'buzzi': 1, 'glamouris': 3, 'barbel': 1, 'haaaaaaaa': 1, 'ltr': 2, 'imanol': 4, 'contado': 1, 'ballesta': 4, 'raleigh': 2, 'truism': 4, 'pressuburg': 1, 'racquel': 3, 'brillant': 2, 'harebrain': 1, 'pff': 1, 'interess': 1, 'quebek': 1, 'lale': 2, 'hub': 2, 'liebermann': 2, 'ns': 2, 'promenad': 1, 'remsen': 2, 'halliran': 1, 'uriel': 1, 'balanchin': 10, 'sendak': 1, 'gic': 1, 'drosselmey': 2, 'nutcrack': 13, 'baryshnikov': 3, 'vuissa': 1, 'solidar': 3, 'unopen': 1, 'merkley': 2, 'tartan': 2, 'heathen': 5, 'absolutley': 5, 'chahta': 1, 'incrid': 1, 'softfordig': 1, 'hadleyvil': 5, 'mimi': 6, 'soh': 2, 'yamamura': 2, 'sab': 2, 'shimomo': 1, 'icecap': 1, 'llama': 1, 'frider': 1, 'friderwav': 1, 'doubtfir': 1, 'hutchison': 3, 'pastorelli': 2, 'warfield': 7, 'goro': 5, 'smap': 3, 'kitagawa': 1, 'hulbert': 1, 'loma': 2, 'spectral': 2, 'lapdog': 1, 'oe': 1, 'pedopheliac': 1, 'husbandri': 1, 'dappl': 1, 'drainingli': 1, 'lasal': 6, 'qaeda': 2, 'rosenbaum': 2, 'kreuk': 1, 'newsflash': 2, 'gilber': 1, 'wiest': 3, 'norbert': 1, 'butz': 2, 'tvnz': 2, 'niamh': 2, 'miln': 2, 'voyna': 4, 'mir': 5, 'dornhelm': 6, 'donnison': 6, 'bezukhov': 2, 'rostova': 1, 'andrej': 1, 'bolkonski': 2, 'hussar': 5, 'clemenc': 1, 'poesi': 1, 'borodino': 1, 'extenu': 3, 'minku': 1, 'fong': 8, 'nicktoon': 2, 'squarepants2': 1, 'robot3': 1, 'zim4': 1, 'catscratch': 7, 'rugratsnotic': 1, 'blik': 2, 'kimber': 1, 'seinfield': 1, 'zim': 2, 'mlaatr': 1, 'mellisa': 7, 'muzzi': 1, 'mistransl': 2, 'detritu': 4, 'clayburgh': 2, 'phillipa': 1, 'litretur': 1, 'felliniesqu': 1, 'babushka': 1, 'quarrington': 2, 'chaykin': 1, 'nz': 11, 'philippa': 1, 'boyen': 1, 'lazili': 7, 'surnow': 1, 'tock': 3, 'mcnaughton': 1, 'psychos': 2, 'fluidic': 1, 'kilcher': 2, 'hrzgovia': 1, 'oudraogo': 1, 'burkina': 6, 'faso': 6, 'dictatur': 1, 'gita': 2, 'usuali': 2, 'apar': 2, 'gassman': 2, 'steampil': 1, 'rossano': 2, 'brazzi': 2, 'movieclip': 1, 'constabulari': 3, 'shamroy': 3, 'yahweh': 1, 'phiiistin': 1, 'parch': 2, 'grecian': 1, 'pruitt': 2, 'mandartori': 1, 'senc': 3, 'mabus': 7, 'solang': 1, 'vohrer': 2, 'lustrou': 1, 'purplish': 1, 'turquois': 4, 'twangi': 2, 'arent': 3, 'meoli': 1, 'kyra': 3, 'bevan': 1, 'hickenloop': 1, 'enbom': 1, 'plainsman': 5, 'buttress': 2, 'akimbo': 1, 'sponsorship': 3, 'vj': 2, 'scientolog': 1, 'uptak': 2, 'biltmor': 1, 'ashevil': 1, 'rj': 1, 'timesi': 1, 'soeveryon': 1, 'juggler': 1, 'slingblad': 4, 'kammerud': 1, 'vett': 5, 'blackest': 3, 'haroun': 1, 'raschid': 1, 'ozma': 1, 'depos': 5, 'utterless': 1, 'thomilson': 1, 'kostner': 1, 'shiloh': 3, 'imoogi': 1, 'followingthi': 1, 'tora': 8, 'olath': 1, 'irregardless': 1, 'junket': 3, 'motherlod': 1, 'whitepag': 1, 'retract': 5, 'seti': 4, 'luxor': 1, 'shaffner': 1, 'swern': 1, 'recordist': 1, 'draughtswoman': 1, 'tutankhamun': 2, 'loudspeak': 3, 'tinkl': 4, 'completest': 7, 'janson': 1, 'amant': 1, 'chanteus': 3, 'atmosph': 5, 'jeong': 2, 'miryang': 6, 'mouthpiec': 5, 'unluckiest': 3, 'rayford': 5, 'durham': 2, 'unedifi': 1, 'kaneshiro': 1, 'comden': 1, 'nacio': 1, 'unmolest': 1, 'ven': 2, 'reaso': 1, 'lantern': 8, '60mph': 1, 'marlyn': 1, 'psa': 4, 'morbi': 1, 'alraira': 1, 'hilcox': 1, 'nikolau': 1, 'geyrhalt': 1, 'plangent': 1, 'sebasti': 3, 'salgado': 2, 'baltz': 1, 'falsif': 4, 'twosom': 3, 'samway': 4, 'databank': 1, 'stonk': 1, 'inli': 1, 'marlboro': 1, 'titlt': 1, '500lb': 1, 'sniffi': 1, 'berardinelli': 3, 'dulli': 3, 'avco': 5, 'waldermar': 3, 'waldemar': 13, 'daninski': 14, 'ly': 3, 'rudderless': 2, 'reemerg': 3, 'speedman': 10, 'parenthes': 2, 'herp': 2, 'calrissian': 3, '3p0': 1, 'mcdiarmid': 7, 'berk': 3, 'supurrrrb': 1, 'streetwalk': 4, 'runway': 10, 'entrancingli': 1, 'benight': 2, 'squarep': 3, 'nickolodean': 2, 'ps3': 3, 'mgs4': 1, 'nonfict': 4, 'aspirin': 1, 'steeler': 2, 'pnc': 1, 'heinz': 6, 'jordanian': 4, 'brionowski': 1, 'swag': 3, 'aff07': 1, 'acrimoni': 3, 'obsequi': 2, 'roundli': 5, 'castig': 4, 'tacit': 4, 'tex': 4, 'mcliam': 1, 'storey': 6, 'currin': 1, 'granddad': 4, 'alesia': 1, 'balalaika': 1, 'traudl': 5, 'fleck': 2, 'tovarish': 1, 'beullar': 1, 'quanxiu': 1, 'jiang': 6, 'langoli': 2, 'lotu': 6, 'bragg': 1, 'finisham': 1, 'prodd': 1, 'tidey': 2, 'emploi': 2, 'levr': 2, 'xerox': 3, 'eateri': 3, 'launder': 6, 'pratic': 1, 'cought': 1, 'shakesper': 2, 'esk': 1, 'smalltalk': 1, 'kittenishli': 1, 'ladyship': 1, 'selden': 3, 'conley': 1, 'eitel': 1, 'kayla': 1, 'gair': 2, 'shopper': 5, 'hoggish': 1, 'blart': 1, 'hatchback': 1, 'washburn': 4, 'glassi': 3, 'millena': 1, 'gardosh': 1, 'elbowroom': 1, 'baromet': 4, 'libertarian': 3, 'repetoir': 1, 'buntch': 1, 'allay': 1, 'amiss': 3, 'unfortuneatley': 1, 'tendress': 1, 'humain': 1, 'inru': 1, 'worlder': 2, 'yalom': 2, 'ziller': 1, 'deamon': 1, 'pogo': 3, 'raksha': 2, 'sanskrit': 2, 'ashmit': 1, 'emran': 5, 'malikka': 1, 'rabidli': 2, 'charect': 5, 'nickl': 1, 'nk': 4, 'befallen': 1, 'gamestop': 1, '99cent': 1, 'hackbarth': 1, 'timbrook': 1, 'carpentri': 1, 'alongwith': 3, 'marxism': 4, 'underdon': 4, 'intermarriag': 1, '1847': 3, 'globetrot': 4, 'skycaptain': 1, 'maglev': 1, 'remand': 1, 'inertli': 1, 'feinstein': 1, 'diaboliqu': 5, 'geeson': 1, 'notari': 1, 'wriggl': 2, 'frumpish': 1, 'amita': 1, 'numb3r': 2, 'untidi': 3, 'disorderli': 1, 'tragi': 2, 'brd': 1, 'voss': 2, 'kleist': 3, 'hodgin': 2, 'flannel': 3, 'unleaven': 1, 'mencken': 2, 'michol': 2, 'psalm': 3, 'rafe': 2, 'laz': 1, 'sweepstak': 2, 'levon': 1, 'tippi': 5, 'hedrin': 1, 'clubfoot': 1, 'heisler': 1, 'warnercolor': 1, 'smite': 1, 'niebelungenli': 1, 'etzel': 8, 'rechristen': 1, 'nibelung': 3, 'conflagr': 2, 'wagnerian': 8, 'tterd': 1, 'mmerung': 1, 'earthbound': 4, 'cabiria': 2, 'splendour': 4, 'burgundian': 5, 'unsex': 1, 'direst': 2, 'flagstaff': 2, 'nau': 3, 'neuman': 1, 'agaaaain': 1, '111': 2, 'unsav': 3, 'centrist': 2, 'pregam': 1, 'mcclug': 1, 'rubenstein': 2, 'damita': 3, 'celario': 1, 'heiden': 1, 'collison': 1, 'benedetti': 2, 'gillin': 1, 'burrier': 1, 'dewam': 1, 'mcclurg': 6, 'bullish': 1, '195': 2, 'mech': 11, 'uear': 1, 'unallur': 2, 'loon': 2, 'bustin': 2, 'anyhoo': 6, 'ireal': 1, 'eriksson': 7, 'unbound': 2, 'balaun': 1, 'chilcot': 1, 'wizardli': 1, 'ahamad': 2, 'basora': 1, 'ahamd': 1, 'fim': 2, 'ludw': 1, 'osmond': 3, 'borradail': 1, 'cathay': 1, 'rockwood': 3, 'godson': 2, 'parricid': 2, 'junctur': 4, 'thimothi': 1, 'peplum': 2, 'instinctu': 2, 'bloodwat': 1, 'zaat': 1, 'nother': 2, 'hornophob': 1, 'hornomania': 1, 'darnedest': 2, 'weldon': 1, 'psychotron': 1, 'hob': 1, 'anvil': 3, 'caitlin': 6, 'feuerstein': 1, 'dwayn': 2, 'outgrowth': 1, 'geniuspleas': 1, 'sharabe': 2, 'duddley': 1, 'gadfli': 1, 'unswerv': 2, 'impur': 1, 'hupfel': 1, 'atoz': 14, 'zarabeth': 7, 'bernet': 1, 'rubano': 1, 'mcgonagl': 1, 'simpon': 1, 'poochi': 2, 'anomal': 2, 'comsymp': 1, 'eari': 1, 'slacken': 2, 'inna': 1, 'ppfff': 1, 'boooooooooooor': 1, 'uninjur': 1, '10cheesi': 2, '10watch': 1, 'shakespearen': 2, 'lawer': 1, 'cassio': 9, 'mearli': 1, 'conflat': 2, 'insubstanti': 5, 'zafoid': 1, 'polygon': 1, 'dinocroc': 20, 'snider': 2, 'hairband': 1, 'ratt': 1, 'longeneck': 4, 'komodo': 2, 'sheez': 2, 'nonactor': 1, 'bombardi': 9, 'gaslit': 1, 'omgosh': 1, 'grover': 5, 'width': 3, 'technobabbl': 5, 'alta': 8, 'butterfield': 2, 'aspen': 2, 'exsanguin': 1, 'crimedi': 1, 'anjelica': 3, 'artemesia': 3, 'maillard': 1, 'unsuspectingli': 2, 'frumpi': 8, 'elocut': 4, 'snippi': 3, 'pamelyn': 1, 'ferdin': 1, 'doublebil': 1, 'dutton': 10, 'josef': 6, 'ghostbust': 10, 'reassembl': 3, 'whitest': 2, 'unflapp': 2, 'marsupi': 2, 'limpest': 1, 'brandner': 3, 'transylvian': 1, 'discothequ': 2, 'inconspicu': 3, 'ossuari': 1, 'gencon': 1, 'flo': 10, 'lebrock': 5, 'krypyonit': 1, 'walkabout': 3, 'sampson': 15, 'underlit': 2, 'leif': 6, 'jonker': 3, 'maroney': 3, 'beltran': 2, 'eberhardt': 2, 'persoanlli': 1, 'ttvik': 2, 'eivor': 2, 'gunilla': 2, 'invetig': 1, 'nebraskan': 2, 'sayeth': 1, 'jugular': 3, 'rgermeist': 1, 'cheesefest': 2, 'remanufactur': 1, 'cruder': 4, 'vulkan': 1, 'jeri': 3, 'ql': 1, 'achiv': 1, 'investog': 1, 'excor': 1, 'movei': 2, 'scren': 1, 'amalr': 2, 'arnaud': 2, 'unschool': 2, 'unmedi': 2, 'unnuanc': 1, 'arbitrarili': 6, 'viola': 9, 'biologist': 4, 'roussillon': 1, 'wolliaston': 1, 'magali': 1, 'sinologist': 1, 'polay': 4, '8k': 1, 'goodli': 1, 'unassured': 1, 'sarlac': 2, 'intenstin': 1, 'anihili': 1, 'degobah': 1, 'tarkin': 1, 'wisen': 1, '10am': 1, 'bree': 3, 'kamp': 1, 'djjohn': 1, 'saturnin': 2, 'jeay': 1, 'selten': 1, 'dastagir': 1, 'maharaja': 2, 'mysor': 2, 'narcissu': 4, 'alisand': 2, 'cartelois': 1, 'orisha': 1, 'georgio': 5, 'milgram': 2, 'frieda': 5, 'inescort': 1, 'verel': 1, 'webpag': 2, 'dayton': 3, 'strenghth': 1, 'gayest': 3, 'crapstori': 1, 'kasugi': 1, 'neigh': 3, 'wheeeew': 1, 'kirckland': 1, 'nightgown': 5, 'gildersneez': 1, 'natch': 6, 'condition': 3, 'verandah': 1, 'woofter': 1, 'pregger': 1, 'earlob': 1, 'saucepan': 1, 'minta': 1, 'durfe': 1, 'cogit': 1, 'mahayana': 2, 'plebe': 1, 'yapfest': 1, 'donahu': 2, 'egress': 2, 'watcha': 1, 'quartermain': 4, 'hoorah': 1, 'matchbox': 2, 'politburo': 1, 'martinet': 3, 'enright': 2, 'vez': 21, 'falsehood': 5, 'counterweight': 2, 'hokiest': 1, 'severeid': 1, 'woar': 1, 'xd': 3, 'suggesst': 1, 'wo2': 1, 'harley': 11, 'frederik': 1, 'kamm': 1, 'chafe': 4, 'sharmila': 1, 'tagor': 1, 'blackli': 3, 'mordantli': 1, 'shockwav': 1, 'andrienn': 1, 'siri': 1, 'baruc': 1, 'geneseo': 1, 'complianc': 5, 'heuy': 1, 'louey': 1, 'mcc': 1, 'tympani': 1, 'miserli': 4, 'yakkiti': 2, 'darksid': 3, 'horray': 1, 'wierder': 1, 'personn': 1, 'fleggenheim': 2, 'lanski': 1, 'neptunemonday': 1, 'neptunefew': 1, 'albeniz': 5, 'centenni': 1, 'spaniard': 13, 'horsel': 1, 'baselin': 1, 'haskin': 1, 'tripod': 21, 'spire': 3, 'squidoid': 1, 'denud': 1, 'greenscreen': 3, 'herki': 3, 'mamer': 1, 'loir': 2, 'lyc': 1, '62': 7, 'molier': 3, 'immobl': 1, 'malad': 1, 'imaginair': 1, 'outreach': 1, 'deleon': 1, 'excempt': 1, 'bbfc': 3, 'lathan': 2, 'weissberg': 1, 'mendel': 5, 'incread': 1, 'chung': 5, 'stinkey': 1, 'hateboat': 1, 'funnnni': 1, 'aidsssss': 1, 'yakin': 2, 'yosi': 1, 'hasid': 1, 'monsey': 1, 'milah': 1, 'chosson': 1, 'busiest': 2, 'flowerchild': 1, 'guadalajara': 1, 'favorti': 1, 'darkangel': 1, '1627': 1, 'leggi': 5, 'throll': 1, 'faridani': 1, 'transluc': 3, 'apport': 1, 'doltish': 2, 'barbirino': 1, 'madolyn': 3, 'elija': 1, 'pugil': 1, 'aurthur': 1, 'outerbridg': 1, 'ps1': 7, 'intermediari': 1, 'reorder': 1, 'blahactu': 1, 'priam': 1, 'yashraj': 7, 'goodlook': 2, 'kitn': 3, 'ajeeb': 3, 'huzoor': 2, 'madrig': 3, 'swooni': 1, 'pepperday': 1, 'vitam': 1, 'scenif': 1, 'dallasian': 1, 'forsythian': 1, 'erman': 1, 'worser': 5, 'mandingo': 1, 'typethey': 1, 'geta': 1, 'alwaysjay': 1, 'poodlesqu': 1, 'brouhaha': 1, 'sulia': 1, 'shiranui': 1, 'untruth': 4, 'ramrod': 1, 'spooner': 4, 'preempt': 3, 'stirl': 5, 'bastedo': 3, 'sharron': 3, 'stewert': 1, 'perovitch': 1, 'sunscreen': 2, 'dgw': 1, 'kish': 1, 'hardcastl': 3, 'mombi': 1, 'ulta': 1, 'hort': 4, 'pfieffer': 6, 'trask': 2, 'unbind': 1, 'sepet': 3, 'quitt': 3, 'menaikkan': 1, 'bulu': 1, 'hujan': 2, '1o': 1, 'foggier': 1, 'valanc': 4, 'molerat': 1, 'shrubberi': 2, 'multilingu': 1, 'chiasmu': 1, 'neighborli': 2, 'krui': 4, 'gustafson': 1, 'pornstress': 1, 'motionfirst': 1, 'tapeworthi': 1, 'joad': 1, 'shonuff': 1, 'fem': 6, 'karlof': 1, 'merli': 1, 'biochem': 2, 'karrer': 1, 'confession': 3, 'pointblank': 1, 'bookkeep': 2, 'lamborghini': 3, 'jdd': 1, 'mclaghlan': 1, '454': 1, 'raphael': 1, 'uncr': 10, 'unexamin': 1, 'powwow': 1, 'verona': 4, 'capulet': 4, 'rycart': 1, 'codpiec': 1, 'mercutio': 3, 'gurn': 4, 'naismith': 1, 'overspeedi': 1, 'kitumura': 1, 'blackhawk': 4, 'preprint': 1, 'nitrat': 4, 'chautard': 1, 'applebloom': 2, 'headdress': 1, 'elvidg': 1, 'chato': 2, 'konnvitz': 1, 'mida': 4, 'crunchi': 1, 'turtorro': 1, 'overbak': 3, 'lala': 1, 'erector': 1, 'moneyshot': 1, 'arrggghhh': 1, 'gt': 4, 'antipathi': 2, 'trnka': 10, 'bratislav': 1, 'pojar': 2, 'drouin': 1, '2000ad': 1, 'parkhous': 1, 'choy': 1, 'huk': 1, 'chio': 1, 'tenney': 3, 'shutout': 2, 'veddar': 1, 'interdepend': 3, 'areslow': 1, 'monahan': 4, 'bludg': 1, 'rebuff': 4, 'bilgey': 1, 'wigstock': 1, 'hubley': 1, 't4': 1, 'wank': 2, 'awful': 1, 'characht': 2, 'phisic': 1, 'junction': 3, 'sufer': 1, 'prognost': 1, 'atavachron': 1, 'gallant': 4, 'methuselah': 1, 'circus': 4, 'spoilerunderr': 1, 'midkiff': 14, 'micmac': 4, 'pascow': 8, 'wakeup': 1, 'troubleshoot': 1, 'pieczanski': 1, 'jpieczanski': 1, 'sidwel': 1, 'edu': 1, 'pleeeeas': 1, 'constitu': 2, 'hobbyhors': 1, 'itwa': 2, 'richardswa': 1, 'andjudg': 1, 'thunderblast': 2, 'brogado': 1, 'enriquez': 2, 'libyan': 1, 'kartiff': 1, 'lankford': 2, 'monogamist': 2, 'pfink': 1, 'lalann': 1, 'schya': 1, 'samedi': 4, 'voudon': 1, 'loa': 2, 'trickster': 6, 'voudoun': 1, 'masterstrok': 1, 'hayley': 2, 'tushi': 2, 'tetanu': 2, 'applewhit': 1, 'polick': 1, 'cletu': 1, 'strate': 1, 'paquerett': 1, 'directeur': 1, 'typewrit': 10, 'okona': 2, 'guinan': 1, 'huggabl': 3, 'placehold': 1, 'spiner': 1, 'billiard': 3, 'mauritiu': 2, 'chagossian': 2, 'edina': 1, 'cassanova': 3, 'psychofrakul': 2, 'zapp': 1, 'smashmouth': 1, 'saitta': 1, 'starman': 2, 'faltermey': 2, 'milford': 5, 'interstellar': 1, 'safeguard': 4, 'whyfor': 1, 'benvolio': 2, 'ropey': 5, 'pimpin': 2, 'christenssen': 1, 'wilt': 4, 'mccall': 5, 'botswana': 2, 'borat': 8, 'kazakhstan': 2, 'mma': 6, 'ramotsw': 3, 'makutsi': 3, 'lucian': 5, 'msamati': 2, 'jlb': 2, 'matekoni': 2, 'suckag': 1, 'anglicis': 1, 'restyl': 1, 'macbook': 1, 'apocryph': 3, 'farri': 4, 'dore': 1, 'algeria': 2, 'similalri': 1, 'overprint': 1, 'infanticid': 2, 'bhave': 3, 'shaaw': 1, 'marathi': 2, 'gauri': 21, 'maharashtra': 1, 'bringer': 1, 'anesthesiologist': 2, 'fantasticli': 1, 'eventulli': 1, 'ucsb': 2, 'intraperson': 1, 'montecito': 1, 'kwai': 4, 'enviabl': 3, 'roamer': 2, 'rue': 10, 'mcelwe': 4, 'mcewe': 1, 'nietsch': 1, 'coghlan': 1, 'skillet': 3, 'trestl': 1, 'kovak': 1, 'gimmeclass': 2, 'humid': 6, 'luvahir': 2, 'chucklehead': 1, 'bangla': 2, 'howdi': 1, 'bombin': 1, 'drivin': 1, 'timidli': 2, 'ohtar': 4, 'yemen': 1, 'khali': 3, 'sunnybrook': 1, 'fount': 2, 'vigil': 10, 'unbrut': 1, 'androgin': 1, 'mump': 1, 'livesi': 1, 'ignoramu': 3, 'dreamin': 2, 'godsak': 1, 'bridgett': 2, 'khamosh': 1, 'shabana': 4, 'azmi': 4, 'baaaaaaaaaaad': 1, 'piquer': 1, 'peic': 3, 'asterix': 1, 'valereon': 1, 'wok': 2, 'unmention': 2, 'christmas': 5, 'ebeneez': 3, 'dapper': 5, 'amphibulo': 4, 'gaillardia': 6, 'larki': 1, 'miscommun': 2, 'airsick': 1, 'ilyena': 1, 'luciana': 5, 'paluzzi': 3, 'ufa': 1, 'huppertz': 1, 'atilla': 1, 'minotaur': 2, '300lb': 1, 'dorfmann': 1, 'inheritor': 5, 'klub': 1, 'wodka': 1, 'mpk': 4, 'suman': 1, 'hmapk': 1, 'alock': 1, 'nath': 13, 'clin': 1, 'oeil': 1, 'ingenios': 1, 'sibley': 1, 'arwen': 3, 'glorfindel': 1, 'rivendel': 5, 'beren': 1, 'luthien': 1, 'sketchili': 1, 'proudfeet': 1, 'bilbo': 2, 'fangorn': 1, 'moria': 2, 'lothlorien': 1, 'soundscap': 1, 'elven': 1, 'uncanon': 2, 'hollin': 1, 'weatherworn': 1, 'beardi': 1, 'numenorian': 1, 'mina': 3, 'tirith': 1, 'monsteroid': 1, '480p': 1, 'willam': 1, 'rvd': 19, 'bischoff': 12, 'econovan': 1, 'moragn': 1, 'psst': 1, 'debit': 5, 'mumblecor': 5, 'linklatt': 1, 'sisterhood': 3, 'hath': 3, '914': 1, 'xian': 4, 'skyler': 1, 'philippon': 1, 'monograph': 1, 'amoureus': 1, 'ronika': 1, 'circumscrib': 1, 'irma': 1, 'vep': 1, 'doinel': 2, 'tweedi': 2, 'mimicri': 3, '2050': 2, 'dementedli': 1, 'industrialist': 5, 'unvari': 1, 'fritter': 2, 'spaceport': 1, 'nuttin': 2, 'reassert': 3, 'inescourt': 2, 'hickvil': 1, 'melbourneit': 1, 'intellectualis': 2, 'gregor': 4, 'timesfunni': 1, 'interrup': 1, 'restitut': 1, 'kasparov': 1, 'whaddya': 1, 'guacamol': 2, 'hinckley': 2, 'haig': 7, 'smarmiest': 2, 'shernaz': 1, 'overqualifi': 2, 'virendra': 1, 'sahi': 1, 'marile': 1, 'byword': 1, 'gespenst': 9, 'yella': 1, 'jerichow': 1, 'petzold': 3, 'dilat': 4, 'aristotelian': 5, 'diffusion': 1, 'ester': 3, 'exurbia': 1, 'sciamma': 13, 'animaux': 1, 'florian': 40, 'renasc': 1, 'nouement': 2, 'pressenc': 1, 'brang': 1, 'mastantonio': 1, 'vedma': 1, 'yevgeniya': 1, 'kryukova': 1, 'teahous': 1, 'hackdom': 1, 'thanku': 1, 'archdioces': 2, 'heartstop': 1, 'armband': 2, 'hoochi': 1, 'pule': 1, 'barnacl': 2, 'tantric': 1, 'oosh': 1, 'pervertish': 1, 'llcoolj': 1, 'firebird': 1, 'accorsi': 3, 'pazienza': 1, 'fm': 1, 'hindranc': 5, 'insurg': 16, 'humve': 2, 'ghoulishli': 1, 'photochem': 1, 'bollbust': 1, 'jihad': 4, 'invect': 3, 'satirist': 1, 'gaoler': 1, 'bast': 1, 'daugher': 1, 'fwwm': 1, 'lh': 1, 'grbavica': 1, 'clasic': 1, 'pickier': 1, 'yee': 2, 'cranston': 1, '125m': 1, 'rawlin': 7, 'surkin': 1, 'barbedwir': 1, 'schwarzmann': 1, 'outsideth': 1, 'autobiograh': 1, 'katzir': 6, 'rejuvin': 1, 'rizzuto': 1, 'dispis': 1, 'cringi': 1, 'shudderingli': 1, 'leyt': 2, 'mockinbird': 1, 'yearl': 2, 'wearier': 1, 'defenseless': 10, 'schomb': 1, 'saboto': 1, 'ramin': 1, '0000000000001': 1, 'tdoit': 1, 'knievel': 1, 'mortif': 1, 'medioacr': 1, 'stabler': 1, 'losvu': 1, 'unattach': 2, '30someth': 1, 'caetano': 2, 'mozambiqu': 2, 'angola': 2, 'bissau': 2, 'exactitud': 1, 'spinola': 1, 'antedot': 1, 'haggardli': 1, 'noriyuki': 1, 'rythym': 1, 'equipt': 1, '89or': 1, 'ayatollah': 3, 'flannigan': 1, 'posttraumat': 1, 'megessey': 1, 'succor': 1, 'plutonium': 7, 'permanent': 1, 'cohl': 1, 'galvin': 1, 'phyilli': 1, 'soundproof': 1, 'abigil': 1, 'abgail': 1, 'checkmat': 2, 'matchstick': 3, 'marmit': 4, 'dayglo': 2, 'homemak': 2, 'pardu': 3, 'altough': 1, 'mabi': 1, 'inopportun': 5, 'heebi': 2, 'jeebi': 2, '139': 1, 'sose': 1, 'shachnovel': 1, 'shorti': 4, 'sundayafternoon': 1, 'emefi': 1, 'branli': 1, 'siecl': 1, 'pl': 2, 'caiss': 1, 'adjurduboi': 1, 'bergan': 1, 'artimisia': 3, 'envok': 1, 'romantisis': 1, 'camerashot': 1, 'inequit': 1, 'videothek': 1, 'hollandish': 1, 'undertitl': 1, 'horrormovi': 2, 'halluzin': 1, 'shizophren': 1, 'mindfu': 1, 'imc6': 1, 'vv': 4, 'tamizh': 1, 'namba': 2, 'munnera': 2, 'maadri': 1, 'innum': 1, 'jeyaraj2': 1, 'jeyaraj3': 1, 'hj': 1, 'energ': 4, 'jothika': 2, 'kamalini': 1, 'mukerjhe': 1, 'thenali': 1, 'haasan': 1, 'thoongada': 2, 'thambi': 1, 'tn': 3, 'keeranor': 1, 'sathoor': 1, 'kamanglish': 1, 'wha': 3, 'gautam': 1, 'kuttram': 1, 'gautum': 1, 'bib': 1, 'cray': 6, 'edinburugh': 1, 'pharmacist': 6, 'sarsgaard': 8, 'estefan': 2, 'ziploc': 1, 'defini': 1, 'spoilerish': 1, 'fy': 1, 'attilla': 1, 'preliter': 1, 'northwestern': 1, 'ramadan': 2, 'ohhhhh': 3, 'helium': 3, 'actra': 1, 'ceeb': 1, 'schmoeller': 1, 'comlex': 1, 'creeli': 1, 'mappl': 1, 'pequod': 1, 'queequeg': 1, 'harpoon': 3, 'stubb': 2, 'hve': 1, 'huuug': 1, 'suuuuuuuuuuuuck': 1, 'afficionado': 3, 'preacherman': 5, 'lawnmowerman': 1, 'cornucopia': 3, 'panpip': 1, 'annabeth': 1, 'barnet': 2, 'boggin': 1, 'bunc': 1, 'matilda': 3, 'fragmentar': 1, 'franzisca': 1, 'preform': 7, 'minha': 2, 'brainpow': 1, 'hypothes': 3, 'kosentsev': 1, 'coranado': 1, 'almerayeda': 1, 'bravora': 1, 'depardu': 1, 'ranyaldo': 1, 'leart': 1, 'osric': 4, 'salvador': 4, 'alliend': 1, 'herzegovina': 3, 'quedraogo': 1, 'birkina': 1, 'gital': 1, 'setembro': 1, 'menvil': 2, 'everli': 3, 'carisl': 1, 'smoothi': 1, 'blusteri': 5, 'mortician': 4, 'gottlieb': 2, 'byer': 2, 'shihuangdi': 1, 'mulan': 5, 'mousetrap': 2, 'flour': 4, 'kinugasa': 2, 'sliperi': 1, 'stinkfest': 1, '20min': 1, 'merritt': 1, 'sanguisuga': 4, 'marnack': 2, 'patrizia': 2, 'webley': 1, 'lidia': 2, 'olizzi': 1, 'marzia': 1, 'caterina': 1, 'chiani': 1, 'valeriano': 1, 'rozzi': 1, 'sanguisga': 1, 'batzella': 1, 'aquarian': 1, 'cur': 2, 'baphomet': 1, 'fakeri': 2, 'improvisatori': 1, 'gwenllian': 1, 'fritchi': 2, 'marijauna': 1, 'unexcept': 6, 'unzip': 2, 'woodenli': 4, 'atherton': 2, 'mcentir': 1, 'maneuver': 1, 'mysterio': 3, 'sintown': 3, 'fraze': 4, 'foy': 2, 'witney': 5, 'ballentin': 4, 'riotous': 2, 'tchecki': 1, 'doomsvil': 2, 'wrangler': 4, 'cacoyani': 1, 'becalm': 1, 'clytemenstra': 1, 'unstat': 2, 'minin': 1, 'nyman': 3, 'hongkong': 2, 'squadder': 2, 'zizola': 3, 'sapphir': 2, 'ballgown': 1, 'marcella': 7, 'plunkett': 1, 'ouvr': 1, 'trancer': 22, 'lightflash': 1, 'maillot': 1, 'yaaaaaaaaaaaaaawwwwwwwwwwwwwwwwwnnnnnnnnnnnnn': 1, '8ozzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz': 1, 'mooment': 1, 'zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz': 1, 'ooop': 3, 'yawnfest': 2, 'zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz': 1, 'somnath': 1, 'mcgilli': 1, 'lahti': 1, 'carvan': 1, 'cardigan': 1, 'tapdanc': 2, 'timewarp': 1, 'streed': 1, 'muscial': 1, 'andros': 1, 'orlac': 1, 'swatman': 1, 'royali': 1, 'northram': 1, 'sneaker': 5, 'deciev': 1, 'gameboy': 3, 'egot': 3, 'scholast': 3, 'phillipin': 5, 'kabosh': 1, 'astoria': 1, 'corregidor': 5, 'bataan': 3, 'luzon': 2, '32nd': 1, 'gitgo': 1, 'grandli': 1, 'burundi': 1, 'transvest': 3, 'humperdinck': 2, 'grayscal': 1, 'canner': 1, 'beetlejuic': 6, 'anbodi': 2, 'burtonesqu': 2, 'homepag': 2, 'manier': 1, 'clink': 4, 'aww': 2, '1660': 1, 'repositori': 3, 'uhhh': 2, 'rosenfield': 1, 'basicli': 4, 'triumf': 1, 'willen': 1, 'phobic': 3, 'soter': 1, 'bloodymonday': 1, 'paradorian': 3, 'karzi': 5, 'dov': 1, 'tiefenbach': 1, 'hogi': 1, 'mpho': 1, 'koaho': 1, 'dicker': 1, 'charle': 1, 'kitano': 4, 'fungal': 1, 'maypo': 1, 'maltex': 1, 'wheatena': 1, 'mccartl': 1, 'withdrawl': 1, 'qaida': 2, 'ciountri': 1, 'windingli': 1, 'wackyest': 1, 'bueno': 5, 'peron': 3, 'cariboo': 2, 'autri': 5, 'frescort': 1, 'interrelationship': 3, 'slingshot': 2, 'clank': 3, 'quill': 2, 'fishhook': 1, 'sweeti': 4, 'nlp': 1, 'hollywoodis': 1, 'pepto': 4, '107': 6, 'eav': 3, 'blatent': 2, 'antler': 3, 'succ': 1, 'samual': 1, 'inculc': 2, 'hoc': 4, 'opprobri': 1, 'willowi': 3, 'punsley': 1, 'schoolwork': 2, 'gorcey': 3, 'h5n1': 1, 'avian': 2, '10thi': 2, 'fuch': 1, 'anhalt': 3, 'armchair': 4, 'interestedli': 1, 'giancaro': 1, 'aapk': 6, 'mohnish': 3, 'behl': 1, 'kalamazoo': 2, 'abash': 2, 'charasmat': 1, 'recipi': 12, 'outloud': 1, 'redeam': 1, 'enterntain': 1, 'exection': 1, 'mikal': 1, 'sumpter': 9, 'manilow': 1, 'whic': 1, 'kou': 2, 'shibasaki': 1, 'koma': 1, 'trekkish': 1, 'technerd': 1, 'rexa': 1, 'judson': 11, 'tima': 1, 'tratment': 1, 'geat': 2, 'faithless': 1, 'waiv': 3, 'lizi': 1, 'warrier': 1, 'mostfam': 2, 'inlcud': 1, 'ubik': 1, 'hyderabadi': 2, 'biryani': 2, 'mst3king': 1, 'jasonx': 1, 'ft13th': 1, 'deathmatch': 2, 'talisman': 1, 'medalian': 1, 'tbi': 2, 'vorelli': 1, 'briget': 2, 'zaz': 5, 'ridgement': 2, 'ster': 4, 'bastidg': 1, 'putdown': 1, 'samharri': 1, 'octopus': 2, 'quadrilater': 1, 'aicha': 3, 'enh': 1, 'herriman': 1, 'heidijean': 1, 'carli': 3, 'pornichet': 2, 'nant': 1, 'belami': 1, 'bismark': 1, 'ghouli': 10, 'furbi': 1, 'grotequ': 1, 'kickoff': 2, 'jaku': 1, 'nutteri': 1, 'revok': 5, 'dramath': 1, 'scifimayb': 1, 'modem': 1, 'mplayer': 2, 'winamp': 1, 'xp': 5, 'xine': 1, 'kaffein': 1, 'suse': 1, 'fier': 1, 'abercrombi': 3, 'varianc': 2, 'seniorita': 1, 'cucacha': 1, 'marilla': 2, 'westley': 4, 'heggi': 3, 'avonlea': 3, 'pfennig': 1, 'vulgarli': 2, 'franticli': 1, 'drifti': 1, 'wurlitz': 3, 'vicent': 4, 'blasco': 3, 'ibanez': 3, 'naranjo': 2, 'unnactract': 1, 'cupido': 2, 'mattox': 7, 'bernarda': 4, 'brull': 3, '157': 2, 'stormrid': 4, 'injun': 3, 'gunneri': 1, 'flam': 1, 'curricular': 2, '19k': 1, 'hz': 1, 'grotesqueri': 1, 'chunkhead': 1, 'ww1': 9, 'flyfish': 2, 'flyfisherman': 2, 'dartmouth': 2, 'quakerli': 1, 'urrrghhhthi': 1, 'majo': 1, 'takkyuubin': 1, 'ghibi': 1, 'uematsu': 1, 'kanno': 1, 'tilman': 1, 'curley': 9, 'aughti': 1, 'wildsid': 4, 'dimitriad': 1, 'pederson': 1, 'cousta': 1, 'blahe': 1, 'migrant': 6, 'condemnatori': 2, 'inflam': 3, 'unalter': 1, 'pyre': 4, 'richman': 2, 'suevia': 1, 'desconocida': 1, 'ingl': 1, 'rawest': 1, 'franclisco': 1, 'spald': 2, 'schlub': 4, 'huggin': 10, 'huggaland': 6, 'drier': 2, 'bookworm': 7, 'hugsi': 5, 'impkin': 1, 'tweaker': 1, 'hugwagon': 1, 'youngberri': 5, 'quartz': 1, 'mastodon': 1, 'tusk': 3, 'admira': 1, 'apparatu': 8, 'whaaaaatttt': 1, 'ssss': 1, 'happpeniiiinngggg': 1, 'globo': 2, 'ojibway': 5, 'conservation': 1, 'palladium': 1, 'belaney': 6, '1888': 3, 'anahareo': 1, 'backwoodsman': 1, 'hddc': 1, 'minidv': 1, 'sprigg': 1, 'stynwyck': 2, 'geofferi': 1, 'fraculat': 1, 'freinken': 1, 'lipnicki': 1, 'snowbel': 1, 'getti': 2, 'chaz': 1, 'buerk': 1, 'bodega': 2, 'iaac': 1, 'dubey': 2, 'cabann': 2, 'freund': 1, 'waissbluth': 2, 'stor': 1, 'temuco': 3, 'pascual': 2, 'fluffbal': 1, 'faludi': 1, 'mirroroh': 1, 'cliver': 9, '7ft': 2, 'buchfelln': 8, 'bloodshot': 2, 'eurocult': 1, 'gisela': 2, 'pochath': 3, 'tempra': 1, 'severin': 1, 'shaffer': 6, 'caraca': 6, 'redistribut': 1, 'algier': 4, 'mf': 1, 'polystyren': 1, 'philisoph': 1, 'balwin': 2, 'innapropri': 1, 'spasitc': 1, 'chronopoli': 1, 'chonopolisian': 1, 'duologu': 3, 'ecko': 2, 'goldsboro': 1, 'darkend': 1, 'sylvan': 3, 'busker': 1, 'herr': 9, 'comma': 3, 'valari': 3, 'fife': 4, 'birthpar': 1, 'birthmoth': 2, 'scf': 1, 'tugger': 1, 'madhavi': 7, 'konkan': 2, 'deepak': 3, 'foreplay': 2, 'charu': 1, 'mohanti': 1, 'thapar': 2, 'buh': 2, 'texasvil': 1, 'buyout': 2, 'kelvin': 2, 'uta': 1, 'ungain': 1, 'quir': 1, 'tem': 1, 'herli': 2, 'breakabl': 2, 'termag': 1, 'stainboy': 1, 'njosnavelin': 1, 'lamo': 1, 'paperboy': 3, 'danzig': 4, 'rosal': 2, 'izzi': 2, 'gruntl': 1, 'heusen': 3, 'bingl': 1, 'schoolyard': 3, 'timo': 4, 'whacker': 1, 'castanet': 1, 'gotterdammerung': 1, 'berti': 4, 'wooster': 2, 'jeev': 4, 'wodehousian': 1, 'wearisom': 2, 'mcdougal': 1, 'wolitz': 1, 'creameri': 1, 'swedlow': 1, 'kirkendal': 3, 'bellboy': 1, 'mindbend': 1, 'riccardo': 2, 'torrebruna': 1, 'giulia': 3, 'mvt': 1, 'huttner': 1, 'enjoyth': 1, 'ghoultown': 1, 'terrorvis': 2, 'beneficiari': 2, 'falwel': 4, 'albot': 1, 'hellishli': 1, 'merriment': 1, 'ghim': 1, 'parn': 5, 'wagnard': 4, 'kardi': 1, 'lodoss': 8, 'deedlit': 4, 'kaoru': 1, 'wada': 1, 'ortiz': 3, 'offput': 1, 'jayc': 1, 'zarustica': 1, 'kashu': 2, 'ashram': 3, 'muscari': 1, 'slayn': 1, 'garrack': 1, 'nees': 2, 'pirotess': 1, 'ryna': 1, 'angora': 3, 'aldonova': 1, 'greevu': 1, 'reona': 1, 'showstoppingli': 1, 'cashew': 2, 'tohma': 1, 'hayami': 1, 'vingh': 1, 'enquanto': 1, 'ela': 2, 'fora': 1, 'marmeladova': 1, 'genderbend': 3, 'symmetri': 7, 'disloc': 5, 'zagro': 1, 'zardkuh': 1, 'irankian': 1, 'ziba': 1, 'rosselini': 2, 'husbang': 1, 'luciu': 4, 'psychomania': 1, 'scri': 3, 'choronzhon': 1, 'cowpi': 1, 'klugman': 9, 'psychotherapi': 1, 'swordmen': 1, 'cyr': 2, 'heslov': 1, 'huerta': 1, 'westcourt': 1, 'annel': 1, 'parr': 1, 'homeset': 1, 'histar': 1, 'hokkaid': 1, 'defa': 2, 'skidoo': 3, 'remarriag': 1, 'preparatori': 2, 'dwervick': 1, 'itier': 3, 'duforq': 1, 'quagmir': 6, 'shiro': 2, 'rapyuta': 1, 'hime': 1, 'rugrat': 3, 'inigo': 1, 'montoya': 2, 'bogdonovitch': 2, 'bogdonovich': 3, 'deniz': 1, 'akkaya': 1, 'friggen': 2, 'myc': 1, 'agnew': 1, 'beiser': 2, 'maldiv': 1, 'fedel': 3, 'noit': 1, 'polk': 3, 'ait': 2, 'britspeak': 1, 'bitingli': 2, 'tradeoff': 1, 'burstingli': 1, 'dilling': 53, 'purvi': 20, 'miliu': 13, 'ducommun': 1, 'searingli': 2, 'reciev': 3, 'anoy': 1, 'hassan': 6, 'tenebra': 1, 'raghavan': 3, 'sematarti': 1, 'lorri': 8, 'horrorvis': 3, 'rolli': 1, 'feliz': 2, 'navidad': 2, 'kavanagh': 2, 'countryman': 4, 'bronco': 2, 'haughtili': 1, 'brak': 7, 'sgcc': 1, 'zorak': 8, 'thunderclees': 1, 'agrument': 1, 'ecw': 2, 'duduc': 1, 'debili': 1, 'interfernc': 1, 'allanc': 1, 'fradul': 1, 'starsal': 1, 'superfl': 2, 'viewtaji': 1, 'nightimmun': 1, 'outstandingli': 11, 'swanton': 2, 'yetth': 1, 'upsurg': 1, 'doggerel': 2, 'arnett': 4, '274': 1, 'mutha': 2, 'kiriya': 2, 'kippei': 1, 'shiina': 1, 'tomorowo': 1, 'taguchi': 1, 'karino': 1, 'craziest': 7, 'flyweight': 1, 'falsi': 1, 'squirmi': 2, 'cognit': 6, 'freedomofmind': 1, 'resourcecent': 1, 'pythonesqu': 2, 'ntsc': 6, 'razorblad': 2, 'woodcraft': 1, 'herder': 2, 'pepino': 1, 'winkleman': 1, 'hassi': 5, 'tnn': 2, 'safest': 1, 'dodgerdud': 1, 'tr': 9, 'minx': 2, 'decorum': 3, 'desctruct': 1, 'geist': 4, 'darla': 2, 'loathabl': 1, 'tedra': 1, 'bux': 1, 'hazardd': 1, 'frikkin': 1, 'observatori': 1, 'alarmist': 7, 'herinteract': 1, 'herint': 1, 'retri': 1, 'untastey': 1, 'lightheartedli': 2, 'pta': 1, 'medellin': 2, 'bloqu': 1, 'magnfici': 1, 'bobbin': 1, 'midland': 3, 'conif': 1, 'synapsi': 1, 'unfaithfu': 1, 'ginni': 4, 'mmmmmmm': 1, 'vonda': 2, 'ihop': 1, 'ostrac': 6, 'belyt': 1, 'lakewood': 3, '00am': 4, 'timeslot': 1, 'toturro': 1, 'torturro': 1, 'wirth': 9, 'southwestern': 3, 'lenient': 4, 'pleiad': 2, 'perseu': 1, 'tauru': 1, 'zantara': 3, 'vetch': 1, 'naaaa': 2, 'eeeevil': 1, '3yr': 2, 'parolini': 3, 'yetian': 2, 'aromat': 2, 'fragranc': 2, 'sotd': 1, 'o': 1, 'whirlpool': 6, 'calumni': 1, 'kramp': 4, 'lube': 8, 'parlou': 1, 'appereantli': 1, 'peugeot': 1, '24m30': 1, 'chrysler': 5, 'aegert': 1, 'winig': 1, 'bluntschi': 1, 'preadolesc': 2, 'sucht': 1, 'dsd': 2, 'naddel': 1, 'bild': 1, 'wetten': 1, 'dass': 1, 'electricut': 2, 'gordan': 5, 'definatli': 4, 'brigley': 1, 'someom': 1, 'deana': 4, 'starsit': 1, 'abysym': 1, 'spraypaint': 1, 'squirtgun': 1, 'rigomorti': 1, 'fudoh': 2, 'angharad': 1, 'poldark': 1, 'adaptor': 1, 'grotti': 1, 'savitch': 1, 'storyaspect': 1, 'stereobland': 1, 'xtro': 4, 'arghhhhh': 1, 'seger': 1, 'indira': 1, 'elsebi': 1, 'everlaugh': 1, 'bargears': 1, 'inuindo': 1, 'overexxager': 1, 'slaon': 1, 'amang': 1, 'admiralti': 1, 'wardroom': 1, 'druri': 1, 'binki': 1, 'canni': 2, 'haw': 7, 'waspish': 1, 'tink': 3, 'thimbl': 1, 'meddlesom': 3, 'jook': 1, 'unmercilessli': 1, 'hoaki': 1, 'tournier': 1, 'capricorn': 2, 'strutt': 1, 'exhud': 1, 'harrod': 2, 'isolationist': 4, 'summerson': 1, 'gentri': 1, 'honoria': 1, 'tulkinghorn': 4, 'parliamentari': 1, 'pickwick': 3, 'debtor': 2, 'copperfield': 7, 'testat': 1, 'drood': 1, 'thackeray': 1, 'whoopdedoodl': 1, 'stefani': 1, 'ef': 4, 'that4': 1, 'mouskouri': 1, 'keypad': 1, 'reisert': 7, 'cellular': 3, 'jayma': 3, 'vbc': 1, 'acu': 2, 'blackenstein': 1, 'jermain': 10, 'contagion': 2, 'overextend': 2, 'parsif': 28, 'kutter': 3, 'sperr': 1, 'haugland': 2, 'wolfgang': 9, 'schone': 1, 'syberberg': 22, 'bayreuth': 3, 'winifr': 1, 'kundri': 12, 'klingsor': 6, 'cosima': 2, 'matild': 1, 'wesendock': 1, 'mezzo': 2, 'metafict': 1, 'windgassen': 1, 'placido': 1, 'domingo': 3, 'yvone': 1, 'beasley': 2, 'spenser': 2, 'unredem': 1, 'timethi': 1, 'rtebek': 1, 'visbi': 1, 'jawaharl': 1, 'nehru': 1, 'karishma': 7, 'conpirici': 1, 'atmosphoer': 1, 'hasselhof': 1, 'homerun': 2, 'bosox': 2, 'blatch': 1, 'levinspiel': 1, 'spearmint': 1, 'sauna': 2, 'masseur': 1, 'popper': 1, 'unexpress': 1, 'douchet': 2, 'carlottai': 1, 'ou': 1, 'marshmallow': 2, 'pahalniuk': 1, 'gell': 5, 'semra': 4, 'turan': 4, 'arthi': 1, 'gao': 2, 'carribien': 1, 'cheezoid': 1, 'riget': 13, 'leona': 8, 'ozaki': 1, 'brenten': 1, 'spec': 4, 'bifoc': 1, 'fune': 2, 'enviou': 6, 'ddr': 1, 'policeschool': 1, 'copernicu': 1, 'galileo': 1, 'incontrovert': 1, 'istead': 2, 'freshner': 1, 'niellson': 1, 'miasma': 2, 'revealingli': 1, 'antonellina': 1, 'interlenghi': 1, 'sartana': 3, 'grandkid': 2, 'dunston': 2, 'benchley': 1, 'amphibi': 1, 'bem': 1, 'vanderpark': 1, 'christop': 2, 'tuxi': 1, 'dedalu': 2, '1904': 1, 'bloomsday': 1, 'gunter': 1, 'volker': 1, 'schl': 1, 'ndorff': 1, 'invinoveritas1': 1, 'aol': 2, 'wyle': 2, 'schroder': 3, 'axiom': 2, 'elmann': 3, 'chematod': 2, 'ellman': 1, '1ton': 1, 'anothw': 1, 'takin': 2, 'yamasato': 3, 'paraguay': 5, 'stroessner': 1, 'unelect': 2, 'mazurszki': 1, 'stocking': 1, 'evita': 3, 'supremo': 2, 'rsther': 1, 'syllab': 1, 'untutor': 1, 'mutir': 1, 'undisturb': 2, 'gibbon': 5, 'shalub': 2, 'gonad': 1, 'gelb': 2, 'suriyothai': 1, 'lek': 1, 'kitaparaporn': 1, '1547': 1, 'bloc': 1, 'ayutthaya': 2, 'burbridg': 2, 'siames': 6, 'hetrakul': 1, 'sudachan': 1, 'yoe': 1, 'hassadeevichit': 1, 'chakkraphat': 1, 'pupart': 1, 'kidulthood': 2, 'cyclorama': 1, 'cyc': 1, 'abner': 1, 'couors': 1, 'nonflamm': 1, 'packard': 5, 'buzbi': 1, 'superabund': 1, 'shlocki': 2, 'paycock': 1, 'crossey': 2, 'comptent': 1, 'koslack': 2, 'embri': 1, 'aaghh': 1, 'charictor': 1, 'mcreedi': 1, 'tryman': 1, 'johnasson': 1, 'yoga': 7, 'barbado': 1, 'fluffier': 1, 'hitter': 3, 'resitu': 1, 'marra': 2, 'radam': 2, 'jastrow': 2, 'tudsburi': 1, 'wouk': 2, 'berel': 1, 'petroniu': 3, 'ursu': 1, 'determinedli': 2, 'buffet': 6, 'mosaic': 5, 'nowt': 1, 'malfeas': 1, 'diaspora': 3, 'dellenbach': 1, 'bluebeard': 2, 'jailbird': 4, 'galapago': 2, 'objectifi': 4, 'talkov': 1, 'bergeron': 1, 'timbuktu': 1, 'underappreci': 8, 'rfk': 1, 'mlk': 5, 'sirhan': 2, 'bremer': 5, 'hinkley': 3, 'mcveigh': 1, 'bulwark': 2, 'shockmovi': 1, 'congruous': 1, 'woolli': 3, 'multilevel': 1, 'faggoti': 1, 'grossout': 1, 'inextric': 3, 'electrolysi': 1, 'indigin': 1, 'hered': 1, 'tupinamba': 2, 'portugeus': 1, 'appos': 2, 'ripen': 3, '365': 1, 'tupi': 2, 'nightfir': 3, 'bronsan': 1, 'suppressor': 2, 'qua': 2, 'lundren': 1, 'dolphi': 1, 'ruthlessreview': 1, 'unlicens': 1, 'novocain': 3, 'oldfriend': 1, 'superfight': 1, 'hatchway': 1, 'pellew': 1, 'ortega': 1, 'brig': 1, 'tyranosaur': 1, 'cusak': 15, 'theat': 1, 'blobbi': 2, 'gonsalv': 1, 'roshan': 11, 'abortionist': 3, 'genreor2': 1, 'fricken': 4, 'hangar': 2, 'yap': 4, 'tare': 1, 'bocka': 1, 'pakag': 1, 'bighouseaz': 1, 'unmoor': 2, 'decomp': 1, 'ub': 1, 'michaelangelo': 1, 'bitchdom': 1, 'lackadais': 6, 'kiba': 3, 'kamisori': 1, 'hanz': 2, 'jigoku': 1, 'zeme': 1, 'oni': 1, 'yawahada': 1, 'koban': 1, 'ittami': 1, 'filmdirector': 1, 'interrest': 1, 'vitti': 4, 'arron': 1, 'kristina': 3, 'sanborn': 1, 'zenderland': 1, 'piscapo': 1, 'eubank': 1, 'louda': 1, 'meridian': 3, 'moviethi': 1, 'inspit': 5, 'diment': 2, 'verheyen': 4, 'vtm': 1, 'garlic': 6, 'jor': 2, 'zam': 1, 'whap': 1, 'gratingli': 4, 'luscious': 2, 'motiveless': 4, 'embank': 1, 'arg': 2, 'driest': 1, 'ungoriest': 1, 'goofiest': 3, 'iguana': 4, 'carto': 1, '151': 1, 'demerit': 2, 'arlon': 1, 'oafish': 1, 'healey': 6, 'alldredg': 2, 'lisl': 1, 'janu': 3, 'seriuosli': 1, 'squinti': 2, 'higr': 1, 'xvid': 1, 'codec': 1, 'hardlin': 1, 'flimsili': 2, 'golani': 2, 'golan': 6, 'faghag': 1, 'nablu': 10, 'saleem': 1, 'shalom': 2, 'quaalud': 2, 'bremner': 3, 'besh': 1, 'flatman': 1, 'kensington': 3, 'austion': 1, 'workjason': 1, 'tackier': 2, 'steretyp': 1, 'zombif': 7, 'eyesif': 1, 'krisak': 3, 'impalp': 1, 'dink': 1, 'monogam': 1, 'commensur': 1, 'sorrano': 1, 'panacea': 3, 'surreptiti': 2, 'apodict': 1, 'cravat': 1, 'ungratifi': 1, 'fuqua': 17, 'sunjata': 1, 'feroc': 4, 'bottomlin': 4, 'underprivilegd': 1, 'delattr': 1, 'aetv': 1, 'jhtml': 1, '75054': 1, 'arvo': 1, 'nightstick': 1, 'mstifi': 2, 'streamwood': 1, 'bucsemi': 1, 'absolutey': 1, 'vitro': 1, 'aphrodesiac': 1, 'intrest': 3, 'restaraunt': 3, 'hennesi': 1, 'silouhett': 1, 'sinnist': 1, 'rancor': 3, 'sarlaac': 2, 'frommag': 1, 'psychoanalyz': 3, 'alpahabet': 1, 'downhom': 1, 'farmland': 2, 'hof': 1, 'kennyhotz': 1, 'shinnick': 1, 'triangul': 2, 'refocus': 1, 'slezak': 2, 'unstudi': 2, 'gitan': 2, 'augustin': 3, 'rekay': 1, 'alternativa': 1, 'afortun': 1, 'valga': 1, 'satiris': 4, 'buckheim': 1, 'freemason': 4, 'shopkeep': 5, 'uchovski': 1, 'yehuda': 1, 'dualism': 1, 'yelli': 6, 'boor': 2, 'zohar': 3, 'liba': 2, 'virtzer': 4, 'lior': 3, 'ashkenazi': 3, 'loughlin': 2, 'kinkl': 1, 'colonist': 5, 'chikli': 3, 'weaselli': 1, 'harbou': 3, 'rudig': 2, 'hunland': 1, 'hildebrand': 4, 'brynhild': 1, 'bertinelli': 3, 'uncrowd': 1, 'greeter': 1, 'millisecond': 2, 'cavanaugh': 5, 'lgbt': 1, 'kilairn': 1, 'babifi': 1, 'takahisa': 1, 'zeze': 1, 'orenji': 1, 'taiyou': 1, 'hideaki': 3, 'anno': 3, 'fanfavorit': 1, 'gunbust': 15, 'honneamis': 1, 'otakon': 1, 'okinawa': 2, 'mechapilot': 1, 'kazumi': 4, 'okada': 14, 'betraysom': 1, 'fanservic': 1, 'greenquist': 3, 'scrubber': 2, 'costigan': 1, 'finneran': 1, 'dunbar': 2, 'dodson': 2, 'galaxina': 1, 'absolutli': 5, 'klien': 2, 'kevlar': 1, 'baaaaaaaaaad': 1, 'mooin': 1, 'undramat': 4, 'knb': 3, 'stillbirth': 1, 'nontheless': 1, 'stuntwoman': 1, 'sheperd': 5, 'dissappear': 1, 'ametu': 1, 'arritu': 1, 'fasso': 1, 'fot': 2, 'semetari': 4, 'cratchitt': 1, 'extremeley': 1, '1and': 1, 'of5': 1, 'gourgou': 1, 'malth': 5, 'dreufuss': 1, 'unact': 1, 'undirect': 1, 'unproduc': 3, 'adma': 1, 'beauticin': 1, 'yasutak': 1, 'ondi': 6, 'nonproport': 1, 'commodifi': 2, 'seashor': 1, 'musson': 2, 'subpoena': 1, 'featherbrain': 1, '165': 1, 'shuriken': 2, 'monorail': 3, 'fintasi': 1, 'multicolor': 3, 'valvolin': 1, 'surrond': 1, 'cossey': 1, 'screenwrtier': 1, 'roebuck': 5, 'axton': 3, 'megaphon': 1, 'biohazard': 4, 'cutscen': 2, 'splatteri': 3, 'shoddili': 6, 'pacey': 3, 'durian': 1, 'bendingli': 1, 'congenit': 2, 'palillo': 2, 'frogbal': 1, 'muscel': 1, 'unlog': 1, 'yould': 1, 'asskick': 1, 'sixpack': 1, 'ignacio': 1, 'shalhoub': 7, 'misha': 7, 'loquaci': 2, 'sonata': 1, 'fermat': 4, 'fibreglass': 1, 'titlesto': 1, 'massanoth': 1, 'clockstopp': 1, 'flyyn': 1, 'wouldv': 1, 'benedick': 1, 'shawnham': 1, 'snidley': 1, 'papp': 1, 'tweener': 1, '1a': 1, 'followseri': 1, '2after': 1, 'wurli': 1, '974th': 1, 'mailroom': 1, 'turismo': 1, 'spoilersther': 2, 'circumnavig': 2, 'cho': 5, 'chocula': 2, 'domicil': 1, 'gower': 1, 'gargl': 1, 'pelleti': 6, 'bilodeau': 2, 'gagnon': 3, 'fabuleux': 1, 'sanhedrin': 1, 'freeeeee': 1, 'coooofffffffiiiiinnnnn': 1, 'yaaa': 1, 'aaawwwwnnn': 1, 'dalen': 2, 'nirgendwo': 1, 'afrika': 2, 'lavatori': 3, 'stuttur': 1, 'whithnail': 1, 'starck': 5, 'foggiest': 1, 'numa': 1, 'sadoul': 2, 'rightist': 1, 'hansom': 2, 'rinna': 3, 'spoilerit': 1, 'caradin': 1, 'bandara': 1, 'transist': 1, 'franciscan': 1, 'dingal': 1, 'theiev': 1, 'corundum': 1, 'revolutionist': 2, 'moray': 3, 'undeliver': 2, 'underflow': 2, 'destabilis': 2, '336th': 1, 'shiksa': 2, 'allahabad': 1, 'ooe': 1, 'amma': 2, 'blockbut': 1, 'traviata': 1, 'sophistri': 2, 'yussef': 1, 'teror': 1, 'viennal': 1, 'unmysti': 1, 'purchass': 1, 'calibur': 1, 'amati': 5, 'zionist': 4, 'jewri': 1, 'internationalist': 1, 'bor': 1, 'mp5': 1, 'martineau': 1, 'okul': 1, 'bbe': 1, 'yesilcam': 1, 'probationari': 1, 'benetako': 2, '175': 1, 'gutwrench': 1, 'diwani': 4, 'alok': 13, 'hosanna': 2, 'newspeopl': 1, 'newswoman': 1, 'usel': 1, 'widdl': 1, 'samaurai': 1, 'rainman': 6, 'wallmart': 2, 'preplan': 1, 'vilest': 3, 'cooz': 2, 'gek': 2, 'shagger': 1, 'unhook': 1, 'flubber': 2, 'meghan': 1, 'heffern': 1, 'petronijev': 2, 'nac': 1, 'barger': 2, 'margi': 1, 'italia': 2, 'moshana': 1, 'halbert': 1, 'andreja': 1, 'punkri': 1, 'prentic': 1, 'vculek': 2, 'reel13': 1, 'feardotcom': 1, '2s': 2, 'morimoto': 1, 'yuki': 3, 'yui': 1, 'nishiyama': 1, '25th': 9, 'nausic': 1, 'meitantei': 1, 'myiazaki': 1, 'ooooohhhh': 2, 'penc': 3, 'allmighti': 1, 'rowel': 3, 'mmb': 1, 'marthesheim': 1, 'warmong': 1, 'boatcrash': 1, 'itti': 2, 'bitti': 6, 'scenemi': 1, '2040': 1, 'peari': 2, 'furious': 4, 'blowout': 2, 'ramonesmobil': 1, 'monoth': 1, 'greyston': 3, 'laci': 4, 'apanowicz': 2, 'grrrl': 1, 'nad': 2, 'gamin': 6, 'chavali': 1, 'baurel': 1, 'boulevardi': 1, 'debrale': 2, 'thomp': 1, 'guptil': 1, 'cinemalaya': 1, 'filmfest': 2, 'cuarn': 1, 'azkaban': 3, 'stdvd': 2, 'degen': 2, 'waaaaaaaay': 1, 'secor': 3, 'courttv': 1, 'endgam': 7, 'totalitar': 1, 'atalant': 2, 'becc': 2, 'machat': 2, 'quantit': 1, 'qualit': 4, 'gazillion': 1, 'lemm': 2, 'nukkin': 1, 'chegwin': 1, 'wyld': 2, 'tomanovich': 4, 'hardin': 2, 'tonto': 1, 'mourner': 3, 'gwtw': 1, 'sabina': 8, 'photoshoot': 3, '125': 3, 'imovi': 1, 'abydo': 4, 'chulak': 1, 'homeworld': 2, 'ska': 3, 'tok': 2, 'vala': 3, 'maldoran': 1, 'galleghar': 2, 'lestat': 3, 'booki': 3, 'trapp': 2, 'gaspi': 1, 'skinflint': 1, 'facelift': 1, 'graber': 1, 'daley': 2, 'labratori': 1, 'granit': 2, 'mackerel': 2, 'yaaawwnnn': 1, 'scrapyard': 2, 'cavaleri': 1, 'xxe': 1, 'lolo': 1, 'jokevijay': 1, 'ordinaryperform': 1, 'registri': 2, 'spreader': 1, 'mckidd': 5, 'pharmaceut': 2, 'exc': 2, 'mgr': 2, 'wienstein': 1, 'bacteri': 1, 'inhumanli': 1, 'servil': 1, 'kiesser': 1, 'willcock': 1, 'branson': 2, 'weixler': 3, 'loutish': 5, 'misguis': 1, 'versifi': 1, 'greeeeeat': 1, 'osiri': 3, 'shoat': 1, 'moat': 2, 'zardin': 1, 'borlenghi': 10, 'cecili': 3, 'bloodsurf': 3, 'lofranco': 1, 'vertido': 2, 'cay': 2, 'lemmya': 2, 'larrazab': 3, 'revolutionairi': 1, 'regehr': 3, 'reif': 3, 'crasser': 1, 'cloven': 1, 'uncomfirm': 1, 'tumult': 2, 'shorthand': 8, 'unblink': 1, 'fatherhood': 4, 'livabl': 3, 'nonprofession': 1, 'doofus': 1, 'ihav': 1, 'sahan': 5, 'gokbakar': 6, 'togan': 5, 'timesif': 1, 'revoltingli': 1, 'fichtner': 1, 'crisper': 3, '3462': 1, 'inca': 7, 'khoi': 2, 'gruber': 1, 'nastasja': 1, '0f': 1, 'adm': 1, 'lanna': 1, 'atan': 2, 'inom': 2, 'kak': 2, 'rabun': 2, 'amani': 1, 'aleya': 1, 'adibah': 1, 'noor': 1, 'mukshin': 1, 'kampung': 2, 'masak': 2, 'digisoft': 3, 'sunway': 5, 'unprofit': 1, 'soberli': 3, 'suway': 1, 'warmingli': 1, 'unpredicat': 1, 'ceaser': 1, 'unwild': 1, 'forgeri': 3, 'giegud': 1, 'aborigon': 1, 'aborigini': 1, 'tesc': 2, 'chiefstrang': 1, 'criminologist': 1, 'pravda': 1, 'opossum': 1, 'uteru': 2, 'lacey': 9, 'vaster': 1, 'cosmolog': 1, 'injunct': 1, 'porcin': 1, 'proletariat': 2, 'glengarri': 4, 'lwt': 1, 'bouquet': 5, 'euthanasiarist': 1, 'torv': 2, 'lesbonk': 1, 'winterson': 1, 'tellingli': 5, 'turnip': 2, 'undercloth': 2, 'bonk': 2, 'asidelightli': 1, 'mahkmalbaf': 1, 'wrrrooonnnnggg': 1, 'diddley': 1, 'biloxi': 1, 'factotum': 1, 'djin': 1, 'cortland': 1, 'uncharm': 1, 'priya': 21, 'madhu': 1, 'swiztertland': 1, 'charton': 1, 'borneo': 2, 'centralis': 1, 'adoringli': 4, 'meltingli': 1, 'bowti': 1, 'wantonli': 2, 'payday': 2, 'fearthi': 1, 'carryout': 1, 'kemper': 1, 'orific': 3, 'unproblemat': 1, 'movieworld': 1, 'fruitlessli': 1, 'finicki': 3, 'sheiner': 3, 'sawahla': 1, 'assured': 3, 'blabbermouth': 1, 'krushgroov': 1, 'ramo': 3, 'eggbeat': 1, 'leakag': 1, 'oracular': 1, 'toulon': 3, 'galley': 2, 'myriel': 1, 'bamataboi': 1, 'tholomy': 1, 'champmathieu': 1, '1832': 1, 'musain': 1, 'frederich': 1, 'lovehatedreamslifeworkplayfriend': 1, 'bode': 8, 'harni': 1, 'saleabl': 1, 'condoleezza': 1, 'deez': 1, 'cholesterol': 1, 'dond': 1, 'shat': 4, 'lysett': 2, 'tera': 2, 'jadoo': 1, 'chal': 2, 'gaya': 2, '2pac': 7, 'dre': 3, 'nisep': 1, 'groundswel': 3, 'undervalu': 8, '4ever': 6, 'boobilici': 1, 'gratitu': 1, 'flamengo': 1, 'cowi': 1, 'mastrantonio': 6, 'bdsm': 3, 'immoder': 1, 'cmon': 2, 'eick': 2, 'toreson': 2, 'gallactica': 4, 'overcrowd': 5, 'guag': 1, 'ceta': 1, 'handlebar': 1, 'warburton': 10, 'megyn': 3, 'kajlich': 2, 'doran': 3, 'phildelphia': 1, 'hiral': 8, 'hirarala': 1, 'hirarl': 2, 'gulab': 1, 'striken': 1, 'roderigo': 1, 'derring': 3, 'forebear': 2, 'vivienn': 2, 'alyssa': 1, 'milano': 4, 'taj': 8, 'kareesha': 1, 'boda': 1, 'sangr': 3, 'brujo': 2, 'comiqu': 1, '1875': 1, 'kiernan': 2, 'datelin': 1, 'thanx': 2, 'rowboat': 1, 'cranberri': 2, 'lecki': 1, 'stereophon': 2, 'emplac': 1, 'ridgeley': 1, 'maltz': 1, 'oversimpli': 1, 'okish': 1, 'schwartz': 6, 'uncontamin': 1, '10molli': 1, 'celaschi': 1, 'horroryearbook': 2, 'democid': 1, 'pleb': 2, 'pompom': 1, 'merab': 1, 'mamardashvili': 1, 'klever': 4, 'maclhuen': 1, 'washer': 3, 'insolubl': 1, 'frenhoff': 1, 'mfn': 2, 'billingham': 1, 'swerv': 4, 'htv': 1, 'norseman': 1, 'reluctantpopstar': 1, 'equit': 1, 'treeless': 2, 'blainsworth': 2, 'cryptkeep': 2, 'idiotern': 2, 'giraff': 3, 'splatterfest': 3, 'henenlott': 1, 'harker': 6, 'watchword': 1, 'beatliest': 1, 'eberhard': 1, 'thurl': 2, 'ruban': 1, 'kookoo': 3, 'raposo': 3, 'unico': 1, 'frenchfilm': 1, 'batboy': 1, 'lilja': 2, 'anjo': 3, 'editorialis': 1, 'qld': 1, 'overington': 2, 'catcal': 1, 'audiencememb': 1, 'putat': 1, '35yr': 2, 'bicep': 1, 'rueful': 1, 'corroborr': 1, 'slickster': 1, 'amman': 2, 'walkley': 1, 'trantula': 1, 'oooooozzzzzz': 1, 'siev': 2, 'miaow': 1, 'redlitch': 3, 'taradash': 2, 'diag': 1, 'barzel': 1, 'mcnear': 1, 'gillia': 1, 'hypermacho': 1, 'cowpok': 2, 'aldridg': 1, 'tumnu': 2, 'gryphon': 1, 'unrol': 2, '87minut': 1, 'enshroud': 4, 'bejeep': 1, 'winnipeg': 3, 'danz': 1, 'margher': 13, 'corbucci': 4, 'rivier': 3, 'dominici': 1, 'carmu': 2, 'robsahm': 2, 'rheubottom': 1, 'flimsier': 2, 'admirerof': 1, 'foralt': 1, 'isnot': 1, 'altersth': 1, 'harrar': 2, 'demeansth': 1, 'harra': 1, 'schang': 1, 'exceptfor': 1, 'thepotala': 1, 'amovi': 2, 'theoric': 1, 'deklerk': 3, 'afrikan': 2, 'afrikanerdom': 1, 'sabc': 1, 'villifi': 1, 'mordr': 2, 'kimbo': 1, 'carano': 2, 'jaa': 3, 'taviani': 1, 'treck': 3, 'lolrent': 1, 'sinbad': 2, 'vandross': 2, 'lieh': 3, 'sunbeam': 1, 'suspiciouli': 1, 'outpac': 1, 'fluf': 1, 'darklight': 2, 'bodaci': 3, 'rooshu': 1, 'exoskeleton': 2, 'mimet': 1, 'poli': 3, 'biff': 5, 'gryll': 1, 'dopplebang': 1, 'spheerhead': 1, 'jingoism': 2, 'fahklempt': 1, 'spca': 1, 'azoid': 1, 'ciff': 1, 'airbag': 2, 'bersen': 2, 'sorenson': 2, 'lifestori': 1, 'dysphoria': 1, 'yancey': 1, 'hobbitt': 1, 'mg': 1, 'pv': 1, 'arend': 1, 'pseudocomedi': 1, 'gattaca': 1, 'elleri': 1, 'moonston': 1, 'runyonesqu': 1, 'magellan33': 1, 'allov': 1, 'krauss': 2, 'muffat': 5, 'hessl': 4, 'vampish': 4, 'harlot': 1, 'vandeuvr': 2, 'filmschool': 2, 'gratuitu': 1, 'gpm': 1, 'ngel': 1, 'rold': 1, 'aurora': 8, 'barranco': 2, 'amalio': 2, 'lvaro': 1, 'lucina': 1, 'mcgill': 2, 'maruja': 2, 'sard': 2, 'galicia': 1, 'gonzalo': 3, 'berridi': 1, 'bingen': 1, 'mendiz': 1, 'abkani': 2, '713': 5, 'hudgen': 2, 'cedrac': 1, 'cmdr': 2, 'despertar': 1, 'patma': 1, 'shorelin': 1, 'bullwhip': 5, 'correggio': 1, 'sloooowli': 1, 'weta': 1, 'henriksen': 9, 'lakhan': 3, 'viay': 1, 'jarhead': 2, 'dannielynn': 2, 'cdg': 1, 'pfc': 1, 'sudburi': 1, 'cinefest': 1, 'vfcc': 1, 'tt0962736': 1, 'wackyland': 1, 'aldrich': 2, 'santuario': 1, 'chimay': 1, 'vato': 1, 'loco': 2, 'burmes': 1, 'blatti': 1, 'smorgasbord': 2, 'ellend': 1, '24year': 1, 'susanna': 6, '225min': 1, '330min': 1, 'aardvark': 1, 'visnjic': 1, 'tudyk': 1, 'diedrich': 1, 'krakowski': 1, 'bagley': 1, 'pdi': 1, 'jabez': 5, 'cytown': 2, 'byniarski': 1, 'sevillana': 1, 'alb': 3, 'niz': 3, 'repossess': 4, 'echt': 2, 'andalusia': 1, 'hispano': 1, 'andorra': 1, 'gibraltar': 1, 'torero': 1, 'unaccompani': 1, 'archipelago': 2, 'schiffer': 1, 'mccloud': 3, 'tabori': 2, 'deyniac': 1, 'sabotur': 2, 'rukjan': 1, 'pruderi': 1, 'vicient': 3, 'baku': 1, 'bowfing': 1, 'recordfirst': 1, 'cksecondli': 1, 'suffocatingli': 2, 'moreinterest': 1, 'eeeewwww': 1, 'joani': 5, 'shriver': 3, 'swampland': 2, 'cannibalis': 1, 'nincompoop': 1, 'noughti': 2, 'ntsb': 2, '737': 1, 'quada': 1, 'recommand': 2, 'auteurist': 1, 'craftsmen': 5, 'fw': 1, 'denunci': 3, 'mikhail': 4, 'evstigneev': 1, 'tolokonnikov': 1, 'unrestor': 1, 'untransl': 1, 'manki': 1, 'tadger': 1, 'scandanavian': 3, 'crapdom': 1, 'flapper': 4, 'stenograph': 1, 'kombat': 4, 'sifu': 1, 'kwok': 3, '23rd': 4, 'hardgor': 3, 'whelk': 1, 'finit': 3, 'miiki': 1, 'hefner': 4, 'jangl': 3, 'nightshift': 1, 'zuni': 2, '10umney': 1, 'umney': 3, 'chandleresqu': 1, 'miserabley': 1, 'paulsen': 5, 'roebson': 1, 'boop': 13, 'bittorr': 1, 'woodpeck': 2, 'enviorment': 1, 'litig': 2, 'heroist': 1, 'sweetish': 1, 'sro': 1, 'penanc': 6, 'beautifi': 2, 'beij': 2, 'dispirited': 1, 'gainsborough': 1, 'masterif': 1, 'decrescendo': 1, 'bleibtreau': 1, 'ufortun': 1, 'lahay': 2, 'milleni': 2, 'eschatalog': 1, 'kyoko': 2, 'berber': 1, 'completetli': 1, 'repudie': 1, 'minnieapoli': 1, 'leighton': 1, 'scheduleservlet': 1, '598947': 1, 'baad': 1, '2h': 1, 'kuran': 1, 'vicenzo': 2, 'unrurli': 1, 'fantasyland': 3, '188': 1, 'coffeehous': 3, 'ishli': 1, 'edifi': 2, 'jazzman': 1, 'underlay': 1, 'doughti': 4, 'cker': 1, '15minut': 1, '25min': 1, 'intermedi': 1, 'cashback': 2, 'dhupia': 2, 'ritika': 2, 'unbeknowst': 1, 'kirron': 1, 'irena': 2, 'curi': 4, 'charlo': 1, 'franck': 2, 'magnier': 2, 'tyold': 1, 'ooohhh': 1, 'woooooo': 1, 'missu': 5, 'potneti': 1, 'haev': 1, 'defalt': 1, 'keung': 1, 'homolka': 1, 'bernardo': 1, 'rodriquez': 1, 'disneyworld': 2, 'flye': 1, 'animast': 1, 'peewe': 1, 'lout': 5, 'ooooooh': 1, 'popeil': 2, 'mcchesney': 4, 'microfich': 4, 'pounc': 5, 'mooommmm': 1, 'misdemean': 1, 'lasorda': 1, 'diabo': 3, 'saiba': 1, 'voc': 1, 'morto': 1, 'quintana': 5, 'unladylik': 1, 'avuncular': 4, 'bombsight': 1, 'lemay': 3, 'nuter': 1, 'roofthooft': 1, 'voogdt': 2, 'puffinstuff': 3, 'blinki': 1, 'lidsvil': 1, 'kroft': 1, 'baer': 2, 'ste': 2, 'framingham': 1, 'miyagi': 3, 'nausem': 1, 'erendira': 13, 'arrestingli': 1, 'por': 3, 'ejemplo': 1, 'mundo': 1, 'pensaba': 1, 'dm': 3, 'mediorcr': 1, 'boink': 3, 'destabil': 1, 'hotli': 4, 'oiran': 3, 'yoshiwara': 1, 'tinder': 1, '16x9': 1, 'hellll': 1, 'borrringg': 1, 'dragoncon': 1, 'kasadya': 2, 'spinnak': 1, 'sommeil': 2, 'atric': 2, 'goir': 3, 'lithuanian': 1, 'subor': 7, 'forelock': 1, 'bedsheet': 3, 'sscrack': 1, 'hollywoodian': 3, 'supremati': 2, 'defelitta': 2, 'gillham': 1, 'argila': 1, 'destri': 4, 'subtlti': 1, 'chive': 1, 'omelett': 3, 'guiana': 1, 'crinkl': 2, 'halleck': 8, 'jenney': 2, 'yeasti': 1, 'sagac': 1, 'ginelli': 1, 'taduz': 1, 'lemk': 1, 'fillet': 3, 'cannom': 1, 'gooledyspook': 1, 'supplic': 3, 'hedgrow': 1, 'outland': 2, 'felch': 1, 'generalissimo': 1, 'closup': 1, 'ornithochiru': 1, 'anticlimat': 1, 'palazzo': 1, 'volpi': 1, 'idolatri': 2, 'chesley': 1, 'bonestel': 1, 'moti': 4, 'meador': 1, 'leaven': 4, '57d': 1, 'bellerophon': 3, 'miniskirt': 2, 'calibanian': 1, 'dalian': 1, 'krel': 1, 'ellips': 2, 'skinnydip': 1, 'calito': 1, 'pachanga': 3, 'salk': 1, 'sao': 4, 'siemen': 2, 'swabbi': 2, 'pew': 5, 'parapyschologist': 1, 'winey': 1, 'sion': 4, 'polynesian': 7, 'palagi': 1, 'sefa': 1, 'anglophob': 1, 'eleonora': 2, 'dooohhh': 1, 'bwainn': 1, 'hurrrt': 1, 'yaarrrghhh': 1, 'yaargh': 1, 'danyael': 1, 'danayel': 1, 'dirtbal': 1, 'rohrschach': 1, 'fufu': 1, 'burma': 3, 'donitz': 1, 'mauldin': 1, 'alger': 2, 'toshikazu': 1, 'kase': 1, 'tibbet': 1, 'ambros': 3, 'adjut': 1, 'andlaurel': 1, 'rosiland': 1, 'bnl': 4, 'creegan': 1, 'afgahnistan': 1, 'koffe': 1, 'anan': 1, 'godawful': 2, 'effeil': 1, 'grateful': 1, 'znaimer': 1, 'colubian': 1, 'equidor': 1, 'inst': 1, 'untast': 1, 'cude': 1, 'wraparound': 5, 'papaya': 2, 'nang': 3, 'uncommun': 2, 'unfaz': 1, 'infantrymen': 1, 'mekum': 4, 'incentiv': 1, 'hault': 1, 'hrt': 1, '2006parsif': 1, 'meistersing': 1, 'libretto': 4, 'unconvert': 1, 'engelbert': 1, 'amforta': 6, 'krick': 2, 'gurnemanz': 6, 'kna': 1, 'wagnerit': 1, 'futureworld': 1, 'piccirillo': 1, 'roadshow': 4, 'braggart': 1, 'plaqu': 2, 'plankton': 1, 'alga': 2, 'kho': 1, 'chaliya': 3, 'woot': 2, 'batarang': 1, 'batbot': 1, 'cryofreez': 1, 'millenia': 2, 'iomagin': 1, 'transtorn': 1, 'catholiqu': 2, 'stil': 2, 'consacr': 1, 'froqu': 1, 'buch': 1, 'xdbut': 1, 'torkl': 1, 'pembrook': 1, 'feeney': 1, 'farmwork': 1, 'kohala': 1, 'ccthemovieman': 1, 'youki': 1, 'kudoh': 2, 'kayo': 2, 'gaijin': 2, 'tane': 1, 'toplessmi': 1, 'mireil': 1, 'perrier': 1, 'cluzet': 2, 'manserv': 6, 'isaach': 2, 'bankol': 3, 'boschi': 2, 'ducass': 2, 'ziabar': 1, 'scrye': 3, 'oneiro': 1, 'anyplac': 2, 'leaver': 1, 'seamstress': 4, 'oilmen': 1, 'mainlin': 3, 'approxi': 1, 'ampa': 2, 'mufasa': 1, 'crandal': 6, 'godlik': 2, 'unsubtleti': 1, 'dumper': 1, 'spikey': 1, 'inexpertli': 1, 'fermi': 1, 'physit': 1, 'wung': 1, 'shara': 1, 'unparrallel': 1, 'jutland': 1, 'awww': 2, 'swartzenegg': 1, '10anoth': 1, 'theres': 5, 'hydroplan': 2, 'muncey': 1, 'cantrel': 1, 'abreast': 2, 'evilli': 3, 'safeco': 1, 'resnikoff': 1, 'bamba': 1, 'argenziano': 1, 'marich': 2, 'fiscal': 2, 'manifestli': 2, 'punkett': 1, 'zebbedi': 1, 'bolla': 1, 'roughi': 1, 'undat': 1, 'kassovitz': 4, 'whereev': 1, '9999': 1, 'zebraman': 2, 'straithrain': 1, 'smidgeon': 2, 'archeri': 4, 'trought': 1, 'polley': 1, 'mephisto': 1, 'fateless': 1, 'rarifi': 2, 'bacula': 1, 'boleslowski': 1, 'enfilden': 1, 'batouch': 1, 'hidegarish': 1, 'ventricl': 1, 'hamliton': 1, 'austeniana': 1, 'teazl': 1, 'merriest': 1, 'carrollian': 1, 'credentialdo': 1, 'dimestor': 1, 'seminara': 1, 'transmitt': 2, 'lampost': 1, 'fredrich': 1, 'strass': 1, 'toland': 1, 'gib': 1, 'schechter': 1, 'setton': 4, 'turnoff': 1, 'headbang': 2, 'realat': 1, 'memo': 3, 'channi': 1, 'dawnfal': 1, 'tt0363163': 1, 'johann': 5, 'slosh': 3, 'byway': 1, 'lattic': 1, 'girder': 2, 'crossbeam': 1, 'wharf': 3, 'gridiron': 2, 'squadroom': 1, 'sinew': 1, 'snooper': 3, 'symbolis': 4, 'inveigh': 2, 'gangway': 2, 'stevedor': 1, 'enyard': 1, 'mulch': 2, 'meaney': 3, 'garda': 3, 'dirtbag': 2, 'dierdr': 1, 'shootem': 1, 'salish': 1, 'kenesaw': 1, 'tope': 2, 'fluffe': 1, 'frisk': 1, 'rayburn': 2, '146': 4, 'manzano': 1, 'chama': 1, 'babson': 1, 'shapiro': 18, 'geritol': 1, 'tunnelvis': 3, 'rubin': 13, 'msg': 1, 'slr': 2, '100x': 2, '1p': 1, 'mahmoud': 2, 'juliano': 2, 'mer': 3, 'peregrin': 1, 'dithyramb': 1, 'guitri': 1, 'uecker': 1, 'mdma': 1, 'oxycontin': 2, 'schwarz': 3, 'buzzer': 6, 'pointlessth': 1, 'hrgd002': 1, 'vfc': 1, '19796': 1, 'ifpi': 1, 'pensylvannia': 1, 'marishcka': 1, 'wuxia': 5, 'wkw': 1, '2046': 1, '820': 1, 'oppinion': 1, 'obvliou': 1, 'findlay': 1, 'sexagenarian': 1, 'craigievar': 1, 'loonat': 4, 'roadrunn': 4, 'acmetropoli': 1, '2772': 2, 'frell': 1, 'sextet': 2, 'henchpeopl': 1, 'henchth': 1, 'drekish': 1, 'salaryman': 3, 'masauki': 1, 'theactor': 1, 'yakusyo': 1, 'companymanwho': 1, 'hislong': 1, 'tolesson': 1, 'traditionaljapanes': 1, 'brokeinto': 1, 'provesthat': 1, 'takenaka': 3, 'naoto': 2, 'eriko': 1, 'thepeopl': 1, 'otherjapanes': 1, 'tayor': 1, 'claydon': 1, 'goto': 5, 'eeriest': 1, 'f13': 2, 'castinga': 1, 'strauli': 1, 'camila': 2, 'jaynett': 1, 'ondin': 1, 'warholit': 1, 'vooren': 1, 'kemek': 1, 'maybellin': 1, 'cascad': 2, 'doot': 4, 'dodedo': 2, 'vaio': 1, 'melodramath': 1, 'rajiv': 1, 'villainth': 1, 'kenya': 4, 'happensthey': 1, 'sharatth': 1, 'prolongedrajiv': 1, 'toofan': 1, 'goodsunni': 1, 'naseer': 1, 'tridev': 2, 'swith': 2, 'helmit': 1, 'shoudl': 1, 'waterson': 1, 'tyrannosauru': 13, 'parasarolophu': 1, 'ooo': 1, 'triceratop': 1, 'erick': 1, 'kulik': 2, 'frontlin': 4, 'sidari': 5, 'ksxi': 2, 'undoubtli': 1, 'woop': 1, 'bloomingdal': 1, 'mocha': 1, 'gordi': 4, 'peen': 1, 'tele': 5, 'sevala': 1, 'calcium': 2, 'scull': 1, 'atm': 2, 'desktop': 3, 'startrek': 1, 'capitan': 1, 'dicov': 1, 'gunboat': 2, 'reconfirm': 1, 'pantheism': 1, 'christianti': 1, 'syncret': 1, 'endpiec': 1, 'jointli': 1, 'rageddi': 1, 'ascript': 1, 'hourslong': 1, 'tomwlaschiha': 1, 'canwith': 1, 'butcharact': 1, 'isnon': 1, 'toput': 1, 'unfortunatechoic': 1, 'anyoneactu': 1, 'biggen': 1, 'mammet': 1, 'seiryuu': 1, 'akan': 7, 'velveti': 4, 'fretwel': 2, 'meatier': 1, 'trice': 1, 'niev': 1, 'kathli': 1, 'borcher': 1, 'torin': 1, 'digi': 5, 'attende': 3, 'hereon': 1, 'necropoli': 2, 'masiela': 3, 'lusha': 3, 'albania': 2, 'beko': 1, 'alleyway': 6, 'feistiest': 1, 'zinnemann': 1, 'pontiac': 3, 'oldsmobil': 1, 'bullhead': 1, 'bitting': 1, 'zelig': 1, 'zirconia': 2, 'commodu': 2, 'gse': 2, 'milwal': 2, 'polym': 2, 'thesing': 2, 'knudsen': 1, 'demotiv': 1, 'northeast': 3, 'childlish': 1, '180d': 1, 'elequ': 1, 'selfloath': 1, 'cambel': 6, 'sherryl': 1, 'pinnocioesqu': 1, 'sastifyingli': 1, 'wilmer': 2, 'valderama': 2, 'gaffigan': 1, 'nugent': 1, 'sensurround': 1, 'pantheist': 1, 'boxset': 2, '2210': 2, 'samba': 5, 'humding': 1, 'obot': 1, 'entebb': 1, 'uganda': 3, 'kampala': 1, 'scotsman': 6, 'foolhardi': 4, 'houseless': 1, 'vagrant': 4, 'dbd': 4, 'urbanscap': 1, 'mongkok': 1, 'eason': 1, 'stechino': 1, 'tablewar': 1, 'goeffrey': 1, 'garofolo': 2, 'directionless': 6, 'theising': 1, 'fondo': 3, 'tiempo': 8, 'valient': 8, 'szifron': 9, 'workmen': 1, 'maximis': 5, 'tosser': 1, 'algorithm': 1, 'crowhaven': 3, 'flagg': 1, 'quirt': 1, 'affix': 3, 'podiatrist': 1, 'incub': 3, 'excursu': 1, 'peripheri': 8, 'threepenni': 3, '608': 1, 'giger': 1, 'zomcon': 6, 'james': 1, 'icewat': 1, 'magictrain': 2, 'pesticid': 1, 'ehrr': 1, 'delenn': 2, 'lennier': 1, 'londo': 1, 'vir': 3, 'lyta': 2, 'lockley': 1, 'garibaldi': 2, 'holo': 2, 'desultori': 5, 'ywca': 2, 'rahxephon': 1, 'anurag': 2, 'basu': 2, 'kucch': 1, 'hawa': 1, 'businessth': 1, 'malika': 4, 'vulgarth': 1, 'ashmith': 2, 'brilliantth': 1, 'convincingalso': 1, 'bakedth': 1, 'toodirect': 1, 'stunningemraan': 1, 'jhutsi': 1, 'elyse': 1, 'triomph': 1, 'odil': 3, 'vernoi': 1, 'badminton': 1, 'shuttlecock': 1, 'everet': 1, 'robo': 4, 'chaulk': 1, 'scandi': 1, 'hendler': 2, 'alterio': 2, 'karizma': 1, 'uo': 2, 'sjund': 1, 'inseglet': 1, 'newgat': 1, 'heavenward': 2, 'housemaid': 6, 'dehumanis': 4, 'dissid': 2, 'interplanetari': 1, 'tt0449040': 1, 'rapaci': 1, 'robi': 4, 'chernitski': 1, 'justina': 1, 'cliffhangin': 1, 'ret': 1, 'kendo': 1, 'iaido': 1, 'mcarthur': 2, '94th': 1, 'moreland': 3, 'wahoo': 1, 'manpow': 1, 'ruff': 2, 'baez': 1, 'avowedli': 1, 'hamwork': 1, 'skeptisc': 1, 'freefal': 4, 'baastard': 1, 'gimbl': 1, 'wiiliam': 1, 'quietest': 2, 'poplular': 1, 'greuesom': 1, 'sawney': 3, 'waay': 2, 'jcc': 3, 'achad': 1, 'huntz': 1, '79th': 1, 'picardo': 3, 'neuro': 3, 'tuvoc': 1, 'dumme': 1, 'dempster': 4, 'paralel': 1, 'stoneman': 1, 'bitzer': 1, 'wolhiem': 2, 'equestrian': 2, 'zoetrop': 1, 'unstartl': 1, 'scaramouch': 2, 'fencer': 6, 'mckim': 1, 'pector': 4, 'salum': 1, 'putman': 3, 'dunwich': 1, 'devonsvil': 1, 'transient': 3, 'chatham': 1, 'eulilah': 1, 'comici': 1, 'personalti': 1, 'villecha': 1, 'handmaiden': 1, 'underutil': 3, 'keay': 1, 'bodypress': 1, 'koz': 1, '555': 1, 'stringent': 3, 'legless': 2, 'quizmast': 1, 'dreama': 2, 'outmatch': 2, 'tumour': 1, 'egbert': 1, 'imagina': 1, '2053': 1, 'luckyli': 1, 'solent': 6, 'donnovan': 1, 'despos': 1, 'ktma': 2, 'superdom': 8, 'kingmak': 1, 'parhat': 1, 'togeath': 1, 'interist': 1, 'uninterist': 1, 'bleri': 1, 'sandman': 7, 'unbenownst': 1, 'showstopp': 3, 'bermuda': 3, 'oldster': 3, 'flavourless': 1, 'anthropomorphis': 2, 'unhorselik': 1, 'hymer': 3, 'ni': 11, 'takeoff': 6, 'spoilerther': 1, 'sherbert': 4, 'tastey': 2, 'sb': 7, 'slimiest': 2, 'loondon': 1, '10could': 1, 'paraben': 1, 'tremel': 3, 'bauerisch': 1, 'yeat': 1, 'londonscap': 1, 'kassar': 1, 'vajna': 1, 'blowback': 1, 'fulmin': 1, 'gibe': 2, 'rattigan': 1, 'gmd': 1, 'leroux': 2, 'draught': 2, 'cockey': 3, 'innaccur': 1, 'marquand': 2, 'kershner': 2, 'tht': 1, 'sicn': 1, 'postmast': 1, 'narrtor': 1, 'frownbust': 1, 'unpublish': 3, 'neofolk': 1, 'relect': 1, 'asscrap': 1, 'peobodi': 1, 'birman': 1, 'walden': 1, 'furgusson': 1, 'kean': 2, 'now': 1, 'jud': 21, 'mapboard': 1, 'walkthrough': 1, 'demagogu': 1, 'barwood': 1, 'toyko': 1, 'marj': 2, 'dusay': 2, 'nimitz': 3, 'toucan': 1, 'speechifi': 3, 'inchon': 2, 'sobriquet': 2, 'rostenberg': 1, 'tooo': 2, 'doesnot': 1, 'takiya': 1, 'masladar': 1, 'holiman': 1, 'brommel': 11, 'piazza': 1, 'excers': 1, 'decoteau': 4, 'comparit': 1, 'amatu': 3, 'acct': 1, 'daslow': 1, 'icaru': 1, 'schimmer': 2, 'pheob': 2, 'buffay': 2, 'arnt': 2, 'pheeb': 1, '2008veri': 1, 'duhhh': 1, 'hitokiri': 19, 'goyokin': 11, 'izo': 15, 'tosha': 3, 'takechi': 8, 'tatsuya': 4, 'nakadai': 2, 'abolit': 3, 'giri': 2, 'ninjo': 1, 'torazo': 1, 'yojimbo': 4, 'tinnitu': 2, 'cheerio': 2, 'pucki': 1, 'morolla': 2, 'realtim': 1, 'thoe': 3, 'pity': 1, 'wafti': 1, 'falagist': 1, 'melendez': 2, 'esperanto': 2, 'drudg': 4, 'francken': 1, 'falangist': 1, 'mander': 2, 'videoasia': 1, 'poolboy': 1, 'bensen': 1, 'steed': 2, 'jobcon': 1, '1984ish': 2, 'damen': 1, 'opiat': 1, 'slyvia': 1, 'deangelo': 2, 'daresay': 1, 'prari': 1, 'ranchhous': 1, 'sharecropp': 2, 'bayonn': 3, 'vainglori': 1, 'gaudier': 1, 'hahahhaa': 1, 'indien': 2, 'matograph': 4, 'kinetoscop': 2, 'arroseur': 1, 'arro': 1, 'showtun': 1, 'dandridg': 1, 'mdm': 1, 'r4': 1, 'subtitlesonc': 1, 'chor': 1, 'reaaaal': 1, 'gop': 1, 'gah': 1, 'watro': 1, 'vomitori': 1, 'calafornia': 1, 'aorta': 1, '55th': 2, 'grubi': 1, 'donel': 1, 'doogan': 2, 'gar': 4, 'saviour': 7, 'uhhhh': 1, 'threateningli': 2, 'nog': 2, 'ashtray': 1, 'grimli': 3, 'sevil': 3, 'pacman': 1, 'penit': 2, 'raygun': 1, 'grid': 3, 'mystifyingli': 2, 'sarin': 4, 'sirin': 1, 'nabokovian': 1, 'involut': 1, 'kinbot': 1, 'solec': 1, 'pynchon': 1, 'bunuellian': 1, 'iglesia': 3, 'overdetermin': 1, 'rawer': 1, 'roadwork': 1, 'airless': 4, 'overf': 1, 'undernourish': 1, 'monetegna': 1, 'adreon': 1, 'grat': 1, 'cassadi': 1, 'smilin': 2, 'hodgkin': 1, 'nate': 4, 'milt': 1, 'hinako': 1, 'fumiya': 2, 'veden': 1, 'spelunk': 1, 'quayl': 3, 'funnyman': 1, 'sala': 3, 'amar': 4, 'gacktnhyd': 1, 'hawt': 1, 'yaoi': 1, 'burbl': 1, 'auxiliari': 2, 'villalobo': 1, 'tbu': 2, 'blackbal': 4, 'bumbler': 3, 'disneyfi': 2, 'reburn': 1, 'cit': 1, 'tenanci': 1, 'tooooo': 2, 'sundown': 6, 'oratorio': 1, 'nanc': 2, 'fizzi': 2, 'hollwood': 2, 'jann': 1, 'loff': 1, 'karlsson': 1, 'findu': 2, 'gaylord': 6, 'rockefel': 2, 'monocl': 1, 'thimig': 1, 'bloodfest': 1, 'earthshak': 1, 'couliss': 1, 'stjerner': 1, 'uden': 1, 'hjerner': 1, 'badest': 1, 'therapeut': 3, 'personl': 1, 'eehaaa': 1, 'markov': 9, 'seaquest': 4, 'lorean': 1, 'unendear': 1, 'disingeni': 1, 'courteney': 2, 'hamfist': 3, 'overreli': 1, 'parod': 2, '500ad': 2, 'fcked': 1, 'fcker': 1, 'jurk': 1, 'oopsalof': 1, 'nicalo': 1, 'tightrop': 3, 'cinemtographi': 1, 'thomerson': 10, 'deth': 5, 'leena': 1, 'wardo': 1, 'crampton': 1, 'trekkin': 1, 'ctv': 3, 'ewanuick': 1, '10eliason': 1, 'zealnd': 1, 'waugh': 5, 'arrivist': 1, 'demateri': 1, 'mortem': 2, 'bumptiou': 2, 'dowag': 2, 'hanker': 3, 'plough': 3, 'mage': 1, 'larp': 1, 'squee': 1, 'why2': 1, 'bigardo': 2, 'candela': 1, 'villedo': 1, 'gimenez': 1, 'cacho': 1, 'francescoantonio': 1, 'meanli': 1, 'deen': 1, 'showiest': 1, 'britpop': 1, 'hemlock': 1, 'umpf': 1, 'atenborough': 3, 'kleban': 1, 'schulman': 1, 'speilburg': 1, 'dyana': 1, 'ortelli': 1, 'wildsmith': 1, 'aforment': 2, 'bong': 3, 'sourpuss': 1, 'beit': 1, 'russborrough': 1, 'wicklow': 1, 'ferret': 5, 'equivalenc': 1, 'liais': 1, 'eurail': 1, 'polito': 2, 'leit': 1, 'ciefli': 1, 'filet': 1, 'mignon': 1, 'cronkit': 2, 'iconograph': 1, 'trailblaz': 1, 'fjaestad': 1, 'munter': 2, 'tarkovki': 1, 'tarkoski': 1, 'aristotl': 1, 'deskbound': 1, 'kmc': 2, 'dezel': 1, 'gorgon': 1, 'allergi': 3, 'meatwad': 1, 'underhandedli': 1, 'smarten': 1, 'zoink': 1, 'earplug': 2, 'austrailian': 2, 'cornbluth': 1, 'innerli': 1, 'threefold': 1, 'rebour': 1, 'mohammedan': 1, 'virtuous': 1, 'jig': 4, 'aegean': 1, 'cosimo': 8, 'pero': 4, 'palookavil': 1, 'endanoth': 1, 'socorro': 1, 'pisana': 2, 'iamaseal2': 3, 'pail': 2, 'joycey': 1, 'enron': 2, 'hertzog': 1, 'cig': 2, 'poeshn': 2, 'coprophilia': 1, 'exambl': 1, 'yat': 1, 'brooklynes': 1, 'sawdust': 2, 'selflessli': 1, 'kreb': 1, 'untuck': 1, 'vaul': 1, 'kostelanitz': 1, 'jobeth': 4, 'lerch': 2, 'willowbrook': 1, 'afterstori': 1, 'subsect': 1, 'noooooo': 1, 'maffia': 3, 'ural': 1, 'outstretch': 1, 'ghraib': 2, 'infantilis': 2, 'coyli': 2, 'gloatingli': 1, 'rotc': 1, 'daman': 1, 'spittl': 1, 'wastepap': 1, 'doggett': 3, 'kamar': 2, 'moloney': 2, 'thea': 2, 'overmuch': 1, 'renal': 1, 'nbb': 2, 'sonatin': 1, '20s1st': 1, 'belasco': 9, 'ainley': 1, 'stromboli': 2, 'litvak': 1, 'spagetti': 1, 'bluish': 3, 'confessor': 1, 'gooodi': 1, 'enclosur': 2, 'wonka': 2, 'inder': 2, 'kamaal': 1, 'deafthi': 1, 'exerciseth': 1, 'snehal': 2, 'dabi': 1, 'scenesdirect': 2, 'angelvivek': 1, 'nelligan': 2, 'follett': 1, 'afrovideo': 1, 'unaccpect': 1, 'remu': 3, 'briar': 2, 'entact': 1, 'jardin': 2, 'scottsdal': 1, 'bruton': 1, 'raitt': 2, 'mcclinton': 1, '2151': 1, 'klaang': 6, 'soval': 1, 'unplug': 3, 'krono': 3, 'hoshi': 6, 'phlox': 8, 'suliban': 5, 'sensor': 1, 'riger': 1, 'prussic': 2, 'clansman': 1, 'ijoachim': 1, 'renberg': 1, 'gla': 1, 'greav': 2, 'nter': 1, 'royl': 1, 'ectoplasm': 1, 'dicpario': 1, 'thunderclap': 1, 'wnsd': 3, 'mesa': 2, 'beamont': 3, 'damned': 1, 'typhoon': 3, '9do': 1, 'albizu': 1, 'guevarra': 3, 'damari': 1, 'maldonado': 1, 'laughingli': 4, 'breckenridg': 1, 'boal': 1, 'teatim': 1, 'gallipoli': 2, 'paschendal': 1, 'tobruk': 1, 'nunchuk': 1, 'coutur': 3, 'bravi': 1, 'beeman': 1, 'intimist': 1, 'litman': 1, 'pressberg': 2, 'knell': 2, 'gestaldi': 1, 'barboo': 1, 'felleghi': 1, 'myoshi': 2, 'steinauer': 1, 'praskin': 1, 'solvenc': 1, 'yoyo': 1, 'trivialia': 1, 'characteriolog': 1, 'scouser': 1, 'deckard': 1, 'anddark': 1, 'bola': 1, 'achero': 1, 'bodysuck': 1, 'reisner': 1, 'stuningli': 1, 'jerkoff': 1, 'narc': 1, 'autofocu': 2, 'booooooooooooooooooooooooooooooooooooooooooooooo': 1, 'afterschool': 2, 'pagent': 1, 'accordian': 3, 'frigjort': 1, 'westerberg': 1, 'bentsen': 1, 'jossi': 1, 'ashknenazi': 1, 'radiologist': 1, 'mcvay': 1, 'poupard': 1, 'thomsen': 1, 'rnrh': 3, 'nunneri': 1, 'aloy': 1, 'biel': 3, 'mesquida': 1, 'bonet': 2, 'ramala': 4, 'nilo': 1, 'mur': 1, 'tur': 7, 'lozano': 1, 'sergi': 1, 'francisca': 7, 'bergonzini': 2, 'nia': 2, 'cassamoor': 1, 'peracaula': 1, 'navarret': 1, 'fath': 1, 'faruza': 1, 'baulk': 1, 'avantgard': 1, 'brant': 2, 'noway': 1, 'keita': 1, 'amemiya': 2, 'necroborg': 9, 'fishbourn': 4, 'limpet': 2, 'zaftig': 2, 'kiarostami': 2, 'straightaway': 3, 'dorlan': 2, 'peacecraft': 2, 'millardo': 1, 'nomm': 1, 'guerr': 1, 'bucketload': 1, 'libra': 1, 'japenes': 3, 'insault': 1, 'gasbag': 1, 'moronfest': 1, 'bilborough': 1, '135m': 1, 'gasgoin': 1, 'tactless': 2, '440': 1, 'surroundsound': 1, 'jafri': 8, 'peripatet': 1, 'inuit': 4, 'alaskan': 5, 'freuchen': 1, 'cluni': 1, 'ermin': 6, 'absolom': 1, 'wyler': 7, 'ul': 2, 'erasmu': 1, 'microman': 1, 'unbelievablewarn': 1, 'spoilerishit': 1, 'timehalla': 1, 'bol': 3, 'rdb': 1, 'halla': 1, 'divyashakti': 1, 'rakeysh': 1, 'mehra': 4, 'sania': 1, 'tenenkrommend': 1, 'onyulo': 2, 'umbopa': 3, 'comstock': 8, 'lode': 3, 'unworldli': 3, 'grande': 1, 'resplend': 2, 'pavignano': 1, 'alatri': 2, 'rocca': 2, 'volo': 2, 'silverbear': 1, 'blazkowicz': 2, 'tetri': 1, 'gta': 7, 'nukem': 3, 'mullin': 2, 'rectangular': 2, 'aarrrgh': 1, '10voluntarili': 1, 'anthonyu': 1, 'vieller': 1, 'wyne': 1, 'suicida': 1, 'zuf': 1, '01pm': 1, 'zapata': 3, 'reduction': 1, 'huac': 4, 'mccarthyit': 1, 'contraband': 3, 'contacte': 1, '405': 1, 'seond': 1, 'f13th': 1, 'rosenlski': 8, 'unasco': 1, 'beachcomb': 3, 'ropsenlski': 1, 'rosnelski': 1, 'rosenliski': 1, 'molotov': 1, 'mattia': 1, 'rosenski': 1, 'creamtor': 1, 'bruit': 1, 'elois': 2, 'micheaux': 8, 'doli': 1, 'armena': 1, 'consuela': 1, 'gyspi': 1, 'carman': 1, 'bylin': 2, 'purnel': 1, 'hsss': 1, 'cobi': 2, 'inciner': 8, 'tremblay': 3, 'alton': 4, 'batali': 3, 'foodi': 1, 'fanpro': 2, 'ticonderoga': 1, 'ferengi': 1, 'cardassian': 2, 'ds12': 1, 'isolyt': 1, 'quicktim': 2, 'divx': 3, 'qt': 2, '320x180': 1, 'titanica': 2, 'shlop': 2, 'schtock': 2, 'zaphoidp': 2, 'proportion': 4, 'prefix': 1, 'halloway': 6, '147': 3, '269': 1, 'sadomasoch': 3, 'reddin': 1, 'grift': 5, 'sepukka': 1, 'seppuka': 1, 'dunski': 2, 'mensong': 5, 'trahison': 1, 'affinit': 1, 'tirard': 2, 'edouard': 2, 'kesey': 1, 'babb': 1, 'ey': 2, 'oregonian': 1, 'garsh': 1, 'norwegia': 1, 'neighter': 1, 'leng': 1, 'norg': 1, 'bayt': 2, 'bogota': 2, 'carrigan': 3, 'ryck': 2, 'groot': 2, 'imac': 1, 'ramallo': 5, 'unconfort': 1, 'bicenntini': 1, 'abat': 2, 'bochner': 3, 'lackthereof': 1, 'teenagerwhi': 1, 'mackenna': 2, 'culbertson': 1, 'rusel': 1, 'bubblingli': 1, 'disport': 1, 'stoutest': 1, 'antisept': 3, 'cloister': 2, 'gingerli': 3, 'oakhurst': 2, 'priorli': 1, 'devorah': 1, 'whiil': 1, 'unconvention': 2, 'admixtur': 1, 'kazetachi': 1, 'hitoshi': 1, 'yazaki': 1, 'enfantin': 1, 'ruggia': 1, 'yellin': 4, 'groden': 1, 'catwomanli': 1, 'steeeeee': 1, 'riiiiiik': 1, 'twoooooooo': 1, 'weeeeeell': 1, 'spongi': 2, 'ncaa': 1, 'unotic': 1, 'balaban': 1, 'brickbat': 1, 'tarrytown': 1, 'lyndhurst': 1, 'zucchini': 1, 'overnit': 1, 'honkytonk': 1, 'satnitefev': 1, 'tilton': 1, 'greaser': 3, 'technologist': 2, 'spearritt': 1, 'cattermol': 1, 'gareth': 2, 'mccormickstar': 1, 'stroup': 4, 'davisplot': 1, 'lolcon': 1, 'briann': 1, 'wayyyyy': 1, 'petey': 2, 'physco': 1, 'beeyotch': 1, 'longo': 2, 'finley': 2, 'hraboski': 1, 'posidon': 1, 'manti': 1, 'courtier': 3, 'pfff': 2, '10wwe': 2, 'powerbomb': 3, 'unbuckl': 1, 'superplex': 4, 'facebust': 3, '10santa': 1, 'stfu': 1, 'nbk': 2, 'unreservedli': 2, 'jaden': 1, 'uberman': 1, 'yeccch': 1, 'buckshot': 1, 'plumtre': 1, 'poptart': 1, 'pasternak': 3, 'joseiturbi': 1, 'discographi': 1, 'hellspawn': 1, 'hellbor': 1, 'palisad': 2, '16k': 1, 'caprio': 4, 'vise': 2, 'bachrach': 1, 'heaviest': 2, 'twadd': 1, 'gracen': 1, 'stormer': 1, 'magu': 1, 'upkeep': 2, 'crete': 1, 'cruther': 1, 'beldan': 1, 'heeeeer': 1, 'smarm': 1, 'platitudin': 1, 'sitck': 1, 'britta': 1, 'disasterpiec': 1, 'literati': 1, 'derivi': 1, 'cheerso': 1, 'informerci': 1, 'fertilis': 1, 'diarrhoeic': 1, 'carabatso': 1, 'cheetor': 1, 'razzoff': 1, 'rayman': 1, 'g4': 1, 'tranceform': 1, 'cybertron': 1, 'sayin': 4, 'andentertain': 1, 'goodperform': 1, 'herperform': 1, 'outtoday': 1, 'prickett': 1, 'newfoundland': 2, 'candyman': 6, 'papierhau': 1, 'pepperhau': 1, 'snog': 5, 'chrecter': 1, 'jumpedtheshark': 1, 'intrigud': 1, 'yabba': 1, 'riki': 1, 'ciro': 3, 'willett': 3, 'genera': 4, 'caramel': 3, 'dnd': 2, 'tabletop': 1, '5second': 1, 'timoteo': 1, 'manu': 11, 'confetti': 1, 'newmail': 1, 'hrer': 3, 'reichstagsbuild': 1, 'playmobil': 1, 'misgaug': 1, 'upn': 3, 'sanctifi': 4, 'fortifi': 6, 'jaid': 2, 'bonbon': 4, 'crocki': 4, 'hoek': 1, 'sotto': 1, 'voce': 1, 'speach': 1, 'tiangl': 1, 'nardini': 1, 'mullen': 1, 'imdbman': 1, 'disinvit': 1, 'backcountri': 1, 'ect': 3, 'repet': 1, 'thow': 1, 'crappier': 3, 'catalu': 2, 'obcess': 4, 'espect': 1, '10a': 1, 'chromium': 1, 'derivit': 1, 'inviol': 1, 'dysfunt': 1, 'unprovokedli': 1, '1897': 2, 'fitzsimmon': 3, 'jip': 2, 'manhattanit': 1, 'neurotic': 1, 'gramm': 2, 'simulador': 1, 'muccino': 8, 'breuer': 2, 'tutelag': 2, 'critiz': 1, 'fannish': 1, 'mainetti': 1, 'tase': 1, 'superfic': 1, 'loew': 3, 'sanguin': 1, 'yolanda': 4, 'aip': 7, 'shanley': 4, 'cappomaggi': 2, 'gillett': 1, 'sooooooooo': 1, 'romantick': 1, 'splattermovi': 1, 'digitech': 2, 'barret': 2, 'regalbuto': 2, 'convit': 1, 'rubinek': 1, 'undepend': 1, 'reshoot': 1, 'hymilayan': 1, 'walder': 1, 'menno': 1, 'meyj': 1, 'daviau': 1, 'doorpost': 1, 'berr': 1, 'bloodfeast': 1, 'rikki': 1, 'soloflex': 1, 'smuttish': 1, 'sanna': 2, 'hietala': 2, 'juha': 1, 'kukkonen': 1, 'heikkil': 1, 'macao': 2, 'loooooooooooong': 1, 'zvonimir': 2, 'rogoz': 1, 'aribert': 3, 'mog': 5, 'fortier': 5, 'crispi': 2, 'surprisedwith': 1, 'orr': 1, 'guynam': 1, 'beenincred': 1, 'gamewhen': 1, 'bartendermik': 1, 'lifeisn': 1, 'givenit': 1, 'andpul': 1, 'enoughfunni': 1, 'reallygood': 1, 'jonlovitz': 1, 'intheir': 1, 'sjust': 1, 'ihighli': 1, 'steerag': 3, '1874': 1, 'zannuck': 1, 'oxbow': 1, 'solver': 3, 'hass': 3, 'stout': 4, 'buckmast': 2, '0093638': 1, 'rubbiush': 1, 'villia': 2, 'amnesti': 1, 'suleiman': 15, 'kabir': 3, 'bedi': 4, 'linderbi': 5, 'onso': 1, 'concer': 1, 's01': 1, 'e04': 1, 'pasion': 1, 'coalvil': 1, 'hindersom': 1, 'clomp': 1, 'gariazzo': 1, 'sunn': 1, 'riffen': 2, 'kasper': 1, 'proletarian': 2, 'ontkean': 2, 'salvator': 5, 'pelican': 2, 'turbocharg': 1, 'whackjob': 1, 'sown': 2, 'thecoffeecoast': 1, 'benward': 7, 'sweatshop': 2, 'winteri': 1, 'gondola': 1, 'pasteur': 16, 'nutz': 1, 'unconfid': 1, 'margarita': 7, 'hedon': 3, 'plumag': 4, 'acropoli': 1, 'sacco': 1, 'dehli': 1, 'evren': 1, 'buyruk': 1, 'moviedom': 2, 'raechel': 1, 'preexist': 1, 'poic': 1, 'sucka': 2, 'bigga': 1, 'figga': 1, '9er': 1, 'hp': 7, 'wristband': 1, 'yao': 1, 'boriqua': 1, 'sunnydal': 1, 'lakeview': 1, 'septuagenarian': 1, 'beaham': 1, 'svankmaj': 1, 'metacinema': 1, 'schlussel': 1, 'podunksvil': 1, 'golina': 1, 'stater': 1, 'junker': 1, 'drecki': 2, 'macluhen': 1, 'penicillin': 1, 'psychosomat': 2, 'southstreet': 1, 'hollander': 1, 'quotidien': 1, 'minorli': 1, 'striper': 1, 'ballyhoo': 4, 'bigami': 1, 'boringu': 1, 'maximu': 1, 'nebulos': 1, 'nilsen': 1, 'silvest': 1, 'solder': 3, 'uggh': 2, 'dogi': 1, 'toom': 1, 'bradycardia': 1, 'gust': 1, 'ute': 1, 'unbow': 1, 'harpsichordist': 1, 'trogar': 1, 'whitehead': 3, 'femur': 1, 'oklar': 5, 'dissabordin': 1, 'beresford': 3, 'malpractic': 3, 'overprotect': 8, 'nonsensich': 1, 'assemblag': 2, 'tenabl': 1, 'leek': 1, 'pra': 1, 'biospher': 3, '978': 1, 'cremast': 2, 'shrimp': 7, 'guano': 5, 'postmortem': 1, 'ntire': 1, 'explant': 1, 'horribbl': 1, 'thumbtack': 2, 'motoris': 1, 'redecor': 1, 'valderrama': 1, 'poge': 1, 'cheris': 1, 'sashi': 1, 'parveen': 1, 'babhi': 1, 'gungaroo': 1, 'bhand': 1, 'meera': 2, 'nachi': 2, 'dadoo': 1, 'schecki': 1, 'noriega': 1, 'critisc': 1, 'divi': 1, 'shakesspear': 1, 'rml': 1, 'dethman': 4, 'microbudget': 1, 'apostol': 1, 'pscyho': 1, 'toreton': 1, 'bruckner': 4, 'franju': 1, 'yeux': 1, 'nighwatch': 1, 'eng': 2, 'moviestor': 1, 'maidserv': 1, 'meudon': 1, 'worf': 2, 'chakotay': 3, 'neelix': 3, 'subspac': 1, 'wildman': 1, 'haifa': 2, 'juaquin': 1, 'tipto': 1, 'admittadli': 1, 'fantabul': 1, 'acrid': 2, 'yuji': 2, 'oda': 1, 'astronautship': 1, 'longhetti': 1, 'expediton': 1, 'johan': 1, 'bhagat': 1, 'ramu': 10, 'crapsterpiec': 1, 'mariesa': 1, 'disfunct': 1, 'hb': 5, 'capita': 2, 'maia': 5, 'swd': 1, 'gasmann': 1, 'delongpr': 1, 'gault': 1, 'mccamu': 1, 'yanno': 1, 'vanlint': 2, 'killin': 1, 'sluizer': 1, 'valiantli': 5, 'blackbefor': 1, 'kongwon': 1, 'ui': 2, 'satchel': 1, 'pickax': 1, 'crawley': 7, 'arnim': 2, 'enach': 1, 'feffer': 1, 'salsa': 3, 'descov': 1, 'emmin': 1, 'sudetenland': 1, 'lalala': 1, 'sioux': 7, 'bugler': 2, 'tutu': 2, 'eithier': 1, 'stalactit': 1, 'sharki': 2, 'scuzziest': 1, 'marseil': 5, '006': 1, 'ric': 3, 'lita': 3, 'mitb': 3, 'stratu': 2, 'hhh': 6, '10fifth': 1, '10sixth': 1, 'torri': 2, 'daivari': 1, 'shockingest': 1, 'jillian': 3, 'simonton': 1, 'cappi': 2, 'mindfram': 1, 'onegin': 3, 'lenski': 1, 'tschaikowski': 1, 'guiltili': 1, 'steinbeck': 1, 'grittili': 1, 'unheat': 1, 'colditz': 2, 'goodliff': 1, 'gotel': 1, 'dalrympl': 1, 'rennt': 4, 'wishman': 3, 'unfind': 1, 'cologn': 3, 'woodifi': 1, 'cinequanon': 1, 'minti': 2, 'zhv': 1, 'cissi': 1, 'childen': 1, 'ingr': 3, 'hiya': 1, 'jlh': 2, 'aerobicid': 3, 'julietta': 1, 'fatih': 3, 'maddison': 1, 'boettich': 2, 'wymor': 1, 'mountian': 1, 'magwood': 1, 'stensvold': 1, 'grooviest': 1, 'unverifi': 1, 'globu': 1, 'shahadah': 2, 'whitewat': 1, '22nd': 1, 'macnicol': 2, 'calista': 1, 'flockofduck': 1, 'shshsh': 1, 'shtewart': 1, 'shlater': 1, 'mcbeak': 2, 'mcquack': 1, 'overrul': 3, 'legalist': 1, 'counterbal': 4, 'sinewi': 2, 'urbanis': 2, 'survivalist': 1, 'ttw': 2, 'thrift': 6, 'snowbank': 1, 'hoiti': 1, 'toiti': 1, 'molecul': 4, 'rebeli': 1, 'nikelodean': 1, 'fibr': 4, 'nicest': 6, 'mucci': 1, 'krogshoj': 1, 'druss': 4, 'marpl': 2, 'rolff': 1, 'morten': 2, 'rotn': 1, 'leffer': 1, 'stellan': 3, 'skarsg': 1, 'trammel': 6, 'raindeer': 1, 'charnier': 6, 'beginsthi': 1, 'thanklessli': 1, 'whitt': 2, '156': 1, 'obsolesc': 2, 'kennicut': 5, 'goofili': 1, 'lifelin': 2, 'mindgam': 2, 'misdraw': 1, 'whooo': 2, 'garnish': 3, 'hester': 2, 'idolis': 1, 'ukwel': 1, 'woman2': 1, 'zhi': 3, 'chun': 3, 'chinawel': 1, 'womanin': 1, 'belpr': 1, 'erschbam': 1, 'goodheart': 2, 'opp': 1, 'greyhound': 1, 'callup': 1, 'kruk': 1, 'lator': 1, 'tampa': 3, 'tolkin': 1, 'politi': 1, 'oar': 1, 'scintilla': 1, 'unbeard': 1, 'fitter': 3, 'genxyz': 1, 'benzocain': 1, 'cheorgraph': 1, 'krystalnacht': 1, 'platfrom': 1, 'dvice': 1, 'beginnig': 1, 'ainc': 1, 'lamppost': 1, 'cardona': 2, 'tintorera': 2, 'redol': 2, 'somnol': 3, 'navuoo': 1, 'outrank': 1, 'sakmann': 1, 'hubatsek': 1, 'scate': 1, 'olari': 2, 'yelena': 1, 'lanskaya': 1, 'sheath': 1, 'vinson': 7, 'giraudot': 1, 'doremu': 1, 'snug': 1, 'perspicaci': 2, 'bifurc': 2, 'paypal': 1, 'rodrigu': 3, 'roundhous': 3, 'auger': 1, 'supersegment': 1, 'dornwinkl': 7, 'mollecular': 1, 'blalack': 1, 'rifkin': 3, 'unbox': 1, 'rade': 3, 'serbedzija': 4, 'wonman': 1, 'voicetrack': 1, 'woodchipp': 3, 'theroux': 1, 'bourvier': 1, 'bistro': 1, 'lize': 1, 'cancan': 2, 'klute': 5, 'macgrud': 1, 'meali': 1, 'famkhe': 1, 'vennera': 1, 'eastland': 3, 'welder': 1, 'guzm': 3, 'boccelli': 2, 'jahfr': 1, 'cheaten': 1, 'nano': 2, 'hunnam': 2, 'bover': 1, 'fantat': 1, 'cliquey': 1, 'dtr': 1, 'lyin': 1, 'bespoil': 1, 'antoniett': 1, 'macarri': 1, 'pascualino': 1, 'armando': 3, 'trovajoli': 1, 'varenn': 1, 'pushkin': 1, 'glitteri': 1, 'kasden': 2, 'thebg': 1, 'cill': 1, 'constanli': 1, 'stever': 1, 'floodwat': 1, 'okavango': 1, 'demoisel': 1, 'humpback': 3, 'cordless': 1, 'epigrammat': 2, 'montenegro': 5, 'gainsay': 1, 'magaret': 1, 'ariszt': 1, 'pasco': 3, 'mcmaster': 2, 'hysterectomi': 1, 'tamura': 1, 'vander': 2, 'voigt': 3, 'trebek': 1, 'abjectli': 1, 'bacchan': 2, 'zanzeer': 1, 'lawari': 1, 'namak': 1, 'halal': 1, 'haryanavi': 1, 'haryanvi': 2, 'hazar': 1, 'ranjeet': 1, 'shaaadaaaap': 1, 'metric': 1, 'franker': 1, 'discript': 1, 'speciali': 1, '18year': 1, 'eliz7212': 1, 'cubicl': 3, 'laserblast': 2, 'malay': 1, 'bgr': 1, 'koboi': 1, 'hurler': 1, 'kpc': 1, 'epcot': 1, 'napa': 2, 'hellbent': 3, 'eyerol': 1, 'geewiz': 1, 'imri': 4, 'houseclean': 1, 'seussian': 1, 'mariya': 1, 'ignatova': 2, 'goner': 3, 'foryth': 1, 'metamoprhi': 1, 'metamorphi': 1, 'glisten': 5, 'inconciev': 1, 'asund': 4, 'philippian': 1, 'macarth': 2, 'pafif': 1, 'outflank': 1, 'yalu': 1, 'withdrew': 2, 'auscrit': 3, 'sommersault': 2, 'pollan': 3, 'schneerbaum': 2, 'ginuea': 1, 'rathk': 2, 'lindum': 3, 'svendsen': 4, 'mejd': 2, 'fascistoid': 1, 'svale': 1, 'weisman': 1, 'motorhead': 1, 'hainey': 1, 'badjatya': 2, 'aloknath': 1, 'scammer': 2, 'lyki': 1, 'crepe': 1, 'hedron': 1, 'rajini': 3, 'toooooo': 2, 'prepaid': 1, '20000': 1, 'sevencard2003': 1, '177': 1, 'ssi': 2, 'sunflow': 2, 'theyd': 1, 'hiariti': 1, 'fraiser': 2, 'bredon': 1, '2003i': 1, 'glyni': 2, 'langaug': 1, 'barril': 1, 'conspici': 1, 'padrino': 1, 'realign': 1, 'protanganist': 1, 'panamericano': 1, 'despairingli': 1, 'chacotero': 1, 'recod': 1, 'muchdespit': 1, 'laurdal': 1, 'concaten': 1, 'schreiber': 4, 'tovah': 4, 'feldshuh': 4, 'castmat': 2, 'macnamara': 1, 'inyong': 1, 'shiktak': 1, 'flagellist': 1, 'selfpiti': 1, 'kilmor': 1, 'wesleyan': 1, 'alderich': 1, 'reenberg': 2, 'kafkanian': 1, 'bedford': 4, 'umilak': 1, 'floe': 1, 'refineri': 1, 'calculatedli': 1, 'applacian': 1, 'cincinnati': 6, 'shamefacedli': 1, 'covent': 1, 'whitelaw': 3, 'philosph': 1, 'alchemist': 1, 'joust': 2, 'megaloman': 2, 'furthest': 2, 'kinghtli': 1, 'pollen': 1, 'japp': 7, 'concubin': 10, 'intransig': 2, 'unreconstruct': 1, 'uso': 5, 'tempestu': 4, 'dutchess': 1, 'jullian': 1, 'bogdansk': 1, 'vermett': 1, 'bilcock': 3, 'alvarez': 3, 'prolifer': 6, 'bioweapon': 1, 'anthrax': 3, 'falken': 5, 'wopr': 3, 'hooki': 2, 'kelippoth': 2, 'sitra': 1, 'achra': 1, 'renea': 2, 'reso': 1, 'humer': 2, 'giuliano': 1, 'puppo': 2, 'tonino': 2, 'delli': 1, 'wertmul': 2, 'sovereign': 3, 'wii': 2, 'klimovski': 2, 'sadomania': 1, 'antiguo': 1, 'marisc': 4, 'nacion': 2, 'chinees': 2, 'grotesuqu': 1, 'lightsabr': 1, 'oldtim': 2, 'viscou': 3, 'scalia': 1, 'ellsworth': 1, 'crayola': 1, 'yellowston': 1, 'perc': 2, 'linclon': 1, 'overstretch': 1, 'crimean': 1, 'resettl': 1, 'obligingli': 5, 'eichmann': 4, 'sooti': 1, 'analis': 1, 'abskani': 1, 'ioana': 4, 'barbu': 2, 'giurgiu': 4, 'faultlin': 1, 'vama': 1, 'vech': 1, 'unmelodi': 1, 'weightless': 1, 'wowzor': 1, 'ipecac': 1, 'samair': 4, 'jonatha': 1, 'subsp': 1, 'denigrati': 1, 'ngoyen': 1, 'brownesqu': 1, 'psychadel': 1, 'gadda': 1, 'bick': 1, 'punchbowl': 1, 'enlish': 1, 'dex': 7, 'eyepatch': 1, 'bai': 4, 'skintight': 1, 'entrepris': 1, 'fiorentino': 5, 'issac': 1, 'pelicang': 2, 'cough2fast2furiouscough': 1, 'm203': 1, 'eur': 3, 'schlingensief': 1, 'roehler': 1, 'weingartn': 1, 'hirschbiegel': 2, 'unber': 1, 'hrbare': 1, 'letzter': 1, 'rauschen': 1, 'muxm': 1, 'uschenstil': 1, 'bednob': 1, 'malil': 1, 'palooza': 1, 'predictor': 1, 'waaaaayyyyyi': 1, 'spacial': 1, 'desatur': 3, 'depopul': 1, 'socioeconom': 2, 'bilson': 4, 'questionnair': 2, 'nicco': 1, 'eroth': 1, 'daarl': 1, 'dittrich': 1, 'ich': 1, 'waldsterben': 1, 'samstag': 1, 'nacht': 1, 'mescalero': 2, 'parsi': 2, 'matteo': 2, 'favreau': 1, 'mangini': 1, 'multipurpos': 1, 'fuhgeddaboutit': 1, 'holist': 3, 'altamont': 4, 'kittson': 1, 'callum': 1, 'satchwel': 1, 'nonld': 1, 'gwoemul': 2, 'swiri': 1, 'dragonheart': 3, 'epaulet': 1, 'maru': 1, 'nietzchean': 1, 'johanson': 8, 'koslo': 2, 'pyschosi': 1, 'listner': 1, 'anglic': 2, 'fiernan': 1, 'writ': 4, 'farth': 1, 'heirloom': 2, 'bodhisattva': 1, 'psychoact': 2, 'quadraphenia': 1, 'shroom': 1, 'cockl': 1, 'acronym': 3, 'portend': 4, 'siodmark': 2, 'antwortet': 1, 'ellissen': 1, 'esmond': 3, 'drost': 1, 'hartl': 2, 'dvorak': 2, 'telkovski': 1, 'stanli': 1, 'treelin': 1, 'whirri': 1, 'nightey': 1, 'nera': 1, 'takaya': 1, 'amano': 1, 'koichiro': 1, 'ota': 1, 'toren': 1, 'kimiko': 6, 'haruhiko': 1, 'mikimoto': 1, 'dooright': 1, 'denemark': 1, 'unfavour': 4, 'feriss': 1, 'sette': 2, 'spieberg': 1, 'bocho': 1, 'genuflect': 1, 'obssess': 1, 'incalcul': 3, 'reheat': 1, 'mainspr': 1, 'mortev': 4, 'backbit': 3, 'julissa': 4, 'putridli': 2, 'haiduk': 2, 'wimmer': 2, 'haiduck': 1, 'dislodg': 5, 'svengooli': 1, 'xenomorph': 1, 'noob': 1, 'afterbirth': 1, 'pci': 1, 'sinn': 1, 'fein': 1, 'hillybilli': 1, 'intergener': 4, 'meik': 4, 'hanley': 1, 'carous': 3, 'implac': 2, 'lowliest': 3, 'parenthet': 2, 'lumsden': 1, 'kellaway': 4, 'sontag': 1, 'genisi': 1, 'razorback': 1, 'holw': 1, 'scarman': 5, 'meaningful': 2, 'custodian': 3, 'andrenalin': 1, 'xo': 1, 'firgur': 1, 'stairstep': 1, 'terrel': 2, 'blinder': 4, 'kerb': 1, 'ravishingli': 2, 'implos': 2, 'espanol': 1, 'muy': 3, 'bien': 1, 'excellent': 1, 'serenad': 4, 'examplari': 1, 'gardern': 1, 'lakeshor': 2, 'tatoo': 1, 'thepac': 1, 'torah': 2, 'storekeep': 2, 'pimpi': 1, 'waylon': 2, 'monotheist': 2, 'merton': 3, 'instrumentalist': 1, 'slough': 2, 'dupr': 4, 'boi': 3, 'dooooosi': 1, 'orgin': 5, 'heeey': 1, 'homegirl': 1, 'storr': 2, 'whist': 1, 'sophocl': 1, 'grossman': 5, 'amillenialist': 1, 'nchez': 3, 'ctomvelu': 1, '18ai': 1, 'shider': 1, 'schoolbu': 1, 'wonk': 1, 'zanato': 1, 'belush': 1, 'intelligensia': 1, 'unsexi': 3, 'giulietta': 2, 'masina': 2, 'tgmb': 1, 'groovay': 1, 'pornostalgia': 1, 'schmooz': 2, 'seld': 2, 'macauley': 3, 'boooor': 2, 'pseudoscientist': 1, 'scientistmix': 1, 'jw': 1, 'cayman': 1, 'alfi': 5, 'micklewhit': 1, 'bastardis': 2, 'thicki': 1, 'huckabe': 2, 'mumbler': 1, 'cotta': 2, 'warror': 1, 'tvpg': 2, 'confuciu': 1, 'sisyphu': 1, 'buzzard': 2, 'pachabel': 1, 'oleg': 1, 'taktarov': 2, 'dieth': 1, 'chearat': 1, 'wouldhav': 1, 'grime': 3, 'inauspici': 3, 'aprox': 1, 'tt': 3, 'noun': 1, 'daugter': 1, 'maura': 1, 'sandford': 1, 'hellbend': 1, 'psyciatrist': 1, 'blitzkrieg': 2, 'rabochiy': 1, 'missiv': 1, 'cartwrightbrid': 1, 'dreamless': 1, 'katte': 1, 'sackhoff': 1, 'townhous': 2, 'critisim': 1, 'grenier': 3, 'marber': 1, 'schnitzler': 3, 'reigen': 1, 'gonorrhea': 2, 'brackettsvil': 1, 'mccomb': 4, 'lefti': 1, 'cussack': 1, 'squirmish': 2, 'whalen': 1, 'spetter': 2, 'reword': 1, 'raiment': 1, 'modif': 10, 'lupa': 2, 'mannara': 2, 'silvestri': 6, 'dagmar': 2, 'lassand': 2, 'cryin': 2, 'actin': 1, 'boombox': 1, 'steall': 1, 'ryoga': 1, 'secondsth': 1, 'stroy': 1, 'benkai': 1, 'hegel': 1, 'superego': 8, 'zeppo': 1, 'sinthom': 1, 'jouissanc': 7, 'rossilini': 1, 'maclachalan': 1, 'sensic': 6, 'dogmatist': 1, 'botega': 1, 'universalis': 1, 'unphilosoph': 1, 'readymad': 1, 'parmistan': 3, 'rubali': 1, 'ondemand': 1, 'meso': 6, 'avow': 2, 'loll': 4, 'phychadel': 1, 'vacuous': 2, 'susann': 2, 'sweatili': 1, 'reapprais': 1, 'tian': 6, 'reachabl': 1, 'recurs': 1, 'budah': 1, 'crispen': 1, 'awkrawrd': 1, 'matlock': 6, 'nack': 1, 'maner': 1, 'xer': 1, 'mana': 1, 'pagemast': 1, 'endectomi': 1, 'concid': 1, 'punctual': 1, 'speedomet': 1, '145': 2, 'supercharg': 1, '300c': 1, 'gelo': 1, 'jelousi': 1, 'sylk': 2, 'ender': 4, 'kroko': 7, 'bascal': 1, 'farina': 2, 'tenness': 2, 'weezer': 1, 'tabasco': 3, 'throuout': 1, 'miah': 1, 'assi': 1, 'chutki': 1, 'naab': 1, 'daal': 1, 'naa': 2, 'isha': 6, 'koppikar': 3, 'hallowe': 1, 'allo': 2, 'fitz': 21, 'cw': 8, 'ncc': 1, '1701': 1, 'pilliar': 1, 'majel': 1, 'rampart': 1, 'giovon': 2, 'maier': 1, 'orthoped': 1, 'hubiriff': 1, 'adj': 1, 'redack': 1, 'disint': 1, 'sargasso': 2, 'mollusk': 1, 'thst': 1, 'alix': 3, 'schloss': 2, 'twentyish': 1, 'tutori': 2, 'gandhiji': 3, 'sherwin': 1, 'toyota': 3, 'actuelli': 1, 'hermoin': 2, 'streetlight': 3, 'christmastim': 3, 'cassinelli': 2, 'aye': 4, 'honost': 1, 'donath': 1, 'judmila': 1, 'novotna': 2, 'thebom': 1, 'edgardo': 1, 'maurizio': 1, 'lecouvreur': 1, 'elisir': 1, 'eleazar': 1, 'juiv': 1, 'periton': 1, 'rigoletto': 1, 'kath': 1, 'intermittedli': 1, 'maratama': 1, 'rugini': 1, 'zoimbi': 1, 'misquot': 3, 'nozzl': 1, 'jerile': 1, 'ide': 1, 'trashmast': 1, 'vadim': 1, 'grandmammi': 1, 'cinmea': 1, 'mcloud': 1, 'sloven': 1, 'excorcist': 3, 'dentatta': 1, 'bowri': 1, 'charlez': 1, 'boatswain': 1, 'raton': 1, 'airial': 1, 'alc': 1, 'busom': 1, 'higginbotham': 2, 'lenser': 1, 'chud': 2, 'p45': 1, 'morecamb': 1, 'boxi': 2, 'macquir': 1, 'telemark': 1, 'kampen': 1, 'tungtvannet': 1, 'norsk': 3, 'vemork': 2, 'tarmac': 2, 'trondstad': 1, 'gunnersid': 1, 'wingnut': 1, 'uniron': 2, 'subhuman': 5, 'hellhol': 2, 'fleec': 5, 'ebersol': 2, 'arcati': 6, 'condomin': 1, 'clarion': 1, 'shatta': 1, 'percussionist': 1, 'sluttishli': 1, 'uncoop': 6, 'alarik': 1, 'truncheon': 1, 'chaf': 1, 'starch': 2, 'robben': 1, 'tanuja': 1, 'menon': 2, 'kk': 1, 'dch': 1, 'sunjay': 1, 'dutt': 4, 'frain': 3, 'vilyenkov': 1, 'biochemistri': 1, 'beermat': 1, 'eazi': 1, 'flava': 1, 'flav': 2, 'bearcat': 1, 'brisco': 1, 'apparenli': 1, 'farrakhan': 2, 'hipocraci': 1, 'rienforc': 1, 'steryotyp': 1, 'keshu': 1, 'producerrk': 1, 'aboutth': 1, 'jumbledth': 1, 'dawood': 1, 'familyth': 1, 'characterizationrk': 1, 'boremus': 1, 'boringamitabh': 1, 'timesakshay': 1, 'hamsaryeman': 1, 'scenesbhumika': 1, 'lotth': 1, 'wrenchmul': 2, 'lao': 2, 'rc': 2, 'cowlishaw': 1, 'sensless': 1, 'strangedirect': 1, 'cinematopghaphi': 1, 'grassroot': 1, 'kahlua': 1, 'unsolicit': 1, 'hammil': 1, 'bipe': 1, 'yanci': 1, 'hegemoni': 2, 'contenti': 2, 'irresolut': 2, 'mantan': 2, 'nicodemu': 1, 'drivvl': 2, 'uncomprehens': 2, 'unrelat': 1, 'vegeburg': 3, 'puertorrican': 1, 'maldeamor': 1, 'briana': 1, 'evigan': 1, 'dewan': 1, 'seldana': 1, 'medoli': 1, 'seashel': 1, 'atlantica': 1, 'ineurop': 1, 'pterdactyl': 1, 'ogar': 1, 'hackerl': 1, 'mccenna': 1, 'partum': 1, 'cinematek': 1, 'relaps': 3, 'manticor': 4, 'marabr': 1, 'seriousuli': 1, 'manoeuv': 1, 'keyword': 4, 'britsih': 1, 'kassir': 2, 'winterli': 1, 'shod': 1, 'bloomberg': 1, 'stockton': 2, 'batb': 1, 'overration': 1, 'lastliber': 1, 'wyat': 2, 'cavalryman': 2, 'apolloniu': 2, 'argonautica': 1, 'acquisit': 2, 'vulgat': 1, 'albany234': 1, 'googlemail': 1, 'mestizo': 2, 'barrio': 2, 'castillian': 1, 'suwkowa': 1, 'touissant': 1, 'fof': 2, 'gyro': 2, 'neolith': 1, 'farli': 1, 'guilgud': 3, 'shazbot': 1, 'disnefluff': 1, 'lupu': 2, 'minder': 2, 'replaydvd': 1, 'arlook': 1, 'bulkhead': 1, 'maytag': 2, 'greist': 2, 'burnford': 7, 'chevalia': 2, 'benj': 1, 'thall': 2, 'quadrup': 1, 'rattler': 1, 'meani': 2, 'moonland': 1, 'ipso': 1, 'nox': 1, 'tollan': 1, 'kelowna': 1, 'langara': 1, '214': 1, 'lavend': 9, 'holofernes': 1, 'albinoni': 1, 'zz': 2, 'pah': 9, 'tah': 1, 'noo': 2, 'actionmovi': 1, 'litghow': 1, 'serialkil': 1, 'comig': 1, 'battaglia': 1, 'mobilis': 1, 'shutdown': 1, 'bailor': 1, 'galiano': 1, 'punchier': 2, 'visial': 1, 'nulliti': 1, 'unacquaint': 1, 'ozu': 16, 'yasujiro': 5, 'bardem': 1, 'nunca': 1, 'pasa': 1, 'trainspott': 1, 'nonbeliev': 1, 'budg': 3, 'moonchild': 5, 'interwiew': 2, 'tangerin': 1, 'td': 1, 'preproduct': 2, 'ghettoism': 1, 'slayrid': 1, 'bleu': 1, 'taru': 1, 'spake': 1, 'zhuzh': 1, 'mantrap': 1, 'patria': 1, 'malnourish': 1, 'pima': 1, 'bugrad': 1, 'dabrova': 1, 'lev': 1, 'andreyev': 1, 'sarda': 1, 'carmelo': 1, 'alana': 1, 'garza': 1, 'hemlich': 3, 'storyman': 1, 'summervil': 1, 'watkin': 1, '1871': 1, 'ideologu': 3, '1780': 3, 'edgiest': 1, 'strenuou': 1, 'leonidu': 1, '10yr': 1, 'kabei': 14, 'untaint': 2, 'ingor': 1, 'zerifferelli': 2, 'fairfaix': 1, 'gainsbourgh': 5, 'ciar': 3, 'modernis': 4, 'desist': 1, 'wilcoxon': 2, 'sagramor': 1, 'wm': 2, 'knapsack': 2, 'sare': 1, 'airplay': 2, 'microsecond': 1, 'whitmor': 4, 'meecham': 2, 'laconian': 1, 'kristevian': 1, 'zit': 1, 'semisubmerg': 1, 'unremit': 2, 'eisenmann': 1, 'mephestophelion': 1, 'naw': 2, 'liferaft': 1, 'vincenzio': 1, 'hewlitt': 1, 'agoraphob': 2, 'afresh': 1, 'zaara': 3, 'deewaar': 3, 'zara': 6, 'raghubir': 1, 'rajendra': 1, 'gupta': 1, 'headed': 1, 'embryon': 1, 'perspir': 2, 'crankcas': 1, 'catchword': 1, 'pars': 2, 'alberson': 1, 'sine': 3, 'wellesley': 1, 'unhelp': 1, 'lecheri': 1, 'famdamili': 1, 'metronom': 1, 'se7ven': 1, 'sunburn': 1, 'and3': 1, 'marshland': 1, 'unsatisfactorili': 1, 'henz': 1, 'fllm': 1, 'monolog': 1, 'misser': 1, 'imperfectli': 2, 'connal': 1, 'lapyuta': 1, 'hagarti': 2, 'airfield': 1, 'zabrinski': 1, 'haven': 1, 'donnersmarck': 2, 'ashbi': 4, 'droog': 1, 'hauptmann': 3, 'wust': 4, 'debrief': 2, 'albin': 1, 'skoda': 2, 'ppk': 1, 'splint': 3, 'anteroom': 1, 'gerhard': 1, 'boldt': 1, 'akt': 1, 'musmanno': 1, 'flooz': 1, 'mclellan': 2, '220': 1, 'ethiopia': 1, 'unerringli': 1, 'neseri': 1, 'serlingesqu': 1, 'verri': 2, 'oogey': 1, 'longish': 2, 'spinelessli': 1, 'howzat': 1, 'feeb': 2, 'brea': 1, 'robyn': 2, 'frisch': 1, 'qualen': 2, 'nakatomi': 1, 'columnbin': 1, 'wrightman': 2, 'falon': 1, 'redsox': 3, 'miley': 1, 'damroo': 1, 'bhaje': 1, 'pukara': 1, 'motori': 1, '80yr': 1, 'appendix': 2, 'unignor': 1, 'evilest': 1, 'willaim': 6, 'auzzi': 1, 'aldrin': 6, 'mcmusicnot': 1, 'lv2': 6, 'lv1': 6, 'amusedli': 1, 'hartnett': 23, 'meyerl': 8, 'flender': 3, 'erath': 1, 'maryl': 1, 'grindingli': 2, 'seargent': 1, 'bugger': 6, 'righto': 1, 'larroquett': 1, 'warsaw': 1, 'fannn': 1, 'notriou': 1, 'periscop': 1, 'soot': 1, 'pungenc': 1, 'bung': 1, 'barrelhous': 1, 'sweeten': 4, 'kvell': 1, 'qazaqfil': 1, 'aimanov': 2, 'konec': 1, 'atamana': 1, 'kyz': 1, 'zhibek': 1, 'aldar': 1, 'kose': 1, 'assa': 1, 'nugmanov': 1, 'tsoy': 1, 'igla': 1, 'kazakh': 5, 'sibirski': 1, 'cyrilnik': 1, 'tsar': 1, 'pariti': 1, 'nobdi': 1, 'kvn': 1, 'dyslex': 2, 'intriqu': 1, 'whizz': 3, 'stringfellow': 1, 'advisedli': 2, 'dmax': 1, '155': 1, 'greenthumb': 1, 'ganja': 2, 'damir': 1, 'ayr': 5, 'hmmmmmmmm': 1, 'jbj': 1, 'sidey': 2, 'khiladi': 1, 'zaprud': 3, 'inexpert': 1, 'trappist': 2, 'bonita': 2, 'granvil': 2, 'brulier': 1, 'lector': 1, 'peke': 6, 'exwif': 1, 'chirst': 1, 'asmat': 1, 'circumcis': 2, 'predetermin': 4, 'slideshow': 1, 'vick': 7, 'theatrex': 2, '3who': 1, 'ecolean': 1, 'misspent': 2, 'tpb': 1, 'purposli': 1, 'georgina': 1, 'verbaan': 1, 'freya': 4, 'dracko': 1, 'lockyer': 1, 'fyall': 1, 'dullsvil': 2, 'lessor': 2, 'mancoy': 1, 'explit': 1, 'personalitiesif': 1, 'mxyzptlk': 1, 'giuffria': 1, 'warbuck': 2, 'hannigan': 2, 'eam': 1, 'revelri': 2, 'katryn': 1, 'cameroun': 1, 'policewomen': 1, 'uhura': 1, 'tkom': 1, 'mcmovi': 2, 'virgnina': 1, 'leath': 1, 'hedeen': 1, 'hi8': 2, 'bmovi': 1, '65m': 1, 'noirest': 1, 'sedahl': 2, 'kronfeld': 1, 'hotvedt': 1, 'hovel': 2, 'ignomini': 4, 'macrab': 1, 'pabulum': 2, 'cartooneri': 2, 'elting': 1, 'minett': 1, 'postdat': 1, 'senelick': 1, 'chrystal': 1, 'beija': 2, 'norsemen': 1, 'metamorph': 1, 'numin': 1, 'dictum': 2, 'tribunesan': 1, 'chroniclesan': 1, 'gatto': 1, 'nove': 1, 'cromoscop': 2, 'franciscu': 6, 'toplin': 2, 'gwangi': 1, 'menczer': 1, 'spaak': 1, 'fraticelli': 1, 'moulder': 1, 'sndtrk': 2, 'somethinbg': 1, 'veiw': 2, 'leat': 1, 'cn': 3, 'nurplex': 1, 'defibul': 1, 'unconci': 1, 'lubric': 2, 'fakk': 2, 'bardwork': 1, 'mulletrif': 1, 'karenina': 1, 'tortu': 1, 'ongoing': 1, 'schedual': 1, 'aflac': 1, 'langenkamp': 1, 'tendon': 1, 'mba': 1, 'abt': 1, 'khnh': 2, 'fwd': 1, 'glycerin': 1, 'supers': 2, 'iffr': 1, 'dvid': 1, 'dought': 1, 'romford': 1, 'emsworth': 2, 'prouder': 1, 'psmith': 1, 'counterattack': 1, 'uckridg': 1, 'pinfold': 1, 'showboat': 3, 'matchpoint': 2, 'booooooooobi': 1, 'kinji': 1, 'fukasaku': 1, 'marathan': 1, 'ttkk': 1, '150m': 1, 'lizabeth': 2, 'cardena': 1, 'liten': 1, 'wonderbook': 1, 'erikkson': 3, 'cuticl': 1, 'telemundo': 7, 'azteca': 9, 'presag': 4, 'pscycholog': 1, 'soundtract': 1, 'sych': 1, 'moog': 1, 'colder': 3, 'hulya': 1, 'avsar': 1, 'vildan': 1, 'atasev': 1, 'dreamboat': 1, 'minmay': 1, 'megalmania': 1, 'gij': 1, 'unwork': 1, 'elsei': 1, 'eugenio': 1, 'zannetti': 1, 'phantasmogor': 1, 'otranto': 2, 'sheev': 1, 'forshadow': 1, 'baddddd': 1, 'culloden': 1, 'mallaig': 1, 'aongha': 2, 'seach': 1, 'seachd': 6, 'chertok': 1, 'golovanov': 1, 'inexactitud': 1, 'kolyma': 1, '1100ad': 1, 'hypotherm': 1, 'awlright': 1, 'moostli': 1, 'moost': 1, 'furia': 2, 'marca': 1, 'conran': 4, 'beet': 3, 'doestoeviski': 1, 'whiski': 7, 'titfield': 2, 'revolutionis': 2, 'kierlaw': 1, 'honoust': 2, 'musti': 2, 'visabl': 1, 'glims': 1, 'ring2': 1, 'jaysun': 1, 'jusenkkyo': 1, 'kuno': 2, 'kodachi': 1, 'happosai': 1, 'alterego': 1, 'eamonn': 3, 'marjok': 1, 'woopi': 3, 'animitron': 1, 'khakke': 1, 'stereoin': 2, 'hoblit': 2, 'christien': 1, 'anholt': 1, 'futterman': 1, 'truant': 1, 'camaro': 1, 'whizbang': 2, 'microscop': 5, 'unalt': 1, 'wagontrain': 1, 'unchain': 2, 'pedagogu': 1, 'colvig': 1, 'realllllllli': 1, 'marzipan': 1, 'proberbi': 1, 'tizzi': 3, 'folder': 3, 'bloomin': 2, 'britsh': 1, 'windu': 1, 'youngl': 1, 'loek': 1, 'dikker': 1, 'geert': 1, 'soutendjik': 1, 'eion': 1, 'manji': 2, 'oafi': 1, 'humpp': 1, 'riegert': 4, 'ppi': 1, 'jaglom': 3, 'giraldi': 2, 'undercard': 3, 'depsit': 1, 'cornett': 3, 'janetti': 2, 'tunney': 1, 'borda': 1, 'wippleman': 4, 'kamala': 1, 'tatanka': 3, 'headshrink': 2, 'fatu': 1, 'boringest': 1, 'barbapapa': 1, 'etait': 1, 'mazing': 2, 'freind': 1, 'bute': 1, 'wowwwwww': 1, 'hadddd': 1, 'maaaybbbee': 1, 'ce3k': 1, 'cryptolog': 1, 'blizzard': 3, 'necromaniac': 1, 'schizophreniac': 10, 'giancaspro': 3, 'finishin': 1, 'elfen': 1, 'inuiyasha': 1, 'idon': 1, 'werelik': 1, 'innerc': 1, 'zulun': 1, 'greatdanc': 1, 'pastwhen': 1, 'newyork': 1, 'viewersmay': 1, 'citydur': 1, 'the80': 1, 'andmovi': 1, 'rememberit': 1, 'waith': 1, 'filmok': 1, 'comedyw': 1, 'allw': 1, 'storiesw': 1, 'respectsbut': 1, 'sel': 1, 'worksactor': 1, 'changesohail': 1, 'anjana': 1, 'suknani': 1, 'dismissalpriyanka': 1, 'yidisch': 1, 'zaitung': 1, 'jarmila': 1, 'clarif': 3, 'onesided': 1, 'misfigur': 1, 'aftershock': 1, 'gabi': 1, 'cp': 3, 'unten': 3, 'moviep': 1, 'krissak': 1, 'googi': 1, 'confluenc': 1, 'groupthink': 1, 'manslay': 1, 'ryoma': 1, 'sakamoto': 8, 'hampeita': 1, 'shimbei': 1, 'anenokoji': 1, 'tosa': 1, 'fiefdom': 1, 'masaru': 1, 'hostel2': 1, 'stine': 1, '10line': 1, 'sk8er': 1, 'daybreak': 2, 'travola': 1, 'marlilyn': 1, 'basin': 3, 'afgan': 1, 'knappertsbusch': 2, 'secomb': 5, 'beatif': 2, 'farling': 1, '1908': 1, 'arhtur': 1, 'bretech': 1, 'arvidson': 1, 'rosza': 4, 'steenki': 1, 'nederland': 1, 'boooo': 1, 'exsist': 2, 'thegirl': 1, 'livinston': 1, 'counterman': 1, 'ibm': 3, 'huckabor': 1, 'saint405': 1, 'jerze': 1, 'representin': 1, 'longman': 2, 'parmenti': 1, 'ansen': 1, 'declan': 1, 'trevyn': 1, 'jessup': 3, 'purefoy': 1, 'excpet': 1, 'codswallop': 1, 'pearlman': 3, 'nicgola': 1, 'sergui': 2, 'nixflix': 1, 'whow': 1, 'materialgo': 1, 'dormal': 1, 'auteil': 2, 'flavorless': 2, 'diploma': 6, 'shittier': 1, 'devoreaux': 1, 'universi': 2, 'kany': 1, 'dicul': 1, 'cesspit': 1, 'lankan': 1, 'ewen': 1, 'horshack': 1, 'pallio': 1, '6hour': 2, '1h40': 2, '10000000000000': 2, 'olympian': 2, 'horndog': 1, 'pluperfect': 1, 'cpo': 1, 'babyyeah': 5, 'obrow': 3, 'ganghi': 1, 'bushrang': 1, 'unencumb': 1, 'lighthorseman': 1, 'pavlinek': 1, 'talliban': 1, 'torenstra': 1, 'grahm': 1, 'yeshua': 1, 'jasmind': 1, 'slowmo': 1, 'sutdi': 1, 'alterior': 1, 'flightplan': 2, 'beltrami': 2, 'while': 1, 'seu': 1, 'freer': 1, 'nativo': 1, 'sagamor': 1, '1200f': 1, 'bd': 2, 'suhaag': 1, 'desh': 1, 'preme': 1, 'shirdi': 1, 'sherawali': 1, 'iba': 2, 'firesign': 2, 'cuppa': 1, 'foundl': 3, 'simonetta': 4, 'asther': 1, 'haitian': 2, 'albizo': 1, 'campo': 3, 'bahama': 1, 'bocabonita': 1, 'soy': 2, 'calahan': 1, 'funfair': 1, 'shwartzeneg': 1, 'historythi': 1, 'frigon': 1, 'thurig': 1, 'persepct': 1, 'reviewi': 1, 'einon': 3, 'draco': 2, 'glockenspur': 1, 'aislinn': 1, 'brutti': 1, 'sporchi': 1, 'cattivi': 1, 'changeabl': 1, 'joon': 2, 'ballast': 1, 'founda': 2, 'yong': 1, 'asiat': 1, 'bressonian': 1, 'beineix': 1, 'mouton': 5, 'canbi': 1, '68th': 1, 'groult': 1, 'birkin': 2, 'angasm': 1, 'hupert': 1, 'opprobrium': 1, 'palliat': 2, 'crockazilla': 1, 'centrifug': 2, 'ackerman': 3, 'vandyk': 1, 'sacrin': 1, 'teamo': 1, 'battlecri': 1, 'chika': 1, 'woopa': 1, 'sellick': 1, 'hellborn': 7, 'irremedi': 1, 'hollywod': 2, 'lemongelli': 1, 'realllllllllli': 1, 'clarksburg': 1, 'childress': 5, 'speeder': 8, 'heffron': 1, 'macon': 2, 'deanesqu': 1, 'janit': 1, 'britt': 3, 'luchi': 1, 'watcxh': 1, 'pagegenr': 1, 'thrillertoo': 1, 'ruuun': 1, 'awaaaaay': 1, 'saaaaaav': 1, 'liiiiiiiiif': 1, 'vit': 2, 'klusak': 1, 'filip': 1, 'remunda': 1, 'hypermarket': 1, 'costco': 2, 'uswa': 1, 'affter': 1, 'mchmaon': 1, 'comon': 1, 'meathook': 1, 'dumbsh': 1, 'howarth': 2, 'redemept': 1, 'bansih': 1, 'rayn': 2, 'fla': 2, 'bregman': 1, 'pdvsa': 1, 'cadena': 1, 'jefe': 1, 'ministro': 2, 'justicia': 1, 'defensa': 1, 'superh': 2, 'cratey': 1, 'eissenman': 1, 'fairplay': 1, 'mccarey': 2, 'fieldsian': 1, 'effluvia': 1, '92nd': 2, 'sickingli': 2, 'tired': 1, 'gagool': 2, 'schlep': 2, 'asini': 1, 'rhythym': 1, 'yeesh': 1, 'simpley': 1, 'cajon': 2, 'morganna': 2, 'macbeal': 1, 'prophes': 1, 'pumb': 1, 'freespirit': 1, 'firey': 2, 'molnar': 1, 'melford': 1, 'billingsley': 2, 'berdalh': 1, 'intuitor': 2, 'moviephys': 1, '30k': 1, 'mockmuntari': 1, 'wymer': 7, 'witchmak': 1, 'bci': 2, 'chulawass': 1, 'ishai': 3, 'vernetta': 1, 'balta': 1, 'ferencz': 1, 'novodni': 1, 'katchuck': 1, 'parrish': 3, 'skyway': 1, 'goremeist': 1, 'worest': 1, 'halley': 3, 'luckier': 1, 'tiburon': 2, 'exet': 1, 'wimsey': 1, 'campion': 6, 'devri': 1, 'itt': 1, 'nou': 3, 'bytch': 1, 'republica': 1, 'dominicana': 1, 'suar': 3, 'ahistor': 1, 'eggleston': 1, 'hogbottom': 3, 'takeout': 1, 'katsopoli': 3, 'gladston': 3, 'monstro': 1, 'kosta': 1, 'clytemnastra': 1, 'faton': 3, 'tackiest': 1, 'awwwwww': 1, 'churningli': 1, 'canoeist': 2, '2480': 1, '2400': 1, 'artbox': 1, 'hech': 1, 'greyson': 3, 'agar': 2, 'arou': 1, 'bellami': 4, 'smartassi': 1, 'fakest': 1, '9it': 1, 'skynet': 1, 'hunh': 2, 'homunculi': 1, 'aga': 1, 'whaley': 2, 'curit': 1, 'kubanski': 1, 'kazaki': 1, 'tommyknock': 1, 'dumbbel': 2, 'mopar': 1, 'seminari': 1, 'snigger': 3, 'mig': 1, 'pipedream': 1, 'gwyne': 3, 'vibrato': 2, 'echoey': 1, 'lk2': 1, 'mecgreg': 1, 'weatherli': 2, 'wildcard': 1, 'inem': 1, 'silken': 2, 'zhongwen': 1, 'tsau': 2, 'contentedli': 1, 'strenght': 2, 'muggi': 1, 'ohh': 3, 'afficinado': 1, 'stedicam': 2, 'hardcov': 3, 'krav': 1, 'maga': 1, 'superspi': 1, 'germin': 1, 'photogrsph': 1, '216': 1, 'varotto': 1, 'duilio': 2, 'prete': 1, 'bottacin': 1, 'piso': 1, 'volp': 2, 'adon': 1, 'kasam': 1, 'madhumati': 1, 'overlord': 4, 'ftagn': 1, 'yog': 2, 'sototh': 1, 'magsel': 1, 'cele': 3, 'jiggli': 2, 'westsid': 1, 'spatulamad': 1, 'filmcow': 1, 'zira': 3, 'overtook': 2, 'unsteer': 1, 'nonono': 1, 'submachin': 2, 'nicolson': 1, 'matelot': 1, 'beholden': 3, 'waacki': 1, 'niall': 1, 'mcneic': 1, 'thine': 3, 'hywel': 1, 'bennet': 4, 'reinstat': 2, 'tutoy': 1, 'shamu': 1, 'galoot': 1, 'bandolero': 1, 'mysoginist': 1, 'citadel': 3, 'styne': 6, 'cahn': 8, 'chromat': 1, 'brocki': 1, 'macphearson': 1, 'movieman': 1, 'problemo': 1, 'jyada': 1, 'safan': 1, '300mln': 1, 'buttafuoco': 2, 'gloam': 1, 'foppishli': 1, 'alistar': 1, 'knieval': 4, 'multitudin': 1, 'udit': 1, 'narayan': 1, 'ruscico': 2, 'blaringli': 1, 'hew': 2, 'coachli': 1, 'satta': 2, 'galbo': 1, 'candelabra': 1, 'residencia': 1, 'serrador': 2, 'aetheri': 1, 'candyshack': 1, 'spiti': 1, 'moebiu': 1, 'giraud': 1, 'myazaki': 1, 'japnanes': 1, 'thornberri': 2, 'charendoff': 1, 'hailstorm': 1, 'hamnet': 1, 'nadjiwarra': 1, 'hopi': 1, 'purif': 2, 'xtragavaganza': 1, 'mclaren': 3, 'tlk': 3, 'screwloos': 1, 'tlk3': 1, 'grossvatertanz': 1, 'tashlin': 3, 'inadvis': 1, 'yokel': 4, 'hicksvil': 1, 'diurnal': 1, 'proctor': 1, 'deathwatch': 1, 'mendocino': 1, 'pleeeas': 1, 'petroichan': 1, 'freebas': 1, 'largess': 5, 'reverenti': 3, 'willa': 2, 'disconnected': 1, 'reschedul': 1, 'jaret': 1, 'winokur': 1, 'rupe': 3, 'vashti': 1, 'purim': 1, 'mian': 3, 'xiong': 1, 'cang': 1, 'ludlam': 1, 'yitzhack': 1, 'unabashedli': 4, 'toiletri': 1, 'unachiev': 2, 'anatomis': 1, 'misforgiv': 1, 'comapni': 1, 'quisessenti': 1, 'hwang': 1, 'moster': 1, 'velizar': 1, 'binev': 1, 'zita': 1, 'stepto': 3, 'houseguest': 3, 'koyamada': 1, 'ecclesiast': 1, 'kolo': 2, 'venin': 1, 'fieriest': 1, 'versoi': 1, 'limey': 2, 'nightwatch': 1, 'dwarv': 2, 'bladrick': 1, 'limerick': 2, 'claythen': 1, 'awayin': 1, 'unscrew': 1, 'agusti': 3, 'maloni': 5, 'desando': 1, 'whacke': 1, 'yaitan': 1, 'dreamili': 3, 'gaili': 1, 'enduringli': 1, 'akai': 1, 'yasoumi': 1, 'umetsu': 1, 'rubberneck': 4, 'farwel': 1, 'paintbrush': 2, 'gagorama': 1, 'cruditi': 3, 'deaki': 1, 'erian': 1, 'wharton': 1, 'funicello': 1, 'stomper': 1, 'bankrobb': 2, 'kanali': 2, 'pierpont': 4, 'feitshan': 1, '4rove': 1, 'geociti': 1, 'johnr': 1, 'walkway': 1, 'spaceflight': 1, '2038': 1, 'versio': 1, 'kwriceher': 1, 'dowri': 5, 'ryuhei': 5, 'whera': 1, 'breakaway': 1, 'turret': 5, 'mot': 1, 'cyrano': 1, 'bergerac': 1, 'courtin': 1, 'chatterbox': 1, 'boater': 1, 'pharma': 1, 'sharkuman': 1, 'garbagep': 1, 'newstart': 1, 'georgett': 1, 'buttermilk': 1, 'vaudevillesqu': 1, 'thishey': 1, 'ruehl': 2, '9that': 1, 'sholem': 1, 'hrshitta': 1, 'jaitley': 3, 'shayari': 1, 'sini': 3, 'chartbust': 1, 'superbowl': 1, 'millenium': 1, 'provincetown': 1, 'hepo': 1, 'morneau': 1, 'rangeela': 1, 'beeru': 1, 'bubban': 1, 'afleck': 2, 'duda': 1, 'waistlin': 1, 'altioklar': 2, 'janset': 1, 'bedingfield': 1, 'ashanti': 9, 'wilkerson': 2, 'carfar': 1, 'shnook': 1, 'dicenzo': 2, 'ivor': 1, 'pflug': 2, 'incompassion': 2, 'crapul': 1, 'folow': 1, 'humm': 1, 'draperi': 3, 'mciver': 2, 'staffer': 3, 'laslo': 1, 'stayer': 1, 'helvard': 1, '27x41': 1, 'couturi': 4, 'greenfield': 2, 'blammo': 2, 'trudeau': 2, 'clitarissa': 1, 'arrrrrggghhhhhh': 1, 'amphetamin': 1, 'mvd': 1, 'lateesha': 1, 'urgh': 2, 'afghani': 1, 'chocco': 1, 'mescalin': 2, 'airstrip': 2, 'exciti': 1, 'therefrom': 1, 'marconi': 1, 'lightol': 2, 'wrinkler': 1, 'rabifi': 1, 'tenshu': 3, 'volley': 4, 'anorexia': 1, 'nervosa': 1, 'wolfstein': 2, 'cellulos': 1, 'reacquaint': 1, 'preener': 1, 'jerkiest': 1, 'lushli': 4, 'nipper': 2, 'vadar': 11, 'rougish': 1, 'srtike': 1, 'carbonit': 2, 'mcdiarmiud': 1, 'repriev': 4, 'deatn': 1, 'empor': 3, 'straggl': 1, 'barbershop': 1, 'wurb': 6, 'tino': 2, 'demob': 1, 'fonzi': 1, 'nordisch': 1, 'filmtag': 1, '50min': 3, '10min': 1, 'savanna': 1, 'bonhoeff': 5, 'discipleship': 1, 'washinton': 1, 'volkswagen': 3, 'ritin': 1, 'rithmet': 1, 'insterest': 1, 'bohnen': 1, 'howcom': 1, 'ngo': 1, 'loveearth': 1, '08th': 1, 'transsylvanian': 2, 'crossco': 3, 'wideescreen': 1, 'leboeuf': 2, 'archiev': 1, 'legendri': 1, 'misra': 1, 'mausi': 2, 'gangu': 1, 'aap': 1, 'surror': 1, 'huf': 1, 'nochnoi': 1, 'dozor': 2, 'counterstrik': 1, 'breslin': 3, 'psilcyb': 1, 'cubensi': 1, 'curabl': 1, 'wamp': 1, 'tk427': 1, 'undr': 1, 'knightrid': 1, 'ventresca': 3, 'jacquet': 5, 'wassup': 1, 'crossfac': 1, 'dudleymatch': 1, 'nidia': 4, 'noblematch': 1, 'hurracanrana': 1, 'rollup': 1, 'hardymatch': 1, 'y2j': 2, 'lionsault': 2, 'cenamatch': 1, 'lesnar': 2, 'heyman': 4, 'rvdmatch': 1, 'tannounc': 1, 'bishoff': 2, 'nwo': 1, 'superkick': 1, 'turnbuckl': 1, 'strom': 1, 'riksihi': 1, 'pinfal': 1, 'stormmatch': 1, 'naboombu': 1, 'piznarski': 2, 'smitrovich': 3, 'corley': 2, 'unhellish': 1, 'bleaker': 2, 'tattoin': 1, 'bantha': 2, 'sarlacc': 3, 'boba': 1, 'dagoba': 1, 'hermamdad': 1, 'eislin': 1, 'enslin': 5, 'kringen': 1, 'magnesium': 1, 'sulfat': 1, 'epsom': 1, 'hotd': 4, 'nietsz': 1, 'cornelia': 2, 'taranitar': 1, 'f117': 2, 'eyeless': 1, 'bleeder': 1, 'tormento': 1, 'equivoc': 2, 'precious': 2, 'shojo': 1, 'espesci': 1, 'superfluous': 1, 'rotton': 1, 'laught': 2, 'yukfest': 1, 'upmanship': 2, 'underprivileg': 2, 'archriv': 2, 'kareem': 1, 'jabaar': 1, 'electroshock': 4, 'riverd': 2, 'dystroph': 2, 'epidermolysi': 2, 'bullosa': 2, 'eb': 3, 'languagemi': 2, '14a': 2, 'sik': 1, 'dangan': 1, 'ranna': 1, 'yappi': 1, 'unoutstand': 1, 'cabarnet': 1, 'bidenesqu': 1, 'pentimento': 1, 'mooner': 1, 'ould': 5, 'produer': 1, 'deleuis': 1, 'amandola': 1, 'davil': 1, 'hammand': 1, 'acheaolog': 1, 'inground': 1, 'pennington': 2, 'godspel': 1, 'longingli': 2, 'muckerji': 3, 'melandez': 1, 'algernon': 1, 'monicelli': 3, 'cardinal': 4, 'ox': 2, 'fyodor': 1, 'chaliapin': 1, 'bovasso': 1, 'despotovich': 1, 'rychard': 2, 'unspool': 2, 'zenobia': 3, 'pzazz': 1, 'pelicul': 1, 'offlin': 2, '1146': 1, '2033': 1, 'iqub': 1, 'pepa': 1, 'buckwheat': 2, 'saxoni': 1, 'beconsid': 1, 'drearymovi': 1, '00pm': 4, 'yammer': 2, 'marmaduk': 2, 'oldfish': 2, 'custard': 3, 'rocqu': 1, 'eeeww': 1, 'gribbon': 2, 'braci': 1, 'paleograph': 1, 'thatwasjunk': 1, 'professionel': 1, 'pothu': 1, 'extremit': 1, 'sedari': 2, 'maisi': 1, 'angelu': 1, 'sudan': 1, 'rotk': 2, 'alleb': 1, 'clarinett': 1, 'estupido': 1, 'dashboard': 1, 'insecticid': 1, 'riverbank': 1, 'iordach': 1, 'yardstick': 4, 'promt': 1, 'thehollywoodnew': 1, 'maybl': 1, 'riget3': 1, 'slajp': 1, 'kerwin': 1, 'pffeifer': 1, 'gothenburg': 2, 'raymi': 1, 'hightail': 1, 'vancamp': 1, 'pandem': 2, 'shingl': 1, 'shipka': 1, 'debi': 3, 'bl': 1, 'walliam': 1, 'tchi': 1, 'umpir': 3, 'admire': 1, 'suck3d': 1, 'egm': 1, 'luzhini': 1, 'gallantri': 1, 'ballbust': 1, 'assasin': 1, 'rigshospitalet': 1, 'gloster': 3, '262': 1, 'yearbook': 3, 'foabh': 3, 'westbound': 1, 'reship': 1, 'zedora': 1, 'besch': 1, 'thermostat': 2, 'goivern': 1, 'pinata': 3, 'aortic': 2, 'humberfloob': 1, 'supe': 1, 'lexcorp': 1, 'ibiza': 3, 'beatriz': 1, 'batarda': 1, 'goforth': 1, 'haft': 2, 'highsmith': 5, 'memoriam': 1, 'undeservingli': 1, 'chamberland': 1, 'baffel': 2, 'cuisinart': 1, 'dweezil': 1, 'holdout': 1, 'monika': 3, 'lith': 3, 'tomcat': 1, 'terpsichorean': 2, 'unclad': 1, 'lacquer': 2, 'goodgfella': 1, 'part2': 6, 'h3ll': 1, 'daym': 1, 'mconaughey': 2, 'edtv': 1, 'amistad': 1, 'springit': 1, 'ineff': 2, 'foretast': 1, 'sexualin': 1, 'couldrel': 1, 'actiona': 1, 'nonthreaten': 1, 'rehydr': 1, 'repaid': 1, 'katey': 10, 'kaley': 7, 'cuoco': 6, 'spanjer': 5, 'pleshett': 1, 'bouffant': 1, 'upclos': 1, 'mostess': 1, 'cornwal': 6, 'legislatur': 3, 'missourian': 1, 'frontyard': 1, 'gateshead': 2, 'scatchard': 1, 'wrung': 2, 'kc': 2, 'katia': 2, 'koslovska': 1, 'shallowest': 2, 'witherspooon': 1, 'schubert': 3, 'leoncavallo': 1, 'matinatta': 1, 'pav': 1, 'gioconda': 1, 'lescaut': 1, 'deodor': 1, 'tasha': 2, 'yar': 1, 'probablythi': 1, 'banger': 3, 'mcgarrett': 2, 'onhand': 1, 'seawal': 1, 'lineyuck': 1, 'klump': 1, 'gordito': 1, 'rebuttl': 1, 'comparrison': 1, 'albertson': 3, 'insteaddamn': 1, 'nogot': 1, '183': 3, '197': 1, 'midi': 1, 'chlorian': 1, 'leterri': 1, 'fta': 2, 'gottdog': 1, 'ture': 1, 'lauuugh': 1, 'salutori': 1, 'copout': 2, 'changeov': 2, 'walla': 1, 'aielo': 2, 'santimoni': 1, 'ladylov': 2, 'dissasatisfi': 1, 'pizazz': 4, 'beadi': 1, 'basicali': 1, 'nasuem': 1, 'shirou': 2, 'gilgamesh': 1, 'anddd': 1, 'staphan': 1, 'mudler': 2, '58th': 1, 'yoji': 4, 'committ': 3, 'tasogar': 1, 'sebei': 1, 'jethro': 6, 'jlo': 1, 'beter': 1, 'massiah': 1, 'tiana': 1, 'galile': 1, 'sedit': 2, 'pontiu': 1, 'tactil': 1, 'tersteegh': 1, 'octress': 1, 'cbe': 1, 'ingal': 1, 'fastbreak': 1, 'chairwoman': 1, 'handsomest': 2, 'butchest': 1, 'arithmet': 2, 'hsien': 12, 'flotilla': 1, 'chekovian': 1, 'smoggi': 1, 'hoberman': 1, 'cambpel': 3, 'meritocraci': 3, 'araki': 1, 'parka': 1, 'jackboot': 2, 'burkhalt': 1, 'kroona': 1, 'primeiv': 1, 'triplet': 3, 'klimt': 1, 'garbageman': 1, 'nearn': 1, 'searchlight': 1, 'antown': 1, 'itc': 1, 'legionnair': 8, 'disciplinarian': 3, 'marneau': 2, 'erfoud': 2, 'segrain': 1, 'beatlemaniac': 1, 'stanfield': 1, 'autocraci': 1, 'emeryvil': 1, 'yosimit': 1, 'dixton': 1, 'russwil': 1, 'vila': 1, 'ladin': 2, 'babelfish': 1, 'diavalo': 1, 'celebriti': 1, 'tommorow': 1, 'doberman': 3, 'zue': 2, 'moviemanmenzel': 1, 'hidebound': 2, 'lansford': 3, 'monkeybon': 1, 'headset': 3, 'conquistador': 6, 'hernando': 3, 'preliminari': 4, 'sleestak': 1, 'reconnoit': 1, 'caterwaul': 1, 'unfortuntli': 1, 'naiev': 1, 'foward': 1, 'bardeleben': 1, 'steinitz': 2, 'adjourn': 1, 'xzptdtphwdm': 1, 'tryfon': 1, 'hrolfgar': 1, 'windlass': 1, 'steelcraft': 1, 'leza': 1, 'marita': 2, 'cyncial': 1, 'sighted': 2, 'vlog': 1, 'stuyves': 1, 'yaniss': 1, 'lespart': 1, 'rousch': 1, 'portho': 1, 'trinneer': 1, 'brannon': 3, 'scrutinis': 1, 'zefram': 1, 'orel': 1, 'extream': 1, 'seinc': 1, 'kr': 1, 'ultramagnet': 1, 'bizmarki': 1, 'y2k': 2, 'reichstag': 1, 'toten': 1, 'winkel': 1, 'eila': 1, 'fallback': 2, 'hoppalong': 1, 'laila': 4, 'tredg': 1, 'quato': 1, 'kuriyami': 2, 'liquidis': 1, 'molten': 4, 'earpiec': 1, '735': 1, 'angelwa': 1, 'naaah': 1, 'stratifi': 1, 'assylum': 1, 'kunst': 1, 'heiligt': 1, 'lueg': 1, 'citroen': 3, 'n1': 1, 'sendback': 1, 'unfasten': 1, 'flouder': 1, 'proced': 1, 'conga': 3, 'unacur': 1, 'cree': 2, 'doggish': 1, 'satiricl': 1, 'bleah': 2, 'mainardi': 1, 'muri': 4, 'eynd': 1, 'dotterman': 1, 'pittor': 1, 'doroth': 1, 'bergh': 1, 'merr': 1, 'alona': 1, 'kamhi': 1, 'poseidon': 3, 'liftoff': 2, 'splashdown': 1, 'metamorphsi': 1, 'genom': 1, 'gordiou': 1, 'normalo': 1, 'crispian': 1, 'allif': 1, 'leprou': 2, 'zhao': 2, 'zhigang': 2, 'bie': 1, 'ladron': 1, 'mentiroso': 1, 'framelin': 1, 'experient': 1, 'manqu': 2, 'forma': 1, 'cohol': 1, 'hopp': 1, 'sfsu': 1, 'soilder': 1, 'wroth': 1, 'muito': 1, 'riso': 1, 'muita': 1, 'alegria': 1, 'outhous': 3, 'ooooh': 3, 'qustion': 1, 'gavilan': 2, 'investigationif': 1, 'britch': 2, 'waxork': 1, 'milennium': 1, 'ioan': 4, 'gruffudd': 4, 'naif': 2, 'xv': 3, 'cavalcad': 2, 'roquevert': 3, 'herrand': 2, 'nombr': 2, 'vilarasau': 1, 'capta': 1, 'spurist': 1, 'unselfishli': 1, 'vampireladi': 1, 'meatmarket2': 1, 'spradlin': 2, 'encumb': 2, 'eshkeri': 1, 'damningli': 1, 'norbit': 2, 'stalon': 1, 'dredd': 1, 'zecchinomanasota': 1, 'florida05': 1, 'nicoli': 3, 'accessor': 1, 'dattilo': 1, 'goldin': 1, 'mindbogglingli': 1, 'videowork': 1, 'insipidli': 3, 'themself': 2, 'dorf': 6, 'overbroad': 1, 'hoodoo': 1, 'fabinyi': 1, 'turnbil': 1, 'tigh': 1, 'leonora': 22, 'huff': 4, 'ainsworth': 1, 'doppler': 1, 'f5': 1, 'televangelist': 4, 'tith': 2, 'backflash': 2, 'shetan': 2, 'sagr': 1, 'friesian': 1, 'ishaak': 1, 'lough': 1, 'ofr': 1, 'hedren': 3, 'hatcheck': 1, 'casablanka': 1, 'nahh': 1, 'lassit': 2, 'kewl': 3, 'spiritit': 1, 'befittingli': 1, 'bilater': 2, 'sagaci': 1, 'favort': 1, 'egocentr': 6, 'conrow': 2, 'wohl': 1, 'tuckwil': 1, 'delventh': 1, 'caulder': 1, 'ixp': 1, 'vaut': 1, 'pein': 1, 'amnes': 1, 'jugar': 1, 'kazak': 1, 'ueli': 1, 'laustsen': 2, 'waistband': 2, 'tarquin': 3, 'canna': 1, 'zd': 2, '7ish': 1, 'egoism': 1, 'kinfolk': 2, 'ambigi': 2, 'indicit': 1, 'carrion': 1, 'longshank': 1, 'epidemi': 1, 'callarn': 3, 'cowardac': 1, 'vexat': 1, 'effett': 1, 'broadsword': 1, 'scotsmen': 1, 'shakespher': 1, 'scotish': 1, 'nagai': 2, 'sunburst': 1, 'gooli': 1, 'tendr': 3, 'phillistin': 1, 'amithab': 1, 'devagan': 1, 'stepmotherhood': 2, 'spahn': 1, 'tagg': 7, 'widdecomb': 1, 'businesspeopl': 1, 'alla': 5, 'toral': 1, 'rolodex': 1, 'omarosa': 1, 'rgb': 1, 'propabl': 1, 'yob': 2, 'munoz': 1, 'jianna': 2, 'videotequ': 1, 'dror': 1, 'shaul': 1, 'kibbutzim': 2, 'mindscrew': 1, 'awara': 1, 'paagal': 1, 'soll': 5, 'rayvyn': 1, 'rocchi': 1, 'salutari': 1, 'essayist': 1, 'cuzak': 1, 'blackbird': 1, 'meysel': 5, 'petersson': 2, 'dethron': 3, 'couriu': 1, 'oleari': 1, 'sto': 1, '80ish': 1, 'csiko': 1, 'horsemen': 2, 'puszta': 1, 'kungfu': 1, 'qing': 1, 'maso': 1, 'admitedli': 1, 'mah': 3, 'velou': 1, 'vg': 1, 'novikov': 1, 'pf': 2, 'funner': 2, 'ahet': 1, 'satuday': 1, 'medevil': 1, 'wheatlri': 1, 'wheatley': 1, 'wrongggg': 1, 'twirli': 1, 'illig': 1, 'picnick': 1, 'bordeaux': 2, 'vam': 2, 'viv': 1, 'dewaana': 1, 'nadeem': 1, 'shravan': 1, 'socheng': 2, 'tumh': 2, 'koyi': 2, 'chahiyy': 1, 'dewanna': 1, 'toung': 1, 'oomph': 4, 'transper': 1, 'lm': 1, 'boly': 1, 'reshoski': 1, 'uninflect': 1, 'yamashiro': 1, 'fogi': 3, 'honkin': 1, 'baler': 1, 'augh': 1, 'bliep': 1, 'commonwealth': 2, 'guniea': 1, 'unterwaldt': 1, 'machinist': 1, 'psychedelia': 1, 'jrr': 1, 'veiwer': 1, 'polemicist': 1, 'bookshop': 4, 'mepri': 1, 'reimagin': 1, 'fanbas': 5, 'divoff': 1, 'struycken': 2, 'dutchman': 7, 'criminolog': 1, 'vivant': 4, 'unhackney': 1, 'larsen': 1, 'singlet': 1, 'teamnot': 1, 'fratricid': 2, 'soundli': 2, 'beget': 3, 'finalist': 1, 'inpenetr': 1, 'automata': 1, 'ptss': 1, 'collosu': 1, 'holobrothel': 1, 'planetscap': 1, 'bedpost': 1, 'wrongdo': 2, 'chamberlin': 1, 'cringey': 1, 'excorsist': 1, 'mezrich': 2, 'halfbak': 1, 'smokl': 1, 'uneffect': 1, 'nella': 3, 'stretta': 1, 'morsa': 1, 'ragno': 1, 'vidhu': 1, 'vinod': 2, 'deewar': 2, 'flophous': 1, 'abott': 1, 'chessecak': 1, 'disneylik': 1, 'timebomb': 2, 'hantz': 1, 'ua': 4, 'matkondar': 1, 'bhajpai': 1, 'bernicio': 1, 'nimbu': 1, 'herzogian': 1, 'sabbath': 2, 'isoyg': 3, 'ilha': 1, 'sangu': 1, 'pigmalion': 1, 'asymmetr': 1, 'ttono': 2, 'alumna': 1, 'geritan': 1, 'clover': 2, 'choo': 6, 'shipiro': 1, 'sarasohn': 1, 'brotherwood': 1, 'doyon': 1, 'artagnan': 2, 'jalous': 1, 'adopte': 2, 'ghent': 2, 'touristi': 2, 'vicotria': 2, 'reeeaalli': 1, 'deeeeeep': 1, 'vieila': 1, 'dalia': 3, 'hearen': 1, 'kirilian': 1, 'daimen': 1, 'mchael': 1, 'lehch': 1, 'felichi': 1, 'temperememt': 1, 'motta': 1, 'bullit': 1, '529': 1, 'evert': 1, 'tawnyteel': 1, 'wolverinish': 1, 'myrick': 2, 'newberri': 1, 'lieber': 1, 'kolton': 1, 'phiniu': 1, 'meskimen': 1, 'annisten': 1, 'undercook': 2, 'studious': 2, 'athenian': 1, 'whotta': 1, 'vepsaian': 1, 'kimi': 3, 'momo': 7, 'muham': 1, 'youssou': 1, 'luxemburg': 2, 'amir': 1, 'leroi': 1, 'senegales': 2, 'seaward': 1, 'rigour': 1, 'counteroff': 1, 'reay': 1, 'greytack': 1, 'apel': 1, 'chhaliya': 1, 'piquantli': 1, 'roshambo': 1, 'karega': 2, 'mustan': 4, 'cccc': 5, 'madhubala': 9, 'kya': 1, 'kehna': 1, 'brielfi': 1, 'dumbl': 1, 'smokingli': 1, 'gibber': 2, 'tyrran': 1, 'marquez': 7, 'incr': 1, 'ibl': 1, 'trist': 1, 'historia': 1, 'ndida': 1, 'ndira': 1, 'eventhough': 1, 'gorbachev': 1, 'gorbi': 1, 'brainlessli': 1, 'patoi': 2, 'hesitantli': 1, 'longueur': 2, 'trauner': 1, 'jaubert': 1, 'prevert': 1, 'strenghten': 1, 'ophul': 3, 'sierck': 2, 'neuen': 1, 'ufern': 1, 'habenera': 1, 'waterway': 1, 'manmad': 1, 'menjou': 2, 'kotero': 3, 'kureshi': 1, 'hightlight': 2, 'fownd': 1, 'uneasili': 1, 'antionioni': 2, 'giuliana': 1, 'roofer': 1, 'rearis': 1, 'hallier': 2, 'jhene': 2, 'lastewka': 2, 'kalasaki': 1, 'nonstraight': 1, '4kid': 4, 'escargoon': 1, 'deded': 2, 'bunkum': 1, 'untrac': 5, 'genghi': 4, 'angrier': 3, 'shtoop': 1, 'meshuganah': 1, 'chahract': 1, 'shakher': 1, 'hawki': 1, 'alcid': 1, 'gertr': 1, 'albaladejo': 1, 'gaspar': 3, 'seul': 1, 'contr': 1, 'tou': 1, 'uncronolog': 1, '10fan': 1, 'cronicl': 1, 'cothk': 5, 'ummmm': 1, 'marmo': 1, 'loooooooov': 1, 'yate': 5, 'sharehold': 1, 'nutsack': 1, 'bowzer': 1, 'riefenstal': 1, 'defray': 1, 'wehl': 1, 'mcneeli': 1, 'cappuccino': 1, 'orna': 1, 'avantguard': 1, 'stillborn': 2, 'becas': 1, 'appelonia': 1, 'daw': 3, 'wiretap': 1, 'sloper': 2, 'insle': 3, 'vieux': 1, 'garcon': 1, 'g7': 2, 'osterman': 1, 'wacth': 1, 'haywagon': 1, 'calligraph': 1, 'suey': 1, 'hairstylist': 1, 'hooror': 1, 'filmmmak': 1, '149': 2, 'arahan': 2, 'yoon': 3, 'asumi': 1, 'seung': 1, 'ryoo': 1, 'huntsberi': 1, 'fulltim': 1, 'coulthard': 2, 'ocsar': 1, 'athol': 2, 'fugard': 1, 'captian': 1, 'coralin': 2, 'luthercorp': 1, 'gallner': 1, 'coool': 1, 'philosophis': 2, 'nachoo': 1, 'narcolept': 2, 'joshuatre': 1, 'girlfirend': 1, 'hippest': 1, 'starsailor': 1, 'factoid': 2, 'embarassingli': 1, 'itv1': 1, 'nickeleoden': 1, 'mellissa': 1, 'clarrissa': 1, 'schintzi': 1, 'laru': 2, 'arminass': 1, 'defenetli': 1, 'answear': 1, 'theid': 2, 'higli': 1, 'wouln': 1, 'pos': 1, 'exatur': 1, 'whalberg': 1, 'unbielev': 1, 'gutenberg': 2, 'shenar': 6, 'flagiti': 1, 'doxi': 1, 'quirkili': 1, 'wournow': 1, 'holoband': 2, 'karadagli': 1, 'russsia': 1, 'oom': 3, 'evident': 1, 'morrocco': 2, 'campout': 1, 'teamup': 1, 'shepherdess': 2, 'voerhoven': 3, 'duperi': 1, 'unfortunt': 1, 'orlandi': 1, 'hearfelt': 1, 'paintshop': 1, 'phawa': 1, 'yashpal': 1, 'burress': 1, 'calil': 1, 'johhni': 2, 'atkinmson': 1, 'tatou': 3, 'timmon': 2, 'splutter': 1, 'rossetti': 1, 'ame': 3, 'naushad': 2, 'wirsch': 1, 'logophobia': 1, 'logophob': 1, 'filmograpghi': 1, 'dotcom': 1, 'unpleasantri': 2, 'bloodwork': 1, 'bernier': 2, 'sossamon': 2, 'rmann': 1, 'pressman': 1, 'ditech': 1, 'conservit': 1, 'tremont': 1, 'vaxham': 1, 'zellerbach': 1, 'amsden': 1, 'arngrim': 1, 'yeeshhhhhhhhhhhhhhhhh': 1, 'padr': 1, 'avenet': 3, 'unnecess': 1, 'with': 2, 'gest': 1, 'colic': 1, 'mori': 1, '142': 1, 'subtextu': 1, 'tremul': 3, 'cinematic': 1, 'relinquish': 4, 'dividend': 3, 'seon': 1, 'yeop': 1, 'arduous': 1, 'pablito': 2, 'jackanap': 1, 'melancholia': 1, 'undocu': 1, 'milburn': 2, 'wellspr': 2, 'fengler': 1, 'fowel': 1, 'interpretor': 2, 'postlewait': 1, 'piedgon': 1, 'unfussi': 1, 'spadafor': 1, 'atla': 4, 'undershort': 1, 'ragnek': 3, 'dirtmast': 1, 'mesmerizingli': 2, 'kastl': 1, 'chemotrod': 1, 'sozzl': 1, 'montezuma': 1, '5400': 1, 'krocodylu': 2, 'ataaaaaaaaaaaaaaaack': 1, 'olphelia': 1, 'rapier': 4, 'tarpon': 1, 'michalka': 4, 'somethihng': 1, 'anniko': 1, 'senesh': 1, 'resistor': 1, 'doctorin': 1, 'uesa': 1, 'romefel': 1, 'bibbiti': 1, 'bobbiti': 1, 'serra': 2, 'patrizio': 1, 'flosi': 1, 'ferilli': 1, 'montorsi': 1, 'transunto': 1, 'sforza': 1, 'undetermin': 1, 'lima': 4, 'cousteau': 3, 'throughtak': 1, 'montroc': 1, 'countryfolk': 1, 'origon': 1, 'deewano': 1, 'badnam': 1, 'devji': 1, 'nepal': 5, 'aod': 3, 'alisha': 3, 'woerner': 2, 'louisianan': 1, 'mayfair': 1, 'nightsheet': 1, 'villechez': 1, 'macrauch': 2, 'pliskin': 1, 'baseman': 1, 'persiflag': 1, '9mm': 3, 'slobberi': 1, 'milki': 1, 'dixen': 1, 'mayal': 1, 'sleez': 1, 'sholey': 1, 'thakur': 8, 'radioraptu': 1, 'liga': 1, 'dieci': 1, 'guccini': 1, 'higson': 2, 'chillout': 1, 'reifi': 1, 'unimpeach': 2, 'coutt': 1, 'debauch': 2, 'expressli': 2, 'disallow': 1, 'append': 1, 'unsens': 1, 'cda': 1, 'peoria': 3, '2257': 1, 'litmu': 1, 'candian': 1, 'knewfrom': 1, 'improvisationalcomedi': 1, 'andromant': 1, 'areal': 1, 'ranko': 4, 'bozic': 4, 'mihic': 3, 'argeninean': 1, 'gobbler': 3, 'settlefor': 1, 'paytv': 1, 'tukur': 2, 'churchman': 1, 'malkovitchesqu': 1, 'shepley': 1, '31st': 4, 'rosenstein': 3, 'milbrant': 1, 'fars': 1, 'gaionsbourg': 1, 'invoc': 1, 'diabolist': 1, 'ricchi': 1, 'brasher': 1, 'aphasia': 1, 'enfin': 1, 'oui': 2, 'meke': 1, 'conver': 1, 'hitlist': 2, 'stroppi': 1, 'burnsian': 1, 'odagiri': 1, 'hjelmet': 1, 'fleer': 1, 'filmrol': 1, 'quasirealist': 1, 'cellophan': 1, 'damper': 2, 'pleasantvillesqu': 1, 'doan': 1, 'boatwork': 1, 'barem': 1, 'kwami': 1, 'taha': 1, 'middlesex': 1, 'wounderful': 1, 'argonn': 4, 'zinn': 3, 'convect': 1, 'lilienth': 1, 'carbid': 2, 'subsidiari': 2, 'hohenzollern': 1, '003830': 1, 'kdo': 1, 'okw': 1, 'wfst': 1, '498': 1, 'declassifi': 1, '5200': 1, 'oss': 1, '6723': 1, 'whittier': 1, '22101': 1, 'rajni': 11, 'shivaji': 1, 'offworld': 1, 'lineag': 2, 'saugag': 1, 'centenari': 2, 'numero': 1, 'uno': 1, 'chich': 2, 'liggin': 1, 'mcgyver': 1, 'fantasist': 2, 'perviou': 1, 'brontean': 1, 'glancingli': 1, 'thoough': 1, 'charat': 1, 'storywrit': 2, 'plaggi': 1, 'letup': 2, 'gilroy': 2, 'regatta': 1, 'outshon': 1, 'kika': 1, 'landen': 1, 'fatboy': 2, 'vaunt': 2, 'matheau': 1, 'fatter': 3, 'beatlemania': 1, 'lunchmeat': 1, 'gereco': 2, 'biotech': 1, 'mandylor': 4, 'commupp': 1, 'hwl': 1, 'respiratori': 1, 'sardonicu': 1, 'burkley': 1, 'shirel': 1, 'ch4': 1, 'merlyn': 1, 'sower': 1, 'playroom': 2, 'rieser': 1, 'unlist': 1, 'tereasa': 1, 'pheacian': 1, 'circ': 1, 'gregorini': 1, 'breton': 2, 'camerini': 1, 'kumai': 2, 'cocoran': 1, 'holdaway': 1, 'bagel': 1, 'baskervil': 2, 'chatsworth': 1, 'oradour': 1, 'glane': 1, 'ashwar': 5, 'isral': 1, 'youseff': 1, 'khandi': 1, 'newsradio': 1, 'dreier': 1, 'pinsent': 1, 'launchpad': 1, 'rhey': 2, 'knightleti': 1, 'rhye': 1, 'donlon': 2, 'lampidorran': 3, 'schmeez': 4, 'zabar': 1, 'pyrokineticist': 1, 'pyrot': 1, 'forklift': 2, 'unstuck': 1, 'chiffon': 1, 'scorsces': 1, 'wormwood': 2, 'transact': 3, 'terwillig': 1, 'nanaimo': 1, 'cultic': 1, 'licensur': 1, 'nickolodeon': 1, 'hedaya': 2, 'mccullough': 2, 'jetlag': 1, 'squealer': 1, 'liddi': 2, 'deliverli': 1, 'ormondroyd': 2, 'ctrl': 2, 'woodrow': 2, 'funt': 1, 'fettl': 1, 'racetrack': 5, 'grandstand': 1, 'traceabl': 1, 'biachi': 1, 'misogyn': 1, 'subtil': 1, 'hig': 1, 'athmospher': 1, 'felitta': 1, 'awwww': 2, 'splurg': 1, 'zaniac': 1, 'walcott': 1, 'professionist': 1, 'hoke': 2, 'zac': 2, 'macarhur': 1, 'eugenia': 2, 'yuan': 1, 'irina': 1, 'isiah': 1, 'laughworthi': 1, 'alacr': 1, 'lach': 1, 'imani': 1, 'hakim': 1, 'alsobrook': 1, 'byran': 1, 'sugarman': 1, '137': 1, 'windego': 1, 'ahhhhh': 1, 'brokerag': 1, 'deidr': 4, 'nyphett': 1, 'thumbtan': 5, 'oedekerk': 1, 'arachnid': 1, 'filmett': 1, 'zapprud': 2, 'steadier': 2, 'letch': 1, 'hugu': 1, 'anglad': 1, 'charlsten': 1, 'pallanc': 1, 'teahupoo': 1, 'quintin': 2, 'wk00817': 1, 'medallist': 1, 'camillia': 1, 'beauregard': 1, 'sweetum': 1, 'whitmir': 1, 'khamini': 1, 'vinay': 1, 'seema': 4, 'shiven': 1, 'gia': 1, 'ashutosh': 2, 'joh': 1, 'tehzeeb': 1, 'raju': 3, 'esrechowitz': 1, 'staphani': 1, 'dayal': 1, 'phoolwati': 1, 'akshaya': 1, 'duchi': 2, 'dupli': 1, 'baranov': 1, 'megapack': 1, 'hene': 1, 'grem': 1, 'gornick': 7, 'woodenhead': 2, 'tarpaulin': 1, 'lettich': 1, 'lionheart': 1, 'rond': 3, 'hyser': 5, 'benfer': 2, 'sycoph': 3, 'brooksophil': 1, 'undistil': 1, '78rpm': 1, 'tarrinno': 1, 'lyudmila': 1, 'savelyeva': 1, 'kirov': 1, 'petersen': 8, '1881': 3, 'perron': 1, 'jutra': 2, 'crom': 1, 'cruic': 1, 'horseman': 2, 'cheshir': 2, 'mckoy': 1, 'daggi': 1, 'mc5': 1, 'eaglebau': 5, 'mcgree': 2, 'ludlow': 3, 'mening': 1, '62229249': 1, 'starrett': 2, 'durango': 2, 'freihof': 1, 'crabbi': 1, 'hows': 1, 'doubleday': 1, 'schnitz': 2, 'ritzig': 1, 'henshaw': 1, 'flashman': 14, 'zimmerman': 1, 'woth': 2, 'arrondis': 2, 'eclectic': 2, 'soccoro': 1, 'photog': 1, 'jion': 1, 'sanfrancisco': 1, 'quinton': 1, 'mostey': 1, 'schriber': 1, 'enki': 1, 'assosi': 1, 'shamalyan': 1, 'chabert': 2, 'peerlessli': 1, 'primadonna': 1, 'ramghad': 1, 'siva': 1, 'telugu': 2, 'amitabhz': 2, 'bikumatr': 1, 'bhavtakur': 1, 'mallik': 1, 'abcd': 1, 'itz': 1, 'heroo': 1, 'ghunguroo': 1, 'heroz': 1, 'ramgopalvarma': 1, 'azjazz': 2, 'prewar': 2, 'coslow': 2, 'marahuana': 1, 'proscenium': 3, 'picford': 1, 'takoma': 1, 'illlinoi': 1, 'hjitler': 1, 'prompter': 1, 'polygram': 1, 'yeast': 1, 'peppoir': 4, 'sleekli': 1, 'schifrin': 2, 'wesson': 2, 'viard': 1, 'dogsbodi': 2, 'beastial': 6, 'berkli': 1, 'tute': 1, 'guinneth': 1, 'resqu': 1, 'hariett': 1, 'lage': 2, 'munnabhai': 3, 'arshad': 1, 'varshi': 1, 'grandn': 1, 'periodth': 1, 'reah': 1, 'cicatillo': 1, 'manr': 1, 'padget': 1, 'inian': 1, 'photograp': 1, 'prival': 1, 'ferhan': 1, 'sensoy': 1, 'aphorist': 1, 'hadnt': 1, 'cartilag': 1, 'ker': 1, 'watcheabl': 1, 'pogrom': 1, 'mcguyver': 1, 'malnutrit': 1, 'unmodern': 1, 'turnpoint': 1, 'eachoth': 4, 'succes': 2, 'quay': 1, 'benjamenta': 1, 'tuner': 5, 'mcinnerni': 6, 'screenin': 1, 'portabello': 3, 'rehibilit': 1, 'taper': 1, 'soorya': 1, 'morant': 3, 'womack': 1, 'gecko': 3, 'lehar': 2, 'buckingham': 2, 'leapin': 1, 'unhand': 1, 'skinnier': 1, 'bering': 3, 'screenlay': 1, 'heartpound': 1, 'fise': 1, 'yasuzo': 1, 'masumura': 2, 'usuri': 2, 'kookili': 1, 'massi': 1, 'abishai': 1, 'linch': 1, 'cavanaughso': 1, 'watchingse': 1, 'cragg': 6, 'friedrich': 2, 'brakeman': 1, 'breen': 1, 'bowdler': 4, 'nieztsch': 4, 'nothin': 1, 'remmeb': 1, 'millionar': 1, 'hallari': 1, 'authur': 1, 'preggo': 1, 'rotld': 1, 'supermut': 1, 'thanato': 3, 'cinepoem': 1, 'whitlow': 2, 'dunkin': 1, 'queas': 1, 'ikey': 1, 'riah': 4, 'chanci': 1, 'acolyt': 5, 'mio': 4, 'giaconda': 3, 'unutter': 2, 'skeksi': 1, 'crucifux': 1, 'psychlog': 1, 'frizzyhead': 1, 'scottsboro': 1, 'elizbeth': 1, 'boccaccio': 1, 'naturist': 2, 'fleurieu': 1, 'salesperson': 1, 'waddel': 2, 'lighthearted': 4, 'setpiec': 3, 'scottland': 1, 'autr': 1, 'fahrt': 1, 'menschentr': 1, 'mmer': 1, 'illbient': 1, 'horrificli': 1, 'tro': 3, 'rebut': 1, 'demonicli': 1, 'juvenilia': 1, 'manichean': 1, 'actionpack': 2, 'jivetalk': 1, 'afroamerican': 1, 'occat': 1, 'groovadel': 1, 'flickerino': 1, 'fect': 1, 'squeezabl': 1, 'radder': 1, 'stiffen': 2, 'anaglyph': 1, 'aldolpho': 3, 'nibbi': 1, 'cof': 1, 'brokovich': 1, 'gerlich': 2, 'drowsi': 4, 'vanesa': 1, 'yougoslavia': 1, 'krantz': 1, 'quich': 1, 'janowski': 1, 'bartholomew': 2, 'moli': 2, 'godzirra': 1, 'wantabedd': 1, 'denom': 1, 'theocrat': 1, 'bakelit': 1, 'floorpan': 1, 'missunderstand': 1, 'themslev': 1, 'weimar': 2, 'zugsmith': 1, 'loftier': 2, 'uninhibitedli': 1, 'amerterish': 1, '500db': 1, 'repoman': 1, 'mummif': 1, 'jansch': 1, 'chauvin': 2, 'torpor': 2, 'beekeep': 1, 'mayday': 1, 'timet': 6, 'hive': 4, 'typographi': 2, 'arsewit': 1, 'goddamit': 1, 'vim': 3, 'whoah': 1, 'hyuk': 2, 'sac': 3, 'winterich': 1, 'wll': 1, 'laroqu': 1, 'salingerist': 1, 'rebenga': 1, 'sosa': 4, 'bastketbal': 1, 'perscript': 1, 'wencher': 1, 'jerkingli': 1, 'rashad': 2, 'phylicia': 1, 'curlingli': 1, 'jugoslavia': 2, 'mcnairi': 1, 'joi': 1, 'famil': 2, 'kazihiro': 6, 'wolski': 1, 'chit': 1, 'nop': 1, 'anykind': 1, 'robespierr': 1, 'marat': 1, 'marcus': 2, 'jurras': 1, 'telefair': 1, 'mclaglan': 3, 'midsom': 1, 'enfilren': 1, 'androvski': 1, '9s': 1, 'japones': 2, 'firmwar': 1, 'zzzzzzzz': 1, 'riqu': 1, 'secuestro': 1, 'frewer': 11, 'twill': 1, 'cadaver': 1, 'wishbon': 5, 'courteou': 2, 'kindler': 1, 'ariana': 1, 'jobanoth': 1, 'atreid': 1, 'starfight': 1, 'flightsuit': 1, 'avg': 2, 'hgtv': 1, 'tesand': 1, 'luren': 1, 'tuttl': 1, 'solondz': 1, 'aestheic': 1, 'challng': 1, 'secert': 1, 'goomba': 1, 'ideologist': 3, 'colera': 1, 'agnieszka': 2, 'forbrydelsen': 3, 'locomot': 2, 'shindler': 1, 'coincidenti': 1, 'rsel': 1, 'dogme95': 2, 'overemphasi': 1, 'spacetim': 1, 'cyher': 1, 'aonn': 1, 'counterespionag': 1, 'dysantri': 1, 'satr': 1, 'couco': 1, 'milla': 1, 'xylophonist': 1, 'handpuppet': 1, 'campeon': 1, 'atcon': 1, 'grierson': 1, 'climacter': 1, 'triviata': 1, 'tapehead': 1, '409': 2, 'astronish': 1, 'weredeplict': 1, 'debris': 1, 'ballz': 1, 'famariali': 1, 'xia': 1, 'appoach': 1, 'devastiingli': 1, 'redey': 2, '192': 1, 'floater': 2, 'colick': 1, 'coalwood': 6, 'lindberg': 3, 'canerday': 1, 'anwer': 1, 'pertinac': 1, 'negron': 2, 'messmer': 1, 'mcdonough': 2, 'azimov': 1, 'roundelay': 1, 'reguard': 1, 'gitwist': 1, 'shallowli': 2, 'doddsvil': 3, 'spectular': 1, '9a': 1, 'interwhin': 1, 'roodt': 1, 'harwood': 2, 'paton': 3, 'kumalo': 2, 'johannesburg': 3, 'sorrento': 1, 'niggaz': 1, 'farmzoid': 1, 'grabbi': 1, 'gucht': 1, 'nagasaki': 2, 'katyn': 1, 'vae': 1, 'victi': 1, 'hangdog': 2, 'taggart': 2, 'chikatila': 1, 'blankwal': 1, 'tungsten': 1, 'ocur': 1, 'jemima': 1, 'manero': 1, 'badalucco': 1, 'kieslowski': 2, 'waverley': 1, 'auld': 2, 'sichuan': 4, 'castrati': 1, 'actingwhen': 1, 'inreign': 1, 'scenedon': 1, 'doesadam': 1, 'smithi': 1, 'cavelleri': 1, 'vassar': 1, 'extemporan': 2, 'hiller': 2, 'smirki': 3, 'racehors': 1, 'paterfamilia': 1, 'donnitz': 1, 'bletchli': 1, 'romaro': 1, 'lofaso': 1, 'calvi': 1, 'pabon': 1, 'estrado': 1, 'heni': 1, 'ambrosin': 1, 'phillpott': 1, 'barbarellish': 1, 'yello': 1, 'memorandum': 1, 'ohmagod': 1, 'crimani': 1, 'bighous': 1, 'misrep': 1, 'disov': 1, 'scald': 1, 'sumpin': 1, 'unrespect': 1, 'gs': 1, 'ritalin': 1, 'horsecoach4hir': 1, 'scopophilia': 1, 'backtrack': 2, 'timpani': 2, 'glame': 1, 'nicholett': 1, 'mcgwire': 1, 'dominqu': 1, 'subcontract': 1, 'trousdal': 1, 'herculi': 2, 'puaro': 2, 'naggi': 1, 'dishi': 1, 'mackey': 1, 'mclarti': 1, 'finnlayson': 1, 'ruccolo': 1, 'shirn': 1, 'clasp': 3, 'jut': 3, 'astroturf': 1, 'degrassi': 2, 'navin': 2, 'blankfield': 3, 'urbisci': 1, 'yester': 1, 'daar': 1, 'chand': 2, 'paar': 1, 'kaif': 1, 'bhopali': 1, 'chalt': 2, 'movieev': 1, 'supos': 1, 'gete': 1, 'budgeti': 1, 'robustli': 1, 'satanis': 1, 'bulgari': 1, 'marlin': 1, 'septuplet': 1, 'lovett': 4, 'reclin': 2, 'everingham': 3, 'sita': 1, 'nandita': 2, 'harshest': 1, 'gywnn': 2, 'nausium': 1, 'mcdonel': 2, 'anthropophag': 1, 'supblot': 1, 'heatbreak': 1, 'ciccolina': 1, 'amann': 2, 'marmont': 3, 'lunohod': 2, '1tv': 1, 'roselina': 1, 'canrun': 1, 'sarahbrown': 1, 'bribessarah': 1, 'doublewed': 1, 'marlonbrando': 1, 'originalbroadway': 1, 'heedless': 1, 'nett': 2, 'tahiti': 8, 'fffrreeaakkyy': 1, 'manat': 1, 'shater': 1, 'burb': 1, 'wynona': 2, 'kadeem': 1, 'hardison': 1, 'film4': 1, 'hitchcok': 1, 'pantaloon': 1, 'aiieeee': 1, 'tiara': 1, 'jaliyl': 1, 'kilo': 2, 'gomba': 1, 'landsman': 1, 'santon': 1, 'francoisa': 1, 'chevrolet': 1, 'unseat': 2, 'ew': 4, '707': 2, 'deporte': 2, 'mimbo': 2, 'rockabilli': 2, 'voodooism': 2, 'bumblebe': 2, 'gulpili': 1, 'nandjiwarna': 1, 'austrailan': 1, 'thuggeri': 2, 'backhand': 1, 'nicolaescu': 1, 'saizescu': 1, 'muresan': 1, 'marinescu': 1, 'margineanu': 1, 'terribil': 1, 'megabomb': 1, 'yackin': 1, 'ninga': 1, 'arnon': 1, 'milchan': 1, 'briley': 1, 'compactor': 2, 'eaghhh': 1, 'mathia': 1, 'urquidez': 1, 'tubercular': 1, 'hongmei': 1, 'zhuangzhuang': 3, 'othewis': 1, 'penlight': 3, 'dullish': 1, 'teat': 1, 'knarl': 1, 'unflaunt': 1, 'bravest': 1, 'wholeheart': 1, 'cheatin': 2, 'overenthusiast': 3, 'croucher': 1, 'sangrou': 1, 'morrer': 1, 'barth': 1, 'spoili': 1, 'aheadwhi': 1, 'peerc': 1, 'ascerb': 1, 'warhead': 4, 'porcasi': 1, 'rucku': 6, 'pacer': 1, 'castelo': 1, 'pulsa': 1, 'nula': 1, 'upload': 1, 'yecch': 1, 'hatley': 1, 'seawright': 1, 'unspens': 1, 'matel': 1, 'froid': 2, 'midproduct': 1, 'yamaha': 1, 'manghattan': 1, 'jme': 1, 'allnut': 1, 'asiaphil': 1, 'honhyol': 1, 'aphrodisiac': 2, 'arrrrgh': 1, 'garante': 1, 'nghya': 1, 'hssh': 3, 'mpkdh': 2, 'hamari': 3, 'imperman': 1, 'interconnected': 1, 'hollywoond': 1, 'queeg': 1, 'katch': 2, 'crimp': 1, 'pseudoscientif': 1, 'maharishi': 1, 'introvers': 3, 'extramarit': 2, 'apr': 2, 'jawlin': 1, 'contigu': 1, 'decalogu': 1, 'mmt': 1, 'ratcatch': 2, 'djimon': 1, 'hounsou': 1, 'impostur': 1, 'shrunken': 2, 'vessela': 1, 'dimitrova': 1, 'mendelito': 2, 'frasncisco': 1, 'corson': 2, 'hacienda': 1, 'zfl': 1, 'legionairr': 1, 'carleton': 2, 'repubhl': 1, 'humanita': 1, 'm80': 1, 'secreteari': 1, 'screwer': 1, 'screwe': 1, 'appolog': 1, 'adminsitr': 1, 'economist': 3, 'imf': 1, 'gatt': 1, 'caall': 1, '10mi': 1, 'steen': 1, 'struther': 2, 'elivra': 1, 'christiansen': 2, 'fredrik': 1, 'lindstr': 1, 'vuxna': 1, 'nniskor': 1, 'huxleyan': 1, 'whateverian': 1, 'ctgsr': 1, 'esampl': 1, 'maidment': 1, 'protelco': 1, 'mlc': 1, 'pock': 2, 'haliday': 6, 'marney': 1, 'frontiersman': 2, 'pederast': 1, 'churlishli': 2, 'anansa': 11, 'sanufu': 2, 'sandel': 3, 'tuareg': 2, 'wunderbar': 1, 'downwind': 1, 'reaalli': 1, 'fearnet': 4, 'skellington': 2, 'freke': 1, 'pwnz': 1, 'placag': 1, 'dood': 2, 'zomerhitt': 1, 'temmink': 1, 'zwartboek': 1, 'immut': 1, 'inagaki': 3, 'tir': 1, 'giraudeau': 1, 'quenc': 2, 'sandrin': 3, 'kiberlain': 3, 'stratofreight': 1, 'skyraid': 1, 'cadmu': 1, 'sbd': 1, 'lindbergh': 1, 'vuchella': 1, 'tosti': 1, 'rossini': 2, 'torchwood': 1, 'sluttiest': 1, '00001': 2, '540i': 1, 'traction': 2, 'halaqah': 1, 'brawlin': 1, 'outlast': 1, 'pate': 2, 'proprietress': 2, 'undoubetli': 1, 'discu': 2, 'spoler': 1, 'adkin': 1, '428': 1, 'fobh': 1, 'mallrat': 2, 'rox': 1, 'trumph': 1, 'dvder': 1, 'mayron': 1, 'bagpip': 2, 'joeli': 2, 'pgbi': 1, 'hughli': 2, 'crestfallen': 1, 'bridger': 3, 'josten': 1, 'faq': 1, 'magrath': 2, 'fillmmak': 1, 'mela': 1, 'nonsenseth': 1, '2000anywayz': 1, 'urrf': 1, 'harish': 2, 'aruna': 2, 'wigdirect': 1, 'badanil': 1, 'moberg': 1, 'grispin': 1, 'anar': 1, 'cini': 5, '4f': 1, 'doili': 1, 'hessian': 4, 'bierstub': 1, 'winier': 1, 'rhinier': 1, 'bratwurst': 2, 'jucier': 1, 'goosier': 1, 'rumann': 1, '241': 2, 'columbusland': 1, 'legerdemain': 1, 'eyeboy': 1, 'kimosab': 1, 'midohio': 1, 'allcost': 1, 'looklik': 1, 'beher': 1, 'tomak': 1, 'thebottom': 1, 'andrupert': 1, 'abandonof': 1, 'demer': 1, 'sleaziest': 4, 'trashiest': 2, 'hershel': 1, 'fdtb': 1, 'internship': 3, 'printout': 1, 'claimer': 1, 'chemestri': 1, 'totin': 1, 'evi': 1, 'lutzki': 1, 'rogain': 1, 'repopul': 1, 'unpopul': 2, 'humanitarian': 5, 'kebir': 1, 'blyston': 1, 'germi': 1, 'miracolo': 1, 'giudizio': 1, 'universal': 1, 'topcoat': 1, 'cloney': 3, 'dairi': 4, 'aldiss': 1, 'mancha': 2, 'baudi': 1, 'blazne': 1, 'zzzzzzzzzzzzpop': 1, 'nabooboo': 1, 'chrouch': 1, 'uppercrust': 1, 'tevi': 1, 'cleancut': 1, 'lifeguard': 3, 'kildar': 1, 'tynisia': 1, 'firesid': 2, 'gangren': 2, 'lundquist': 1, 'sportscast': 2, 'visser': 1, 'tackili': 1, 'moviv': 1, 'beccket': 4, 'peeter': 1, 'pedicur': 1, '425': 1, 'palsey': 1, 'gripen': 1, 'hkp': 1, 'jammer': 2, 'rb': 2, 'ssg': 1, 'subpoint': 1, 'devereux': 1, 'helix': 1, 'vann': 3, '5x': 1, 'costi': 1, 'anchorpoint': 1, 'coahuila': 1, 'zacateca': 1, 'potosi': 1, 'sedona': 2, 'msmyth': 1, 'marquz': 1, 'frustrationfest': 1, 'seizureif': 1, 'stinkin': 1, 'whitch': 2, 'kridg': 2, 'bulworth': 1, 'mustachio': 1, 'crapola': 3, 'shoddier': 1, 'borgesian': 1, 'hooknos': 1, 'monthi': 1, 'chitchat': 2, 'irrfan': 2, 'dondaro': 1, 'warnicki': 1, 'cimmerian': 1, 'conceptwis': 1, 'super8': 1, 'penpal': 1, 'kno': 1, 'wahm': 1, 'croak': 1, 'epitaph': 2, 'pellesk': 2, 'eisen': 1, 'sadek': 2, 'laddish': 1, 'gisbourn': 1, 'auguri': 1, 'hernand': 1, 'axl': 1, 'warbird': 1, 'epoqu': 1, 'violeta': 1, 'mena': 4, 'suvari': 3, 'secreti': 1, 'nsync': 2, 'hohum': 1, 'flatlin': 2, 'tdd': 1, 'yaburi': 1, 'asagoro': 6, 'shushui': 5, 'exult': 3, 'theworst': 1, 'controlcomput': 1, 'isperhap': 1, 'otherreview': 1, 'establishingshot': 1, 'directioni': 1, 'mildgor': 1, 'vdb': 1, 'tindl': 1, 'wyke': 1, '5kph': 1, 'mccullum': 2, 'obelisk': 1, 'ekland': 3, 'totter': 4, 'antonik': 1, 'fiorella': 2, 'bandali': 1, 'reviewy': 1, 'bof': 2, 'homeliest': 1, 'abuelita': 1, 'targu': 1, '5x5': 1, 'cheen': 1, 'fernack': 1, 'invinic': 1, 'blackman': 1, 'lowbal': 1, 'lolol': 1, 'kojac': 1, 'suffolk': 2, 'eyow': 1, 'guyland': 1, 'donlevey': 1, 'stevens': 1, 'carnaevon': 1, 'whitechapel': 2, 'murdston': 5, 'spliss': 1, 'bubi': 1, 'walke': 1, 'waalk': 2, 'ralf': 1, 'cosma': 1, 'unplay': 2, 'tauter': 1, '9lb': 1, 'emment': 2, 'derigu': 1, 'apocalypto': 1, 'soren': 2, 'oversimplif': 1, 'judeo': 1, 'misappl': 1, 'funim': 1, 'fillum': 2, 'kinlan': 1, 'barantini': 1, 'sherritt': 1, 'kiri': 4, 'paramor': 1, 'nutzo': 1, 'beanbag': 1, 'slumdog': 2, 'yaara': 7, 'yara': 1, 'gadi': 1, 'plainer': 1, 'bazza': 11, 'everag': 1, 'poofter': 1, 'quanta': 1, 'gyppo': 1, 'rickmansworth': 1, 'covington': 1, 'snacka': 1, 'fitzgibbon': 1, 'dunni': 1, 'seinfeldish': 1, 'bharathi': 1, 'susham': 1, 'dalip': 1, 'kaajal': 3, 'becoem': 1, 'cemetri': 1, 'diahnn': 1, 'pedo': 1, 'vejigant': 1, 'lupita': 2, 'treed': 2, 'yecchi': 1, 'laural': 1, 'jp': 3, 'sarro': 3, 'ruta': 1, 'venezuelian': 1, 'perico': 1, 'ripiao': 1, 'veal': 1, 'cutlet': 1, 'ong': 3, 'bak': 3, 'jodedor': 1, 'timemachin': 1, 'antiviru': 1, 'phyton': 1, 'nfa': 1, 'sickel': 1, 'mola': 1, 'bijou': 2, 'swang': 1, 'ngela': 1, 'unlikley': 1, 'barebon': 1, 'galling': 1, 'trevino': 1, 'eta': 1, 'drosselmei': 1, 'mea': 1, 'culpa': 1, 'ethnocentr': 3, 'punji': 1, 'subgroup': 1, 'mesoamerican': 3, 'quaresma': 1, 'deusexmachina529': 1, 'rantzen': 3, 'nitric': 2, 'emmerdal': 1, 'bsm': 1, 'padarouski': 1, 'nosher': 1, 'punkah': 2, 'banu': 1, 'cfto': 3, 'ckco': 1, 'wiarton': 1, 'magtena': 1, '089': 1, 'pearlstein': 1, 'massacrenot': 1, 'beacham': 1, 'chippendal': 1, 'theirs': 1, 'bluetooth': 1, 'conur': 1, 'philidelphia': 1, 'curvaci': 1, 'belabour': 1, 'tono': 3, 'santacruz': 1, 'anda': 3, 'plascencia': 1, 'echoy': 1, 'itd': 1, 'spiret': 1, 'themhi': 1, 'cyberspac': 1, 'yakit': 5, 'northeastern': 1, 'fernanda': 2, 'carvalho': 2, 'tadeu': 1, 'resold': 1, 'louren': 2, 'ot': 1, 'vio': 1, 'amazona': 1, 'saraiva': 1, 'calloni': 1, 'ften': 1, 'gl': 2, 'ria': 5, 'lagemann': 1, 'kounen': 1, 'gto': 1, 'kintaro': 1, 'hirohisa': 1, 'christan': 1, 'woohoo': 2, 'acteur': 2, 'dussoli': 4, 'josian': 1, 'balasko': 2, 'arzenta': 10, 'duccio': 4, 'tessari': 7, 'gravini': 1, 'porel': 1, 'maggio': 1, 'diffr': 1, 'grunwald': 1, 'troisi': 1, 'cutitta': 1, 'silvano': 2, 'ippol': 1, 'ferrio': 1, 'choosen': 1, 'uptad': 1, 'vallejo': 1, 'toschi': 1, 'dzundza': 3, 'marmalad': 2, 'samuraisploit': 1, 'yasuzu': 1, 'doubletim': 1, 'loanshark': 1, 'onishi': 1, 'mukherje': 2, 'aquick': 1, 'lk': 1, 'assed': 1, 'harrumph': 1, 'ffwd': 1, 'delimma': 1, 'immediatli': 2, 'ofnosferatu': 1, 'blacksnak': 10, 'anouska': 7, 'prows': 1, 'hempel': 1, '1870': 3, 'spoilment': 1, 'aracnophobia': 1, 'mirada': 1, 'arclight': 1, 'posi': 1, 'bamber': 1, 'helfer': 2, 'mccreari': 1, 'unjad': 1, 'sardin': 1, 'slickest': 2, 'bhaer': 1, 'rochfort': 1, 'jambore': 1, 'preyer': 1, 'religul': 3, 'ien': 2, 'hajim': 2, 'hitoto': 6, 'nenji': 1, 'hito': 1, 'shian': 1, 'equinox': 2, 'monsterfest': 1, 'grillo': 1, 'sizemor': 1, 'farnel': 1, 'rwandes': 1, 'lanuitrwandais': 1, 'nuy': 1, 'chalon': 1, 'maddona': 1, 'actullli': 1, 'survivi': 1, 'rubyin': 1, 'moviesalso': 1, 'scoyk': 1, 'odessi': 1, 'cabel': 10, 'extermli': 1, 'tracheotomi': 1, 'pipsqueak': 2, 'thierot': 2, 'nickerson': 2, 'flitti': 1, 'panabak': 1, 'jemison': 2, 'teenybopp': 2, 'doophu': 1, 'unadapt': 1, 'dialong': 1, 'littttl': 1, 'cul': 2, 'theathr': 1, 'prosthesi': 1, 'churchyard': 1, 'opac': 1, 'quotidian': 1, 'herbal': 4, 'isca': 1, 'perfeita': 1, 'sequitir': 1, 'trannsylvania': 1, 'purgat': 1, 'orsen': 1, 'desdimona': 1, 'venetian': 2, 'sensationi': 1, 'jutter': 1, 'tolmekian': 1, 'hisaichi': 2, 'preconc': 1, 'ridgway': 1, 'readabl': 4, 'feferman': 1, 'overblo': 1, 'tarantin': 1, 'shameomet': 1, 'ific': 1, 'veber': 1, 'hamer': 2, 'cinemath': 1, 'reshap': 3, 'snipper': 1, 'revolucion': 1, 'siempr': 1, 'hyller': 1, 'entirelli': 1, 'igeni': 1, 'presumb': 1, 'kiara': 1, 'nyugen': 3, 'offsuit': 1, 'fd': 1, 'balcan': 3, 'scatterbrain': 1, 'thinkthey': 1, 'rocketboy': 1, 'jumanji': 3, 'onsid': 1, 'hearp': 1, 'ger': 4, 'posteriorli': 1, 'tupac': 6, 'yutt': 1, 'stensgaard': 1, 'strapless': 1, '100mph': 1, 'eeda': 1, 'ravenstein': 1, 'lorado': 1, 'armateur': 1, 'characatur': 2, 'thepsych': 1, 'unwatchablelist': 1, 'goldmask': 1, 'dubbedstud': 1, 'magicbecaus': 1, 'flatact': 1, 'notbefor': 1, 'withmi': 1, 'withsmok': 1, 'youcrav': 1, 'arelaugh': 1, 'areattack': 1, 'onth': 1, 'beenspent': 1, 'spurtingwound': 1, 'anywayjust': 1, 'medo': 1, 'notappear': 1, 'conjob': 1, 'femalenud': 1, 'arghhh': 1, 'leasur': 1, 'contless': 1, 'chastedi': 1, 'adt': 1, 'fcc': 1, 'fmv': 3, 'winni': 4, 'oddsi': 1, 'oscer': 2, 'shirdan': 1, 'macan': 1, 'cristi': 9, 'sisabl': 1, 'archenemi': 3, 'halfpennyworth': 1, 'harf': 1, 'uth': 1, 'mamabolo': 2, 'boland': 4, '9484': 1, '3516': 1, 'hijixn': 1, 'pocketbook': 3, 'prefabr': 1, 'scriptor': 1, 'weightlessli': 1, 'mazzucato': 1, 'mikshelt': 1, 'persecutor': 2, 'bronchiti': 2, 'pardner': 1, 'volnay': 1, 'procuror': 1, 'uder': 1, 'unconsi': 1, 'carnelutti': 1, 'willim': 1, 'clergymen': 1, 'grayish': 1, 'unalik': 1, 'winterwond': 1, 'boringoveral': 1, 'cthi': 1, 'arisan': 1, 'dx': 5, 'rareley': 1, 'ruhr': 2, 'wellbalanc': 1, 'thosewher': 1, 'beyondmi': 1, 'isi': 1, 'dionysu': 1, 'adoni': 1, 'mithraism': 1, 'sipu': 3, 'dena': 1, 'schlosser': 1, 'rigoberta': 1, 'mench': 1, '300ad': 1, 'besant': 1, 'krazi': 1, 'perog': 1, 'hittit': 1, 'signia': 1, 'yiiii': 1, 'elvia': 1, 'absolutelli': 1, 'junkermann': 7, 'cramden': 1, 'ruppert': 1, 'hopton': 1, 'fishtail': 5, '16iem': 1, 'ardant': 4, 'qdlm': 1, 'twyker': 1, 'feist': 2, 'vraiment': 1, 'delfont': 1, 'semon': 1, 'ruge': 6, 'plunt': 1, 'dreich': 1, 'dosh': 1, 'laundress': 1, 'fob': 1, 'cot': 3, 'babyhood': 1, 'madelyn': 1, 'saloshin': 1, 'ghostwrit': 1, 'rollerboy': 1, 'inappreci': 1, 'daeseleir': 1, 'yali': 3, 'warmhearted': 1, 'nonconform': 2, 'superstrong': 1, 'spirited': 2, 'wordwhat': 1, 'glitterati': 1, 'fervour': 2, 'profligaci': 1, 'anjali': 1, 'abhijeet': 2, 'rehan': 1, 'airhostess': 1, 'gayatri': 2, 'arora': 1, 'tyagi': 1, 'sanjeev': 1, 'datta': 5, 'bandekarr': 1, 'excellent29th': 1, 'looooonnnggg': 1, 'whitecloud': 1, 'sei': 1, 'nea': 7, 'blister': 3, 'nemsi': 1, 'mooradian': 1, 'saliva': 1, 'chimayo': 3, 'catfish': 1, 'enviro': 1, 'ungener': 2, 'rsc': 1, 'lyli': 1, 'euphu': 1, 'oragami': 1, 'owhat': 1, 'burri': 1, 'vietcong': 2, 'safeauto': 1, 'trimmer': 1, 'spielmann': 1, 'meckern': 1, 'sudern': 1, 'prolo': 2, 'parochi': 3, 'seild': 1, 'casav': 1, 'substitu': 1, 'meanspirit': 1, 'rippingli': 1, 'blop': 1, 'bertha': 1, 'ff2': 1, 'cardon': 1, '72nd': 1, 'desalvo': 1, 'mesmorizingli': 1, 'powerlessli': 1, 'candoli': 3, 'aubri': 1, 'madi': 2, 'strickler': 4, 'headston': 2, 'flask': 1, 'visuel': 1, 'teressa': 1, 'clingi': 1, 'disbar': 1, 'rummi': 1, 'filippin': 1, 'yegg': 1, 'waaaaaaaaay': 1, 'hitchik': 1, 'songtot': 1, 'movieeveryth': 1, 'twi': 1, 'walrus': 2, 'wgbh': 1, 'beergut': 1, 'f00l': 1, 'addio': 1, '1000lb': 1, 'animetv': 1, 'illya': 1, 'mcconnohi': 1, 'dillut': 1, 'boyscout': 1, 'gunrunn': 1, 'allmor': 1, 'plastecin': 1, 'coachload': 1, 'machett': 1, 'siriaqu': 1, 'cacophonist': 1, 'postlesumthingor': 1, 'celozzi': 2, 'bodybag': 2, 'farino': 1, 'koster': 1, 'scatti': 2, 'unneccessari': 1, 'elenor': 1, 'ilu': 1, 'decamp': 1, 'gudalcan': 1, 'placebo': 2, 'chayya': 1, 'wordsmith': 1, 'immodest': 1, 'ozymandia': 1, 'conceptionless': 1, 'leyner': 2, 'pikser': 2, 'tracklist': 1, 'brox': 1, 'rehear': 1, 'chorin': 4, 'unsweati': 1, 'grotto': 2, 'waterslid': 1, 'hup': 1, 'appollonia': 1, 'sexshoot': 1, 'sneakili': 1, 'shadrach': 2, 'disneyish': 1, 'sanitis': 1, 'methink': 1, 'syudov': 1, 'unston': 1, 'juscar': 1, 'brunna': 2, 'remedio': 2, 'olmstead': 2, 'skivvi': 2, 'enchantingli': 1, 'inund': 2, 'unrelievedli': 1, 'obligortori': 1, 'gassi': 1, 'palermo': 25, 'unforunatley': 1, 'tenderheart': 1, 'hofeu': 1, 'bethard': 1, 'woodsi': 1, 'sumptuous': 2, 'pluckin': 1, 'trapero': 2, 'bonaerens': 1, 'mariano': 1, 'loca': 1, 'zombielik': 1, 'toysru': 1, 'icebox': 1, 'lowcut': 1, 'pneumaticali': 1, 'raphaelit': 1, 'topor': 1, 'trekovski': 3, 'mademouisel': 1, 'hypersensit': 2, 'demarco': 1, 'gruen': 1, 'duckburg': 2, 'mcduck': 1, 'bekker': 1, 'turkic': 1, 'mongolian': 2, 'rustam': 1, 'ibragimbekov': 1, 'czekh': 1, 'rodan': 2, 'mothra': 1, 'daiei': 1, 'mammothli': 1, 'snaggl': 1, 'seiko': 1, 'naci': 1, 'drinkabl': 1, 'franch': 1, 'camembert': 1, 'whey': 1, 'leporida': 1, 'lagomorpha': 1, 'thema': 1, 'screecher': 1, 'nopd': 1, 'tricktri': 1, 'premad': 2, 'imotep': 1, 'eck': 1, 'unsupris': 1, 'daffili': 1, 'stellwaggen': 1, 'mathilda': 1, 'suckl': 4, 'alcain': 1, 'thundercloud': 1, 'richthofen': 2, 'gotha': 1, 'aero': 1, 'mutti': 1, 'tepidli': 1, 'weill': 6, 'ratoff': 2, 'strongbox': 1, 'izod': 1, 'reprob': 1, 'lobbyist': 2, 'beurk': 3, 'vercor': 1, 'disorganis': 2, 'gream': 2, 'tropi': 3, 'vancruysen': 1, 'hubschmid': 1, 'hominoid': 1, 'adamo': 1, 'rolando': 2, 'malecio': 1, 'amayao': 1, 'chriterion': 1, 'waft': 1, 'pugsley': 1, 'austines': 1, 'falsetto': 2, 'farcial': 2, 'fakespearan': 1, 'anacron': 1, 'appalingli': 1, 'particullari': 1, 'sepoy': 1, 'annouc': 1, 'melania': 1, 'infra': 1, 'expet': 1, 'nuevo': 1, 'yurek': 1, 'bogayevicz': 7, 'krystina': 1, 'lodz': 1, 'ellipsi': 2, 'eurasian': 4, 'ananda': 1, 'anglifi': 1, 'hornet': 1, 'eccentricmoth': 1, 'airbal': 3, 'autocock': 1, 'woodsbal': 2, 'speedbal': 2, 'zeder': 2, 'pupi': 1, 'avati': 1, 'plagiari': 1, 'avatilet': 1, 'implausibl': 1, 'makowski': 1, 'spoilerif': 1, 'reasonbali': 1, '18a': 1, 'eliason': 1, 'angler': 1, 'ganglord': 1, 'sondergaard': 1, 'bookdom': 1, 'shrekism': 1, 'tentpol': 2, 'subgenera': 1, 'consil': 1, 'genuingli': 1, 'unsettel': 1, 'dureyea': 1, 'ital': 1, 'godisnowher': 1, 'maegi': 1, 'cobain': 1, 'tywker': 3, 'dizzyingli': 1, 'pardieu': 1, 'formulat': 1, 'chalki': 1, 'biswa': 3, 'sameer': 1, 'amrutha': 1, 'anjaan': 4, 'ajnabi': 3, 'abhi': 2, 'aada': 1, 'adhura': 1, 'dancey': 1, 'netlaska': 1, 'hrabal': 1, 'hasek': 1, 'menzel': 1, 'sverak': 1, 'unmanli': 1, 'pigozzi': 1, 'femi': 1, 'benussi': 1, 'giombini': 1, 'lubi': 1, '740il': 1, 'lime': 2, 'lethim': 1, 'theset': 1, 'aliceevan': 1, 'fromteen': 1, 'andil': 1, 'isa': 1, 'apparentlyunengin': 1, 'onlyintermitt': 1, 'wehav': 1, 'ofrec': 1, 'viagem': 1, 'barkley': 2, 'freudstein': 1, 'twelfth': 1, 'unimpos': 2, 'kingli': 1, 'mcewan': 1, 'dosent': 1, 'poundland': 2, 'plasterboard': 1, 'majkowski': 4, 'sollac': 3, 'blanketi': 1, 'doesen': 2, 'unpretens': 1, 'writr': 1, 'deutschen': 1, 'panzer': 1, 'mahalov': 1, 'babitch': 1, 'dina': 2, 'abdullah': 1, 'tousl': 2, 'ast': 1, 'arditi': 1, 'azema': 1, 'chinpira': 1, 'slowwwwww': 1, 'tideland': 1, 'nenett': 1, 'casar': 4, 'paradi': 4, 'alfio': 2, 'contini': 2, 'childbear': 1, 'completeist': 1, 'daena': 2, 'puzzlement': 4, 'thx1138': 2, 'embarrassli': 1, 'scenether': 1, 'athsma': 1, '280': 1, 'theremin': 3, 'parvenu': 1, 'megaeuro': 1, 'largley': 1, 'nough': 1, 'dusan': 2, 'kovacev': 1, 'kostic': 1, 'stanojlo': 1, 'milinkov': 1, 'slobodan': 2, 'sijan': 2, 'gispsi': 1, 'kako': 1, 'sistematski': 1, 'unisten': 1, 'davitelj': 1, 'protiv': 1, 'davitelja': 1, 'redraw': 2, 'usaff': 2, 'loggerhead': 1, 'hourglass': 2, 'pettili': 1, 'nekoski': 1, 'locu': 2, 'lederhosen': 1, 'katzelmach': 1, 'luckli': 1, 'encyclopidi': 1, 'carnosour': 1, 'pongo': 2, 'perdita': 1, 'coffey': 1, 'dez': 3, 'dazzi': 2, 'catepillar': 1, 'consigliori': 1, 'campili': 1, 'masi': 1, 'stathom': 1, 'miscategor': 1, 'minutest': 1, 'jogando': 1, 'assassino': 1, '19thc': 1, 'zzzz': 1, 'boxlietn': 1, 'labia': 2, 'anon': 1, 'joong': 1, 'flaccidli': 1, 'apallingli': 1, 'zui': 1, 'sprog': 1, 'jamacian': 1, 'tenma': 1, 'alejo': 1, 'zoran': 1, 'moshimo': 1, 'kamen': 1, 'treen': 1, 'klaski': 2, 'csupo': 2, 'tt0408790': 1, 'usercom': 1, '578i': 1, 'orderd': 1, 'sould': 1, 'brocksmith': 1, 'nomolo': 3, 'midrang': 1, 'decontamin': 3, 'infring': 4, 'hh': 1, 'tenterhook': 1, 'slider': 2, '2h30': 1, 'compassionn': 1, 'spectabl': 1, 'innovatori': 1, 'sketchlik': 1, 'crispli': 2, 'musuraca': 1, 'rivkin': 1, 'wimpish': 1, 'baseheart': 1, 'stradl': 1, 'previn': 1, 'yuwen': 2, '1790': 1, 'coll': 1, 'grater': 1, 'budjet': 1, 'civvi': 1, 'catalonia': 1, 'gerda': 2, 'cihangir': 1, 'undamag': 1, 'zanta': 1, 'farra': 1, 'rockythebear': 1, 'ernestin': 1, 'peggoti': 1, 'untract': 1, 'chaco': 1, 'ooveral': 1, 'taxman': 1, 'cottrel': 1, 'tranquilli': 1, 'mape': 1, 'broth': 3, 'sharawat': 1, 'kabhi': 3, 'kushi': 1, 'ghum': 1, 'rishtaa': 1, 'dandia': 1, 'taandav': 1, 'santosh': 1, 'thundiiayil': 1, 'corneal': 1, 'huber': 1, 'andro': 1, 'tarri': 1, 'markel': 2, 'kass': 1, 'mestressat': 1, 'bilancio': 1, 'resours': 1, 'aaja': 1, 'nachl': 1, 'falak': 1, 'haridwar': 1, 'saitn': 1, 'ravingli': 1, 'lenghth': 1, 'umi': 1, 'miteita': 1, 'swansong': 1, 'oshin': 6, 'nagiko': 2, 'misa': 2, 'okuhara': 1, 'unneccesari': 1, 'goombaesqu': 1, 'bauxit': 1, 'dunebuggi': 1, 'hemet': 1, 'deix': 1, 'mazar': 1, 'syncer': 1, 'smokescreen': 2, 'disjointedli': 1, 'kratina': 1, '1901': 4, '2642': 1, 'nonlinear': 1, 'backword': 1, 'tenaru': 1, 'halcyon': 1, 'chicori': 1, 'rada': 1, 'ishoo': 1, 'getter': 3, 'padburi': 1, 'deferenti': 1, 'sprain': 1, 'unco': 1, 'walid': 1, 'shoebat': 1, 'shootist': 1, 'frack': 1, 'caprican': 1, 'horsewhip': 1, '1920i': 1, '1930i': 1, 'croisett': 2, 'unconc': 1, 'durr': 1, 'numbskul': 1, 'aetheist': 3, 'rigamarol': 1, 'jb': 2, 'eeuurrgghh': 1, 'vengeant': 1, 'ladyslipp': 1, 'alladin': 2, 'robald': 1, '10objection': 1, 'jobbo': 1, '90ish': 2, 'krog': 1, 'kroc': 1, 'gunsel': 1, '1610': 1, 'imbd': 2, 'oopp': 1, 'jukebox': 3, 'gregoli': 1, 'oren': 1, 'sugarco': 2, 'c4': 1, 'fontanel': 1, 'britten': 1, 'reti': 1, 'mim': 1, '59th': 2, 'lubrici': 1, 'arthor': 1, 'cess': 1, 'tless': 1, 'dourdan': 1, 'unkown': 1, 'novelett': 2, 'cugat': 1, 'mcneali': 3, 'microsystem': 1, 'moroccon': 1, '2000sdri': 1, 'dongen': 1, '420': 1, '51b': 1, 'advisori': 4, 'fightin': 2, 'deadeningli': 3, '50ft': 1, 'crapulast': 1, 'milanes': 4, 'alessandro': 2, 'urb': 1, 'senza': 1, 'thalassa': 1, 'accompagni': 1, 'amsterdamn': 1, 'everday': 1, 'bulldos': 1, 'yd': 1, 'squishi': 1, 'uncoil': 1, 'acclim': 2, 'protuber': 1, 'probosci': 1, 'syncher': 1, 'solti': 1, 'sacrament': 2, 'yuzo': 1, 'koshiro': 1, 'airtight': 2, 'rohit': 1, 'bikram': 2, 'saluja': 1, 'jik': 2, 'richandson': 1, 'octopuss': 1, 'camara': 1, 'tegan': 1, 'weeknight': 1, 'mulit': 1, 'brainwhi': 1, 'shmaltz': 1, 'lintz': 3, 'sloppish': 1, 'motocross': 2, 'aaliyah': 1, 'zvezda': 2, 'endnot': 1, 'empahsis': 1, 'retopolog': 1, 'bomberang': 1, 'lasker': 2, 'kroll': 1, 'krasner': 1, 'atomspher': 1, 'scanlon': 1, 'sigfri': 1, 'peeew': 1, 'unfrozen': 2, 'fuhgeddaboudit': 1, 'cashman': 1, 'passworthi': 8, 'guaronte': 1, 'proprietari': 1, 'eldard': 2, 'ripthi': 1, 'uktv': 1, 'fuddi': 1, 'duddi': 1, 'tt0283181': 1, 'provensa': 1, 'thiat': 1, 'rollerblad': 1, 'nowheresvil': 1, 'fightm': 1, 'ficker': 1, 'basbal': 1, 'deadlier': 2, 'microchip': 1, 'computeris': 1, 'cyhper': 1, 'baylock': 1, 'korot': 1, 'zardoz': 2, 'numberless': 1, 'bondless': 1, 'scripted': 1, 'lightfooted': 1, 'renuka': 2, 'daftardar': 2, 'ghosti': 2, 'mallow': 1, 'myerson': 1, 'kellum': 1, 'grauen': 1, 'wie': 1, 'welt': 1, 'kam': 1, 'prag': 10, 'balduin': 12, 'margit': 2, 'grete': 2, 'schwarzenberg': 3, 'lothar': 2, 'rner': 3, 'scapinelli': 5, 'gottowt': 3, 'hann': 1, 'ewer': 4, 'salmonova': 1, 'weidemann': 1, 'waldi': 1, 'malloy': 1, 'raza': 1, 'benignli': 1, 'cutdown': 1, 'turveydrop': 1, 'jellybi': 1, 'theowinthrop': 1, 'eliott': 1, 'flyte': 2, 'hawdon': 1, 'copyist': 1, 'keng': 1, 'brickmak': 1, 'neckett': 1, 'amoung': 1, 'commite': 1, 'beege': 1, 'alerthomeward': 1, 'trainyard': 1, 'andel': 1, 'walterman': 2, 'unburi': 1, 'eguilez': 1, 'atavist': 1, 'dingiest': 1, 'fullscreen': 3, 'peppard': 1, 'puro': 6, 'sued': 1, 'prate': 2, 'guntenberg': 1, 'ebook': 1, '18137': 1, 'academia': 2, 'sunnyg': 1, 'aymer': 6, 'engalnd': 1, 'thge': 1, 'franchina': 1, 'advocaci': 2, 'camarari': 1, 'mamma': 2, 'cerletti': 2, 'vertebra': 1, 'hippocrat': 1, 'fucu': 1, 'unannounc': 1, 'bmoviefreak': 1, 'bungi': 1, 'chortl': 2, '130': 2, 'ebano': 1, 'vasquez': 2, 'doorstop': 1, 'biroc': 2, 'fandango': 1, 'megaplex': 1, 'zenon': 1, 'kilner': 1, 'rrw': 2, 'oilfield': 1, 'dapn': 1, 'dauntless': 1, 'beingcorn': 1, 'tp': 7, 'felini': 1, 'fenn': 3, 'gowki': 1, 'broon': 1, 'mollycoddl': 1, 'essanay': 2, 'thebi': 3, 'everson': 1, 'ched': 1, 'mbarrass': 1, 'cuf': 1, 'euguen': 1, 'estrella': 1, 'wilsey': 1, 'brasseur': 1, 'mosntr': 1, 'leaderless': 1, 'gauleit': 1, 'bonnair': 1, 'ranker': 1, 'flatteri': 4, 'antimatt': 1, 'dunkirk': 2, 'atchison': 1, 'topeka': 1, 'burnsid': 1, 'ericson': 2, 'scrimmag': 1, 'ravioli': 1, 'ziti': 1, 'casterini': 1, 'untrust': 1, 'evolutionist': 1, 'militar': 2, 'zair': 1, 'telethon': 1, 'jape': 1, 'leitmotiv': 2, 'galitzien': 1, 'ferdinandvongalitzien': 1, 'budweis': 1, 'wga': 1, 'brunch': 1, 'marciano': 1, 'homeli': 1, 'nonaquat': 1, 'pothold': 1, 'airfix': 1, 'loooooong': 1, 'sweatdroid': 1, 'imhotep': 1, 'hearted': 3, 'archtyp': 1, 'donato': 1, 'discover': 1, 'cosmetician': 1, 'nesbitt': 3, 'parlablan': 1, 'perjuri': 1, '20001': 1, 'hahagrun': 1, 'gangmemb': 1, 'ourday': 1, 'striker': 1, 'siberl': 4, 'rav': 1, 'bser': 1, 'calder': 2, 'pagel': 1, 'bierko': 1, 'flapjack': 2, 'mandark': 2, 'fragasso': 9, 'felsh': 1, 'jerzi': 3, 'stuhr': 1, 'reaaaaallli': 1, 'cripe': 2, 'telekenisi': 1, 'x1': 1, 'verhooven': 1, 'verhopven': 1, 'gesellich': 1, 'hooooottttttttttt': 1, 'clammi': 1, '8star': 1, '10star': 1, 'anett': 2, 'charleson': 1, 'longendeck': 1, 'notoriu': 1, 'tomelti': 1, 'badel': 1, 'confab': 1, 'brammel': 1, 'sanjaya': 1, 'mchale': 2, 'shavian': 1, 'onelin': 2, 'vivaah': 1, 'vishq': 1, 'shikhar': 2, 'nanook': 2, 'kayak': 3, '330am': 1, 'umiak': 1, 'sker': 1, 'geograp': 1, 'xtian': 4, 'charlesmanson': 1, 'xtianiti': 1, 'piss3d': 1, 'streetfight': 4, 'locut': 1, 'quicken': 2, 'tribbiani': 2, 'loooov': 1, 'denser': 1, 'mclachlan': 1, 'fairuza': 2, 'muro': 1, 'polidori': 1, 'gargantua': 1, 'zoolog': 2, 'takashima': 2, 'ivanova': 1, 'tallman': 1, 'minbari': 1, 'micael': 1, 'brackett': 3, 'ckin': 1, 'gwar': 4, 'deathbot': 1, 'motionlessli': 1, 'goddam': 2, 'blisteringli': 1, 'boobtub': 1, 'mostest': 1, 'kitbag': 1, 'windfal': 1, 'calvari': 2, 'dorama': 2, 'viewership': 1, 'jejun': 1, 'walberg': 1, 'makinen': 1, 'saalistajat': 1, 'autocu': 1, 'pedicurist': 1, 'spud': 2, 'faaar': 1, 'lowsi': 1, 'hhoorriibblle': 1, 'booooooo': 1, 'borderland': 1, 'clamour': 1, 'speaksman': 2, 'apparantli': 3, 'humma': 3, '13k': 1, 'aesop': 1, 'ozporn': 1, 'kuomintang': 1, 'chiang': 2, 'shek': 1, 'autonomi': 2, 'bringleson': 1, 'rubrick': 1, 'iritf': 3, 'selwyn': 1, 'kenichi': 1, 'endo': 1, 'kazushi': 1, 'shungiku': 1, 'uchida': 2, 'muto': 1, 'scatalog': 1, 'sheeesh': 1, 'indentur': 1, 'escrow': 1, 'geranium': 1, 'moviefreak': 1, 'sibil': 1, 'procliv': 2, 'flotsam': 1, 'lippo': 1, 'awstruck': 1, 'gillmor': 2, 'fashionthat': 1, 'flesheat': 2, 'tribeswomen': 1, 'everpres': 1, 'bako': 1, 'palladino': 1, 'verrrrri': 1, 'bisset': 3, 'mockag': 3, 'listerin': 1, 'manckiewitz': 1, 'greati': 1, 'entropi': 3, 'wassel': 1, 'miljan': 1, 'reunifi': 1, 'maximillian': 1, 'manassa': 1, 'mckinley': 1, 'kantor': 1, 'ruinou': 1, 'bilingu': 2, 'cyan': 1, 'teensploit': 1, 'guerin': 1, 'catelain': 1, 'hugon': 2, 'autant': 3, 'sten': 1, 'waterburi': 2, 'ct': 1, 'diniro': 1, 'nimrod': 1, 'poplar': 1, 'redmond': 1, 'brough': 1, 'glenco': 2, 'middlebrow': 2, 'bassist': 1, 'copious': 1, 'erickson': 1, 'orri': 2, 'giantsthi': 1, 'gidget': 2, 'beachboy': 1, 'contemporay': 1, 'cifaretto': 1, 'redifin': 2, 'reprogram': 1, 'overanxi': 1, 'touchabl': 1, '17million': 1, 'vunerablit': 1, 'donoho': 1, 'vancleef': 2, 'hauk': 1, 'eisley': 2, 'strock': 2, 'summum': 1, 'detlef': 1, 'baroni': 1, 'riffl': 2, 'holmann': 1, 'leclerc': 3, 'signer': 1, 'dupui': 1, 'dythiramb': 1, 'veterinari': 2, 'daugther': 1, 'paramind': 1, 'yasminda': 2, 'melachon': 1, 'habanera': 2, 'tarrant': 1, 'zagreb': 1, 'jz': 1, 'zeleznic': 1, 'butterick': 1, 'treater': 2, 'spaniel': 2, 'ais': 1, 'commedia': 1, 'brittannica': 1, 'marivaudag': 1, 'cherubino': 1, 'figaro': 2, 'kardasian': 1, 'cresta': 8, 'honu': 2, 'gant': 7, 'kiowa': 1, 'beelin': 1, '1864': 2, 'calico': 3, 'beenvil': 1, 'blodgett': 1, 'meldrick': 1, 'rasch': 2, 'longorria': 1, 'schotland': 2, 'knick': 2, 'cei': 2, '5539': 1, 'abducte': 1, 'whitley': 1, 'strieber': 1, 'klass': 1, 'posner': 1, 'filmedth': 1, 'necromaniacthi': 1, 'beejesu': 1, 'heezi': 1, 'timberflak': 1, 'halfass': 2, 'commentor': 1, 'poki': 1, 'spindl': 1, 'mowgli': 1, 'okey': 4, 'maelstr': 1, 'affectedli': 1, 'neutralis': 1, 'verveen': 1, 'siouxi': 1, 'palingenesi': 1, 'foreshorten': 1, 'mungl': 1, 'cwhere': 1, 'extremeey': 1, 'amat': 1, 'guthri': 5, 'caudil': 1, 'zeb': 3, 'hunnicutt': 2, 'milktoast': 1, 'uttter': 1, 'cran': 1, 'damagingli': 2, 'ubermensch': 1, 'biplan': 3, 'koenekamp': 1, 'planter': 2, 'comedu': 1, 'reliefu': 1, 'northt': 1, 'lawmen': 3, 'testoteron': 1, 'chappl': 1, 'hanahan': 1, 'lucianna': 3, 'madeira': 1, 'cobalt': 2, 'gaillardian': 2, 'videofilm': 1, 'watercolor': 1, 'sking': 1, 'alchohol': 1, 'moimem': 1, 'prosi': 1, 'gingerman': 1, 'boobag': 1, 'yound': 1, 'turley': 1, 'olosio': 1, 'khomeini': 1, 'ahmadinejad': 1, 'tbh': 1, 'usus': 1, 'magest': 1, 'gwenneth': 4, 'beckingsal': 1, 'balikbayan': 1, 'megazord': 1, 'senshi': 1, 'tobikag': 1, 'kohler': 2, 'doogi': 1, 'howser': 1, 'pantyhos': 2, '30ish': 1, 'stinkingli': 1, 'cybersix': 6, 'data7': 1, 'luve': 1, 'sieldman': 1, 'reichter': 1, 'broflofski': 1, 'nosediv': 1, 'foreclos': 1, 'zeek': 1, 'godawul': 1, 'grisal': 1, 'bejarano': 1, 'triana': 1, 'freejack': 1, 'pineal': 1, 'lindsley': 1, 'catwomen': 2, 'sappili': 1, 'frankenhook': 1, 'sinyard': 1, 'suaviti': 2, 'anaem': 1, 'timecop': 4, '1it': 1, '2060': 1, 'timetravel': 1, 'shortat': 1, 'daraar': 2, 'paydirt': 1, 'corollari': 2, 'reichskanzl': 1, 'salava': 1, 'arnald': 1, 'hillerman': 2, 'cringeabl': 1, 'pippi': 6, 'longstock': 1, 'lindgren': 1, 'hawker': 1, 'b36': 1, '84f': 1, '8u': 1, '11f': 1, 'skywarrior': 1, 'wingtip': 1, 'thunderjet': 1, 'jowett': 1, 'a50': 1, 'nec': 1, 'mysoju': 1, 'sumir': 1, 'iwaya': 1, 'herioc': 1, 'kimba': 1, 'mirkovich': 1, 'moreira': 6, 'mcgorman': 1, 'krivtsov': 1, 'zombiefest': 2, 'scarefest': 2, 'ansonia': 1, 'fao': 1, 'chez': 2, 'christianson': 2, 'christenson': 2, 'anaesthesia': 1, 'korzeniowski': 1, 'darabont': 2, 'oculist': 1, 'garia': 1, 'katzenbach': 1, 'tanni': 4, 'evangelin': 2, 'molden': 1, 'sherriff': 3, 'dsv': 1, 'mirthless': 2, 'gossam': 1, 'fluidli': 2, 'nonethelss': 1, 'thayer': 1, 'impound': 1, 'beckettian': 1, 'drk': 1, 'hal9000': 1, 'chennai': 1, 'ghatak': 1, 'khiladiyon': 1, 'khialdi': 1, 'zanjeer': 1, 'choti': 1, 'sacrfic': 1, 'dadsaheb': 1, 'phalk': 1, 'shudn': 1, 'chacha': 1, 'praarthana': 1, 'buzzword': 1, 'sindhoor': 1, 'qayamat': 2, 'dhoom2': 1, 'fanaa': 1, 'golmaal': 2, 'hammili': 1, 'knowabl': 2, 'hammiest': 1, 'stagehand': 2, 'usu': 1, 'whove': 1, 'hedghog': 1, 'robotnik': 1, 'yokia': 1, 'kaleidescop': 1, 'labrynth': 1, 'tetzlaff': 2, 'uxb': 1, 'jaqui': 1, 'khakhe': 1, 'khakhi': 1, 'rajnikanth': 3, '7even': 1, 'humprey': 1, 'substat': 1, 'crewmemeb': 1, 'americanim': 2, 'dreadlock': 1, 'icegun': 1, 'jlu': 1, 'sesem': 3, 'veggi': 2, 'dulani': 1, 'zaitochi': 1, 'ichii': 1, 'yomada': 1, 'dmv': 2, 'gawdaw': 2, 'nicolett': 1, 'pyromaniac': 1, 'faw': 1, 'desli': 2, 'seiter': 1, 'nikkhil': 1, 'sati': 1, 'savitri': 1, 'pati': 1, 'parmeshwar': 1, 'salmaan': 2, 'priyanaka': 1, 'jereon': 1, 'isgeorg': 2, 'serat': 2, 'jatt': 2, 'sonheim': 2, 'jkd': 1, 'germanish': 1, 'macau': 1, 'laughablebut': 1, 'the70': 1, 'contempari': 1, 'terminu': 2, 'postrevolutionari': 2, 'priveghi': 2, 'permeabl': 1, 'membran': 1, 'osmosi': 1, 'horsecocki': 1, 'tatto': 1, 'palmira': 1, 'natacha': 1, 'amal': 1, 'delamer': 1, 'aicn': 1, 'thorstein': 1, 'veblen': 1, 'raha': 1, 'nasha': 1, 'jee': 2, 'moviewel': 1, 'movieanyway': 1, 'badamitabh': 1, 'jaya': 3, 'ghungroo': 2, 'narishma': 1, 'heheheh': 1, 'oki': 1, 'watchingth': 1, 'ratingdirect': 1, '10total': 1, '10si': 1, 'shabbir': 1, 'naqvi': 1, 'mochanian': 1, 'lattanzi': 1, 'highjinx': 1, 'nonintent': 1, 'chorist': 2, 'connected': 2, 'kovack': 4, 'scuf': 1, 'remo': 4, 'uptrodden': 1, 'bartok': 2, 'concerto': 3, 'condoli': 1, 'severison': 1, 'stuttgart': 3, 'messeg': 1, 'wongo': 1, 'drover': 3, 'lasagna': 4, 'conehead': 2, 'dde': 2, 'killl': 1, 'huxley': 1, 'tomilinson': 1, 'oshea': 1, 'fragglerock': 1, 'rhetorom': 1, '278': 1, 'soderberghian': 1, 'bratt': 1, 'incompetent': 1, 'proleteriat': 1, 'cappucino': 1, 'phriend': 1, 'seussic': 1, 'metafilm': 1, 'makavajev': 1, 'borj': 4, 'nonviol': 1, 'bjore': 1, 'ahlstedt': 1, 'snapper': 1, 'rigbi': 1, 'bergammi': 1, 'gaudenzi': 1, 'nothan': 1, 'fmc': 2, 'doxen': 1, 'sociopolit': 1, 'soiler': 1, 'watchowski': 2, 'overmast': 1, 'attept': 1, 'whigham': 2, 'mockumentri': 1, 'zoheb': 2, 'wasim': 1, 'manjit': 1, 'khosla': 1, 'mannu': 4, 'amritl': 1, 'sha': 1, 'suresh': 1, 'ompuri': 1, '240': 1, 'schwadel': 2, 'driftwood': 1, 'gobbledi': 2, 'kistofferson': 1, 'carruth': 4, 'staf': 1, 'mcmahonag': 1, 'michonoku': 1, 'underatak': 1, 'suffus': 1, 'mcmurphi': 1, 'mediumist': 1, 'ceylones': 1, 'autocrat': 2, 'persepoli': 3, 'coulai': 1, 'moggi': 1, 'rulezzz': 1, 'talon': 1, 'gfx': 1, 'soundeffect': 1, 'scryeeee': 2, 'escpeci': 1, 'unsuspens': 2, 'impurest': 1, 'blushi': 2, 'fucki': 1, '30lb': 1, 'independentcrit': 1, 'andaaz': 1, 'abandoningindian': 1, 'foxbark': 1, 'brylcreem': 1, 'gutman': 1, 'wonderley': 1, '35th': 2, 'wheati': 1, 'kevetch': 1, 'christmav': 1, 'imzadi': 3, 'weirdi': 1, 'spackl': 1, 'harriett': 1, 'meeci': 2, 'heideck': 1, 'snoodl': 3, 'hilariu': 2, 'boettcher': 1, 'profster': 2, 'burl': 1, 'kaiso': 1, 'pizzazz': 1, 'documetari': 1, 'undersand': 1, 'preferisco': 1, 'pasqual': 1, 'khrzhanosvki': 1, 'shortsight': 1, 'shet': 1, 'shangai': 4, 'unfurl': 1, 'chori': 4, 'mehndi': 4, 'dekhn': 3, 'raaj': 1, 'nadira': 1, 'pakeeza': 1, 'haan': 1, 'pakeza': 1, 'twink': 3, 'msti': 1, 'hertfordshir': 1, 'alban': 3, 'hemel': 1, 'hempstead': 1, 'conchatta': 2, 'taxat': 3, 'decivil': 1, 'unshav': 1, 'tzigan': 1, 'planetoid': 1, 'teodoro': 5, 'giulio': 2, 'lope': 2, 'udia': 3, 'caval': 2, 'soninha': 4, 'lvia': 1, 'waldomiro': 2, 'ailton': 1, 'terezinha': 1, 'meola': 1, 'lio': 2, 'ara': 5, 'ecgtb': 1, 'thay': 1, 'tracksuit': 1, 'goundamani': 1, 'interdimension': 1, 'babaji': 1, 'param': 1, 'chakra': 1, 'keiko': 1, 'samsung': 1, 'lazarushian': 1, 'ziman': 1, 'fizzli': 1, 'emilfork': 1, 'krank': 2, 'loiter': 1, 'dungi': 1, 'heider': 1, 'wight': 1, 'wearili': 3, 'painer': 1, 'forcelin': 1, 'digonal': 1, 'backround': 1, 'between': 1, 'cheyney': 1, 'kindsa': 1, 'blogger': 1, 'blotter': 1, 'fliqu': 1, 'kosturica': 1, 'bil': 1, 'kaleidiscop': 1, 'wingfield': 2, 'immov': 2, 'faustian': 3, 'machinea': 1, 'dinasti': 1, 'coffeshop': 2, 'maschocist': 1, 'multizillion': 1, 'jerrin': 1, 'folsom': 1, 'rangeland': 1, 'landauer': 1, 'midwif': 1, 'backbreak': 1, 'unclaim': 1, 'midwint': 1, 'footl': 1, 'lamplight': 1, 'crumb': 2, 'ween': 1, 'starkest': 1, 'polysyllab': 1, 'pandro': 1, 'mohav': 1, 'tantrapur': 2, 'realityshowlik': 1, 'tautli': 1, 'degeneraci': 1, 'safdar': 1, 'kheir': 2, 'abadi': 2, 'masoud': 1, 'kheymeh': 1, 'kaboud': 1, 'adlai': 1, 'tchiness': 1, 'frech': 1, 'hillsborough': 2, '02i': 1, 'jamesbondish': 1, 'inartist': 1, 'outa': 2, 'serf': 1, 'bazaar': 1, 'montauk': 1, 'patronisingli': 2, 'costal': 1, 'urbanit': 2, '10pm': 3, 'infierno': 3, 'malebranch': 1, 'jorobado': 1, 'orgia': 1, 'espanto': 1, 'tumba': 1, 'latido': 1, 'panico': 1, 'rojo': 1, 'guir': 1, 'tansi': 1, 'christmanish': 1, 'cattral': 1, 'alloimono': 1, 'stou': 1, 'neou': 1, 'shenzi': 3, 'antelop': 1, 'wildebeest': 2, 'rhinoceros': 1, 'broddrick': 1, 'frivil': 1, 'klaveno': 3, 'horroresqu': 1, 'perf': 1, 'bytom': 1, 'orvil': 1, 'bestul': 1, 'indefins': 1, 'prescreen': 2, 'toooo': 1, 'cadavra': 1, 'neno': 1, 'kaho': 1, 'contraversi': 1, 'surrogaci': 4, 'mastan': 1, 'ballin': 1, 'cromoson': 1, 'sportswear': 1, 'seamier': 2, 'iambic': 2, 'pentamet': 2, 'moviewis': 1, 'lol1': 1, 'zavattini': 1, 'valis': 1, 'montreux': 1, 'grievous': 1, 'dietrichesqu': 1, 'sinecur': 1, 'foucault': 1, 'copain': 1, 'uncinemat': 2, 'ungift': 1, 'paso': 2, 'metroplex': 1, 'ameriquest': 1, 'disney1920': 1, 'tira': 3, 'buono': 1, 'lightner': 2, 'pingo': 1, 'knauf': 1, 'mckelheer': 1, 'firgen': 2, 'franic': 2, 'altieri': 1, 'flore': 1, 'petaluma': 1, 'leora': 1, 'barish': 1, 'trimel': 1, 'racoon': 2, 'bettiefil': 1, 'obv': 1, 'skunk': 6, 'lonnen': 2, 'rosalyn': 1, 'landor': 2, 'rosalyin': 1, 'matthaw': 1, 'ssed': 1, 'apper': 1, 'delt': 3, 'dyad': 1, '1903': 3, 'mentalist': 1, 'deffin': 1, 'stroesser': 1, 'kringl': 1, 'sanguinari': 1, 'impercept': 1, 'trickiest': 1, 'zink': 1, 'hydrat': 1, 'wc': 2, 'biarkan': 1, 'bintang': 1, 'menari': 1, 'bbm': 1, 'ferzan': 1, 'ozpetek': 1, 'vovochka': 4, 'varda': 1, 'anterior': 1, 'millon': 1, 'duvuvi': 1, 'sou': 2, 'douc': 1, 'plage': 1, 'zinemann': 1, 'maurier': 1, 'brevet': 1, 'hsd': 1, 'poil': 1, 'carott': 1, 'olvidado': 1, 'uncomprom': 1, 'argent': 1, 'poch': 1, 'vivement': 1, 'dimanch': 1, 'microbiolog': 1, 'alki': 3, 'delarua': 1, 'menen': 1, 'santamarina': 5, 'estela': 3, 'abrazo': 1, 'partido': 1, 'emiliano': 1, 'pineyro': 1, 'coselli': 1, 'melina': 2, 'petrielli': 1, 'esperando': 1, 'mesia': 1, 'billabong': 1, 'yonder': 1, 'polyphobia': 2, 'polyamor': 1, 'limitlessli': 1, 'polyamori': 1, 'trinder': 1, 'bond2a': 1, 'zeferelli': 1, 'exager': 1, 'avast': 1, 'citra': 1, 'windstorm': 1, 'daaaaaaaaaaaaaaaaaddddddddd': 1, 'chessi': 1, 'horor': 2, 'crudi': 1, 'gayson': 1, 'zobi': 1, 'nanit': 1, 'catalyz': 2, '3min': 1, 'irreligi': 1, 'masseus': 2, 'economis': 1, 'hwi': 2, '236': 1, 'erba': 1, 'c1': 2, 'savori': 1, 'selton': 1, 'mello': 1, 'spolador': 1, 'cordob': 1, 'whistlestop': 1, 'brooch': 2, 'dumbwait': 1, 'nuzzl': 1, 'racecar': 3, 'eightiesli': 1, 'vaccuum': 1, 'gatsbi': 1, 'unqiu': 1, 'balibar': 1, 'calculatingli': 1, 'uncontest': 1, 'intergend': 1, 'intemper': 1, 'scob': 1, 'sherrybabi': 1, 'calamin': 2, 'reognis': 1, 'fercryinoutloud': 1, 'vacu': 1, 'historyish': 1, 'adjunct': 2, 'schine': 1, 'hagiographi': 4, 'obit': 1, 'budd': 3, 'schulberg': 1, 'filmograph': 1, 'portait': 1, 'eventless': 1, 'vesica': 1, 'mondrian': 1, 'arguebl': 1, 'yulin': 3, 'ecxel': 1, 'a1': 1, 'puril': 1, 'adl': 1, 'accapella': 1, '230mph': 1, 'your': 2, 'suki': 1, 'medencev': 1, 'frightner': 1, 'scratcher': 4, 'medak': 2, 'adhes': 2, 'mayagi': 1, 'ils': 4, 'shruki': 1, 'widman': 1, 'fud': 1, 'cantic': 1, 'eichhorn': 1, 'radditz': 1, 'raddatz': 1, 'opfergang': 1, 'suntan': 1, 'brenneck': 1, 'beethtoven': 1, 'bleibteu': 1, 'grandam': 1, 'holst': 1, 'blut': 1, 'kora': 2, 'rosen': 1, 'tirol': 1, 'ihf': 1, 'mada': 1, 'yager': 1, 'schartzscop': 1, 'crummier': 1, 'beastmast': 2, 'tsst': 1, 'gooback': 1, 'ug': 1, 'qestion': 1, 'recommed': 1, 'exculsivley': 1, 'watchit': 1, 'gretal': 1, '45min': 3, 'coltish': 1, 'mroavich': 1, 'habousch': 1, 'koun': 3, 'soraj': 3, 'anupamji': 1, 'ishk': 2, 'licoln': 1, 'eravamo': 1, 'tanto': 1, 'hellrid': 1, 'louco': 1, 'jacko': 2, 'greensleev': 1, 'katharyn': 2, 'caduta': 1, 'zandale': 13, 'pillsburi': 1, 'kornhaus': 1, 'tangi': 1, 'viveca': 1, 'lindfor': 1, 'theirri': 1, 'tatta': 1, 'entwisl': 1, 'cessna': 1, 'snooker': 3, 'awakeningli': 1, 'rumah': 1, 'tumpangan': 1, 'signboard': 1, 'bismillahhirrahmannirrahim': 1, 'poorlyact': 1, 'histouch': 1, 'cr4p': 2, 'sh1tti': 1, 'hillth': 1, 'nautilu': 1, 'shockless': 1, 'maryln': 1, 'bdu': 1, 'jarom': 1, 'cowman': 1, '450': 1, 'km': 1, 'tweezer': 2, 'azn': 2, 'scenest': 1, 'critcism': 1, 'moviestar': 1, 'watc': 1, 'superson': 1, 'terminatrix': 1, 'philco': 1, 'kinescop': 1, 'weskit': 1, 'remington': 2, 'engletin': 1, 'antart': 1, 'denzil': 1, 'aparthiet': 1, 'faschist': 1, 'surpressor': 1, 'sidestori': 1, 'sidewind': 2, 'anglophil': 2, 'topiari': 1, 'joesphin': 1, 'himi': 1, '921': 1, 'horstachio': 6, 'fizzlybear': 1, 'schuckett': 1, 'bloomington': 1, 'pinacl': 1, 'padruig': 2, 'uill': 1, 'covel': 1, 'assult': 1, 'sassoon': 2, 'maniquen': 1, 'womman': 1, 'undet': 1, 'misconduct': 1, 'negotiatior': 1, 'vulneabl': 1, 'sluti': 1, 'medicor': 1, 'mirro': 1, 'oilwel': 1, 'pinko': 1, 'unfotun': 1, 'greencin': 1, 'sturla': 2, 'gunnarsson': 2, 'dastor': 1, 'chowdhri': 1, 'unbeguil': 1, 'sooni': 1, 'taraporevala': 1, 'fridrik': 1, 'fridriksson': 1, 'davidian': 1, 'acumen': 3, 'expresss': 1, 'damiella': 1, 'damiana': 1, 'meatiest': 1, 'natham': 1, 'apharan': 1, 'jha': 1, 'piyadarashan': 1, 'cxxp': 1, 'jezuz': 1, 'meeuwsen': 1, 'abscess': 1, 'saskatoon': 1, 'curvatur': 1, 'popoff': 1, 'hinn': 1, 'absalom': 2, 'venger': 2, 'okiya': 1, 'aroona': 1, 'nandu': 1, 'ruskin': 1, 'nowhonestli': 1, 'developmenti': 1, 'trimest': 1, 'utensil': 2, 'hoosegow': 2, 'chowderhead': 1, 'linnea': 1, 'logotheti': 1, 'standalon': 3, 'crout': 1, 'altron': 1, 'croat': 8, 'lanto': 2, 'producer9and': 1, 'karadzh': 1, 'izetbegovich': 1, 'tudjman': 2, 'yuggoslavia': 1, 'multiethn': 2, 'sarayevo': 1, 'aeronaut': 2, 'tepo': 1, 'philbin': 1, 'nativetex4u': 1, 'gilt': 1, 'almanesqu': 1, 'sollips': 1, 'mammonist': 1, 'pheromon': 1, 'barometr': 1, 'draaaaaaaawl': 1, 'morano': 1, 'kerosin': 1, 'oooooh': 1, 'becal': 1, 'freedmen': 1, 'baccarat': 1, 'motormouth': 1, 'ministr': 1, 'aloft': 1, 'vegan': 2, 'beachfront': 1, 'elpidia': 2, 'blindsid': 1, 'subiaco': 1, 'thuddingli': 1, 'darnit': 1, 'myst': 1, 'mustv': 1, 'rosalina': 1, 'dimeco': 1, 'korey': 1, 'hypest': 1, 'bejesu': 1, 'deforest': 1, 'chanson': 1, 'crocheti': 1, 'whiteley': 1, 'angeletti': 1, 'napl': 1, 'blackmoor': 1, 'ursla': 1, 'gamecock': 1, 'escrev': 1, 'collagen': 1, 'deon': 1, 'nutt': 1, 'dearabl': 1, 'fishbon': 1, 'sep': 2, 'unglu': 1, 'chances': 1, 'sassydon': 1, 'shadowfrank': 1, 'variousit': 1, 'moy': 1, 'beni': 1, 'endinghonestli': 1, 'doy': 1, 'antirust': 1, 'breadbasket': 2, 'breadstick': 2, 'moratorium': 1, 'hurter': 1, 'beguin': 1, 'mok': 2, 'fenni': 3, 'koon': 1, 'pharagraph': 1, 'passersbi': 1, 'blackfriar': 1, 'unsmil': 2, 'cleaverli': 1, 'disconcertingli': 1, 'nainit': 2, 'dhiraj': 3, 'qawwali': 1, 'sindbad': 1, 'kmadden': 1, 'winselt': 1, 'shocki': 1, 'katzenberg': 1, 'clackiti': 1, 'labyrinthian': 1, 'snuggest': 1, 'gawi': 3, 'pewter': 1, 'greico': 2, 'dratic': 1, 'originaland': 1, 'jarrett': 1, 'mcmichael': 2, 'ashen': 1, 'hott': 2, 'menotti': 3, 'mundial': 1, 'napoli': 5, 'tifosi': 1, 'camorra': 1, 'bilardo': 1, 'argi': 1, 'fenwick': 5, 'valdano': 1, 'shilton': 3, 'goalkeep': 1, 'handbal': 1, 'linesman': 1, 'burruchaga': 1, 'beardsley': 1, 'pele': 2, 'chapin': 1, 'matthieu': 2, 'deforc': 1, 'fagan': 1, 'gawp': 1, 'ropier': 1, 'galton': 1, 'grainer': 1, 'arold': 1, 'brambel': 1, 'collud': 1, 'aloysiu': 1, 'finerman': 2, 'kefauv': 1, 'robitussen': 1, 'dahm': 1, 'brainsadilla': 1, 'roobi': 1, 'oliva': 1, 'brangelina': 1, 'oozin': 1, 'runni': 1, 'bleb': 1, 'bollo': 1, 'balfour': 1, 'subwoof': 2, 'petrochem': 1, 'extirp': 1, 'lundegaard': 1, 'maneat': 2, 'dumbfoundingli': 1, 'movergo': 1, 'motorola': 1, '90c': 1, '44c': 1, '75c': 1, '35c': 1, '50c': 1, 'unadjust': 1, 'purdom': 1, 'vachtangi': 1, 'kote': 1, 'daoshvili': 1, 'germogel': 1, 'ipolit': 1, 'xvichia': 1, 'sergo': 1, 'zakariadz': 1, 'sofiko': 1, 'chiaur': 1, 'verikoan': 1, 'djafaridz': 1, 'sesilia': 1, 'takaishvili': 1, 'abashidz': 1, 'evgeni': 1, 'leonov': 1, 'mallorquin': 1, 'mallorqui': 1, 'barcelonan': 1, 'sunback': 1, 'zappati': 2, 'alselmo': 1, 'knowal': 1, 'gabfest': 1, 'kramden': 1, 'berwick': 1, 'lemma': 2, 'iniqu': 1, 'absolutl': 1, 'slalom': 1, 'twat': 1, 'fairview': 1, 'rodenti': 1, 'stewardship': 2, 'warnerscop': 1, 'eckland': 1, 'onibaba': 1, 'brubak': 1, 'yubb': 1, 'nubb': 1, 'wildenbr': 1, 'calibro': 1, 'incres': 1, 'placard': 2, 'classist': 1, 'cincinatti': 2, 'foreclosur': 1, 'ahahhahahaha': 1, 'sunlit': 1, 'pepperoni': 1, 'nyland': 1, 'reaaaalli': 1, 'shakesperean': 1, 'rohal': 1, '660': 1, 'macmurphi': 1, 'benjiman': 1, 'fleashen': 1, 'orazio': 2, 'merlik': 2, 'vreeland': 1, 'caravaggio': 1, 'agostino': 1, 'maojlov': 1, 'delhomm': 1, 'unflavor': 1, 'tapioca': 1, 'aroo': 1, 'quenton': 2, 'peptid': 6, 'receptor': 1, '1492': 1, 'unprovock': 1, 'expositionari': 1, 'gothika': 2, 'raili': 1, 'dinaggioi': 1, 'stinkpil': 1, 'characterswel': 1, 'fastmov': 1, 'jeepster': 1, 'shakepear': 1, 'sanitorium': 3, 'grandchild': 2, 'smolley': 1, 'briant': 1, 'voltando': 1, 'viver': 1, 'ashle': 1, 'vahtang': 1, 'movielink': 1, 'overblow': 1, 'amatur': 1, '10entertain': 1, '10replay': 1, 'bhhaaaad': 1, 'vanload': 1, 'ovi': 1, 'grinderlin': 1, 'haber': 1, 'overglamor': 1, 'balaclava': 1, 'angelin': 1, 'dott': 1, 'menopuas': 1, 'teeenag': 1, 'asta': 2, 'enmiti': 1, 'pecul': 1, 'fam': 1, 'prenez': 1, 'ane': 1, 'entent': 1, 'unargu': 3, 'giacconino': 1, 'holey': 1, 'gizzard': 1, 'sandcastl': 1, 'unroot': 1, 'whither': 1, 'hitcock': 1, 'itit': 1, 'buddist': 1, 'templechild': 1, 'expressionbad': 2, 'monkschild': 1, 'childth': 1, 'montegna': 1, 'prestidigit': 1, 'marraig': 1, 'sophomoron': 1, 'rabbitt': 1, 'snyder': 5, 'ahlberg': 1, 'farmboy': 1, 'faylen': 1, 'mensch': 2, 'thaxter': 2, 'politico': 4, 'archbishop': 2, 'stoppag': 1, 'overridden': 1, 'uppanc': 3, 'downi': 1, 'lul': 1, 'gummint': 2, 'vermicelli': 1, 'gloopi': 1, 'circumlocut': 2, 'ivress': 1, 'pouvoir': 1, 'sententi': 1, 'kalmu': 1, 'slc': 2, 'baiscal': 1, 'skitz': 1, 'swett': 1, 'mcdougl': 1, 'tamo': 2, 'peva': 2, 'caratheris': 1, 'optimu': 6, 'powermast': 1, 'megatron': 1, 'prosciutto': 1, 'quoth': 1, 'toliet': 1, 'agniezska': 1, 'shipload': 3, 'lanier': 2, 'pontent': 1, 'inten': 1, 'xizhao': 2, 'lowbudget': 1, 'abdu': 1, 'hamdi': 3, 'yvon': 1, 'ronet': 2, 'akm': 1, 'khazzan': 1, 'rempit': 1, 'evo': 1, 'centerstag': 1, 'porsh': 1, 'carerra': 4, 'koenigsegg': 1, 'ccx': 1, 'plasticki': 1, 'eliniak': 2, 'mumabi': 1, 'ulster': 1, 'tanna': 1, 'stope': 1, 'piven': 2, 'itallian': 1, 'subleti': 1, 'bakshki': 1, 'junglebunni': 1, 'commercialis': 2, 'perfection': 1, 'brune': 2, 'begot': 1, 'punker': 1, 'hs': 1, 'froud': 1, 'sider': 1, 'furdion': 1, 'artem': 1, 'tkachenko': 1, 'chulpan': 1, 'hamatova': 1, 'nyberg': 1, 'being': 1, 'berkovit': 1, 'soulheal': 1, 'sumthin': 1, 'maculay': 1, 'maraglia': 1, 'unlikelihood': 1, 'sulphur': 2, 'snakey': 1, 'souza': 2, 'farthest': 2, 'emaci': 1, 'vfx': 1, 'hookup': 1, 'somth': 1, 'kevorkian': 1, 'sinkhol': 1, 'mei': 4, 'midscreen': 1, 'droplet': 1, 'schweibert': 1, 'hutchin': 1, 'someup': 1, 'fortuat': 1, 'carlita': 1, 'jax': 2, 'thieriot': 2, 'spymat': 1, 'battement': 2, 'kierkegaard': 1, 'pyke': 5, 'sajani': 7, 'sivan': 6, 'instic': 1, 'rebl': 1, 'erkia': 1, 'recom': 1, 'bordello': 5, 'masqu': 1, 'unclassifi': 1, 'fooler': 1, 'biliti': 1, 'schulm': 1, 'throve': 1, 'voltair': 1, 'antimilitar': 1, 'mourir': 1, 'cardella': 3, 'kacey': 3, 'woorter': 1, 'quinlan': 2, 'jetlin': 1, 'patroni': 2, 'geniusli': 1, 'odyessi': 1, 'aikido': 2, 'naidu': 1, 'heep': 3, 'addon': 1, 'tongueless': 1, 'swayze': 4, 'agendabut': 1, 'outstad': 1, 'cagliostro': 1, 'coc': 1, 'tsotg': 1, 'timecod': 1, 'pedtrchenko': 1, 'jazzist': 1, 'kapow': 1, 'ina': 2, 'silvermann': 1, 'tester': 5, 'through': 2, 'gatl': 1, 't2': 2, 'siska': 1, 'rumpi': 1, 'pumpi': 1, 'screechi': 1, 'worringli': 1, 'unwari': 1, 'wayback': 1, 'kazuhiro': 7, 'deejay': 1, 'snaggletooth': 1, 'actriss': 1, 'odilon': 1, 'arrhythm': 1, 'facelessli': 1, 'monosyl': 2, 'ghettoiz': 1, 'egoyan': 1, 'imu': 1, 'frankbob': 1, 'flatfeet': 1, 'icb': 1, 'karra': 2, 'plimton': 1, 'indiscreet': 3, 'omdurman': 1, 'mahdist': 1, 'livington': 1, 'redlight': 1, 'ubaldo': 1, 'ragona': 1, 'galico': 4, 'railbird': 1, 'okinawan': 1, 'fotr': 1, 'superf': 1, 'gazzo': 1, 'suarez': 4, 'camacho': 1, 'leina': 1, 'scorecard': 1, 'putter': 2, 'xenophobicjust': 1, 'maximumanoth': 1, 'steir': 1, 'potok': 1, 'thrillerwint': 1, 'reasona': 1, 'iridesc': 1, 'denuev': 1, 'redfish': 1, 'zalman': 1, 'orbison': 1, 'diol': 2, 'treveil': 2, 'dallenbach': 1, 'lenthal': 1, 'kinlaw': 1, 'wiggin': 1, 'sumerel': 1, 'hayman': 2, 'kuwait': 1, 'pachelbel': 1, 'avro': 1, 'anson': 1, '303': 1, 'dorsal': 1, 'armless': 1, 'guildernstern': 1, 'filmslik': 1, 'morethan': 1, 'thedirector': 1, 'hecertainli': 1, 'heha': 2, 'whileremind': 1, 'thisi': 1, 'calai': 1, 'ano': 4, 'sattv': 1, 'sn': 2, 'characteratur': 1, 'heheit': 1, 'brilliantdont': 1, 'kanji': 1, 'pennelop': 1, 'taglialucci': 1, 'schamu': 1, 'mutabl': 1, 'mobiu': 1, 'arrrgghhh': 1, 'scratchili': 1, 'aggriv': 1, 'beanpol': 1, 'yuba': 1, 'myopia': 2, 'cecelia': 1, 'woog': 1, 'herbivor': 1, 'timur': 1, 'bekmambetov': 4, 'blomkamp': 1, 'joburg': 1, 'clanki': 1, 'acker': 1, 'megahi': 1, 'reshuffl': 1, 'bouyant': 2, 'morticia': 1, 'cemetari': 2, 'sappingli': 1, 'sathya': 1, 'heeru': 1, 'gunghroo': 1, 'lal': 1, 'bierc': 1, 'leguizemo': 1, 'calabres': 1, 'bensonhurst': 2, 'bayridg': 1, 'gumba': 1, 'cbgbomfug': 1, 'gourmand': 1, 'wpix': 1, 'kaiju': 6, 'carapac': 1, 'propuls': 2, 'shusuk': 4, 'kaneko': 4, 'shayamalan': 1, 'boudoir': 1, 'juicier': 1, 'expat': 1, 'amair': 1, 'yaser': 1, 'piotr': 1, 'opioion': 1, 'preti': 1, 'muslin': 1, 'gouald': 5, 'gossebump': 1, 'bwahahahahha': 1, 'stilwel': 1, 'pursuant': 1, 'caswel': 2, 'smeaton': 2, 'videoeven': 1, 'jarecki': 1, 'houdini': 1, 'unwieldi': 2, 'artyfartyrati': 1, 'meteorologist': 1, 'trinari': 1, 'arachnophobia': 1, 'albatross': 1, 'voorhess': 1, '378': 1, 'rumanian': 2, 'kalser': 1, 'runmanian': 1, 'garron': 2, '166': 1, 'oogl': 1, 'giovinazzo': 1, 'cauliflow': 1, 'eduh': 1, 'cait': 1, 'nepaleas': 1, 'totenkopf': 2, 'nepales': 1, 'emu': 1, 'juvi': 1, 'firebug': 1, 'songbook': 1, 'affectingli': 1, 'harltey': 1, 'friedberg': 1, 'franni': 2, 'delouis': 1, 'settlel': 1, 'thid': 1, 'shuffler': 1, 'alum': 2, 'impolit': 1, 'glynn': 3, 'turman': 2, 'caparzo': 1, 'feodor': 2, 'questionthat': 1, 'relaes': 1, 'playgroung': 1, 'espinazo': 1, 'weel': 2, 'sevilla': 1, 'creditsof': 1, 'superwonderscop': 1, '194': 1, 'klaymat': 1, '788': 1, 'xxl': 1, 'squirter': 1, 'doncha': 1, 'toffe': 1, 'wyeth': 1, 'contrarili': 1, 'unthought': 3, 'heterosex': 1, 'sistuh': 1, 'celeberti': 1, 'musashibo': 1, 'fak': 1, 'bargepol': 1, 'plissken': 1, '8000': 1, 'charteri': 1, 'ffoliott': 1, 'cowan': 1, 'mcvey': 2, 'crawli': 1, 'trotwood': 2, 'sempergrati': 1, 'conspirit': 1, '20c': 1, 'streetz': 1, 'doubter': 2, 'everlastingli': 1, 'theotocopulo': 1, 'donnagio': 1, 'dorna': 1, 'gona': 1, 'simular': 2, 'debyt': 1, 'humanim': 1, 'batail': 1, 'everyplac': 1, 'nesher': 1, 'garant': 1, 'innocentish': 1, 'wren': 1, 'hisself': 1, 'flan': 1, 'h2': 1, 'h3': 1, 'steckert': 7, 'zzzzzzzzzzzzz': 1, 'prudhomm': 1, 'arss': 1, 'urn': 2, 'genuis': 1, 'jimbo': 1, 'madn': 1, 'appologis': 1, 'cleat': 1, 'pissi': 1, 'stealin': 1, 'unschedul': 1, 'unpatriot': 2, 'turakistan': 1, 'haliburton': 1, 'visibil': 1, 'pointeblank': 1, 'tomeiher': 1, 'allit': 1, 'nekhron': 3, 'jerol': 1, 'farzetta': 1, 'starchas': 1, 'orin': 1, 'nausicca': 1, 'leesa': 1, 'flagpol': 1, 'anjela': 1, 'elana': 1, 'binysh': 1, 'fantasma': 1, '9000': 1, 'shortcak': 1, 'unsalt': 1, 'campanella': 1, 'oringin': 1, 'stockroom': 1, 'pina': 1, 'colada': 1, 'healdi': 1, 'braik': 1, 'spac': 1, 'jayaraj': 1, 'partha': 1, 'modail': 1, 'nalla': 1, 'ggooooodd': 1, 'natica': 3, 'ohrt': 1, 'immanuel': 1, 'tuengerth': 1, 'demmer': 1, 'supervan': 1, 'lasar': 1, 'deservingli': 1, 'mclaglin': 1, 'odyss': 1, 'unpercept': 1, 'merendino': 1, 'dervish': 1, 'facebook': 2, 'tvone': 1, 'rmb4': 1, 'hyet': 1, 'khala': 2, 'mahattan': 1, 'ip': 3, 'preferenti': 1, 'clearlli': 1, 'rightou': 1, 'jerrod': 1, 'asses': 1, 'fogbound': 1, 'causeway': 2, 'woamn': 1, 'necrot': 1, 'sheepl': 1, 'unintenion': 1, 'vermeer': 1, 'genevi': 1, 'radtha': 1, 'keitl': 1, 'aventura': 2, 'ferzetti': 1, 'amich': 1, 'grido': 1, 'aesthetic': 1, 'bitterman': 2, 'doofi': 1, 'mattel': 1, 'donowho': 1, 'probal': 1, 'alanti': 1, '10segment': 5, 'ladysmith': 1, 'mambazo': 1, 'musican': 1, 'spagnola': 1, 'parano': 1, 'lagosi': 5, 'cyajim': 1, 'correlli': 1, 'mandolin': 1, 'royersford': 1, 'thrace': 1, 'basestar': 1, 'frakken': 1, 'slothi': 1, 'dorkili': 1, 'outshoot': 1, 'lizardri': 1, 'carnabi': 1, 'mithra': 1, 'dionys': 1, 'nc17': 1, 'grandin': 3, 'smyrner': 1, 'atempt': 1, 'begger': 1, 'headtrip': 1, 'pish': 1, 'hernia': 1, 'pinet': 2, 'konerak': 1, 'sinthasomphon': 1, '1h40m': 1, 'kellytoni': 1, 'h20': 2, 'improprieti': 1, 'copola': 2, 'elizbethan': 1, 'strategist': 2, 'ooof': 1, 'acturli': 1, 'salisburi': 3, 'debney': 1, 'prevar': 1, 'nytim': 1, 'inculp': 1, 'heigel': 1, 'youe': 1, 'deathrap': 1, 'smmf': 4, 'pian': 3, 'notecard': 1, 'lycra': 1, 'greaest': 1, 'bhiku': 1, 'mhatr': 1, 'lillet': 1, 'khalla': 1, 'kulbhushan': 1, 'kharbanda': 1, 'watchin': 1, 'khushi': 1, 'pagal': 1, 'sassier': 1, 'divag': 1, 'haight': 1, 'asburi': 1, 'raphaelson': 3, 'unvent': 1, 'halton': 1, 'colcord': 1, 'mulford': 1, 'encultur': 1, 'astoundlingli': 1, 'inconnu': 1, 'strasbourg': 1, 'azur': 1, 'smarttech': 1, 'latimor': 1, 'branscomb': 1, 'dever': 1, 'quoit': 1, '20year': 1, 'ump': 1, 'teenth': 1, 'personnag': 1, 'mcaffe': 1, 'hypercrit': 1, 'bonsal': 1, 'quetin': 2, 'taratino': 1, 'phoormola': 1, 'cregar': 1, 'broiler': 1, 'nyfiken': 2, 'thandi': 1, 'medichlorian': 1, 'bloodstream': 2, 'winterbolt': 2, 'phinea': 1, 'ferb': 1, 'doofenshmirtz': 1, 'oireland': 1, 'motherfu': 1, 'tche': 1, 'thhe': 7, 'thhe2': 2, 'sided': 1, 'fijian': 1, 'subaltern': 1, 'charactor': 3, 'overspeak': 1, 'outplay': 1, 'goerg': 1, 'kristan': 1, 'goodspe': 1, 'turteltaub': 1, 'pirro': 1, 'deathrow': 2, 'todean': 1, 'cafferti': 1, 's02e03': 1, 'rhame': 4, 'mehki': 2, 'pfifer': 2, 'alllll': 1, 'distroy': 1, 'boooooo': 1, 'telletubb': 1, 'dolf': 1, 'malayalam': 4, 'mukesh': 1, 'sukumari': 2, 'horrorfilm': 1, 'bickl': 1, 'pupkin': 1, 'psychoth': 1, 'chaimsaw': 1, 'loust': 1, 'eesh': 1, 'schoolday': 1, 'pettyf': 2, 'daintili': 1, 'rakish': 2, 'expedition': 1, 'gradat': 1, 'spellcast': 1, 'undef': 2, 'russki': 1, 'heckuva': 1, 'jacqualin': 1, 'saidism': 1, 'thnk': 1, 'gruveyman2': 1, 'msn': 1, 'celoron': 1, 'scummiest': 1, 'moldiest': 1, 'spoilerphob': 1, '200ft': 1, 'bali': 1, 'subtletli': 1, 'tawa': 2, 'mccarten': 1, 'klendathu': 1, 'folklorist': 1, 'metzler': 1, 'meatpack': 2, 'sugarbab': 1, 'misanthropist': 1, 'moveiego': 1, 'hortyon': 1, 'bendr': 1, 'dachau': 2, 'scetchi': 1, 'saleswomen': 1, 'sputnick': 2, 'gollywood': 1, 'msb': 3, 'natsu': 1, 'yasumi': 1, 'tankentai': 2, 'exeggcut': 1, 'togepi': 1, 'tsukur': 1, 'kireihana': 1, 'bellossom': 1, 'poliwhirl': 1, 'poliwrath': 1, 'arshia': 1, 'furura': 1, 'jirarudan': 1, 'moltr': 1, 'zapdo': 1, 'defic': 1, 'loafersi': 1, 'kollek': 1, 'warrio': 1, 'quark': 1, 'arawak': 1, 'clipper': 1, '1805': 1, 'relativist': 1, 'scree': 1, 'snowflak': 1, 'heisenberg': 3, 'michio': 1, 'kaku': 1, 'prometheu': 1, 'convoyeur': 3, 'formalist': 1, 'mariag': 3, 'hatstand': 1, 'welliv': 1, 'phh': 1, 'disjunct': 1, 'surest': 2, 'trilateralist': 1, 'conspiracist': 1, 'bushco': 1, 'studier': 1, 'headbangin': 1, 'lakeridg': 1, 'orgolini': 1, 'soisson': 1, 'rhet': 1, 'topham': 1, 'katsuhito': 1, 'samehada': 1, 'otoko': 1, 'momojiri': 1, 'gashuin': 2, 'corpu': 2, 'nemisi': 1, 'particualrli': 1, 'richart': 1, 'crummiest': 1, 'yoghurt': 1, 'familymemb': 1, 'stratagem': 1, 'puleez': 1, 'apsion': 1, 'kukla': 1, '029': 1, 'keypunch': 1, '087': 1, '477': 1, 'merideth': 1, 'experienti': 2, 'aliso': 1, 'viejo': 1, 'uncorrect': 1, 'antiquarian': 1, 'unforget': 1, 'morbui': 1, 'claustraphobia': 1, 'lebeouf': 1, 'diamit': 1, 'zigzag': 3, 'miscount': 1, 'potbelli': 1, 'metropolitain': 1, '102nd': 1, 'lol10': 1, 'blighter': 1, 'maill': 1, 'recurv': 1, 'minogou': 1, '201': 1, 'asswip': 1, 'shankil': 1, 'tiag': 1, 'ratcher': 2, 'toussaint': 2, 'usabl': 2, 'moshpit': 1, 'malama': 1, 'kodokoo': 1, 'phir': 1, 'rihanna': 1, 'duguay': 2, 'morheng': 1, 'scrimp': 1, 'hannay': 1, 'thornhil': 1, 'indispos': 1, 'ringlet': 1, 'ammonia': 1, 'capomezza': 3, 'malacici': 2, 'clipboard': 2, 'conditio': 1, 'vampirefilm': 1, 'dancingscen': 1, 'defint': 1, 'indiscern': 4, 'ktla': 2, '1814': 1, 'packenham': 1, 'lioness': 1, 'volut': 1, 'reconqu': 1, 'omiru': 3, 'iliada': 1, 'odysseia': 1, 'drang': 1, 'treacli': 3, '970': 1, 'bolliwood': 1, 'blocki': 1, 'digitis': 2, '2x4': 1, 'romasanta': 1, 'semat': 1, 'foxley': 1, 'breakag': 1, 'shakycam': 1, 'bannon': 2, 'cultureless': 1, 'keven': 1, 'quickliy': 1, 'sentient': 1, 'foothold': 2, 'mouthi': 3, 'golberg': 1, 'plana': 1, 'stigler': 1, 'drippingli': 1, 'homefront': 5, 'ioffer': 1, 'nightlin': 1, 'macer': 2, 'assael': 1, 'highen': 1, 'unburden': 1, 'daker': 1, 'holman': 1, 'ryall': 1, 'zy': 2, 'dioz': 1, 'psycopath': 1, 'horniest': 1, 'lipton': 2, 'thoroughfar': 1, 'unassault': 1, 'unrecycl': 1, 'muddili': 1, 'signoff': 1, 'halar': 1, 'yamashita': 1, 'yakmallah': 1, 'mochri': 1, 'anglican': 1, 'etta': 1, 'awtwb': 2, 'decev': 1, 'misu': 1, 'jez': 1, 'striesand': 2, 'stinkpot': 1, 'tingli': 1, 'bullfinch': 2, 'vanderpool': 1, 'cice': 2, 'jacobit': 1, 'kinsman': 1, 'sossaman': 1, 'avocado': 2, 'controversialist': 1, 'twoddl': 1, 'capaldi': 1, 'cooney': 1, 'hairdryer': 1, 'colorlessli': 1, 'zano': 3, 'munn': 2, 'symbolist': 1, 'cs': 5, 'goodhead': 1, 'satterfield': 1, 'panhallagan': 1, 'bbca': 2, 'vidpic': 1, 'eramu': 1, 'abernathi': 2, 'nex': 1, 'cassiu': 1, '200th': 1, 'paperi': 1, 'brend': 1, 'chasiti': 1, 'krummern': 1, 'jul': 1, 'folket': 1, 'noisili': 1, 'unpatronis': 1, 'dispit': 2, 'ninerid': 1, 'outweight': 1, 'ikea': 2, 'commoditis': 1, 'gharli': 1, 'gymakta': 1, 'countoo': 1, 'berra': 1, 'c3p0': 1, 'lamma': 1, 'melman': 1, 'derm': 1, 'brrr': 1, 'chauncey': 1, 'coupledom': 1, 'virginhood': 1, 'succed': 1, 'c3': 1, 'outsleep': 1, 'slackli': 1, 'mcfarlan': 1, 'italic': 1, 'qm': 2, 'hier': 1, 'h50': 1, 'ngyuen': 1, 'whooool': 1, 'japeri': 1, 'autonom': 1, 'thorwald': 1, 'dehaven': 1, 'sous': 1, 'werch': 1, 'nikah': 1, 'overstimul': 1, 'poulang': 1, 'inquilino': 1, 'carfax': 3, 'rassimov': 2, 'shubert': 2, 'stracultr': 1, 'coitu': 2, 'uninsprir': 1, 'asexu': 1, 'julliard': 1, 'infinitesim': 1, 'ehm': 1, 'ont': 1, 'oshawa': 1, 'tsander': 1, '227': 1, 'slowish': 1, 'warbler': 1, 'caplan': 1, 'goldenhersh': 1, 'aureliu': 2, 'chappel': 1, 'queef': 1, 'parkyakarku': 2, 'woodburi': 1, 'libya': 1, 'mongkut': 1, 'leonowen': 1, 'gusman': 1, '20x': 1, 'wouter': 2, '2inch': 1, 'densest': 1, 'blandman': 2, 'enquir': 2, 'jove': 1, 'puuurfect': 1, 'terrytoon': 1, 'bryanston': 2, 'koya': 1, 'itinerari': 1, 'overcrank': 1, 'naqoyqatsi': 1, 'rstj': 1, 'yankovich': 1, 'lockett': 2, 'leesvil': 1, 'alexanderleesvil': 1, 'sparker': 1, 'icky': 1, 'boran': 2, 'tabbi': 1, 'partook': 4, 'orland': 1, 'shc': 2, 'potenta': 1, 'cutback': 1, 'kobal': 2, 'guarner': 1, 'jaffer': 1, 'nickeloden': 1, 'maori': 1, 'owww': 1, 'peww': 1, 'weww': 1, 'playhousefirstli': 1, 'pelswick': 1, 'catdog': 1, 'mccathi': 1, 'undyingli': 1, 'kirchenbau': 1, 'madhoff': 1, 'parachutist': 1, 'madrasi': 1, 'kurta': 1, 'tere': 1, 'liy': 1, 'paer': 1, 'kaafi': 1, 'avtar': 1, 'bihar': 1, 'bambaiya': 1, 'diwali': 1, 'abhisheh': 1, 'agha': 1, 'koi': 1, 'tamb': 1, 'ramgarh': 1, 'kaliganj': 1, 'farhan': 1, 'akhtar': 1, 'jpdutta': 1, 'nafta': 1, 'assan': 5, 'saito': 3, 'shimono': 2, 'blum': 1, 'bmi': 1, 'lath': 1, 'intrigiung': 1, 'blach': 1, 'flroian': 1, 'jacquin': 1, 'propeganda': 1, 'heigth': 1, 'filbert': 1, 'gibbet': 1, 'ajikko': 1, 'saiyan': 1, 'dilleng': 1, 'workingman': 1, 'overwhlelm': 1, 'dharam': 1, 'achcha': 1, 'pitaji': 1, 'chalta': 1, 'ankhein': 1, 'swarg': 1, 'indianvalu': 1, 'bingel': 1, 'toleran': 1, 'livvakterna': 1, 'sauk': 2, 'haddad': 5, 'choker': 1, 'boxcov': 2, 'wiesz': 1, 'milliardo': 1, 'harilal': 2, 'hemolyt': 1, 'duisburg': 1, 'referat': 1, 'emek': 1, 'lavern': 2, 'mousey': 2, 'ppppuuuulllleeeeeez': 1, 'erasur': 1, 'eightbal': 1, 'clow': 1, 's1m0ne': 1, 'francai': 1, 'cappra': 1, 'flim': 1, 'rofl': 1, 'complexion': 1, 'dennison': 1, 'fatherth': 1, 'zariwala': 1, 'mahatama': 1, 'kantrowitz': 2, 'shmatt': 1, 'figg': 1, 'gibbler': 3, 'responis': 1, 'absoutley': 1, 'comparis': 1, 'picher': 1, 'page2': 1, '020410': 1, 'rijn': 2, 'downpoint': 1, 'plentli': 1, 'actionscen': 2, 'geno': 4, 'forfeit': 1, 'pharmacolog': 1, 'stormcatch': 1, 'slovakian': 1, 'karsi': 1, 'energis': 1, 'kieffer': 1, 'oplev': 1, 'leviticu': 1, 'udon': 1, 'gli': 1, 'occhi': 1, 'dentro': 1, 'gaot': 1, 'allthewhil': 1, 'clatch': 1, 'tarradiddl': 1, 'pomegran': 3, 'buchanan': 6, 'enchanc': 1, 'mest': 1, 'kinematograficheskogo': 1, 'operatora': 1, 'kinematograph': 1, 'clamber': 1, 'aquaint': 1, 'nigger': 2, 'tromeo': 1, 'voiceless': 1, 'crackd': 1, 'cundi': 1, 'menephta': 1, 'newlw': 1, 'minglun': 1, '4ward': 1, 'filmirag': 4, 'nausica': 1, 'ones1': 1, 'crotchi': 1, 'momentsbol': 1, 'diaphan': 1, 'grushenka': 1, 'soetman': 1, 'bulova': 1, 'misfocus': 1, 'mwuhahahaa': 1, 'uncom': 1, 'bandanna': 1, 'tapeworm': 1, 'paella': 1, 'gifter': 1, 'payaso': 1, 'plinplin': 1, 'chutney': 1, 'sigfreid': 1, 'riga': 1, 'alexej': 1, 'grizli': 1, 'quimnn': 1, 'daytona': 1, 'indianapoli': 1, 'amoretti': 1, 'lorain': 1, 'unmind': 2, 'cocksur': 2, 'rana': 1, 'zyada': 1, 'musalman': 2, 'hindusthan': 1, 'therin': 1, 'discolor': 1, 'accredit': 1, 'stien': 1, 'virginni': 2, 'eurocrim': 1, 'gravina': 1, 'bloodstain': 1, 'muert': 1, 'tua': 1, 'tieh': 8, 'floral': 1, 'sundress': 1, 'obo': 1, 'locarno': 1, 'dcreasy2001': 1, 'pavlovian': 1, 'unbidden': 1, 'figgi': 1, 'savier': 1, 'dumbstuck': 1, 'connaughton': 1, 'weightier': 1, 'cvisit': 1, 'moviemusereview': 1, 'uncount': 2, 'travelcard': 1, 'fistsof': 1, 'h2efw': 1, 'revoew': 1, 'schanzer': 1, 'welisch': 1, 'unabsorb': 1, 'wheezer': 3, 'benumb': 1, 'distressingli': 2, 'cartouch': 3, 'dancig': 1, 'mnouchkin': 1, 'matra': 1, 'skolimowski': 1, 'parm': 1, 'skedaddl': 2, 'copperi': 1, 'decorsia': 1, 'helsinki': 1, '100m': 1, 'stargaard': 1, 'sainsburi': 1, 'bathebo': 1, 'oooooo': 1, 'monopol': 1, 'untwin': 1, 'buckner': 3, 'stro': 1, 'mbna': 1, 'mastercard': 1, 'everbodi': 1, 'x10': 1, 'futon': 1, 'yaayyyyy': 1, 'goalpost': 1, 'chandul': 1, 'dalal': 1, 'nilamben': 1, 'bapu': 1, 'girish': 1, 'karnad': 1, 'tughlaq': 1, 'jonathn': 1, 'acquaintac': 1, 'ballon': 1, 'characth': 1, 'caultron': 1, 'spoilerstom': 1, 'streeter': 1, 'bolkin': 2, 'crackdown': 1, 'leeringli': 1, '1934earl': 1, 'grauman': 1, 'naturel': 1, 'lona': 1, 'ml': 1, 'stalinson': 1, 'moden': 1, 'gladiatori': 2, '1923': 1, 'vohra': 1, 'dumroo': 5, 'bhain': 1, 'kyun': 1, 'meri': 1, 'patni': 1, 'tushar': 1, 'distateful': 1, 'dinsey': 1, 'onwheth': 1, 'kacia': 1, 'dibler': 1, 'appalachian': 2, 'kerkour': 1, 'overheat': 1, '32lb': 1, 'bergdof': 1, 'chemstrand': 1, 'kicki': 1, 'dewet': 1, 'overloud': 1, 'thenceforth': 1, 'afterl': 1, 'plutocrat': 1, 'featureless': 3, 'adriensen': 1, 'sno': 1, 'sonarman65': 1, 'jannick': 2, 'bazeley': 1, 'rojar': 1, 'eliana': 1, 'stupedn': 1, 'edwedg': 1, 'conrand': 1, 'roadtrip': 1, 'despir': 1, 'theoscarsblog': 1, 'deird': 1, 'iwil': 1, 'durya': 1, 'footrac': 1, 'realllyyyy': 1, 'tt0250274': 1, 'keightley': 1, 'magasiva': 1, 'cinch': 1, 'reccommend': 1, 'imdber': 1, 'melnick': 1, 'rohauer': 1, 'brontosauru': 1, 'defenitli': 1, 'gulfstream': 1, 'hopa': 1, 'romanovich': 1, 'favela': 1, 'orpheu': 1, 'pixot': 1, 'ailtan': 1, 'silvia': 2, 'telenovela': 1, 'teordoro': 1, 'kamera': 1, 'metin': 1, 'alsanjak': 3, 'goebel': 2, 'guaranti': 1, 'steffania': 3, 'tomasso': 3, 'shoddiest': 1, 'saatchi': 1, 'coercibl': 1, 'wort': 1, 'statuett': 2, 'flue': 2, 'marienth': 1, 'pequin': 1, 'batwomen': 1, '4hr': 1, 'roadmovi': 3, 'topactor': 1, 'fifteenth': 2, 'mear': 2, 'hesteria': 1, 'cosmeticli': 1, 'skungi': 1, 'obstructionist': 1, 'keymast': 1, 'intermit': 1, 'moviesfreddi': 1, 'episodesfreddi': 1, 'crach': 1, 'filmwho': 1, 'suberb': 1, '2600': 3, 'newb': 1, 'combinator': 1, 'camillo': 1, 'nuno': 1, 'westwood': 1, 'estoril': 1, 'ribeiro': 1, 'suckotroc': 1, 'doodad': 1, 'rottenest': 1, 'scoundral': 1, 'badman': 1, 'underimpress': 1, 'raveup': 1, 'teeeell': 1, 'youuuu': 1, 'efff': 1, 'ieeee': 1, 'expen': 1, 'shuriiken': 1, 'jidai': 2, 'geki': 2, 'hiroshi': 2, 'castellari': 1, 'keoma': 1, 'isao': 2, 'natsuyagi': 1, 'tsunehiko': 1, 'watas': 1, 'scaaari': 1, 'vanti': 1, 'resolout': 1, 'siberia': 1, 'grapevin': 1, 'konchalovksi': 3, 'substanceless': 1, 'spectactor': 1, 'nightski': 1, 'alexei': 1, 'derric': 1, 'bonecrush': 1, 'elway': 1, 'linett': 1, 'swordsmanship': 1, '6wk': 1, 'guiltlessli': 1, 'pomeranz': 1, 'by1': 1, 'timeshift': 1, 'buchman': 1, 'veen': 1, 'deltoro': 3, 'unspun': 1, 'gobsmack': 2, '44yr': 1, 'atav': 1, 'yugonostalg': 1, 'ademir': 1, 'kenov': 1, 'kustarica': 1, 'pavl': 1, 'vujis': 1, 'muzam': 1, 'eccelston': 1, 'ubernerd': 1, 'drainag': 1, 'gauff': 1, 'reflux': 1, 'signag': 1, 'thorp': 2, 'grrrrrr': 1, 'gimor': 1, 'tutazema': 2, 'claren': 1, 'clure': 1, 'cahiil': 1, 'stakingli': 1, 'inthus': 1, 'southsid': 1, 'ctm': 1, 'cpr': 1, 'regen': 1, 'fda': 1, 'belowth': 1, 'woozi': 1, 'anual': 2, 'caiapha': 1, 'hatfield': 1, 'rollebal': 1, '4x4': 1, 'farenheit': 1, 'asssoci': 1, 'troubador': 1, 'homestretch': 1, 'externalis': 1, 'expansionist': 1, 'eiko': 1, 'ando': 1, 'roadway': 1, 'industrialis': 1, 'faraci': 1, 'mung': 2, 'zhen': 1, 'tuo': 1, 'sassafra': 1, 'tt0059080': 1, 'recut': 1, 'shead': 1, 'celebei': 3, 'apricorn': 1, 'sezuan': 1, 'mendolita': 1, 'yaqui': 1, 'enneri': 1, 'franciso': 1, 'fopish': 1, 'volita': 1, 'counsil': 1, 'cordova': 1, 'gonzolez': 1, 'yrigoyen': 1, 'liom': 1, 'cinemather': 1, 'uncook': 1, 'timento': 1, 'cooln': 3, 'achterbusch': 1, 'neikov': 3, 'tormei': 1, 'pickard': 1, 'pronoun': 1, 'gambol': 1, 'fib': 1, 'laudanum': 1, 'godwin': 2, 'kller': 1, 'hairpin': 1, 'msft3000': 1, 'pvr': 1, 'lavvi': 1, 'inpromptu': 1, 'farsi': 3, 'wanki': 1, 'omid': 2, 'djalili': 2, 'schreck': 1, 'masamun': 1, 'shirow': 1, 'japon': 1, 'moodili': 1, 'nuel': 2, 'herilhi': 1, 'grodi': 1, 'tupamaro': 1, 'uruguayan': 1, 'matamoro': 2, 'ukrain': 1, 'wanter': 2, 'labouredli': 1, 'meyerowitz': 1, 'treshold': 1, 'chirstmastim': 1, 'outbid': 1, 'memoris': 1, 'maryam': 1, 'cribbin': 1, 'derrida': 1, 'crimmini': 1, 'woodcut': 1, 'talman': 1, 'iceman': 1, 'votrian': 1, 'morman': 1, 'gillan': 1, '878': 1, '1mln': 1, 'ozon': 3, 'fontana': 6, 'overmey': 2, 'yoshimura': 3, 'sumpthin': 1, 'chatman': 1, 'upbraid': 2, 'nephilim': 1, 'jaani': 1, 'dushman': 1, 'thatth': 1, 'boringeven': 1, 'sanju': 1, 'suneil': 1, 'queenli': 1, 'interaci': 1, 'timewis': 1, 'mmiv': 1, 'hea': 1, 'jailsd': 1, 'above': 1, 'bhang': 1, 'yummm': 1, 'callu': 1, 'lakshya': 1, 'hrithik': 1, 'zom': 2, 'slight1i': 1, 'chinoiseri': 1, 'gegen': 1, 'dummheit': 1, 'kaempfen': 1, 'goetter': 1, 'selbst': 1, 'vergeben': 1, 'ciru': 1, 'kessl': 1, 'chimer': 1, 'methaphor': 1, 'babyya': 1, 'tomeii': 2, 'sheriif': 1, 'tmob': 1, 'comicon': 1, 'dorkknob': 1, 'incumb': 2, 'edyarb': 2, 'bgs1614': 1, 'filmaan': 1, 'floppedh': 1, '3a': 1, 'dwelv': 1, 'forgiventh': 1, 'upendra': 2, 'limay': 2, 'toowhil': 1, 'timesth': 1, 'handledmadhur': 1, 'okaykonkana': 1, 'nowday': 1, 'drumstick': 1, 'scoobidoo': 1, 'stateli': 1, 'garrick': 1, 'tembi': 2, 'cortes': 2, 'bogdonavich': 3, 'overexplan': 1, 'partic': 1, 'messick': 1, 'vinchenzo': 1, 'caprioli': 1, 'manzari': 1, 'hallberg': 1, 'mvovi': 1, 'prabhat': 2, 'azghar': 1, 'jhurhad': 1, 'aakash': 1, 'naseerdun': 1, 'sonam': 1, 'jyotsna': 1, 'kiran': 1, 'saat': 1, 'samundar': 1, 'abromowitz': 1, 'stonefac': 1, 'simmond': 1, 'kauffman': 1, 'oblast': 1, 'headboard': 1, 'scantli': 1, 'cuddlesom': 1, 'wicket': 1, 'warrick': 1, 'naboo': 1, 'wesa': 1, 'lr': 1, 'aragami': 5, 'tsutomu': 2, 'yashiro': 2, 'naturali': 1, 'fubar': 1, 'trimbl': 2, 'womano': 2, 'scaley': 1, 'shrub': 2, 'distractedli': 1, 'sinuou': 1, 'racerunn': 1, 'betta': 1, 'gtf': 1, 'deedi': 1, 'ekspr': 4, 'bakov': 2, 'cerar': 1, 'blaylock': 1, 'sicenc': 1, 'badi': 1, 'ridb': 1, 'nesson': 2, 'vulva': 1, 'clitori': 1, 'nivoli': 1, 'prazer': 1, 'matar': 1, 'salvo': 1, 'tarlow': 1, 'asquith': 1, 'condsid': 1, 'dkd': 5, 'sanjuro': 1, 'joeseph': 1, 'totak': 1, 'factualwhil': 1, 'suxor': 1, 'piecesom': 1, 'reservist': 1, 'mountainbilli': 1, 'predictionsin': 1, 'wrongfurth': 1, 'wrongin': 1, 'jonbenet': 1, 'hjm': 1, 'contradictor': 1, 'horrifyingand': 1, 'linguin': 1, 'shumach': 1, 'lavitz': 1, 'deker': 1, 'dumass': 1, 'britannica': 1, 'demarc': 1, 'mesopotamia': 3, 'limbless': 1, 'spideyman': 1, 'cest': 1, 'tigra': 2, 'necron': 1, 'lockstock': 1, 'verd': 1, 'ceuta': 1, '1415': 1, 'pide': 1, 'salgueiro': 3, 'appori': 1, 'stothart': 1, 'weawwi': 1, 'awfuwwi': 1, 'weg': 1, 'wamb': 1, 'rouv': 1, 'bacri': 1, 'jaoui': 1, 'kunef': 1, 'marija': 1, 'dewar': 2, 'grappelli': 1, 'sugimoto': 1, 'wla': 2, 'kumba': 1, 'ngassa': 1, 'ntuba': 1, '6million': 1, 'bolden': 1, 'inchworm': 1, 'belleau': 2, 'lha': 1, 'concomit': 1, 'flicka': 2, 'naffli': 1, 'thunderhead': 1, 'waw': 4, 'gwilym': 2, 'downriv': 1, 'godpar': 2, 'limpid': 1, 'kinzer': 1, 'peckingli': 1, 'dew': 1, 'caseload': 1, 'taxidermist': 1, 'mimeux': 1, 'derbi': 2, 'chamionship': 1, 'midkoff': 1, 'drunkenli': 3, 'confusedli': 2, 'shiniest': 1, 'larcenist': 1, 'kanefski': 1, 'verica': 1, 'avjo': 1, 'wahala': 1, 'sidesplitt': 1, 'foghorn': 1, 'coplandesqu': 1, 'konrack': 1, 'untreat': 1, 'ebola': 2, 'glammier': 1, 'poundag': 1, 'snick': 1, 'apac': 1, 'neverheless': 1, 'bismarck': 1, 'gautet': 1, 'directorship': 2, 'bigv': 1, 'calculu': 2, 'airstrik': 1, 'kj': 1, 'urbib': 1, 'roldan': 1, 'lei': 1, 'lynley': 1, 'jaffrey': 1, 'kinnair': 1, 'contera': 1, 'bendrix': 1, 'auie': 1, 'levelheaded': 1, 'rattner': 1, 'zan': 2, 'crochet': 2, 'prawn': 1, 'tricksi': 2, 'batonzilla': 1, 'monsalvat': 1, 'crocus': 1, 'paralyt': 1, 'tempi': 1, 'shana': 1, 'meru': 1, 'blotto': 2, 'boatwoman': 1, 'makavejev': 1, 'laur': 1, 'kee': 2, 'metbi': 1, 'undiscrimin': 2, 'breathnach': 1, 'delphi': 1, 'kake': 1, 'irreproach': 1, 'umderstand': 1, 'rastu': 1, 'aauugghh': 1, 'cryogen': 1, 'psm': 3, 'janett': 2, 'oke': 2, 'tomatoey': 1, 'vexati': 1, 'lilliham': 1, 'seascap': 2, 'dogpatch': 1, 'bleacher': 1, 'sup': 1, 'dic': 3, 'lamarch': 1, 'wambini': 1, 'dardino': 1, 'sachetti': 1, 'fagrasso': 1, 'phillimin': 1, 'fabrazio': 1, 'deang': 1, 'tomassi': 1, 'gianetto': 1, 'mangal': 1, 'firoz': 1, 'finleyson': 2, 'horniphobia': 1, 'seamanship': 2, 'meaninglessli': 2, 'morro': 1, 'shiko': 2, 'funjatta': 2, 'pennslyvania': 1, 'learnfrom': 1, 'ustas': 1, 'cetnik': 3, 'mihajlov': 1, 'pavel': 1, 'krajina': 3, 'knin': 1, 'paramilitarian': 1, 'glava': 1, 'oric': 1, 'seselj': 1, 'arkan': 1, 'jovic': 1, 'bulatov': 1, 'tudman': 1, 'previosli': 1, 'mujahedin': 1, 'bilgewat': 1, 'waverli': 1, 'batpeopl': 1, 'batperson': 1, 'equipp': 1, 'kuo': 1, 'chui': 1, 'apperci': 1, 'asco': 1, 'molemen': 1, 'redundantli': 1, 'stoppingli': 1, 'challi': 1, 'filthiest': 1, 'werewov': 1, 'vlkava': 1, 'florin': 1, 'ladislav': 1, 'krecmer': 1, 'florica': 1, 'ludmila': 1, 'safarova': 1, 'sano': 1, 'strenuous': 1, 'eyecandi': 2, 'assaya': 2, 'lithograph': 1, 'mcconnel': 2, 'binouch': 1, 'kurylenko': 2, 'generalis': 2, 'filmha': 1, 'charactercan': 1, 'wascondemn': 1, 'awaitress': 1, 'themal': 2, 'arsonistrespons': 1, 'securityguard': 1, 'aphotog': 1, 'erici': 1, 'travelingthrough': 1, 'hisform': 1, 'herand': 1, 'thescen': 2, 'therid': 1, 'entirestori': 1, 'againstpeopl': 1, 'nosuspens': 1, 'seeest': 1, 'ofa': 1, 'heroffic': 1, 'apoliceman': 1, 'surewher': 1, 'thinksom': 1, 'hasfurnish': 1, 'guardout': 1, 'scanningcelebr': 1, 'grainyblack': 1, 'weezil': 1, 'justabout': 1, 'mebe': 1, 'notrecommend': 1, 'somesexu': 1, 'aghhh': 1, 'maunder': 1, 'bohbot': 1, 'mcnicol': 6, 'chalantli': 1, 'cutish': 1, 'nepotist': 1, 'torpidli': 1, 'quellen': 1, 'speelman': 1, 'd1': 1, 'h1': 1, 'rd1': 1, 'd8': 1, 'whaler': 2, 'sensai': 1, 'laryng': 1, 'esperanza': 1, 'dudek': 1, 'snifflin': 1, 'jordanthink': 1, 'cousi': 1, 'lomax': 1, 'deever': 1, 'invergordon': 1, 'wuorno': 2, 'jenner': 1, 'stalagmit': 1, 'chomper': 1, 'seigel': 2, 'stromberg': 1, 'clod': 2, 'laclo': 1, 'whatchoo': 1, 'diff': 1, 'stani': 1, 'huxtabl': 2, 'trendier': 1, 'ragdol': 1, 'shrieber': 2, 'wiseass': 1, 'hathor': 1, 'pseudolesbian': 1, 'neuroinfecti': 1, 'chanel': 1, 'quarrelsom': 1, 'hatosi': 1, 'throughlin': 1, 'metacinemat': 1, 'wheeli': 1, 'tesser': 1, 'greedo': 1, 'whatsit': 5, 'centaurion': 1, 'bowleg': 1, 'ixchel': 1, 'amerikan': 1, 'loooooov': 1, 'babbett': 2, 'rubei': 1, 'buttonhol': 1, 'tractacu': 1, 'hampel': 1, 'memburi': 1, 'leder': 1, 'cbbc': 1, 'courc': 2, 'deosnt': 1, 'nolo': 1, 'mosley': 1, 'electrolyt': 1, 'sobbingli': 1, 'brutsman': 1, 'indignantli': 2, 'robbbin': 1, 'leiveva': 1, 'levieva': 1, 'kardashian': 1, 'baldi': 1, 'rambha': 1, 'hinton': 1, 'trueblood': 2, 'rumbler': 1, 'mid30': 1, 'sherlyn': 1, 'scwatch': 1, 'saphead': 1, 'af': 1, 'rooyen': 1, 'satelit': 1, 'blackbust': 3, 'exploitation': 1, 'uttara': 1, 'baokar': 1, 'kaire': 1, 'hotbod': 1, 'mutton': 1, 'gruell': 1, 'xxx2': 1, 'gaffikin': 5, 'cartograph': 1, 'inskip': 3, 'goudri': 2, 'newth': 1, 'ornithologist': 1, 'vodyanoi': 1, 'wiltshir': 1, 'camfield': 2, 'roev': 1, 'womanli': 1, 'jmv': 1, 'loosi': 1, 'compaer': 1, 'wallonia': 1, 'lada': 1, 'espoir': 1, 'kaurism': 1, 'lca': 1, 'eklund': 1, 'frostbitten': 1, 'fie': 1, 'colomb': 1, 'clatter': 1, 'jemb': 1, 'skinniest': 1, 'doulittl': 1, 'andcompel': 1, 'aposs': 1, 'sheritt': 2, 'shoeless': 1, 'solipsist': 1, 'alow': 1, 'iraqui': 1, 'shoebox': 1, 'hoth': 1, 'fukuki': 1, 'reiju': 1, 'fsn': 2, 'stunker': 1, 'bii': 3, 'gruelingli': 1, 'alecia': 5, 'liliom': 11, 'sealer': 1, 'bere': 1, 'michum': 1, 'prescenc': 1, 'chakiri': 1, 'hereabout': 1, 'ejames6342': 1, 'vllad': 1, 'hypobol': 1, 'wuxi': 1, 'rulez': 1, 'sheakspear': 1, 'biron': 1, 'bloodshet': 1, 'sullivani': 1, 'leisin': 4, 'cocktal': 1, 'manicurist': 1, 'lamor': 2, 'sheldrak': 1, 'judel': 1, 'sheepishli': 1, 'kavali': 1, 'saarsgard': 2, 'kiddifi': 1, 'mckellhar': 1, 'rece': 1, 'aakrosh': 1, 'betaab': 1, 'smithapatel': 1, 'drohkaal': 1, 'theonli': 2, 'zaphod': 1, 'beeblebrox': 1, 'awarde': 1, 'kiloton': 1, 'murderbal': 2, 'antoniu': 5, 'riann': 1, 'sergej': 1, 'trifunov': 1, 'lyubomir': 2, 'hegalhuzen': 1, 'slesing': 5, 'hackenstien': 1, 'botkin': 1, 'dyann': 1, 'dirossario': 1, 'schreiner': 1, 'littlehammer16787': 1, 'statesjust': 1, 'causestar': 1, 'convok': 1, 'flordia': 1, 'vilifyi': 1, 'swimmingli': 1, 'capeshaw': 1, 'bucktooth': 1, 'protag': 1, 'starker': 1, 'meffert': 1, 'laster': 1, 'difficultli': 1, 'barthelmi': 1, 'samourai': 1, 'nonverb': 1, 'ishiro': 1, 'takarada': 2, 'chushingura': 1, 'eisei': 1, 'amamoto': 1, 'hama': 1, 'circuitri': 1, 'bmoc': 1, 'duboi': 1, 'cinemaphotographi': 3, 'desoto': 1, 'caccia': 1, 'ogi': 1, 'reiko': 1, 'kuba': 1, 'marverick': 1, 'josha': 1, 'juarass': 1, 'hipp': 1, 'antonionian': 1, 'freshett': 1, 'ancien': 1, 'threeoveral': 1, 'stroboscop': 1, 'kizz': 1, 'reconaiss': 1, 'grusom': 1, 'steveday': 1, 'hool': 1, 'chlo': 1, 'winkl': 1, 'harnoi': 1, 'eeyor': 1, 'babbitt': 1, 'alcott': 1, 'season3': 1, 'season2': 1, 'season1': 1, 'brail': 1, 'laxit': 1, 'vca': 1, 'charcoal': 1, 'archli': 1, '12mm': 1, 'inadvertantli': 1, 'mcgreevey': 3, 'mumi': 3, 'gatesvil': 1, 'tokar': 1, 'ewashen': 1, 'garfish': 1, '20k': 1, 'mylo': 2, 'nautiliu': 2, 'charactist': 1, 'rendev': 1, 'isuzu': 1, 'arbaaz': 3, 'payal': 2, 'houseth': 1, 'asleepdirect': 1, 'priyan': 1, 'songcinematographi': 1, 'throughoutrajp': 1, 'khemmu': 1, 'murli': 1, 'deniselacey2000': 1, 'bandido': 1, 'grazia': 1, 'buccella': 1, 'kristensen': 1, 'unsynchronis': 1, 'toyomichi': 1, 'kurita': 1, 'wendingo': 1, 'flamb': 1, 'jockhood': 1, 'hidehiko': 1, 'chainsmok': 1, 'suzhou': 1, 'eleanora': 2, 'staunchli': 2, 'kameradschaft': 2, 'messianist': 1, 'starfish': 1, 'gilliamesqu': 1, 'wiggli': 2, 'brianiac': 1, 'otoh': 1, 'forevermor': 1, 'whidbey': 1, 'stivic': 1, 'deflector': 1, 'dorkier': 1, 'kael': 3, 'simi': 1, 'franklyn': 1, 'rockfal': 1, 'insuper': 1, 'unkindto': 1, 'badlyact': 1, 'cack': 1, 'waslik': 1, 'staringbecaus': 1, 'iswreck': 1, 'cinematographywa': 1, 'fromthi': 1, 'chauffer': 1, 'umcompromis': 1, 'nickleodeon': 1, 'cruellest': 2, 'sistah': 1, 'futz': 1, 'horgan': 1, 'zucov': 2, 'munk': 1, 'trashbin': 1, 'raval': 1, 'nitu': 1, 'bagheri': 1, 'boppana': 1, 'complicated': 1, 'moorish': 1, 'scud': 3, 'chador': 1, 'teheran': 1, 'changdong': 1, 'doyeon': 1, 'shina': 8, 'sino': 1, 'corean': 2, 'jongchan': 2, 'kangho': 1, 'ribsi': 1, 'paychequ': 1, 'caco': 1, 'moldavia': 1, 'gogu': 1, 'necula': 1, 'raducanu': 1, 'nicodim': 1, 'ungureanu': 1, 'oana': 1, 'piecnita': 1, 'scabrou': 1, 'macclan': 2, 'tinsletown': 1, 'coxsuck': 1, 'penisl': 1, 'holmi': 1, 'shouldnt': 1, 'i8n': 1, 'mortitz': 1, 'thirthysometh': 1, 'twomarlow': 1, 'wishmast': 2, 'wushu': 1, 'unmat': 1, 'rebanish': 1, 'dahlink': 1, 'spotlessli': 1, 'superhu': 1, 'm4tv': 2, 'lat': 1, 'venison': 1, 'pagoda': 1, 'devenport': 1, 'prejudicm': 1, 'skewered': 1, 'gorey': 1, 'petter': 1, 'slapsticki': 1, 'farah': 1, 'camoletti': 1, 'tommorrow': 1, 'assasain': 1, 'assassain': 1, 'kult': 2, 'ermann': 1, 'kitley': 1, 'chalant': 1, 'dessin': 1, 'm1': 4, 'comanch': 1, 'f22': 1, 'faker': 1, 'nabucco': 1, 'mcmillian': 1, 'veeeeri': 1, 'voraci': 1, 'synthpop': 1, 'bolha': 1, 'marqu': 1, 'enprison': 1, 'desid': 1, 'momosel': 1, 'hankshaw': 1, 'emptiest': 1, 'halloweeni': 1, 'klok': 1, 'supposebl': 1, 'redbon': 1, 'baltron': 1, 'referr': 1, 'duvet': 1, 'blehfun': 1, 'howlin': 1, 'hallan': 3, 'doughton': 1, 'sarpeidon': 5, 'niob': 1, 'lisett': 1, 'freiberg': 4, '272': 2, 'stepchildren': 1, 'tholian': 2, '273': 1, 'slat': 1, 'droop': 1, 'mouthburst': 1, 'cooti': 1, 'gretta': 1, 'obviosli': 1, 'crueliti': 1, 'melora': 1, 'catogoricali': 1, 'indendo': 1, 'aplogis': 1, 'tiw': 1, 'oporto': 1, 'pinho': 1, 'manichaean': 1, 'torino': 1, 'raucous': 1, 'definaetli': 1, 'extortionist': 1, 'benzedrin': 1, 'kisser': 1, 'gunni': 1, 'backett': 1, 'medalist': 1, 'alveraz': 2, 'miraglittoa': 1, 'ochoa': 1, 'cpt': 5, 'papich': 2, 'aden': 1, 'eward': 1, 'neurosurgeon': 1, '20ti': 1, '30ti': 1, 'polack': 1, 'regulatori': 1, 'unilater': 2, 'tund': 1, 'jeged': 1, 'gaiti': 1, 'ritu': 1, 'shivpuri': 1, 'solanki': 1, 'wamsi': 1, 'ostent': 1, 'shallot': 1, 'messing': 1, 'trasform': 1, 'anorect': 1, 'quall': 2, 'squeed': 1, 'shrinkwrap': 1, 'lovingkind': 1, 'quinnn': 1, 'plothol': 1, 'movie8': 1, 'squeakiest': 1, 'ler': 2, 'underwork': 1, 'woofer': 1, 'napper': 1, 'interspl': 1, 'nachtgestalten': 1, 'maudit': 1, 'lonestar': 1, 'presnel': 1, 'darkish': 1, 'berhard': 1, 'cavangh': 1, 'mcwade': 1, 'etiienn': 1, 'shad': 1, 'kik': 6, 'esau': 1, 'recommanded1': 1, 'guiliti': 1, 'formulmat': 1, 'sinni': 1, 'pevensi': 1, 'rascism': 1, 'laze': 1, 'fetuccini': 1, 'lumberjack': 6, 'hoag': 2, 'bonacorsi': 1, 'unfortunta': 1, 'steadycam': 1, 'noemi': 1, 'bae': 1, 'outrac': 1, 'intensif': 1, 'holend': 1, 'thieleman': 1, 'tallinn': 4, 'ilka': 1, 'rvilaturi': 1, 'talinn': 1, 'negulesco': 1, 'linwood': 1, 'retironi': 1, 'fritzi': 1, 'haberland': 1, 'hilmir': 1, 'nason': 1, 'sightless': 1, 'llmann': 1, 'engel': 1, 'schrott': 1, 'subsidi': 3, 'barfuss': 2, 'filmstiftung': 1, 'nrw': 1, 'filmf': 1, 'rderung': 1, 'ffa': 1, 'rosenm': 1, 'ller': 1, 'vilsmaier': 1, 'steinbichl': 1, '1813': 2, 'capitain': 1, 'roual': 1, 'blackguard': 1, 'swanston': 2, 'comt': 1, 'farquhar': 3, 'cheven': 1, 'highlandis': 1, 'inveresk': 1, 'queensferri': 1, 'sthetic': 1, 'idealis': 1, 'miglior': 1, 'nemico': 1, 'radlitch': 1, 'politiqu': 1, 'astr': 3, 'ladon': 1, 'descart': 1, 'percev': 1, 'xvii': 1, 'luchini': 1, 'trasvestis': 1, 'bovari': 1, 'joliet': 1, 'hanoi': 1, 'wolvi': 2, 'whyyyy': 1, 'guinneapig': 1, 'mmhm': 1, 'dissapear': 3, 'woooooow': 1, 'ij': 3, 'aq': 2, 'boyum': 1, 'aikidoist': 1, 'collyer': 1, 'couric': 1, 'merika': 1, 'usenet': 1, 'tallahasse': 1, 'macroscop': 2, 'hka4': 1, 'physchedelia': 1, 'crescent': 1, 'unintens': 1, 'sunniest': 1, '164': 1, 'craptitud': 1, 'yeo': 2, 'layrac': 1, 'trattoria': 1, 'bregana': 6, 'trista': 1, 'occast': 1, 'lushiou': 2, 'apolig': 1, 'accurs': 1, 'johannsen': 1, 'gotb': 1, 'antonym': 1, 'fierstein': 1, 'inessenti': 1, 'cliniqu': 1, 'streisandi': 1, '2015': 1, 'squeel': 1, 'techicolor': 1, 'apparel': 1, '1min': 1, 'seasam': 1, 'zape': 1, 'pont': 1, 'lufft': 1, 'superfriend': 5, 'mcswain': 1, 'grodd': 1, 'toyman': 1, 'metallo': 1, 'darkseid': 1, 'filmat': 1, 'batmit': 1, 'rarest': 2, 'saddo': 1, 'thicko': 1, 'saltcoat': 1, 'forton': 1, 'fromth': 1, 'kirtland': 1, 'vistor': 1, 'moonbas': 1, 'inacess': 1, 'aito': 5, 'hemmerl': 1, 'infield': 1, 'nesmith': 1, 'sportcast': 1, 'mybluray': 1, 'tragedian': 1, 'tinyurl': 1, 'ojhoyn': 1, 'caledon': 1, 'totti': 1, 'chacun': 1, 'cherch': 1, 'expenc': 1, 'nebot': 2, 'montejo': 1, 'altruism': 1, 'cch': 1, 'unspecif': 1, 'papi': 1, 'bowm': 3, 'chicka': 1, 'goff': 1, 'syrkin': 1, 'lemarit': 1, 'ayin': 1, 'trenchard': 1, 'ahu': 1, 'leway': 1, 'rheumi': 1, 'dooooom': 1, 'weebl': 1, 'allyc': 1, 'germna': 1, 'skaal': 2, 'steuerman': 1, 'marthi': 2, 'christopherson': 1, 'prost': 1, 'cheeto': 1, 'nicmart': 1, 'reformat': 2, 'dvdbeaver': 1, 'dvdcompare2': 1, 'kingofmask': 1, 'htmwonder': 1, 'japans': 1, 'edgeway': 1, 'policticli': 1, 'divison': 1, 'slezi': 1, 'disas': 1, 'proplem': 1, 'ughhhh': 1, 'brillent': 1, 'conculs': 1, 'coverup': 1, 'chadwick': 1, 'appollo': 4, 'b2': 1, 'mopest': 1, 'wifey': 1, 'stayov': 1, 'mosey': 1, 'fritzsch': 1, 'outdraw': 1, 'okanagan': 1, 'univeristi': 1, 'shirli': 1, 'mourbi': 1, 'shyan': 2, 'wali': 1, 'ladki': 1, 'churidar': 1, 'mirrorless': 1, 'looong': 1, 'cumpsti': 1, 'eursela': 1, 'daisey': 3, 'schtupp': 1, 'fern': 1, 'malaga': 1, 'willingham': 1, 'sssss': 1, 'leiberman': 1, 'herend': 1, 'josip': 1, 'broz': 1, 'sssr': 1, 'politbiro': 1, 'nieport': 1, 'weatherman': 1, 'garr': 6, 'toxicolog': 1, 'aliveal': 1, 'bluest': 2, 'pragmatist': 1, 'boopou': 1, 'authen': 1, 'shiraki': 3, 'laguna': 1, 'playin': 1, 'sameth': 1, 'nerdth': 1, 'fakeeven': 1, 'runnign': 1, 'offsom': 1, 'toprajp': 1, 'umcomfort': 1, 'tebaldi': 2, 'amneri': 1, 'renata': 1, '20ft': 1, 'declamatori': 2, 'strudel': 1, 'adreno': 1, 'pirouet': 1, 'mineshaft': 1, 'handymen': 1, 'sexlet': 1, 'kashmir': 1, '158': 2, 'relationsip': 1, 'cr5eat': 1, 'tosca': 1, 'boobless': 1, 'whippersnapp': 1, 'shoal': 1, 'keynot': 1, 'cutiest': 1, 'lni': 1, 'compartment': 1, 'craftili': 1, 'balsmey': 1, 'sawasde': 1, 'mbongeni': 1, 'ngema': 1, 'roney': 2, 'bonnevi': 1, 'adi': 1, 'samraj': 1, 'picutr': 1, 'chuk': 1, 'macaroni': 1, 'kev': 1, 'motherfock': 1, 'familia': 1, 'scherler': 2, 'germain': 5, 'decal': 1, 'docteur': 1, 'crooked': 1, 'talentwis': 1, 'ufologist': 1, 'thougth': 1, 'didja': 1, 'hollywoon': 1, 'endingi': 1, 'hungrier': 1, 'stk': 1, 'lochley': 1, 'soulhunt': 1, 'feiss': 1, 'welldon': 1, 'swash': 1, 'machesney': 5, 'tugge': 1, 'gravesit': 1, 'avion': 1, 'airspe': 1, 'countermeasur': 3, 'depressur': 1, '618': 1, '502': 1, 'allsuperb': 1, 'admar': 1, 'onw': 1, 'supranatur': 3, 'solarbabi': 1, 'caliban': 1, 'lieutent': 1, 'farman': 1, 'barbarossa': 1, 'wolfpack': 1, 'pincer': 1, 'danira': 1, 'govich': 1, 'knightw': 1, 'dumland': 1, 'davidlynch': 1, 'felecia': 1, 'fic': 1, 'hlot': 3, 'stitchin': 1, 'ovari': 1, 'furtil': 1, 'kilkenni': 1, 'softcov': 1, 'ghostwritten': 1, 'megawatt': 1, 'navarr': 1, 'nivola': 1, 'costard': 2, 'traumit': 1, 'riflescop': 1, 'teardrop': 1, 'skywrit': 1, 'theli': 1, 'computer': 1, 'depardieuon': 1, 'chometcut': 1, 'coenth': 1, 'hilarious4': 1, 'aissa': 1, 'maiga': 1, 'lagravenes': 1, 'eurythm': 1, 'ingsoc': 1, 'goldstien': 1, 'unperson': 1, 'lees': 1, 'seatmat': 1, 'weez': 1, 'anastacia': 1, 'bibiddi': 1, 'bobiddi': 1, 'bohemia': 2, 'youngblood': 3, 'herese': 1, 'rochel': 1, 'sherif': 1, 'hdv': 1, 'oscarsshut': 1, 'babtis': 1, 'malcomx': 1, 'basset': 1, 'moviedo': 1, 'llydia': 1, 'stet': 1, 'yaww': 1, 'atemp': 1, 'affectt': 1, 'engul': 1, 'funkion': 1, 'seafood': 3, 'kanedaaa': 1, 'tetsuoooo': 1, 'pester': 1, 'relabel': 1, 'stamford': 1, 'directordirector': 1, 'photographyeditorcan': 1, 'metoo': 1, 'bettger': 2, 'nm0281661': 1, 'sheb': 2, 'wooley': 2, 'brinegar': 2, 'moo': 2, 'kermi': 1, 'kann': 1, 'kompetit': 1, 'krown': 1, 'kraap': 1, '905': 1, 'lowber': 1, 'spokan': 1, 'postapocalypt': 1, 'starpow': 1, 'predictib': 1, 'decaffein': 1, 'criticz': 1, 'gehrlich': 1, 'stallyn': 1, 'deputis': 1, 'wyngard': 1, 'eddington': 1, 'aspidistra': 1, 'lambeth': 1, 'bonhomi': 1, 'horlick': 1, 'attle': 2, 'assent': 1, 'unhind': 1, 'legalis': 1, 'reabsorb': 1, 'officialdom': 2, 'rancour': 1, 'reymond': 1, 'annick': 1, 'matheron': 1, 'laetitia': 1, 'legrix': 1, 'condiment': 1, 'dionysian': 1, 'apollonian': 1, 'ohlund': 1, 'disaster': 1, 'goldcrest': 1, 'kensett': 2, 'campest': 1, 'urmitz': 1, 'laureat': 1, 'receip': 3, 'sclerosi': 1, 'hepat': 1, 'communic': 1, 'jacquelyn': 1, 'ahold': 2, 'edibl': 1, 'nibbl': 1, 'bimbett': 1, '3b': 1, 'dramabaazi': 1, 'intertextu': 1, 'icecub': 1, 'pulli': 1, 'comper': 1, 'herbet': 1, 'spinechil': 1, 'syvli': 1, 'oreil': 1, 'lepag': 1, 'ducharm': 1, 'archambault': 1, 'dalamatian': 1, 'everon': 1, 'ieuan': 1, 'grufford': 1, 'sharpish': 1, 'diepardieu': 1, 'poa': 1, 'thereinaft': 1, 'lockup': 1, 'cullinan': 1, 'velda': 1, 'blucher': 1, 'centerlin': 1, 'unban': 2, 'laupta': 1, 'patzu': 1, 'yorga': 1, 'fountainhead': 1, 'screenshot': 1, 'whatchout': 1, 'ohohh': 1, 'cacti': 1, 'bucatinski': 1, 'lifeform': 2, 'delicto': 1, 'surran': 1, 'filmit': 1, 'unbelivebl': 1, 'catylast': 1, 'oppurun': 1, 'licker': 1, 'sociabl': 1, 'emuls': 1, 'crustacean': 1, 'unessenti': 1, 'exo': 1, 'anincoherr': 1, 'withissu': 1, 'andth': 1, 'thepast': 1, 'allabout': 1, 'veryraunchi': 1, 'doyourself': 1, 'farsuperior': 1, 'tertiari': 2, 'carlucci': 1, 'avanti': 1, 'doenitz': 1, 'bulbou': 1, 'kyber': 1, 'unwaiv': 2, 'cleari': 1, 'hierarch': 1, 'fugli': 1, 'abrahm': 1, 'topo': 1, 'fffc': 6, 'jodoworski': 1, 'innan': 2, 'vaguest': 2, 'igav': 1, 'unimaginativestori': 1, 'willreal': 1, 'baldand': 1, 'ajampack': 1, 'andnobodi': 1, 'wasfilm': 1, 'hadknowledg': 1, 'compositionactu': 1, 'laughwhen': 1, 'vicitm': 1, 'detatch': 1, 'hollar': 1, 'proft': 1, 'alaskey': 1, 'stretchi': 1, 'enema': 1, 'futuramafan1987': 1, 'birdfood': 1, '6am': 1, 'nissan': 1, 'moraka': 1, 'mk2': 2, 'gti': 1, 'nuimag': 1, 'surewhil': 1, 'tlk2': 1, 'wimmen': 1, 'spaceman': 1, 'dumpti': 1, 'morphett': 2, 'sinden': 1, 'jamal': 2, 'voletta': 1, 'smithonit': 1, 'whedonett': 1, 'crappili': 1, 'esper': 1, 'romilda': 1, 'rivault': 1, 'moscovit': 1, 'faun': 1, 'segonzac': 1, 'schmoke': 2, 'zaljko': 1, 'ivanek': 1, 'paperwork': 1, 'reuter': 1, 'osservator': 1, 'seda': 1, 'addario': 1, 'wbal': 1, 'ehrlich': 2, 'elegiu': 1, 'lucaiti': 3, 'compeer': 1, 'strongboy': 1, 'steensen': 1, 'roemheld': 3, 'frenziedli': 1, 'convex': 1, 'cinemademerd': 1, 'igloo': 1, 'salmon': 1, 'graaf': 2, 'beddo': 1, 'thenceforward': 1, 'nunchaku': 1, 'snm': 1, 'weho': 1, 'pachebel': 1, 'garand': 1, 'eniemi': 1, 'yaarana': 2, 'agnisakshi': 2, 'filmdaraar': 1, 'disappointingdirect': 1, 'goodrishi': 1, 'swte': 1, 'ekstas': 1, 'koerpel': 1, 'frantisek': 1, 'horki': 2, 'androschin': 1, 'stallich': 1, 'bohumil': 1, 'goni': 1, 'stepdad': 1, 'higginson': 2, 'fraim': 2, 'winkelman': 4, 'aftra': 1, 'buisnesswoman': 1, 'f14': 2, 'f18': 2, 'f16': 3, 'm61': 1, 'seagl': 1, 'foresti': 1, 'stape': 1, 'useful': 1, 'spoilerswow': 1, 'fuflo': 1, 'funder': 1, 'knopfler': 2, 'innacuraci': 1, 'especiallli': 1, 'abbu': 2, 'aba': 1, 'shiph': 1, 'kuntar': 2, 'klinghoff': 1, 'lauro': 1, 'chatila': 1, 'syrian': 1, 'zionism': 1, 'palimpsest': 1, 'berkinsal': 1, 'censori': 1, 'hermet': 1, 'elucubr': 1, 'sempr': 1, 'fetishis': 1, 'chael': 1, 'alternant': 1, 'patakin': 1, 'expier': 1, 'esssenc': 1, 'limn': 1, 'nihlani': 1, 'baap': 1, 'sadhashiv': 2, 'absoul': 1, 'kafi': 1, 'privleg': 1, 'poter': 1, 'khaki': 3, 'unbecomingli': 1, 'mispronunci': 1, 'ivana': 1, 'springerland': 1, 'nutrient': 1, 'attanborough': 1, 'hardhat': 1, 'sorel': 1, 'mallwart': 1, 'sklar': 1, 'epiphan': 2, 'uninstal': 1, 'progenitor': 1, 'unearp': 1, 'tudo': 1, 'dinheiro': 1, 'themyscira': 1, 'hippolyt': 1, 'yeow': 1, 'ressurect': 1, '4pm': 1, 'gorn': 1, 'triskelion': 1, 'medusin': 1, 'pinkish': 1, 'studiou': 1, 'thesign': 1, 's2t': 6, 's2rd': 4, '12hr': 1, 'soso': 5, 'aleko': 8, 'achillea': 5, 'korina': 1, 'aristidi': 2, 'michalaki': 1, 'ticki': 1, 'wooofff': 1, 'acheiv': 1, 'shanghaines': 1, 'marzio': 2, 'ismir': 1, 'methadrin': 1, 'dexadrin': 1, 'kumer': 1, 'ragpal': 1, 'ugghh': 1, 'shvollenpeck': 1, 'johannsson': 1, 'manhatttan': 1, 'unbothersom': 1, 'jace': 1, 'sucess': 1, 'funniestdirti': 1, 'reportari': 1, 'housman': 1, 'aryian': 1, 'teruyo': 1, 'nogami': 1, 'tobei': 1, 'mitsugoro': 1, 'bando': 1, 'hatsu': 1, 'shida': 2, 'miku': 2, 'yama': 1, 'hisako': 1, 'rei': 1, '1h53': 1, 'workhors': 2, 'collerton': 2, 'purdi': 1, 'gove': 1, 'alucarda': 1, 'aah': 1, 'subson': 1, 'bloodthirst': 1, 'flintlock': 2, 'incher': 1, 'ribcag': 1, 'gemston': 1, 'buzzkil': 1, 'slipknot': 1, 'avventura': 4, 'bya': 1, 'lakeb': 1, 'copp': 1, 'chordant': 1, 'sheena': 3, 'bottin': 1, 'fanshaw': 11, 'letheren': 1, 'unpack': 1, 'habitaci': 1, 'roark': 1, 'bwahahha': 1, 'yesser': 2, 'nani': 1, 'sixgun': 1, 'shutterbug': 1, 'daneldorado': 1, 'antigen': 1, 'giblet': 1, 'hollyood': 1, 'dopi': 2, 'ese': 1, 'naustradam': 1, 'misshappen': 1, 'misslead': 1, 'tonkin': 1, 'wend': 1, 'urinari': 1, 'forfend': 1, '041': 1, 'jagoff': 1, 'gout': 1, 'sternum': 1, 'wherewith': 2, 'sisyphean': 1, 'soderburgh': 1, 'bolvian': 1, 'skeletor': 1, 'blackstar': 2, '6yo': 1, 'hannek': 1, 'puddi': 1, 'trruck': 1, 'stinkbug': 1, 'ragbag': 1, 'roadwarrior': 1, 'briganti': 1, 'citta': 1, 'viventi': 1, 'mcnalley': 1, 'rephrens': 1, 'druidic': 1, 'premed': 1, 'cmmandment': 1, 'tieney': 1, 'yung': 2, 'yardley': 1, 'hamtaro': 1, 'envirojudgement': 1, 'envirofascist': 1, 'margoli': 1, 'glinda': 1, 'deniabl': 1, 'johansen': 1, 'goldston': 1, 'tuscani': 1, 'gieldgud': 1, 'laert': 1, 'tanglefoot': 1, 'encw': 1, 'decaf': 1, 'chistina': 1, 'rcci': 1, 'mingella': 1, 'syphili': 1, 'duomo': 1, 'laurenz': 1, 'aadha': 1, 'hamaari': 1, 'mulkurul': 2, 'countlessli': 1, 'shielah': 2, 'wald': 1, 'guayabera': 1, 'basqu': 1, 'petru': 1, 'rodr': 2, 'guez': 2, 'castulo': 1, 'guerra': 2, 'meier': 1, 'kola': 1, 'mendum': 1, 'reh': 1, 'gye': 1, 'chaar': 1, 'bisto': 1, 'mildread': 1, 'idiosyncraci': 1, '817': 1, '937': 1, 'earner': 1, 'unmanipul': 1, 'rwtd': 1, 'enthusast': 1, 'fasin': 1, 'infantryman': 1, 'represen': 1, '54th': 1, 'gratit': 1, 'piquor': 1, 'garfil': 1, 'regimen': 2, 'gossemar': 1, 'unchoreograph': 1, 'about': 1, 'ranikhet': 1, 'almora': 1, 'kareeb': 1, 'bhabhi': 2, 'ravindra': 1, 'jain': 1, 'ramayana': 1, 'bahal': 1, 'hynd': 1, 'vedder': 1, 'esl': 1, 'luncheonett': 1, 'latk': 1, 'metropol': 1, 'schoenaert': 1, 'boel': 1, 'louwyck': 1, 'eptiom': 1, 'mastrontonio': 1, 'colom': 1, '14ai': 1, '106min': 1, 'muff': 1, 'guillesp': 2, '5250': 1, 'freeform': 1, 'shadmehr': 1, 'rastin': 1, 'longleg': 1, 'saddli': 1, 'anja': 1, 'veinbreak': 1, 'llbean': 1, 'pigfac': 1, 'montoss': 2, 'arlana': 1, 'shandara': 1, 'colwel': 1, 'justi': 2, 'unclev': 1, 'cleverless': 1, 'craparama': 1, '2030': 2, 'kahuna': 1, 'crawler': 1, 'mirna': 1, 'socioti': 1, 'bubbi': 1, 'guerro': 2, 'physical': 1, 'crusierweight': 1, 'intercontenit': 1, 'barbarino': 1, 'gunnarson': 1, 'barbwir': 1, 'streneous': 1, 'wantabe': 1, 'consumingli': 1, 'dorcey': 1, 'dentisti': 1, 'deader': 1, 'tacon': 3, 'lejano': 3, 'almod': 2, 'yack': 1, 'rekka': 1, 'sakaki': 1, 'sakaguchi': 1, 'takuand': 1, 'bruge': 2, 'leatherhead': 1, 'christansan': 1, 'husen': 1, 'darkhunt': 2, 'hobbesian': 1, 'sharer': 1, 'nadija': 1, 'vonngut': 1, 'congradul': 1, 'niveau': 1, 'brandoesqu': 1, 'tauntingli': 1, 'korin': 1, 'weirdsvil': 1, 'newsday': 1, 'charishma': 1, 'comptrol': 1, 'abdomin': 1, 'portabellow': 1, 'idjit': 1, 'anneliza': 1, 'greenbush': 1, 'pekinpah': 3, 'litr': 1, 'splitz': 1, 'tise': 1, 'bissett': 2, 'mackintosh': 3, 'zowe': 1, 'togther': 1, 'repetitev': 1, 'vaug': 1, 'durban': 1, 'gauteng': 1, 'handcraft': 1, 'zillionair': 1, 'mayles': 1, 'kickass': 1, 'cheesili': 1, 'mcgoldrick': 1, 'invictu': 1, 'unconquer': 1, 'loulla': 1, 'rocll': 1, 'foreveri': 1, 'grossest': 1, 'hairpiec': 1, 'tyrel': 1, 'charolett': 1, 'sweatier': 1, 'liswood': 1, 'volubl': 1, 'portrai': 1, 'tog': 1, 'bairn': 1, 'hra': 1, 'mindwalk': 1, 'underexplain': 1, 'bizniss': 1, 'stylophon': 1, 'tzu': 1, 'groomsmen': 1, 'gramma': 1, 'goodfellow': 1, 'unheed': 2, 'christmass': 1, 'thomason': 1, 'tio': 1, 'superpeopl': 1, 'maneur': 1, 'supermor': 1, 'superpowerman': 1, 'supermortalman': 1, 'inerest': 1, 'superbrain': 1, 'kyrptonit': 1, 'poupon': 1, 'sumner': 2, 'auberjonoi': 1, 'douchebag': 1, 'trow': 1, 'hyperderm': 1, 'maclaren': 1, 'uwi': 1, 'fangless': 1, 'briliant': 1, '1852': 1, 'rumbusti': 1, 'ragtim': 2, 'trixi': 1, 'odbray': 1, 'kelton': 1, 'kawajiri': 1, 'kiriyama': 1, 'counterproduct': 1, 'duduk': 1, 'crewmen': 2, 'badmitton': 1, 'dikkat': 1, 'cikabilir': 1, 'precios': 1, 'ocarina': 1, 'pacingli': 1, 'isar': 1, 'redoubl': 1, 'pathar': 1, 'urdhu': 1, 'gharana': 1, 'stanwyk': 2, 'komomo': 3, 'torur': 1, 'capon': 6, 'whiteclad': 1, 'actingjob': 1, 'yuoki': 1, 'umptieth': 1, 'shearmur': 1, 'michiko': 1, 'megaladon': 1, 'srbljanov': 3, 'biljana': 1, 'vestment': 1, 'utd': 1, 'chracter': 1, 'algrant': 1, 'baitz': 1, 'entei': 2, 'whatshisfac': 1, 'nailgun': 1, 'bierstadt': 1, 'rousselot': 1, 'thatat': 1, 'goodadapt': 1, 'kitchenett': 1, 'unoccupi': 1, 'brunda': 1, 'lilley': 1, 'paduch': 1, 'gamboa': 1, 'poder': 1, 'ciochetti': 1, 'unhurt': 1, 'ionesco': 1, 'subpaar': 1, 'chuckawalla': 1, 'bezzerid': 1, 'hodiak': 3, 'empurpl': 1, 'masseratti': 1, 'dorthi': 1, 'preambl': 2, 'softsho': 1, 'cumparsita': 1, 'zizt': 1, 'cinematographicli': 1, 'yeik': 1, 'montplaisir': 1, 'cinematagraph': 1, 'dickson': 1, '1893': 1, 'kinetescop': 1, 'molteni': 1, 'general': 1, 'fewest': 1, 'kassi': 1, 'minium': 1, 'shelleen': 1, 'kailin': 1, 'vandermey': 1, 'gooooooodddd': 1, 'margui': 2, 'butlin': 1, 'nickolson': 1, 'morgenstern': 1, 'durward': 1, 'grimstead': 1, 'louiguy': 1, 'damaso': 1, 'prado': 2, 'insturment': 1, 'ziv': 4, 'bubbler': 1, 'wnbq': 1, 'wmaq': 1, 'heileman': 1, 'tellin': 1, 'deterct': 1, 'annapoli': 1, 'ksc': 1, 'ccaf': 1, 'artiest': 1, 'phlip': 1, 'athanli': 1, 'athenli': 1, 'beluschi': 1, 'fordist': 2, 'taylorist': 1, 'disproport': 1, 'bauhau': 2, 'relativ': 1, 'breadwinn': 1, 'pundit': 2, 'metti': 1, 'horrorpop': 1, 'phenomonaut': 1, 'psychobilli': 1, 'markey': 1, 'canfield': 3, 'skulduggeri': 1, 'sippl': 1, 'arrowsmith': 1, 'truste': 2, 'conov': 1, 'henrietta': 3, 'unreach': 2, 'jeannett': 1, 'strawberry22': 1, 'neatest': 1, 'wilnona': 1, 'digga': 1, 'tunnah': 1, 'radziwil': 1, 'pai': 1, 'kue': 2, 'feng': 1, 'bip': 1, 'yasher': 1, 'oberman': 1, 'mackichan': 1, 'carii': 1, 'momento': 1, 'plotti': 1, 'midtorso': 1, 'scrotal': 1, 'wold': 1, 'schlump': 1, 'drywal': 1, 'cheeee': 1, 'zheeee': 1, 'lippman': 1, 'chil': 1, 'dren': 1, 'propound': 1, 'identi': 1, 'kuan': 1, 'doob': 1, 'jaongi': 1, 'ortrentin': 1, 'independantmasterpiec': 1, 'wincibl': 1, 'drugsa': 1, 'propan': 1, 'brosan': 1, 'buddw': 1, 'cosel': 1, '1775': 1, 'mcconnahay': 1, 'natassja': 1, 'corigliano': 1, 'boardinghous': 1, '33m': 1, 'wg': 1, 'subl': 1, 'sembello': 1, 'trashin': 1, 'bmx': 1, 'homelif': 1, 'emptour': 1, 'adenoid': 1, 'cinematoraphi': 1, 'hummm': 1, 'feinberg': 1, 'proctologist': 2, 'enoch': 4, 'obviusli': 1, 'fictici': 1, 'hussl': 1, 'bussl': 1, 'geronimi': 1, 'lusk': 1, 'slithi': 1, 'gmail': 1, 'malkovichian': 1, 'floodgat': 1, 'nigga': 1, 'yolonda': 1, 'jascha': 1, 'sahl': 1, 'kiyomasa': 1, 'farili': 1, 'custum': 1, 'sardinia': 3, 'bismol': 2, 'jerkwad': 1, 'godchild': 1, 'ghotst': 1, 'kremlin': 1, 'doest': 1, 'inferenc': 1, '2100': 1, 'decrement': 1, 'carlis': 1, 'zomb': 1, 'brrrrrrr': 1, 'testaverdi': 1, 'haavard': 1, 'lillehei': 1, 'uav': 2, 'massud': 4, 'phreak': 1, 'login': 1, 'backdoor': 1, 'rerout': 1, 'badat': 1, 'kerchner': 1, 'yna': 3, 'vukovar': 3, 'montenegrin': 1, 'ustash': 1, 'fyrom': 1, 'glendyn': 1, 'ivin': 1, 'difficut': 1, 'okazaki': 1, 'tonorma': 1, 'fooledton': 1, '100k': 1, 'exel': 1, 'thees': 1, 'honostli': 1, 'grigsbi': 2, 'goaul': 3, 'somnambul': 1, 'interpretaion': 1, 'depardeu': 1, 'marjan': 1, 'satrapirenaiss': 1, 'springi': 1, 'titant': 1, 'sasqu': 1, 'laurentii': 1, 'basingerthi': 1, 'mcclain': 1, 'anbu': 1, 'henshal': 1, 'molt': 1, 'whattt': 1, 'cockold': 1, 'lapel': 3, 'oneida': 1, 'unpract': 1, 'tearoom': 1, 'athelni': 1, 'amjad': 1, 'susmitha': 1, '10guinea': 1, 'shirl': 1, 'sipsey': 1, 'bandwidth': 1, 'literalist': 1, 'hermeneut': 1, 'trib': 1, 'shhhhh': 1, 'tiness': 1, 'wayno': 1, 'harrleson': 1, 'lotof': 1, 'bouchey': 1, 'prophess': 1, 'djakarta': 1, 'aznar': 1, 'multilater': 1, 'tourista': 1, 'generif': 1, 'mcdonaldland': 1, 'dated': 1, 'louisvil': 2, 'blackblood': 1, 'gaghan': 2, 'kazakhstani': 1, 'hae': 2, 'ziegfield': 1, 'persifina': 1, 'paradic': 1, 'johnathin': 1, 'invlov': 1, 'lovetrapmovi': 1, 'darndest': 1, 'leland': 1, 'heyward': 1, 'kanoodl': 1, 'columb': 1, 'daytiem': 1, 'morehead': 1, 'risa': 2, 'kohara': 2, 'osamu': 1, 'caugh': 1, 'caputur': 1, 'definitli': 1, 'mumari': 1, 'thison': 1, 'ery': 1, 'grainier': 1, 'savingtheday': 1, '1000000': 1, 'despart': 1, 'orgazim': 1, 'mechenoset': 2, 'atmoshper': 1, 'connori': 1, 'cineteca': 1, 'lustrous': 1, 'garnier': 1, 'alabast': 1, 'incandesc': 2, 'serbo': 1, 'clastrophob': 1, 'realisticli': 1, 'averagous': 1, 'permayb': 1, 'allllllll': 1, 'sohpi': 1, 'rentabl': 1, 'sahibjaan': 1, 'blackmor': 1, 'ridd': 1, 'dugal': 1, 'ensor': 1, 'faggu': 1, 'everytihng': 1, 'subvalu': 1, 'appalling': 1, 'yez': 1, 'marinaro': 1, 'lagomorph': 1, 'prolog': 1, 'twop': 1, 'purgatorio': 1, 'kf': 2, 'infinnerti': 1, 'aaaand': 1, 'antibodi': 2, 'evilmak': 1, 'reteam': 2, 'snr': 1, 'synonomu': 1, 'jaki': 1, 'heffner': 1, 'goodluck': 1, 'witchboard': 1, 'selzer': 1, 'tisa': 1, 'defenselessli': 1, 'nonreligi': 1, 'messian': 1, 'unseason': 1, 'gcif': 1, 'linag': 1, 'franziska': 1, 'chesapeak': 2, 'coatesvil': 1, 'reeeeeaalli': 1, 'tomreynolds2004': 1, 'thingto': 1, 'conahay': 1, 'heorin': 1, 'unbefit': 1, 'nguh': 1, 'tawne': 3, 'loman': 3, 'apoplexi': 1, 'cinequest': 1, 'cornili': 1, 'sakez': 1, 'ewig': 1, 'hippler': 3, 'moviewatch': 1, 'heatbeat': 1, 'bergdoff': 1, '5million': 1, 'telesal': 1, 'proya': 1, 'fullmoon': 1, 'perplexedli': 1, 'yeeeeaaaaahhhhhhhhh': 1, 'deroubaix': 1, 'picot': 1, 'lightpost': 1, 'gandu': 1, 'liberator': 1, 'verucci': 1, 'foxworthi': 1, 'spinetingl': 1, 'chicatillo': 1, 'kinekor': 1, 'wip': 4, 'dinocrap': 2, 'ahahahahahhahahahahahahahahahhahahahahahahah': 1, 'homoer': 1, 'hearbi': 1, 'paracetamol': 1, 'untrumpet': 1, 'zmeu': 1, 'dresch': 1, 'housedress': 1, 'fuchsia': 1, 'macclain': 2, 'zena': 2, 'eeeeeeeek': 1, 'zoloft': 1, 'momentsbomb': 1, 'bruja': 1, 'thr': 1, 'stivaletti': 1, 'italianis': 1, 'hobnob': 1, 'chelita': 1, 'secunda': 1, 'catweazl': 1, 'jeopardis': 2, '153': 1, 'johnnymacbest': 1, 'liana': 1, 'aggrandiz': 1, 'wingism': 1, 'shahan': 1, 'commanchero': 1, 'eido': 3, 'gamepad': 1, 'leiuten': 1, 'mamoulian': 1, 'daumier': 1, 'cavil': 2, 'bernd': 1, 'eeeb': 3, 'nikko': 1, 'shovelwar': 1, 'chapterplay': 1, 'dukesofhazzard': 1, 'westfront': 2, '850pm': 1, 'manhatten': 1, 'pendelton': 5, 'meself': 1, 'works1': 1, 'aloung': 1, 'writersani': 1, 'fabersham': 1, 'ghostintheshel': 1, 'surprisebut': 1, 'goodit': 1, 'flawsth': 1, 'followthen': 1, 'tabun': 1, 'bahot': 1, 'outgovinda': 1, 'sartoriu': 1, 'hypo': 2, 'bulow': 2, 'peggey': 1, 'msting': 1, 'carnivalist': 1, 'straiten': 1, 'ballykissangel': 1, 'forement': 1, 'spliff': 1, 'braley': 1, 'walchek': 1, 'menendez': 1, 'aboutagirli': 1, 'imperialflag': 1, 'coinsid': 1, 'documnetari': 1, 'unmerit': 1, 'eeeeeeevil': 1, 'petulantli': 1, 'choth': 1, 'coaltrain': 2, '2023': 1, 'programmat': 1, 'psicoanalit': 1, 'irc': 1, 'chatroom': 1, 'soderbergherabracadabrablahblah': 1, 'prig': 2, 'claridad': 1, 'painful': 1, 'haverti': 1, 'mosbey': 1, 'rez': 1, 'xyx': 1, 'uvw': 1, 'maschera': 1, 'demonio': 1, 'haydn': 1, 'panettier': 1, '11001001': 1, 'pullout': 1, 'tweedl': 1, 'serisouli': 1, 'schiavelli': 8, 'consigliar': 1, 'piggli': 1, 'horowitz': 1, 'rebb': 2, 'latchkey': 1, 'wrackingli': 1, 'romanu': 1, 'richmont': 1, 'genoa': 6, 'haney': 1, 'adagio': 1, 'underpar': 1, 'hasen': 1, 'cedrick': 1, 'pumphrey': 1, 'honegg': 1, 'janci': 1, 'huntsman': 1, 'prsoner': 1, 'demofilo': 1, 'piena': 1, 'dollari': 1, 'transexu': 1, 'bunghol': 1, 'moser': 1, 'kabinett': 1, 'filmmuseum': 1, 'kasumi': 1, 'nabiki': 1, 'ikkoku': 1, 'crapo': 1, 'saxaphon': 1, 'angelena': 1, 'dopiest': 1, 'silentbob': 1, 'duwayn': 1, 'nadu': 2, 'easton': 1, 'anarki': 1, 'landru': 1, 'verdoux': 1, 'longshoreman': 1, 'bailiff': 2, 'ambersom': 1, '1949er': 1, 'elem': 1, 'klimov': 1, 'arminian': 1, 'chattel': 1, 'lashley': 1, 'umaga': 1, 'tipsi': 1, 'brusk': 1, 'matchup': 1, 'enix': 3, 'sooooooooooo': 1, 'engros': 1, 'macchu': 1, 'leathermen': 1, 'stm': 2, 'thau': 1, 'xk': 2, 'blick': 1, 'rootbeer': 2, '3x5': 1, 'whorl': 1, 'loerrta': 1, 'spang': 1, 'cassiopea': 1, 'betwixt': 1, 'shakur': 2, 'homeownership': 1, 'dimbulb': 1, 'undestand': 1, 'homour': 1, 'hazelhurst': 1, 'yau': 2, 'fung': 1, 'fastli': 1, 'manoven': 2, 'projcect': 1, 'balaguero': 1, 'lughnasa': 1, 'danner': 1, 'joisey': 1, 'schlitz': 1, 'truckstop': 1, 'wwwwoooooohhhhhhoooooooo': 1, 'bippi': 1, 'starletta': 1, '39th': 1, 'minnesotan': 2, 'irland': 2, 'snazzier': 1, 'abril': 1, 'scholl': 1, 'interstiti': 1, 'upros': 1, 'l1': 1, 'l2': 1, 'bugliosa': 1, 'helter': 1, 'skelter': 1, 'schappert': 1, 'taayla': 1, 'chojnacki': 1, 'tichon': 1, 'scattergood': 1, 'kevan': 1, 'ohtsji': 1, 'scriptal': 1, 'spectic': 1, 'teer': 1, 'nonjudgment': 1, 'treehous': 1, 'hunzik': 1, 'foulmouth': 2, 'slahser': 1, 'tgwwt': 1, 'larkin': 1, 'bentivoglio': 1, 'widder': 1, 'typeset': 1, 'handwritten': 1, 'stumpfing': 1, '1318': 1, 'northfield': 3, 'jackleg': 1, 'baptis': 2, 'gol': 1, 'welshman': 1, 'sweari': 1, 'ahahahah': 1, 'yrd': 1, 'cannabalist': 1, 'silvermen': 1, 'gyu': 1, 'neversoft': 3, 'activis': 1, 'storymod': 2, 'saleen': 2, 's7': 4, 'sociopathi': 1, 'vanderbeek': 1, 'funfar': 1, 'brunhilda': 3, 'longship': 1, 'aesir': 2, 'clarksberg': 3, 'gasket': 1, 'koersk': 1, 'otsu': 1, 'musashi': 1, 'shyt': 1, 'amphlett': 1, 'jobe': 1, 'karfreitag': 1, 'heiland': 1, 'warter': 1, 'gaupeau': 1, 'conciou': 1, 'sidiou': 1, 'calomari': 1, 'sullesteian': 1, 'watterman': 2, 'sweetwat': 1, 'melvi': 1, 'frightless': 1, 'superannu': 1, 'coland': 1, 'crinolin': 1, 'plumpish': 1, 'ayon': 1, 'florrett': 1, 'tmtm': 11, 'sowwi': 1, 'vulturin': 1, 'brasswar': 1, 'terrifyng': 1, 'potray': 1, 'kalifonia': 1, 'marielito': 1, 'caracortada': 1, 'rucksack': 2, 'nicoleti': 1, 'decongest': 1, 'repar': 1, 'kabob': 1, 'redeemi': 1, 'maby': 1, 'einmal': 2, 'leben': 1, 'respir': 1, 'lifecycl': 1, 'federlin': 2, 'houst': 1, 'sweedish': 1, 'taupin': 1, 'ulaganaayakan': 1, 'ulagam': 2, 'tollywood': 2, 'comeon': 1, 'anoint': 1, 'damner': 1, 'protein': 4, 'bothermi': 1, 'hautefeuil': 1, 'viev': 1, 'travestit': 1, 'changwei': 1, 'sorghum': 1, 'cawley': 1, 'mcfarland': 1, 'nechayev': 1, 'whaddayagonndo': 1, 'cmm': 1, 'dazza': 1, 'surend': 1, 'fratlik': 1, 'judaai': 1, 'boxto': 1, 'wantsth': 1, 'ridiculouson': 1, 'storyeven': 1, 'forcedanil': 1, 'farida': 1, 'andreeff': 3, 'afemal': 1, 'forblood': 1, 'swonder': 1, 'savagei': 1, 'vampirefamili': 1, 'whoattack': 1, 'thisup': 1, 'starrand': 1, 'hespend': 1, 'thanhugh': 1, 'likeh': 1, 'themost': 1, 'goesfor': 1, 'hamsterand': 1, 'kidalso': 1, 'watchingviol': 1, 'killertongu': 1, 'scowork': 1, 'thebackground': 1, 'includevampir': 1, 'atarti': 1, 'onetiresom': 1, 'sexualviol': 1, 'sexualrefer': 2, 'freakeri': 1, 'perfunctorili': 1, 'prepared': 1, 'rillington': 1, 'titillatori': 1, 'spreadeagl': 1, 'monopolist': 1, 'lifesav': 1, 'scuzzlebut': 1, 'maaan': 1, 'kbottom': 1, 'moag': 9, 'chiyo': 1, 'suzuka': 1, 'ohgo': 1, 'podgi': 1, 'shimku': 2, 'bakumatsu': 1, 'hanpei': 2, 'nakada': 1, 'ryonosuk': 1, 'aristophan': 1, 'benedek': 1, 'gwot': 1, 'quanxin': 1, 'agrarian': 1, 'nonpolit': 1, 'bleepesqu': 1, 'susco': 1, 'hatless': 1, '2035': 1, 'sorin': 1, 'ertha': 1, 'segement': 1, 'witchhunt': 1, 'jura': 1, 'gregoir': 1, 'loiret': 1, 'caill': 1, 'bambou': 1, 'golubeva': 1, 'tinderstick': 1, 'streamer': 1, 'piecem': 1, 'halmark': 2, 'derit': 1, 'nek': 1, 'dipaolo': 1, 'yawn23': 1, 'agian': 1, 'zukor': 1, 'ging': 1, 'p2p': 1, 'kazaa': 1, 'saaad': 1, 'innit': 1, 'crisanti': 3, 'odeon': 1, '3th': 1, 'wud': 2, 'tsu': 1, 'hinter': 1, 'carven': 1, 'lussier': 2, 'crudup': 1, 'hitchen': 1, 'waldron': 1, 'lupinesqu': 1, 'gobledegook': 1, 'gurdebek': 1, 'joesph': 1, 'hannan': 1, 'titillatingli': 1, 'velazquez': 1, 'pronounci': 1, 'reigert': 1, 'centurian': 1, 'becous': 2, 'careful': 1, 'hadl': 1, 'ninjitsu': 1, 'jokerish': 1, 'agro': 1, 'bolshoi': 1, 'opus': 1, 'hrishitta': 1, 'diwana': 1, 'andalusian': 1, 'woodmobil': 1, 'headroom': 1, 'twizzler': 1, 'checkbook': 2, 'flakiest': 1, 'diggler': 2, 'aparadektoi': 1, 'lefteri': 1, 'papapetr': 1, 'aggelopoulo': 1, 'corrina': 2, 'michali': 2, 'gc': 1, 'commitophob': 1, 'huang': 1, 'jianxiang': 1, 'standa': 4, 'ondrej': 3, 'zdenek': 3, 'peli': 1, 'tmavomodr': 1, 'svet': 1, 'multilay': 1, 'grap': 1, 'mishima': 1, 'yukio': 1, 'ultranationalist': 1, 'shinbei': 1, '51st': 1, 'orpington': 1, 'lanci': 1, 'defininit': 1, 'sporat': 1, 'seanc': 1, 'bilk': 1, 'shatfac': 1, 'stuckey': 1, 'kanpur': 1, 'kareeena': 1, 'naala': 1, 'dhanno': 1, 'snazzili': 1, 'lakh': 1, 'issuey': 1, 'northbound': 1, 'matta': 2, 'herredia': 1, 'randon': 1, 'lawbreak': 1, 'darlin': 1, 'goldbeg': 1, 'unnesicari': 1, 'messylittl': 1, 'valuewhatsoev': 1, 'achanc': 1, 'shesaw': 1, 'amysteri': 1, 'bebutl': 1, 'realsoap': 1, 'shusband': 1, 'thematriarch': 1, 'drivinglesson': 1, 'emptyairplan': 1, 'thisth': 1, 'scenesad': 1, 'andletterbox': 1, 'sexand': 1, 'isaw': 1, 'andstun': 1, 'thingin': 1, 'forpractic': 1, 'whohaunt': 1, 'thescript': 1, 'dailyoccurr': 1, 'hislin': 1, 'dirtydozen': 1, 'buther': 1, 'onhow': 1, 'cannotrecom': 1, 'vhscopi': 1, 'stronggor': 1, 'adultsitu': 1, 'stirringli': 1, 'horthi': 1, 'phili': 1, 'ramm': 2, 'rommel': 1, 'blecher': 1, 'imagari': 2, 'unconsum': 1, 'stablem': 1, 'enyoy': 1, 'abdomen': 1, 'coachella': 1, 'armagedon': 1, 'higherprais': 1, 'iskon': 1, 'rajendranath': 1, 'mehmood': 1, 'hangal': 1, 'achala': 1, 'sachdev': 1, 'panchamda': 2, 'asanin': 1, 'migratori': 1, 'intrepidli': 1, 'eastward': 1, 'ethnograph': 1, 'abilityof': 1, 'ati': 1, 'doozer': 1, 'gobo': 3, 'mokey': 1, 'boober': 1, 'feisty': 1, 'mainstrain': 1, 'constructor': 1, 'youngstown': 1, 'agla': 1, 'planck': 1, 'inconsisti': 1, 'reexamin': 1, 'wath': 1, 'storyrapa': 1, 'nui': 1, 'sonego': 2, 'sordi': 1, 'coiffur': 1, 'govida': 1, 'swatch': 6, 'naugahyd': 1, 'paluski': 1, 'kayl': 1, 'timler': 1, 'sahsa': 1, 'kluznick': 1, 'mccaid': 2, 'marish': 1, 'mindel': 1, 'uncyn': 1, 'mujar': 1, 'belengur': 1, 'timecrim': 1, 'castrato': 1, 'hvr': 1, 'zx81': 1, 'woodworm': 1, 'garbagemen': 1, 'balraj': 1, 'bharai': 1, 'foolight': 1, 'collingwood': 1, 'cossimo': 1, 'gandolphini': 1, 'subcontractor': 1, 'folkway': 1, 'tau': 1, 'classick': 1, 'shakspear': 1, 'accouter': 1, 'dazzler': 1, 'eyecatch': 1, 'antrax': 1, 'burgerl': 1, 'crocket': 1, 'sorte': 1, 'prerog': 1, 'southron': 1, 'umbil': 1, 'improperli': 1, 'swashbucklin': 1, 'lor': 1, 'reliquari': 1, 'caselli': 1, 'stimpi': 1, 'dater': 1, 'edwina': 1, 'batchler': 1, '7day': 1, 'toytown': 1, 'yowl': 1, 'wwwwhhhyyyyyyi': 1, 'mastic': 1, 'fo': 1, 'finace': 1, 'clevag': 1, 'sensou': 1, 'houswif': 1, 'sooon': 1, 'besxt': 1, 'screwiest': 1, 'shenk': 2, 'greenman': 3, 'reveil': 1, 'missoula': 1, 'bluer': 1, 'emeritu': 1, 'unca': 1, 'hatsumomo': 1, 'nitta': 2, 'beem': 1, 'meatlov': 1, 'phillipen': 1, 'couldv': 1, 'shouldv': 1, 'draaaaaag': 1, 'ficat': 1, 'naaahhh': 1, 'bordoni': 1, 'ontop': 1, 'swinstead': 1, 'hellbreed': 1, 'safran': 1, 'foer': 1, 'birma': 1, 'hutu': 1, 'rwandan': 1, 'battlement': 1, 'eggplant': 1, 'wobblyhand': 1, 'glenaan': 2, 'ltd': 1, 'blurr': 1, 'thumbl': 1, 'worriedli': 2, 'shehan': 1, 'mutiraci': 1, 'sharkey': 1, 'liyan': 2, 'vambo': 1, 'drule': 1, 'unkwown': 1, 'lisaray': 1, 'zang': 1, 'hypnotherapi': 1, 'whord': 1, 'apeshyt': 1, 'clavichord': 1, 'scarlatti': 1, 'ilkka': 1, 'rvi': 2, 'laturi': 2, 'pimedus': 3, 'rvet': 1, 'snaut': 1, 'terj': 1, 'wthere': 1, 'unforten': 1, 'kotia': 1, 'numskul': 1, 'mississipi': 1, 'piquant': 1, 'overpass': 1, 'madhupur': 1, 'ekta': 1, 'bhagyashre': 1, 'windblown': 1, 'flynnish': 1, 'apologia': 1, 'bhisti': 1, 'yowsa': 4, 'teensi': 1, 'hubba': 3, 'leidner': 1, 'mercado': 2, 'leatheran': 1, 'unrival': 1, 'syal': 1, 'divali': 1, 'undertext': 3, 'neema': 1, 'tippl': 1, 'rammel': 1, 'astrotheolog': 1, 'agnostic': 1, 'sarcinello': 1, 'superviru': 1, 'splain': 1, 'teamster': 1, 'kermod': 1, 'theakston': 1, 'cert': 1, 'mdb': 1, 'strano': 1, 'vizio': 1, 'signora': 1, 'hamnett': 1, 'everywer': 1, 'obout': 1, 'stoltzfu': 1, 'yeun': 1, 'outvot': 1, 'stepfamili': 1, 'tinkerbel': 1, 'beaudray': 1, 'demeril': 1, 'caricaturist': 1, 'beadl': 2, 'brownlow': 1, 'thoughout': 1, 'f430': 1, '4cylind': 1, '140hp': 1, '40mph': 1, 'cnvrmzx2km': 1, 'amile': 1, 'logician': 1, 'nyquist': 1, 'ferrigno': 1, 'anansi': 1, 'slowenian': 1, 'rach': 1, 'rogg': 1, 'kil': 1, 'seychel': 1, '70m': 1, 'moralis': 1, 'czechoslovakian': 1, 'inevitab': 1, 'fantasticali': 1, 'chali': 1, 'ensenada': 1, 'alrit': 1, 'arrghh': 1, 'alarmsalesman': 1, 'agolden': 1, 'katecapshaw': 1, 'goingwel': 1, 'securityfirm': 1, 'inon': 1, 'theirclient': 1, 'buysecur': 1, 'getinvolv': 1, 'lifewith': 1, 'intocapshaw': 1, 'hisboss': 1, 'parentsar': 1, 'linewith': 1, 'tellssexu': 1, 'otherthan': 1, 'shedo': 1, 'thesecur': 1, 'understandarquett': 1, 'asnivel': 1, 'marymccormack': 1, 'butsh': 1, 'reynoldsi': 1, 'especiallytel': 1, 'toosoon': 1, 'canbreak': 1, 'justto': 1, 'thoseat': 1, 'thisweak': 1, 'betterchoic': 1, 'sschizophren': 1, 'publicdomain': 1, 'littlesearch': 1, 'benacquista': 1, 'parole': 1, 'vadepi': 1, 'september3': 1, 'scalethank': 1, 'sirbossman': 1, 'beluch': 1, 'laski': 1, 'loyalk': 1, 'rosson': 1, 'ludicri': 1, 'capri': 1, 'wooww': 1, 'gaz': 1, 'seemi': 1, 'sokorowska': 1, 'rollan': 2, 'chevincourt': 1, 'eug': 1, 'jouanneau': 1, 'hirsh': 1, 'unfocuss': 1, 'fobidden': 1, 'extensor': 1, 'tomilson': 1, 'guncrazi': 1, 'mija': 1, 'sasquatsh': 1, 'unlook': 1, 'unbend': 1, 'jelou': 1, 'miltonesqu': 1, 'denoument': 1, 'pinkin': 1, 'swarthi': 3, 'dystop': 1, 'rudiment': 1, 'rashli': 1, 'longstreet': 3, 'annamari': 3, 'austreheim': 1, 'woad': 1, 'russain': 1, 'szl': 1, 'kardo': 1, 'talen': 1, 'stratif': 1, 'slapchop': 1, 'rhymer': 2, 'scientologist': 2, 'bambaata': 1, 'tvg': 1, 'fetchess': 1, 'questmast': 1, 'pasqal': 1, 'uff': 1, 'japrisot': 3, 'roubaix': 2, 'indiain': 3, 'adotp': 1, 'collum': 1, 'caugt': 1, 'apertur': 1, 'cranker': 1, 'rejoind': 1, 'bumpus': 1, 'farku': 2, '2001thi': 1, 'tajiri': 1, 'ril': 2, 'noak': 1, 'isaak': 1, 'martain': 1, 'scctm': 1, 'fullmoondirect': 1, 'ottaviano': 1, 'dellacqua': 1, 'vani': 1, 'serafin': 1, 'shebang': 1, 'verson': 1, 'dirth': 1, 'growingli': 1, 'studliest': 1, 'archietectur': 1, 'haberdasheri': 1, 'shrekif': 1, 'waspi': 1, 'oafiest': 1, 'nicotero': 1, '950': 1, 'macallum': 3, 'phoenician': 2, 'snuffleupagu': 1, 'skellen': 2, 'hyun': 2, 'glienna': 1, '3m': 1, 'muppifi': 1, 'ohmigod': 1, 'prehysteria': 1, 'arrgh': 1, 'ultimo': 1, 'carath': 1, 'elef': 1, 'executor': 1, 'altanti': 1, 'roget': 1, 'neural': 1, 'arkoff': 1, 'esoteria': 1, 'selectman': 1, 'imput': 1, 'cineliter': 1, 'eveytim': 1, 'aaaugh': 1, 'unicycl': 1, 'bocaccio': 1, 'hagelin': 1, 'chass': 2, 'chiropractor': 1, 'mcnab': 1, 'catharth': 1, 'coppi': 1, 'punge': 1, 'ppvthe': 1, '2006smackdown': 1, 'hardyz': 1, 'buyrat': 1, 'layla': 1, 'unwaveringli': 1, 'hardcas': 1, 'sweeet': 1, 'sayr': 1, 'guiol': 2, 'wizen': 1, 'subtelli': 1, 'heartrench': 1, 'reglamentari': 1, 'kusminski': 2, 'feinnn': 1, 'linton': 1, 'cliffnot': 1, 'galveston': 1, 'grindley': 1, 'somm': 1, 'vasti': 1, 'deyoung': 1, 'octaviu': 1, 'countrywoman': 1, 'baccalieri': 1, 'suge': 1, 'frazzlingli': 1, 'indescret': 1, 'bruisingli': 1, 'uglypeopl': 1, 'jefferey': 2, 'wombat': 1, 'protaganist': 1, 'houseboy': 1, 'tite': 1, 'gloomili': 1, 'mopey': 1, 'rho': 1, 'merhi': 1, 'boltay': 1, 'kravitz': 1, 'buba': 1, 'rietman': 1, 'ani': 1, 'difranco': 1, 'tricep': 1, 'rnb': 1, 'snapshott': 1, 'showeman': 1, 'writter': 1, 'zacar': 1, 'viren': 3, 'sahay': 3, 'aryaman': 1, 'chawala': 1, 'afterworld': 1, 'halfhour': 1, 'tohappen': 1, 'theirseemingli': 1, 'whenth': 1, 'theymistakenli': 1, 'standstillfor': 1, 'onlygot': 1, 'gorgeoushunki': 1, 'withth': 1, 'oneattract': 1, 'thieson': 1, 'sparc': 2, 'bonair': 1, 'montaug': 1, 'stormbreak': 1, 'thoroughbr': 1, 'starnberg': 1, 'him': 1, 'prehensil': 1, 'stapler': 1, 'youknowwhat': 1, 'aloo': 1, 'gobi': 1, 'virtuost': 1, 'sanjiv': 1, 'peckenpah': 1, 'sunup': 1, 'snocker': 1, 'bmob': 1, 'opaera': 1, 'gozalez': 1, 'entrant': 1, 'kismet': 1, 'horrizon': 1, 'amerindian': 1, 'numan': 1, 'alanrickmaniac': 1, 'holic': 1, 'wisbech': 1, 'indubit': 1, 'breadlin': 1, 'grumpier': 1, 'footman': 1, 'honkeytonk': 2, 'scootin': 1, 'kraatz': 1, 'howson': 1, 'superlgu': 1, 'icu': 1, 'fellner': 1, 'valmont': 1, 'dursley': 1, 'repleat': 1, 'jowl': 1, 'camora': 1, 'capich': 1, 'billington': 1, 'gerschwin': 1, 'woody7739': 1, 'wallec': 1, 'muldayr': 1, 'zwrite': 1, 'sanpro': 1, 'moisturis': 1, 'tti': 1, 'lifford': 1, 'dicknson': 1, 'catalonian': 1, 'villarona': 2, 'balear': 1, 'bergonzino': 1, 'sor': 1, 'andreu': 1, 'alcantara': 1, 'herzegowina': 1, 'franjo': 1, 'bufooneri': 1, 'shao': 1, 'rosenkavali': 1, 'unenerget': 1, 'tetsuya': 1, 'nakadei': 4, 'daymio': 1, 'bippiti': 1, 'boppiti': 1, 'oceanographi': 1, 'jeckyl': 1, 'viagra': 1, 'viciado': 1, 'salvif': 1, 'sensualist': 1, 'muscal': 1, 'halleluha': 1, 'brutalis': 1, 'kursk': 1, 'ifi': 1, 'wasquit': 1, 'axiomat': 1, 'bolshev': 1, 'wt': 1, 'arthropod': 1, 'dadaist': 1, 'swng': 1, 'featherston': 2, 'sharpvil': 1, 'hogwart': 1, 'bedwet': 1, 'briish': 1, 'kait': 1, 'hutchenc': 2, 'onorati': 1, 'talledega': 1, 'striba': 1, 'yearm': 1, 'isint': 1, 'coreen': 1, 'clit': 1, 'baronland': 1, 'lupton': 1, 'purbb': 1, 'cheekili': 1, 'barabra': 1, 'oversc': 1, 'caribean': 1, 'menahem': 1, 'dinero': 1, 'dodekakupl': 1, 'superbal': 1, 'shelbyvil': 1, 'mcilheni': 1, 'rinki': 1, 'jakarta': 2, '8bit': 1, 'zodsworth': 1, 'longjohn': 1, 'nietszchean': 1, 'shyli': 1, 'nietszch': 2, 'rf': 11, 'waterb': 1, 'faaaaaabul': 1, 'pilippino': 1, 'wayon': 1, 'staffenberg': 1, 'cathernin': 1, 'masterton': 1, 'leguzaimo': 1, 'maclagan': 1, 'cloeck': 1, 'jawbon': 1, 'amazingi': 1, 'splatterish': 1, 'naughtili': 1, 'alexondra': 1, 'ead': 2, 'leight': 1, 'nakano': 1, '1594': 1, 'tupiniquin': 2, 'ardu': 1, 'colassanti': 1, 'tupinamb': 1, 'seboipep': 1, 'magalh': 3, 'gostoso': 2, 'lson': 1, 'rodrix': 1, 'braz': 1, 'brasileiro': 1, 'humberto': 1, 'mauro': 1, 'cenograph': 1, 'monteiro': 1, 'associa': 1, 'paulista': 1, 'tico': 1, 'agathaclos': 1, 'gaetani': 1, 'pla': 1, 'brackish': 1, 'schenck': 1, 'dardi': 1, 'smiler': 2, 'grogan': 2, 'postmark': 1, 'intermesh': 1, 'hepcat': 1, 'kale': 1, 'armetta': 1, 'pursestr': 1, 'xtreme': 1, 'petron': 1, 'satiricon': 1, 'bernano': 1, 'magot': 1, 'connoisseurship': 1, '215': 1, 'unown': 1, '2point4': 1, 'veoh': 1, 'unavli': 1, 'curitz': 1, 'unriv': 1, 'valenti': 4, 'clamshel': 1, 'tamahori': 1, 'duskfal': 1, 'depli': 1, 'wlaker': 1, 'tiebtan': 1, 'vison': 1, 'whaaa': 1, 'haari': 1, 'britan': 1, 'veranda': 1, 'billowi': 1, 'spoilerwarn': 1, 'ntr': 1, 'sivajiganeshan': 1, 'sneedek': 1, 'hollywe': 1, 'scandinavia': 1, 'bergstrom': 1, 'selldal': 1, 'wollter': 1, 'sellam': 1, 'sheirk': 1, 'demoni': 1, 'gyao': 1, 'mechagodzilla': 1, 'strep': 1, 'jarrow': 1, 'forri': 1}

['movi', 'film', 'one', 'like', 'time']

Question: What are the five most frequently appearing (tokenized) words in the training set? Does it makes sense that these words appear frequently in the training set?

Answer: Movi, film, one, like and time are most frequently appearing words

dict(list(word_dict.items())[0:5])

{'movi': 2, 'film': 3, 'one': 4, 'like': 5, 'time': 6}

Save word_dict

Later on when we construct an endpoint which processes a submitted review we will need to make use of the word_dict which we have created. As such, we will save it to a file now for future use.

data_dir = '../data/pytorch' # The folder we will use for storing data
if not os.path.exists(data_dir): # Make sure that the folder exists
    os.makedirs(data_dir)

with open(os.path.join(data_dir, 'word_dict.pkl'), "wb") as f:
    pickle.dump(word_dict, f)
print("this")
    

this

Transform the reviews

Now that we have our word dictionary which allows us to transform the words appearing in the reviews into integers, it is time to make use of it and convert our reviews to their integer sequence representation, making sure to pad or truncate to a fixed length, which in our case is 500.

def convert_and_pad(word_dict, sentence, pad=500):
    NOWORD = 0 # We will use 0 to represent the 'no word' category
    INFREQ = 1 # and we use 1 to represent the infrequent words, i.e., words not appearing in word_dict
    
    working_sentence = [NOWORD] * pad
    
    for word_index, word in enumerate(sentence[:pad]):
        if word in word_dict:
            working_sentence[word_index] = word_dict[word]
        else:
            working_sentence[word_index] = INFREQ
            
    return working_sentence, min(len(sentence), pad)

def convert_and_pad_data(word_dict, data, pad=500):
    result = []
    lengths = []
    
    for sentence in data:
        converted, leng = convert_and_pad(word_dict, sentence, pad)
        result.append(converted)
        lengths.append(leng)
        
    return np.array(result), np.array(lengths)

train_X, train_X_len = convert_and_pad_data(word_dict, train_X)
test_X, test_X_len = convert_and_pad_data(word_dict, test_X)

As a quick check to make sure that things are working as intended, check to see what one of the reviews in the training set looks like after having been processeed. Does this look reasonable? What is the length of a review in the training set?

test_X[:3]

array([[ 96,  24,   2, ...,   0,   0,   0],
       [487, 786, 342, ...,   0,   0,   0],
       [244,   1,   1, ...,   0,   0,   0]])

Question: In the cells above we use the preprocess_data and convert_and_pad_data methods to process both the training and testing set. Why or why not might this be a problem?

Answer: preprocess_data converts reviews into tokenized words, punctuations, etc. convert_and_aid_data aids in making the reviews of fixed length and replacing less frequent words

Step 3: Upload the data to S3

As in the XGBoost notebook, we will need to upload the training dataset to S3 in order for our training code to access it. For now we will save it locally and we will upload to S3 later on.

Save the processed training dataset locally

It is important to note the format of the data that we are saving as we will need to know it when we write the training code. In our case, each row of the dataset has the form label, length, review[500] where review[500] is a sequence of 500 integers representing the words in the review.

import pandas as pd
    
pd.concat([pd.DataFrame(train_y), pd.DataFrame(train_X_len), pd.DataFrame(train_X)], axis=1) \
        .to_csv(os.path.join(data_dir, 'train.csv'), header=False, index=False)
print("test")

test

Uploading the training data

Next, we need to upload the training data to the SageMaker default S3 bucket so that we can provide access to it while training our model.

import sagemaker

sagemaker_session = sagemaker.Session()

bucket = sagemaker_session.default_bucket()
prefix = 'sagemaker/sentiment_rnn'

role = sagemaker.get_execution_role()

input_data = sagemaker_session.upload_data(path=data_dir, bucket=bucket, key_prefix=prefix)

NOTE: The cell above uploads the entire contents of our data directory. This includes the word_dict.pkl file. This is fortunate as we will need this later on when we create an endpoint that accepts an arbitrary review. For now, we will just take note of the fact that it resides in the data directory (and so also in the S3 training bucket) and that we will need to make sure it gets saved in the model directory.

Step 4: Build and Train the PyTorch Model

In the XGBoost notebook we discussed what a model is in the SageMaker framework. In particular, a model comprises three objects

• Model Artifacts,
• Training Code, and
• Inference Code,

each of which interact with one another. In the XGBoost example we used training and inference code that was provided by Amazon. Here we will still be using containers provided by Amazon with the added benefit of being able to include our own custom code.

We will start by implementing our own neural network in PyTorch along with a training script. For the purposes of this project we have provided the necessary model object in the model.py file, inside of the train folder. You can see the provided implementation by running the cell below.

!pygmentize train/model.py

import torch.nn as nn

class LSTMClassifier(nn.Module):
    """
    This is the simple RNN model we will be using to perform Sentiment Analysis.
    """

    def __init__(self, embedding_dim, hidden_dim, vocab_size):
        """
        Initialize the model by settingg up the various layers.
        """
        super(LSTMClassifier, self).__init__()

        self.embedding = nn.Embedding(vocab_size, embedding_dim, padding_idx=0)
        self.lstm = nn.LSTM(embedding_dim, hidden_dim)
        self.dense = nn.Linear(in_features=hidden_dim, out_features=1)
        self.sig = nn.Sigmoid()
        
        self.word_dict = None

    def forward(self, x):
        """
        Perform a forward pass of our model on some input.
        """
        x = x.t()
        lengths = x[0,:]
        reviews = x[1:,:]
        embeds = self.embedding(reviews)
        lstm_out, _ = self.lstm(embeds)
        out = self.dense(lstm_out)
        out = out[lengths - 1, range(len(lengths))]
        return self.sig(out.squeeze())

The important takeaway from the implementation provided is that there are three parameters that we may wish to tweak to improve the performance of our model. These are the embedding dimension, the hidden dimension and the size of the vocabulary. We will likely want to make these parameters configurable in the training script so that if we wish to modify them we do not need to modify the script itself. We will see how to do this later on. To start we will write some of the training code in the notebook so that we can more easily diagnose any issues that arise.

First we will load a small portion of the training data set to use as a sample. It would be very time consuming to try and train the model completely in the notebook as we do not have access to a gpu and the compute instance that we are using is not particularly powerful. However, we can work on a small bit of the data to get a feel for how our training script is behaving.

import torch
import torch.utils.data

# Read in only the first 250 rows
train_sample = pd.read_csv(os.path.join(data_dir, 'train.csv'), header=None, names=None, nrows=250)

# Turn the input pandas dataframe into tensors
train_sample_y = torch.from_numpy(train_sample[[0]].values).float().squeeze()
train_sample_X = torch.from_numpy(train_sample.drop([0], axis=1).values).long()

# Build the dataset
train_sample_ds = torch.utils.data.TensorDataset(train_sample_X, train_sample_y)
# Build the dataloader
train_sample_dl = torch.utils.data.DataLoader(train_sample_ds, batch_size=50)

(TODO) Writing the training method

Next we need to write the training code itself. This should be very similar to training methods that you have written before to train PyTorch models. We will leave any difficult aspects such as model saving / loading and parameter loading until a little later.

#import=

from torch import nn

def train(model, train_loader, epochs, optimizer, loss_fn, device, clip=6):
    for epoch in range(1, epochs + 1):
        model.train()
        total_loss = 0
        for batch in train_loader:         
            batch_X, batch_y = batch
            
            batch_X = batch_X.to(device)
            batch_y = batch_y.to(device)
            
            # TODO: Complete this train method to train the model provided model.zero_grad()
            model.zero_grad()
            out = model(batch_X)
            print(out)
            loss = loss_fn(out.squeeze(),batch_y.float())               #loss
            loss.backward()                
            print(loss)
            nn.utils.clip_grad_norm_(model.parameters(), clip)
            optimizer.step()
            model.zero_grad()
            
          
            
            total_loss =total_loss + loss.data.item()
        print("Epoch: {}, BCELoss: {}".format(epoch, total_loss / len(train_loader)))

#print("test")

Supposing we have the training method above, we will test that it is working by writing a bit of code in the notebook that executes our training method on the small sample training set that we loaded earlier. The reason for doing this in the notebook is so that we have an opportunity to fix any errors that arise early when they are easier to diagnose.

import torch.optim as optim
from train.model import LSTMClassifier

device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = LSTMClassifier(32, 100, 5000).to(device)
optimizer = optim.Adam(model.parameters())
loss_fn = torch.nn.BCELoss()

train(model, train_sample_dl, 6, optimizer, loss_fn, device)

tensor([0.5033, 0.5033, 0.5030, 0.5223, 0.5092, 0.5285, 0.5028, 0.5188, 0.5275,
        0.5120, 0.5339, 0.5323, 0.5227, 0.5129, 0.5058, 0.5038, 0.5026, 0.5219,
        0.5451, 0.5289, 0.5049, 0.5165, 0.5197, 0.5303, 0.4979, 0.5005, 0.4913,
        0.5052, 0.5436, 0.5249, 0.5034, 0.5260, 0.5224, 0.5237, 0.5135, 0.5156,
        0.5156, 0.5192, 0.5085, 0.5341, 0.4767, 0.5144, 0.5121, 0.5106, 0.5151,
        0.5502, 0.5055, 0.5111, 0.5174, 0.5249], grad_fn=<SigmoidBackward>)
tensor(0.6913, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4925, 0.5206, 0.5015, 0.5215, 0.5192, 0.5442, 0.5239, 0.5171, 0.5159,
        0.5368, 0.5104, 0.5169, 0.4942, 0.5073, 0.5086, 0.5246, 0.5066, 0.5111,
        0.5413, 0.5162, 0.5330, 0.5104, 0.5021, 0.5208, 0.5420, 0.5187, 0.5009,
        0.5022, 0.5329, 0.5214, 0.4917, 0.5285, 0.5111, 0.5333, 0.5087, 0.4970,
        0.5262, 0.5232, 0.5213, 0.5121, 0.5274, 0.5296, 0.5240, 0.5299, 0.4919,
        0.5010, 0.5164, 0.5115, 0.5159, 0.5111], grad_fn=<SigmoidBackward>)
tensor(0.6984, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4949, 0.4985, 0.5302, 0.5470, 0.5184, 0.5341, 0.5243, 0.5306, 0.5216,
        0.5029, 0.5041, 0.5309, 0.5452, 0.5163, 0.5079, 0.5194, 0.5068, 0.5285,
        0.5132, 0.5042, 0.5288, 0.5264, 0.4893, 0.5227, 0.4994, 0.5250, 0.5021,
        0.5202, 0.5253, 0.5420, 0.5279, 0.5098, 0.5158, 0.5372, 0.5110, 0.5181,
        0.5012, 0.5211, 0.5210, 0.5148, 0.5230, 0.5390, 0.5134, 0.5353, 0.5252,
        0.5274, 0.5118, 0.4982, 0.5091, 0.5208], grad_fn=<SigmoidBackward>)
tensor(0.6937, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.5325, 0.5299, 0.5262, 0.5272, 0.4963, 0.4953, 0.5322, 0.5242, 0.5108,
        0.4862, 0.5302, 0.5278, 0.5124, 0.5089, 0.5189, 0.5252, 0.5568, 0.5050,
        0.5072, 0.4867, 0.5331, 0.5157, 0.5023, 0.4918, 0.4980, 0.5078, 0.5041,
        0.5361, 0.5322, 0.5117, 0.5215, 0.5283, 0.5191, 0.5309, 0.5060, 0.5389,
        0.5220, 0.5358, 0.5111, 0.4930, 0.5226, 0.5024, 0.5480, 0.5121, 0.5214,
        0.5280, 0.5181, 0.4897, 0.5231, 0.5076], grad_fn=<SigmoidBackward>)
tensor(0.6880, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4953, 0.5030, 0.5275, 0.5319, 0.5348, 0.5006, 0.5270, 0.5137, 0.5173,
        0.5209, 0.5016, 0.5001, 0.5198, 0.5076, 0.5200, 0.4820, 0.5380, 0.5272,
        0.5092, 0.5220, 0.4988, 0.4951, 0.4976, 0.5246, 0.5194, 0.5301, 0.4879,
        0.5322, 0.5014, 0.4985, 0.5266, 0.5040, 0.5286, 0.5186, 0.5048, 0.5052,
        0.5161, 0.5190, 0.5106, 0.5123, 0.5475, 0.5379, 0.5137, 0.5027, 0.5264,
        0.5009, 0.5242, 0.5126, 0.5161, 0.5356], grad_fn=<SigmoidBackward>)
tensor(0.6873, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 1, BCELoss: 0.6917336344718933
tensor([0.5087, 0.5144, 0.4862, 0.5224, 0.5122, 0.5259, 0.4930, 0.5440, 0.5145,
        0.5069, 0.5356, 0.5254, 0.5408, 0.5094, 0.4897, 0.5021, 0.4957, 0.5125,
        0.5406, 0.5204, 0.4911, 0.5088, 0.5138, 0.5266, 0.5029, 0.4883, 0.4904,
        0.5324, 0.5452, 0.5260, 0.5136, 0.5505, 0.5252, 0.5322, 0.5039, 0.5099,
        0.4984, 0.5175, 0.5053, 0.5232, 0.4654, 0.5081, 0.5278, 0.5243, 0.5162,
        0.5271, 0.5126, 0.5162, 0.5264, 0.5258], grad_fn=<SigmoidBackward>)
tensor(0.6795, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4822, 0.5166, 0.5090, 0.5194, 0.5178, 0.5383, 0.5446, 0.4982, 0.5174,
        0.5284, 0.4959, 0.5207, 0.4879, 0.5029, 0.4982, 0.5209, 0.4987, 0.5078,
        0.5364, 0.5100, 0.5265, 0.5097, 0.4890, 0.5152, 0.5667, 0.5518, 0.4874,
        0.4892, 0.5218, 0.5067, 0.4842, 0.5364, 0.5074, 0.5250, 0.5067, 0.4943,
        0.5185, 0.5176, 0.5256, 0.5008, 0.5217, 0.5378, 0.5148, 0.5353, 0.4906,
        0.5039, 0.5142, 0.5150, 0.5076, 0.5311], grad_fn=<SigmoidBackward>)
tensor(0.6901, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4697, 0.4916, 0.5258, 0.5462, 0.5065, 0.5298, 0.5104, 0.5280, 0.5120,
        0.4972, 0.5144, 0.5284, 0.5412, 0.5048, 0.5063, 0.5053, 0.4996, 0.5525,
        0.5202, 0.5064, 0.5319, 0.5595, 0.4845, 0.5241, 0.4860, 0.5068, 0.4892,
        0.5083, 0.5280, 0.5379, 0.5312, 0.5011, 0.5215, 0.5280, 0.5054, 0.5084,
        0.4892, 0.5027, 0.5259, 0.5121, 0.5135, 0.5392, 0.5096, 0.5277, 0.5180,
        0.5181, 0.4966, 0.4921, 0.4931, 0.5186], grad_fn=<SigmoidBackward>)
tensor(0.6823, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.5450, 0.5320, 0.5167, 0.5347, 0.4959, 0.4954, 0.5301, 0.5194, 0.4997,
        0.4909, 0.5584, 0.5305, 0.5231, 0.5106, 0.5240, 0.5160, 0.5665, 0.5015,
        0.5170, 0.4757, 0.5361, 0.5179, 0.5030, 0.4936, 0.4910, 0.4977, 0.5062,
        0.5336, 0.5282, 0.5146, 0.5146, 0.5279, 0.5539, 0.5547, 0.5104, 0.5408,
        0.5120, 0.5617, 0.5098, 0.4819, 0.5259, 0.5027, 0.5446, 0.5096, 0.5136,
        0.5249, 0.5169, 0.4851, 0.5078, 0.5085], grad_fn=<SigmoidBackward>)
tensor(0.6793, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4839, 0.4950, 0.5297, 0.5371, 0.5345, 0.4909, 0.5325, 0.4985, 0.5032,
        0.5162, 0.4943, 0.4967, 0.5094, 0.5267, 0.5047, 0.4700, 0.5639, 0.5325,
        0.5029, 0.5261, 0.4995, 0.4886, 0.5248, 0.5294, 0.5135, 0.5537, 0.4846,
        0.5296, 0.4894, 0.4813, 0.5530, 0.4995, 0.5276, 0.5172, 0.5055, 0.4950,
        0.5148, 0.5244, 0.5122, 0.5202, 0.5442, 0.5329, 0.5078, 0.5088, 0.5133,
        0.5122, 0.5089, 0.5077, 0.5146, 0.5445], grad_fn=<SigmoidBackward>)
tensor(0.6793, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 2, BCELoss: 0.6821139693260193
tensor([0.5089, 0.5244, 0.4694, 0.5120, 0.5144, 0.5260, 0.4842, 0.5728, 0.5007,
        0.5041, 0.5372, 0.5209, 0.5539, 0.5058, 0.4760, 0.4982, 0.4783, 0.5069,
        0.5428, 0.5161, 0.4828, 0.5040, 0.5171, 0.5241, 0.5108, 0.4769, 0.4857,
        0.5625, 0.5418, 0.5284, 0.5167, 0.5783, 0.5161, 0.5400, 0.4971, 0.5104,
        0.4821, 0.5176, 0.4947, 0.5154, 0.4540, 0.4997, 0.5497, 0.5414, 0.5129,
        0.5075, 0.5127, 0.5194, 0.5328, 0.5283], grad_fn=<SigmoidBackward>)
tensor(0.6722, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4721, 0.5164, 0.5167, 0.5184, 0.5165, 0.5382, 0.5696, 0.4799, 0.5192,
        0.5197, 0.4832, 0.5275, 0.4819, 0.5004, 0.4899, 0.5205, 0.4927, 0.5022,
        0.5340, 0.5073, 0.5236, 0.5111, 0.4757, 0.5141, 0.5963, 0.5896, 0.4749,
        0.4777, 0.5120, 0.4951, 0.4753, 0.5463, 0.5043, 0.5190, 0.5057, 0.4911,
        0.5147, 0.5142, 0.5326, 0.4897, 0.5191, 0.5518, 0.5056, 0.5463, 0.4886,
        0.5080, 0.5103, 0.5189, 0.5008, 0.5555], grad_fn=<SigmoidBackward>)
tensor(0.6840, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4440, 0.4858, 0.5215, 0.5490, 0.4944, 0.5283, 0.4957, 0.5257, 0.5032,
        0.4917, 0.5270, 0.5263, 0.5400, 0.4945, 0.5078, 0.4912, 0.4944, 0.5789,
        0.5302, 0.5083, 0.5385, 0.5961, 0.4807, 0.5278, 0.4732, 0.4894, 0.4774,
        0.4980, 0.5328, 0.5350, 0.5358, 0.4941, 0.5300, 0.5211, 0.5003, 0.4993,
        0.4775, 0.4841, 0.5337, 0.5101, 0.5040, 0.5430, 0.5065, 0.5207, 0.5108,
        0.5089, 0.4825, 0.4876, 0.4778, 0.5185], grad_fn=<SigmoidBackward>)
tensor(0.6709, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.5604, 0.5345, 0.5070, 0.5445, 0.4949, 0.4955, 0.5294, 0.5157, 0.4873,
        0.4947, 0.5883, 0.5360, 0.5354, 0.5135, 0.5303, 0.5067, 0.5793, 0.4976,
        0.5275, 0.4626, 0.5411, 0.5215, 0.5054, 0.4952, 0.4836, 0.4865, 0.5086,
        0.5339, 0.5263, 0.5182, 0.5079, 0.5272, 0.5901, 0.5788, 0.5167, 0.5455,
        0.5021, 0.5893, 0.5066, 0.4702, 0.5302, 0.5028, 0.5424, 0.5071, 0.5046,
        0.5223, 0.5154, 0.4780, 0.4919, 0.5102], grad_fn=<SigmoidBackward>)
tensor(0.6698, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4719, 0.4870, 0.5344, 0.5444, 0.5352, 0.4823, 0.5402, 0.4824, 0.4892,
        0.5128, 0.4858, 0.4949, 0.4987, 0.5439, 0.4893, 0.4537, 0.5913, 0.5390,
        0.4963, 0.5295, 0.4998, 0.4822, 0.5569, 0.5370, 0.5051, 0.5781, 0.4811,
        0.5290, 0.4753, 0.4614, 0.5806, 0.4938, 0.5271, 0.5163, 0.5056, 0.4854,
        0.5158, 0.5299, 0.5147, 0.5282, 0.5422, 0.5292, 0.5017, 0.5147, 0.4995,
        0.5241, 0.4937, 0.5030, 0.5140, 0.5578], grad_fn=<SigmoidBackward>)
tensor(0.6699, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 3, BCELoss: 0.6733484148979187
tensor([0.5113, 0.5374, 0.4509, 0.5023, 0.5173, 0.5279, 0.4745, 0.6031, 0.4870,
        0.5033, 0.5405, 0.5181, 0.5697, 0.5023, 0.4609, 0.4939, 0.4584, 0.5005,
        0.5462, 0.5126, 0.4744, 0.5012, 0.5238, 0.5206, 0.5201, 0.4645, 0.4785,
        0.5951, 0.5417, 0.5317, 0.5195, 0.6088, 0.5086, 0.5510, 0.4906, 0.5127,
        0.4652, 0.5187, 0.4831, 0.5076, 0.4395, 0.4921, 0.5722, 0.5583, 0.5124,
        0.4880, 0.5128, 0.5243, 0.5397, 0.5313], grad_fn=<SigmoidBackward>)
tensor(0.6640, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4612, 0.5169, 0.5230, 0.5181, 0.5206, 0.5398, 0.5966, 0.4610, 0.5217,
        0.5114, 0.4685, 0.5362, 0.4752, 0.4962, 0.4817, 0.5211, 0.4880, 0.4968,
        0.5332, 0.5041, 0.5217, 0.5127, 0.4597, 0.5138, 0.6286, 0.6301, 0.4610,
        0.4658, 0.5007, 0.4807, 0.4653, 0.5606, 0.5030, 0.5134, 0.5047, 0.4864,
        0.5109, 0.5122, 0.5411, 0.4765, 0.5165, 0.5679, 0.4970, 0.5606, 0.4866,
        0.5126, 0.5100, 0.5239, 0.4939, 0.5806], grad_fn=<SigmoidBackward>)
tensor(0.6775, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4150, 0.4798, 0.5162, 0.5550, 0.4820, 0.5289, 0.4792, 0.5216, 0.4940,
        0.4852, 0.5418, 0.5238, 0.5407, 0.4845, 0.5106, 0.4771, 0.4906, 0.6073,
        0.5432, 0.5112, 0.5496, 0.6347, 0.4768, 0.5334, 0.4586, 0.4694, 0.4668,
        0.4878, 0.5407, 0.5325, 0.5419, 0.4863, 0.5407, 0.5165, 0.4953, 0.4894,
        0.4650, 0.4659, 0.5456, 0.5073, 0.4945, 0.5482, 0.5052, 0.5129, 0.5053,
        0.5003, 0.4668, 0.4857, 0.4621, 0.5197], grad_fn=<SigmoidBackward>)
tensor(0.6582, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.5804, 0.5369, 0.4957, 0.5577, 0.4915, 0.4945, 0.5307, 0.5122, 0.4734,
        0.4974, 0.6215, 0.5436, 0.5507, 0.5196, 0.5386, 0.4973, 0.5962, 0.4916,
        0.5394, 0.4460, 0.5491, 0.5283, 0.5102, 0.4972, 0.4754, 0.4727, 0.5110,
        0.5383, 0.5280, 0.5235, 0.5014, 0.5267, 0.6277, 0.6024, 0.5250, 0.5536,
        0.4912, 0.6193, 0.4983, 0.4569, 0.5360, 0.5024, 0.5401, 0.5036, 0.4928,
        0.5191, 0.5128, 0.4679, 0.4746, 0.5117], grad_fn=<SigmoidBackward>)
tensor(0.6586, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4593, 0.4791, 0.5422, 0.5539, 0.5368, 0.4742, 0.5508, 0.4653, 0.4761,
        0.5109, 0.4758, 0.4954, 0.4866, 0.5574, 0.4736, 0.4296, 0.6207, 0.5468,
        0.4894, 0.5317, 0.4993, 0.4754, 0.5959, 0.5482, 0.4915, 0.6023, 0.4762,
        0.5312, 0.4573, 0.4371, 0.6096, 0.4855, 0.5261, 0.5162, 0.5035, 0.4762,
        0.5199, 0.5347, 0.5183, 0.5358, 0.5412, 0.5264, 0.4945, 0.5210, 0.4837,
        0.5371, 0.4769, 0.4989, 0.5155, 0.5775], grad_fn=<SigmoidBackward>)
tensor(0.6584, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 4, BCELoss: 0.6633203268051148
tensor([0.5183, 0.5556, 0.4285, 0.4944, 0.5211, 0.5315, 0.4630, 0.6352, 0.4723,
        0.5059, 0.5459, 0.5172, 0.5903, 0.4988, 0.4425, 0.4894, 0.4343, 0.4918,
        0.5495, 0.5090, 0.4645, 0.5015, 0.5354, 0.5142, 0.5314, 0.4497, 0.4677,
        0.6321, 0.5477, 0.5347, 0.5223, 0.6429, 0.5046, 0.5676, 0.4838, 0.5170,
        0.4459, 0.5209, 0.4698, 0.4992, 0.4189, 0.4860, 0.5950, 0.5746, 0.5171,
        0.4667, 0.5133, 0.5324, 0.5476, 0.5337], grad_fn=<SigmoidBackward>)
tensor(0.6535, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4489, 0.5175, 0.5265, 0.5186, 0.5350, 0.5427, 0.6266, 0.4406, 0.5254,
        0.5021, 0.4495, 0.5473, 0.4664, 0.4878, 0.4737, 0.5228, 0.4852, 0.4918,
        0.5345, 0.4981, 0.5203, 0.5143, 0.4382, 0.5140, 0.6642, 0.6743, 0.4439,
        0.4524, 0.4850, 0.4591, 0.4528, 0.5826, 0.5045, 0.5077, 0.5034, 0.4788,
        0.5063, 0.5121, 0.5517, 0.4588, 0.5126, 0.5864, 0.4880, 0.5796, 0.4846,
        0.5179, 0.5171, 0.5312, 0.4861, 0.6066], grad_fn=<SigmoidBackward>)
tensor(0.6697, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.3789, 0.4730, 0.5088, 0.5667, 0.4687, 0.5326, 0.4587, 0.5129, 0.4847,
        0.4763, 0.5598, 0.5201, 0.5426, 0.4751, 0.5145, 0.4634, 0.4895, 0.6378,
        0.5599, 0.5162, 0.5678, 0.6754, 0.4726, 0.5417, 0.4400, 0.4426, 0.4587,
        0.4771, 0.5536, 0.5300, 0.5497, 0.4759, 0.5544, 0.5146, 0.4898, 0.4770,
        0.4505, 0.4479, 0.5638, 0.5020, 0.4844, 0.5545, 0.5068, 0.5028, 0.5038,
        0.4925, 0.4471, 0.4889, 0.4454, 0.5221], grad_fn=<SigmoidBackward>)
tensor(0.6426, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.6075, 0.5385, 0.4806, 0.5758, 0.4828, 0.4911, 0.5350, 0.5079, 0.4560,
        0.4982, 0.6600, 0.5536, 0.5719, 0.5320, 0.5501, 0.4864, 0.6196, 0.4807,
        0.5539, 0.4232, 0.5622, 0.5417, 0.5206, 0.4998, 0.4658, 0.4543, 0.5128,
        0.5489, 0.5344, 0.5314, 0.4951, 0.5266, 0.6669, 0.6238, 0.5373, 0.5672,
        0.4771, 0.6525, 0.4803, 0.4402, 0.5448, 0.5013, 0.5353, 0.4975, 0.4750,
        0.5132, 0.5078, 0.4520, 0.4543, 0.5124], grad_fn=<SigmoidBackward>)
tensor(0.6443, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4465, 0.4709, 0.5557, 0.5662, 0.5394, 0.4670, 0.5663, 0.4464, 0.4647,
        0.5121, 0.4626, 0.5006, 0.4712, 0.5637, 0.4585, 0.3925, 0.6524, 0.5561,
        0.4816, 0.5305, 0.4972, 0.4689, 0.6452, 0.5647, 0.4677, 0.6238, 0.4684,
        0.5379, 0.4329, 0.4067, 0.6396, 0.4728, 0.5227, 0.5174, 0.4962, 0.4682,
        0.5298, 0.5365, 0.5246, 0.5420, 0.5407, 0.5242, 0.4837, 0.5287, 0.4627,
        0.5521, 0.4567, 0.4955, 0.5216, 0.6079], grad_fn=<SigmoidBackward>)
tensor(0.6430, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 5, BCELoss: 0.6506130695343018
tensor([0.5348, 0.5834, 0.3995, 0.4895, 0.5260, 0.5367, 0.4482, 0.6689, 0.4568,
        0.5158, 0.5540, 0.5194, 0.6195, 0.4951, 0.4182, 0.4844, 0.4012, 0.4791,
        0.5510, 0.5040, 0.4503, 0.5080, 0.5560, 0.5015, 0.5460, 0.4306, 0.4517,
        0.6768, 0.5654, 0.5351, 0.5243, 0.6826, 0.5069, 0.5940, 0.4761, 0.5241,
        0.4207, 0.5249, 0.4537, 0.4900, 0.3873, 0.4835, 0.6184, 0.5892, 0.5314,
        0.4416, 0.5153, 0.5459, 0.5565, 0.5335], grad_fn=<SigmoidBackward>)
tensor(0.6382, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4343, 0.5161, 0.5237, 0.5200, 0.5689, 0.5470, 0.6627, 0.4185, 0.5310,
        0.4879, 0.4211, 0.5618, 0.4515, 0.4705, 0.4667, 0.5261, 0.4866, 0.4868,
        0.5404, 0.4850, 0.5188, 0.5172, 0.4070, 0.5154, 0.7047, 0.7235, 0.4205,
        0.4357, 0.4592, 0.4221, 0.4346, 0.6176, 0.5106, 0.5024, 0.5034, 0.4656,
        0.4995, 0.5156, 0.5650, 0.4317, 0.5045, 0.6094, 0.4753, 0.6062, 0.4826,
        0.5236, 0.5380, 0.5433, 0.4771, 0.6342], grad_fn=<SigmoidBackward>)
tensor(0.6599, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.3300, 0.4654, 0.4979, 0.5930, 0.4543, 0.5418, 0.4306, 0.4924, 0.4777,
        0.4630, 0.5826, 0.5143, 0.5430, 0.4668, 0.5187, 0.4506, 0.4946, 0.6694,
        0.5809, 0.5259, 0.5989, 0.7176, 0.4686, 0.5541, 0.4134, 0.4010, 0.4563,
        0.4672, 0.5761, 0.5276, 0.5593, 0.4592, 0.5720, 0.5159, 0.4824, 0.4596,
        0.4311, 0.4309, 0.5907, 0.4906, 0.4721, 0.5619, 0.5125, 0.4866, 0.5111,
        0.4867, 0.4196, 0.5037, 0.4266, 0.5264], grad_fn=<SigmoidBackward>)
tensor(0.6219, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.6450, 0.5369, 0.4558, 0.6017, 0.4628, 0.4827, 0.5453, 0.5008, 0.4297,
        0.4960, 0.7091, 0.5680, 0.6047, 0.5576, 0.5678, 0.4702, 0.6547, 0.4593,
        0.5744, 0.3893, 0.5854, 0.5687, 0.5467, 0.5009, 0.4530, 0.4274, 0.5120,
        0.5688, 0.5472, 0.5419, 0.4904, 0.5264, 0.7077, 0.6385, 0.5576, 0.5915,
        0.4559, 0.6909, 0.4434, 0.4162, 0.5606, 0.5002, 0.5198, 0.4846, 0.4441,
        0.4994, 0.4962, 0.4239, 0.4288, 0.5111], grad_fn=<SigmoidBackward>)
tensor(0.6240, grad_fn=<BinaryCrossEntropyBackward>)
tensor([0.4344, 0.4604, 0.5817, 0.5829, 0.5438, 0.4624, 0.5911, 0.4247, 0.4576,
        0.5216, 0.4419, 0.5166, 0.4473, 0.5562, 0.4483, 0.3351, 0.6883, 0.5668,
        0.4702, 0.5198, 0.4917, 0.4685, 0.7072, 0.5894, 0.4228, 0.6337, 0.4543,
        0.5533, 0.3994, 0.3705, 0.6692, 0.4527, 0.5114, 0.5213, 0.4749, 0.4635,
        0.5522, 0.5297, 0.5417, 0.5431, 0.5380, 0.5236, 0.4613, 0.5404, 0.4287,
        0.5704, 0.4282, 0.4922, 0.5363, 0.6577], grad_fn=<SigmoidBackward>)
tensor(0.6203, grad_fn=<BinaryCrossEntropyBackward>)
Epoch: 6, BCELoss: 0.6328567624092102

In order to construct a PyTorch model using SageMaker we must provide SageMaker with a training script. We may optionally include a directory which will be copied to the container and from which our training code will be run. When the training container is executed it will check the uploaded directory (if there is one) for a requirements.txt file and install any required Python libraries, after which the training script will be run.

(TODO) Training the model

When a PyTorch model is constructed in SageMaker, an entry point must be specified. This is the Python file which will be executed when the model is trained. Inside of the train directory is a file called train.py which has been provided and which contains most of the necessary code to train our model. The only thing that is missing is the implementation of the train() method which you wrote earlier in this notebook.

TODO: Copy the train() method written above and paste it into the train/train.py file where required.

The way that SageMaker passes hyperparameters to the training script is by way of arguments. These arguments can then be parsed and used in the training script. To see how this is done take a look at the provided train/train.py file.

from sagemaker.pytorch import PyTorch

estimator = PyTorch(entry_point="train.py",
                    source_dir="train",
                    role=role,
                    framework_version='0.4.0',
                    train_instance_count=1,
                    train_instance_type='ml.p2.xlarge',
                    hyperparameters={
                        'epochs': 10,
                        'hidden_dim': 200,
                    })

estimator.fit({'training': input_data})

2020-06-28 05:58:16 Starting - Starting the training job...
2020-06-28 05:58:19 Starting - Launching requested ML instances......
2020-06-28 05:59:23 Starting - Preparing the instances for training......
2020-06-28 06:00:34 Downloading - Downloading input data...
2020-06-28 06:01:10 Training - Downloading the training image...
2020-06-28 06:01:41 Training - Training image download completed. Training in progress..bash: cannot set terminal process group (-1): Inappropriate ioctl for device
bash: no job control in this shell
2020-06-28 06:01:41,923 sagemaker-containers INFO     Imported framework sagemaker_pytorch_container.training
2020-06-28 06:01:41,949 sagemaker_pytorch_container.training INFO     Block until all host DNS lookups succeed.
2020-06-28 06:01:44,962 sagemaker_pytorch_container.training INFO     Invoking user training script.
2020-06-28 06:01:45,228 sagemaker-containers INFO     Module train does not provide a setup.py. 
Generating setup.py
2020-06-28 06:01:45,228 sagemaker-containers INFO     Generating setup.cfg
2020-06-28 06:01:45,229 sagemaker-containers INFO     Generating MANIFEST.in
2020-06-28 06:01:45,229 sagemaker-containers INFO     Installing module with the following command:
/usr/bin/python -m pip install -U . -r requirements.txt
Processing /opt/ml/code
Collecting pandas (from -r requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/74/24/0cdbf8907e1e3bc5a8da03345c23cbed7044330bb8f73bb12e711a640a00/pandas-0.24.2-cp35-cp35m-manylinux1_x86_64.whl (10.0MB)
Collecting numpy (from -r requirements.txt (line 2))
  Downloading https://files.pythonhosted.org/packages/b5/36/88723426b4ff576809fec7d73594fe17a35c27f8d01f93637637a29ae25b/numpy-1.18.5-cp35-cp35m-manylinux1_x86_64.whl (19.9MB)
Collecting nltk (from -r requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/92/75/ce35194d8e3022203cca0d2f896dbb88689f9b3fce8e9f9cff942913519d/nltk-3.5.zip (1.4MB)
Collecting beautifulsoup4 (from -r requirements.txt (line 4))
  Downloading https://files.pythonhosted.org/packages/66/25/ff030e2437265616a1e9b25ccc864e0371a0bc3adb7c5a404fd661c6f4f6/beautifulsoup4-4.9.1-py3-none-any.whl (115kB)
Collecting html5lib (from -r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/6c/dd/a834df6482147d48e225a49515aabc28974ad5a4ca3215c18a882565b028/html5lib-1.1-py2.py3-none-any.whl (112kB)
Collecting pytz>=2011k (from pandas->-r requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/4f/a4/879454d49688e2fad93e59d7d4efda580b783c745fd2ec2a3adf87b0808d/pytz-2020.1-py2.py3-none-any.whl (510kB)
Requirement already satisfied, skipping upgrade: python-dateutil>=2.5.0 in /usr/local/lib/python3.5/dist-packages (from pandas->-r requirements.txt (line 1)) (2.7.5)
Requirement already satisfied, skipping upgrade: click in /usr/local/lib/python3.5/dist-packages (from nltk->-r requirements.txt (line 3)) (7.0)
Collecting joblib (from nltk->-r requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/28/5c/cf6a2b65a321c4a209efcdf64c2689efae2cb62661f8f6f4bb28547cf1bf/joblib-0.14.1-py2.py3-none-any.whl (294kB)
Collecting regex (from nltk->-r requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/b8/7b/01510a6229c2176425bda54d15fba05a4b3df169b87265b008480261d2f9/regex-2020.6.8.tar.gz (690kB)
Collecting tqdm (from nltk->-r requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/f3/76/4697ce203a3d42b2ead61127b35e5fcc26bba9a35c03b32a2bd342a4c869/tqdm-4.46.1-py2.py3-none-any.whl (63kB)
Collecting soupsieve>1.2 (from beautifulsoup4->-r requirements.txt (line 4))
  Downloading https://files.pythonhosted.org/packages/6f/8f/457f4a5390eeae1cc3aeab89deb7724c965be841ffca6cfca9197482e470/soupsieve-2.0.1-py3-none-any.whl
Requirement already satisfied, skipping upgrade: six>=1.9 in /usr/local/lib/python3.5/dist-packages (from html5lib->-r requirements.txt (line 5)) (1.11.0)
Collecting webencodings (from html5lib->-r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/f4/24/2a3e3df732393fed8b3ebf2ec078f05546de641fe1b667ee316ec1dcf3b7/webencodings-0.5.1-py2.py3-none-any.whl
Building wheels for collected packages: nltk, train, regex
  Running setup.py bdist_wheel for nltk: started
  Running setup.py bdist_wheel for nltk: finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/ae/8c/3f/b1fe0ba04555b08b57ab52ab7f86023639a526d8bc8d384306
  Running setup.py bdist_wheel for train: started
  Running setup.py bdist_wheel for train: finished with status 'done'
  Stored in directory: /tmp/pip-ephem-wheel-cache-4rue2ocu/wheels/35/24/16/37574d11bf9bde50616c67372a334f94fa8356bc7164af8ca3
  Running setup.py bdist_wheel for regex: started
  Running setup.py bdist_wheel for regex: finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/9c/e2/cf/246ad8c87bcdf3cba1ec95fa89bc205c9037aa8f4d2e26fdad
Successfully built nltk train regex
Installing collected packages: pytz, numpy, pandas, joblib, regex, tqdm, nltk, soupsieve, beautifulsoup4, webencodings, html5lib, train
  Found existing installation: numpy 1.15.4
    Uninstalling numpy-1.15.4:
      Successfully uninstalled numpy-1.15.4
Successfully installed beautifulsoup4-4.9.1 html5lib-1.1 joblib-0.14.1 nltk-3.5 numpy-1.18.5 pandas-0.24.2 pytz-2020.1 regex-2020.6.8 soupsieve-2.0.1 tqdm-4.46.1 train-1.0.0 webencodings-0.5.1
You are using pip version 18.1, however version 20.2b1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
2020-06-28 06:02:07,659 sagemaker-containers INFO     Invoking user script

Training Env:

{
    "job_name": "sagemaker-pytorch-2020-06-28-05-58-16-002",
    "input_data_config": {
        "training": {
            "S3DistributionType": "FullyReplicated",
            "RecordWrapperType": "None",
            "TrainingInputMode": "File"
        }
    },
    "resource_config": {
        "hosts": [
            "algo-1"
        ],
        "network_interface_name": "eth0",
        "current_host": "algo-1"
    },
    "model_dir": "/opt/ml/model",
    "output_data_dir": "/opt/ml/output/data",
    "output_intermediate_dir": "/opt/ml/output/intermediate",
    "log_level": 20,
    "additional_framework_parameters": {},
    "input_dir": "/opt/ml/input",
    "module_name": "train",
    "channel_input_dirs": {
        "training": "/opt/ml/input/data/training"
    },
    "input_config_dir": "/opt/ml/input/config",
    "num_cpus": 4,
    "user_entry_point": "train.py",
    "num_gpus": 1,
    "output_dir": "/opt/ml/output",
    "current_host": "algo-1",
    "module_dir": "s3://sagemaker-ap-south-1-847165439330/sagemaker-pytorch-2020-06-28-05-58-16-002/source/sourcedir.tar.gz",
    "network_interface_name": "eth0",
    "framework_module": "sagemaker_pytorch_container.training:main",
    "hosts": [
        "algo-1"
    ],
    "hyperparameters": {
        "hidden_dim": 200,
        "epochs": 10
    }
}

Environment variables:

SM_MODULE_NAME=train
SM_OUTPUT_DIR=/opt/ml/output
SM_INPUT_DATA_CONFIG={"training":{"RecordWrapperType":"None","S3DistributionType":"FullyReplicated","TrainingInputMode":"File"}}
SM_NUM_CPUS=4
SM_FRAMEWORK_MODULE=sagemaker_pytorch_container.training:main
SM_LOG_LEVEL=20
SM_CURRENT_HOST=algo-1
SM_CHANNEL_TRAINING=/opt/ml/input/data/training
SM_TRAINING_ENV={"additional_framework_parameters":{},"channel_input_dirs":{"training":"/opt/ml/input/data/training"},"current_host":"algo-1","framework_module":"sagemaker_pytorch_container.training:main","hosts":["algo-1"],"hyperparameters":{"epochs":10,"hidden_dim":200},"input_config_dir":"/opt/ml/input/config","input_data_config":{"training":{"RecordWrapperType":"None","S3DistributionType":"FullyReplicated","TrainingInputMode":"File"}},"input_dir":"/opt/ml/input","job_name":"sagemaker-pytorch-2020-06-28-05-58-16-002","log_level":20,"model_dir":"/opt/ml/model","module_dir":"s3://sagemaker-ap-south-1-847165439330/sagemaker-pytorch-2020-06-28-05-58-16-002/source/sourcedir.tar.gz","module_name":"train","network_interface_name":"eth0","num_cpus":4,"num_gpus":1,"output_data_dir":"/opt/ml/output/data","output_dir":"/opt/ml/output","output_intermediate_dir":"/opt/ml/output/intermediate","resource_config":{"current_host":"algo-1","hosts":["algo-1"],"network_interface_name":"eth0"},"user_entry_point":"train.py"}
SM_NUM_GPUS=1
SM_USER_ARGS=["--epochs","10","--hidden_dim","200"]
SM_OUTPUT_INTERMEDIATE_DIR=/opt/ml/output/intermediate
PYTHONPATH=/usr/local/bin:/usr/lib/python35.zip:/usr/lib/python3.5:/usr/lib/python3.5/plat-x86_64-linux-gnu:/usr/lib/python3.5/lib-dynload:/usr/local/lib/python3.5/dist-packages:/usr/lib/python3/dist-packages
SM_INPUT_DIR=/opt/ml/input
SM_HPS={"epochs":10,"hidden_dim":200}
SM_MODULE_DIR=s3://sagemaker-ap-south-1-847165439330/sagemaker-pytorch-2020-06-28-05-58-16-002/source/sourcedir.tar.gz
SM_CHANNELS=["training"]
SM_HOSTS=["algo-1"]
SM_HP_HIDDEN_DIM=200
SM_MODEL_DIR=/opt/ml/model
SM_NETWORK_INTERFACE_NAME=eth0
SM_HP_EPOCHS=10
SM_USER_ENTRY_POINT=train.py
SM_INPUT_CONFIG_DIR=/opt/ml/input/config
SM_RESOURCE_CONFIG={"current_host":"algo-1","hosts":["algo-1"],"network_interface_name":"eth0"}
SM_OUTPUT_DATA_DIR=/opt/ml/output/data
SM_FRAMEWORK_PARAMS={}

Invoking script with the following command:

/usr/bin/python -m train --epochs 10 --hidden_dim 200


Using device cuda.
Get train data loader.
Model loaded with embedding_dim 32, hidden_dim 200, vocab_size 5000.
tensor([ 0.4905,  0.4965,  0.4900,  0.4886,  0.5090,  0.4929,  0.4969,
         0.4989,  0.4815,  0.4949,  0.4959,  0.4977,  0.4879,  0.4709,
         0.4930,  0.4900,  0.4949,  0.4808,  0.4942,  0.5028,  0.4870,
         0.4968,  0.4891,  0.4858,  0.5092,  0.4888,  0.4731,  0.5008,
         0.4773,  0.5004,  0.4964,  0.5016,  0.4977,  0.4908,  0.4989,
         0.4846,  0.4975,  0.5061,  0.4885,  0.4974,  0.5076,  0.4974,
         0.5088,  0.5016,  0.4970,  0.5071,  0.4879,  0.5050,  0.4865,
         0.4986,  0.4925,  0.4876,  0.4870,  0.4847,  0.4956,  0.4832,
         0.5044,  0.4779,  0.5036,  0.4959,  0.4857,  0.4817,  0.4897,
         0.4939,  0.4918,  0.4922,  0.4852,  0.4938,  0.4967,  0.4899,
         0.5069,  0.4853,  0.5023,  0.4995,  0.4928,  0.5060,  0.4889,
         0.4907,  0.4936,  0.4665,  0.4906,  0.4939,  0.4988,  0.4949,
         0.5010,  0.4863,  0.4899,  0.4944,  0.4987,  0.5049,  0.4849,
         0.4838,  0.4960,  0.4789,  0.4884,  0.4888,  0.4940,  0.4743,
         0.5034,  0.5174,  0.4949,  0.4801,  0.5050,  0.4720,  0.4938,
         0.5132,  0.4962,  0.5013,  0.4915,  0.4939,  0.5053,  0.4918,
         0.4932,  0.4943,  0.4736,  0.4895,  0.4885,  0.5050,  0.4971,
         0.4911,  0.5005,  0.5120,  0.5045,  0.4886,  0.4907,  0.4746,
         0.4857,  0.5028,  0.4894,  0.4979,  0.4880,  0.4904,  0.4807,
         0.4902,  0.4876,  0.4913,  0.4746,  0.4885,  0.4852,  0.4880,
         0.4958,  0.4817,  0.4935,  0.4871,  0.5069,  0.4843,  0.4738,
         0.5036,  0.4901,  0.5002,  0.5042,  0.4932,  0.4922,  0.5008,
         0.4779,  0.4759,  0.4907,  0.5121,  0.4838,  0.4981,  0.5030,
         0.4712,  0.4814,  0.4913,  0.4899,  0.4844,  0.4645,  0.4798,
         0.4737,  0.4723,  0.4984,  0.5050,  0.5097,  0.5046,  0.4823,
         0.5042,  0.4901,  0.4867,  0.4864,  0.4867,  0.4812,  0.4792,
         0.5060,  0.4977,  0.5048,  0.4987,  0.4748,  0.5024,  0.4816,
         0.4921,  0.4967,  0.4895,  0.4935,  0.4979,  0.4792,  0.4854,
         0.4870,  0.4909,  0.5092,  0.4873,  0.5055,  0.4906,  0.5019,
         0.4986,  0.4965,  0.4927,  0.4817,  0.4967,  0.4910,  0.4950,
         0.4928,  0.4913,  0.4737,  0.5156,  0.4996,  0.4887,  0.4994,
         0.4823,  0.4824,  0.4936,  0.5112,  0.4767,  0.5031,  0.4901,
         0.4839,  0.4963,  0.4693,  0.4702,  0.4940,  0.4858,  0.5003,
         0.4931,  0.5019,  0.4804,  0.4721,  0.4835,  0.4968,  0.4993,
         0.5021,  0.4839,  0.4851,  0.4979,  0.4959,  0.4823,  0.4878,
         0.4920,  0.5071,  0.4944,  0.4968,  0.5081,  0.4917,  0.5062,
         0.4963,  0.4816,  0.4877,  0.4928,  0.4805,  0.5059,  0.4779,
         0.5073,  0.4855,  0.4945,  0.5078,  0.5078,  0.4915,  0.4848,
         0.5098,  0.4978,  0.4816,  0.4961,  0.4904,  0.4946,  0.4841,
         0.5011,  0.4788,  0.4958,  0.4840,  0.4889,  0.4829,  0.4627,
         0.4817,  0.4781,  0.4932,  0.4844,  0.4964,  0.4828,  0.5033,
         0.5057,  0.4864,  0.4835,  0.4905,  0.4785,  0.4880,  0.4843,
         0.5066,  0.5033,  0.5122,  0.5138,  0.4846,  0.5140,  0.4891,
         0.4796,  0.5005,  0.4884,  0.5009,  0.4893,  0.4914,  0.4942,
         0.4972,  0.4741,  0.5222,  0.4966,  0.4753,  0.4965,  0.4986,
         0.4829,  0.4935,  0.4814,  0.4859,  0.5028,  0.4946,  0.4909,
         0.4901,  0.4981,  0.4936,  0.4878,  0.4996,  0.4801,  0.4916,
         0.4899,  0.4912,  0.4928,  0.4875,  0.4871,  0.4895,  0.4907,
         0.4993,  0.4772,  0.4985,  0.4999,  0.4735,  0.5022,  0.4837,
         0.4872,  0.4896,  0.4962,  0.4967,  0.4965,  0.4918,  0.4879,
         0.5004,  0.4796,  0.4813,  0.5074,  0.4903,  0.4841,  0.4818,
         0.4860,  0.4925,  0.4865,  0.4889,  0.4909,  0.4971,  0.5019,
         0.5111,  0.4990,  0.5005,  0.5023,  0.4901,  0.4835,  0.4986,
         0.5093,  0.5027,  0.4826,  0.4835,  0.4938,  0.4918,  0.4970,
         0.4855,  0.4944,  0.4856,  0.5104,  0.4795,  0.4949,  0.5056,
         0.4851,  0.4831,  0.4966,  0.4742,  0.5067,  0.5005,  0.4802,
         0.4873,  0.4969,  0.4820,  0.4986,  0.4861,  0.5101,  0.4873,
         0.4905,  0.4887,  0.5002,  0.4840,  0.5018,  0.4981,  0.5024,
         0.4838,  0.4905,  0.5017,  0.4860,  0.4900,  0.4917,  0.5059,
         0.4990,  0.5005,  0.5008,  0.4956,  0.4951,  0.5126,  0.4945,
         0.4896,  0.4877,  0.4918,  0.4868,  0.5094,  0.4849,  0.5015,
         0.4897,  0.4873,  0.5081,  0.4865,  0.4918,  0.4973,  0.4976,
         0.4958,  0.4974,  0.4778,  0.4923,  0.5048,  0.4882,  0.4994,
         0.4903,  0.5070,  0.5172,  0.4981,  0.4894,  0.4980,  0.4829,
         0.4992,  0.4810,  0.4903,  0.5054,  0.4897,  0.4949,  0.4877,
         0.4891,  0.4914,  0.5096,  0.4890,  0.4894,  0.4884,  0.4898,
         0.4965,  0.4840,  0.5073,  0.5114,  0.4918,  0.5013,  0.4821,
         0.4967,  0.4905,  0.4990,  0.5041,  0.4674,  0.5041,  0.4951,
         0.4959,  0.4790,  0.4805,  0.4937,  0.4859,  0.4922,  0.4984,
         0.4888,  0.5007,  0.4704,  0.5022,  0.4957,  0.5016,  0.4880,
         0.4884,  0.4827,  0.4865,  0.4793,  0.5011,  0.5175,  0.4922,
         0.4903,  0.4810,  0.4808,  0.5084,  0.4995,  0.4815,  0.4901,
         0.4860,  0.5114,  0.4839,  0.5002,  0.4948,  0.4813,  0.4838,
         0.4935], device='cuda:0')
tensor(0.6922, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5009,  0.5302,  0.4977,  0.5218,  0.5090,  0.4977,  0.4971,
         0.4815,  0.4893,  0.4837,  0.4898,  0.4821,  0.4880,  0.4988,
         0.4822,  0.5028,  0.5013,  0.4867,  0.5012,  0.4950,  0.4781,
         0.4925,  0.5117,  0.5069,  0.5098,  0.4927,  0.5185,  0.5043,
         0.4738,  0.4696,  0.4939,  0.5062,  0.4767,  0.5187,  0.5205,
         0.5020,  0.4869,  0.4756,  0.4943,  0.5055,  0.4932,  0.4818,
         0.5037,  0.5120,  0.4700,  0.5105,  0.4802,  0.4904,  0.4716,
         0.5218,  0.4980,  0.5173,  0.4847,  0.4993,  0.4745,  0.4815,
         0.4897,  0.4982,  0.4995,  0.5029,  0.4840,  0.4945,  0.5095,
         0.4980,  0.4812,  0.4938,  0.5005,  0.4987,  0.4867,  0.4721,
         0.5197,  0.4869,  0.4921,  0.4865,  0.4957,  0.5088,  0.4992,
         0.5028,  0.4888,  0.4832,  0.4882,  0.4994,  0.4808,  0.4927,
         0.5018,  0.4892,  0.5122,  0.5135,  0.4938,  0.4960,  0.5091,
         0.4944,  0.4975,  0.4849,  0.4775,  0.4927,  0.4982,  0.4794,
         0.4883,  0.4945,  0.4869,  0.5015,  0.4837,  0.5237,  0.4960,
         0.4899,  0.4963,  0.4959,  0.4911,  0.4765,  0.4823,  0.5024,
         0.4746,  0.5141,  0.4871,  0.4883,  0.5063,  0.4953,  0.5040,
         0.4820,  0.4905,  0.4893,  0.5061,  0.5024,  0.5076,  0.5000,
         0.5047,  0.5002,  0.5067,  0.4889,  0.5257,  0.5083,  0.5014,
         0.5005,  0.4721,  0.4869,  0.4995,  0.5001,  0.5156,  0.4851,
         0.5147,  0.5072,  0.4829,  0.5151,  0.4947,  0.4834,  0.4852,
         0.4887,  0.5099,  0.4990,  0.5003,  0.4941,  0.4842,  0.4818,
         0.5156,  0.4744,  0.4728,  0.4811,  0.4851,  0.4884,  0.4792,
         0.4965,  0.4796,  0.4851,  0.4747,  0.5121,  0.4681,  0.5008,
         0.5033,  0.4716,  0.4971,  0.4819,  0.4858,  0.5070,  0.5090,
         0.5004,  0.5275,  0.4824,  0.4925,  0.4908,  0.4816,  0.4983,
         0.5097,  0.4971,  0.5145,  0.4972,  0.5022,  0.4869,  0.5092,
         0.4847,  0.5109,  0.4757,  0.4921,  0.4795,  0.4837,  0.4837,
         0.4879,  0.4833,  0.5087,  0.5028,  0.4975,  0.4796,  0.4920,
         0.5021,  0.5094,  0.5002,  0.5038,  0.4762,  0.5053,  0.5015,
         0.4996,  0.4782,  0.5122,  0.5155,  0.5198,  0.4928,  0.4845,
         0.4921,  0.4844,  0.4873,  0.5050,  0.5050,  0.5128,  0.5003,
         0.4828,  0.5100,  0.5096,  0.4882,  0.5141,  0.4759,  0.4926,
         0.4897,  0.4796,  0.4797,  0.5143,  0.4923,  0.5281,  0.4764,
         0.4940,  0.4788,  0.5074,  0.5028,  0.4858,  0.5076,  0.4866,
         0.4995,  0.4837,  0.5043,  0.4909,  0.4986,  0.4862,  0.4792,
         0.4953,  0.4980,  0.4898,  0.5111,  0.5073,  0.4929,  0.5015,
         0.4926,  0.5055,  0.4874,  0.4968,  0.5081,  0.4945,  0.4749,
         0.4907,  0.4942,  0.5076,  0.4965,  0.4857,  0.4939,  0.4866,
         0.4937,  0.5082,  0.5076,  0.4895,  0.4881,  0.4951,  0.5092,
         0.5201,  0.4973,  0.4994,  0.4974,  0.4976,  0.5060,  0.4943,
         0.4892,  0.4923,  0.4950,  0.4946,  0.4816,  0.4834,  0.4932,
         0.4827,  0.4772,  0.5049,  0.4915,  0.4790,  0.4915,  0.5161,
         0.5031,  0.5066,  0.5329,  0.4935,  0.4883,  0.4898,  0.4901,
         0.4829,  0.4989,  0.5174,  0.4902,  0.5048,  0.5023,  0.5061,
         0.4888,  0.5008,  0.5073,  0.5053,  0.4886,  0.4852,  0.5145,
         0.4979,  0.4889,  0.4790,  0.4963,  0.4972,  0.4946,  0.4906,
         0.5183,  0.4923,  0.5148,  0.4810,  0.4953,  0.4771,  0.4865,
         0.4867,  0.4985,  0.5248,  0.5087,  0.4903,  0.4884,  0.4976,
         0.5060,  0.4901,  0.4869,  0.4801,  0.5110,  0.4899,  0.5098,
         0.4963,  0.5249,  0.4876,  0.4842,  0.4718,  0.5129,  0.4774,
         0.4812,  0.4823,  0.5049,  0.5150,  0.5294,  0.4916,  0.4996,
         0.5091,  0.4864,  0.4878,  0.4849,  0.5051,  0.4988,  0.4836,
         0.5201,  0.4978,  0.4889,  0.5018,  0.4707,  0.4846,  0.4944,
         0.5031,  0.5333,  0.4723,  0.4960,  0.5295,  0.5316,  0.5040,
         0.4953,  0.5042,  0.4899,  0.4848,  0.5225,  0.5055,  0.5124,
         0.4987,  0.5057,  0.4979,  0.4918,  0.4948,  0.4953,  0.4792,
         0.5019,  0.4909,  0.4948,  0.5016,  0.4946,  0.5090,  0.5077,
         0.4893,  0.5019,  0.4873,  0.4953,  0.5084,  0.4828,  0.4769,
         0.4852,  0.5002,  0.5064,  0.5078,  0.4994,  0.5029,  0.4924,
         0.4953,  0.4842,  0.5069,  0.5021,  0.4896,  0.4942,  0.5083,
         0.4984,  0.4964,  0.5051,  0.4972,  0.5035,  0.4704,  0.4863,
         0.4793,  0.4863,  0.4872,  0.4794,  0.4903,  0.5059,  0.4801,
         0.4881,  0.5074,  0.4927,  0.4736,  0.5076,  0.5057,  0.4835,
         0.4798,  0.5086,  0.4977,  0.5040,  0.4975,  0.5045,  0.4925,
         0.4942,  0.4975,  0.4833,  0.4892,  0.4910,  0.5173,  0.4928,
         0.5053,  0.4895,  0.5076,  0.4798,  0.4951,  0.5015,  0.5036,
         0.4830,  0.4718,  0.5048,  0.4786,  0.5144,  0.5054,  0.5070,
         0.5088,  0.4866,  0.4791,  0.4962,  0.5107,  0.5206,  0.4957,
         0.4941,  0.4807,  0.5175,  0.4768,  0.4846,  0.5034,  0.5033,
         0.4962,  0.4922,  0.4832,  0.4791,  0.5153,  0.4788,  0.5046,
         0.5158,  0.4947,  0.4821,  0.4888,  0.4968,  0.5021,  0.4832,
         0.4819,  0.4961,  0.5233,  0.4826,  0.4846,  0.5050,  0.5204,
         0.5107], device='cuda:0')
tensor(0.6933, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4864,  0.4861,  0.5165,  0.5017,  0.5076,  0.5100,  0.4968,
         0.4921,  0.5106,  0.4961,  0.4984,  0.5376,  0.4843,  0.4917,
         0.4952,  0.5074,  0.5058,  0.5077,  0.5139,  0.4964,  0.4951,
         0.4978,  0.4816,  0.5046,  0.4936,  0.5101,  0.4869,  0.5214,
         0.5019,  0.5109,  0.4987,  0.4867,  0.4721,  0.5144,  0.5388,
         0.5077,  0.5055,  0.5153,  0.5077,  0.5061,  0.4938,  0.5036,
         0.5132,  0.5019,  0.4946,  0.5279,  0.4769,  0.4983,  0.4886,
         0.4905,  0.4912,  0.5054,  0.4890,  0.5119,  0.4872,  0.4879,
         0.5120,  0.4885,  0.4887,  0.4819,  0.5109,  0.5058,  0.5394,
         0.4963,  0.5045,  0.4876,  0.5172,  0.5117,  0.4853,  0.5441,
         0.5030,  0.4987,  0.4928,  0.5004,  0.4847,  0.5049,  0.4667,
         0.4868,  0.4794,  0.4971,  0.5102,  0.4898,  0.4881,  0.4932,
         0.5126,  0.4800,  0.5038,  0.5075,  0.5012,  0.4870,  0.4916,
         0.5137,  0.4848,  0.4956,  0.4993,  0.5070,  0.5011,  0.5081,
         0.5181,  0.5047,  0.4834,  0.4920,  0.5126,  0.5056,  0.5271,
         0.4916,  0.5064,  0.4806,  0.5063,  0.5083,  0.5030,  0.5252,
         0.5004,  0.5134,  0.4918,  0.4911,  0.4831,  0.5033,  0.4893,
         0.4835,  0.4844,  0.5127,  0.5057,  0.5041,  0.4946,  0.4854,
         0.5135,  0.5077,  0.5021,  0.5104,  0.4862,  0.4724,  0.4997,
         0.4779,  0.4957,  0.4829,  0.4975,  0.5022,  0.5000,  0.4801,
         0.5006,  0.4928,  0.5096,  0.4776,  0.5051,  0.5135,  0.4794,
         0.5170,  0.5148,  0.5277,  0.5288,  0.4908,  0.5081,  0.4981,
         0.4977,  0.5101,  0.5028,  0.5062,  0.4915,  0.4973,  0.4989,
         0.5285,  0.4789,  0.4830,  0.4862,  0.4781,  0.4875,  0.5120,
         0.5039,  0.5079,  0.4962,  0.4890,  0.5220,  0.4825,  0.4708,
         0.4871,  0.4732,  0.4991,  0.4983,  0.5314,  0.5108,  0.5262,
         0.5124,  0.4871,  0.5330,  0.4880,  0.4684,  0.4992,  0.4852,
         0.5008,  0.4960,  0.4984,  0.5193,  0.4878,  0.5054,  0.5124,
         0.4916,  0.4888,  0.5148,  0.4994,  0.4989,  0.4898,  0.5198,
         0.5350,  0.4844,  0.5163,  0.5162,  0.5040,  0.5064,  0.4908,
         0.5134,  0.4982,  0.5063,  0.4949,  0.4991,  0.4969,  0.5053,
         0.5137,  0.5088,  0.4925,  0.4849,  0.5198,  0.5092,  0.4811,
         0.4829,  0.4970,  0.4819,  0.5100,  0.4939,  0.4966,  0.5300,
         0.4857,  0.5062,  0.4879,  0.4975,  0.4861,  0.4970,  0.4865,
         0.4960,  0.5127,  0.4897,  0.5361,  0.4985,  0.4819,  0.5094,
         0.4991,  0.4889,  0.4956,  0.5139,  0.5048,  0.5082,  0.5017,
         0.4882,  0.4813,  0.4804,  0.5105,  0.5121,  0.5001,  0.4866,
         0.4895,  0.4988,  0.5110,  0.4943,  0.5140,  0.4998,  0.4810,
         0.4818,  0.4904,  0.4788,  0.5089,  0.4844,  0.4849,  0.5211,
         0.4901,  0.5023,  0.5002,  0.4949,  0.5028,  0.4984,  0.4979,
         0.4937,  0.5387,  0.5094,  0.4894,  0.5052,  0.5094,  0.4924,
         0.5151,  0.5007,  0.4753,  0.4826,  0.5011,  0.4904,  0.5098,
         0.4850,  0.4906,  0.4934,  0.4935,  0.4837,  0.4803,  0.5087,
         0.4942,  0.4767,  0.5034,  0.4860,  0.5046,  0.4984,  0.4775,
         0.5042,  0.4936,  0.5134,  0.5102,  0.5067,  0.5013,  0.5216,
         0.5031,  0.4925,  0.4972,  0.4993,  0.4794,  0.5087,  0.5136,
         0.5009,  0.5002,  0.4694,  0.4876,  0.4993,  0.4987,  0.5135,
         0.4954,  0.5109,  0.4943,  0.4901,  0.4966,  0.4984,  0.5049,
         0.4878,  0.4986,  0.4971,  0.4908,  0.5507,  0.5109,  0.4918,
         0.4773,  0.4840,  0.5076,  0.5112,  0.4701,  0.4830,  0.4829,
         0.5040,  0.4897,  0.5020,  0.4829,  0.5065,  0.4899,  0.5032,
         0.4736,  0.5017,  0.5415,  0.5095,  0.4747,  0.5002,  0.5054,
         0.5183,  0.4960,  0.5048,  0.5353,  0.5017,  0.4868,  0.4840,
         0.4931,  0.5022,  0.5070,  0.5003,  0.4844,  0.4918,  0.5109,
         0.5007,  0.4923,  0.5375,  0.5023,  0.4951,  0.5002,  0.5232,
         0.4722,  0.5054,  0.4770,  0.5071,  0.5056,  0.4995,  0.5227,
         0.4900,  0.4848,  0.4948,  0.4842,  0.4842,  0.5044,  0.4769,
         0.5248,  0.4903,  0.5067,  0.4873,  0.5087,  0.4886,  0.5088,
         0.5106,  0.4742,  0.4980,  0.4993,  0.4992,  0.4772,  0.5112,
         0.5080,  0.4883,  0.4779,  0.5369,  0.4930,  0.4861,  0.4969,
         0.4911,  0.5034,  0.5012,  0.4864,  0.4899,  0.5013,  0.5110,
         0.5058,  0.5088,  0.5039,  0.4984,  0.4913,  0.5000,  0.5128,
         0.5056,  0.4851,  0.4935,  0.5066,  0.4980,  0.4892,  0.4948,
         0.5114,  0.5020,  0.5086,  0.5040,  0.5013,  0.5033,  0.4995,
         0.5004,  0.5398,  0.4862,  0.4929,  0.4829,  0.5057,  0.4926,
         0.4947,  0.4797,  0.4829,  0.4898,  0.5148,  0.4907,  0.4990,
         0.5273,  0.5102,  0.5060,  0.5123,  0.4822,  0.4864,  0.4792,
         0.4839,  0.4808,  0.4858,  0.4953,  0.4792,  0.4793,  0.4947,
         0.4979,  0.4999,  0.5069,  0.4964,  0.5450,  0.4937,  0.5172,
         0.5069,  0.5102,  0.5032,  0.4924,  0.5043,  0.4891,  0.4928,
         0.5205,  0.5044,  0.4826,  0.5394,  0.4914,  0.5016,  0.4855,
         0.5050,  0.4935,  0.4966,  0.4701,  0.5219,  0.4925,  0.4854,
         0.4880,  0.4890,  0.4879,  0.4722,  0.5093,  0.5137,  0.4872,
         0.5105], device='cuda:0')
tensor(0.6934, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4853,  0.4961,  0.4854,  0.5083,  0.4910,  0.4892,  0.5168,
         0.5013,  0.5126,  0.4875,  0.4972,  0.4809,  0.4957,  0.4908,
         0.4983,  0.5051,  0.5267,  0.5017,  0.4962,  0.5062,  0.4822,
         0.5413,  0.5020,  0.4927,  0.5029,  0.5176,  0.5033,  0.4998,
         0.4892,  0.5016,  0.4825,  0.4886,  0.4965,  0.5486,  0.5082,
         0.5173,  0.4901,  0.4986,  0.4943,  0.4908,  0.5109,  0.4966,
         0.4974,  0.4796,  0.5195,  0.4807,  0.4868,  0.4899,  0.5053,
         0.4812,  0.4858,  0.4986,  0.4765,  0.4922,  0.4821,  0.5153,
         0.4977,  0.5075,  0.5040,  0.4828,  0.4740,  0.4860,  0.5416,
         0.4878,  0.4875,  0.4896,  0.4966,  0.5018,  0.5032,  0.4884,
         0.4926,  0.5011,  0.5240,  0.5251,  0.4829,  0.5052,  0.4876,
         0.4894,  0.4759,  0.5082,  0.5302,  0.4910,  0.5019,  0.5053,
         0.4986,  0.5015,  0.4842,  0.4906,  0.5061,  0.5325,  0.5079,
         0.4963,  0.5107,  0.4871,  0.5018,  0.4910,  0.5044,  0.4820,
         0.5078,  0.4912,  0.5082,  0.5656,  0.5062,  0.4956,  0.5091,
         0.5437,  0.4938,  0.5057,  0.4865,  0.4855,  0.4853,  0.4685,
         0.4925,  0.4825,  0.4830,  0.4843,  0.5329,  0.4970,  0.5414,
         0.5085,  0.5673,  0.5034,  0.5091,  0.4932,  0.5137,  0.5009,
         0.5057,  0.5232,  0.5025,  0.4993,  0.4809,  0.5061,  0.5064,
         0.5129,  0.4820,  0.5413,  0.4848,  0.5052,  0.5157,  0.5014,
         0.5047,  0.4978,  0.4993,  0.4968,  0.5196,  0.4695,  0.4878,
         0.5178,  0.4930,  0.4893,  0.4933,  0.5023,  0.4841,  0.4828,
         0.4944,  0.4853,  0.5208,  0.5140,  0.5112,  0.5043,  0.5025,
         0.4887,  0.5003,  0.5135,  0.4777,  0.4909,  0.5308,  0.4989,
         0.5068,  0.5011,  0.4860,  0.4795,  0.4897,  0.4906,  0.5061,
         0.4937,  0.4752,  0.4887,  0.4956,  0.4844,  0.4877,  0.4790,
         0.4967,  0.4948,  0.4939,  0.4928,  0.5073,  0.4966,  0.5007,
         0.5201,  0.5302,  0.4874,  0.4874,  0.4796,  0.5136,  0.5148,
         0.4984,  0.5411,  0.5051,  0.4737,  0.4587,  0.5075,  0.5041,
         0.5022,  0.4990,  0.4917,  0.4920,  0.5183,  0.4633,  0.4948,
         0.4962,  0.5080,  0.4877,  0.4975,  0.4737,  0.5490,  0.4854,
         0.4914,  0.4813,  0.4983,  0.5108,  0.5424,  0.4832,  0.4881,
         0.4839,  0.4950,  0.4973,  0.4907,  0.5020,  0.4946,  0.4908,
         0.4910,  0.5169,  0.4877,  0.5141,  0.5046,  0.5059,  0.4929,
         0.4747,  0.5145,  0.5182,  0.5168,  0.4944,  0.4983,  0.5110,
         0.5077,  0.5153,  0.5086,  0.5215,  0.4851,  0.4964,  0.4789,
         0.4812,  0.4754,  0.4985,  0.5041,  0.5215,  0.4878,  0.4974,
         0.5054,  0.4804,  0.5073,  0.4756,  0.4837,  0.5023,  0.5402,
         0.4796,  0.4867,  0.4912,  0.5021,  0.4872,  0.4872,  0.5176,
         0.5086,  0.4960,  0.5190,  0.4860,  0.5043,  0.5129,  0.4938,
         0.4802,  0.5185,  0.4808,  0.4838,  0.4785,  0.5000,  0.4914,
         0.4803,  0.4986,  0.5119,  0.4960,  0.4990,  0.4943,  0.4898,
         0.5052,  0.4873,  0.4832,  0.4960,  0.5051,  0.4955,  0.5082,
         0.4940,  0.5066,  0.4974,  0.5412,  0.4991,  0.5041,  0.4899,
         0.5075,  0.5014,  0.5062,  0.5251,  0.4971,  0.4875,  0.4824,
         0.4959,  0.5172,  0.5135,  0.4828,  0.4778,  0.5310,  0.4991,
         0.4831,  0.4891,  0.5038,  0.4983,  0.4799,  0.4817,  0.4924,
         0.4912,  0.4922,  0.5157,  0.4983,  0.5133,  0.4949,  0.5050,
         0.5426,  0.5087,  0.4823,  0.5087,  0.4819,  0.4872,  0.4980,
         0.4806,  0.5116,  0.5046,  0.5579,  0.5122,  0.4887,  0.4912,
         0.5097,  0.4983,  0.4887,  0.4897,  0.4885,  0.4939,  0.5079,
         0.4953,  0.4915,  0.5162,  0.5094,  0.5023,  0.5191,  0.4911,
         0.4899,  0.5172,  0.5052,  0.4906,  0.4908,  0.4887,  0.4875,
         0.5088,  0.4860,  0.4856,  0.5355,  0.5031,  0.4930,  0.5035,
         0.5015,  0.5051,  0.4780,  0.5426,  0.4989,  0.5066,  0.5008,
         0.4886,  0.5121,  0.5017,  0.5083,  0.4820,  0.5245,  0.4898,
         0.5104,  0.5346,  0.5045,  0.4929,  0.4863,  0.4853,  0.5426,
         0.5176,  0.4979,  0.5385,  0.4876,  0.5034,  0.5099,  0.4978,
         0.4798,  0.4974,  0.5052,  0.5055,  0.5114,  0.4889,  0.4981,
         0.4854,  0.5178,  0.5002,  0.5185,  0.5327,  0.5102,  0.4859,
         0.5116,  0.4980,  0.4893,  0.5407,  0.5233,  0.5038,  0.4939,
         0.5071,  0.4913,  0.5248,  0.5090,  0.4912,  0.4706,  0.4926,
         0.4775,  0.5123,  0.4961,  0.5400,  0.4887,  0.5117,  0.4885,
         0.4845,  0.5351,  0.4932,  0.4997,  0.5105,  0.5027,  0.4772,
         0.5104,  0.5256,  0.4800,  0.5194,  0.4887,  0.5029,  0.5059,
         0.4940,  0.5112,  0.4777,  0.4843,  0.4997,  0.5068,  0.4851,
         0.4989,  0.4950,  0.4986,  0.4857,  0.4913,  0.4885,  0.5074,
         0.5043,  0.4778,  0.4944,  0.5007,  0.4975,  0.4748,  0.5248,
         0.5218,  0.4909,  0.4815,  0.4812,  0.4862,  0.4816,  0.5042,
         0.4802,  0.5034,  0.5051,  0.4849,  0.5056,  0.5071,  0.5246,
         0.4752,  0.5240,  0.4787,  0.4835,  0.5134,  0.5256,  0.4832,
         0.4902,  0.4853,  0.4966,  0.4949,  0.5008,  0.5086,  0.4934,
         0.4875,  0.5135,  0.4961,  0.4852,  0.5120,  0.4883,  0.5171,
         0.4954], device='cuda:0')
tensor(0.6919, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4856,  0.4754,  0.4904,  0.4911,  0.4951,  0.4810,  0.4958,
         0.4752,  0.4596,  0.5038,  0.4990,  0.4864,  0.5023,  0.4999,
         0.4853,  0.4902,  0.5115,  0.4749,  0.4966,  0.5054,  0.4892,
         0.5032,  0.4757,  0.4884,  0.5059,  0.5033,  0.4826,  0.4787,
         0.5065,  0.5067,  0.4929,  0.5154,  0.5011,  0.4973,  0.4948,
         0.4938,  0.5034,  0.4891,  0.4995,  0.5170,  0.5201,  0.4994,
         0.5188,  0.4958,  0.4692,  0.5588,  0.5082,  0.4685,  0.5232,
         0.4721,  0.5079,  0.5110,  0.5168,  0.4856,  0.4907,  0.5027,
         0.4989,  0.4802,  0.4703,  0.5084,  0.4853,  0.5236,  0.5055,
         0.4898,  0.5477,  0.5095,  0.4842,  0.4824,  0.5024,  0.5067,
         0.4676,  0.4876,  0.5117,  0.5718,  0.5143,  0.5086,  0.5512,
         0.4849,  0.4778,  0.4884,  0.4902,  0.5191,  0.4879,  0.5036,
         0.5055,  0.5227,  0.4744,  0.4961,  0.5032,  0.4830,  0.4862,
         0.4834,  0.4819,  0.4955,  0.4821,  0.5131,  0.4969,  0.4816,
         0.4980,  0.4739,  0.4994,  0.5104,  0.5472,  0.4852,  0.5144,
         0.4959,  0.4717,  0.4946,  0.4966,  0.4848,  0.4962,  0.4934,
         0.5139,  0.5115,  0.4798,  0.5106,  0.4892,  0.5119,  0.4982,
         0.4888,  0.5043,  0.4813,  0.5030,  0.4851,  0.5161,  0.5018,
         0.4848,  0.5012,  0.4855,  0.5256,  0.4676,  0.5069,  0.4990,
         0.5042,  0.4930,  0.4978,  0.4834,  0.5317,  0.4713,  0.4890,
         0.5034,  0.4890,  0.4945,  0.4893,  0.5210,  0.4991,  0.4929,
         0.5142,  0.5190,  0.4973,  0.4946,  0.5006,  0.5016,  0.5053,
         0.5062,  0.4968,  0.5138,  0.4647,  0.4936,  0.4923,  0.4818,
         0.4902,  0.5060,  0.4930,  0.4863,  0.4802,  0.4745,  0.5524,
         0.5223,  0.4986,  0.5091,  0.4817,  0.5245,  0.4965,  0.4548,
         0.5227,  0.4971,  0.5085,  0.4963,  0.4725,  0.4949,  0.4995,
         0.5002,  0.5047,  0.4804,  0.4748,  0.4835,  0.4863,  0.4933,
         0.4785,  0.5091,  0.5221,  0.5080,  0.4898,  0.4868,  0.5071,
         0.4890,  0.4993,  0.5033,  0.5051,  0.4799,  0.4923,  0.5113,
         0.5190,  0.4982,  0.5022,  0.5055,  0.4801,  0.4874,  0.5265,
         0.5073,  0.5129,  0.4755,  0.4962,  0.4823,  0.4886,  0.4739,
         0.4880,  0.4873,  0.5525,  0.4866,  0.5042,  0.4833,  0.5016,
         0.4821,  0.4974,  0.4776,  0.4989,  0.4897,  0.5055,  0.4847,
         0.4867,  0.5119,  0.4786,  0.4680,  0.4875,  0.4897,  0.4931,
         0.4708,  0.4918,  0.4910,  0.5037,  0.4804,  0.4855,  0.5236,
         0.5163,  0.4831,  0.4819,  0.5346,  0.5048,  0.4917,  0.4973,
         0.4985,  0.4931,  0.5107,  0.4835,  0.5045,  0.4971,  0.4966,
         0.4821,  0.4778,  0.5336,  0.4713,  0.5134,  0.5007,  0.5631,
         0.4842,  0.4813,  0.5133,  0.4820,  0.4837,  0.5205,  0.5261,
         0.5043,  0.4941,  0.4939,  0.5013,  0.5529,  0.5485,  0.4772,
         0.5001,  0.5182,  0.4910,  0.4908,  0.5080,  0.4996,  0.4927,
         0.4863,  0.4863,  0.5161,  0.5073,  0.4760,  0.4775,  0.4764,
         0.4960,  0.4884,  0.5088,  0.4925,  0.5268,  0.4834,  0.5122,
         0.5109,  0.4881,  0.5446,  0.5102,  0.4920,  0.5015,  0.5110,
         0.5308,  0.5008,  0.4853,  0.5016,  0.4854,  0.4678,  0.5067,
         0.4753,  0.4832,  0.4854,  0.4767,  0.4886,  0.4980,  0.5499,
         0.4822,  0.5015,  0.4879,  0.5031,  0.4940,  0.4797,  0.4827,
         0.4882,  0.4948,  0.5147,  0.4918,  0.4772,  0.5050,  0.4806,
         0.4803,  0.5076,  0.5180,  0.5047,  0.5119,  0.5189,  0.5021,
         0.5778,  0.4720,  0.4837,  0.4849,  0.4729,  0.5150,  0.5062,
         0.5588,  0.4818,  0.5051,  0.4988,  0.4848,  0.5175,  0.5038,
         0.4787,  0.5006,  0.4940,  0.5039,  0.4995,  0.4923,  0.4944,
         0.5084,  0.5453,  0.4976,  0.4714,  0.4898,  0.4984,  0.4806,
         0.4964,  0.4946,  0.4932,  0.5183,  0.5020,  0.5046,  0.4792,
         0.4940,  0.4833,  0.4859,  0.4737,  0.5152,  0.5147,  0.4700,
         0.5475,  0.5147,  0.5079,  0.4878,  0.5162,  0.4985,  0.5013,
         0.5017,  0.5149,  0.4931,  0.5079,  0.5026,  0.4916,  0.4984,
         0.4812,  0.5069,  0.4908,  0.5098,  0.5085,  0.5147,  0.5198,
         0.4985,  0.4822,  0.5120,  0.4952,  0.5210,  0.5105,  0.5235,
         0.5135,  0.4904,  0.5170,  0.5073,  0.4793,  0.4936,  0.5181,
         0.5026,  0.4939,  0.4814,  0.5007,  0.4923,  0.4597,  0.4986,
         0.4912,  0.5284,  0.4849,  0.5130,  0.4972,  0.4769,  0.4789,
         0.5100,  0.4906,  0.4844,  0.5154,  0.4881,  0.4889,  0.5440,
         0.5052,  0.4744,  0.4874,  0.4843,  0.5009,  0.5047,  0.5561,
         0.5177,  0.5100,  0.4825,  0.4849,  0.5166,  0.5201,  0.5001,
         0.4997,  0.4882,  0.5201,  0.5066,  0.4960,  0.4858,  0.4862,
         0.4889,  0.4798,  0.4818,  0.4893,  0.4916,  0.5097,  0.4729,
         0.5010,  0.4773,  0.4821,  0.5227,  0.4778,  0.5011,  0.5196,
         0.4764,  0.4877,  0.4817,  0.5144,  0.5000,  0.4846,  0.5172,
         0.4778,  0.5071,  0.4921,  0.4878,  0.4971,  0.4913,  0.4900,
         0.4881,  0.5064,  0.5025,  0.4868,  0.4953,  0.5089,  0.4737,
         0.4605,  0.4749,  0.5161,  0.5095,  0.5073,  0.4850,  0.5602,
         0.5106,  0.5028,  0.4862,  0.4986,  0.5330,  0.4834,  0.5057,
         0.4972], device='cuda:0')
tensor(0.6905, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5426,  0.5011,  0.4907,  0.4810,  0.5842,  0.5801,  0.4941,
         0.4994,  0.4733,  0.4994,  0.4943,  0.5215,  0.5054,  0.4981,
         0.4739,  0.4964,  0.4993,  0.5068,  0.4975,  0.5112,  0.4876,
         0.5273,  0.4901,  0.4867,  0.5298,  0.5203,  0.5146,  0.4901,
         0.4933,  0.4967,  0.4860,  0.4908,  0.5051,  0.4784,  0.5068,
         0.4753,  0.5183,  0.4737,  0.4874,  0.4796,  0.4729,  0.4806,
         0.4940,  0.5234,  0.5047,  0.4813,  0.5179,  0.4986,  0.4990,
         0.4846,  0.4916,  0.4838,  0.5011,  0.4487,  0.5073,  0.5082,
         0.4744,  0.4916,  0.4797,  0.4910,  0.4823,  0.5092,  0.4698,
         0.4750,  0.4921,  0.4883,  0.4793,  0.4854,  0.5006,  0.4756,
         0.4676,  0.5128,  0.4850,  0.5084,  0.5036,  0.4706,  0.5061,
         0.4859,  0.5140,  0.4558,  0.4647,  0.4622,  0.5129,  0.5135,
         0.4893,  0.4925,  0.4915,  0.4811,  0.4849,  0.4941,  0.5129,
         0.5201,  0.5014,  0.4928,  0.4812,  0.5040,  0.5095,  0.5170,
         0.5084,  0.5403,  0.4957,  0.5033,  0.4670,  0.5773,  0.5582,
         0.5012,  0.4704,  0.5163,  0.5216,  0.4864,  0.4678,  0.5016,
         0.4615,  0.4748,  0.5036,  0.5031,  0.4740,  0.4838,  0.5002,
         0.4823,  0.5357,  0.5074,  0.4808,  0.4857,  0.4633,  0.5833,
         0.4972,  0.4785,  0.5076,  0.4926,  0.5257,  0.4889,  0.5271,
         0.5101,  0.4604,  0.4841,  0.4983,  0.5169,  0.4875,  0.4994,
         0.5212,  0.4814,  0.5061,  0.5213,  0.5536,  0.4982,  0.4835,
         0.4834,  0.5085,  0.4969,  0.4804,  0.4989,  0.4895,  0.5080,
         0.5009,  0.4704,  0.5065,  0.4864,  0.4960,  0.5615,  0.4899,
         0.4892,  0.4930,  0.4968,  0.5054,  0.4925,  0.4822,  0.4889,
         0.4698,  0.4994,  0.5091,  0.4760,  0.5563,  0.5049,  0.5080,
         0.5137,  0.5244,  0.4773,  0.4931,  0.5176,  0.4876,  0.4771,
         0.4983,  0.5176,  0.4988,  0.4979,  0.4914,  0.4744,  0.4957,
         0.4871,  0.4996,  0.5233,  0.5086,  0.4870,  0.5025,  0.5117,
         0.5172,  0.4847,  0.4850,  0.5606,  0.5086,  0.4774,  0.5199,
         0.5454,  0.4809,  0.5014,  0.4844,  0.5542,  0.4899,  0.4906,
         0.4940,  0.5459,  0.5458,  0.4663,  0.4659,  0.5062,  0.5086,
         0.4648,  0.5030,  0.4911,  0.5201,  0.5489,  0.5017,  0.4842,
         0.4819,  0.4776,  0.4730,  0.4998,  0.5030,  0.5057,  0.4899,
         0.4983,  0.4886,  0.5106,  0.4989,  0.4985,  0.4894,  0.5148,
         0.5220,  0.4790,  0.4878,  0.4838,  0.4807,  0.4956,  0.4906,
         0.4874,  0.4847,  0.4878,  0.5231,  0.5149,  0.5180,  0.4864,
         0.5217,  0.4951,  0.5215,  0.5226,  0.4871,  0.5208,  0.5053,
         0.5097,  0.4998,  0.5075,  0.5095,  0.5312,  0.4514,  0.4504,
         0.5210,  0.4992,  0.5183,  0.5048,  0.4830,  0.4684,  0.4967,
         0.4691,  0.4949,  0.5044,  0.4693,  0.4843,  0.4886,  0.4970,
         0.5265,  0.5180,  0.5031,  0.4853,  0.5498,  0.4727,  0.4882,
         0.4929,  0.4893,  0.5010,  0.5182,  0.5231,  0.5284,  0.5043,
         0.4954,  0.4953,  0.5021,  0.4717,  0.5486,  0.4950,  0.5173,
         0.5015,  0.4861,  0.4731,  0.4902,  0.5088,  0.4979,  0.5317,
         0.5088,  0.5036,  0.5113,  0.4821,  0.4547,  0.4895,  0.4797,
         0.4893,  0.4820,  0.4823,  0.5045,  0.4923,  0.5301,  0.5116,
         0.4931,  0.5104,  0.4905,  0.5027,  0.5313,  0.4978,  0.4704,
         0.5014,  0.4733,  0.4932,  0.4758,  0.5008,  0.4991,  0.5488,
         0.4923,  0.5027,  0.4676,  0.5163,  0.5276,  0.5094,  0.4819,
         0.4926,  0.4777,  0.5187,  0.4855,  0.4790,  0.5022,  0.5037,
         0.4752,  0.5141,  0.5172,  0.5162,  0.4745,  0.5242,  0.5036,
         0.4766,  0.4675,  0.4908,  0.5106,  0.5093,  0.4828,  0.4958,
         0.5181,  0.4752,  0.5249,  0.5077,  0.5078,  0.4889,  0.4806,
         0.5150,  0.4811,  0.5143,  0.4979,  0.4688,  0.5010,  0.5039,
         0.5055,  0.4756,  0.4987,  0.4921,  0.4915,  0.4883,  0.5532,
         0.4911,  0.4818,  0.4791,  0.5223,  0.5039,  0.4950,  0.4903,
         0.5101,  0.4938,  0.5001,  0.5003,  0.5113,  0.5121,  0.4664,
         0.5308,  0.4709,  0.4691,  0.4660,  0.4978,  0.4740,  0.4961,
         0.4915,  0.4735,  0.5004,  0.4752,  0.5145,  0.5114,  0.4770,
         0.4726,  0.4784,  0.4654,  0.5115,  0.4866,  0.5035,  0.4936,
         0.4990,  0.4846,  0.5568,  0.4758,  0.4724,  0.4957,  0.5330,
         0.5139,  0.5301,  0.5023,  0.5112,  0.5076,  0.4839,  0.4872,
         0.4782,  0.5073,  0.4863,  0.5019,  0.5433,  0.5005,  0.5211,
         0.4939,  0.4883,  0.4770,  0.4807,  0.4993,  0.4657,  0.4952,
         0.4728,  0.5012,  0.5077,  0.5166,  0.5097,  0.5052,  0.4993,
         0.5060,  0.5526,  0.5014,  0.5120,  0.5139,  0.4962,  0.5892,
         0.4973,  0.4923,  0.4962,  0.4914,  0.4807,  0.4961,  0.5060,
         0.4957,  0.4877,  0.4807,  0.5274,  0.5133,  0.5051,  0.4892,
         0.5101,  0.5517,  0.5232,  0.4690,  0.4898,  0.4941,  0.5172,
         0.4870,  0.4965,  0.4887,  0.5077,  0.4870,  0.5237,  0.5203,
         0.4946,  0.4723,  0.4672,  0.4870,  0.4996,  0.4772,  0.5153,
         0.4870,  0.4967,  0.4709,  0.5089,  0.5126,  0.5012,  0.5141,
         0.4999,  0.4624,  0.4874,  0.4973,  0.5060,  0.4597,  0.4904,
         0.4781], device='cuda:0')
tensor(0.6892, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5292,  0.4859,  0.4536,  0.4867,  0.5092,  0.5124,  0.5065,
         0.4809,  0.5022,  0.4865,  0.4917,  0.4997,  0.4644,  0.4985,
         0.5295,  0.4796,  0.5083,  0.5035,  0.4857,  0.5740,  0.5279,
         0.5271,  0.5679,  0.4972,  0.5143,  0.5111,  0.5050,  0.4812,
         0.4666,  0.4988,  0.4794,  0.4820,  0.5016,  0.5233,  0.4911,
         0.4860,  0.4920,  0.5158,  0.4731,  0.5048,  0.4809,  0.5183,
         0.5064,  0.4856,  0.5635,  0.4960,  0.5028,  0.5204,  0.4794,
         0.4823,  0.4808,  0.4632,  0.5086,  0.5169,  0.4911,  0.5003,
         0.5164,  0.4806,  0.4779,  0.4992,  0.5004,  0.5328,  0.5113,
         0.5081,  0.4979,  0.5191,  0.5171,  0.5078,  0.5217,  0.4984,
         0.5172,  0.4990,  0.4619,  0.4991,  0.5150,  0.4940,  0.4965,
         0.4890,  0.5139,  0.5583,  0.4769,  0.5669,  0.5044,  0.5125,
         0.5122,  0.5856,  0.4748,  0.4897,  0.5264,  0.4810,  0.4851,
         0.5073,  0.4720,  0.5064,  0.4985,  0.4610,  0.4958,  0.5197,
         0.5041,  0.4845,  0.5548,  0.5111,  0.5124,  0.4738,  0.5316,
         0.4796,  0.4759,  0.4920,  0.6003,  0.5105,  0.5095,  0.4970,
         0.4978,  0.4835,  0.5028,  0.4719,  0.5092,  0.4668,  0.5069,
         0.4894,  0.5143,  0.4838,  0.4970,  0.4978,  0.4794,  0.5122,
         0.5190,  0.4609,  0.5011,  0.4560,  0.4942,  0.5043,  0.4822,
         0.5070,  0.4874,  0.4967,  0.4660,  0.4934,  0.4448,  0.4886,
         0.4979,  0.5141,  0.5137,  0.4820,  0.4731,  0.5167,  0.4775,
         0.4869,  0.5003,  0.4940,  0.5203,  0.4806,  0.4780,  0.5031,
         0.5317,  0.5329,  0.5002,  0.4832,  0.5153,  0.4616,  0.4900,
         0.4854,  0.4816,  0.5071,  0.5166,  0.4260,  0.5138,  0.4568,
         0.5135,  0.4791,  0.4730,  0.5037,  0.4561,  0.4869,  0.4675,
         0.5144,  0.4654,  0.5103,  0.4870,  0.5097,  0.5353,  0.4990,
         0.5580,  0.5061,  0.5026,  0.4910,  0.4647,  0.5048,  0.5563,
         0.5130,  0.4690,  0.4816,  0.4704,  0.4669,  0.5230,  0.5006,
         0.4953,  0.4758,  0.5005,  0.4877,  0.5188,  0.5197,  0.5096,
         0.4663,  0.4965,  0.5073,  0.5164,  0.4815,  0.4857,  0.5104,
         0.4908,  0.5151,  0.5181,  0.4435,  0.4764,  0.5235,  0.4897,
         0.5477,  0.4904,  0.5033,  0.4731,  0.4973,  0.5030,  0.4787,
         0.5055,  0.4731,  0.4804,  0.4797,  0.5428,  0.5192,  0.5195,
         0.4814,  0.4902,  0.4972,  0.4806,  0.5030,  0.4631,  0.4744,
         0.4951,  0.4774,  0.5008,  0.5556,  0.4794,  0.4882,  0.4956,
         0.5018,  0.4610,  0.4921,  0.4837,  0.5054,  0.4726,  0.5351,
         0.5038,  0.4972,  0.4829,  0.4822,  0.4933,  0.5127,  0.4913,
         0.4909,  0.5049,  0.4885,  0.4950,  0.5130,  0.5141,  0.5181,
         0.4817,  0.5080,  0.5165,  0.4829,  0.5387,  0.4761,  0.4803,
         0.4779,  0.4897,  0.4769,  0.5023,  0.5128,  0.4975,  0.5164,
         0.4804,  0.4919,  0.4785,  0.5171,  0.4748,  0.4762,  0.4941,
         0.4736,  0.4739,  0.5203,  0.4929,  0.5111,  0.4903,  0.4961,
         0.5066,  0.5208,  0.4822,  0.5587,  0.5657,  0.5047,  0.4725,
         0.4736,  0.4979,  0.4758,  0.4896,  0.4954,  0.4664,  0.4602,
         0.4995,  0.4618,  0.5395,  0.5445,  0.5591,  0.5140,  0.5283,
         0.4698,  0.4979,  0.4918,  0.4748,  0.4826,  0.4626,  0.4727,
         0.4659,  0.4930,  0.4925,  0.4782,  0.4941,  0.5112,  0.4721,
         0.5191,  0.5035,  0.5236,  0.4452,  0.5119,  0.5047,  0.4673,
         0.4958,  0.5179,  0.4704,  0.4670,  0.4999,  0.4933,  0.5565,
         0.4971,  0.5049,  0.5238,  0.5073,  0.4983,  0.4986,  0.4963,
         0.4956,  0.5049,  0.5077,  0.4984,  0.4890,  0.4765,  0.5025,
         0.5163,  0.4987,  0.5135,  0.5149,  0.4836,  0.5115,  0.5107,
         0.5182,  0.5162,  0.4881,  0.4899,  0.4958,  0.4820,  0.5076,
         0.4692,  0.4774,  0.5045,  0.4840,  0.5329,  0.4892,  0.5206,
         0.4768,  0.5883,  0.4760,  0.5153,  0.4888,  0.5116,  0.5826,
         0.5006,  0.4700,  0.5066,  0.4711,  0.5139,  0.4911,  0.5216,
         0.4951,  0.4733,  0.5022,  0.4895,  0.4907,  0.5100,  0.4744,
         0.5031,  0.5112,  0.4810,  0.5133,  0.5060,  0.5053,  0.4823,
         0.5140,  0.4827,  0.5146,  0.5121,  0.5048,  0.5239,  0.5040,
         0.5157,  0.4989,  0.5072,  0.4753,  0.5028,  0.5289,  0.5397,
         0.5079,  0.4942,  0.4812,  0.5081,  0.5099,  0.4766,  0.4994,
         0.5246,  0.5118,  0.5104,  0.5063,  0.5150,  0.4855,  0.5025,
         0.4924,  0.4921,  0.4865,  0.5123,  0.4727,  0.5070,  0.4752,
         0.5326,  0.4851,  0.4737,  0.5028,  0.5822,  0.5056,  0.5089,
         0.5574,  0.4986,  0.5139,  0.4571,  0.4944,  0.5162,  0.4680,
         0.4997,  0.4869,  0.5313,  0.4866,  0.4937,  0.5009,  0.4937,
         0.4485,  0.4968,  0.4810,  0.4770,  0.5104,  0.4854,  0.4870,
         0.4994,  0.5244,  0.5756,  0.4866,  0.4731,  0.5016,  0.4884,
         0.5098,  0.5077,  0.4608,  0.4943,  0.4894,  0.4820,  0.4904,
         0.4961,  0.4752,  0.4827,  0.4499,  0.5057,  0.5134,  0.4764,
         0.5116,  0.4447,  0.5005,  0.4784,  0.5009,  0.4772,  0.4945,
         0.5047,  0.5094,  0.4892,  0.4899,  0.5077,  0.4719,  0.4768,
         0.5255,  0.4990,  0.5100,  0.5121,  0.5044,  0.5656,  0.4833,
         0.4823], device='cuda:0')
tensor(0.6872, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4966,  0.5456,  0.4704,  0.4672,  0.4926,  0.5059,  0.5047,
         0.5163,  0.4930,  0.4805,  0.5237,  0.5156,  0.5000,  0.4898,
         0.4875,  0.5227,  0.5675,  0.4907,  0.4816,  0.4840,  0.4845,
         0.5543,  0.4723,  0.4891,  0.5385,  0.4906,  0.4907,  0.4612,
         0.4999,  0.5616,  0.4920,  0.4814,  0.5143,  0.5161,  0.4878,
         0.5301,  0.4955,  0.5183,  0.4936,  0.5277,  0.5133,  0.4796,
         0.4925,  0.5288,  0.5251,  0.5318,  0.5123,  0.5201,  0.4840,
         0.5158,  0.5393,  0.4952,  0.4659,  0.4727,  0.5596,  0.4899,
         0.4885,  0.4922,  0.5016,  0.5140,  0.5005,  0.4816,  0.4859,
         0.4744,  0.4790,  0.4910,  0.4841,  0.4829,  0.4980,  0.5032,
         0.4680,  0.5134,  0.4983,  0.5216,  0.5087,  0.5118,  0.4647,
         0.4901,  0.4863,  0.5448,  0.5087,  0.4959,  0.4944,  0.4975,
         0.4891,  0.4663,  0.5217,  0.5075,  0.4389,  0.5017,  0.5634,
         0.4809,  0.4805,  0.5142,  0.4857,  0.4886,  0.4888,  0.5159,
         0.5314,  0.5005,  0.5197,  0.4810,  0.4994,  0.5184,  0.5039,
         0.5078,  0.5341,  0.4940,  0.4896,  0.4796,  0.4613,  0.4835,
         0.4914,  0.5161,  0.5247,  0.5031,  0.5091,  0.5096,  0.4710,
         0.5842,  0.5045,  0.5224,  0.4873,  0.5124,  0.4980,  0.4889,
         0.4954,  0.5062,  0.5095,  0.4705,  0.4995,  0.4895,  0.4889,
         0.4909,  0.5027,  0.5013,  0.5304,  0.4895,  0.4931,  0.5182,
         0.4915,  0.4825,  0.5537,  0.5734,  0.5049,  0.4582,  0.4815,
         0.4589,  0.4939,  0.5087,  0.5046,  0.5053,  0.4957,  0.4821,
         0.5075,  0.5065,  0.5218,  0.4887,  0.5442,  0.5345,  0.5112,
         0.4824,  0.5224,  0.4913,  0.4824,  0.5831,  0.5053,  0.4732,
         0.4954,  0.5251,  0.5310,  0.4886,  0.4733,  0.4714,  0.4722,
         0.5032,  0.5017,  0.4894,  0.4556,  0.4811,  0.4946,  0.5196,
         0.5190,  0.4939,  0.4817,  0.5075,  0.5026,  0.5318,  0.4797,
         0.5540,  0.4646,  0.4966,  0.5199,  0.5104,  0.4657,  0.4891,
         0.5102,  0.4847,  0.4746,  0.5062,  0.5123,  0.5121,  0.4707,
         0.5120,  0.5444,  0.4939,  0.4681,  0.5188,  0.4996,  0.4949,
         0.4965,  0.5029,  0.4953,  0.5422,  0.5037,  0.4784,  0.5002,
         0.5578,  0.5294,  0.5222,  0.4710,  0.4728,  0.4837,  0.5469,
         0.5071,  0.5021,  0.4869,  0.5018,  0.5228,  0.5109,  0.4991,
         0.5345,  0.5159,  0.4906,  0.5133,  0.4836,  0.5253,  0.4743,
         0.5582,  0.5099,  0.5073,  0.5221,  0.4444,  0.4654,  0.4973,
         0.5030,  0.5001,  0.4771,  0.5050,  0.5124,  0.5215,  0.4819,
         0.4938,  0.4634,  0.4801,  0.5003,  0.4847,  0.4750,  0.5029,
         0.5038,  0.4879,  0.5022,  0.5068,  0.4920,  0.4591,  0.5105,
         0.4934,  0.4469,  0.4700,  0.5074,  0.4808,  0.5150,  0.4690,
         0.4879,  0.4913,  0.5311,  0.5093,  0.5592,  0.4658,  0.4631,
         0.4780,  0.4988,  0.4719,  0.5022,  0.4965,  0.4920,  0.4758,
         0.4762,  0.5115,  0.4958,  0.4976,  0.5065,  0.4775,  0.5072,
         0.5152,  0.5013,  0.5168,  0.4713,  0.5302,  0.5276,  0.4790,
         0.4889,  0.4703,  0.4750,  0.4928,  0.5347,  0.5081,  0.5522,
         0.5050,  0.4853,  0.5113,  0.4899,  0.4582,  0.5078,  0.4813,
         0.5201,  0.5084,  0.5667,  0.4938,  0.4784,  0.4885,  0.4860,
         0.4714,  0.5019,  0.4872,  0.4765,  0.5107,  0.4753,  0.5401,
         0.4920,  0.4667,  0.5655,  0.5370,  0.4819,  0.4437,  0.4848,
         0.4939,  0.4711,  0.4715,  0.4952,  0.5136,  0.5223,  0.5095,
         0.4807,  0.5178,  0.5676,  0.5061,  0.5336,  0.5179,  0.5041,
         0.5039,  0.4653,  0.5692,  0.4946,  0.4786,  0.5059,  0.5709,
         0.5120,  0.4862,  0.5084,  0.5139,  0.4965,  0.5013,  0.5027,
         0.4643,  0.4884,  0.5487,  0.5075,  0.4791,  0.4814,  0.4685,
         0.4920,  0.4702,  0.5147,  0.4742,  0.4643,  0.4820,  0.5087,
         0.5222,  0.4770,  0.5006,  0.4906,  0.5148,  0.4838,  0.4993,
         0.5232,  0.4898,  0.5271,  0.4762,  0.5311,  0.4933,  0.4757,
         0.5311,  0.4873,  0.5569,  0.5037,  0.5067,  0.4800,  0.4848,
         0.5130,  0.4854,  0.4780,  0.4864,  0.5108,  0.5250,  0.4675,
         0.4937,  0.4871,  0.5310,  0.5128,  0.5647,  0.4872,  0.5046,
         0.5236,  0.4782,  0.4886,  0.6023,  0.5707,  0.4688,  0.5023,
         0.5121,  0.5392,  0.5001,  0.4991,  0.4811,  0.4935,  0.5544,
         0.5301,  0.4623,  0.4881,  0.5079,  0.5073,  0.5195,  0.5098,
         0.5282,  0.5085,  0.5014,  0.5044,  0.4997,  0.4924,  0.4741,
         0.4985,  0.4840,  0.4957,  0.5056,  0.4871,  0.4854,  0.5585,
         0.5059,  0.4871,  0.5018,  0.5050,  0.4918,  0.5048,  0.5027,
         0.4885,  0.4776,  0.4806,  0.4819,  0.4945,  0.5031,  0.5057,
         0.4839,  0.4834,  0.5082,  0.4981,  0.5034,  0.4668,  0.5060,
         0.4847,  0.5157,  0.5135,  0.4826,  0.4610,  0.5366,  0.5656,
         0.5111,  0.4520,  0.4982,  0.5285,  0.5174,  0.5128,  0.4838,
         0.4971,  0.4670,  0.4954,  0.5144,  0.4870,  0.4954,  0.4871,
         0.5101,  0.4957,  0.5006,  0.5055,  0.4991,  0.5139,  0.5027,
         0.5172,  0.4674,  0.5433,  0.5043,  0.5194,  0.5108,  0.5326,
         0.4917,  0.4914,  0.4821,  0.5036,  0.5408,  0.5279,  0.4598,
         0.4704], device='cuda:0')
tensor(0.6926, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5190,  0.4700,  0.5097,  0.5269,  0.4981,  0.5029,  0.4607,
         0.5068,  0.5397,  0.4794,  0.4716,  0.4966,  0.5007,  0.5293,
         0.5172,  0.4809,  0.4574,  0.5084,  0.4748,  0.4927,  0.4512,
         0.5849,  0.4995,  0.4988,  0.4527,  0.5176,  0.5054,  0.4746,
         0.4817,  0.5385,  0.4824,  0.4857,  0.4797,  0.4715,  0.5547,
         0.4813,  0.4767,  0.5028,  0.4666,  0.5937,  0.5026,  0.4777,
         0.5137,  0.5271,  0.4647,  0.5118,  0.4956,  0.4658,  0.4830,
         0.5117,  0.4993,  0.4838,  0.5163,  0.4920,  0.5533,  0.5182,
         0.5061,  0.4979,  0.5142,  0.5876,  0.5025,  0.5132,  0.4861,
         0.5516,  0.4814,  0.4992,  0.5616,  0.5146,  0.4993,  0.5166,
         0.5064,  0.4981,  0.5813,  0.4841,  0.5824,  0.4701,  0.5029,
         0.4647,  0.4950,  0.4801,  0.5205,  0.4697,  0.5427,  0.5016,
         0.5004,  0.5338,  0.4662,  0.4913,  0.4697,  0.5048,  0.4673,
         0.4627,  0.5068,  0.4783,  0.4828,  0.5030,  0.4993,  0.4878,
         0.5050,  0.4661,  0.5344,  0.4829,  0.5163,  0.5556,  0.5140,
         0.5276,  0.5336,  0.4939,  0.5134,  0.5214,  0.4672,  0.5037,
         0.4978,  0.5174,  0.4978,  0.4907,  0.4750,  0.4707,  0.4829,
         0.5358,  0.4700,  0.5040,  0.4855,  0.4903,  0.5031,  0.4650,
         0.5378,  0.5005,  0.6124,  0.4873,  0.5283,  0.4745,  0.5123,
         0.4629,  0.4857,  0.5762,  0.5113,  0.4912,  0.4995,  0.4787,
         0.4904,  0.4866,  0.4662,  0.5030,  0.5199,  0.4978,  0.5115,
         0.4794,  0.5112,  0.4727,  0.5866,  0.5265,  0.5048,  0.5101,
         0.4597,  0.5285,  0.4954,  0.4838,  0.5585,  0.4920,  0.5529,
         0.5016,  0.4741,  0.5030,  0.4556,  0.5035,  0.5101,  0.5190,
         0.4893,  0.5116,  0.4812,  0.5235,  0.5255,  0.4810,  0.4642,
         0.4600,  0.5151,  0.4917,  0.5189,  0.4664,  0.5057,  0.5162,
         0.5141,  0.4966,  0.5059,  0.4758,  0.5033,  0.5028,  0.5189,
         0.5002,  0.4926,  0.5185,  0.5166,  0.5044,  0.5560,  0.5027,
         0.5165,  0.4918,  0.4926,  0.4888,  0.4820,  0.4885,  0.5700,
         0.5154,  0.5087,  0.4609,  0.4877,  0.4683,  0.4588,  0.5209,
         0.5152,  0.4804,  0.5215,  0.4604,  0.4681,  0.4747,  0.5148,
         0.6118,  0.4741,  0.4701,  0.4773,  0.4915,  0.4988,  0.4737,
         0.5406,  0.4600,  0.4597,  0.4952,  0.5296,  0.4601,  0.5403,
         0.5822,  0.4958,  0.4845,  0.5582,  0.4905,  0.5131,  0.5058,
         0.5448,  0.5090,  0.5092,  0.5080,  0.4964,  0.4992,  0.4840,
         0.5038,  0.4820,  0.5528,  0.4655,  0.5210,  0.4731,  0.4800,
         0.5252,  0.4896,  0.5173,  0.4866,  0.5339,  0.4877,  0.4917,
         0.5064,  0.5113,  0.4520,  0.5030,  0.4912,  0.5151,  0.4708,
         0.4615,  0.5039,  0.4857,  0.5109,  0.4896,  0.5001,  0.5324,
         0.4840,  0.5160,  0.4911,  0.4802,  0.4888,  0.4652,  0.4704,
         0.5018,  0.5031,  0.5157,  0.5227,  0.5667,  0.5283,  0.4746,
         0.5185,  0.4846,  0.5290,  0.5505,  0.4677,  0.4949,  0.4756,
         0.5044,  0.5228,  0.5026,  0.5062,  0.5113,  0.5039,  0.5005,
         0.5017,  0.4901,  0.5207,  0.6046,  0.5613,  0.5241,  0.5545,
         0.5283,  0.5198,  0.5068,  0.4794,  0.5034,  0.5152,  0.4345,
         0.5243,  0.5017,  0.5502,  0.4925,  0.5594,  0.4997,  0.5297,
         0.5078,  0.4725,  0.4787,  0.4653,  0.4961,  0.4908,  0.5438,
         0.4603,  0.5095,  0.5083,  0.5230,  0.4964,  0.5358,  0.4820,
         0.4680,  0.5032,  0.5077,  0.4878,  0.5313,  0.4829,  0.5044,
         0.4781,  0.4978,  0.4714,  0.5538,  0.5183,  0.5051,  0.4668,
         0.5132,  0.4844,  0.4783,  0.4809,  0.5130,  0.4808,  0.4964,
         0.4955,  0.5241,  0.5377,  0.4942,  0.4906,  0.4963,  0.4863,
         0.4686,  0.4949,  0.5200,  0.4725,  0.5407,  0.4911,  0.4981,
         0.4864,  0.5146,  0.4780,  0.4895,  0.4905,  0.4771,  0.4586,
         0.5497,  0.4599,  0.5335,  0.5372,  0.5100,  0.4576,  0.5005,
         0.5198,  0.5038,  0.5305,  0.4923,  0.4831,  0.4754,  0.4833,
         0.4683,  0.5325,  0.4829,  0.4774,  0.4712,  0.4694,  0.4711,
         0.4617,  0.4666,  0.4923,  0.4743,  0.5026,  0.5084,  0.5012,
         0.4800,  0.4992,  0.5113,  0.4652,  0.4866,  0.5339,  0.4686,
         0.4893,  0.5007,  0.4782,  0.4930,  0.5181,  0.4877,  0.4840,
         0.4722,  0.4913,  0.5089,  0.5127,  0.5007,  0.5558,  0.5077,
         0.4943,  0.4805,  0.4855,  0.4696,  0.5232,  0.5065,  0.4915,
         0.5053,  0.5156,  0.5087,  0.5201,  0.5056,  0.5208,  0.4801,
         0.5211,  0.5653,  0.5140,  0.4987,  0.4994,  0.5222,  0.5180,
         0.4977,  0.4733,  0.5147,  0.4912,  0.5027,  0.4942,  0.4972,
         0.4786,  0.4883,  0.5240,  0.5128,  0.5107,  0.5014,  0.4996,
         0.4898,  0.4930,  0.5138,  0.4885,  0.4709,  0.4962,  0.4940,
         0.4897,  0.5127,  0.4795,  0.4979,  0.4769,  0.4493,  0.4934,
         0.5569,  0.5165,  0.5019,  0.4828,  0.5104,  0.5008,  0.4923,
         0.5881,  0.4968,  0.4612,  0.4923,  0.4842,  0.4487,  0.4731,
         0.5892,  0.4948,  0.4728,  0.5191,  0.4687,  0.5149,  0.5784,
         0.4895,  0.5099,  0.5224,  0.5103,  0.4716,  0.4912,  0.5171,
         0.4816,  0.5297,  0.5065,  0.4749,  0.5068,  0.4948,  0.4639,
         0.4946], device='cuda:0')
tensor(0.6922, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5086,  0.4693,  0.5367,  0.5054,  0.4927,  0.5032,  0.5082,
         0.4769,  0.5290,  0.5316,  0.5907,  0.4666,  0.4899,  0.5948,
         0.4780,  0.5028,  0.4988,  0.5172,  0.5010,  0.4498,  0.5041,
         0.4940,  0.5082,  0.5159,  0.5678,  0.5062,  0.5218,  0.4884,
         0.5816,  0.5065,  0.5235,  0.5085,  0.4983,  0.5219,  0.4788,
         0.5161,  0.4920,  0.5086,  0.4801,  0.5139,  0.4652,  0.5463,
         0.4886,  0.4672,  0.4839,  0.5068,  0.5321,  0.5334,  0.5091,
         0.5255,  0.5126,  0.4964,  0.4573,  0.5059,  0.4775,  0.5244,
         0.4912,  0.5092,  0.4777,  0.5087,  0.4618,  0.5329,  0.5232,
         0.4502,  0.4883,  0.5355,  0.4839,  0.5371,  0.4590,  0.4917,
         0.4632,  0.5065,  0.5283,  0.4897,  0.5147,  0.5025,  0.5015,
         0.5240,  0.4777,  0.5187,  0.5034,  0.5265,  0.5156,  0.4975,
         0.4636,  0.4736,  0.4608,  0.4627,  0.5461,  0.4969,  0.4945,
         0.4529,  0.4833,  0.5301,  0.5030,  0.4903,  0.4822,  0.4878,
         0.5101,  0.5262,  0.4801,  0.5078,  0.4955,  0.4793,  0.5161,
         0.5512,  0.5178,  0.4673,  0.4656,  0.4523,  0.4893,  0.5093,
         0.5164,  0.4970,  0.4782,  0.4879,  0.4823,  0.5914,  0.4864,
         0.4783,  0.4970,  0.5010,  0.5017,  0.5932,  0.4813,  0.5273,
         0.5315,  0.5103,  0.4854,  0.4790,  0.4803,  0.5323,  0.5064,
         0.5225,  0.5082,  0.5006,  0.4906,  0.5888,  0.4491,  0.5539,
         0.4979,  0.5264,  0.4982,  0.4828,  0.4770,  0.5048,  0.5039,
         0.4925,  0.5236,  0.5011,  0.4846,  0.5028,  0.5285,  0.5141,
         0.5141,  0.4799,  0.4911,  0.4934,  0.4713,  0.5894,  0.5314,
         0.5058,  0.4255,  0.5506,  0.4517,  0.5008,  0.4822,  0.5549,
         0.5750,  0.5864,  0.4867,  0.4866,  0.4916,  0.5308,  0.5184,
         0.5195,  0.5449,  0.4861,  0.5035,  0.4961,  0.4852,  0.5047,
         0.5952,  0.5190,  0.5428,  0.4924,  0.5040,  0.4908,  0.5444,
         0.5304,  0.4814,  0.4808,  0.5010,  0.5209,  0.5093,  0.5094,
         0.5155,  0.4796,  0.5156,  0.5003,  0.5074,  0.4674,  0.4690,
         0.4772,  0.5204,  0.4841,  0.5228,  0.4822,  0.4704,  0.5216,
         0.5680,  0.4956,  0.5136,  0.4969,  0.5321,  0.5071,  0.5140,
         0.4819,  0.4858,  0.4965,  0.4675,  0.4919,  0.5350,  0.4823,
         0.4715,  0.4841,  0.4651,  0.5048,  0.4884,  0.5097,  0.5225,
         0.4845,  0.5245,  0.4848,  0.4972,  0.4883,  0.5027,  0.5384,
         0.5186,  0.4854,  0.5048,  0.4908,  0.4978,  0.5200,  0.4557,
         0.4747,  0.5908,  0.4804,  0.5193,  0.5293,  0.5160,  0.4699,
         0.5003,  0.4608,  0.4923,  0.5188,  0.5076,  0.5149,  0.5006,
         0.5282,  0.5020,  0.4923,  0.4867,  0.5154,  0.5861,  0.5022,
         0.5662,  0.4813,  0.4988,  0.5050,  0.4541,  0.4664,  0.5203,
         0.4686,  0.4958,  0.4984,  0.4615,  0.5110,  0.5477,  0.4796,
         0.5855,  0.4845,  0.5099,  0.5884,  0.6069,  0.4942,  0.4778,
         0.4553,  0.4779,  0.5350,  0.5041,  0.4843,  0.4644,  0.5182,
         0.4897,  0.4931,  0.5089,  0.4651,  0.4998,  0.4673,  0.4845,
         0.5164,  0.4657,  0.5905,  0.5072,  0.4928,  0.4680,  0.5102,
         0.5363,  0.4779,  0.5016,  0.4987,  0.4915,  0.4240,  0.5218,
         0.4631,  0.5317,  0.5153,  0.4731,  0.5311,  0.4664,  0.5527,
         0.4842,  0.5291,  0.4908,  0.4634,  0.5667,  0.5128,  0.5259,
         0.4825,  0.5183,  0.5107,  0.5271,  0.4902,  0.4770,  0.5150,
         0.4896,  0.5031,  0.4979,  0.4809,  0.5888,  0.4930,  0.4571,
         0.5160,  0.4970,  0.5233,  0.4983,  0.4905,  0.5637,  0.4996,
         0.4963,  0.4740,  0.5237,  0.5168,  0.4896,  0.4857,  0.5298,
         0.4833,  0.5357,  0.5056,  0.5091,  0.4814,  0.5150,  0.5393,
         0.4936,  0.5015,  0.4935,  0.4875,  0.5233,  0.4783,  0.5083,
         0.4712,  0.5188,  0.4560,  0.4935,  0.4972,  0.4723,  0.5150,
         0.4696,  0.4621,  0.5271,  0.5049,  0.5204,  0.5114,  0.4934,
         0.4630,  0.4869,  0.5088,  0.4950,  0.5145,  0.4870,  0.5443,
         0.4975,  0.4641,  0.4658,  0.4757,  0.5031,  0.5225,  0.4633,
         0.5280,  0.4681,  0.5272,  0.5223,  0.5306,  0.5075,  0.5163,
         0.5094,  0.5017,  0.4779,  0.5416,  0.4652,  0.4390,  0.4914,
         0.4440,  0.5128,  0.5045,  0.4814,  0.5484,  0.4600,  0.4600,
         0.4893,  0.4539,  0.4814,  0.5012,  0.4833,  0.4708,  0.4993,
         0.5047,  0.5403,  0.5113,  0.4984,  0.5072,  0.4932,  0.5219,
         0.5149,  0.4992,  0.4787,  0.5259,  0.4636,  0.5086,  0.4841,
         0.4937,  0.5127,  0.5248,  0.5080,  0.5430,  0.5073,  0.5632,
         0.4789,  0.4574,  0.4707,  0.4727,  0.4883,  0.4811,  0.4634,
         0.5386,  0.5054,  0.4671,  0.4947,  0.4807,  0.5238,  0.4776,
         0.4735,  0.5066,  0.4515,  0.5051,  0.5252,  0.4822,  0.4825,
         0.5156,  0.5336,  0.5056,  0.4863,  0.5235,  0.5042,  0.4801,
         0.4860,  0.4614,  0.5223,  0.5548,  0.5104,  0.4927,  0.4998,
         0.5200,  0.5059,  0.5190,  0.4960,  0.5206,  0.4954,  0.5196,
         0.5098,  0.4679,  0.5006,  0.5252,  0.5247,  0.5204,  0.5052,
         0.4905,  0.5238,  0.4712,  0.4895,  0.4876,  0.4777,  0.5131,
         0.6192,  0.5165,  0.4592,  0.4963,  0.5275,  0.4948,  0.5021,
         0.5060], device='cuda:0')
tensor(0.6849, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4745,  0.4946,  0.5537,  0.4843,  0.4985,  0.4537,  0.5223,
         0.5166,  0.4772,  0.4873,  0.4751,  0.5205,  0.5004,  0.4628,
         0.5032,  0.4846,  0.6140,  0.4922,  0.6079,  0.4626,  0.5300,
         0.4891,  0.4785,  0.4993,  0.4515,  0.5074,  0.4994,  0.4706,
         0.5113,  0.4528,  0.5025,  0.5377,  0.4854,  0.4960,  0.5034,
         0.4466,  0.4927,  0.5294,  0.4628,  0.5046,  0.4798,  0.5020,
         0.5135,  0.5024,  0.5314,  0.5297,  0.4835,  0.5816,  0.5080,
         0.5668,  0.4646,  0.4943,  0.4793,  0.5220,  0.5253,  0.5129,
         0.5163,  0.4896,  0.5040,  0.4834,  0.5091,  0.5170,  0.4823,
         0.5102,  0.5087,  0.4658,  0.4922,  0.4754,  0.5447,  0.4791,
         0.5276,  0.5664,  0.5058,  0.5434,  0.5079,  0.5348,  0.5065,
         0.5005,  0.4545,  0.5111,  0.4585,  0.5046,  0.4554,  0.4650,
         0.5264,  0.5000,  0.4787,  0.5044,  0.5458,  0.5241,  0.4980,
         0.4684,  0.5226,  0.5556,  0.5212,  0.4948,  0.4665,  0.5384,
         0.4971,  0.5053,  0.5229,  0.5500,  0.4455,  0.4908,  0.4707,
         0.5085,  0.4973,  0.5294,  0.4794,  0.4533,  0.5070,  0.4979,
         0.4611,  0.4688,  0.5229,  0.4993,  0.5492,  0.5014,  0.5291,
         0.4690,  0.5536,  0.4935,  0.4954,  0.4912,  0.5468,  0.5000,
         0.5190,  0.4673,  0.4800,  0.5446,  0.4866,  0.5120,  0.4768,
         0.4605,  0.4596,  0.5836,  0.5141,  0.4870,  0.4584,  0.4858,
         0.5004,  0.5178,  0.5410,  0.5121,  0.5006,  0.4975,  0.4731,
         0.5119,  0.5005,  0.5041,  0.4818,  0.5743,  0.4812,  0.4756,
         0.5001,  0.4895,  0.5004,  0.4608,  0.5648,  0.4914,  0.5121,
         0.5185,  0.4629,  0.5939,  0.4871,  0.4710,  0.4862,  0.4778,
         0.5141,  0.4875,  0.5004,  0.5391,  0.5630,  0.5064,  0.5034,
         0.4666,  0.5062,  0.5295,  0.5090,  0.5272,  0.4921,  0.4893,
         0.4477,  0.5108,  0.5005,  0.4957,  0.4957,  0.4597,  0.5067,
         0.4941,  0.5256,  0.5099,  0.5364,  0.5084,  0.5000,  0.5154,
         0.4523,  0.6001,  0.4794,  0.5467,  0.4940,  0.5090,  0.5429,
         0.4644,  0.4611,  0.5155,  0.5002,  0.5160,  0.4883,  0.5134,
         0.5076,  0.5215,  0.4909,  0.4831,  0.5250,  0.5686,  0.4796,
         0.4837,  0.4848,  0.5146,  0.4664,  0.5933,  0.5067,  0.5164,
         0.4413,  0.5173,  0.4990,  0.4919,  0.4645,  0.5212,  0.4761,
         0.4966,  0.5084,  0.4769,  0.4802,  0.5049,  0.5317,  0.5100,
         0.5189,  0.4841,  0.4876,  0.4774,  0.4444,  0.5097,  0.4481,
         0.4959,  0.4474,  0.4553,  0.5490,  0.5177,  0.4927,  0.4783,
         0.4698,  0.4965,  0.5047,  0.4611,  0.5352,  0.5120,  0.4864,
         0.4891,  0.4752,  0.5213,  0.5053,  0.5165,  0.5000,  0.5547,
         0.4650,  0.5223,  0.4824,  0.5205,  0.5024,  0.5528,  0.4892,
         0.5409,  0.5669,  0.4997,  0.4853,  0.4936,  0.5024,  0.5226,
         0.4413,  0.4682,  0.5098,  0.5431,  0.4585,  0.5287,  0.4969,
         0.5037,  0.5161,  0.4901,  0.5033,  0.4618,  0.5401,  0.5086,
         0.4789,  0.5021,  0.5235,  0.5350,  0.5263,  0.4812,  0.5181,
         0.5578,  0.4932,  0.5036,  0.5321,  0.5450,  0.4987,  0.5190,
         0.4822,  0.5007,  0.4977,  0.4941,  0.5006,  0.4830,  0.5104,
         0.5011,  0.5288,  0.5077,  0.4536,  0.4960,  0.4689,  0.4737,
         0.4764,  0.4837,  0.4710,  0.5475,  0.4768,  0.5028,  0.4975,
         0.5064,  0.5034,  0.4652,  0.4649,  0.4822,  0.5240,  0.5159,
         0.4568,  0.4725,  0.5870,  0.5458,  0.5135,  0.5621,  0.5091,
         0.4801,  0.5027,  0.4983,  0.4765,  0.5175,  0.5138,  0.5391,
         0.4951,  0.5257,  0.4807,  0.5007,  0.4683,  0.5058,  0.4626,
         0.5236,  0.5235,  0.5326,  0.5162,  0.4618,  0.4944,  0.4968,
         0.5046,  0.4609,  0.5841,  0.5046,  0.4701,  0.5229,  0.4671,
         0.5051,  0.5025,  0.5247,  0.5137,  0.5233,  0.4928,  0.4752,
         0.4955,  0.5070,  0.4957,  0.5132,  0.5141,  0.4859,  0.5868,
         0.4503,  0.5334,  0.5310,  0.4678,  0.4892,  0.5119,  0.5169,
         0.4766,  0.4770,  0.4841,  0.4860,  0.6162,  0.5025,  0.5123,
         0.5037,  0.5346,  0.5081,  0.5093,  0.4182,  0.4479,  0.4708,
         0.5191,  0.4969,  0.5145,  0.5248,  0.5147,  0.5099,  0.5159,
         0.4671,  0.5039,  0.5291,  0.4845,  0.4978,  0.5009,  0.5285,
         0.5220,  0.5264,  0.5124,  0.4974,  0.5279,  0.4906,  0.5121,
         0.5829,  0.4742,  0.4757,  0.4922,  0.4898,  0.4850,  0.4751,
         0.4998,  0.5510,  0.4989,  0.4905,  0.4709,  0.5176,  0.4751,
         0.4711,  0.4991,  0.4647,  0.4808,  0.4284,  0.4952,  0.5042,
         0.4625,  0.5221,  0.4829,  0.5097,  0.4970,  0.5024,  0.4525,
         0.4714,  0.4602,  0.4895,  0.5197,  0.5152,  0.4488,  0.5173,
         0.4836,  0.5102,  0.4834,  0.4811,  0.4622,  0.4620,  0.5536,
         0.4737,  0.4939,  0.5951,  0.5155,  0.4938,  0.4887,  0.5280,
         0.4594,  0.4585,  0.4914,  0.5253,  0.5168,  0.4809,  0.4665,
         0.5121,  0.4695,  0.4541,  0.5601,  0.4819,  0.5251,  0.5106,
         0.4760,  0.5097,  0.4789,  0.4526,  0.4549,  0.5105,  0.4750,
         0.4951,  0.5015,  0.4916,  0.5020,  0.5424,  0.5324,  0.5077,
         0.4862,  0.4947,  0.5261,  0.5485,  0.5115,  0.4921,  0.4659,
         0.4944], device='cuda:0')
tensor(0.6873, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4855,  0.4991,  0.5188,  0.5100,  0.5094,  0.5063,  0.4368,
         0.5263,  0.5127,  0.5226,  0.5104,  0.4838,  0.4893,  0.5052,
         0.5183,  0.4690,  0.5371,  0.4710,  0.5701,  0.4960,  0.5001,
         0.5064,  0.5228,  0.5360,  0.4735,  0.5719,  0.4623,  0.4378,
         0.4848,  0.5130,  0.5139,  0.5452,  0.4882,  0.4868,  0.5466,
         0.4831,  0.4807,  0.5465,  0.5416,  0.4895,  0.6105,  0.5114,
         0.5262,  0.4594,  0.5929,  0.4927,  0.4485,  0.4932,  0.4967,
         0.4907,  0.5384,  0.5542,  0.5100,  0.5167,  0.4660,  0.5093,
         0.4749,  0.5298,  0.4959,  0.4603,  0.5404,  0.4984,  0.5268,
         0.5282,  0.5279,  0.4414,  0.4795,  0.4803,  0.5289,  0.5133,
         0.4847,  0.5230,  0.5110,  0.5274,  0.5087,  0.5049,  0.4744,
         0.5254,  0.4415,  0.5802,  0.4841,  0.5121,  0.5186,  0.4867,
         0.5231,  0.5249,  0.4898,  0.5414,  0.5303,  0.4754,  0.5524,
         0.5239,  0.4591,  0.5027,  0.4845,  0.4923,  0.4780,  0.5403,
         0.5252,  0.4896,  0.6303,  0.4717,  0.5195,  0.5068,  0.4696,
         0.4900,  0.5291,  0.5265,  0.5212,  0.5002,  0.5015,  0.4667,
         0.5118,  0.5121,  0.4728,  0.4929,  0.4947,  0.5108,  0.4967,
         0.5703,  0.4674,  0.4445,  0.4945,  0.5027,  0.5373,  0.5157,
         0.5402,  0.4483,  0.4934,  0.5438,  0.4622,  0.5405,  0.4866,
         0.5294,  0.5079,  0.4673,  0.5229,  0.4690,  0.5205,  0.4880,
         0.5016,  0.5184,  0.5053,  0.4555,  0.5285,  0.5391,  0.4929,
         0.5249,  0.5301,  0.5112,  0.4564,  0.5255,  0.5031,  0.5093,
         0.5090,  0.5240,  0.5156,  0.5403,  0.5434,  0.4873,  0.5050,
         0.5133,  0.4662,  0.5427,  0.5147,  0.5087,  0.4894,  0.4714,
         0.4742,  0.5031,  0.5129,  0.5179,  0.5163,  0.5299,  0.4870,
         0.4719,  0.5922,  0.4485,  0.5807,  0.5103,  0.4755,  0.5292,
         0.5288,  0.4991,  0.5364,  0.5672,  0.5816,  0.5196,  0.4969,
         0.4898,  0.4749,  0.5205,  0.4604,  0.4963,  0.5272,  0.5205,
         0.4938,  0.4776,  0.4967,  0.4840,  0.4727,  0.4905,  0.4747,
         0.4851,  0.5083,  0.4614,  0.4671,  0.4881,  0.4833,  0.4672,
         0.5695,  0.4810,  0.4696,  0.5069,  0.4841,  0.5089,  0.4554,
         0.5388,  0.4706,  0.4740,  0.4633,  0.4726,  0.5267,  0.5122,
         0.5121,  0.5016,  0.4522,  0.5321,  0.5171,  0.4373,  0.4977,
         0.5924,  0.5217,  0.5155,  0.5184,  0.4686,  0.5191,  0.5027,
         0.5592,  0.4974,  0.4952,  0.4663,  0.4916,  0.5309,  0.4730,
         0.4859,  0.4921,  0.5125,  0.5280,  0.4979,  0.5126,  0.5338,
         0.5214,  0.4690,  0.4741,  0.4958,  0.4586,  0.4980,  0.4898,
         0.5281,  0.4947,  0.5610,  0.4826,  0.4808,  0.4895,  0.5359,
         0.5242,  0.5302,  0.4855,  0.4703,  0.4988,  0.4807,  0.4619,
         0.5205,  0.5826,  0.4731,  0.5010,  0.5190,  0.5027,  0.4785,
         0.5292,  0.5481,  0.4835,  0.5038,  0.5128,  0.5923,  0.4842,
         0.5465,  0.4906,  0.4856,  0.5086,  0.5127,  0.5490,  0.5174,
         0.4749,  0.4749,  0.5258,  0.4854,  0.4690,  0.5007,  0.5201,
         0.5274,  0.4818,  0.4861,  0.4772,  0.5376,  0.5094,  0.5086,
         0.4842,  0.5088,  0.4920,  0.4556,  0.4873,  0.4952,  0.5014,
         0.5028,  0.5261,  0.4883,  0.5559,  0.4906,  0.5303,  0.5041,
         0.5715,  0.4661,  0.5173,  0.5511,  0.4783,  0.5051,  0.5642,
         0.5034,  0.5078,  0.5208,  0.5658,  0.5274,  0.5309,  0.4933,
         0.4777,  0.5232,  0.5169,  0.5240,  0.5228,  0.5395,  0.5345,
         0.5032,  0.5531,  0.5098,  0.4715,  0.4816,  0.4867,  0.4888,
         0.4370,  0.5087,  0.5068,  0.6178,  0.5061,  0.5041,  0.5289,
         0.4798,  0.4907,  0.4831,  0.4419,  0.5463,  0.5085,  0.4949,
         0.5348,  0.5202,  0.4684,  0.5214,  0.5104,  0.5075,  0.5281,
         0.4846,  0.5181,  0.4929,  0.5173,  0.4992,  0.5189,  0.4838,
         0.5100,  0.5276,  0.5216,  0.4873,  0.5217,  0.4871,  0.4518,
         0.4997,  0.4928,  0.5234,  0.4628,  0.4587,  0.5173,  0.4709,
         0.4936,  0.5005,  0.4803,  0.4752,  0.5261,  0.4592,  0.4757,
         0.4917,  0.5152,  0.5021,  0.5208,  0.5123,  0.5155,  0.4958,
         0.5137,  0.5497,  0.4922,  0.5045,  0.5460,  0.5327,  0.4725,
         0.5337,  0.4693,  0.4606,  0.4476,  0.4881,  0.4972,  0.5912,
         0.4921,  0.5262,  0.4782,  0.4409,  0.5887,  0.5865,  0.5027,
         0.4816,  0.5372,  0.5159,  0.4679,  0.4924,  0.4735,  0.5161,
         0.5124,  0.4549,  0.5128,  0.5336,  0.5000,  0.4870,  0.5552,
         0.4989,  0.5108,  0.5692,  0.5284,  0.4894,  0.5037,  0.4698,
         0.4776,  0.4779,  0.5365,  0.5193,  0.4724,  0.5389,  0.5550,
         0.5361,  0.4844,  0.4641,  0.5350,  0.4818,  0.4745,  0.4782,
         0.4842,  0.5323,  0.4665,  0.5302,  0.5349,  0.4898,  0.5126,
         0.4903,  0.5197,  0.5057,  0.4765,  0.5627,  0.4994,  0.5107,
         0.4954,  0.4844,  0.5063,  0.4754,  0.4857,  0.4865,  0.5169,
         0.5043,  0.4513,  0.4653,  0.5072,  0.5434,  0.4723,  0.5573,
         0.4830,  0.4595,  0.4914,  0.4840,  0.5236,  0.4868,  0.4761,
         0.4847,  0.4730,  0.5013,  0.4743,  0.5334,  0.4260,  0.5178,
         0.4738,  0.4853,  0.5542,  0.5487,  0.5109,  0.4954,  0.5241,
         0.5026], device='cuda:0')
tensor(0.6882, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5010,  0.4778,  0.4994,  0.5048,  0.4590,  0.4913,  0.4961,
         0.4566,  0.4848,  0.4676,  0.5275,  0.4939,  0.5013,  0.5043,
         0.5560,  0.5014,  0.4939,  0.5067,  0.4846,  0.5055,  0.5140,
         0.5305,  0.4776,  0.4514,  0.4638,  0.5921,  0.4960,  0.4738,
         0.4782,  0.4704,  0.5251,  0.4942,  0.5176,  0.4863,  0.4918,
         0.5329,  0.5776,  0.5012,  0.4633,  0.4545,  0.4917,  0.4409,
         0.5123,  0.4463,  0.4996,  0.4933,  0.4555,  0.4939,  0.4579,
         0.4777,  0.5054,  0.5020,  0.5024,  0.5096,  0.4682,  0.5120,
         0.4855,  0.4570,  0.4992,  0.4446,  0.5216,  0.4882,  0.4804,
         0.4988,  0.5096,  0.5194,  0.5205,  0.4751,  0.4870,  0.5086,
         0.4709,  0.5032,  0.4405,  0.4792,  0.5421,  0.5157,  0.5108,
         0.5109,  0.5061,  0.5042,  0.4711,  0.4814,  0.5062,  0.5081,
         0.4495,  0.4839,  0.5228,  0.5242,  0.5233,  0.5062,  0.4839,
         0.4542,  0.5237,  0.4720,  0.5109,  0.5357,  0.5056,  0.4970,
         0.4876,  0.5113,  0.4678,  0.4775,  0.4964,  0.5397,  0.5432,
         0.4814,  0.4696,  0.5354,  0.4773,  0.4737,  0.4770,  0.4882,
         0.5080,  0.5048,  0.4712,  0.5232,  0.5231,  0.5100,  0.5093,
         0.5115,  0.5425,  0.4662,  0.5147,  0.5360,  0.5068,  0.5167,
         0.4929,  0.5169,  0.4935,  0.4486,  0.4943,  0.4598,  0.5304,
         0.4859,  0.4964,  0.6127,  0.5825,  0.4957,  0.5045,  0.5503,
         0.5072,  0.4933,  0.5073,  0.5126,  0.5030,  0.4688,  0.4564,
         0.4340,  0.5206,  0.5387,  0.4837,  0.4943,  0.5573,  0.4958,
         0.4761,  0.5289,  0.4830,  0.5139,  0.5343,  0.5970,  0.4872,
         0.5243,  0.4837,  0.4848,  0.4792,  0.5234,  0.4480,  0.4929,
         0.4974,  0.5196,  0.5122,  0.5629,  0.4454,  0.4578,  0.5029,
         0.5161,  0.5331,  0.5300,  0.5903,  0.4676,  0.4961,  0.5321,
         0.4822,  0.4611,  0.5551,  0.5139,  0.5244,  0.4861,  0.4905,
         0.4826,  0.4700,  0.4977,  0.5397,  0.4501,  0.5053,  0.5051,
         0.5101,  0.5003,  0.4682,  0.5063,  0.5729,  0.4995,  0.4579,
         0.4690,  0.4859,  0.4977,  0.4971,  0.4258,  0.5166,  0.5173,
         0.4851,  0.5781,  0.4988,  0.4527,  0.5266,  0.5239,  0.5230,
         0.4541,  0.5590,  0.4475,  0.5266,  0.5582,  0.5241,  0.6081,
         0.5603,  0.4804,  0.5276,  0.4952,  0.4798,  0.5822,  0.4420,
         0.5105,  0.5016,  0.4703,  0.4720,  0.5287,  0.4969,  0.5165,
         0.5043,  0.5042,  0.5279,  0.4623,  0.5191,  0.5370,  0.4441,
         0.5337,  0.4598,  0.5240,  0.4418,  0.4431,  0.5159,  0.4805,
         0.4788,  0.4758,  0.4867,  0.4858,  0.5375,  0.4414,  0.4702,
         0.5010,  0.5304,  0.4440,  0.4574,  0.5325,  0.4700,  0.4843,
         0.4893,  0.4950,  0.4549,  0.5320,  0.4673,  0.4880,  0.5059,
         0.4915,  0.5238,  0.5079,  0.4885,  0.5040,  0.4656,  0.5250,
         0.5118,  0.5062,  0.5192,  0.5279,  0.4622,  0.4444,  0.5104,
         0.4768,  0.4915,  0.4828,  0.5097,  0.4792,  0.5101,  0.5006,
         0.5088,  0.4654,  0.5412,  0.4919,  0.6037,  0.4059,  0.4813,
         0.5116,  0.4450,  0.5004,  0.4719,  0.5172,  0.5167,  0.4563,
         0.4783,  0.4820,  0.5206,  0.4968,  0.4861,  0.5284,  0.4936,
         0.4650,  0.4834,  0.4844,  0.5045,  0.4863,  0.5050,  0.5354,
         0.5064,  0.4661,  0.4809,  0.4993,  0.4582,  0.5004,  0.4830,
         0.4739,  0.5249,  0.5001,  0.5381,  0.4737,  0.4594,  0.5591,
         0.5049,  0.5084,  0.4830,  0.5000,  0.5084,  0.5019,  0.4485,
         0.5124,  0.5138,  0.4578,  0.5045,  0.5245,  0.5317,  0.4648,
         0.4956,  0.5094,  0.5185,  0.4954,  0.4999,  0.5169,  0.5153,
         0.5851,  0.4944,  0.4871,  0.4998,  0.4818,  0.4937,  0.4962,
         0.4865,  0.4806,  0.5197,  0.4596,  0.5557,  0.5376,  0.5530,
         0.5025,  0.4751,  0.5208,  0.4940,  0.5069,  0.4616,  0.6015,
         0.4973,  0.4744,  0.4976,  0.4810,  0.4950,  0.4792,  0.4952,
         0.4904,  0.5268,  0.4855,  0.5094,  0.5164,  0.4652,  0.5448,
         0.5292,  0.5074,  0.4518,  0.5493,  0.4810,  0.4604,  0.5169,
         0.5208,  0.4740,  0.5228,  0.5530,  0.5614,  0.5056,  0.4825,
         0.5147,  0.4163,  0.5198,  0.4900,  0.5185,  0.5501,  0.4766,
         0.5220,  0.4647,  0.4523,  0.5512,  0.4920,  0.4855,  0.4722,
         0.4639,  0.5115,  0.4750,  0.5346,  0.4974,  0.4578,  0.4905,
         0.5794,  0.5313,  0.4975,  0.5010,  0.4915,  0.5104,  0.4625,
         0.4995,  0.5035,  0.5754,  0.4837,  0.5203,  0.5328,  0.4549,
         0.4630,  0.4699,  0.5304,  0.5138,  0.5228,  0.4871,  0.4959,
         0.5003,  0.6003,  0.5047,  0.5010,  0.4594,  0.5015,  0.4724,
         0.5119,  0.4971,  0.5206,  0.4448,  0.4661,  0.4880,  0.5154,
         0.5176,  0.5297,  0.4928,  0.4984,  0.4997,  0.5855,  0.5353,
         0.4948,  0.4994,  0.5369,  0.5110,  0.5998,  0.5068,  0.4647,
         0.4928,  0.5214,  0.5062,  0.5051,  0.5426,  0.4753,  0.5022,
         0.4177,  0.4954,  0.4799,  0.4840,  0.4919,  0.5262,  0.5827,
         0.5622,  0.5258,  0.4810,  0.5151,  0.4681,  0.5388,  0.4924,
         0.5070,  0.5073,  0.5333,  0.5076,  0.4973,  0.4610,  0.4632,
         0.5019,  0.5286,  0.4934,  0.5376,  0.4905,  0.4818,  0.4779,
         0.4984], device='cuda:0')
tensor(0.6851, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4770,  0.4830,  0.5115,  0.4970,  0.4436,  0.5399,  0.5224,
         0.3869,  0.4908,  0.5432,  0.4622,  0.4789,  0.4639,  0.5213,
         0.4675,  0.4586,  0.5530,  0.4238,  0.5058,  0.5356,  0.4960,
         0.4858,  0.4768,  0.4942,  0.5078,  0.4762,  0.4975,  0.4767,
         0.5048,  0.5218,  0.4870,  0.5202,  0.5471,  0.5234,  0.4828,
         0.4865,  0.4743,  0.6014,  0.5015,  0.4916,  0.4862,  0.6258,
         0.5167,  0.5177,  0.4761,  0.4722,  0.5137,  0.5330,  0.5178,
         0.4886,  0.4948,  0.5475,  0.4669,  0.4829,  0.4993,  0.5069,
         0.5026,  0.4609,  0.5334,  0.5389,  0.5231,  0.5017,  0.5777,
         0.5137,  0.4837,  0.5022,  0.5082,  0.5447,  0.5462,  0.5099,
         0.5159,  0.4849,  0.5054,  0.4871,  0.5288,  0.4865,  0.4627,
         0.5335,  0.5298,  0.4712,  0.4791,  0.5718,  0.4986,  0.5196,
         0.5614,  0.4924,  0.5192,  0.4818,  0.5462,  0.5195,  0.5555,
         0.4821,  0.4929,  0.4704,  0.4620,  0.4414,  0.5254,  0.5080,
         0.5104,  0.4762,  0.4975,  0.5265,  0.5132,  0.5020,  0.4932,
         0.5312,  0.5273,  0.4658,  0.4653,  0.4999,  0.5368,  0.5261,
         0.4976,  0.4843,  0.4765,  0.4984,  0.5199,  0.4508,  0.4908,
         0.5410,  0.5152,  0.4857,  0.4963,  0.5094,  0.4814,  0.5026,
         0.5524,  0.4855,  0.5505,  0.5430,  0.5053,  0.5011,  0.4917,
         0.4818,  0.5094,  0.4872,  0.5446,  0.4786,  0.4981,  0.4589,
         0.5073,  0.5148,  0.4345,  0.5184,  0.4539,  0.4897,  0.4642,
         0.4437,  0.5015,  0.5130,  0.4732,  0.4670,  0.4964,  0.5813,
         0.4816,  0.5055,  0.5556,  0.4680,  0.5196,  0.5182,  0.5000,
         0.5069,  0.4835,  0.4912,  0.5132,  0.4385,  0.4862,  0.4994,
         0.5633,  0.5373,  0.5027,  0.4936,  0.5015,  0.4853,  0.5210,
         0.4628,  0.5135,  0.4956,  0.4554,  0.4948,  0.4826,  0.4842,
         0.4682,  0.4705,  0.5270,  0.4966,  0.5236,  0.4819,  0.5161,
         0.5748,  0.4674,  0.4778,  0.4787,  0.4572,  0.5233,  0.5291,
         0.4929,  0.4900,  0.4935,  0.5160,  0.5050,  0.5158,  0.4663,
         0.4506,  0.4802,  0.4825,  0.4685,  0.5134,  0.5067,  0.5330,
         0.5558,  0.4858,  0.5141,  0.5357,  0.4717,  0.4872,  0.5221,
         0.5355,  0.5631,  0.4538,  0.5064,  0.5508,  0.4823,  0.5041,
         0.5238,  0.4645,  0.4927,  0.5364,  0.4403,  0.4896,  0.5318,
         0.5017,  0.4415,  0.4934,  0.4649,  0.5316,  0.5180,  0.4888,
         0.4836,  0.5537,  0.5069,  0.4966,  0.4878,  0.5334,  0.5320,
         0.4812,  0.4891,  0.5022,  0.4962,  0.4710,  0.4985,  0.4743,
         0.4792,  0.5299,  0.4757,  0.4946,  0.5260,  0.5353,  0.5467,
         0.5489,  0.4822,  0.4806,  0.4779,  0.4852,  0.5002,  0.5180,
         0.4918,  0.5061,  0.4852,  0.4873,  0.4975,  0.5248,  0.5284,
         0.5212,  0.4563,  0.5450,  0.4698,  0.4871,  0.5065,  0.4912,
         0.5260,  0.4526,  0.4607,  0.5405,  0.4763,  0.5278,  0.4705,
         0.5406,  0.5604,  0.5036,  0.4394,  0.5328,  0.5350,  0.4762,
         0.4992,  0.4969,  0.5073,  0.4463,  0.5103,  0.5358,  0.5376,
         0.5133,  0.5028,  0.5241,  0.5029,  0.5291,  0.4737,  0.4883,
         0.5208,  0.5324,  0.5078,  0.5524,  0.5030,  0.4933,  0.5571,
         0.5135,  0.4807,  0.5389,  0.4941,  0.4420,  0.5219,  0.4376,
         0.5061,  0.5198,  0.4859,  0.4895,  0.5285,  0.5603,  0.4484,
         0.4897,  0.5681,  0.5104,  0.6239,  0.5976,  0.4732,  0.6169,
         0.5125,  0.5405,  0.5094,  0.4716,  0.5382,  0.4825,  0.5082,
         0.5413,  0.4823,  0.5589,  0.4827,  0.4886,  0.5011,  0.4647,
         0.5030,  0.4900,  0.4981,  0.5562,  0.5377,  0.4566,  0.5216,
         0.5093,  0.5271,  0.5143,  0.5364,  0.5157,  0.4720,  0.5008,
         0.4568,  0.4014,  0.4828,  0.5440,  0.5260,  0.4890,  0.4564,
         0.4929,  0.5016,  0.5199,  0.4611,  0.5265,  0.5158,  0.4275,
         0.4257,  0.4369,  0.4866,  0.4744,  0.5248,  0.5031,  0.5884,
         0.5469,  0.4915,  0.5021,  0.4899,  0.5772,  0.4724,  0.5255,
         0.5355,  0.4732,  0.5079,  0.5098,  0.5212,  0.5447,  0.5314,
         0.5040,  0.5511,  0.5184,  0.5114,  0.4776,  0.4533,  0.5161,
         0.5091,  0.4839,  0.4953,  0.5382,  0.4898,  0.4874,  0.5368,
         0.5161,  0.5575,  0.4668,  0.4807,  0.4944,  0.5052,  0.4959,
         0.5151,  0.5175,  0.5087,  0.5430,  0.4918,  0.4954,  0.5360,
         0.5103,  0.4585,  0.4619,  0.3926,  0.4802,  0.4038,  0.5068,
         0.4814,  0.5182,  0.4765,  0.5173,  0.4851,  0.5057,  0.5140,
         0.4666,  0.5063,  0.4980,  0.4941,  0.5072,  0.5741,  0.4878,
         0.4892,  0.5445,  0.5158,  0.4732,  0.5208,  0.4987,  0.4616,
         0.4706,  0.4826,  0.5258,  0.4823,  0.4364,  0.4957,  0.4983,
         0.4716,  0.4942,  0.5696,  0.5136,  0.5652,  0.5208,  0.4792,
         0.5545,  0.5050,  0.5112,  0.5278,  0.4627,  0.5223,  0.5349,
         0.5704,  0.6082,  0.4694,  0.5027,  0.5195,  0.4835,  0.4995,
         0.4567,  0.5279,  0.4871,  0.4830,  0.5400,  0.4898,  0.5001,
         0.5083,  0.4653,  0.4769,  0.4922,  0.5008,  0.4947,  0.4968,
         0.4737,  0.5257,  0.4889,  0.5167,  0.5294,  0.4928,  0.4836,
         0.4844,  0.5397,  0.4983,  0.4709,  0.5048,  0.5289,  0.4711,
         0.5072], device='cuda:0')
tensor(0.6846, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4563,  0.5697,  0.4681,  0.4721,  0.5026,  0.4979,  0.5269,
         0.5824,  0.5903,  0.4972,  0.4382,  0.5191,  0.4893,  0.5129,
         0.4930,  0.4443,  0.5570,  0.4894,  0.4868,  0.5226,  0.4955,
         0.4425,  0.5237,  0.4885,  0.5197,  0.5138,  0.4590,  0.5567,
         0.4973,  0.5402,  0.4826,  0.5214,  0.5372,  0.4793,  0.4814,
         0.5151,  0.5008,  0.5117,  0.5083,  0.5481,  0.4771,  0.5689,
         0.4662,  0.4617,  0.5120,  0.4864,  0.4609,  0.5105,  0.4810,
         0.5287,  0.5372,  0.4997,  0.5362,  0.5208,  0.5110,  0.4730,
         0.5116,  0.5005,  0.5121,  0.4707,  0.4865,  0.5013,  0.4704,
         0.5488,  0.5649,  0.4977,  0.5000,  0.4513,  0.4868,  0.5853,
         0.5044,  0.5223,  0.5364,  0.4928,  0.4580,  0.4675,  0.4951,
         0.4641,  0.4777,  0.4861,  0.5064,  0.5097,  0.5300,  0.4675,
         0.5207,  0.4840,  0.5266,  0.4867,  0.5205,  0.4889,  0.4404,
         0.4792,  0.4233,  0.4689,  0.5007,  0.4896,  0.5443,  0.5062,
         0.4791,  0.4919,  0.5204,  0.5443,  0.4828,  0.4948,  0.4742,
         0.5267,  0.4173,  0.5333,  0.5376,  0.4203,  0.5458,  0.4855,
         0.4965,  0.5225,  0.5423,  0.5591,  0.4885,  0.4799,  0.4781,
         0.4368,  0.6016,  0.5442,  0.5277,  0.4500,  0.5084,  0.4914,
         0.4959,  0.5001,  0.4909,  0.5162,  0.4606,  0.5085,  0.5028,
         0.4530,  0.5153,  0.5369,  0.5325,  0.4909,  0.4441,  0.4563,
         0.5337,  0.5430,  0.4907,  0.4952,  0.4887,  0.5045,  0.5117,
         0.5255,  0.4621,  0.5102,  0.5272,  0.4853,  0.4832,  0.4813,
         0.4975,  0.5180,  0.5093,  0.5027,  0.5256,  0.4872,  0.4282,
         0.4819,  0.4891,  0.4743,  0.5251,  0.5021,  0.5107,  0.5479,
         0.5550,  0.5268,  0.5286,  0.4803,  0.4867,  0.5089,  0.5015,
         0.6118,  0.5568,  0.4971,  0.4469,  0.5003,  0.5140,  0.5232,
         0.5023,  0.4871,  0.5126,  0.4995,  0.4843,  0.4609,  0.4426,
         0.5277,  0.5021,  0.5043,  0.5370,  0.5432,  0.5308,  0.4643,
         0.4804,  0.4401,  0.4965,  0.4900,  0.5187,  0.5014,  0.4616,
         0.5513,  0.4795,  0.4710,  0.5158,  0.5051,  0.4844,  0.4876,
         0.4618,  0.4808,  0.4944,  0.5964,  0.4539,  0.4513,  0.4814,
         0.5224,  0.5149,  0.5304,  0.5264,  0.4891,  0.5027,  0.4600,
         0.5237,  0.5293,  0.5735,  0.4903,  0.5765,  0.5143,  0.6053,
         0.4978,  0.4450,  0.5264,  0.5099,  0.4591,  0.4846,  0.5052,
         0.5202,  0.5275,  0.4972,  0.4900,  0.5072,  0.6299,  0.5146,
         0.4126,  0.4978,  0.5581,  0.5080,  0.6170,  0.5114,  0.4747,
         0.4899,  0.5016,  0.5303,  0.5372,  0.5215,  0.5402,  0.4904,
         0.5185,  0.5070,  0.5085,  0.4544,  0.4330,  0.5511,  0.4879,
         0.4686,  0.5680,  0.5291,  0.4558,  0.4808,  0.4699,  0.5191,
         0.4505,  0.5028,  0.5623,  0.5033,  0.4814,  0.5177,  0.4850,
         0.4605,  0.5317,  0.5802,  0.5073,  0.3988,  0.4595,  0.5963,
         0.5280,  0.4424,  0.5459,  0.5231,  0.4806,  0.5098,  0.4750,
         0.5208,  0.4989,  0.4854,  0.4516,  0.5213,  0.4797,  0.5075,
         0.4743,  0.5015,  0.4749,  0.4562,  0.4798,  0.4808,  0.5815,
         0.4795,  0.4944,  0.4519,  0.4697,  0.4894,  0.5062,  0.5088,
         0.4811,  0.4976,  0.5025,  0.5494,  0.5665,  0.5297,  0.4779,
         0.4950,  0.4543,  0.5353,  0.5096,  0.5148,  0.5501,  0.4952,
         0.5372,  0.4482,  0.4990,  0.4693,  0.4905,  0.5233,  0.5481,
         0.5013,  0.5281,  0.4485,  0.4825,  0.5219,  0.4933,  0.5480,
         0.5136,  0.4548,  0.5470,  0.5058,  0.4979,  0.4894,  0.5404,
         0.4833,  0.4639,  0.4539,  0.4978,  0.5473,  0.4919,  0.4620,
         0.5285,  0.4837,  0.5047,  0.5196,  0.4901,  0.5171,  0.4530,
         0.4673,  0.4779,  0.4902,  0.4727,  0.4821,  0.4641,  0.5048,
         0.3993,  0.4816,  0.5185,  0.5648,  0.5053,  0.4525,  0.5344,
         0.4245,  0.4929,  0.5417,  0.4712,  0.4663,  0.4850,  0.4993,
         0.5144,  0.5541,  0.4948,  0.4828,  0.4760,  0.4263,  0.5348,
         0.4539,  0.5185,  0.5505,  0.4966,  0.5603,  0.4626,  0.5385,
         0.5322,  0.5047,  0.5300,  0.5535,  0.5385,  0.5095,  0.5411,
         0.5174,  0.5206,  0.4615,  0.4467,  0.4732,  0.5367,  0.5010,
         0.4547,  0.5147,  0.4936,  0.5418,  0.5456,  0.5355,  0.5191,
         0.5992,  0.5347,  0.4680,  0.5464,  0.5893,  0.4704,  0.5236,
         0.5094,  0.4664,  0.5048,  0.5339,  0.5021,  0.5049,  0.5202,
         0.4773,  0.5366,  0.5425,  0.5107,  0.5157,  0.5517,  0.4964,
         0.4844,  0.4427,  0.5489,  0.5024,  0.5388,  0.4743,  0.5074,
         0.5391,  0.4966,  0.5077,  0.4822,  0.5480,  0.4535,  0.4934,
         0.5040,  0.5387,  0.4500,  0.4698,  0.5213,  0.4702,  0.3982,
         0.4819,  0.4970,  0.5362,  0.4469,  0.5165,  0.4669,  0.4750,
         0.5355,  0.4997,  0.4839,  0.5245,  0.5267,  0.5972,  0.5919,
         0.4972,  0.4801,  0.5414,  0.5244,  0.4914,  0.5281,  0.4869,
         0.5381,  0.5009,  0.4458,  0.4801,  0.4780,  0.5181,  0.5947,
         0.4299,  0.4428,  0.4969,  0.5381,  0.5355,  0.5376,  0.4672,
         0.4729,  0.5549,  0.5031,  0.5038,  0.5262,  0.5295,  0.4241,
         0.5062,  0.4900,  0.4936,  0.4896,  0.5779,  0.4860,  0.5315,
         0.5880], device='cuda:0')
tensor(0.6867, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5079,  0.5389,  0.5358,  0.4936,  0.4962,  0.5283,  0.5761,
         0.5132,  0.4983,  0.4757,  0.4716,  0.4631,  0.5701,  0.5138,
         0.4691,  0.4545,  0.5100,  0.5929,  0.4765,  0.4828,  0.4586,
         0.6125,  0.5954,  0.5104,  0.4724,  0.5149,  0.5255,  0.4395,
         0.4769,  0.5080,  0.5174,  0.5295,  0.4950,  0.5528,  0.4246,
         0.4568,  0.4543,  0.5270,  0.5251,  0.5153,  0.4864,  0.4406,
         0.5214,  0.4700,  0.4768,  0.5960,  0.5181,  0.5991,  0.4675,
         0.5125,  0.5294,  0.4839,  0.4741,  0.5150,  0.4209,  0.5158,
         0.5005,  0.4903,  0.5800,  0.4975,  0.4424,  0.4867,  0.4701,
         0.5038,  0.5456,  0.5501,  0.5136,  0.4451,  0.4814,  0.4935,
         0.4949,  0.5414,  0.5363,  0.4787,  0.5454,  0.4835,  0.5303,
         0.5416,  0.5565,  0.4856,  0.4590,  0.5314,  0.4774,  0.5576,
         0.4735,  0.5602,  0.4826,  0.4911,  0.5440,  0.5134,  0.5234,
         0.5932,  0.4877,  0.4556,  0.4868,  0.4906,  0.5161,  0.5067,
         0.4629,  0.4981,  0.5478,  0.5685,  0.4834,  0.4550,  0.4878,
         0.4854,  0.5372,  0.4552,  0.5470,  0.4932,  0.5343,  0.5282,
         0.4486,  0.5454,  0.5118,  0.4728,  0.4935,  0.4502,  0.4962,
         0.4875,  0.5097,  0.4636,  0.5078,  0.5066,  0.4761,  0.4822,
         0.5037,  0.4694,  0.5105,  0.5583,  0.5366,  0.4748,  0.4923,
         0.4716,  0.4954,  0.4433,  0.4900,  0.4953,  0.4685,  0.5022,
         0.4777,  0.4798,  0.4458,  0.4999,  0.4918,  0.4583,  0.4626,
         0.4969,  0.6028,  0.4864,  0.5725,  0.5222,  0.4724,  0.4755,
         0.4814,  0.4720,  0.5570,  0.5204,  0.4408,  0.4842,  0.4786,
         0.4535,  0.4832,  0.5602,  0.4802,  0.4558,  0.5169,  0.5131,
         0.5164,  0.5868,  0.4495,  0.5074,  0.4285,  0.4585,  0.4801,
         0.5543,  0.5401,  0.4559,  0.5029,  0.5429,  0.5093,  0.4827,
         0.5823,  0.5131,  0.5174,  0.5556,  0.5514,  0.5284,  0.4993,
         0.4832,  0.4841,  0.5077,  0.5806,  0.5598,  0.5220,  0.5813,
         0.4942,  0.5005,  0.5576,  0.4471,  0.5552,  0.5098,  0.5180,
         0.5252,  0.4849,  0.5058,  0.4943,  0.5114,  0.4744,  0.5195,
         0.4923,  0.4851,  0.4672,  0.4849,  0.4789,  0.4828,  0.4580,
         0.4785,  0.4545,  0.4929,  0.4690,  0.5348,  0.4540,  0.4881,
         0.5614,  0.5168,  0.4493,  0.4699,  0.4871,  0.5263,  0.4644,
         0.4929,  0.5284,  0.4891,  0.4941,  0.5687,  0.5148,  0.4557,
         0.5286,  0.4233,  0.4877,  0.5018,  0.4750,  0.4951,  0.4595,
         0.5285,  0.5150,  0.4397,  0.5118,  0.4936,  0.4894,  0.5108,
         0.5113,  0.5378,  0.5818,  0.5005,  0.4758,  0.4869,  0.5118,
         0.4563,  0.4413,  0.4515,  0.4567,  0.5260,  0.5396,  0.5619,
         0.4520,  0.5655,  0.5237,  0.4919,  0.4743,  0.4674,  0.4966,
         0.5356,  0.5441,  0.4329,  0.4345,  0.4872,  0.5329,  0.5016,
         0.4857,  0.4848,  0.4671,  0.5332,  0.5237,  0.4716,  0.4793,
         0.4975,  0.5021,  0.4918,  0.4673,  0.4856,  0.4512,  0.4663,
         0.4526,  0.4991,  0.5621,  0.5420,  0.4993,  0.5136,  0.4970,
         0.4726,  0.4635,  0.5113,  0.5086,  0.5226,  0.5120,  0.5182,
         0.5095,  0.4051,  0.5129,  0.4661,  0.5261,  0.4665,  0.5049,
         0.4413,  0.4985,  0.5168,  0.4197,  0.5181,  0.5361,  0.4705,
         0.4619,  0.4872,  0.5191,  0.4634,  0.5332,  0.4546,  0.4720,
         0.5021,  0.4646,  0.4555,  0.5388,  0.4988,  0.4641,  0.4648,
         0.5139,  0.5052,  0.5253,  0.4882,  0.6088,  0.4921,  0.4888,
         0.4799,  0.4908,  0.5156,  0.4972,  0.4735,  0.5366,  0.4594,
         0.4880,  0.4474,  0.4601,  0.4805,  0.4485,  0.4466,  0.4783,
         0.5837,  0.4775,  0.5104,  0.5169,  0.4755,  0.4797,  0.5226,
         0.4774,  0.5208,  0.5195,  0.4847,  0.4810,  0.5290,  0.4934,
         0.4674,  0.5216,  0.4261,  0.5305,  0.5655,  0.5230,  0.4771,
         0.4889,  0.5960,  0.5348,  0.4760,  0.5139,  0.4691,  0.5241,
         0.4704,  0.5223,  0.5295,  0.5312,  0.4969,  0.5061,  0.5334,
         0.5312,  0.5433,  0.4807,  0.5606,  0.5212,  0.4594,  0.4492,
         0.5078,  0.5237,  0.5127,  0.4967,  0.4380,  0.5443,  0.5159,
         0.4760,  0.4841,  0.5924,  0.5080,  0.5337,  0.5381,  0.4886,
         0.5339,  0.4883,  0.5336,  0.4809,  0.4570,  0.5311,  0.4816,
         0.4681,  0.4991,  0.5075,  0.4820,  0.4916,  0.5037,  0.4942,
         0.4451,  0.4729,  0.5542,  0.5187,  0.5477,  0.5678,  0.4791,
         0.5299,  0.4823,  0.4369,  0.5480,  0.4550,  0.5092,  0.5392,
         0.5320,  0.5013,  0.4918,  0.4665,  0.5194,  0.5208,  0.4827,
         0.4717,  0.5301,  0.4803,  0.4589,  0.5165,  0.5116,  0.4832,
         0.4457,  0.4886,  0.5393,  0.4412,  0.4592,  0.4991,  0.4695,
         0.4901,  0.4863,  0.4642,  0.5151,  0.5015,  0.4507,  0.5222,
         0.4429,  0.4652,  0.4768,  0.5212,  0.4801,  0.4701,  0.4798,
         0.5404,  0.5202,  0.4787,  0.4945,  0.5248,  0.4999,  0.4879,
         0.4830,  0.5041,  0.5033,  0.5221,  0.4678,  0.5198,  0.4934,
         0.5333,  0.6120,  0.4864,  0.4739,  0.5128,  0.5809,  0.5158,
         0.4908,  0.5094,  0.4925,  0.4701,  0.5279,  0.4738,  0.5503,
         0.4753,  0.4691,  0.5769,  0.4965,  0.5461,  0.5369,  0.4933,
         0.5350], device='cuda:0')
tensor(0.6885, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4710,  0.5056,  0.5032,  0.4716,  0.5378,  0.5033,  0.5042,
         0.4912,  0.4892,  0.5866,  0.5310,  0.5726,  0.4693,  0.5489,
         0.4832,  0.4722,  0.4484,  0.4951,  0.5320,  0.4744,  0.5682,
         0.4716,  0.5150,  0.4428,  0.5320,  0.4863,  0.4765,  0.5526,
         0.4636,  0.4448,  0.6004,  0.5144,  0.5027,  0.4689,  0.4981,
         0.4780,  0.4485,  0.4589,  0.5108,  0.4926,  0.4904,  0.4770,
         0.4741,  0.4894,  0.4561,  0.5163,  0.4671,  0.4948,  0.5002,
         0.4306,  0.4423,  0.5320,  0.5066,  0.5624,  0.5016,  0.5059,
         0.4375,  0.4836,  0.4596,  0.4377,  0.4836,  0.4589,  0.4488,
         0.4632,  0.4550,  0.6040,  0.5857,  0.4927,  0.4531,  0.5895,
         0.5441,  0.5218,  0.5274,  0.5543,  0.4831,  0.4999,  0.5571,
         0.4714,  0.5194,  0.4134,  0.5659,  0.5154,  0.4965,  0.4944,
         0.4676,  0.5178,  0.4436,  0.5049,  0.4755,  0.5325,  0.4962,
         0.4717,  0.5446,  0.5172,  0.5466,  0.5418,  0.5401,  0.4942,
         0.5498,  0.5046,  0.5629,  0.5090,  0.5103,  0.5168,  0.4341,
         0.4952,  0.4620,  0.4570,  0.4803,  0.4883,  0.4947,  0.5176,
         0.5134,  0.5083,  0.4907,  0.4521,  0.5024,  0.4724,  0.5919,
         0.4791,  0.5276,  0.5182,  0.4950,  0.4255,  0.4128,  0.4539,
         0.5105,  0.4959,  0.4766,  0.4383,  0.5037,  0.4786,  0.5059,
         0.5468,  0.4458,  0.5363,  0.4815,  0.4487,  0.5725,  0.5615,
         0.5432,  0.4371,  0.4895,  0.5193,  0.4700,  0.4709,  0.4874,
         0.4478,  0.5192,  0.4932,  0.5215,  0.5431,  0.5099,  0.4515,
         0.4861,  0.4729,  0.4871,  0.5315,  0.5167,  0.5273,  0.4739,
         0.5171,  0.5266,  0.5349,  0.4202,  0.5254,  0.5214,  0.4532,
         0.5470,  0.4981,  0.5229,  0.4901,  0.4842,  0.4651,  0.5269,
         0.5027,  0.4912,  0.5507,  0.5034,  0.4457,  0.4646,  0.4262,
         0.4558,  0.4979,  0.5273,  0.4811,  0.5364,  0.5200,  0.4809,
         0.4741,  0.4625,  0.5103,  0.4915,  0.5466,  0.5205,  0.5804,
         0.4520,  0.5350,  0.4847,  0.5875,  0.5858,  0.4832,  0.5628,
         0.5005,  0.4872,  0.5851,  0.5408,  0.5226,  0.5294,  0.5220,
         0.4760,  0.4840,  0.5385,  0.5390,  0.5990,  0.5179,  0.5810,
         0.5294,  0.4540,  0.4827,  0.4763,  0.5720,  0.4425,  0.5099,
         0.4345,  0.4918,  0.5147,  0.4990,  0.4219,  0.5404,  0.5116,
         0.4857,  0.5341,  0.4618,  0.4754,  0.5308,  0.5247,  0.5323,
         0.4831,  0.4872,  0.4915,  0.5383,  0.5499,  0.4814,  0.4880,
         0.5879,  0.5147,  0.5504,  0.5090,  0.5562,  0.4826,  0.5094,
         0.4708,  0.5383,  0.4944,  0.4248,  0.4919,  0.5078,  0.5359,
         0.5188,  0.5099,  0.5974,  0.5418,  0.5547,  0.4690,  0.5208,
         0.4631,  0.5406,  0.4966,  0.4830,  0.5963,  0.5384,  0.6307,
         0.4806,  0.5012,  0.4738,  0.4713,  0.4403,  0.5003,  0.5253,
         0.5156,  0.5980,  0.4855,  0.5198,  0.5183,  0.4785,  0.4860,
         0.4794,  0.6040,  0.4854,  0.5197,  0.5202,  0.4844,  0.4912,
         0.4922,  0.5160,  0.5862,  0.4924,  0.3968,  0.4802,  0.4861,
         0.5013,  0.5378,  0.4812,  0.4572,  0.5064,  0.5697,  0.5553,
         0.4857,  0.4966,  0.4716,  0.5114,  0.5101,  0.5276,  0.5463,
         0.4992,  0.4722,  0.4666,  0.4521,  0.5334,  0.4723,  0.4677,
         0.4568,  0.4876,  0.4939,  0.5099,  0.5088,  0.5496,  0.5234,
         0.4735,  0.4730,  0.4898,  0.4898,  0.4929,  0.4600,  0.5088,
         0.4875,  0.4909,  0.4995,  0.4896,  0.5312,  0.5090,  0.5243,
         0.4500,  0.5508,  0.4397,  0.4229,  0.5199,  0.5008,  0.5690,
         0.5281,  0.4845,  0.5443,  0.6196,  0.5741,  0.4746,  0.4910,
         0.4996,  0.5424,  0.4436,  0.5010,  0.4964,  0.5137,  0.5615,
         0.5414,  0.4819,  0.4917,  0.5407,  0.4965,  0.5379,  0.4615,
         0.5400,  0.5209,  0.5282,  0.4623,  0.4940,  0.4620,  0.4868,
         0.4660,  0.5264,  0.4883,  0.4788,  0.4839,  0.5172,  0.4876,
         0.5112,  0.5517,  0.5002,  0.5346,  0.4773,  0.4684,  0.5447,
         0.5460,  0.4398,  0.5094,  0.5056,  0.4349,  0.5423,  0.4874,
         0.4811,  0.4988,  0.5411,  0.5133,  0.5336,  0.4974,  0.5196,
         0.5355,  0.5548,  0.4520,  0.4717,  0.4760,  0.4676,  0.5297,
         0.6242,  0.5057,  0.4259,  0.5095,  0.5086,  0.4949,  0.4812,
         0.4812,  0.4881,  0.4336,  0.5327,  0.4477,  0.5556,  0.4962,
         0.5246,  0.4812,  0.5632,  0.4562,  0.4831,  0.5405,  0.4794,
         0.4939,  0.5315,  0.5362,  0.4603,  0.5280,  0.4612,  0.5259,
         0.5264,  0.4296,  0.5079,  0.4567,  0.4376,  0.5168,  0.5523,
         0.4743,  0.4994,  0.5079,  0.5084,  0.4832,  0.5216,  0.5006,
         0.5725,  0.4612,  0.5118,  0.4591,  0.4752,  0.5402,  0.4667,
         0.5448,  0.4881,  0.5045,  0.4985,  0.5134,  0.5320,  0.5066,
         0.5057,  0.4759,  0.5578,  0.5024,  0.5138,  0.5015,  0.5355,
         0.5085,  0.4715,  0.4905,  0.5391,  0.5269,  0.5495,  0.5569,
         0.5116,  0.5231,  0.4858,  0.4935,  0.5055,  0.5140,  0.4811,
         0.4667,  0.5156,  0.5111,  0.4571,  0.4774,  0.6230,  0.5695,
         0.4643,  0.5125,  0.4817,  0.4847,  0.5184,  0.4658,  0.5351,
         0.4681,  0.5222,  0.4635,  0.4773,  0.4562,  0.5007,  0.4755,
         0.5000], device='cuda:0')
tensor(0.6866, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4710,  0.5473,  0.4572,  0.5247,  0.4825,  0.4727,  0.5660,
         0.4493,  0.5186,  0.4579,  0.4406,  0.5572,  0.4714,  0.5010,
         0.4881,  0.5359,  0.5790,  0.5474,  0.5228,  0.4620,  0.5080,
         0.5168,  0.4967,  0.5444,  0.5478,  0.4621,  0.4987,  0.4905,
         0.4909,  0.4774,  0.4701,  0.4138,  0.4464,  0.4426,  0.5094,
         0.4399,  0.5014,  0.5351,  0.4898,  0.4616,  0.5556,  0.4796,
         0.4552,  0.5149,  0.4913,  0.4969,  0.4861,  0.5296,  0.5548,
         0.5271,  0.5132,  0.4901,  0.5383,  0.4831,  0.4985,  0.4753,
         0.5396,  0.5113,  0.4452,  0.5300,  0.4367,  0.4869,  0.4841,
         0.4717,  0.4641,  0.4689,  0.5071,  0.4717,  0.5263,  0.4280,
         0.5517,  0.5083,  0.5009,  0.4391,  0.5155,  0.5029,  0.4589,
         0.4717,  0.4584,  0.4837,  0.5118,  0.5435,  0.4215,  0.5502,
         0.5184,  0.4943,  0.4899,  0.4924,  0.5799,  0.5094,  0.4456,
         0.5437,  0.4026,  0.5143,  0.5658,  0.4231,  0.5278,  0.4727,
         0.5291,  0.4968,  0.4978,  0.4765,  0.4627,  0.4458,  0.4811,
         0.5048,  0.4908,  0.4796,  0.5243,  0.4657,  0.5242,  0.5057,
         0.5708,  0.4874,  0.5451,  0.5761,  0.4083,  0.5237,  0.4754,
         0.5134,  0.3954,  0.4026,  0.4863,  0.5213,  0.5343,  0.4850,
         0.4953,  0.5174,  0.4806,  0.4916,  0.4855,  0.4351,  0.5906,
         0.4637,  0.4721,  0.4707,  0.5017,  0.4027,  0.5389,  0.4349,
         0.5444,  0.4817,  0.4938,  0.5410,  0.5259,  0.4993,  0.4538,
         0.5552,  0.4719,  0.5299,  0.5071,  0.6068,  0.4699,  0.5004,
         0.4932,  0.4837,  0.4357,  0.5372,  0.5232,  0.4737,  0.4737,
         0.4685,  0.4884,  0.4540,  0.5310,  0.4791,  0.5397,  0.4966,
         0.5290,  0.5022,  0.5114,  0.4921,  0.4751,  0.4760,  0.4535,
         0.5665,  0.4438,  0.4655,  0.5039,  0.4752,  0.4316,  0.5129,
         0.4460,  0.4811,  0.5272,  0.5224,  0.4749,  0.5028,  0.5036,
         0.6195,  0.6035,  0.4914,  0.5300,  0.5417,  0.4617,  0.4877,
         0.5483,  0.4578,  0.4534,  0.5465,  0.5033,  0.5215,  0.6034,
         0.4861,  0.6210,  0.4704,  0.4628,  0.4997,  0.4724,  0.5081,
         0.4832,  0.4328,  0.5741,  0.5305,  0.4923,  0.5482,  0.4662,
         0.5879,  0.4763,  0.4914,  0.4198,  0.4431,  0.4784,  0.4667,
         0.5035,  0.5316,  0.4903,  0.4956,  0.5184,  0.6687,  0.4397,
         0.4447,  0.5235,  0.4626,  0.4591,  0.5054,  0.4663,  0.5090,
         0.4835,  0.5211,  0.5046,  0.4775,  0.4919,  0.4722,  0.4650,
         0.4689,  0.5121,  0.5325,  0.4983,  0.5117,  0.4757,  0.4871,
         0.4632,  0.4938,  0.5379,  0.4662,  0.5499,  0.5339,  0.4679,
         0.5181,  0.4895,  0.4368,  0.4687,  0.5115,  0.5042,  0.4637,
         0.4572,  0.5004,  0.4544,  0.4735,  0.5309,  0.4935,  0.4384,
         0.4894,  0.5284,  0.5094,  0.4906,  0.4194,  0.4395,  0.4590,
         0.5059,  0.4821,  0.5433,  0.5693,  0.5225,  0.4363,  0.4484,
         0.5055,  0.4481,  0.4929,  0.5423,  0.4816,  0.4855,  0.4879,
         0.5130,  0.4868,  0.4791,  0.5476,  0.5244,  0.4838,  0.5099,
         0.5061,  0.4585,  0.4658,  0.4826,  0.3853,  0.4642,  0.5284,
         0.4934,  0.5024,  0.4645,  0.4975,  0.4960,  0.5270,  0.5091,
         0.4925,  0.4782,  0.4941,  0.4721,  0.4603,  0.4657,  0.5015,
         0.5031,  0.5148,  0.5926,  0.4673,  0.5570,  0.5006,  0.4698,
         0.5078,  0.6091,  0.4879,  0.4599,  0.5865,  0.4219,  0.4933,
         0.5058,  0.5605,  0.5187,  0.4639,  0.4709,  0.5637,  0.4725,
         0.5257,  0.5022,  0.5295,  0.6085,  0.4810,  0.5267,  0.5442,
         0.4770,  0.5088,  0.4255,  0.4980,  0.4941,  0.4977,  0.3886,
         0.4965,  0.4782,  0.4533,  0.5215,  0.4798,  0.4506,  0.4854,
         0.4807,  0.4865,  0.5237,  0.4615,  0.5053,  0.5093,  0.4902,
         0.5487,  0.5320,  0.5097,  0.4358,  0.4593,  0.5875,  0.4960,
         0.5402,  0.4821,  0.5112,  0.4601,  0.4598,  0.5423,  0.5071,
         0.5402,  0.4861,  0.4531,  0.4971,  0.4586,  0.4741,  0.5033,
         0.5226,  0.5690,  0.4838,  0.4997,  0.4525,  0.6110,  0.4905,
         0.4896,  0.4546,  0.5047,  0.5126,  0.4958,  0.4624,  0.5319,
         0.5527,  0.4318,  0.4950,  0.4926,  0.4318,  0.4861,  0.4976,
         0.5527,  0.5116,  0.5307,  0.4443,  0.5063,  0.4813,  0.5616,
         0.5128,  0.5191,  0.4518,  0.4433,  0.5888,  0.4994,  0.4829,
         0.5140,  0.4908,  0.4398,  0.6203,  0.4718,  0.5055,  0.4493,
         0.4875,  0.4994,  0.5492,  0.4782,  0.5643,  0.4458,  0.4978,
         0.4798,  0.5225,  0.4667,  0.4904,  0.4835,  0.5025,  0.4847,
         0.4354,  0.4988,  0.4163,  0.3815,  0.4415,  0.4967,  0.4636,
         0.4841,  0.5460,  0.5009,  0.4826,  0.4992,  0.4891,  0.4407,
         0.4709,  0.5302,  0.6271,  0.4801,  0.4859,  0.4603,  0.5183,
         0.5406,  0.3968,  0.4594,  0.4869,  0.4520,  0.4343,  0.5313,
         0.5095,  0.5892,  0.4604,  0.4889,  0.4386,  0.4680,  0.5086,
         0.5374,  0.4887,  0.5355,  0.5796,  0.4635,  0.4747,  0.5010,
         0.5939,  0.4539,  0.5128,  0.4958,  0.5558,  0.4177,  0.5029,
         0.5216,  0.5398,  0.5063,  0.5138,  0.5193,  0.4423,  0.4906,
         0.4943,  0.5813,  0.5165,  0.4906,  0.4902,  0.5461,  0.4679,
         0.5147], device='cuda:0')
tensor(0.6761, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5144,  0.4616,  0.4837,  0.4458,  0.5221,  0.5756,  0.5281,
         0.6093,  0.4754,  0.4990,  0.5445,  0.4900,  0.5253,  0.5339,
         0.4830,  0.4372,  0.5141,  0.4612,  0.4351,  0.4199,  0.4224,
         0.4285,  0.4667,  0.4736,  0.4061,  0.5171,  0.4270,  0.4995,
         0.4893,  0.5222,  0.4692,  0.5258,  0.5894,  0.5062,  0.5119,
         0.5257,  0.5659,  0.5007,  0.4484,  0.4948,  0.4815,  0.5536,
         0.5495,  0.4784,  0.5283,  0.4909,  0.4641,  0.5229,  0.6114,
         0.4723,  0.5283,  0.4860,  0.5287,  0.4989,  0.4582,  0.4977,
         0.4172,  0.4761,  0.5821,  0.5154,  0.5468,  0.4907,  0.4109,
         0.5107,  0.4878,  0.4708,  0.4813,  0.5197,  0.4356,  0.4787,
         0.4943,  0.4381,  0.4656,  0.4567,  0.4612,  0.5438,  0.4794,
         0.5445,  0.4785,  0.4667,  0.5197,  0.4710,  0.5243,  0.5429,
         0.5850,  0.4535,  0.5603,  0.4769,  0.4987,  0.6082,  0.4920,
         0.5625,  0.5298,  0.5294,  0.5012,  0.4115,  0.4912,  0.4911,
         0.4539,  0.4564,  0.4945,  0.5560,  0.5246,  0.5881,  0.5370,
         0.3993,  0.5085,  0.4900,  0.4416,  0.5200,  0.5041,  0.4801,
         0.5024,  0.4672,  0.5206,  0.4896,  0.4385,  0.6179,  0.5073,
         0.3876,  0.4658,  0.4464,  0.5210,  0.4996,  0.5325,  0.4902,
         0.4434,  0.5509,  0.4867,  0.4631,  0.6201,  0.5186,  0.4883,
         0.5625,  0.4893,  0.5030,  0.5158,  0.4814,  0.5485,  0.5127,
         0.4682,  0.5209,  0.4801,  0.4980,  0.5181,  0.4544,  0.4938,
         0.5595,  0.4441,  0.5444,  0.5063,  0.5386,  0.5048,  0.4955,
         0.4828,  0.5041,  0.5051,  0.4704,  0.5609,  0.4626,  0.6400,
         0.5770,  0.4590,  0.5203,  0.5134,  0.4497,  0.5305,  0.4582,
         0.3891,  0.4557,  0.4364,  0.5060,  0.5079,  0.4562,  0.4422,
         0.5199,  0.4907,  0.4136,  0.5638,  0.4967,  0.4092,  0.4725,
         0.4648,  0.5090,  0.5080,  0.5279,  0.5387,  0.5099,  0.5068,
         0.4376,  0.5198,  0.5260,  0.4963,  0.4995,  0.4641,  0.5526,
         0.4828,  0.5177,  0.5142,  0.4968,  0.5322,  0.5178,  0.4794,
         0.4456,  0.4685,  0.4440,  0.4944,  0.5141,  0.5202,  0.5431,
         0.5206,  0.4748,  0.4405,  0.4525,  0.5053,  0.4850,  0.5047,
         0.4146,  0.4737,  0.4558,  0.4376,  0.5014,  0.4686,  0.4457,
         0.4163,  0.5643,  0.4529,  0.5219,  0.5064,  0.5331,  0.4488,
         0.5157,  0.4818,  0.4919,  0.4923,  0.5441,  0.4841,  0.5377,
         0.4673,  0.4560,  0.4791,  0.4282,  0.5665,  0.5460,  0.4512,
         0.4214,  0.5061,  0.4237,  0.5323,  0.4274,  0.4942,  0.5985,
         0.5452,  0.5395,  0.4621,  0.4933,  0.5236,  0.4640,  0.3813,
         0.4795,  0.4814,  0.4725,  0.4644,  0.5463,  0.5806,  0.5130,
         0.5001,  0.4604,  0.4329,  0.5793,  0.4944,  0.5106,  0.4080,
         0.4853,  0.5227,  0.5067,  0.4667,  0.4319,  0.4498,  0.4421,
         0.5383,  0.5516,  0.3568,  0.4651,  0.4856,  0.5245,  0.4851,
         0.5309,  0.4166,  0.5005,  0.5076,  0.6195,  0.4756,  0.4849,
         0.4607,  0.4894,  0.5184,  0.5592,  0.5860,  0.4313,  0.5047,
         0.4683,  0.5277,  0.4119,  0.4813,  0.4785,  0.4869,  0.4423,
         0.4758,  0.5756,  0.4867,  0.4105,  0.4868,  0.4871,  0.4752,
         0.4864,  0.5147,  0.5058,  0.4552,  0.6236,  0.4843,  0.4901,
         0.5473,  0.5083,  0.5059,  0.5093,  0.5300,  0.5157,  0.4841,
         0.5315,  0.4667,  0.4765,  0.5192,  0.4662,  0.5216,  0.4429,
         0.5229,  0.4928,  0.4123,  0.5508,  0.4933,  0.5072,  0.4531,
         0.5275,  0.4727,  0.5030,  0.4905,  0.5342,  0.4863,  0.4964,
         0.4649,  0.5031,  0.5302,  0.6000,  0.4363,  0.5293,  0.5270,
         0.5225,  0.4805,  0.4495,  0.5265,  0.4665,  0.4850,  0.4580,
         0.4462,  0.5230,  0.5103,  0.4857,  0.5106,  0.4945,  0.5096,
         0.5045,  0.5137,  0.4745,  0.5641,  0.4761,  0.4580,  0.5523,
         0.4951,  0.4970,  0.4757,  0.5150,  0.4978,  0.4534,  0.4275,
         0.3993,  0.5052,  0.4762,  0.4374,  0.4811,  0.4643,  0.5177,
         0.5031,  0.4834,  0.5197,  0.5056,  0.5295,  0.4572,  0.4406,
         0.4775,  0.4657,  0.5309,  0.5515,  0.4981,  0.5193,  0.4486,
         0.4747,  0.4567,  0.5007,  0.5663,  0.4658,  0.4731,  0.4754,
         0.4532,  0.4607,  0.4625,  0.4913,  0.4590,  0.5681,  0.4996,
         0.5633,  0.5299,  0.4760,  0.4524,  0.4828,  0.4262,  0.5060,
         0.4974,  0.5448,  0.4825,  0.4875,  0.4566,  0.5491,  0.4028,
         0.4890,  0.4336,  0.5751,  0.4400,  0.3798,  0.5284,  0.5414,
         0.4694,  0.4670,  0.5621,  0.6392,  0.5135,  0.4693,  0.4043,
         0.5297,  0.5580,  0.4404,  0.4452,  0.4670,  0.4488,  0.4877,
         0.5533,  0.5850,  0.5125,  0.4479,  0.5520,  0.4149,  0.4500,
         0.4848,  0.4464,  0.5054,  0.5388,  0.4987,  0.4877,  0.5461,
         0.4750,  0.4730,  0.6027,  0.5225,  0.4629,  0.4325,  0.4424,
         0.4886,  0.6365,  0.4576,  0.5123,  0.4977,  0.5247,  0.5430,
         0.4525,  0.5211,  0.5765,  0.4576,  0.5032,  0.6392,  0.4877,
         0.5046,  0.5402,  0.5816,  0.4468,  0.4744,  0.4339,  0.4956,
         0.4640,  0.5007,  0.4475,  0.5064,  0.4951,  0.4979,  0.5145,
         0.5600,  0.4579,  0.5205,  0.4699,  0.5045,  0.5083,  0.4718,
         0.4025], device='cuda:0')
tensor(0.6802, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4757,  0.5270,  0.4304,  0.4381,  0.4590,  0.5419,  0.4618,
         0.4638,  0.4284,  0.4005,  0.4905,  0.4385,  0.4913,  0.4992,
         0.5771,  0.4645,  0.5112,  0.4711,  0.5446,  0.5315,  0.4893,
         0.4953,  0.5109,  0.5139,  0.5098,  0.5139,  0.6372,  0.4957,
         0.4776,  0.5133,  0.4577,  0.5552,  0.4899,  0.5559,  0.5402,
         0.5410,  0.4730,  0.5682,  0.4419,  0.5235,  0.4600,  0.4802,
         0.4693,  0.4737,  0.5336,  0.4617,  0.4920,  0.4430,  0.4790,
         0.4250,  0.4602,  0.5057,  0.5442,  0.4675,  0.5836,  0.5046,
         0.4467,  0.4805,  0.5891,  0.5110,  0.5932,  0.5276,  0.5187,
         0.4869,  0.5030,  0.5717,  0.4690,  0.5518,  0.4553,  0.4563,
         0.4699,  0.4488,  0.5551,  0.5975,  0.4478,  0.4668,  0.5000,
         0.5371,  0.4543,  0.5177,  0.4577,  0.4441,  0.4651,  0.4884,
         0.4670,  0.5247,  0.5057,  0.4363,  0.4904,  0.4933,  0.4944,
         0.4925,  0.4636,  0.4209,  0.4631,  0.5292,  0.4982,  0.4161,
         0.5051,  0.4854,  0.4094,  0.4803,  0.4798,  0.6450,  0.4978,
         0.4636,  0.4818,  0.5743,  0.5515,  0.4910,  0.4619,  0.5641,
         0.4687,  0.5368,  0.4640,  0.5286,  0.4515,  0.5566,  0.5172,
         0.4324,  0.4718,  0.5684,  0.4862,  0.4771,  0.5137,  0.4403,
         0.5720,  0.4680,  0.4833,  0.5175,  0.5676,  0.5077,  0.5080,
         0.4682,  0.4364,  0.5190,  0.4390,  0.4392,  0.4581,  0.4497,
         0.5813,  0.4898,  0.4977,  0.4446,  0.5065,  0.4326,  0.4687,
         0.4614,  0.5899,  0.4626,  0.4317,  0.4841,  0.4614,  0.4614,
         0.5319,  0.5332,  0.4341,  0.4835,  0.5107,  0.3948,  0.4713,
         0.4330,  0.5069,  0.4586,  0.5212,  0.4829,  0.4676,  0.4603,
         0.4684,  0.4713,  0.4227,  0.5093,  0.5025,  0.4425,  0.4615,
         0.5349,  0.5170,  0.5130,  0.4647,  0.5576,  0.4309,  0.5633,
         0.5120,  0.4673,  0.5108,  0.5500,  0.4610,  0.5127,  0.5115,
         0.4547,  0.5405,  0.4146,  0.4654,  0.4222,  0.4835,  0.5125,
         0.4797,  0.5046,  0.5037,  0.4375,  0.4510,  0.4703,  0.5015,
         0.4231,  0.5691,  0.5510,  0.5067,  0.4876,  0.5780,  0.4999,
         0.5255,  0.4210,  0.4388,  0.5071,  0.4876,  0.4781,  0.4738,
         0.4646,  0.5093,  0.5174,  0.4809,  0.5442,  0.4767,  0.4910,
         0.4769,  0.4939,  0.4695,  0.4773,  0.4594,  0.3958,  0.5282,
         0.4940,  0.4575,  0.4814,  0.5590,  0.4970,  0.4683,  0.3964,
         0.5182,  0.4935,  0.4645,  0.4742,  0.4851,  0.5321,  0.4622,
         0.5047,  0.4911,  0.5363,  0.5052,  0.4563,  0.6144,  0.4961,
         0.4879,  0.5713,  0.4287,  0.4560,  0.6074,  0.4792,  0.4686,
         0.5187,  0.3686,  0.4928,  0.6211,  0.4651,  0.5207,  0.4686,
         0.5019,  0.5274,  0.5618,  0.4598,  0.5003,  0.4325,  0.5008,
         0.5394,  0.5016,  0.5003,  0.5657,  0.5003,  0.4389,  0.5101,
         0.5455,  0.5108,  0.5043,  0.4442,  0.4720,  0.5104,  0.5219,
         0.5258,  0.4227,  0.5140,  0.5055,  0.4999,  0.5583,  0.5377,
         0.5611,  0.4786,  0.5951,  0.4938,  0.5693,  0.4767,  0.5074,
         0.5175,  0.5642,  0.5277,  0.4425,  0.4465,  0.4889,  0.5654,
         0.4192,  0.4473,  0.4832,  0.4684,  0.4227,  0.4985,  0.5215,
         0.5131,  0.4371,  0.4353,  0.4829,  0.5447,  0.4745,  0.5044,
         0.4428,  0.4948,  0.4544,  0.4467,  0.5163,  0.5145,  0.4480,
         0.4753,  0.4958,  0.4537,  0.4874,  0.5378,  0.5597,  0.5915,
         0.4931,  0.4544,  0.5740,  0.5137,  0.4957,  0.4814,  0.4881,
         0.4624,  0.5375,  0.5567,  0.4618,  0.4396,  0.4861,  0.4222,
         0.4666,  0.5067,  0.5323,  0.4879,  0.4905,  0.4656,  0.5160,
         0.5254,  0.3609,  0.5038,  0.4560,  0.4752,  0.4994,  0.5050,
         0.4390,  0.5457,  0.4954,  0.5229,  0.4967,  0.5294,  0.4783,
         0.4965,  0.4977,  0.5255,  0.5030,  0.5298,  0.5755,  0.5045,
         0.5195,  0.4587,  0.5379,  0.4890,  0.5101,  0.4577,  0.3942,
         0.5250,  0.4735,  0.4625,  0.5715,  0.4892,  0.4884,  0.4597,
         0.4927,  0.4734,  0.4646,  0.4865,  0.5258,  0.4322,  0.5318,
         0.4473,  0.5160,  0.6177,  0.4957,  0.4909,  0.5684,  0.5259,
         0.4452,  0.5649,  0.5082,  0.4812,  0.4759,  0.4443,  0.6306,
         0.5402,  0.4469,  0.4904,  0.5184,  0.5342,  0.5439,  0.5090,
         0.4408,  0.5370,  0.5161,  0.4685,  0.4871,  0.4000,  0.5192,
         0.4812,  0.4634,  0.4623,  0.4375,  0.4974,  0.5127,  0.5936,
         0.5323,  0.5201,  0.4641,  0.5025,  0.4414,  0.4712,  0.4445,
         0.5701,  0.4681,  0.4910,  0.5247,  0.5189,  0.5883,  0.4580,
         0.4928,  0.5049,  0.4739,  0.5500,  0.5513,  0.5027,  0.4537,
         0.5154,  0.5034,  0.5501,  0.4539,  0.4501,  0.5351,  0.4945,
         0.4431,  0.4319,  0.4655,  0.4787,  0.5329,  0.5105,  0.4415,
         0.5206,  0.4379,  0.5226,  0.4760,  0.5248,  0.5269,  0.5411,
         0.5323,  0.4658,  0.4897,  0.4652,  0.5086,  0.4648,  0.4797,
         0.5495,  0.5748,  0.4809,  0.4753,  0.5114,  0.5015,  0.4378,
         0.4818,  0.5635,  0.6019,  0.5056,  0.5101,  0.5384,  0.4424,
         0.4922,  0.4796,  0.4664,  0.5111,  0.5156,  0.5530,  0.5256,
         0.5143,  0.4596,  0.4647,  0.5270,  0.5141,  0.5027,  0.4246,
         0.5103], device='cuda:0')
tensor(0.6864, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4858,  0.4044,  0.4354,  0.3917,  0.4389,  0.5519,  0.4757,
         0.4950,  0.4189,  0.4689,  0.5429,  0.5996,  0.4703,  0.4777,
         0.4686,  0.4771,  0.5089,  0.4307,  0.6125,  0.4997,  0.5129,
         0.5439,  0.4818,  0.5882,  0.4914,  0.4787,  0.4640,  0.4361,
         0.4382,  0.5332,  0.4732,  0.5773,  0.4911,  0.5279,  0.4179,
         0.4894,  0.5284,  0.5817,  0.4344,  0.5116,  0.5539,  0.5430,
         0.5722,  0.5588,  0.3927,  0.4681,  0.5333,  0.5870,  0.4251,
         0.4914,  0.5063,  0.5967,  0.4582,  0.4471,  0.5366,  0.4470,
         0.5523,  0.4336,  0.5564,  0.5484,  0.4768,  0.4980,  0.4832,
         0.4822,  0.4505,  0.5404,  0.4032,  0.5532,  0.5822,  0.4261,
         0.5149,  0.5165,  0.4951,  0.5108,  0.4707,  0.4446,  0.5415,
         0.4702,  0.4672,  0.5581,  0.5738,  0.4937,  0.5195,  0.5002,
         0.5315,  0.4466,  0.4329,  0.5064,  0.5566,  0.4541,  0.5634,
         0.4414,  0.5577,  0.4708,  0.4844,  0.4711,  0.4736,  0.4251,
         0.4435,  0.5108,  0.5560,  0.5351,  0.5222,  0.5577,  0.4732,
         0.4640,  0.5105,  0.4749,  0.5070,  0.4942,  0.5502,  0.4992,
         0.5332,  0.5567,  0.5388,  0.4725,  0.4913,  0.5127,  0.4778,
         0.5257,  0.4937,  0.5055,  0.4666,  0.5486,  0.4394,  0.4925,
         0.5302,  0.5319,  0.4528,  0.5269,  0.4861,  0.5485,  0.5724,
         0.4803,  0.4577,  0.4851,  0.5193,  0.4666,  0.4804,  0.5295,
         0.4425,  0.4371,  0.3949,  0.5173,  0.5122,  0.4948,  0.4576,
         0.4980,  0.4966,  0.4927,  0.4866,  0.4187,  0.4409,  0.5307,
         0.5355,  0.6410,  0.3625,  0.4518,  0.4512,  0.4491,  0.4986,
         0.5281,  0.4547,  0.5422,  0.4284,  0.5422,  0.4765,  0.4756,
         0.4784,  0.5175,  0.4958,  0.4625,  0.5144,  0.4830,  0.5016,
         0.5453,  0.4653,  0.4307,  0.4716,  0.4295,  0.4540,  0.4569,
         0.5028,  0.4611,  0.5121,  0.5068,  0.5594,  0.5149,  0.5051,
         0.4570,  0.5051,  0.5652,  0.4845,  0.4592,  0.4864,  0.4843,
         0.4973,  0.4832,  0.4935,  0.4372,  0.5184,  0.5605,  0.4679,
         0.5106,  0.5730,  0.4655,  0.4616,  0.5037,  0.5600,  0.5519,
         0.4907,  0.4634,  0.5031,  0.4635,  0.4962,  0.4564,  0.4209,
         0.3764,  0.4395,  0.5239,  0.4540,  0.4146,  0.5549,  0.5091,
         0.5104,  0.4648,  0.5402,  0.5217,  0.5522,  0.4740,  0.5392,
         0.4998,  0.5144,  0.5021,  0.4112,  0.4096,  0.5083,  0.5179,
         0.4662,  0.4692,  0.4683,  0.4510,  0.4827,  0.4619,  0.4457,
         0.5693,  0.6364,  0.4780,  0.4927,  0.4627,  0.4482,  0.5403,
         0.4846,  0.4947,  0.5480,  0.5314,  0.5008,  0.5201,  0.4895,
         0.4983,  0.5098,  0.5052,  0.5301,  0.4847,  0.5152,  0.4194,
         0.4901,  0.4423,  0.4723,  0.4995,  0.5888,  0.4699,  0.5726,
         0.5633,  0.5080,  0.5509,  0.4399,  0.4416,  0.4761,  0.4111,
         0.4517,  0.4147,  0.5779,  0.4498,  0.5047,  0.4387,  0.5082,
         0.4462,  0.4832,  0.4307,  0.4556,  0.4736,  0.4669,  0.4639,
         0.5937,  0.5120,  0.4777,  0.4950,  0.4851,  0.4802,  0.4088,
         0.4413,  0.4994,  0.5191,  0.5299,  0.4496,  0.5661,  0.5445,
         0.4584,  0.4491,  0.4840,  0.5954,  0.5347,  0.5235,  0.3729,
         0.5262,  0.4962,  0.5315,  0.4864,  0.4829,  0.5532,  0.5074,
         0.4451,  0.4681,  0.5317,  0.4366,  0.3782,  0.4428,  0.4830,
         0.4712,  0.4427,  0.4700,  0.4998,  0.6372,  0.4447,  0.4501,
         0.3923,  0.4803,  0.4176,  0.5061,  0.4576,  0.4674,  0.4148,
         0.4741,  0.4765,  0.4789,  0.5405,  0.4876,  0.4756,  0.4737,
         0.4743,  0.4942,  0.5694,  0.5603,  0.4680,  0.4911,  0.3857,
         0.4629,  0.4781,  0.5116,  0.5539,  0.4339,  0.6387,  0.4146,
         0.4957,  0.5305,  0.5119,  0.4789,  0.5496,  0.5335,  0.4913,
         0.5405,  0.4707,  0.4775,  0.4986,  0.4721,  0.5644,  0.4825,
         0.4715,  0.5131,  0.4034,  0.4403,  0.6094,  0.6146,  0.5021,
         0.4833,  0.4647,  0.5192,  0.4936,  0.4332,  0.4526,  0.6357,
         0.5787,  0.4419,  0.5309,  0.5235,  0.4588,  0.4684,  0.4881,
         0.5078,  0.4730,  0.4514,  0.5023,  0.3825,  0.4466,  0.5685,
         0.4661,  0.5122,  0.5630,  0.5188,  0.4634,  0.5616,  0.5542,
         0.4844,  0.4659,  0.6063,  0.4948,  0.5785,  0.5377,  0.5089,
         0.5324,  0.4738,  0.4838,  0.4788,  0.4252,  0.5159,  0.5630,
         0.4828,  0.4702,  0.5391,  0.4789,  0.4528,  0.5054,  0.4923,
         0.4858,  0.4305,  0.5441,  0.4068,  0.4871,  0.4644,  0.4631,
         0.4505,  0.5996,  0.4918,  0.6011,  0.4552,  0.4706,  0.4925,
         0.6017,  0.5057,  0.4312,  0.5705,  0.5713,  0.5538,  0.5169,
         0.5479,  0.4731,  0.5020,  0.4902,  0.4617,  0.5241,  0.4650,
         0.5147,  0.6453,  0.4328,  0.4897,  0.4822,  0.3892,  0.4931,
         0.5614,  0.4535,  0.4919,  0.5302,  0.4571,  0.6137,  0.5218,
         0.4745,  0.4897,  0.4612,  0.4511,  0.4353,  0.5202,  0.5825,
         0.5175,  0.4272,  0.5306,  0.5189,  0.4844,  0.5704,  0.4621,
         0.4623,  0.4724,  0.5188,  0.4237,  0.4918,  0.5320,  0.5704,
         0.5296,  0.5198,  0.5067,  0.4582,  0.5191,  0.5587,  0.4574,
         0.4877,  0.5677,  0.4189,  0.5017,  0.5767,  0.6046,  0.4677,
         0.4878], device='cuda:0')
tensor(0.6831, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4338,  0.4783,  0.4907,  0.4324,  0.4790,  0.5339,  0.3961,
         0.5297,  0.3974,  0.4393,  0.4573,  0.4572,  0.5244,  0.5479,
         0.4544,  0.4258,  0.5737,  0.5119,  0.4987,  0.5472,  0.5583,
         0.4918,  0.5291,  0.5026,  0.4383,  0.4773,  0.4314,  0.4592,
         0.4866,  0.5084,  0.4323,  0.5204,  0.4208,  0.4125,  0.5626,
         0.5014,  0.4525,  0.4793,  0.5277,  0.4923,  0.4898,  0.4632,
         0.4980,  0.4117,  0.4318,  0.4805,  0.3814,  0.4701,  0.5097,
         0.4702,  0.5047,  0.3999,  0.4686,  0.4515,  0.5994,  0.4884,
         0.4891,  0.3988,  0.5426,  0.4380,  0.5680,  0.4825,  0.5117,
         0.4473,  0.4530,  0.4072,  0.4966,  0.3778,  0.5025,  0.4464,
         0.5878,  0.4258,  0.4305,  0.4350,  0.4463,  0.4682,  0.3827,
         0.5045,  0.5570,  0.5603,  0.3711,  0.5653,  0.4216,  0.5228,
         0.5251,  0.4196,  0.4690,  0.4606,  0.4048,  0.4144,  0.4630,
         0.4865,  0.5633,  0.4479,  0.4962,  0.4320,  0.5190,  0.4302,
         0.4715,  0.4403,  0.4483,  0.4745,  0.5310,  0.4544,  0.5148,
         0.3836,  0.4237,  0.4427,  0.4924,  0.4554,  0.4548,  0.6308,
         0.6489,  0.5491,  0.5164,  0.5095,  0.5012,  0.4748,  0.5705,
         0.4521,  0.4364,  0.4424,  0.5418,  0.5226,  0.4351,  0.5146,
         0.4608,  0.5545,  0.5292,  0.4449,  0.4577,  0.5177,  0.4772,
         0.4575,  0.5265,  0.5237,  0.5355,  0.4357,  0.4852,  0.5187,
         0.5397,  0.4731,  0.4452,  0.5288,  0.5178,  0.5677,  0.4577,
         0.4269,  0.6084,  0.4922,  0.5567,  0.4648,  0.4982,  0.5254,
         0.5406,  0.6825,  0.5575,  0.4189,  0.5853,  0.4509,  0.4387,
         0.4688,  0.4774,  0.5033,  0.4248,  0.4848,  0.4379,  0.4523,
         0.4447,  0.5506,  0.5015,  0.4801,  0.4832,  0.4983,  0.4850,
         0.4824,  0.4930,  0.4726,  0.4814,  0.4429,  0.4804,  0.5038,
         0.5728,  0.4318,  0.4639,  0.4335,  0.5881,  0.5452,  0.5543,
         0.4469,  0.4877,  0.6114,  0.5081,  0.4988,  0.6089,  0.4093,
         0.4462,  0.5096,  0.4502,  0.4375,  0.5993,  0.4360,  0.5078,
         0.4402,  0.4645,  0.5242,  0.4638,  0.4337,  0.5625,  0.4434,
         0.4097,  0.5314,  0.4045,  0.4789,  0.5031,  0.4732,  0.5264,
         0.5720,  0.5176,  0.4685,  0.5887,  0.4660,  0.4722,  0.4831,
         0.4897,  0.4238,  0.6547,  0.5675,  0.5262,  0.5719,  0.5242,
         0.4198,  0.5545,  0.4554,  0.5092,  0.4879,  0.4899,  0.4997,
         0.5358,  0.5800,  0.4165,  0.5006,  0.4479,  0.6091,  0.4581,
         0.4722,  0.5037,  0.5941,  0.5177,  0.5103,  0.4334,  0.6318,
         0.5261,  0.4553,  0.4278,  0.5307,  0.5272,  0.5315,  0.5429,
         0.4499,  0.5616,  0.6019,  0.4203,  0.4591,  0.5614,  0.5196,
         0.5391,  0.4512,  0.4712,  0.4306,  0.5079,  0.4657,  0.5797,
         0.5105,  0.4264,  0.5177,  0.4641,  0.4578,  0.4995,  0.4995,
         0.5480,  0.4508,  0.4110,  0.5884,  0.4973,  0.4708,  0.4760,
         0.4625,  0.5685,  0.4098,  0.5036,  0.4889,  0.4983,  0.4300,
         0.5285,  0.5180,  0.5152,  0.5625,  0.5112,  0.5203,  0.4280,
         0.5307,  0.5024,  0.5046,  0.5211,  0.4500,  0.5230,  0.5279,
         0.4268,  0.4961,  0.4711,  0.5318,  0.5289,  0.5232,  0.4352,
         0.4285,  0.5340,  0.5674,  0.5053,  0.4527,  0.4699,  0.4137,
         0.4393,  0.5705,  0.5353,  0.4419,  0.4174,  0.5577,  0.6145,
         0.5434,  0.5092,  0.5011,  0.5345,  0.5016,  0.5426,  0.4791,
         0.5325,  0.4612,  0.4587,  0.6327,  0.4504,  0.4870,  0.4794,
         0.4412,  0.5877,  0.4369,  0.5158,  0.5913,  0.5131,  0.5055,
         0.4495,  0.4883,  0.5083,  0.4907,  0.4575,  0.3870,  0.4493,
         0.4964,  0.4919,  0.4534,  0.4265,  0.5889,  0.5531,  0.5232,
         0.5266,  0.5259,  0.4163,  0.5275,  0.4360,  0.5187,  0.4944,
         0.4388,  0.5161,  0.5006,  0.6132,  0.4695,  0.4979,  0.5571,
         0.5113,  0.5537,  0.4203,  0.4876,  0.5139,  0.4230,  0.5391,
         0.5713,  0.4368,  0.5245,  0.5887,  0.4553,  0.4551,  0.4643,
         0.4848,  0.4790,  0.4696,  0.4951,  0.5311,  0.5413,  0.4665,
         0.4396,  0.5587,  0.5112,  0.4948,  0.4803,  0.4842,  0.5218,
         0.4933,  0.4743,  0.5045,  0.5874,  0.5642,  0.5521,  0.4567,
         0.4957,  0.5585,  0.4877,  0.4910,  0.4262,  0.6007,  0.4695,
         0.4454,  0.5405,  0.5257,  0.5514,  0.5781,  0.4331,  0.5240,
         0.3814,  0.3481,  0.4694,  0.4839,  0.4397,  0.6049,  0.4859,
         0.4943,  0.5072,  0.4956,  0.5273,  0.5621,  0.4643,  0.4898,
         0.4105,  0.5191,  0.5838,  0.5417,  0.4477,  0.4958,  0.5494,
         0.5862,  0.5465,  0.4997,  0.4015,  0.4412,  0.5347,  0.4652,
         0.4353,  0.5421,  0.5389,  0.5182,  0.5418,  0.4680,  0.3574,
         0.4648,  0.4252,  0.5652,  0.5376,  0.4069,  0.4575,  0.4867,
         0.4421,  0.4496,  0.4581,  0.4998,  0.4240,  0.5187,  0.5109,
         0.4449,  0.5634,  0.4261,  0.4667,  0.4683,  0.5515,  0.4565,
         0.6785,  0.4771,  0.5955,  0.4703,  0.4788,  0.4793,  0.5020,
         0.4185,  0.5485,  0.4633,  0.5728,  0.4437,  0.4823,  0.4077,
         0.4194,  0.4379,  0.4979,  0.3827,  0.4413,  0.5295,  0.5363,
         0.4648,  0.5530,  0.4290,  0.4342,  0.3967,  0.5296,  0.4099,
         0.4278], device='cuda:0')
tensor(0.6816, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4744,  0.4386,  0.5280,  0.6441,  0.4283,  0.4682,  0.4104,
         0.4898,  0.5899,  0.4776,  0.4655,  0.5444,  0.4204,  0.5157,
         0.4978,  0.5179,  0.5427,  0.6977,  0.4592,  0.5138,  0.5124,
         0.4642,  0.4487,  0.4101,  0.4710,  0.4283,  0.4514,  0.4720,
         0.5589,  0.3960,  0.4933,  0.4850,  0.5151,  0.5032,  0.3945,
         0.6126,  0.4945,  0.4828,  0.5464,  0.4363,  0.4914,  0.4790,
         0.4471,  0.4971,  0.5354,  0.5443,  0.5712,  0.5366,  0.5092,
         0.5292,  0.4476,  0.5647,  0.3996,  0.4527,  0.4691,  0.5361,
         0.5849,  0.4435,  0.5378,  0.4323,  0.3716,  0.5520,  0.4795,
         0.4636,  0.5326,  0.4429,  0.4591,  0.4514,  0.4370,  0.4180,
         0.4620,  0.5433,  0.4572,  0.4843,  0.4897,  0.5163,  0.4844,
         0.4230,  0.5454,  0.4958,  0.5987,  0.4705,  0.5894,  0.5022,
         0.4264,  0.4373,  0.4878,  0.4381,  0.4218,  0.4869,  0.5513,
         0.4944,  0.5124,  0.4781,  0.4630,  0.4846,  0.4569,  0.5251,
         0.4324,  0.5733,  0.4892,  0.5081,  0.4339,  0.4265,  0.5316,
         0.4195,  0.4371,  0.5722,  0.3848,  0.4990,  0.4231,  0.4516,
         0.5117,  0.4415,  0.5500,  0.4483,  0.4591,  0.4508,  0.4296,
         0.5784,  0.4876,  0.5641,  0.5644,  0.4357,  0.5286,  0.4488,
         0.4942,  0.3996,  0.6203,  0.5197,  0.4892,  0.4306,  0.4912,
         0.4751,  0.4850,  0.4365,  0.5120,  0.5525,  0.6253,  0.4374,
         0.5421,  0.4831,  0.5801,  0.4482,  0.6052,  0.4839,  0.4740,
         0.5210,  0.4610,  0.4804,  0.5751,  0.5065,  0.5163,  0.4995,
         0.4884,  0.4302,  0.4781,  0.4891,  0.5768,  0.4380,  0.5322,
         0.4537,  0.4519,  0.4787,  0.5069,  0.4279,  0.5098,  0.5228,
         0.4658,  0.5657,  0.5245,  0.5461,  0.5434,  0.4568,  0.5258,
         0.4909,  0.5831,  0.4838,  0.5433,  0.4099,  0.4928,  0.5001,
         0.4940,  0.4935,  0.5055,  0.5493,  0.4935,  0.4159,  0.4619,
         0.3615,  0.6095,  0.5372,  0.6033,  0.5771,  0.4784,  0.5139,
         0.5668,  0.5006,  0.4402,  0.5281,  0.4337,  0.6263,  0.4289,
         0.4827,  0.4884,  0.4672,  0.4854,  0.5425,  0.4825,  0.5186,
         0.4775,  0.4771,  0.4880,  0.5032,  0.4696,  0.4369,  0.4702,
         0.5676,  0.5448,  0.5065,  0.5689,  0.4597,  0.4974,  0.5138,
         0.4421,  0.5562,  0.5570,  0.6394,  0.5362,  0.5420,  0.5391,
         0.4892,  0.5035,  0.3833,  0.5277,  0.4404,  0.4759,  0.4643,
         0.4206,  0.5126,  0.5624,  0.5305,  0.5559,  0.5205,  0.5073,
         0.5250,  0.4855,  0.5708,  0.5443,  0.5278,  0.4962,  0.4987,
         0.4823,  0.4581,  0.3825,  0.5345,  0.3859,  0.4448,  0.3812,
         0.5437,  0.4832,  0.5104,  0.5207,  0.4652,  0.5354,  0.4458,
         0.4833,  0.5363,  0.3800,  0.5889,  0.5471,  0.3770,  0.4648,
         0.5712,  0.5043,  0.4675,  0.4909,  0.3862,  0.5177,  0.3474,
         0.5673,  0.5162,  0.4272,  0.4230,  0.5182,  0.5114,  0.3949,
         0.5109,  0.4516,  0.4246,  0.4959,  0.5101,  0.4991,  0.5216,
         0.4755,  0.4904,  0.5319,  0.4486,  0.4804,  0.5468,  0.5485,
         0.6738,  0.4321,  0.4812,  0.5066,  0.3280,  0.4683,  0.4789,
         0.5400,  0.5379,  0.5142,  0.5474,  0.4608,  0.4909,  0.5097,
         0.4951,  0.4105,  0.5408,  0.6323,  0.4792,  0.5251,  0.4625,
         0.5473,  0.5526,  0.4918,  0.5133,  0.3969,  0.4351,  0.3934,
         0.4376,  0.5518,  0.5518,  0.5332,  0.5415,  0.5706,  0.4594,
         0.4576,  0.5882,  0.5860,  0.5369,  0.4962,  0.5183,  0.4439,
         0.4550,  0.4772,  0.4305,  0.5161,  0.5062,  0.5265,  0.5061,
         0.4778,  0.4948,  0.5207,  0.5346,  0.4310,  0.6228,  0.6792,
         0.4504,  0.4612,  0.4505,  0.4603,  0.4637,  0.4953,  0.5779,
         0.4060,  0.6208,  0.4330,  0.4711,  0.4655,  0.4695,  0.5022,
         0.4967,  0.5106,  0.4706,  0.4643,  0.5185,  0.4824,  0.5442,
         0.4458,  0.4588,  0.3908,  0.5261,  0.4958,  0.4919,  0.5304,
         0.5327,  0.5684,  0.4262,  0.5169,  0.3898,  0.4287,  0.4963,
         0.4311,  0.4672,  0.4175,  0.4830,  0.5690,  0.4924,  0.5070,
         0.4884,  0.4326,  0.4329,  0.5448,  0.4879,  0.5889,  0.4657,
         0.4599,  0.4914,  0.5330,  0.5594,  0.5318,  0.5653,  0.4786,
         0.4944,  0.5637,  0.5307,  0.4447,  0.5113,  0.4918,  0.4677,
         0.5225,  0.4710,  0.4284,  0.4701,  0.5831,  0.4310,  0.4446,
         0.5233,  0.6170,  0.4931,  0.5342,  0.5477,  0.4532,  0.5043,
         0.4650,  0.5732,  0.4164,  0.5390,  0.5593,  0.4531,  0.5638,
         0.4536,  0.5075,  0.4807,  0.5283,  0.5680,  0.4450,  0.5159,
         0.5269,  0.5526,  0.5775,  0.4032,  0.5021,  0.4700,  0.4934,
         0.5651,  0.5730,  0.5361,  0.5057,  0.5395,  0.5514,  0.5523,
         0.4543,  0.4537,  0.5180,  0.4025,  0.7071,  0.4870,  0.5281,
         0.4215,  0.5749,  0.4465,  0.4965,  0.5170,  0.4969,  0.5078,
         0.5956,  0.4351,  0.4462,  0.4736,  0.4112,  0.4573,  0.4841,
         0.3575,  0.4303,  0.4270,  0.5989,  0.4126,  0.4584,  0.4721,
         0.5390,  0.4880,  0.4127,  0.5824,  0.5700,  0.4658,  0.4589,
         0.4303,  0.5645,  0.4505,  0.4640,  0.4946,  0.5266,  0.4064,
         0.4408,  0.5953,  0.5494,  0.5707,  0.5334,  0.5571,  0.4848,
         0.4962], device='cuda:0')
tensor(0.6752, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5629,  0.4866,  0.5325,  0.4044,  0.4633,  0.4965,  0.5499,
         0.5276,  0.5755,  0.4570,  0.4067,  0.6127,  0.4521,  0.4594,
         0.5020,  0.6021,  0.5110,  0.5257,  0.4415,  0.4432,  0.5464,
         0.4447,  0.5460,  0.4818,  0.5155,  0.5107,  0.4090,  0.4424,
         0.4724,  0.3972,  0.4347,  0.4652,  0.5555,  0.5404,  0.4934,
         0.6120,  0.6001,  0.5075,  0.5925,  0.4352,  0.5500,  0.4914,
         0.5240,  0.5874,  0.5395,  0.4969,  0.4566,  0.5171,  0.5150,
         0.5325,  0.4992,  0.6144,  0.4875,  0.5617,  0.5904,  0.4899,
         0.4867,  0.4626,  0.4817,  0.5890,  0.3658,  0.4391,  0.4877,
         0.4558,  0.5057,  0.4586,  0.6019,  0.4384,  0.5131,  0.4928,
         0.4914,  0.4569,  0.3787,  0.5046,  0.5963,  0.5412,  0.5330,
         0.4892,  0.5514,  0.5361,  0.5236,  0.4703,  0.5308,  0.5222,
         0.5250,  0.4648,  0.4602,  0.4276,  0.5189,  0.6150,  0.5569,
         0.4145,  0.5626,  0.3941,  0.5282,  0.4595,  0.4471,  0.4596,
         0.4752,  0.5701,  0.4309,  0.4652,  0.5552,  0.4373,  0.4375,
         0.4507,  0.3506,  0.4583,  0.5604,  0.5034,  0.5342,  0.5032,
         0.3983,  0.5323,  0.5109,  0.5106,  0.5288,  0.4695,  0.5363,
         0.5277,  0.3768,  0.5319,  0.4310,  0.4960,  0.4389,  0.4792,
         0.5188,  0.4806,  0.5414,  0.5393,  0.4574,  0.6488,  0.4776,
         0.4306,  0.5418,  0.4396,  0.5033,  0.4952,  0.5029,  0.4872,
         0.5141,  0.4348,  0.6155,  0.5504,  0.5215,  0.5780,  0.4596,
         0.4747,  0.4787,  0.5385,  0.5458,  0.4446,  0.4091,  0.7005,
         0.5136,  0.5074,  0.5431,  0.5405,  0.4383,  0.6167,  0.5509,
         0.5766,  0.4553,  0.4156,  0.6318,  0.4352,  0.4960,  0.4840,
         0.4419,  0.5263,  0.4015,  0.5782,  0.5112,  0.4814,  0.6682,
         0.5207,  0.5351,  0.4914,  0.5242,  0.4369,  0.5197,  0.5398,
         0.5244,  0.4554,  0.4562,  0.4867,  0.5253,  0.4662,  0.5213,
         0.5259,  0.4408,  0.4421,  0.5230,  0.4703,  0.3982,  0.3439,
         0.5631,  0.4983,  0.3864,  0.4576,  0.6127,  0.4828,  0.4986,
         0.5134,  0.4456,  0.5733,  0.5474,  0.4977,  0.5175,  0.4792,
         0.4975,  0.5385,  0.5772,  0.5484,  0.4647,  0.6493,  0.5308,
         0.3706,  0.5163,  0.4230,  0.5064,  0.4321,  0.4073,  0.4721,
         0.4803,  0.4503,  0.5923,  0.4442,  0.4413,  0.5450,  0.4385,
         0.4926,  0.4897,  0.3951,  0.5686,  0.4453,  0.4547,  0.4294,
         0.4629,  0.6104,  0.5915,  0.4464,  0.5368,  0.5144,  0.4835,
         0.5241,  0.4251,  0.5221,  0.5184,  0.4813,  0.3930,  0.4817,
         0.5863,  0.5053,  0.5180,  0.4803,  0.4826,  0.3743,  0.4479,
         0.5741,  0.5370,  0.4200,  0.5814,  0.4434,  0.6281,  0.5112,
         0.5311,  0.4423,  0.4985,  0.5502,  0.4241,  0.4572,  0.5120,
         0.3891,  0.5612,  0.4194,  0.5869,  0.4297,  0.4863,  0.5308,
         0.6110,  0.5534,  0.5739,  0.5133,  0.5559,  0.5257,  0.5441,
         0.5026,  0.4586,  0.3731,  0.4691,  0.4894,  0.3831,  0.4778,
         0.6502,  0.5810,  0.5286,  0.3907,  0.7066,  0.5314,  0.4294,
         0.5398,  0.5482,  0.6008,  0.4008,  0.5562,  0.4261,  0.5327,
         0.5397,  0.5094,  0.4866,  0.5639,  0.5154,  0.5041,  0.4850,
         0.4212,  0.5776,  0.5213,  0.3842,  0.5265,  0.5476,  0.4405,
         0.4326,  0.4827,  0.5578,  0.4949,  0.4946,  0.5722,  0.4275,
         0.5278,  0.5355,  0.5799,  0.4457,  0.4860,  0.4444,  0.5127,
         0.5179,  0.4188,  0.4585,  0.4914,  0.5019,  0.5540,  0.5459,
         0.5250,  0.4482,  0.5633,  0.5053,  0.5869,  0.4515,  0.5504,
         0.4588,  0.4719,  0.5553,  0.5960,  0.3841,  0.4782,  0.4465,
         0.5541,  0.5571,  0.4135,  0.4875,  0.6274,  0.5581,  0.4313,
         0.4911,  0.5062,  0.4302,  0.4997,  0.5709,  0.4765,  0.5136,
         0.4612,  0.4474,  0.5044,  0.6054,  0.5380,  0.4084,  0.5209,
         0.3802,  0.3280,  0.5071,  0.5672,  0.4857,  0.5289,  0.4629,
         0.4729,  0.5109,  0.5133,  0.5093,  0.5311,  0.4696,  0.4972,
         0.5030,  0.4240,  0.5508,  0.7065,  0.5430,  0.4729,  0.5647,
         0.5460,  0.4252,  0.5224,  0.4024,  0.4680,  0.4989,  0.4507,
         0.5847,  0.3991,  0.4607,  0.5812,  0.3991,  0.5191,  0.5104,
         0.4392,  0.4228,  0.4850,  0.5208,  0.4344,  0.5478,  0.4695,
         0.5385,  0.3791,  0.4030,  0.5866,  0.5610,  0.5095,  0.4556,
         0.4734,  0.4216,  0.4829,  0.4744,  0.4507,  0.4718,  0.5040,
         0.4567,  0.4750,  0.6082,  0.5042,  0.5486,  0.4416,  0.5401,
         0.4716,  0.4602,  0.5031,  0.5420,  0.5185,  0.4219,  0.5102,
         0.4062,  0.4926,  0.4558,  0.4695,  0.4746,  0.4964,  0.4906,
         0.4067,  0.4009,  0.4171,  0.5137,  0.5736,  0.4662,  0.5113,
         0.5840,  0.4912,  0.6012,  0.5561,  0.4176,  0.5123,  0.4969,
         0.4871,  0.6418,  0.5249,  0.5632,  0.4487,  0.5905,  0.4495,
         0.5273,  0.4445,  0.4936,  0.4474,  0.4332,  0.4764,  0.6065,
         0.5126,  0.5191,  0.3906,  0.4501,  0.4679,  0.4603,  0.4812,
         0.4792,  0.4620,  0.4503,  0.4712,  0.4693,  0.5338,  0.4726,
         0.6150,  0.4290,  0.4331,  0.5905,  0.5595,  0.4471,  0.5049,
         0.4343,  0.5510,  0.5384,  0.4312,  0.4847,  0.5294,  0.4866,
         0.6207], device='cuda:0')
tensor(0.6768, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4776,  0.5597,  0.4767,  0.5087,  0.5064,  0.4109,  0.4830,
         0.5803,  0.3878,  0.3501,  0.5674,  0.3876,  0.5902,  0.5324,
         0.4250,  0.4511,  0.4532,  0.4774,  0.4678,  0.4212,  0.4470,
         0.5137,  0.5729,  0.4556,  0.5158,  0.5481,  0.4900,  0.5707,
         0.5459,  0.5938,  0.5372,  0.5686,  0.4354,  0.4692,  0.5810,
         0.3842,  0.4671,  0.4949,  0.4000,  0.4901,  0.5132,  0.5594,
         0.5320,  0.4987,  0.4923,  0.3898,  0.5583,  0.5252,  0.5209,
         0.5435,  0.3812,  0.5799,  0.5737,  0.4316,  0.4706,  0.5296,
         0.4680,  0.6272,  0.6131,  0.5260,  0.5852,  0.5811,  0.4931,
         0.5322,  0.5127,  0.6332,  0.3737,  0.4916,  0.6133,  0.5425,
         0.4704,  0.5599,  0.4333,  0.4366,  0.4472,  0.5518,  0.5237,
         0.4532,  0.5792,  0.4242,  0.4638,  0.5437,  0.5278,  0.5789,
         0.4411,  0.5290,  0.5348,  0.4871,  0.4193,  0.5372,  0.6013,
         0.4469,  0.5300,  0.5152,  0.5621,  0.5023,  0.4765,  0.3936,
         0.4412,  0.4687,  0.5709,  0.5217,  0.4546,  0.5072,  0.5007,
         0.4361,  0.5360,  0.5645,  0.4949,  0.4068,  0.5089,  0.6313,
         0.5333,  0.5653,  0.5056,  0.5898,  0.4785,  0.5161,  0.4907,
         0.5140,  0.6449,  0.5439,  0.5311,  0.5237,  0.4923,  0.4498,
         0.5202,  0.6066,  0.4683,  0.4514,  0.5239,  0.4564,  0.4687,
         0.4970,  0.6367,  0.4689,  0.4707,  0.3560,  0.5228,  0.4486,
         0.5167,  0.4759,  0.4694,  0.4843,  0.4948,  0.5373,  0.5254,
         0.6508,  0.5676,  0.6138,  0.4960,  0.5625,  0.6154,  0.5862,
         0.4832,  0.4129,  0.5661,  0.4260,  0.4738,  0.4262,  0.5599,
         0.4433,  0.5067,  0.4044,  0.5309,  0.3968,  0.5394,  0.5194,
         0.4530,  0.4572,  0.4273,  0.5120,  0.5810,  0.5224,  0.5611,
         0.4936,  0.4205,  0.5385,  0.4658,  0.5511,  0.4419,  0.5872,
         0.4650,  0.4056,  0.5812,  0.5028,  0.4893,  0.5438,  0.6701,
         0.5988,  0.4261,  0.5473,  0.4883,  0.5104,  0.4113,  0.5444,
         0.4897,  0.4896,  0.4516,  0.4406,  0.4534,  0.5539,  0.4551,
         0.5821,  0.5303,  0.4549,  0.5497,  0.5069,  0.5455,  0.5710,
         0.3785,  0.4899,  0.6221,  0.5944,  0.4328,  0.4507,  0.5156,
         0.5568,  0.6353,  0.4025,  0.6100,  0.4884,  0.5313,  0.5001,
         0.4483,  0.6157,  0.4700,  0.5563,  0.5437,  0.5360,  0.4232,
         0.5099,  0.6149,  0.5463,  0.4217,  0.4814,  0.4518,  0.6147,
         0.4543,  0.6002,  0.4624,  0.3486,  0.4606,  0.5820,  0.4998,
         0.5809,  0.5400,  0.3915,  0.5179,  0.3819,  0.4531,  0.4862,
         0.4296,  0.4619,  0.4883,  0.4513,  0.5581,  0.5303,  0.4365,
         0.5866,  0.3682,  0.5200,  0.4754,  0.5522,  0.5248,  0.4784,
         0.5273,  0.6015,  0.7295,  0.5402,  0.5169,  0.4394,  0.5849,
         0.5334,  0.5949,  0.5938,  0.5725,  0.4956,  0.4291,  0.4210,
         0.4610,  0.5144,  0.5056,  0.4231,  0.6788,  0.4205,  0.4511,
         0.5473,  0.4195,  0.5409,  0.5619,  0.5647,  0.5601,  0.5028,
         0.4904,  0.5942,  0.4308,  0.4651,  0.5186,  0.3594,  0.4516,
         0.4966,  0.4642,  0.4768,  0.3447,  0.4199,  0.4191,  0.4809,
         0.5005,  0.4103,  0.5128,  0.4952,  0.5379,  0.5216,  0.4124,
         0.5803,  0.6207,  0.5835,  0.3635,  0.5267,  0.4623,  0.6475,
         0.5518,  0.5860,  0.4867,  0.5216,  0.4458,  0.4979,  0.4273,
         0.5690,  0.4828,  0.5602,  0.5716,  0.5844,  0.4927,  0.4103,
         0.5887,  0.5001,  0.4956,  0.5334,  0.4099,  0.5554,  0.4747,
         0.5296,  0.5421,  0.5043,  0.5217,  0.5582,  0.4394,  0.5544,
         0.4671,  0.4569,  0.4906,  0.4443,  0.6060,  0.4807,  0.5632,
         0.5203,  0.4328,  0.5018,  0.4481,  0.5531,  0.4476,  0.4960,
         0.3932,  0.4955,  0.6326,  0.5251,  0.6179,  0.4974,  0.6571,
         0.4796,  0.5354,  0.4691,  0.5923,  0.4056,  0.4412,  0.5661,
         0.5030,  0.5573,  0.6023,  0.5163,  0.6364,  0.4899,  0.4099,
         0.5020,  0.5652,  0.5365,  0.5624,  0.6272,  0.4777,  0.4308,
         0.5951,  0.4386,  0.5538,  0.5987,  0.5903,  0.5395,  0.4376,
         0.5200,  0.4912,  0.5709,  0.6216,  0.6217,  0.4437,  0.4677,
         0.6379,  0.5082,  0.4119,  0.5577,  0.5563,  0.5535,  0.4814,
         0.5664,  0.5823,  0.5671,  0.5653,  0.5047,  0.4567,  0.4901,
         0.4798,  0.4852,  0.4069,  0.4204,  0.4326,  0.5390,  0.5296,
         0.6378,  0.5309,  0.4369,  0.4216,  0.4985,  0.3673,  0.6177,
         0.4561,  0.5509,  0.5016,  0.4571,  0.5438,  0.5173,  0.5478,
         0.4988,  0.4924,  0.4649,  0.4301,  0.5098,  0.4992,  0.5480,
         0.6106,  0.5017,  0.5814,  0.5613,  0.4162,  0.4872,  0.5129,
         0.4052,  0.5658,  0.4965,  0.5314,  0.5340,  0.4889,  0.4519,
         0.4717,  0.5808,  0.4148,  0.3525,  0.5350,  0.4621,  0.5475,
         0.4273,  0.4731,  0.6378,  0.5307,  0.4872,  0.3690,  0.4364,
         0.5029,  0.3907,  0.4807,  0.5399,  0.4332,  0.4858,  0.5062,
         0.4919,  0.5361,  0.4956,  0.5909,  0.5228,  0.4644,  0.4632,
         0.4986,  0.5790,  0.5875,  0.5214,  0.4548,  0.5781,  0.5046,
         0.5157,  0.5059,  0.3921,  0.5009,  0.4391,  0.5595,  0.6325,
         0.4663,  0.5330,  0.5750,  0.4842,  0.4473,  0.6249,  0.5800,
         0.3960], device='cuda:0')
tensor(0.6638, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4960,  0.5795,  0.6496,  0.4805,  0.4688,  0.5679,  0.5767,
         0.5288,  0.5089,  0.4375,  0.4691,  0.4186,  0.7018,  0.5340,
         0.4706,  0.5384,  0.3814,  0.3931,  0.6022,  0.4632,  0.5223,
         0.5034,  0.4737,  0.3908,  0.6257,  0.5468,  0.6715,  0.4403,
         0.4224,  0.4934,  0.5898,  0.5468,  0.4955,  0.4704,  0.4846,
         0.6202,  0.4819,  0.5084,  0.5032,  0.4682,  0.4790,  0.4540,
         0.5526,  0.5062,  0.5898,  0.3716,  0.4859,  0.4378,  0.5716,
         0.6059,  0.5720,  0.5411,  0.3865,  0.4477,  0.5974,  0.6083,
         0.4655,  0.6061,  0.4715,  0.4910,  0.6298,  0.4748,  0.6107,
         0.5412,  0.5665,  0.4217,  0.3527,  0.4637,  0.3648,  0.5432,
         0.4145,  0.4499,  0.6137,  0.4484,  0.5223,  0.4322,  0.4206,
         0.5185,  0.7203,  0.5583,  0.5448,  0.3778,  0.5639,  0.5677,
         0.5133,  0.4619,  0.5509,  0.6095,  0.5340,  0.4763,  0.5531,
         0.5018,  0.5903,  0.5179,  0.4821,  0.3765,  0.5250,  0.5253,
         0.5401,  0.5524,  0.4986,  0.5582,  0.4941,  0.4867,  0.4904,
         0.4556,  0.4510,  0.5579,  0.5994,  0.6421,  0.4484,  0.4148,
         0.5178,  0.4352,  0.5694,  0.5957,  0.3367,  0.3948,  0.4741,
         0.4298,  0.4854,  0.4587,  0.4031,  0.5002,  0.5011,  0.6015,
         0.3616,  0.4629,  0.5340,  0.5324,  0.6222,  0.6679,  0.6502,
         0.5205,  0.4991,  0.4861,  0.6239,  0.7080,  0.6061,  0.3839,
         0.5799,  0.6020,  0.6135,  0.4896,  0.4795,  0.4834,  0.5135,
         0.4564,  0.6095,  0.5065,  0.4818,  0.5595,  0.5257,  0.3885,
         0.5582,  0.5376,  0.4619,  0.4775,  0.6222,  0.4010,  0.5677,
         0.5451,  0.5078,  0.5078,  0.6475,  0.4093,  0.6092,  0.4544,
         0.5493,  0.4801,  0.5778,  0.4153,  0.5168,  0.5953,  0.5170,
         0.4982,  0.6187,  0.6918,  0.4500,  0.5320,  0.5626,  0.4595,
         0.6001,  0.5618,  0.5036,  0.6151,  0.5479,  0.5751,  0.5800,
         0.5223,  0.4530,  0.5740,  0.5653,  0.4319,  0.5013,  0.5099,
         0.6255,  0.6125,  0.4812,  0.3897,  0.5431,  0.4631,  0.5163,
         0.4893,  0.6954,  0.4591,  0.6278,  0.5412,  0.3784,  0.4285,
         0.4737,  0.4476,  0.5932,  0.5338,  0.6160,  0.5162,  0.5620,
         0.5365,  0.5669,  0.4485,  0.5783,  0.5354,  0.4467,  0.5344,
         0.4536,  0.5855,  0.5866,  0.4086,  0.3740,  0.5257,  0.5147,
         0.4970,  0.5373,  0.4160,  0.5606,  0.4495,  0.4623,  0.4826,
         0.4304,  0.5592,  0.5642,  0.4454,  0.5979,  0.4958,  0.5960,
         0.5945,  0.4264,  0.5312,  0.5208,  0.5673,  0.6013,  0.5193,
         0.4983,  0.4023,  0.5539,  0.4015,  0.6556,  0.6140,  0.5734,
         0.5247,  0.5264,  0.5906,  0.3936,  0.5403,  0.4303,  0.4239,
         0.4245,  0.4752,  0.5290,  0.5212,  0.6402,  0.4528,  0.6877,
         0.5883,  0.6091,  0.5348,  0.5265,  0.5921,  0.4990,  0.4782,
         0.6494,  0.6443,  0.6706,  0.4516,  0.6026,  0.5829,  0.5378,
         0.5129,  0.4452,  0.4648,  0.4627,  0.6535,  0.4548,  0.6659,
         0.5574,  0.5586,  0.5911,  0.5683,  0.4882,  0.4895,  0.4617,
         0.4429,  0.5881,  0.6089,  0.4576,  0.5229,  0.4845,  0.5570,
         0.5171,  0.5075,  0.5301,  0.4352,  0.4416,  0.5654,  0.4373,
         0.4396,  0.4662,  0.6210,  0.3134,  0.5364,  0.5628,  0.5756,
         0.5273,  0.5202,  0.4291,  0.5332,  0.5769,  0.5653,  0.4178,
         0.4643,  0.5946,  0.4102,  0.4811,  0.4911,  0.5455,  0.5028,
         0.5292,  0.5908,  0.4369,  0.4087,  0.5141,  0.4150,  0.3648,
         0.5505,  0.3919,  0.4853,  0.4478,  0.6187,  0.3914,  0.5317,
         0.5700,  0.4164,  0.4866,  0.5360,  0.5025,  0.5568,  0.4187,
         0.5330,  0.5547,  0.4328,  0.5983,  0.5468,  0.4569,  0.4642,
         0.4806,  0.5878,  0.5735,  0.5246,  0.6345,  0.4856,  0.5457,
         0.4909,  0.3955,  0.5786,  0.4886,  0.3427,  0.4415,  0.5557,
         0.3584,  0.3846,  0.5351,  0.4468,  0.5417,  0.4355,  0.4970,
         0.6199,  0.4620,  0.4830,  0.4637,  0.4303,  0.4073,  0.4733,
         0.4789,  0.4346,  0.6168,  0.5939,  0.4826,  0.4917,  0.5358,
         0.5114,  0.4766,  0.5992,  0.5916,  0.4278,  0.4841,  0.5090,
         0.5818,  0.5646,  0.5055,  0.5412,  0.5923,  0.5963,  0.5499,
         0.5163,  0.6511,  0.5299,  0.5355,  0.5407,  0.4122,  0.4449,
         0.4092,  0.6042,  0.6060,  0.6006,  0.4842,  0.5271,  0.4328,
         0.6869,  0.4837,  0.6379,  0.3057,  0.3755,  0.5285,  0.4882,
         0.6168,  0.6125,  0.6577,  0.5242,  0.4917,  0.5419,  0.5133,
         0.5220,  0.5024,  0.5663,  0.3960,  0.5499,  0.6244,  0.3836,
         0.5441,  0.4422,  0.5029,  0.4632,  0.6055,  0.4368,  0.3131,
         0.3694,  0.5332,  0.4983,  0.4467,  0.4989,  0.5780,  0.6431,
         0.4605,  0.5299,  0.5834,  0.5981,  0.5819,  0.5928,  0.5796,
         0.4878,  0.5030,  0.5492,  0.4840,  0.4510,  0.5635,  0.5470,
         0.4590,  0.5671,  0.6744,  0.4935,  0.4676,  0.6144,  0.5436,
         0.7053,  0.4150,  0.5275,  0.4256,  0.4335,  0.5589,  0.5061,
         0.4837,  0.6728,  0.4746,  0.5804,  0.4920,  0.6314,  0.4964,
         0.4973,  0.5869,  0.5836,  0.6105,  0.3844,  0.5746,  0.4221,
         0.5408,  0.5043,  0.4450,  0.5820,  0.5052,  0.6259,  0.5607,
         0.5851], device='cuda:0')
tensor(0.6742, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4563,  0.4961,  0.5095,  0.3272,  0.6598,  0.2972,  0.5404,
         0.4674,  0.4611,  0.5026,  0.4519,  0.5269,  0.5582,  0.6093,
         0.5083,  0.4823,  0.4807,  0.5905,  0.6015,  0.5699,  0.6810,
         0.5198,  0.4767,  0.4592,  0.3898,  0.4919,  0.4839,  0.5713,
         0.5440,  0.5063,  0.5981,  0.4292,  0.5667,  0.4848,  0.4011,
         0.5447,  0.5009,  0.4613,  0.5284,  0.5785,  0.4725,  0.3779,
         0.7045,  0.6212,  0.6341,  0.5596,  0.5268,  0.6675,  0.5160,
         0.7809,  0.6598,  0.6017,  0.4939,  0.4026,  0.3665,  0.5051,
         0.5072,  0.6399,  0.4774,  0.5075,  0.4972,  0.5067,  0.3575,
         0.4881,  0.5356,  0.4966,  0.5324,  0.5807,  0.5459,  0.3292,
         0.5941,  0.3916,  0.4497,  0.3746,  0.4442,  0.4707,  0.4172,
         0.6091,  0.5580,  0.5970,  0.5133,  0.4768,  0.4327,  0.4361,
         0.4604,  0.3988,  0.5144,  0.3476,  0.4896,  0.5944,  0.4537,
         0.5273,  0.4522,  0.4854,  0.3837,  0.6722,  0.4580,  0.6181,
         0.5049,  0.5662,  0.4351,  0.5690,  0.5245,  0.4725,  0.5299,
         0.6067,  0.4037,  0.5502,  0.5399,  0.3322,  0.5700,  0.5871,
         0.4665,  0.5313,  0.5810,  0.5110,  0.5495,  0.5211,  0.5399,
         0.4815,  0.7079,  0.6784,  0.4210,  0.5390,  0.4742,  0.5775,
         0.4624,  0.4422,  0.5801,  0.6313,  0.5658,  0.5662,  0.4420,
         0.4534,  0.4866,  0.4633,  0.6771,  0.5906,  0.6389,  0.3913,
         0.5156,  0.5327,  0.4079,  0.4461,  0.6232,  0.5265,  0.4729,
         0.6683,  0.5584,  0.5284,  0.5034,  0.3934,  0.5985,  0.5282,
         0.5367,  0.5638,  0.5429,  0.5308,  0.5377,  0.3170,  0.5271,
         0.5903,  0.5772,  0.5298,  0.3851,  0.4467,  0.2933,  0.3525,
         0.4702,  0.4411,  0.5199,  0.6125,  0.5006,  0.5055,  0.6094,
         0.5337,  0.6181,  0.6377,  0.5843,  0.6382,  0.4988,  0.4072,
         0.5436,  0.4778,  0.6015,  0.4258,  0.5641,  0.3362,  0.6310,
         0.5301,  0.4689,  0.4835,  0.5300,  0.5005,  0.4697,  0.4337,
         0.6422,  0.5448,  0.4656,  0.5079,  0.5298,  0.6551,  0.4110,
         0.5479,  0.5227,  0.6585,  0.5636,  0.5318,  0.5096,  0.5121,
         0.4996,  0.6497,  0.5511,  0.6204,  0.5209,  0.5003,  0.4906,
         0.4867,  0.5422,  0.6565,  0.6185,  0.3297,  0.5205,  0.3624,
         0.4843,  0.6531,  0.6207,  0.6059,  0.4908,  0.3667,  0.4258,
         0.4869,  0.5512,  0.5414,  0.6032,  0.5695,  0.4701,  0.3712,
         0.5178,  0.5296,  0.5569,  0.6234,  0.4798,  0.4271,  0.4078,
         0.3976,  0.6343,  0.2960,  0.4406,  0.5245,  0.6341,  0.6045,
         0.3701,  0.6595,  0.6621,  0.5960,  0.2696,  0.4985,  0.6301,
         0.4647,  0.6177,  0.5577,  0.6057,  0.4930,  0.5809,  0.5390,
         0.4650,  0.5849,  0.5824,  0.5660,  0.4161,  0.5604,  0.5883,
         0.5262,  0.4762,  0.6268,  0.5225,  0.5221,  0.5408,  0.6953,
         0.4252,  0.4335,  0.4002,  0.5102,  0.5758,  0.6005,  0.6187,
         0.4899,  0.5775,  0.3571,  0.4742,  0.5279,  0.5724,  0.4670,
         0.3680,  0.7051,  0.4827,  0.4789,  0.5107,  0.4823,  0.5099,
         0.5349,  0.4030,  0.5495,  0.4920,  0.4879,  0.5218,  0.4789,
         0.5632,  0.5471,  0.4946,  0.4930,  0.6688,  0.5680,  0.5436,
         0.4611,  0.5314,  0.4437,  0.5817,  0.5848,  0.4870,  0.4869,
         0.4677,  0.4816,  0.4186,  0.4868,  0.4229,  0.5654,  0.4361,
         0.4994,  0.4566,  0.4217,  0.4598,  0.4920,  0.4421,  0.5854,
         0.6158,  0.4577,  0.6487,  0.5417,  0.5247,  0.6670,  0.6756,
         0.5805,  0.5007,  0.5384,  0.5114,  0.4363,  0.4516,  0.5388,
         0.3652,  0.4440,  0.4441,  0.5192,  0.3514,  0.4291,  0.4260,
         0.3455,  0.5831,  0.6898,  0.5547,  0.4559,  0.5631,  0.4826,
         0.4028,  0.4653,  0.6244,  0.4951,  0.5258,  0.4571,  0.5954,
         0.4741,  0.5463,  0.4671,  0.6392,  0.4549,  0.5913,  0.5400,
         0.4879,  0.6331,  0.5818,  0.5807,  0.4814,  0.4999,  0.4116,
         0.4640,  0.4843,  0.5208,  0.5130,  0.6655,  0.5725,  0.3976,
         0.4863,  0.4559,  0.6417,  0.5465,  0.4736,  0.4092,  0.5262,
         0.6038,  0.5551,  0.5310,  0.6324,  0.6850,  0.7080,  0.5293,
         0.4502,  0.5872,  0.5223,  0.4722,  0.4194,  0.4867,  0.5151,
         0.5757,  0.6210,  0.6074,  0.7455,  0.6787,  0.4022,  0.6980,
         0.4340,  0.4811,  0.5704,  0.6165,  0.4922,  0.4491,  0.5860,
         0.5220,  0.5329,  0.5209,  0.5323,  0.3345,  0.4940,  0.5414,
         0.4042,  0.7426,  0.6036,  0.6402,  0.5281,  0.4823,  0.6687,
         0.6161,  0.4487,  0.3467,  0.5505,  0.3628,  0.5628,  0.4514,
         0.5022,  0.5857,  0.5109,  0.5884,  0.4166,  0.5994,  0.4812,
         0.5327,  0.4975,  0.5117,  0.4802,  0.5008,  0.5720,  0.6433,
         0.4979,  0.5708,  0.5723,  0.5771,  0.4436,  0.5351,  0.4913,
         0.4710,  0.4016,  0.5194,  0.7421,  0.4246,  0.6328,  0.4938,
         0.5123,  0.5046,  0.6975,  0.6706,  0.4707,  0.4705,  0.4344,
         0.4878,  0.4488,  0.6821,  0.6021,  0.4214,  0.5383,  0.6559,
         0.4874,  0.4911,  0.3280,  0.5274,  0.6018,  0.5156,  0.5073,
         0.5133,  0.5101,  0.3938,  0.5934,  0.4264,  0.5512,  0.5414,
         0.4067,  0.5136,  0.4496,  0.5836,  0.5194,  0.6973,  0.5535,
         0.5181], device='cuda:0')
tensor(0.6688, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4770,  0.7209,  0.3982,  0.4162,  0.6879,  0.6064,  0.4495,
         0.4393,  0.6626,  0.5894,  0.4792,  0.3483,  0.7489,  0.6400,
         0.4010,  0.4205,  0.7164,  0.6221,  0.4163,  0.3565,  0.5622,
         0.5584,  0.5169,  0.5319,  0.5379,  0.4684,  0.4756,  0.6612,
         0.5947,  0.5767,  0.6341,  0.3390,  0.5693,  0.5710,  0.5250,
         0.6955,  0.4846,  0.5563,  0.5755,  0.4688,  0.6962,  0.4937,
         0.3506,  0.5882,  0.5453,  0.4201,  0.5514,  0.5423,  0.4784,
         0.5036,  0.2930,  0.4293,  0.4716,  0.7348,  0.6368,  0.5150,
         0.5651,  0.3929,  0.3782,  0.4051,  0.3647,  0.5720,  0.5231,
         0.5601,  0.4388,  0.6186,  0.3954,  0.5802,  0.4014,  0.4205,
         0.4222,  0.5575,  0.3407,  0.7719,  0.5296,  0.5546,  0.4935,
         0.4970,  0.3785,  0.4950,  0.4546,  0.3440,  0.4703,  0.3932,
         0.4878,  0.5389,  0.6525,  0.5578,  0.4778,  0.4894,  0.7013,
         0.7550,  0.5235,  0.6322,  0.6287,  0.5764,  0.7471,  0.2417,
         0.7871,  0.4938,  0.5410,  0.4433,  0.4374,  0.4413,  0.6497,
         0.7228,  0.3284,  0.4526,  0.6327,  0.5236,  0.6984,  0.5377,
         0.7968,  0.6993,  0.4557,  0.4354,  0.6293,  0.6904,  0.4429,
         0.5039,  0.3737,  0.8194,  0.5986,  0.6481,  0.6336,  0.3686,
         0.5009,  0.6648,  0.5484,  0.4963,  0.6463,  0.5693,  0.7148,
         0.6440,  0.3896,  0.4890,  0.4343,  0.5883,  0.5009,  0.6075,
         0.4897,  0.4888,  0.3793,  0.7184,  0.5870,  0.5576,  0.6614,
         0.7913,  0.5103,  0.4647,  0.5591,  0.6326,  0.6251,  0.5361,
         0.3367,  0.4726,  0.5531,  0.6458,  0.4281,  0.5912,  0.5220,
         0.5480,  0.6742,  0.5887,  0.6010,  0.5285,  0.5503,  0.6400,
         0.5044,  0.5577,  0.6847,  0.6377,  0.4930,  0.6229,  0.3817,
         0.4076,  0.6027,  0.6473,  0.6400,  0.4758,  0.6447,  0.4494,
         0.7342,  0.4141,  0.4128,  0.6484,  0.6380,  0.7239,  0.5406,
         0.6587,  0.5579,  0.4066,  0.5424,  0.6773,  0.4506,  0.5734,
         0.6119,  0.6541,  0.4688,  0.3861,  0.5062,  0.5823,  0.3790,
         0.5384,  0.6774,  0.6422,  0.5319,  0.5225,  0.5239,  0.5179,
         0.4184,  0.5917,  0.5817,  0.4953,  0.5256,  0.4973,  0.4095,
         0.5749,  0.7943,  0.5958,  0.3954,  0.5466,  0.4292,  0.5866,
         0.4163,  0.4639,  0.5183,  0.4296,  0.4092,  0.5223,  0.5132,
         0.6988,  0.6288,  0.5659,  0.5540,  0.5562,  0.4502,  0.7163,
         0.5998,  0.6568,  0.3557,  0.3594,  0.5092,  0.5637,  0.5032,
         0.6365,  0.5694,  0.6907,  0.4847,  0.4137,  0.5480,  0.8180,
         0.5100,  0.7207,  0.7014,  0.4444,  0.4796,  0.6249,  0.4935,
         0.3869,  0.5107,  0.4987,  0.5845,  0.4730,  0.4734,  0.5292,
         0.5608,  0.6128,  0.4635,  0.6574,  0.6221,  0.8075,  0.2778,
         0.6322,  0.5022,  0.6026,  0.6856,  0.3749,  0.5513,  0.5062,
         0.4494,  0.4247,  0.4571,  0.3598,  0.4337,  0.5523,  0.4431,
         0.4704,  0.5322,  0.4392,  0.4970,  0.5181,  0.4732,  0.6129,
         0.5268,  0.5733,  0.4671,  0.6541,  0.5936,  0.5781,  0.5321,
         0.6257,  0.2911,  0.6815,  0.4826,  0.4071,  0.5055,  0.4691,
         0.4600,  0.5824,  0.4416,  0.7157,  0.5362,  0.5329,  0.6199,
         0.5983,  0.6338,  0.4830,  0.3755,  0.3744,  0.6773,  0.6254,
         0.4536,  0.5227,  0.5531,  0.5446,  0.5554,  0.7135,  0.5838,
         0.5069,  0.6068,  0.3990,  0.5071,  0.4661,  0.4884,  0.4496,
         0.5369,  0.4686,  0.4899,  0.5225,  0.5165,  0.5206,  0.6382,
         0.4391,  0.5048,  0.5518,  0.4913,  0.4314,  0.5520,  0.5234,
         0.5911,  0.6010,  0.5022,  0.5118,  0.4646,  0.4826,  0.4012,
         0.4755,  0.5220,  0.3946,  0.7190,  0.4805,  0.6219,  0.6499,
         0.6260,  0.3885,  0.5501,  0.5970,  0.3411,  0.6547,  0.5497,
         0.4996,  0.5847,  0.6110,  0.5690,  0.4428,  0.5053,  0.3915,
         0.5488,  0.5697,  0.3986,  0.5363,  0.5846,  0.5695,  0.5081,
         0.6150,  0.5431,  0.5712,  0.5847,  0.6109,  0.6326,  0.3679,
         0.5695,  0.4405,  0.4914,  0.5097,  0.6085,  0.4474,  0.5836,
         0.5825,  0.5618,  0.5719,  0.5867,  0.4096,  0.6387,  0.4463,
         0.5530,  0.5677,  0.4502,  0.5464,  0.4520,  0.6152,  0.3356,
         0.5760,  0.6379,  0.4055,  0.4082,  0.5028,  0.8217,  0.5072,
         0.5370,  0.4878,  0.5699,  0.6124,  0.6140,  0.7548,  0.6484,
         0.6661,  0.5994,  0.3354,  0.5070,  0.4741,  0.5470,  0.5363,
         0.5794,  0.5850,  0.3722,  0.5464,  0.5685,  0.6988,  0.6353,
         0.6680,  0.5804,  0.5706,  0.4531,  0.5274,  0.5243,  0.4087,
         0.3824,  0.3744,  0.7275,  0.7291,  0.7006,  0.5504,  0.5123,
         0.5236,  0.5195,  0.5703,  0.4828,  0.5241,  0.5029,  0.4974,
         0.5623,  0.4728,  0.4325,  0.4053,  0.4223,  0.7566,  0.7078,
         0.7112,  0.4338,  0.7593,  0.3865,  0.3779,  0.6075,  0.5170,
         0.4335,  0.5162,  0.6123,  0.4302,  0.4804,  0.4631,  0.7324,
         0.3235,  0.3989,  0.4060,  0.4763,  0.7305,  0.4755,  0.4383,
         0.4447,  0.4191,  0.5451,  0.4310,  0.3040,  0.3667,  0.7485,
         0.4595,  0.2995,  0.6552,  0.5358,  0.4089,  0.5367,  0.5956,
         0.7070,  0.3070,  0.4417,  0.5977,  0.6396,  0.4866,  0.5015,
         0.5173], device='cuda:0')
tensor(0.6508, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4305,  0.6665,  0.8327,  0.4954,  0.6604,  0.4278,  0.4112,
         0.4861,  0.5690,  0.6654,  0.5145,  0.6583,  0.6323,  0.7291,
         0.6453,  0.7291,  0.6717,  0.8243,  0.8062,  0.8443,  0.7913,
         0.8905,  0.4692,  0.6699,  0.4161,  0.4389,  0.5553,  0.6261,
         0.6025,  0.4467,  0.7548,  0.8093,  0.5007,  0.6095,  0.4504,
         0.5561,  0.7619,  0.8547,  0.4998,  0.6263,  0.8646,  0.6158,
         0.6737,  0.5480,  0.6085,  0.3875,  0.6661,  0.2829,  0.4360,
         0.4010,  0.6689,  0.3408,  0.4234,  0.5451,  0.3058,  0.7025,
         0.3900,  0.5234,  0.8341,  0.4934,  0.5571,  0.5600,  0.7041,
         0.7752,  0.8628,  0.4334,  0.7865,  0.4524,  0.4714,  0.6918,
         0.6830,  0.8992,  0.6154,  0.8486,  0.4843,  0.5554,  0.5035,
         0.8168,  0.5810,  0.6126,  0.4766,  0.4925,  0.7303,  0.5823,
         0.6158,  0.6376,  0.8028,  0.7146,  0.7670,  0.8655,  0.6011,
         0.4753,  0.8498,  0.4626,  0.6218,  0.8354,  0.6296,  0.7754,
         0.6436,  0.4974,  0.7894,  0.5394,  0.5755,  0.8446,  0.5291,
         0.7160,  0.6867,  0.4873,  0.6387,  0.7031,  0.4764,  0.5129,
         0.4645,  0.3875,  0.8923,  0.8137,  0.7443,  0.5320,  0.5765,
         0.3116,  0.4257,  0.5202,  0.8755,  0.6667,  0.7877,  0.6009,
         0.5113,  0.2542,  0.4409,  0.8265,  0.7643,  0.3012,  0.7657,
         0.2949,  0.5282,  0.3343,  0.3803,  0.5798,  0.8487,  0.6668,
         0.5159,  0.7695,  0.5942,  0.7476,  0.6534,  0.4493,  0.4137,
         0.7703,  0.4135,  0.4593,  0.6632,  0.6616,  0.4259,  0.5447,
         0.3594,  0.6304,  0.5532,  0.6008,  0.6433,  0.8011,  0.3254,
         0.5705,  0.6524,  0.7264,  0.5562,  0.8481,  0.6857,  0.7030,
         0.4520,  0.4737,  0.5149,  0.7497,  0.7060,  0.3065,  0.6029,
         0.5416,  0.8516,  0.2385,  0.2979,  0.4252,  0.6818,  0.6428,
         0.5913,  0.6797,  0.8264,  0.7991,  0.8480,  0.6446,  0.7627,
         0.8243,  0.7238,  0.4266,  0.3707,  0.5428,  0.5638,  0.7692,
         0.6914,  0.5690,  0.8285,  0.7826,  0.7348,  0.5896,  0.4456,
         0.8705,  0.5034,  0.8701,  0.5772,  0.7623,  0.3415,  0.6552,
         0.3121,  0.4051,  0.5046,  0.6422,  0.7696,  0.3830,  0.4737,
         0.4759,  0.7363,  0.7314,  0.4629,  0.6331,  0.8098,  0.4798,
         0.2318,  0.6911,  0.4535,  0.7493,  0.6417,  0.3775,  0.8100,
         0.5979,  0.5809,  0.3825,  0.7971,  0.7412,  0.2810,  0.4366,
         0.5219,  0.7607,  0.7239,  0.3667,  0.5119,  0.7873,  0.8208,
         0.5207,  0.3077,  0.6509,  0.6128,  0.7244,  0.8199,  0.7019,
         0.6615,  0.4547,  0.7186,  0.4662,  0.3644,  0.5647,  0.7833,
         0.5820,  0.6482,  0.3753,  0.6743,  0.6891,  0.5324,  0.6658,
         0.6353,  0.7200,  0.3565,  0.3633,  0.4469,  0.3167,  0.7543,
         0.7129,  0.7493,  0.7606,  0.4341,  0.5736,  0.4983,  0.4652,
         0.6016,  0.8591,  0.5562,  0.6392,  0.4846,  0.8039,  0.3425,
         0.3789,  0.6984,  0.6509,  0.7331,  0.5375,  0.8083,  0.5498,
         0.4815,  0.6827,  0.7611,  0.5456,  0.5919,  0.6426,  0.7141,
         0.7102,  0.4195,  0.8031,  0.8816,  0.7311,  0.4418,  0.6831,
         0.6910,  0.3879,  0.5249,  0.7268,  0.7841,  0.8827,  0.6045,
         0.8070,  0.6106,  0.9029,  0.5291,  0.3416,  0.6272,  0.5958,
         0.7845,  0.4566,  0.6764,  0.6250,  0.7923,  0.4089,  0.2537,
         0.7746,  0.5116,  0.7868,  0.6797,  0.7188,  0.5182,  0.5573,
         0.5933,  0.4884,  0.4104,  0.7421,  0.3453,  0.3858,  0.7662,
         0.3482,  0.6799,  0.5073,  0.6162,  0.7543,  0.8701,  0.8220,
         0.5905,  0.7720,  0.6579,  0.5768,  0.3274,  0.6884,  0.5220,
         0.6322,  0.5014,  0.3492,  0.4955,  0.5063,  0.7623,  0.5286,
         0.4371,  0.7513,  0.6776,  0.6207,  0.7418,  0.8562,  0.7764,
         0.5594,  0.5103,  0.8264,  0.7989,  0.4723,  0.5116,  0.4423,
         0.6728,  0.5502,  0.7958,  0.7164,  0.5682,  0.4277,  0.6733,
         0.3993,  0.5473,  0.5918,  0.5587,  0.6578,  0.7800,  0.3479,
         0.6716,  0.5338,  0.5503,  0.5285,  0.6006,  0.6355,  0.4843,
         0.5330,  0.7356,  0.4904,  0.3082,  0.6493,  0.6229,  0.4384,
         0.4713,  0.7299,  0.7463,  0.4624,  0.8156,  0.4987,  0.4190,
         0.7964,  0.7597,  0.3056,  0.4316,  0.7929,  0.5859,  0.7747,
         0.8237,  0.7790,  0.4621,  0.7521,  0.5663,  0.8518,  0.4762,
         0.4049,  0.7757,  0.8041,  0.4709,  0.7887,  0.7827,  0.7193,
         0.7164,  0.5995,  0.6784,  0.7967,  0.6631,  0.6573,  0.7324,
         0.5936,  0.7331,  0.6918,  0.5788,  0.6454,  0.4673,  0.6996,
         0.5791,  0.4535,  0.7569,  0.3014,  0.5224,  0.3227,  0.8903,
         0.6588,  0.7548,  0.5238,  0.5815,  0.6624,  0.4962,  0.5302,
         0.4110,  0.5717,  0.6155,  0.7768,  0.7271,  0.7588,  0.6398,
         0.8116,  0.8082,  0.3193,  0.5639,  0.5608,  0.8870,  0.5004,
         0.7514,  0.7049,  0.7763,  0.5992,  0.7278,  0.6694,  0.4442,
         0.6283,  0.4439,  0.6949,  0.6832,  0.5031,  0.3398,  0.7005,
         0.4145,  0.8638,  0.7038,  0.8275,  0.5727,  0.5861,  0.7701,
         0.4963,  0.6196,  0.4708,  0.6487,  0.3984,  0.6703,  0.6815,
         0.6174,  0.8405,  0.8583,  0.2941,  0.6092,  0.6137,  0.7840,
         0.4634], device='cuda:0')
tensor(0.7037, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4194,  0.5610,  0.5598,  0.6603,  0.8338,  0.5903,  0.5920,
         0.5816,  0.4605,  0.4027,  0.4714,  0.5196,  0.5094,  0.3617,
         0.7006,  0.4018,  0.5280,  0.2509,  0.5220,  0.5658,  0.4878,
         0.3435,  0.6166,  0.4200,  0.5053,  0.4508,  0.3212,  0.4010,
         0.6208,  0.6979,  0.6926,  0.7653,  0.5464,  0.6353,  0.6126,
         0.4904,  0.4282,  0.3624,  0.4313,  0.5511,  0.6606,  0.5009,
         0.7491,  0.4467,  0.3899,  0.5636,  0.5205,  0.4998,  0.5775,
         0.3448,  0.4600,  0.4308,  0.4793,  0.5779,  0.5502,  0.6784,
         0.6573,  0.4697,  0.4567,  0.4528,  0.4741,  0.3184,  0.3922,
         0.5825,  0.6149,  0.4756,  0.5835,  0.3484,  0.4512,  0.3100,
         0.7837,  0.3821,  0.3448,  0.5894,  0.6445,  0.4876,  0.7386,
         0.4590,  0.5345,  0.6417,  0.6710,  0.4630,  0.6858,  0.3626,
         0.8379,  0.6926,  0.4140,  0.3407,  0.5361,  0.6848,  0.5172,
         0.4878,  0.3795,  0.4325,  0.3857,  0.4236,  0.4348,  0.5019,
         0.2706,  0.5597,  0.5460,  0.4566,  0.5609,  0.8126,  0.3963,
         0.5364,  0.7229,  0.6730,  0.5004,  0.2936,  0.4767,  0.4434,
         0.4087,  0.6056,  0.6814,  0.3108,  0.5889,  0.6211,  0.8256,
         0.5935,  0.6955,  0.3453,  0.6230,  0.6950,  0.4089,  0.7531,
         0.4251,  0.6752,  0.5592,  0.3239,  0.3921,  0.6918,  0.6755,
         0.6454,  0.4239,  0.7205,  0.3439,  0.5139,  0.7598,  0.4543,
         0.6968,  0.3628,  0.6948,  0.3186,  0.5701,  0.6418,  0.6202,
         0.5564,  0.3937,  0.6962,  0.4173,  0.5762,  0.7447,  0.7279,
         0.3255,  0.5423,  0.4572,  0.5551,  0.5425,  0.3623,  0.3952,
         0.6969,  0.4331,  0.6666,  0.5108,  0.6438,  0.5076,  0.7820,
         0.4486,  0.7028,  0.5564,  0.2679,  0.4113,  0.6007,  0.2952,
         0.4254,  0.3968,  0.6418,  0.6134,  0.5520,  0.6227,  0.4898,
         0.6001,  0.6101,  0.4310,  0.4984,  0.6736,  0.6258,  0.7429,
         0.6575,  0.6687,  0.5059,  0.4665,  0.3701,  0.4833,  0.2798,
         0.3244,  0.4630,  0.6481,  0.7857,  0.6591,  0.5063,  0.7257,
         0.5485,  0.6529,  0.6503,  0.6010,  0.5837,  0.5656,  0.4872,
         0.6021,  0.4896,  0.4640,  0.4573,  0.6497,  0.5583,  0.4259,
         0.4522,  0.4874,  0.7201,  0.4413,  0.3067,  0.3425,  0.4935,
         0.5075,  0.7861,  0.3896,  0.5416,  0.3540,  0.5675,  0.3616,
         0.4321,  0.5284,  0.4603,  0.5826,  0.7094,  0.7694,  0.6421,
         0.3820,  0.6631,  0.4764,  0.4248,  0.3924,  0.5137,  0.3351,
         0.5515,  0.5819,  0.4877,  0.4062,  0.7628,  0.6125,  0.5497,
         0.5080,  0.7026,  0.5420,  0.5061,  0.6742,  0.7004,  0.5677,
         0.4185,  0.5936,  0.4417,  0.4144,  0.3954,  0.7630,  0.5848,
         0.6254,  0.5340,  0.8357,  0.5292,  0.2412,  0.3693,  0.5973,
         0.5422,  0.4564,  0.5479,  0.7756,  0.6248,  0.4768,  0.3765,
         0.5812,  0.5637,  0.3566,  0.4413,  0.4522,  0.4934,  0.6226,
         0.3767,  0.5969,  0.7418,  0.5238,  0.6595,  0.4522,  0.3783,
         0.3375,  0.5191,  0.5946,  0.3376,  0.4525,  0.4141,  0.4315,
         0.5631,  0.4525,  0.3158,  0.7261,  0.5140,  0.4330,  0.4652,
         0.6804,  0.5170,  0.3178,  0.5239,  0.4904,  0.4870,  0.5120,
         0.5626,  0.7047,  0.3565,  0.5591,  0.6043,  0.3922,  0.6709,
         0.3459,  0.4773,  0.3282,  0.5537,  0.4928,  0.3652,  0.6301,
         0.4983,  0.5243,  0.4382,  0.4446,  0.4938,  0.5998,  0.6072,
         0.4024,  0.6606,  0.4069,  0.4203,  0.4915,  0.5589,  0.5553,
         0.3989,  0.4474,  0.5801,  0.2553,  0.3235,  0.8097,  0.4438,
         0.2960,  0.3508,  0.7881,  0.4684,  0.5312,  0.4229,  0.3638,
         0.4265,  0.2697,  0.4913,  0.7324,  0.5921,  0.5637,  0.6249,
         0.4126,  0.4073,  0.7201,  0.3425,  0.5656,  0.4006,  0.3453,
         0.5479,  0.5371,  0.4641,  0.5513,  0.4345,  0.3889,  0.5571,
         0.5822,  0.4632,  0.7211,  0.4970,  0.3555,  0.4063,  0.6452,
         0.3933,  0.5432,  0.6717,  0.6279,  0.3775,  0.6983,  0.3471,
         0.3530,  0.7002,  0.5550,  0.3752,  0.6778,  0.4426,  0.3781,
         0.5173,  0.5587,  0.4175,  0.7314,  0.4839,  0.4627,  0.4664,
         0.6703,  0.4244,  0.6477,  0.7880,  0.5856,  0.6440,  0.4122,
         0.5111,  0.6008,  0.6611,  0.7905,  0.5283,  0.5267,  0.2882,
         0.4407,  0.6073,  0.4602,  0.4238,  0.5216,  0.6830,  0.4053,
         0.4119,  0.5890,  0.4261,  0.6405,  0.4707,  0.3992,  0.4469,
         0.7365,  0.3239,  0.6253,  0.3445,  0.4580,  0.5173,  0.4141,
         0.3877,  0.6080,  0.5480,  0.3842,  0.5184,  0.3622,  0.6787,
         0.5465,  0.4269,  0.3594,  0.5040,  0.3501,  0.4985,  0.3676,
         0.5126,  0.7512,  0.4657,  0.4196,  0.5746,  0.5025,  0.5437,
         0.5272,  0.3649,  0.6772,  0.4524,  0.4604,  0.3794,  0.3401,
         0.5159,  0.4214,  0.3331,  0.5114,  0.8695,  0.5095,  0.4738,
         0.7161,  0.6675,  0.6398,  0.6575,  0.5278,  0.3881,  0.7293,
         0.4143,  0.3930,  0.3952,  0.6593,  0.4672,  0.7154,  0.5695,
         0.5716,  0.6158,  0.4263,  0.4858,  0.6197,  0.2338,  0.5582,
         0.3786,  0.5825,  0.7270,  0.6334,  0.4483,  0.5384,  0.3120,
         0.7980,  0.3834,  0.3950,  0.4718,  0.4356,  0.6728,  0.6192,
         0.4073], device='cuda:0')
tensor(0.6437, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5740,  0.4065,  0.3603,  0.4281,  0.5281,  0.7383,  0.6392,
         0.4616,  0.5681,  0.5070,  0.6301,  0.3475,  0.4714,  0.3958,
         0.5155,  0.5258,  0.4258,  0.7422,  0.4368,  0.6951,  0.2897,
         0.3130,  0.2910,  0.2849,  0.4476,  0.3686,  0.7529,  0.4013,
         0.6289,  0.5143,  0.6288,  0.4063,  0.2927,  0.4077,  0.4632,
         0.3668,  0.5684,  0.4642,  0.5032,  0.3933,  0.4303,  0.3703,
         0.4707,  0.5744,  0.4533,  0.2774,  0.3284,  0.3834,  0.4371,
         0.2775,  0.4855,  0.3501,  0.4045,  0.4097,  0.5082,  0.4477,
         0.7031,  0.5868,  0.5344,  0.5895,  0.4970,  0.6926,  0.4463,
         0.2494,  0.3900,  0.5272,  0.5883,  0.5055,  0.5286,  0.4000,
         0.5220,  0.5240,  0.3574,  0.3075,  0.4268,  0.4481,  0.5115,
         0.5714,  0.3702,  0.4569,  0.2826,  0.5225,  0.4963,  0.3616,
         0.5694,  0.4538,  0.5569,  0.4343,  0.5631,  0.5289,  0.5012,
         0.3678,  0.3577,  0.5270,  0.3600,  0.2748,  0.3875,  0.4199,
         0.2698,  0.3771,  0.6925,  0.5326,  0.6711,  0.5032,  0.5261,
         0.5909,  0.3876,  0.4532,  0.3694,  0.4492,  0.3592,  0.7555,
         0.3739,  0.4765,  0.4810,  0.5905,  0.5070,  0.5189,  0.5561,
         0.4954,  0.5282,  0.7102,  0.5457,  0.4388,  0.4587,  0.4029,
         0.3063,  0.5772,  0.4033,  0.3679,  0.6769,  0.5881,  0.5004,
         0.5522,  0.4745,  0.4002,  0.5373,  0.4369,  0.3693,  0.4123,
         0.3158,  0.4216,  0.5823,  0.3135,  0.5047,  0.4750,  0.4009,
         0.4626,  0.3527,  0.4958,  0.4522,  0.4547,  0.3083,  0.2879,
         0.3329,  0.4103,  0.3559,  0.4121,  0.3342,  0.7093,  0.3814,
         0.5056,  0.3759,  0.4254,  0.2850,  0.7761,  0.2933,  0.5921,
         0.5426,  0.6905,  0.4980,  0.3080,  0.7441,  0.4890,  0.4962,
         0.6099,  0.4818,  0.3518,  0.4288,  0.2631,  0.4104,  0.4337,
         0.4375,  0.4014,  0.5289,  0.4084,  0.6682,  0.6394,  0.6177,
         0.3974,  0.3406,  0.3875,  0.4674,  0.3414,  0.5344,  0.4607,
         0.3660,  0.4254,  0.7530,  0.3134,  0.3447,  0.3736,  0.4436,
         0.4192,  0.4772,  0.3091,  0.4531,  0.4586,  0.3495,  0.3831,
         0.4729,  0.7271,  0.4083,  0.3608,  0.6864,  0.4457,  0.6052,
         0.2904,  0.3363,  0.4205,  0.5464,  0.4053,  0.6003,  0.6172,
         0.3389,  0.3219,  0.3973,  0.5080,  0.6775,  0.3926,  0.3541,
         0.4879,  0.5526,  0.4463,  0.3903,  0.4386,  0.7496,  0.4931,
         0.5198,  0.5372,  0.6547,  0.4514,  0.3356,  0.4843,  0.4555,
         0.5494,  0.4181,  0.4559,  0.5934,  0.4142,  0.5188,  0.5973,
         0.3695,  0.5516,  0.3807,  0.7368,  0.6834,  0.4777,  0.3449,
         0.3594,  0.3259,  0.5545,  0.3822,  0.4795,  0.2744,  0.3833,
         0.4536,  0.4239,  0.3075,  0.5860,  0.4203,  0.3005,  0.3610,
         0.5640,  0.2794,  0.4304,  0.4629,  0.2859,  0.6944,  0.2946,
         0.6215,  0.6174,  0.5865,  0.4961,  0.3666,  0.4650,  0.2757,
         0.3093,  0.3533,  0.6510,  0.5124,  0.3875,  0.4628,  0.3155,
         0.4408,  0.4118,  0.6006,  0.6530,  0.3932,  0.4994,  0.6983,
         0.6256,  0.5827,  0.5351,  0.3270,  0.4028,  0.3904,  0.5774,
         0.5019,  0.2724,  0.5160,  0.5928,  0.4122,  0.4514,  0.2735,
         0.2796,  0.4520,  0.4945,  0.2475,  0.2927,  0.6974,  0.4496,
         0.6704,  0.5872,  0.3647,  0.3323,  0.4866,  0.3493,  0.2529,
         0.4388,  0.2845,  0.5707,  0.4873,  0.3181,  0.3920,  0.3054,
         0.4401,  0.5701,  0.4255,  0.4041,  0.6461,  0.3954,  0.5295,
         0.3091,  0.5565,  0.4084,  0.4358,  0.5928,  0.3018,  0.4799,
         0.3060,  0.3441,  0.4386,  0.5374,  0.3890,  0.4740,  0.3120,
         0.5108,  0.3706,  0.4322,  0.2884,  0.4834,  0.3900,  0.4108,
         0.6072,  0.6479,  0.3103,  0.5171,  0.3323,  0.2284,  0.4671,
         0.4634,  0.4395,  0.6215,  0.5360,  0.4568,  0.3575,  0.4690,
         0.3416,  0.2154,  0.4624,  0.3594,  0.7073,  0.4280,  0.4052,
         0.4953,  0.6325,  0.2998,  0.3769,  0.4491,  0.3875,  0.3732,
         0.5467,  0.2784,  0.3438,  0.4310,  0.4946,  0.4418,  0.5901,
         0.5895,  0.5226,  0.3472,  0.4109,  0.5110,  0.5012,  0.4424,
         0.4177,  0.3414,  0.3754,  0.3846,  0.3340,  0.3261,  0.4809,
         0.4604,  0.4973,  0.5219,  0.4518,  0.4186,  0.3879,  0.2914,
         0.5072,  0.6333,  0.4264,  0.3302,  0.4104,  0.4651,  0.4399,
         0.4275,  0.4289,  0.3230,  0.7354,  0.3942,  0.4307,  0.5231,
         0.5124,  0.2630,  0.2865,  0.3531,  0.6550,  0.2964,  0.4316,
         0.4903,  0.3256,  0.4486,  0.2537,  0.3615,  0.5780,  0.4793,
         0.5769,  0.6483,  0.3350,  0.3463,  0.5096,  0.2894,  0.3438,
         0.5478,  0.4165,  0.2772,  0.5075,  0.4699,  0.4230,  0.3137,
         0.7206,  0.5103,  0.5811,  0.4957,  0.5182,  0.5889,  0.5316,
         0.5617,  0.3816,  0.6232,  0.5649,  0.5451,  0.5174,  0.4604,
         0.5885,  0.3278,  0.4101,  0.4194,  0.6215,  0.3092,  0.4062,
         0.5596,  0.2871,  0.4990,  0.4085,  0.4180,  0.3367,  0.4328,
         0.2142,  0.7447,  0.5267,  0.3868,  0.3001,  0.5104,  0.5934,
         0.5151,  0.3849,  0.2523,  0.5754,  0.2667,  0.6015,  0.3083,
         0.5729,  0.4028,  0.2849,  0.4356,  0.3319,  0.4828,  0.4510,
         0.4002], device='cuda:0')
tensor(0.6742, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3750,  0.4416,  0.3929,  0.3186,  0.4611,  0.3426,  0.3154,
         0.4175,  0.3857,  0.3376,  0.3797,  0.4327,  0.5165,  0.5299,
         0.5551,  0.5348,  0.5860,  0.5377,  0.5831,  0.3322,  0.4449,
         0.4103,  0.3673,  0.3867,  0.4903,  0.5057,  0.5112,  0.4631,
         0.4684,  0.4231,  0.2690,  0.4609,  0.4789,  0.3492,  0.3687,
         0.4090,  0.5691,  0.4527,  0.4375,  0.5220,  0.5956,  0.2378,
         0.2332,  0.3604,  0.4284,  0.3131,  0.3443,  0.4449,  0.4099,
         0.5009,  0.4633,  0.5743,  0.4733,  0.3148,  0.3277,  0.3276,
         0.3364,  0.5845,  0.5230,  0.3088,  0.2630,  0.4222,  0.3797,
         0.4162,  0.3948,  0.3504,  0.3480,  0.3761,  0.4325,  0.3540,
         0.3772,  0.4183,  0.4891,  0.2730,  0.3813,  0.4339,  0.5975,
         0.5183,  0.2962,  0.4087,  0.4492,  0.2365,  0.4825,  0.3866,
         0.2751,  0.3745,  0.3743,  0.5472,  0.7051,  0.4768,  0.4189,
         0.4747,  0.3784,  0.5877,  0.4772,  0.4297,  0.3571,  0.4748,
         0.6237,  0.4829,  0.5213,  0.3844,  0.3727,  0.5779,  0.3165,
         0.4742,  0.4948,  0.2577,  0.6976,  0.3894,  0.4600,  0.3862,
         0.2752,  0.4233,  0.4917,  0.6104,  0.5922,  0.3791,  0.3235,
         0.3655,  0.5269,  0.3428,  0.6074,  0.5780,  0.2973,  0.3723,
         0.3591,  0.4015,  0.4479,  0.5611,  0.2112,  0.4800,  0.4983,
         0.4488,  0.6066,  0.5305,  0.4583,  0.4830,  0.4408,  0.6757,
         0.5139,  0.3895,  0.3419,  0.4799,  0.5994,  0.3820,  0.6268,
         0.4023,  0.5653,  0.3573,  0.4571,  0.6022,  0.6935,  0.3429,
         0.3766,  0.2692,  0.4040,  0.4178,  0.4317,  0.5442,  0.3468,
         0.4778,  0.3043,  0.4920,  0.3125,  0.3873,  0.4664,  0.3936,
         0.4719,  0.3141,  0.4804,  0.2829,  0.5605,  0.6119,  0.5158,
         0.4214,  0.2658,  0.3534,  0.4826,  0.2490,  0.4558,  0.2919,
         0.3206,  0.3468,  0.4906,  0.6449,  0.3115,  0.3726,  0.2912,
         0.4919,  0.2454,  0.4223,  0.4877,  0.5137,  0.4687,  0.5438,
         0.4092,  0.3413,  0.5337,  0.3069,  0.5855,  0.6208,  0.4812,
         0.4611,  0.4127,  0.4348,  0.3581,  0.4053,  0.2687,  0.4285,
         0.2555,  0.3988,  0.2761,  0.4083,  0.4767,  0.3408,  0.6626,
         0.5429,  0.6205,  0.3220,  0.6670,  0.4222,  0.3419,  0.3422,
         0.6910,  0.4291,  0.3623,  0.4619,  0.2172,  0.2445,  0.5989,
         0.5525,  0.4856,  0.6257,  0.3405,  0.5812,  0.5115,  0.2878,
         0.2262,  0.2477,  0.3533,  0.4488,  0.5332,  0.3866,  0.4661,
         0.5110,  0.5245,  0.3658,  0.4459,  0.3743,  0.5583,  0.4436,
         0.4120,  0.3344,  0.3124,  0.4873,  0.2863,  0.3446,  0.4385,
         0.6232,  0.3183,  0.3590,  0.5408,  0.4534,  0.3409,  0.4127,
         0.5428,  0.4435,  0.5022,  0.3012,  0.4400,  0.4513,  0.3890,
         0.4237,  0.3989,  0.2693,  0.4126,  0.2393,  0.6218,  0.3474,
         0.2664,  0.5463,  0.4691,  0.4018,  0.3421,  0.2442,  0.5242,
         0.4075,  0.4433,  0.2435,  0.3011,  0.3275,  0.4483,  0.5707,
         0.5535,  0.3302,  0.3945,  0.4343,  0.4223,  0.4242,  0.3817,
         0.3669,  0.3234,  0.4579,  0.4858,  0.3258,  0.6233,  0.3522,
         0.4427,  0.3213,  0.4441,  0.6189,  0.4592,  0.4108,  0.2595,
         0.5078,  0.4342,  0.3711,  0.5759,  0.4633,  0.3191,  0.3243,
         0.3354,  0.3518,  0.3066,  0.4324,  0.5024,  0.4823,  0.5415,
         0.3413,  0.4361,  0.4684,  0.3260,  0.3210,  0.3124,  0.4893,
         0.4478,  0.3975,  0.5168,  0.3504,  0.3055,  0.3268,  0.5168,
         0.3687,  0.5904,  0.5162,  0.3883,  0.6275,  0.4929,  0.3110,
         0.4620,  0.3408,  0.4861,  0.3970,  0.3186,  0.4541,  0.3543,
         0.3489,  0.3725,  0.5379,  0.6464,  0.4294,  0.3195,  0.4188,
         0.3760,  0.3903,  0.5075,  0.3451,  0.4330,  0.4070,  0.5299,
         0.3262,  0.2986,  0.4233,  0.3420,  0.3896,  0.4925,  0.5395,
         0.5587,  0.2907,  0.4463,  0.4944,  0.2913,  0.3509,  0.2692,
         0.3991,  0.5306,  0.3335,  0.5615,  0.5228,  0.5495,  0.4533,
         0.5357,  0.4411,  0.4191,  0.3415,  0.4214,  0.4720,  0.4885,
         0.3284,  0.5085,  0.3202,  0.5162,  0.3184,  0.3436,  0.4518,
         0.4375,  0.6903,  0.4702,  0.4842,  0.4983,  0.2383,  0.4829,
         0.4229,  0.4639,  0.3806,  0.3231,  0.5783,  0.4244,  0.4650,
         0.4215,  0.4556,  0.6353,  0.6309,  0.3952,  0.4100,  0.3782,
         0.5940,  0.2485,  0.3697,  0.5531,  0.2691,  0.2508,  0.4911,
         0.2963,  0.3903,  0.5622,  0.1803,  0.4163,  0.3917,  0.2386,
         0.2654,  0.3494,  0.3065,  0.4109,  0.4605,  0.3953,  0.4484,
         0.5461,  0.2563,  0.4143,  0.2512,  0.3226,  0.3405,  0.6353,
         0.5139,  0.1888,  0.5738,  0.5424,  0.6992,  0.3346,  0.4402,
         0.3581,  0.6260,  0.4413,  0.3391,  0.5119,  0.6849,  0.3725,
         0.4835,  0.4978,  0.3825,  0.4156,  0.1916,  0.4912,  0.4509,
         0.4038,  0.4416,  0.3386,  0.3077,  0.3214,  0.5263,  0.3018,
         0.3766,  0.3995,  0.5949,  0.5415,  0.4362,  0.2185,  0.2614,
         0.4259,  0.2802,  0.4091,  0.4353,  0.4614,  0.3968,  0.4627,
         0.3325,  0.3826,  0.3340,  0.5457,  0.4314,  0.4234,  0.4429,
         0.2522,  0.4653,  0.4421,  0.6644,  0.2673,  0.2572,  0.3615,
         0.2416], device='cuda:0')
tensor(0.6861, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5671,  0.3537,  0.4682,  0.7057,  0.3809,  0.4579,  0.5963,
         0.6774,  0.4559,  0.3724,  0.2703,  0.3897,  0.4127,  0.3342,
         0.3578,  0.5456,  0.4517,  0.3703,  0.6066,  0.5538,  0.3065,
         0.2751,  0.5160,  0.4920,  0.3676,  0.5213,  0.6967,  0.5006,
         0.4556,  0.4424,  0.3353,  0.3488,  0.1997,  0.3519,  0.5127,
         0.4713,  0.2829,  0.2759,  0.4628,  0.4513,  0.5020,  0.3852,
         0.5212,  0.4410,  0.5676,  0.4872,  0.5289,  0.4447,  0.4482,
         0.4864,  0.2537,  0.5245,  0.6246,  0.6153,  0.5966,  0.6467,
         0.4337,  0.3460,  0.3800,  0.4870,  0.3469,  0.4188,  0.4457,
         0.6083,  0.3910,  0.3743,  0.6449,  0.4773,  0.3648,  0.4242,
         0.3021,  0.3710,  0.3338,  0.3399,  0.2751,  0.5410,  0.5172,
         0.3463,  0.4919,  0.6248,  0.4808,  0.2921,  0.4756,  0.3375,
         0.3269,  0.3467,  0.4512,  0.5067,  0.3097,  0.3123,  0.4866,
         0.3742,  0.4845,  0.3665,  0.3153,  0.4425,  0.4470,  0.4751,
         0.5737,  0.3608,  0.3346,  0.3196,  0.4002,  0.3129,  0.3636,
         0.2957,  0.5140,  0.2938,  0.3589,  0.4794,  0.4139,  0.4264,
         0.5302,  0.3507,  0.5579,  0.4133,  0.4707,  0.2757,  0.3383,
         0.3792,  0.4548,  0.3878,  0.6250,  0.4801,  0.4597,  0.4771,
         0.4372,  0.3545,  0.2195,  0.6510,  0.3048,  0.2458,  0.7154,
         0.5443,  0.5532,  0.4667,  0.3072,  0.3713,  0.5378,  0.5317,
         0.5732,  0.5454,  0.4065,  0.1840,  0.6060,  0.2763,  0.2627,
         0.5325,  0.3961,  0.6152,  0.4530,  0.7229,  0.4782,  0.4703,
         0.2827,  0.4176,  0.3745,  0.3849,  0.5428,  0.7401,  0.3034,
         0.4197,  0.6394,  0.4469,  0.4241,  0.3129,  0.5474,  0.3912,
         0.2252,  0.3821,  0.5548,  0.4498,  0.4860,  0.4328,  0.4325,
         0.4146,  0.6160,  0.4122,  0.6317,  0.5717,  0.5432,  0.5547,
         0.5160,  0.3924,  0.4668,  0.4125,  0.3855,  0.4334,  0.3391,
         0.4186,  0.4883,  0.4646,  0.4115,  0.3846,  0.4780,  0.3779,
         0.3851,  0.4665,  0.4761,  0.4850,  0.3688,  0.4653,  0.3733,
         0.3565,  0.4016,  0.2491,  0.5968,  0.4387,  0.4283,  0.4527,
         0.2476,  0.4346,  0.3644,  0.3814,  0.4264,  0.3729,  0.5118,
         0.5527,  0.3379,  0.5822,  0.2997,  0.4147,  0.6387,  0.4367,
         0.5586,  0.4744,  0.6077,  0.6146,  0.4304,  0.2925,  0.3848,
         0.4155,  0.4282,  0.3994,  0.4597,  0.4713,  0.3484,  0.3295,
         0.4511,  0.3839,  0.6284,  0.3521,  0.5409,  0.2724,  0.3706,
         0.3821,  0.4905,  0.3076,  0.2835,  0.2346,  0.2243,  0.3737,
         0.2919,  0.4960,  0.4350,  0.5460,  0.5906,  0.4458,  0.3280,
         0.4381,  0.6092,  0.3956,  0.4694,  0.3087,  0.3270,  0.3867,
         0.2079,  0.4319,  0.6023,  0.4786,  0.4790,  0.3226,  0.4538,
         0.4288,  0.5009,  0.5190,  0.3062,  0.3454,  0.3481,  0.4525,
         0.5074,  0.6560,  0.6699,  0.2780,  0.2851,  0.4095,  0.3623,
         0.6297,  0.3845,  0.3473,  0.4305,  0.6162,  0.4263,  0.5382,
         0.4195,  0.2645,  0.4207,  0.4922,  0.3230,  0.3690,  0.2449,
         0.6103,  0.3537,  0.4605,  0.5390,  0.5440,  0.5978,  0.3581,
         0.5509,  0.3540,  0.5732,  0.3357,  0.4962,  0.4299,  0.4710,
         0.6099,  0.3559,  0.2318,  0.4745,  0.3093,  0.5093,  0.4811,
         0.3643,  0.4808,  0.3327,  0.4596,  0.6068,  0.5332,  0.2936,
         0.5229,  0.5303,  0.4891,  0.5073,  0.3625,  0.2910,  0.2352,
         0.4410,  0.4984,  0.3603,  0.3953,  0.4708,  0.3187,  0.4283,
         0.4514,  0.4490,  0.3131,  0.6822,  0.3629,  0.5516,  0.2431,
         0.6267,  0.5781,  0.4412,  0.2316,  0.4139,  0.4111,  0.2566,
         0.3421,  0.2783,  0.5216,  0.5328,  0.3560,  0.4126,  0.4013,
         0.5240,  0.5051,  0.6576,  0.5229,  0.5287,  0.4145,  0.6529,
         0.4070,  0.3840,  0.4629,  0.4140,  0.3338,  0.3671,  0.4359,
         0.4469,  0.3193,  0.3743,  0.4087,  0.4674,  0.3238,  0.7180,
         0.3936,  0.5848,  0.4501,  0.3498,  0.4572,  0.2315,  0.4836,
         0.4515,  0.6356,  0.3655,  0.2967,  0.3407,  0.5508,  0.4572,
         0.4977,  0.3923,  0.5393,  0.4144,  0.4218,  0.3571,  0.3518,
         0.3813,  0.6950,  0.2923,  0.5269,  0.5405,  0.4737,  0.4303,
         0.4569,  0.5587,  0.5113,  0.5025,  0.4938,  0.3786,  0.5273,
         0.4108,  0.3354,  0.6736,  0.3826,  0.5030,  0.4955,  0.4797,
         0.4864,  0.4600,  0.3812,  0.2817,  0.3198,  0.3616,  0.3010,
         0.5060,  0.3502,  0.3614,  0.5301,  0.3548,  0.3467,  0.3378,
         0.5619,  0.5503,  0.5700,  0.3771,  0.3627,  0.2455,  0.3693,
         0.4043,  0.5277,  0.3503,  0.3595,  0.4505,  0.3589,  0.5900,
         0.3891,  0.2669,  0.3908,  0.3321,  0.4479,  0.3553,  0.5050,
         0.3170,  0.4631,  0.6350,  0.2848,  0.3118,  0.3943,  0.4140,
         0.4344,  0.3627,  0.4829,  0.4754,  0.5057,  0.3634,  0.2920,
         0.3400,  0.3147,  0.5501,  0.4591,  0.4378,  0.6226,  0.4052,
         0.3660,  0.4532,  0.3005,  0.5841,  0.3883,  0.5930,  0.3266,
         0.3564,  0.4311,  0.4567,  0.3262,  0.5478,  0.3524,  0.4597,
         0.6440,  0.3735,  0.3109,  0.5902,  0.4084,  0.5579,  0.3544,
         0.5242,  0.4792,  0.4592,  0.6108,  0.2946,  0.3410,  0.6113,
         0.4151], device='cuda:0')
tensor(0.6838, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3191,  0.3986,  0.5540,  0.4640,  0.4578,  0.3251,  0.4135,
         0.4232,  0.6074,  0.4279,  0.2937,  0.2617,  0.4001,  0.5259,
         0.2331,  0.4670,  0.6182,  0.5561,  0.4448,  0.4078,  0.3644,
         0.4106,  0.5054,  0.3614,  0.4768,  0.3448,  0.4883,  0.4282,
         0.4587,  0.5583,  0.4705,  0.6356,  0.4119,  0.3464,  0.3318,
         0.2894,  0.4853,  0.3516,  0.5453,  0.3549,  0.4883,  0.3857,
         0.4835,  0.5483,  0.3401,  0.5085,  0.5213,  0.3465,  0.3420,
         0.5615,  0.4282,  0.3850,  0.3818,  0.4968,  0.4998,  0.4750,
         0.4375,  0.6037,  0.4681,  0.4320,  0.5415,  0.4344,  0.6164,
         0.3538,  0.4818,  0.4062,  0.4512,  0.4298,  0.4078,  0.3197,
         0.6163,  0.3817,  0.3669,  0.3956,  0.4169,  0.4010,  0.4492,
         0.2758,  0.4544,  0.2361,  0.3293,  0.5826,  0.3117,  0.2711,
         0.4043,  0.4351,  0.4921,  0.3106,  0.4237,  0.5558,  0.4195,
         0.2860,  0.4086,  0.4436,  0.4746,  0.5129,  0.3104,  0.3204,
         0.4368,  0.4428,  0.3746,  0.4814,  0.4150,  0.3104,  0.4120,
         0.3770,  0.4250,  0.4256,  0.4357,  0.5129,  0.4171,  0.4381,
         0.4167,  0.3733,  0.3627,  0.4526,  0.4275,  0.3957,  0.4869,
         0.3656,  0.4591,  0.4767,  0.5691,  0.4302,  0.4205,  0.4805,
         0.5327,  0.5128,  0.4499,  0.4633,  0.4161,  0.5693,  0.3029,
         0.5405,  0.5587,  0.4142,  0.6040,  0.3768,  0.6071,  0.6181,
         0.4726,  0.5363,  0.4371,  0.3881,  0.5372,  0.4332,  0.3572,
         0.3322,  0.4613,  0.4693,  0.4314,  0.4479,  0.2945,  0.6499,
         0.5332,  0.3905,  0.3612,  0.4736,  0.4396,  0.4501,  0.7394,
         0.3742,  0.4477,  0.5809,  0.3094,  0.3131,  0.3756,  0.4763,
         0.4609,  0.5771,  0.3929,  0.3712,  0.4734,  0.4054,  0.4725,
         0.4746,  0.3269,  0.6205,  0.5780,  0.3194,  0.5007,  0.5018,
         0.5548,  0.5873,  0.5036,  0.4518,  0.5664,  0.6840,  0.3890,
         0.4918,  0.5265,  0.5107,  0.3653,  0.3195,  0.4110,  0.3616,
         0.5663,  0.5726,  0.3747,  0.5412,  0.3732,  0.3772,  0.3981,
         0.4790,  0.5668,  0.4117,  0.3570,  0.5323,  0.4057,  0.5723,
         0.4768,  0.3947,  0.4424,  0.4823,  0.4802,  0.7106,  0.4537,
         0.2571,  0.4041,  0.5145,  0.4374,  0.3772,  0.4066,  0.3966,
         0.3180,  0.4661,  0.5859,  0.6037,  0.7045,  0.5028,  0.5853,
         0.3943,  0.3946,  0.5958,  0.5036,  0.4980,  0.4463,  0.3647,
         0.3928,  0.3417,  0.4456,  0.3169,  0.5366,  0.3140,  0.4585,
         0.3627,  0.5326,  0.5317,  0.4005,  0.3460,  0.4508,  0.4387,
         0.4052,  0.5521,  0.5036,  0.5818,  0.5942,  0.4529,  0.5687,
         0.3139,  0.3272,  0.5864,  0.4256,  0.4868,  0.3692,  0.5438,
         0.3669,  0.4876,  0.5174,  0.4523,  0.3092,  0.2874,  0.4505,
         0.4597,  0.4385,  0.5402,  0.3804,  0.3760,  0.5075,  0.3137,
         0.3057,  0.4037,  0.2466,  0.4379,  0.6341,  0.5266,  0.3213,
         0.2903,  0.4555,  0.7551,  0.2934,  0.4278,  0.3811,  0.5998,
         0.4690,  0.4059,  0.4294,  0.4077,  0.5951,  0.3839,  0.4845,
         0.2790,  0.4183,  0.4923,  0.4573,  0.6152,  0.2517,  0.4039,
         0.4169,  0.4010,  0.6326,  0.3952,  0.2925,  0.3217,  0.3861,
         0.4003,  0.3690,  0.5485,  0.6328,  0.4121,  0.4833,  0.6624,
         0.4397,  0.2920,  0.4954,  0.3984,  0.5938,  0.3600,  0.5550,
         0.4401,  0.3909,  0.4063,  0.5482,  0.4963,  0.3943,  0.4820,
         0.4070,  0.3114,  0.4060,  0.3935,  0.6271,  0.5382,  0.5186,
         0.5859,  0.3085,  0.3705,  0.5366,  0.5291,  0.3032,  0.4533,
         0.4765,  0.3788,  0.5204,  0.4838,  0.3944,  0.3325,  0.3505,
         0.5799,  0.2876,  0.4777,  0.4826,  0.3291,  0.5780,  0.4174,
         0.4861,  0.3774,  0.3592,  0.5681,  0.4280,  0.2506,  0.5940,
         0.3652,  0.4446,  0.6164,  0.4992,  0.4166,  0.4761,  0.5039,
         0.5875,  0.3535,  0.4226,  0.5356,  0.5370,  0.5350,  0.3209,
         0.4743,  0.4501,  0.4382,  0.5317,  0.3320,  0.5427,  0.4280,
         0.4270,  0.5944,  0.5106,  0.4801,  0.3696,  0.5469,  0.4028,
         0.5556,  0.5404,  0.3002,  0.3977,  0.4765,  0.3261,  0.5161,
         0.3173,  0.5442,  0.3324,  0.2401,  0.4726,  0.4925,  0.4405,
         0.5162,  0.5270,  0.4272,  0.3309,  0.2064,  0.3633,  0.4448,
         0.4500,  0.5609,  0.3624,  0.3637,  0.5305,  0.3578,  0.3730,
         0.6167,  0.4839,  0.5642,  0.3555,  0.4094,  0.4591,  0.6238,
         0.4310,  0.3988,  0.4345,  0.6122,  0.4210,  0.2184,  0.5693,
         0.3335,  0.4759,  0.4867,  0.5951,  0.4614,  0.3755,  0.6720,
         0.4833,  0.4355,  0.2317,  0.4020,  0.6016,  0.4292,  0.3645,
         0.3949,  0.2042,  0.4633,  0.2909,  0.4377,  0.4527,  0.6538,
         0.4685,  0.3999,  0.3813,  0.4210,  0.3897,  0.5716,  0.5360,
         0.4392,  0.5374,  0.4735,  0.4432,  0.4256,  0.3402,  0.4139,
         0.4798,  0.4974,  0.4646,  0.3274,  0.4328,  0.3976,  0.3804,
         0.4685,  0.4407,  0.5434,  0.5531,  0.4099,  0.4842,  0.5138,
         0.3722,  0.5289,  0.5764,  0.3722,  0.5270,  0.3834,  0.5735,
         0.4390,  0.3745,  0.3940,  0.4576,  0.4275,  0.4431,  0.5074,
         0.6387,  0.6254,  0.5128,  0.4660,  0.4243,  0.4421,  0.4806,
         0.4769], device='cuda:0')
tensor(0.6670, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2975,  0.5221,  0.4497,  0.4291,  0.5676,  0.5163,  0.3125,
         0.5008,  0.5870,  0.4658,  0.4928,  0.3702,  0.3543,  0.3377,
         0.3338,  0.3828,  0.5310,  0.4335,  0.3217,  0.5703,  0.5782,
         0.5569,  0.5011,  0.6162,  0.6806,  0.5733,  0.4602,  0.3939,
         0.4751,  0.3733,  0.4089,  0.3949,  0.4768,  0.5757,  0.5527,
         0.6949,  0.5140,  0.5447,  0.4108,  0.3954,  0.4488,  0.4866,
         0.4509,  0.3858,  0.4216,  0.3515,  0.4438,  0.3344,  0.4513,
         0.3903,  0.5457,  0.3344,  0.5436,  0.3684,  0.4512,  0.4750,
         0.4724,  0.4088,  0.5151,  0.4498,  0.5403,  0.4954,  0.5115,
         0.4273,  0.4296,  0.2976,  0.4325,  0.4439,  0.4527,  0.4422,
         0.4972,  0.3590,  0.3577,  0.4733,  0.6348,  0.5140,  0.4057,
         0.3923,  0.4077,  0.2718,  0.5831,  0.4771,  0.4876,  0.3080,
         0.4776,  0.5223,  0.4740,  0.3269,  0.3714,  0.5418,  0.5290,
         0.5965,  0.2967,  0.4099,  0.4613,  0.4697,  0.4380,  0.6036,
         0.3630,  0.5568,  0.4492,  0.4913,  0.4004,  0.4683,  0.4948,
         0.5561,  0.5404,  0.4230,  0.6212,  0.5067,  0.4810,  0.3433,
         0.4032,  0.3615,  0.4848,  0.4014,  0.3981,  0.5591,  0.5856,
         0.6308,  0.3520,  0.4595,  0.4351,  0.4491,  0.3820,  0.3670,
         0.5676,  0.4531,  0.4320,  0.4459,  0.4201,  0.6682,  0.5029,
         0.5255,  0.4986,  0.3552,  0.4391,  0.4785,  0.4031,  0.5221,
         0.2613,  0.5540,  0.4613,  0.4480,  0.3951,  0.4219,  0.4679,
         0.5369,  0.5525,  0.3695,  0.5136,  0.4819,  0.4051,  0.4315,
         0.3336,  0.5341,  0.4131,  0.2449,  0.6226,  0.3825,  0.3918,
         0.4084,  0.4366,  0.4614,  0.3098,  0.5506,  0.2681,  0.3990,
         0.3587,  0.4854,  0.5372,  0.5055,  0.4190,  0.4906,  0.4851,
         0.5271,  0.4084,  0.4528,  0.4354,  0.5724,  0.2857,  0.5428,
         0.6480,  0.6471,  0.3920,  0.5022,  0.3604,  0.5722,  0.6161,
         0.4296,  0.4671,  0.5262,  0.4096,  0.5083,  0.3520,  0.4614,
         0.5658,  0.5490,  0.4376,  0.4790,  0.4592,  0.6263,  0.5177,
         0.6320,  0.2691,  0.3565,  0.6654,  0.3487,  0.4330,  0.5691,
         0.4757,  0.6035,  0.5659,  0.5026,  0.4954,  0.4949,  0.3236,
         0.4044,  0.4110,  0.4218,  0.4026,  0.5592,  0.3125,  0.4774,
         0.5015,  0.4458,  0.4655,  0.4980,  0.4224,  0.4298,  0.3801,
         0.3186,  0.2976,  0.5003,  0.3404,  0.5294,  0.6648,  0.5084,
         0.4666,  0.3703,  0.3987,  0.2554,  0.4855,  0.5227,  0.4070,
         0.4831,  0.4743,  0.4210,  0.4300,  0.3246,  0.6029,  0.4033,
         0.4786,  0.5281,  0.3687,  0.6384,  0.3867,  0.5965,  0.5199,
         0.3560,  0.3831,  0.4784,  0.4410,  0.5202,  0.3763,  0.3730,
         0.3011,  0.3384,  0.4337,  0.4431,  0.4041,  0.4495,  0.5765,
         0.3374,  0.3837,  0.4968,  0.4565,  0.3500,  0.4635,  0.2511,
         0.3565,  0.4197,  0.6308,  0.5193,  0.4528,  0.4803,  0.4032,
         0.3763,  0.4666,  0.4635,  0.4160,  0.3898,  0.2825,  0.4841,
         0.3891,  0.3227,  0.4737,  0.3135,  0.5178,  0.5011,  0.4439,
         0.3654,  0.5839,  0.4402,  0.3999,  0.4699,  0.4295,  0.5596,
         0.4441,  0.4836,  0.3324,  0.4523,  0.4680,  0.4045,  0.4958,
         0.3215,  0.5513,  0.6318,  0.5310,  0.5105,  0.5228,  0.4339,
         0.5190,  0.4411,  0.2960,  0.4738,  0.3059,  0.4043,  0.3202,
         0.4416,  0.4792,  0.5049,  0.3297,  0.3448,  0.6370,  0.6775,
         0.5080,  0.4412,  0.3799,  0.4937,  0.5986,  0.5209,  0.3460,
         0.4171,  0.4743,  0.3584,  0.3456,  0.6539,  0.5089,  0.4792,
         0.3527,  0.4436,  0.4368,  0.4446,  0.5052,  0.4109,  0.4373,
         0.3776,  0.4765,  0.5095,  0.3873,  0.4500,  0.4172,  0.6623,
         0.4695,  0.5634,  0.6450,  0.5159,  0.5308,  0.4187,  0.4366,
         0.5205,  0.4791,  0.3917,  0.4885,  0.4466,  0.5993,  0.4208,
         0.3998,  0.4339,  0.4013,  0.3488,  0.5206,  0.3932,  0.4279,
         0.3739,  0.4724,  0.5356,  0.4620,  0.3663,  0.4634,  0.4096,
         0.4387,  0.5148,  0.5666,  0.5481,  0.7109,  0.3785,  0.6105,
         0.4885,  0.3669,  0.4986,  0.5778,  0.5655,  0.5112,  0.5940,
         0.3891,  0.5541,  0.3179,  0.2866,  0.3800,  0.3959,  0.3766,
         0.4501,  0.3992,  0.3658,  0.4950,  0.4107,  0.4774,  0.4030,
         0.4778,  0.4628,  0.5117,  0.4618,  0.3350,  0.4786,  0.4851,
         0.4075,  0.5310,  0.4033,  0.4578,  0.5683,  0.5835,  0.3416,
         0.5281,  0.3959,  0.5033,  0.3601,  0.3974,  0.5666,  0.4541,
         0.4528,  0.4231,  0.4096,  0.6698,  0.4288,  0.3896,  0.5201,
         0.3804,  0.3697,  0.2381,  0.4278,  0.4783,  0.5559,  0.4184,
         0.4125,  0.5069,  0.4464,  0.3356,  0.5346,  0.5015,  0.3854,
         0.6315,  0.5193,  0.5315,  0.4222,  0.4997,  0.3333,  0.4578,
         0.3562,  0.4235,  0.4673,  0.5202,  0.5533,  0.5082,  0.5015,
         0.4586,  0.4950,  0.4514,  0.4796,  0.4064,  0.4290,  0.3152,
         0.5759,  0.3915,  0.4246,  0.2854,  0.5011,  0.4505,  0.3988,
         0.3875,  0.5132,  0.4516,  0.6157,  0.4416,  0.3032,  0.4586,
         0.4846,  0.5774,  0.5248,  0.5909,  0.5694,  0.4626,  0.5550,
         0.3473,  0.4404,  0.5020,  0.3634,  0.4337,  0.4760,  0.5687,
         0.3580], device='cuda:0')
tensor(0.6546, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5132,  0.4375,  0.5975,  0.4652,  0.5191,  0.6022,  0.4132,
         0.5060,  0.7044,  0.4689,  0.4780,  0.6162,  0.5535,  0.4701,
         0.3498,  0.3500,  0.4155,  0.3713,  0.4337,  0.5379,  0.6463,
         0.3886,  0.4485,  0.5005,  0.6227,  0.5495,  0.5543,  0.4187,
         0.6808,  0.6527,  0.4216,  0.5521,  0.5097,  0.5234,  0.4434,
         0.4369,  0.4615,  0.4380,  0.5074,  0.4565,  0.6208,  0.5436,
         0.5217,  0.4309,  0.5467,  0.4756,  0.3967,  0.3591,  0.2824,
         0.3589,  0.3803,  0.6325,  0.4054,  0.4097,  0.3659,  0.4838,
         0.6059,  0.5325,  0.4484,  0.5673,  0.3837,  0.4413,  0.3746,
         0.4493,  0.4672,  0.3641,  0.4597,  0.4185,  0.4486,  0.3313,
         0.4457,  0.3837,  0.4250,  0.4129,  0.4967,  0.4838,  0.5080,
         0.4786,  0.4474,  0.4945,  0.4429,  0.4286,  0.4033,  0.6222,
         0.7265,  0.4657,  0.4323,  0.4892,  0.5065,  0.5317,  0.4927,
         0.5182,  0.6048,  0.5420,  0.6392,  0.4576,  0.3970,  0.3450,
         0.4679,  0.3994,  0.5796,  0.4774,  0.4362,  0.4249,  0.4947,
         0.5829,  0.5131,  0.6555,  0.4545,  0.6020,  0.4157,  0.4780,
         0.3285,  0.6223,  0.5293,  0.5711,  0.4514,  0.5659,  0.5267,
         0.5541,  0.4873,  0.3923,  0.5270,  0.4376,  0.4970,  0.5533,
         0.4041,  0.3755,  0.5019,  0.3895,  0.4830,  0.4711,  0.4137,
         0.3768,  0.3555,  0.6585,  0.5878,  0.4821,  0.5168,  0.4815,
         0.5290,  0.6108,  0.4438,  0.5210,  0.4726,  0.5808,  0.6072,
         0.5299,  0.4221,  0.4620,  0.6012,  0.2695,  0.5897,  0.4325,
         0.5857,  0.5044,  0.5667,  0.5336,  0.4482,  0.3915,  0.5054,
         0.3790,  0.4831,  0.5097,  0.3934,  0.3595,  0.6584,  0.5543,
         0.4499,  0.5079,  0.2994,  0.5087,  0.4705,  0.4457,  0.4226,
         0.4676,  0.5285,  0.4330,  0.5747,  0.5488,  0.3870,  0.5656,
         0.4665,  0.3822,  0.3901,  0.4918,  0.5182,  0.4238,  0.4893,
         0.5079,  0.3409,  0.6549,  0.2873,  0.5170,  0.2789,  0.5602,
         0.5381,  0.5997,  0.4610,  0.4725,  0.5839,  0.5422,  0.3403,
         0.6408,  0.4748,  0.4951,  0.4264,  0.3218,  0.5536,  0.4728,
         0.4569,  0.6316,  0.5008,  0.5498,  0.4546,  0.4597,  0.6135,
         0.5276,  0.5412,  0.5481,  0.5681,  0.3429,  0.5967,  0.4199,
         0.3802,  0.5132,  0.4868,  0.4771,  0.6432,  0.2578,  0.4754,
         0.3526,  0.4905,  0.3494,  0.5584,  0.5075,  0.4768,  0.5610,
         0.5001,  0.2947,  0.3703,  0.3811,  0.4916,  0.3894,  0.4607,
         0.6368,  0.3620,  0.4735,  0.5907,  0.5904,  0.4015,  0.4773,
         0.6198,  0.3404,  0.3879,  0.5800,  0.5609,  0.4869,  0.5269,
         0.6782,  0.4604,  0.5767,  0.3919,  0.4642,  0.4951,  0.5115,
         0.4860,  0.5657,  0.4541,  0.4809,  0.5307,  0.5156,  0.3976,
         0.6301,  0.4213,  0.4495,  0.4581,  0.5331,  0.4608,  0.5647,
         0.4418,  0.4046,  0.5063,  0.5354,  0.4606,  0.4531,  0.5715,
         0.4622,  0.4823,  0.5151,  0.4165,  0.5431,  0.5700,  0.4181,
         0.4113,  0.5163,  0.6383,  0.4957,  0.5087,  0.4259,  0.4804,
         0.4306,  0.4899,  0.4060,  0.4811,  0.5982,  0.3827,  0.3764,
         0.4390,  0.5788,  0.5293,  0.6003,  0.4604,  0.4666,  0.4409,
         0.5188,  0.4016,  0.3115,  0.4212,  0.5427,  0.5538,  0.5603,
         0.5961,  0.3950,  0.4284,  0.3849,  0.4206,  0.5871,  0.7183,
         0.3857,  0.5373,  0.6571,  0.4949,  0.3196,  0.6089,  0.4419,
         0.5551,  0.5323,  0.5322,  0.5273,  0.4153,  0.3996,  0.5183,
         0.5253,  0.5013,  0.4633,  0.5767,  0.3503,  0.5411,  0.2939,
         0.4700,  0.3631,  0.3743,  0.5225,  0.3739,  0.4706,  0.4827,
         0.4657,  0.5251,  0.5482,  0.5855,  0.4805,  0.3871,  0.3978,
         0.4868,  0.4238,  0.4957,  0.5902,  0.5487,  0.5190,  0.6220,
         0.4250,  0.4910,  0.4846,  0.4375,  0.5069,  0.5260,  0.4997,
         0.4755,  0.4516,  0.4734,  0.5681,  0.4185,  0.6161,  0.6385,
         0.5325,  0.4655,  0.5008,  0.4716,  0.4810,  0.5470,  0.6027,
         0.4715,  0.4541,  0.5125,  0.5255,  0.4943,  0.4968,  0.5217,
         0.2527,  0.5230,  0.4528,  0.5060,  0.5428,  0.4165,  0.5618,
         0.3255,  0.4882,  0.3324,  0.5203,  0.5861,  0.5555,  0.6088,
         0.3761,  0.3793,  0.6506,  0.5062,  0.4082,  0.4561,  0.4231,
         0.3611,  0.4452,  0.3206,  0.4584,  0.5003,  0.7176,  0.4736,
         0.5016,  0.5175,  0.4843,  0.3102,  0.4936,  0.3920,  0.5577,
         0.4850,  0.5374,  0.4194,  0.4513,  0.2643,  0.3493,  0.4677,
         0.4049,  0.5887,  0.4331,  0.6249,  0.5766,  0.3863,  0.4666,
         0.4672,  0.6096,  0.6509,  0.3343,  0.4728,  0.4489,  0.4716,
         0.5392,  0.4546,  0.3776,  0.4730,  0.3675,  0.6005,  0.5089,
         0.4480,  0.6573,  0.4621,  0.4152,  0.3671,  0.5471,  0.4647,
         0.5334,  0.3126,  0.5864,  0.4362,  0.3834,  0.4308,  0.5287,
         0.3899,  0.4243,  0.4055,  0.5710,  0.5373,  0.4052,  0.5328,
         0.5122,  0.3425,  0.3964,  0.3531,  0.5467,  0.3500,  0.5116,
         0.5825,  0.5556,  0.5366,  0.5087,  0.6414,  0.3108,  0.3924,
         0.5290,  0.5862,  0.4734,  0.4359,  0.5113,  0.4962,  0.4747,
         0.4332,  0.5377,  0.5016,  0.4220,  0.4551,  0.4624,  0.4798,
         0.3873], device='cuda:0')
tensor(0.6681, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4943,  0.6235,  0.5452,  0.5016,  0.4154,  0.2881,  0.3742,
         0.4706,  0.4840,  0.4209,  0.4990,  0.6018,  0.5794,  0.3926,
         0.5422,  0.4500,  0.5156,  0.2804,  0.3963,  0.3996,  0.5202,
         0.6214,  0.5499,  0.4662,  0.4273,  0.4625,  0.5068,  0.3634,
         0.6039,  0.5941,  0.5925,  0.3664,  0.5548,  0.4172,  0.4480,
         0.5895,  0.3794,  0.5476,  0.4938,  0.5562,  0.4338,  0.4749,
         0.4279,  0.4661,  0.4078,  0.5349,  0.5969,  0.5088,  0.4981,
         0.3995,  0.4922,  0.6817,  0.4349,  0.4731,  0.4639,  0.4879,
         0.5215,  0.4465,  0.4635,  0.4489,  0.4715,  0.6326,  0.6030,
         0.5041,  0.5349,  0.4624,  0.5008,  0.5093,  0.5745,  0.5113,
         0.5385,  0.5202,  0.4423,  0.6935,  0.4732,  0.4691,  0.4317,
         0.5376,  0.6186,  0.4970,  0.4524,  0.5300,  0.5966,  0.4585,
         0.3965,  0.4342,  0.2861,  0.5891,  0.4158,  0.3925,  0.4998,
         0.3979,  0.4960,  0.4597,  0.4584,  0.5860,  0.5278,  0.6125,
         0.5401,  0.4897,  0.4855,  0.3978,  0.4328,  0.4376,  0.4824,
         0.5070,  0.6091,  0.4706,  0.6206,  0.4347,  0.4595,  0.5321,
         0.5531,  0.3669,  0.5463,  0.4333,  0.4911,  0.5657,  0.4582,
         0.3658,  0.4467,  0.4287,  0.3991,  0.6288,  0.5475,  0.5321,
         0.3548,  0.5162,  0.5282,  0.4807,  0.3513,  0.5176,  0.4245,
         0.5610,  0.5296,  0.5382,  0.5456,  0.5645,  0.5439,  0.5511,
         0.3572,  0.4820,  0.5002,  0.6382,  0.4873,  0.4755,  0.4558,
         0.5923,  0.5156,  0.4886,  0.5737,  0.4810,  0.4648,  0.5184,
         0.5640,  0.3687,  0.4784,  0.4343,  0.7031,  0.3977,  0.3875,
         0.4169,  0.3114,  0.5340,  0.4358,  0.5395,  0.4859,  0.6024,
         0.5861,  0.4444,  0.4461,  0.3584,  0.4631,  0.3988,  0.5252,
         0.4045,  0.3688,  0.4812,  0.5886,  0.5728,  0.5184,  0.5693,
         0.3946,  0.6007,  0.5092,  0.5043,  0.5643,  0.5107,  0.6279,
         0.4510,  0.5069,  0.5815,  0.6248,  0.3923,  0.5870,  0.5895,
         0.3687,  0.3537,  0.5017,  0.5286,  0.4802,  0.5283,  0.5133,
         0.4414,  0.4860,  0.5819,  0.4910,  0.5592,  0.4542,  0.3928,
         0.3744,  0.5468,  0.4557,  0.5069,  0.5065,  0.6077,  0.4418,
         0.4610,  0.4089,  0.3847,  0.5006,  0.4786,  0.4445,  0.5013,
         0.4274,  0.4304,  0.5083,  0.4399,  0.3653,  0.6437,  0.4399,
         0.4381,  0.6149,  0.6732,  0.5592,  0.5047,  0.5025,  0.4994,
         0.5419,  0.5952,  0.4940,  0.6102,  0.5844,  0.4923,  0.5499,
         0.5696,  0.4617,  0.5787,  0.4997,  0.4617,  0.5230,  0.4919,
         0.5038,  0.4793,  0.5670,  0.5603,  0.4392,  0.4716,  0.4062,
         0.5797,  0.4573,  0.3982,  0.5129,  0.5588,  0.4606,  0.5320,
         0.4758,  0.6213,  0.3497,  0.3720,  0.4167,  0.5000,  0.4719,
         0.5916,  0.3657,  0.4332,  0.4826,  0.7038,  0.5125,  0.4624,
         0.4348,  0.5590,  0.5339,  0.3879,  0.5185,  0.5858,  0.3455,
         0.4107,  0.4479,  0.4380,  0.6775,  0.3905,  0.4091,  0.5198,
         0.4780,  0.3438,  0.5219,  0.5340,  0.5194,  0.3955,  0.5921,
         0.5197,  0.5652,  0.4391,  0.6107,  0.4640,  0.5933,  0.4465,
         0.5735,  0.4437,  0.4493,  0.5141,  0.4367,  0.5884,  0.6388,
         0.3039,  0.4908,  0.5513,  0.4255,  0.4893,  0.4224,  0.5133,
         0.3357,  0.4996,  0.5476,  0.4556,  0.4842,  0.5872,  0.5127,
         0.5739,  0.5551,  0.4363,  0.5064,  0.5714,  0.4538,  0.5538,
         0.5155,  0.4543,  0.4531,  0.4399,  0.5257,  0.5193,  0.5721,
         0.3420,  0.5349,  0.4172,  0.4185,  0.5461,  0.5760,  0.5646,
         0.5050,  0.5407,  0.5455,  0.4106,  0.4734,  0.5398,  0.4962,
         0.3166,  0.5237,  0.4075,  0.3607,  0.4829,  0.4959,  0.5301,
         0.4905,  0.5692,  0.4091,  0.3209,  0.4802,  0.4209,  0.5834,
         0.5210,  0.4791,  0.4679,  0.4024,  0.4489,  0.5443,  0.5335,
         0.4152,  0.3608,  0.3729,  0.4707,  0.5024,  0.4096,  0.4547,
         0.5196,  0.3986,  0.5496,  0.3356,  0.5622,  0.4822,  0.4163,
         0.4919,  0.5578,  0.6381,  0.5083,  0.4633,  0.4215,  0.5528,
         0.5873,  0.5292,  0.5497,  0.4752,  0.5347,  0.5738,  0.5452,
         0.4495,  0.3381,  0.4949,  0.5852,  0.5141,  0.4967,  0.3768,
         0.5398,  0.4574,  0.5328,  0.3972,  0.5481,  0.3552,  0.4692,
         0.5314,  0.5099,  0.5045,  0.4690,  0.5799,  0.5183,  0.2970,
         0.5849,  0.5627,  0.5430,  0.4063,  0.4640,  0.3573,  0.4479,
         0.3966,  0.4588,  0.6153,  0.5102,  0.5011,  0.5091,  0.4392,
         0.2963,  0.4515,  0.4869,  0.4148,  0.3570,  0.3304,  0.3377,
         0.5106,  0.5688,  0.3561,  0.5559,  0.4041,  0.4058,  0.4004,
         0.4760,  0.5212,  0.3990,  0.4608,  0.5835,  0.4410,  0.5421,
         0.4746,  0.4224,  0.5748,  0.4166,  0.4505,  0.5847,  0.4144,
         0.4718,  0.4868,  0.5751,  0.6073,  0.5722,  0.5539,  0.4184,
         0.4959,  0.3992,  0.5220,  0.5209,  0.4973,  0.4454,  0.6388,
         0.6042,  0.5139,  0.4543,  0.4359,  0.5408,  0.5148,  0.4759,
         0.4075,  0.5504,  0.5584,  0.4164,  0.5472,  0.4977,  0.5969,
         0.5685,  0.6000,  0.4669,  0.6241,  0.4956,  0.3258,  0.5214,
         0.5693,  0.5577,  0.4802,  0.3248,  0.5386,  0.5804,  0.4047,
         0.6260], device='cuda:0')
tensor(0.6757, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4034,  0.5141,  0.5198,  0.4347,  0.3786,  0.5618,  0.5882,
         0.4724,  0.4798,  0.6018,  0.5357,  0.4844,  0.5892,  0.5159,
         0.5661,  0.4823,  0.4756,  0.4654,  0.4104,  0.4971,  0.3245,
         0.4570,  0.4612,  0.4834,  0.4618,  0.4492,  0.6052,  0.4851,
         0.4375,  0.4382,  0.5247,  0.4421,  0.4647,  0.6498,  0.3839,
         0.3504,  0.5051,  0.5691,  0.5440,  0.4567,  0.3536,  0.5409,
         0.6338,  0.5056,  0.5919,  0.4871,  0.5184,  0.4948,  0.4987,
         0.5039,  0.4942,  0.5557,  0.4428,  0.3751,  0.4889,  0.5847,
         0.3800,  0.4688,  0.4988,  0.3859,  0.4772,  0.5027,  0.4230,
         0.4687,  0.6587,  0.5305,  0.5430,  0.5013,  0.3767,  0.4847,
         0.6143,  0.5786,  0.5451,  0.5493,  0.5039,  0.4498,  0.5418,
         0.5439,  0.5727,  0.4778,  0.3366,  0.4355,  0.4006,  0.6198,
         0.3099,  0.4443,  0.6276,  0.5714,  0.5939,  0.3676,  0.5640,
         0.5141,  0.3149,  0.4930,  0.4161,  0.4563,  0.4974,  0.3148,
         0.5065,  0.5402,  0.5401,  0.4603,  0.4988,  0.6054,  0.5230,
         0.4891,  0.4960,  0.5654,  0.6181,  0.3525,  0.4893,  0.4755,
         0.6541,  0.5144,  0.4377,  0.4522,  0.4899,  0.4287,  0.3237,
         0.6341,  0.3834,  0.4421,  0.3594,  0.4101,  0.5465,  0.3971,
         0.4254,  0.5215,  0.5854,  0.4683,  0.4298,  0.4378,  0.6064,
         0.5463,  0.5417,  0.5968,  0.6103,  0.4851,  0.6323,  0.5139,
         0.5384,  0.3669,  0.4947,  0.4382,  0.5973,  0.4941,  0.5466,
         0.5307,  0.4997,  0.4670,  0.4605,  0.6065,  0.4870,  0.5229,
         0.6027,  0.5734,  0.4821,  0.5772,  0.5189,  0.4649,  0.4845,
         0.3404,  0.4421,  0.5493,  0.7165,  0.4089,  0.4968,  0.5108,
         0.6748,  0.4896,  0.4667,  0.5965,  0.4762,  0.4549,  0.3406,
         0.6513,  0.3312,  0.5177,  0.5525,  0.4873,  0.4399,  0.5079,
         0.2918,  0.5551,  0.5554,  0.5421,  0.5125,  0.3783,  0.5438,
         0.5076,  0.4344,  0.3661,  0.3979,  0.4771,  0.4778,  0.3966,
         0.3386,  0.4624,  0.4414,  0.6374,  0.5567,  0.4501,  0.5727,
         0.5260,  0.5259,  0.4023,  0.4792,  0.4602,  0.4625,  0.4679,
         0.5346,  0.5038,  0.4138,  0.4387,  0.4857,  0.3620,  0.5102,
         0.4061,  0.4661,  0.5333,  0.5033,  0.4826,  0.5156,  0.5109,
         0.5490,  0.4606,  0.5455,  0.6194,  0.5125,  0.5127,  0.4938,
         0.4551,  0.5543,  0.5657,  0.4945,  0.4061,  0.4971,  0.6390,
         0.6949,  0.4547,  0.4894,  0.5072,  0.5197,  0.5691,  0.6324,
         0.3552,  0.4624,  0.5359,  0.4717,  0.4533,  0.4824,  0.4488,
         0.4390,  0.6642,  0.5734,  0.4853,  0.4996,  0.4673,  0.5056,
         0.5247,  0.4455,  0.4567,  0.4469,  0.6543,  0.4760,  0.5078,
         0.6919,  0.4652,  0.5252,  0.5685,  0.5134,  0.5203,  0.5124,
         0.5289,  0.4666,  0.4720,  0.5885,  0.3911,  0.5060,  0.4301,
         0.6704,  0.4629,  0.4285,  0.6591,  0.6045,  0.3867,  0.4468,
         0.3961,  0.5319,  0.5139,  0.3898,  0.4412,  0.4596,  0.2906,
         0.3639,  0.3995,  0.3481,  0.4671,  0.4059,  0.6669,  0.3107,
         0.6089,  0.4684,  0.4551,  0.5479,  0.4724,  0.4987,  0.5357,
         0.4536,  0.6689,  0.5718,  0.4625,  0.5153,  0.4654,  0.5722,
         0.5436,  0.5161,  0.5166,  0.5101,  0.5423,  0.6714,  0.5652,
         0.4159,  0.4186,  0.5110,  0.3882,  0.6148,  0.5231,  0.5295,
         0.4700,  0.4931,  0.4938,  0.5328,  0.6382,  0.4579,  0.4824,
         0.4478,  0.4381,  0.5899,  0.5038,  0.3816,  0.4295,  0.6038,
         0.5324,  0.4291,  0.4634,  0.4174,  0.5903,  0.4886,  0.6038,
         0.4205,  0.5477,  0.3575,  0.5029,  0.5849,  0.4685,  0.4949,
         0.5051,  0.5888,  0.4549,  0.4735,  0.5620,  0.4059,  0.4672,
         0.4845,  0.4728,  0.4131,  0.4782,  0.6174,  0.4539,  0.6942,
         0.6144,  0.4761,  0.6044,  0.4849,  0.4961,  0.6421,  0.4944,
         0.4599,  0.5156,  0.4681,  0.5228,  0.5805,  0.6625,  0.5000,
         0.4002,  0.5584,  0.3789,  0.5618,  0.4661,  0.3205,  0.6510,
         0.3459,  0.4922,  0.3736,  0.5038,  0.6586,  0.3491,  0.5947,
         0.5261,  0.4291,  0.4555,  0.5156,  0.7400,  0.3718,  0.4351,
         0.4544,  0.3159,  0.5781,  0.4823,  0.4695,  0.4476,  0.4700,
         0.3584,  0.6038,  0.4499,  0.4542,  0.5022,  0.4751,  0.5299,
         0.5734,  0.2981,  0.5683,  0.5459,  0.4616,  0.5601,  0.4823,
         0.4527,  0.5094,  0.6619,  0.4239,  0.4824,  0.4946,  0.4851,
         0.4628,  0.3896,  0.3997,  0.5560,  0.4294,  0.5336,  0.4903,
         0.5574,  0.4764,  0.6111,  0.4119,  0.4169,  0.5655,  0.4727,
         0.7111,  0.4791,  0.3924,  0.4420,  0.5025,  0.5078,  0.4694,
         0.4483,  0.5345,  0.4108,  0.4192,  0.3375,  0.4561,  0.7171,
         0.5420,  0.5314,  0.4441,  0.6223,  0.5178,  0.5580,  0.4045,
         0.4941,  0.3534,  0.3541,  0.4812,  0.5025,  0.5038,  0.5174,
         0.4501,  0.5008,  0.3323,  0.6204,  0.5428,  0.6017,  0.5549,
         0.5341,  0.4403,  0.3899,  0.3819,  0.3718,  0.4690,  0.4602,
         0.3983,  0.5663,  0.3999,  0.5703,  0.5282,  0.5418,  0.4321,
         0.4925,  0.4642,  0.5587,  0.5151,  0.4741,  0.6276,  0.3116,
         0.5630,  0.4702,  0.3681,  0.5096,  0.4609,  0.7259,  0.5007,
         0.4264], device='cuda:0')
tensor(0.6609, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4563,  0.4436,  0.7009,  0.7204,  0.4563,  0.6107,  0.4571,
         0.6227,  0.5021,  0.5851,  0.4925,  0.6220,  0.6147,  0.6624,
         0.4038,  0.5494,  0.4612,  0.4856,  0.5758,  0.4785,  0.6172,
         0.5098,  0.2713,  0.4438,  0.3828,  0.6900,  0.4333,  0.5615,
         0.3778,  0.6128,  0.4545,  0.5294,  0.5761,  0.5936,  0.5976,
         0.4173,  0.4755,  0.6030,  0.4751,  0.4148,  0.6737,  0.5717,
         0.4761,  0.5317,  0.4780,  0.3687,  0.5826,  0.5556,  0.5399,
         0.3120,  0.3554,  0.7097,  0.5076,  0.5771,  0.4918,  0.5687,
         0.5493,  0.3882,  0.4668,  0.4847,  0.5758,  0.5081,  0.5179,
         0.5043,  0.4893,  0.5265,  0.3350,  0.4877,  0.5699,  0.5117,
         0.3997,  0.4822,  0.3466,  0.4425,  0.5321,  0.5577,  0.5210,
         0.5345,  0.4977,  0.4372,  0.3850,  0.4792,  0.3916,  0.5862,
         0.4455,  0.4549,  0.5746,  0.5615,  0.4517,  0.5873,  0.4583,
         0.5595,  0.5436,  0.6961,  0.5038,  0.4155,  0.5525,  0.4965,
         0.4478,  0.6309,  0.5570,  0.4332,  0.6686,  0.4863,  0.4884,
         0.5397,  0.3881,  0.4093,  0.4655,  0.4777,  0.3269,  0.5157,
         0.5410,  0.6212,  0.3911,  0.4310,  0.4504,  0.5105,  0.4964,
         0.5358,  0.5879,  0.5642,  0.5367,  0.5812,  0.5264,  0.4192,
         0.5305,  0.5582,  0.4882,  0.6032,  0.4566,  0.5268,  0.5004,
         0.5887,  0.5205,  0.4398,  0.4691,  0.5018,  0.5158,  0.4850,
         0.4892,  0.5135,  0.3594,  0.4625,  0.4626,  0.5321,  0.4541,
         0.4153,  0.4084,  0.4817,  0.5421,  0.4992,  0.5883,  0.5740,
         0.4634,  0.5245,  0.5104,  0.4486,  0.4765,  0.5090,  0.3995,
         0.4961,  0.3929,  0.4473,  0.3846,  0.6606,  0.4805,  0.4470,
         0.3916,  0.5438,  0.4358,  0.5837,  0.5640,  0.5326,  0.4217,
         0.5905,  0.5131,  0.5438,  0.5363,  0.5631,  0.4620,  0.4769,
         0.5407,  0.4532,  0.7285,  0.5434,  0.4545,  0.5592,  0.7000,
         0.3050,  0.5661,  0.4757,  0.4433,  0.5491,  0.5409,  0.4726,
         0.5165,  0.4733,  0.6134,  0.5838,  0.3600,  0.4843,  0.6751,
         0.6271,  0.4580,  0.5541,  0.4992,  0.3800,  0.5188,  0.5380,
         0.5399,  0.6704,  0.6045,  0.4387,  0.4826,  0.4082,  0.4038,
         0.4194,  0.5200,  0.5200,  0.5284,  0.2835,  0.3008,  0.4551,
         0.3814,  0.4115,  0.6210,  0.3431,  0.6062,  0.4529,  0.5538,
         0.4474,  0.4785,  0.6094,  0.6089,  0.4691,  0.5018,  0.6516,
         0.4759,  0.4023,  0.3229,  0.5299,  0.7323,  0.4589,  0.5575,
         0.4646,  0.5345,  0.5180,  0.6194,  0.5876,  0.4641,  0.4784,
         0.4592,  0.4151,  0.4106,  0.4839,  0.5824,  0.4384,  0.3820,
         0.5255,  0.5227,  0.5228,  0.5011,  0.4613,  0.4611,  0.4597,
         0.5057,  0.4380,  0.5075,  0.4880,  0.4924,  0.4660,  0.4731,
         0.4883,  0.5565,  0.5459,  0.5937,  0.4943,  0.3128,  0.5587,
         0.4397,  0.6120,  0.7399,  0.4518,  0.5462,  0.4230,  0.5733,
         0.5666,  0.4560,  0.3809,  0.6176,  0.5645,  0.4364,  0.4616,
         0.5622,  0.5071,  0.4598,  0.5646,  0.5873,  0.5529,  0.4617,
         0.5925,  0.5219,  0.6464,  0.5178,  0.4620,  0.5103,  0.5850,
         0.5439,  0.5266,  0.3593,  0.5349,  0.5582,  0.6971,  0.5694,
         0.5269,  0.5414,  0.5711,  0.4499,  0.5754,  0.5147,  0.4002,
         0.5099,  0.4859,  0.4965,  0.4208,  0.5391,  0.3921,  0.4523,
         0.4919,  0.5098,  0.4545,  0.6349,  0.4237,  0.5257,  0.3933,
         0.5229,  0.4473,  0.4137,  0.4608,  0.4587,  0.4639,  0.6118,
         0.4390,  0.5285,  0.4623,  0.4321,  0.4748,  0.5571,  0.3992,
         0.5015,  0.4391,  0.5051,  0.3886,  0.5335,  0.4997,  0.5185,
         0.4835,  0.4684,  0.5605,  0.4715,  0.4001,  0.4529,  0.5480,
         0.6050,  0.5359,  0.4989,  0.5230,  0.5436,  0.4099,  0.4394,
         0.3720,  0.4418,  0.5472,  0.4319,  0.4321,  0.4563,  0.4841,
         0.4835,  0.3597,  0.5167,  0.5439,  0.5648,  0.4509,  0.5012,
         0.5166,  0.5808,  0.5369,  0.3283,  0.6198,  0.5384,  0.5155,
         0.4289,  0.4028,  0.5449,  0.5725,  0.5613,  0.4417,  0.5016,
         0.4800,  0.4863,  0.4671,  0.4088,  0.6252,  0.5404,  0.3285,
         0.6718,  0.4875,  0.4822,  0.3463,  0.3539,  0.5608,  0.3962,
         0.6413,  0.4285,  0.5583,  0.5577,  0.3077,  0.4457,  0.5067,
         0.4395,  0.5376,  0.4416,  0.5042,  0.5033,  0.5828,  0.5779,
         0.5407,  0.5562,  0.5591,  0.4677,  0.5186,  0.5301,  0.4534,
         0.7362,  0.6364,  0.6481,  0.3741,  0.5846,  0.5799,  0.4667,
         0.4194,  0.4845,  0.6079,  0.4728,  0.4525,  0.5164,  0.3536,
         0.4746,  0.4951,  0.3836,  0.4631,  0.4709,  0.4991,  0.4415,
         0.6206,  0.5577,  0.5093,  0.4302,  0.5197,  0.5158,  0.5836,
         0.5192,  0.6534,  0.3678,  0.4736,  0.5372,  0.4515,  0.5129,
         0.6950,  0.5160,  0.5358,  0.4280,  0.5404,  0.4975,  0.6146,
         0.4035,  0.4234,  0.5984,  0.5273,  0.6738,  0.4731,  0.5043,
         0.3797,  0.4280,  0.3343,  0.4727,  0.4288,  0.4826,  0.4977,
         0.4725,  0.4666,  0.5124,  0.4085,  0.4837,  0.5435,  0.4769,
         0.5394,  0.6463,  0.4817,  0.4193,  0.5126,  0.5560,  0.5427,
         0.4900,  0.5076,  0.4155,  0.3641,  0.6128,  0.5987,  0.5839,
         0.5447], device='cuda:0')
tensor(0.6556, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4718,  0.4883,  0.3516,  0.6354,  0.4823,  0.4680,  0.4668,
         0.4897,  0.4739,  0.6016,  0.4973,  0.5292,  0.4957,  0.5335,
         0.4693,  0.4208,  0.5347,  0.5140,  0.4976,  0.4020,  0.4956,
         0.4651,  0.5684,  0.5846,  0.5277,  0.5084,  0.5448,  0.4100,
         0.5682,  0.4907,  0.4974,  0.5222,  0.3721,  0.4694,  0.5708,
         0.5617,  0.5303,  0.6062,  0.5268,  0.4528,  0.4066,  0.4077,
         0.5426,  0.4574,  0.5088,  0.3960,  0.4869,  0.5118,  0.4635,
         0.5556,  0.7384,  0.5233,  0.5255,  0.5162,  0.5173,  0.5229,
         0.3462,  0.5665,  0.4459,  0.4310,  0.4808,  0.4442,  0.4844,
         0.5913,  0.5177,  0.4086,  0.4899,  0.5447,  0.3849,  0.5672,
         0.5529,  0.5249,  0.5496,  0.4369,  0.5134,  0.4775,  0.5285,
         0.3807,  0.4290,  0.5236,  0.4489,  0.5142,  0.6674,  0.4953,
         0.6390,  0.6769,  0.5110,  0.4597,  0.5089,  0.3533,  0.4448,
         0.5105,  0.5013,  0.3993,  0.5935,  0.3856,  0.5684,  0.5203,
         0.4936,  0.4820,  0.4204,  0.6331,  0.4933,  0.7058,  0.4703,
         0.6448,  0.5137,  0.5210,  0.4954,  0.4564,  0.5452,  0.4046,
         0.4363,  0.4730,  0.4169,  0.6733,  0.4481,  0.4699,  0.5322,
         0.5029,  0.3921,  0.4763,  0.5255,  0.4437,  0.4127,  0.4796,
         0.3938,  0.5534,  0.4652,  0.5271,  0.4741,  0.4508,  0.5310,
         0.4574,  0.5526,  0.5143,  0.5668,  0.4765,  0.4477,  0.6005,
         0.6507,  0.4809,  0.6001,  0.7330,  0.4947,  0.5598,  0.5861,
         0.6290,  0.5024,  0.4816,  0.4142,  0.6067,  0.6388,  0.4922,
         0.5313,  0.5734,  0.5604,  0.3610,  0.4266,  0.4394,  0.5156,
         0.4504,  0.5335,  0.6482,  0.5328,  0.4993,  0.4173,  0.5426,
         0.5188,  0.4485,  0.5518,  0.3819,  0.4363,  0.5652,  0.5881,
         0.4298,  0.5513,  0.5113,  0.4827,  0.6451,  0.6008,  0.4584,
         0.5200,  0.7063,  0.4047,  0.5806,  0.5538,  0.4939,  0.5713,
         0.3997,  0.5572,  0.5144,  0.4738,  0.4487,  0.5249,  0.4543,
         0.5195,  0.6352,  0.5674,  0.5853,  0.4034,  0.5632,  0.5253,
         0.6260,  0.5347,  0.5272,  0.5380,  0.4617,  0.4312,  0.4738,
         0.6260,  0.4526,  0.4470,  0.4914,  0.4926,  0.4753,  0.4957,
         0.4837,  0.5406,  0.5940,  0.5900,  0.4985,  0.4895,  0.4938,
         0.5080,  0.5261,  0.5103,  0.4933,  0.4674,  0.5991,  0.4969,
         0.5514,  0.4571,  0.5666,  0.5626,  0.5729,  0.6534,  0.5533,
         0.4533,  0.6083,  0.5069,  0.5200,  0.5373,  0.4739,  0.5202,
         0.5088,  0.5396,  0.5871,  0.4865,  0.4514,  0.5854,  0.4526,
         0.4741,  0.5511,  0.5607,  0.5293,  0.5888,  0.4164,  0.5315,
         0.5621,  0.5758,  0.4900,  0.5359,  0.6934,  0.4859,  0.5606,
         0.4897,  0.5797,  0.4970,  0.5040,  0.5362,  0.4333,  0.6071,
         0.4037,  0.3913,  0.4426,  0.5976,  0.6420,  0.5657,  0.5360,
         0.5493,  0.5768,  0.5593,  0.3993,  0.4988,  0.5342,  0.5234,
         0.5163,  0.5614,  0.5505,  0.5203,  0.5493,  0.5432,  0.6089,
         0.5556,  0.5157,  0.4682,  0.4314,  0.4238,  0.6253,  0.4950,
         0.4623,  0.5224,  0.6738,  0.4673,  0.5338,  0.5112,  0.6278,
         0.4562,  0.4791,  0.4770,  0.4845,  0.4814,  0.5093,  0.4339,
         0.5082,  0.5722,  0.5555,  0.5522,  0.6900,  0.4916,  0.5260,
         0.5594,  0.4436,  0.5164,  0.4291,  0.6724,  0.4483,  0.4821,
         0.5736,  0.5017,  0.4076,  0.4480,  0.5351,  0.4996,  0.5300,
         0.5145,  0.5788,  0.4693,  0.3521,  0.4575,  0.4815,  0.4330,
         0.5262,  0.5041,  0.3671,  0.5013,  0.5914,  0.5004,  0.5669,
         0.5837,  0.4117,  0.4954,  0.5735,  0.4349,  0.4955,  0.6454,
         0.5836,  0.4454,  0.5042,  0.4469,  0.4799,  0.6097,  0.4470,
         0.6187,  0.5781,  0.6942,  0.5774,  0.4496,  0.5526,  0.4903,
         0.4734,  0.5533,  0.5771,  0.6650,  0.5316,  0.5411,  0.5393,
         0.7094,  0.5686,  0.3761,  0.5184,  0.3669,  0.5929,  0.4667,
         0.4036,  0.5458,  0.5858,  0.4811,  0.5584,  0.5446,  0.3769,
         0.4675,  0.5393,  0.5085,  0.4333,  0.5408,  0.4134,  0.5167,
         0.4373,  0.6406,  0.3395,  0.5625,  0.4208,  0.4870,  0.4148,
         0.3577,  0.6007,  0.7179,  0.4688,  0.5043,  0.4342,  0.4460,
         0.4942,  0.5596,  0.5190,  0.4704,  0.4671,  0.3965,  0.6361,
         0.5708,  0.4754,  0.3340,  0.4908,  0.5254,  0.5476,  0.4188,
         0.4173,  0.4892,  0.4719,  0.3776,  0.4447,  0.5043,  0.6084,
         0.4813,  0.3375,  0.5119,  0.5154,  0.6186,  0.5648,  0.5559,
         0.4263,  0.4851,  0.3217,  0.4581,  0.3919,  0.3933,  0.5498,
         0.3801,  0.6720,  0.4542,  0.4926,  0.5438,  0.5340,  0.5218,
         0.5641,  0.3819,  0.4737,  0.6060,  0.5570,  0.5998,  0.5418,
         0.5269,  0.4957,  0.5799,  0.6224,  0.5013,  0.5557,  0.4796,
         0.4931,  0.4413,  0.5325,  0.6054,  0.5201,  0.5532,  0.5644,
         0.4004,  0.4509,  0.5228,  0.4692,  0.4858,  0.6157,  0.5320,
         0.6086,  0.4989,  0.5077,  0.5009,  0.3488,  0.4481,  0.5600,
         0.5173,  0.5755,  0.5935,  0.5771,  0.4180,  0.6323,  0.4554,
         0.4881,  0.4741,  0.4486,  0.4531,  0.4465,  0.4610,  0.5592,
         0.4114,  0.7640,  0.5690,  0.5597,  0.4953,  0.5273,  0.6348,
         0.4836], device='cuda:0')
tensor(0.6769, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4367,  0.3630,  0.5194,  0.5882,  0.5779,  0.5236,  0.3928,
         0.5955,  0.3831,  0.5661,  0.3722,  0.5216,  0.4712,  0.5637,
         0.4931,  0.3594,  0.5093,  0.5160,  0.5957,  0.4208,  0.6224,
         0.4650,  0.6344,  0.4773,  0.4473,  0.6114,  0.3795,  0.5819,
         0.7705,  0.5988,  0.4117,  0.5703,  0.5210,  0.5004,  0.5713,
         0.5743,  0.5277,  0.4138,  0.4100,  0.4540,  0.4726,  0.5593,
         0.5659,  0.5267,  0.5471,  0.4600,  0.4790,  0.4714,  0.5779,
         0.5952,  0.6388,  0.5131,  0.5319,  0.5906,  0.4394,  0.5703,
         0.4626,  0.5707,  0.4086,  0.4570,  0.4389,  0.5080,  0.4764,
         0.5802,  0.5295,  0.3472,  0.4220,  0.7591,  0.4672,  0.5110,
         0.6736,  0.5270,  0.5291,  0.5284,  0.5800,  0.4396,  0.6540,
         0.4379,  0.5136,  0.4006,  0.5323,  0.4276,  0.6052,  0.3035,
         0.5597,  0.7348,  0.4905,  0.6209,  0.5189,  0.3865,  0.5106,
         0.5381,  0.4923,  0.4373,  0.6372,  0.5198,  0.5144,  0.4915,
         0.5828,  0.5159,  0.5029,  0.5146,  0.4229,  0.4307,  0.4432,
         0.6141,  0.5105,  0.4929,  0.3818,  0.4916,  0.4914,  0.4943,
         0.6006,  0.5408,  0.3606,  0.5539,  0.5643,  0.5527,  0.5839,
         0.4786,  0.7133,  0.4306,  0.5211,  0.5786,  0.5714,  0.4293,
         0.6169,  0.4868,  0.3557,  0.4997,  0.4672,  0.5445,  0.5680,
         0.4181,  0.5351,  0.6288,  0.6086,  0.5161,  0.4751,  0.4519,
         0.6069,  0.5913,  0.5757,  0.4923,  0.4383,  0.4416,  0.5908,
         0.4570,  0.4579,  0.5078,  0.3293,  0.5639,  0.6615,  0.6094,
         0.6370,  0.5282,  0.3931,  0.4751,  0.4631,  0.6115,  0.3195,
         0.4420,  0.7013,  0.4091,  0.5451,  0.5456,  0.5908,  0.4997,
         0.5862,  0.5520,  0.5186,  0.3151,  0.5591,  0.5689,  0.5308,
         0.5184,  0.5726,  0.5186,  0.4616,  0.5166,  0.4608,  0.5274,
         0.6352,  0.4906,  0.3410,  0.4747,  0.4887,  0.5155,  0.4766,
         0.3780,  0.5345,  0.5012,  0.5418,  0.5185,  0.5189,  0.4977,
         0.4949,  0.6085,  0.4695,  0.4694,  0.4504,  0.4477,  0.4554,
         0.6010,  0.4199,  0.5998,  0.5045,  0.6165,  0.6324,  0.5054,
         0.4496,  0.5159,  0.3120,  0.5283,  0.5618,  0.3507,  0.5809,
         0.5141,  0.4782,  0.4763,  0.5408,  0.5451,  0.5185,  0.4777,
         0.3767,  0.4806,  0.5552,  0.6013,  0.5876,  0.6008,  0.5328,
         0.4512,  0.4881,  0.5561,  0.5350,  0.5649,  0.3508,  0.4710,
         0.3599,  0.5416,  0.7582,  0.5043,  0.5681,  0.5009,  0.4734,
         0.5524,  0.4485,  0.5762,  0.4246,  0.4481,  0.4679,  0.4747,
         0.5218,  0.5235,  0.4866,  0.5245,  0.5494,  0.4749,  0.5433,
         0.5682,  0.5274,  0.5249,  0.4357,  0.4945,  0.5617,  0.5953,
         0.5990,  0.4434,  0.6757,  0.4807,  0.5090,  0.3887,  0.2728,
         0.6075,  0.6775,  0.5072,  0.4551,  0.5978,  0.4617,  0.4653,
         0.3800,  0.6028,  0.2740,  0.6139,  0.5318,  0.4520,  0.3965,
         0.3403,  0.5569,  0.4826,  0.5855,  0.3941,  0.5469,  0.4096,
         0.4794,  0.5560,  0.5395,  0.5150,  0.4638,  0.4587,  0.5983,
         0.5230,  0.5229,  0.5907,  0.5240,  0.2650,  0.4630,  0.5061,
         0.4353,  0.5023,  0.5990,  0.5044,  0.5622,  0.4881,  0.4349,
         0.6449,  0.4488,  0.5866,  0.5695,  0.4455,  0.3740,  0.6541,
         0.5212,  0.6435,  0.5162,  0.5803,  0.4457,  0.4445,  0.6890,
         0.5741,  0.5474,  0.5955,  0.5767,  0.5299,  0.5188,  0.5372,
         0.5197,  0.4277,  0.6469,  0.5128,  0.4258,  0.5434,  0.5469,
         0.5144,  0.5586,  0.4586,  0.4603,  0.5730,  0.5742,  0.6110,
         0.4405,  0.5735,  0.5509,  0.5205,  0.4755,  0.4347,  0.4682,
         0.4373,  0.5363,  0.4862,  0.4382,  0.5378,  0.5444,  0.5477,
         0.6231,  0.5265,  0.4876,  0.5029,  0.5562,  0.4988,  0.3804,
         0.4384,  0.5237,  0.4050,  0.4343,  0.4832,  0.4975,  0.5530,
         0.5443,  0.4739,  0.5622,  0.5014,  0.5857,  0.4838,  0.5278,
         0.4605,  0.4779,  0.5030,  0.6313,  0.6219,  0.4935,  0.4059,
         0.4831,  0.6887,  0.5432,  0.5454,  0.5008,  0.4168,  0.5094,
         0.6039,  0.4306,  0.4861,  0.5148,  0.5100,  0.5624,  0.7490,
         0.5510,  0.4721,  0.4705,  0.5324,  0.5606,  0.5746,  0.6115,
         0.4767,  0.6441,  0.5464,  0.3040,  0.4486,  0.4619,  0.4673,
         0.5796,  0.5400,  0.4886,  0.5660,  0.5554,  0.3107,  0.6043,
         0.4956,  0.4324,  0.5660,  0.4791,  0.5183,  0.6087,  0.5717,
         0.7163,  0.4180,  0.5222,  0.5533,  0.4125,  0.5273,  0.4283,
         0.5167,  0.5175,  0.4935,  0.5186,  0.5637,  0.4962,  0.3977,
         0.4630,  0.5376,  0.4767,  0.5255,  0.4367,  0.5261,  0.5336,
         0.4964,  0.6806,  0.5273,  0.3630,  0.5216,  0.4513,  0.5284,
         0.5386,  0.4806,  0.4635,  0.4502,  0.5014,  0.4999,  0.5395,
         0.4823,  0.6446,  0.4665,  0.4441,  0.5499,  0.2812,  0.4991,
         0.4790,  0.5650,  0.5157,  0.5213,  0.3323,  0.4213,  0.4648,
         0.4583,  0.4220,  0.5516,  0.5479,  0.4053,  0.5547,  0.5639,
         0.4473,  0.7312,  0.4404,  0.4699,  0.4197,  0.4444,  0.4763,
         0.5376,  0.6117,  0.4845,  0.5090,  0.3882,  0.5475,  0.6257,
         0.4601,  0.4855,  0.4345,  0.5092,  0.4316,  0.5279,  0.4489,
         0.3716], device='cuda:0')
tensor(0.6579, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5858,  0.5481,  0.4777,  0.5768,  0.4038,  0.5370,  0.6372,
         0.5025,  0.6356,  0.4091,  0.5076,  0.4798,  0.5458,  0.4805,
         0.4943,  0.5141,  0.5740,  0.4427,  0.4564,  0.4672,  0.6398,
         0.5314,  0.4237,  0.5035,  0.4442,  0.4999,  0.6157,  0.5548,
         0.4234,  0.5052,  0.4357,  0.5028,  0.5237,  0.6650,  0.6139,
         0.5743,  0.5012,  0.7331,  0.3960,  0.4453,  0.4269,  0.5205,
         0.5209,  0.5058,  0.3197,  0.6343,  0.5386,  0.4940,  0.5054,
         0.5768,  0.3879,  0.5252,  0.5306,  0.5076,  0.5173,  0.5050,
         0.5221,  0.6257,  0.5320,  0.4723,  0.5121,  0.6325,  0.4458,
         0.5491,  0.4841,  0.4897,  0.6097,  0.3662,  0.5965,  0.5679,
         0.6559,  0.4882,  0.4797,  0.5185,  0.4685,  0.4976,  0.4924,
         0.3687,  0.5635,  0.4086,  0.5740,  0.4829,  0.5328,  0.5413,
         0.5154,  0.4519,  0.4302,  0.4021,  0.5267,  0.5806,  0.3931,
         0.4595,  0.4321,  0.3884,  0.5323,  0.5912,  0.4780,  0.5662,
         0.5439,  0.5423,  0.4852,  0.5432,  0.5390,  0.3993,  0.5054,
         0.4535,  0.4362,  0.5694,  0.5170,  0.6066,  0.5969,  0.3684,
         0.4338,  0.3005,  0.4393,  0.5269,  0.6875,  0.4737,  0.5509,
         0.5687,  0.4454,  0.7076,  0.5582,  0.3641,  0.5128,  0.6185,
         0.4586,  0.4234,  0.4053,  0.4925,  0.5690,  0.6365,  0.3203,
         0.4359,  0.5664,  0.4133,  0.5541,  0.4993,  0.5186,  0.5544,
         0.5757,  0.5505,  0.5722,  0.4629,  0.5410,  0.5432,  0.5160,
         0.6342,  0.5037,  0.6662,  0.5040,  0.4860,  0.6032,  0.5953,
         0.5022,  0.5779,  0.5367,  0.4430,  0.5054,  0.5983,  0.4831,
         0.5235,  0.5130,  0.5195,  0.5375,  0.5766,  0.4966,  0.4448,
         0.5147,  0.4761,  0.5074,  0.3704,  0.6238,  0.4255,  0.5102,
         0.5315,  0.5677,  0.4247,  0.3805,  0.4862,  0.4582,  0.4734,
         0.2881,  0.6272,  0.4947,  0.4769,  0.4996,  0.4843,  0.4296,
         0.4303,  0.5084,  0.5167,  0.5061,  0.3900,  0.4229,  0.5550,
         0.5677,  0.5269,  0.3774,  0.5034,  0.4415,  0.7426,  0.3726,
         0.5563,  0.6027,  0.2986,  0.6127,  0.5082,  0.4900,  0.5115,
         0.4002,  0.5511,  0.4343,  0.6018,  0.5741,  0.5900,  0.4742,
         0.4144,  0.4013,  0.5195,  0.5058,  0.3794,  0.5430,  0.5055,
         0.3749,  0.4285,  0.5300,  0.4451,  0.4699,  0.4352,  0.5200,
         0.5742,  0.5118,  0.5788,  0.4378,  0.4286,  0.5116,  0.6210,
         0.5594,  0.4852,  0.4577,  0.5547,  0.5258,  0.5002,  0.4084,
         0.5498,  0.4736,  0.3999,  0.7580,  0.4671,  0.4993,  0.4802,
         0.4536,  0.5006,  0.5298,  0.4083,  0.4904,  0.5791,  0.4685,
         0.5452,  0.5136,  0.5002,  0.4453,  0.5394,  0.4073,  0.5822,
         0.5703,  0.6031,  0.6345,  0.4126,  0.4826,  0.5560,  0.5768,
         0.5318,  0.5345,  0.5842,  0.4190,  0.5776,  0.5114,  0.3976,
         0.4849,  0.5589,  0.5425,  0.4547,  0.5240,  0.5517,  0.3914,
         0.6094,  0.4505,  0.4992,  0.4860,  0.5549,  0.5040,  0.4156,
         0.5831,  0.3708,  0.5250,  0.4829,  0.4956,  0.4718,  0.5393,
         0.5422,  0.4878,  0.6681,  0.4863,  0.4967,  0.4237,  0.5153,
         0.5101,  0.4891,  0.5566,  0.5683,  0.5820,  0.4926,  0.5540,
         0.4621,  0.4971,  0.5548,  0.5423,  0.5482,  0.4254,  0.4591,
         0.4423,  0.5446,  0.4543,  0.4838,  0.5823,  0.5038,  0.5503,
         0.5712,  0.5406,  0.6104,  0.4004,  0.5657,  0.6110,  0.5604,
         0.4618,  0.5045,  0.4312,  0.5633,  0.5211,  0.3590,  0.5654,
         0.5102,  0.4798,  0.6227,  0.3732,  0.6415,  0.4284,  0.4472,
         0.4139,  0.5767,  0.5763,  0.4741,  0.5791,  0.4714,  0.6088,
         0.5249,  0.5819,  0.5176,  0.5501,  0.3678,  0.4998,  0.4368,
         0.4683,  0.3942,  0.4905,  0.6138,  0.4764,  0.4434,  0.5731,
         0.4790,  0.4843,  0.5800,  0.6390,  0.4318,  0.5416,  0.5266,
         0.4344,  0.5722,  0.5259,  0.5253,  0.5086,  0.4283,  0.4974,
         0.5481,  0.4978,  0.5141,  0.5883,  0.4643,  0.5609,  0.4773,
         0.6765,  0.5137,  0.6023,  0.4794,  0.6292,  0.5228,  0.5998,
         0.4505,  0.4947,  0.3998,  0.4682,  0.4629,  0.4419,  0.6353,
         0.5387,  0.5024,  0.5655,  0.5866,  0.5198,  0.5143,  0.5758,
         0.4083,  0.5577,  0.5359,  0.6209,  0.4161,  0.4942,  0.5278,
         0.7121,  0.5074,  0.4222,  0.3839,  0.6073,  0.3728,  0.5698,
         0.4243,  0.4657,  0.6343,  0.4440,  0.5722,  0.5158,  0.5779,
         0.6093,  0.5105,  0.4919,  0.7387,  0.5500,  0.5399,  0.3990,
         0.5204,  0.5351,  0.4531,  0.4605,  0.4805,  0.5257,  0.5791,
         0.5606,  0.3052,  0.4987,  0.6192,  0.5081,  0.5290,  0.5029,
         0.5066,  0.5185,  0.4828,  0.4709,  0.5516,  0.5676,  0.4944,
         0.5656,  0.4641,  0.4993,  0.5216,  0.6965,  0.3427,  0.6230,
         0.4624,  0.4624,  0.4951,  0.5350,  0.5581,  0.4823,  0.4950,
         0.3967,  0.6870,  0.4350,  0.4849,  0.5670,  0.5452,  0.5123,
         0.4485,  0.4779,  0.4121,  0.5362,  0.5847,  0.5604,  0.5445,
         0.7164,  0.4744,  0.6180,  0.4644,  0.4681,  0.4614,  0.6062,
         0.4529,  0.5450,  0.4803,  0.5780,  0.5307,  0.4544,  0.5122,
         0.5948,  0.5677,  0.4326,  0.5082,  0.4951,  0.5174,  0.4773,
         0.5794], device='cuda:0')
tensor(0.6703, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5390,  0.5875,  0.5138,  0.6180,  0.4963,  0.4842,  0.5182,
         0.6499,  0.4726,  0.4625,  0.6531,  0.5675,  0.5210,  0.5861,
         0.4725,  0.7198,  0.4486,  0.5682,  0.6277,  0.5231,  0.5327,
         0.5306,  0.4780,  0.4416,  0.5537,  0.5492,  0.5010,  0.5437,
         0.5249,  0.5085,  0.4132,  0.5603,  0.7128,  0.4866,  0.5254,
         0.5952,  0.4307,  0.5490,  0.4240,  0.4664,  0.5919,  0.5817,
         0.4538,  0.6220,  0.5866,  0.4848,  0.4851,  0.4691,  0.4942,
         0.5300,  0.3662,  0.4288,  0.4223,  0.6015,  0.5128,  0.5615,
         0.5069,  0.4476,  0.4291,  0.4726,  0.5298,  0.4532,  0.6517,
         0.4428,  0.5753,  0.4731,  0.4630,  0.6370,  0.5162,  0.6507,
         0.5820,  0.5403,  0.4550,  0.4713,  0.5200,  0.3798,  0.6038,
         0.5169,  0.5317,  0.5052,  0.5008,  0.4623,  0.5528,  0.3971,
         0.4874,  0.4926,  0.4998,  0.5298,  0.5892,  0.5968,  0.4821,
         0.6179,  0.4736,  0.5087,  0.4673,  0.3433,  0.4684,  0.5467,
         0.4924,  0.6112,  0.5282,  0.4174,  0.4440,  0.5145,  0.5854,
         0.6656,  0.3824,  0.5377,  0.4604,  0.4526,  0.5692,  0.4763,
         0.5624,  0.5372,  0.4862,  0.5266,  0.4652,  0.4842,  0.5274,
         0.5715,  0.4310,  0.5509,  0.4237,  0.6103,  0.5192,  0.4724,
         0.5048,  0.6218,  0.5864,  0.4944,  0.5340,  0.4567,  0.4576,
         0.5462,  0.4570,  0.5029,  0.5711,  0.5409,  0.4757,  0.4046,
         0.5063,  0.4992,  0.5211,  0.3355,  0.6520,  0.4593,  0.5280,
         0.4597,  0.4406,  0.3470,  0.5748,  0.2743,  0.5121,  0.4634,
         0.6030,  0.4901,  0.4776,  0.4785,  0.5024,  0.5296,  0.4231,
         0.6082,  0.5778,  0.6145,  0.5178,  0.4898,  0.3411,  0.4065,
         0.5546,  0.3871,  0.6587,  0.4704,  0.5519,  0.5070,  0.5315,
         0.4907,  0.5395,  0.6200,  0.6294,  0.4179,  0.5269,  0.5965,
         0.3486,  0.3294,  0.4593,  0.4718,  0.4685,  0.4892,  0.5618,
         0.3997,  0.4330,  0.5669,  0.3680,  0.4736,  0.5910,  0.5677,
         0.4753,  0.4526,  0.5438,  0.5099,  0.4176,  0.5417,  0.6407,
         0.5399,  0.4518,  0.5560,  0.4198,  0.4786,  0.4827,  0.3432,
         0.4300,  0.4970,  0.5196,  0.4964,  0.6820,  0.4248,  0.3815,
         0.5203,  0.5815,  0.4900,  0.4728,  0.5038,  0.5414,  0.4848,
         0.5008,  0.6466,  0.6502,  0.5707,  0.3914,  0.3866,  0.4352,
         0.5195,  0.5014,  0.6868,  0.4340,  0.5106,  0.4073,  0.4372,
         0.4548,  0.5129,  0.5322,  0.5522,  0.4094,  0.5267,  0.4752,
         0.4156,  0.4676,  0.5233,  0.5550,  0.5872,  0.5428,  0.4758,
         0.5493,  0.4162,  0.6178,  0.4713,  0.5022,  0.4854,  0.5083,
         0.5194,  0.5570,  0.5204,  0.5298,  0.4731,  0.5970,  0.4025,
         0.4634,  0.6432,  0.4650,  0.4588,  0.4604,  0.6200,  0.4509,
         0.4821,  0.5881,  0.5611,  0.5035,  0.5740,  0.4942,  0.6342,
         0.5512,  0.5980,  0.6353,  0.5787,  0.6292,  0.4306,  0.4678,
         0.5306,  0.6023,  0.6372,  0.4308,  0.6270,  0.4891,  0.4680,
         0.4493,  0.4673,  0.5718,  0.5062,  0.5422,  0.4819,  0.5659,
         0.4773,  0.4937,  0.4915,  0.5104,  0.4185,  0.5025,  0.4106,
         0.4473,  0.4423,  0.5628,  0.5640,  0.4422,  0.5113,  0.4780,
         0.4902,  0.3904,  0.5224,  0.5402,  0.3844,  0.6406,  0.5186,
         0.5214,  0.5165,  0.5338,  0.5884,  0.5065,  0.5536,  0.4204,
         0.5357,  0.5212,  0.4705,  0.3432,  0.5735,  0.4524,  0.4662,
         0.4503,  0.4707,  0.4681,  0.4743,  0.5348,  0.4444,  0.5605,
         0.4191,  0.5678,  0.5040,  0.5034,  0.5222,  0.5075,  0.4623,
         0.4968,  0.5116,  0.5179,  0.5658,  0.5748,  0.5393,  0.5644,
         0.4307,  0.5062,  0.7002,  0.4701,  0.4334,  0.3787,  0.4268,
         0.4299,  0.3588,  0.4826,  0.6288,  0.5351,  0.5156,  0.6362,
         0.3951,  0.4842,  0.3854,  0.5424,  0.5367,  0.5126,  0.7270,
         0.3708,  0.4392,  0.5067,  0.5718,  0.5058,  0.4692,  0.3509,
         0.4530,  0.4598,  0.5061,  0.5213,  0.5666,  0.4427,  0.4883,
         0.4538,  0.4684,  0.5210,  0.5524,  0.4545,  0.5828,  0.5581,
         0.5744,  0.5284,  0.3830,  0.5712,  0.5229,  0.6096,  0.4599,
         0.4854,  0.4706,  0.5655,  0.5692,  0.5572,  0.6312,  0.6034,
         0.4796,  0.5269,  0.5042,  0.4425,  0.6451,  0.4667,  0.7135,
         0.4355,  0.5617,  0.5230,  0.5731,  0.4829,  0.5802,  0.5241,
         0.6025,  0.4477,  0.4364,  0.4396,  0.4822,  0.4486,  0.4289,
         0.3582,  0.5450,  0.3941,  0.5235,  0.4220,  0.4012,  0.4036,
         0.6295,  0.4943,  0.4272,  0.3960,  0.4780,  0.5696,  0.5228,
         0.5095,  0.5579,  0.5302,  0.6611,  0.5647,  0.4399,  0.4735,
         0.3600,  0.5156,  0.4945,  0.5974,  0.4794,  0.4248,  0.5077,
         0.4993,  0.5068,  0.4840,  0.5361,  0.6142,  0.4612,  0.4576,
         0.4470,  0.4274,  0.4865,  0.4738,  0.4542,  0.5639,  0.3822,
         0.5636,  0.5388,  0.4295,  0.5492,  0.4286,  0.4300,  0.5227,
         0.5299,  0.4395,  0.4384,  0.3881,  0.4664,  0.5283,  0.4472,
         0.5320,  0.4653,  0.5457,  0.5701,  0.5348,  0.5102,  0.5641,
         0.5816,  0.5309,  0.5578,  0.6726,  0.4530,  0.4816,  0.6209,
         0.5594,  0.4757,  0.3697,  0.5885,  0.5576,  0.5244,  0.6705,
         0.4187], device='cuda:0')
tensor(0.6680, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5641,  0.4127,  0.3858,  0.4563,  0.3351,  0.4713,  0.6230,
         0.4685,  0.5853,  0.4256,  0.5473,  0.5202,  0.5931,  0.4487,
         0.6499,  0.4385,  0.4850,  0.4739,  0.4947,  0.5536,  0.5610,
         0.4949,  0.5715,  0.5861,  0.3905,  0.5137,  0.5022,  0.4077,
         0.4554,  0.4849,  0.5556,  0.4245,  0.5475,  0.5115,  0.4292,
         0.5890,  0.4488,  0.5287,  0.5540,  0.5355,  0.4320,  0.6194,
         0.5765,  0.6528,  0.4757,  0.5205,  0.5082,  0.5769,  0.4071,
         0.3460,  0.4537,  0.4671,  0.4852,  0.5364,  0.5288,  0.5108,
         0.5436,  0.3714,  0.4762,  0.5741,  0.4543,  0.5880,  0.4507,
         0.7156,  0.5428,  0.4693,  0.4922,  0.5851,  0.4880,  0.5337,
         0.5076,  0.5861,  0.5859,  0.4346,  0.5890,  0.4656,  0.4222,
         0.6204,  0.5774,  0.4633,  0.5145,  0.6374,  0.5176,  0.5044,
         0.6147,  0.6226,  0.6274,  0.5434,  0.2499,  0.4552,  0.5937,
         0.5272,  0.5451,  0.5211,  0.5379,  0.6050,  0.6072,  0.5165,
         0.6995,  0.3502,  0.3883,  0.5980,  0.5330,  0.4281,  0.4479,
         0.5281,  0.5742,  0.4796,  0.5873,  0.4539,  0.3230,  0.5263,
         0.5885,  0.5922,  0.4766,  0.5264,  0.6669,  0.4866,  0.4793,
         0.5642,  0.5977,  0.5301,  0.6044,  0.4376,  0.4058,  0.6487,
         0.3833,  0.5019,  0.5567,  0.5154,  0.4423,  0.5242,  0.5291,
         0.5765,  0.4891,  0.4940,  0.5498,  0.4167,  0.3954,  0.5369,
         0.6164,  0.5085,  0.3649,  0.5065,  0.4559,  0.5473,  0.5253,
         0.4326,  0.4969,  0.4693,  0.6057,  0.5595,  0.2770,  0.4163,
         0.6551,  0.5262,  0.4968,  0.4704,  0.5629,  0.5220,  0.5133,
         0.4917,  0.3550,  0.4844,  0.6025,  0.4109,  0.5324,  0.6961,
         0.5241,  0.5768,  0.5849,  0.4492,  0.4090,  0.3952,  0.4540,
         0.3827,  0.4090,  0.5135,  0.4336,  0.5653,  0.5991,  0.4423,
         0.5470,  0.5391,  0.5120,  0.4053,  0.5751,  0.5565,  0.4795,
         0.3638,  0.5416,  0.5775,  0.4968,  0.4642,  0.5760,  0.5759,
         0.6228,  0.5142,  0.5122,  0.5145,  0.4702,  0.6206,  0.6135,
         0.5293,  0.4674,  0.4641,  0.5856,  0.5275,  0.5577,  0.6977,
         0.5898,  0.4938,  0.5403,  0.6496,  0.5319,  0.5176,  0.5919,
         0.3723,  0.5116,  0.5812,  0.5303,  0.5145,  0.5221,  0.4740,
         0.3931,  0.5007,  0.4096,  0.4557,  0.3720,  0.7008,  0.3924,
         0.5488,  0.5128,  0.7696,  0.5021,  0.5878,  0.5449,  0.5266,
         0.5523,  0.5870,  0.4702,  0.6635,  0.4682,  0.5361,  0.4675,
         0.6507,  0.4420,  0.5369,  0.5706,  0.4656,  0.5731,  0.5087,
         0.4815,  0.6235,  0.7125,  0.6087,  0.3910,  0.5317,  0.4795,
         0.4939,  0.6481,  0.6517,  0.4257,  0.5908,  0.5439,  0.5816,
         0.6638,  0.5252,  0.5052,  0.4942,  0.5867,  0.5859,  0.6393,
         0.4497,  0.5553,  0.5036,  0.5179,  0.5935,  0.3743,  0.5150,
         0.5640,  0.4799,  0.5424,  0.5730,  0.6634,  0.4933,  0.6257,
         0.5035,  0.4642,  0.5623,  0.4965,  0.5627,  0.5190,  0.5098,
         0.4271,  0.4006,  0.5429,  0.6389,  0.5276,  0.5136,  0.5440,
         0.5632,  0.4324,  0.5035,  0.4975,  0.4443,  0.5333,  0.5010,
         0.5235,  0.3853,  0.6025,  0.4757,  0.5527,  0.6504,  0.5703,
         0.5210,  0.5199,  0.7510,  0.5138,  0.4526,  0.4892,  0.5118,
         0.4086,  0.6390,  0.4428,  0.4747,  0.5068,  0.4973,  0.5489,
         0.4663,  0.5297,  0.4694,  0.4422,  0.4678,  0.5995,  0.4049,
         0.5407,  0.4843,  0.2784,  0.5169,  0.2881,  0.4313,  0.4281,
         0.4742,  0.6080,  0.5944,  0.6976,  0.4441,  0.5722,  0.3787,
         0.6160,  0.4216,  0.4631,  0.4885,  0.5685,  0.4995,  0.5154,
         0.6313,  0.5800,  0.5297,  0.5261,  0.4841,  0.3316,  0.4944,
         0.4862,  0.5330,  0.6033,  0.4827,  0.6950,  0.5305,  0.5262,
         0.4686,  0.5165,  0.5059,  0.5143,  0.5226,  0.4421,  0.4310,
         0.5753,  0.2823,  0.5507,  0.7452,  0.5494,  0.4902,  0.6797,
         0.7350,  0.5023,  0.4137,  0.3779,  0.6560,  0.4693,  0.5482,
         0.4155,  0.3935,  0.3718,  0.4517,  0.6246,  0.5426,  0.4314,
         0.5209,  0.6304,  0.5838,  0.5806,  0.4965,  0.6187,  0.6507,
         0.5024,  0.5954,  0.6282,  0.5328,  0.5313,  0.5684,  0.6297,
         0.6577,  0.6043,  0.3676,  0.5864,  0.5000,  0.5421,  0.4829,
         0.5855,  0.4554,  0.5002,  0.5291,  0.5130,  0.4333,  0.5228,
         0.5573,  0.4390,  0.4776,  0.4682,  0.5318,  0.5326,  0.5455,
         0.5050,  0.5382,  0.3944,  0.4832,  0.5367,  0.5895,  0.4987,
         0.5043,  0.5441,  0.5980,  0.5064,  0.4222,  0.5114,  0.5129,
         0.5002,  0.4987,  0.4019,  0.5521,  0.5051,  0.5345,  0.4777,
         0.4951,  0.5268,  0.5190,  0.4505,  0.4872,  0.3577,  0.5761,
         0.5283,  0.5320,  0.5572,  0.5050,  0.4410,  0.3277,  0.5416,
         0.6428,  0.3901,  0.4850,  0.4093,  0.5731,  0.3726,  0.5370,
         0.4370,  0.4518,  0.4873,  0.5499,  0.4201,  0.5609,  0.4687,
         0.4496,  0.5658,  0.4938,  0.4833,  0.6053,  0.4668,  0.5316,
         0.6005,  0.4687,  0.4909,  0.7672,  0.5574,  0.6026,  0.3447,
         0.5212,  0.5238,  0.5224,  0.5032,  0.5005,  0.5450,  0.4857,
         0.5627,  0.5519,  0.5482,  0.4716,  0.6458,  0.6242,  0.4924,
         0.4980], device='cuda:0')
tensor(0.6605, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5285,  0.4031,  0.7182,  0.5866,  0.5194,  0.5564,  0.5843,
         0.3289,  0.4961,  0.5384,  0.5824,  0.5350,  0.6565,  0.6855,
         0.5281,  0.5172,  0.4962,  0.4212,  0.5347,  0.3937,  0.5343,
         0.4388,  0.6341,  0.5281,  0.5060,  0.3803,  0.5213,  0.4140,
         0.4453,  0.4938,  0.4731,  0.5055,  0.4833,  0.6591,  0.3433,
         0.5601,  0.3416,  0.5122,  0.4456,  0.5141,  0.4877,  0.4546,
         0.3376,  0.6856,  0.4666,  0.3922,  0.3949,  0.5229,  0.5204,
         0.5968,  0.4607,  0.5188,  0.4941,  0.4730,  0.4093,  0.5370,
         0.5069,  0.5372,  0.3787,  0.4940,  0.4329,  0.5021,  0.6185,
         0.5820,  0.4464,  0.4746,  0.4892,  0.5152,  0.6080,  0.4634,
         0.4485,  0.4177,  0.6089,  0.4368,  0.5660,  0.4502,  0.5562,
         0.5688,  0.5718,  0.4736,  0.4297,  0.4882,  0.5086,  0.5503,
         0.5877,  0.4797,  0.4139,  0.4739,  0.4321,  0.5834,  0.4927,
         0.4290,  0.5971,  0.7153,  0.6863,  0.4530,  0.5846,  0.5455,
         0.5150,  0.5104,  0.4617,  0.4294,  0.6629,  0.4795,  0.5394,
         0.4401,  0.4719,  0.5802,  0.4262,  0.4713,  0.4652,  0.4853,
         0.4083,  0.5360,  0.5451,  0.5497,  0.3799,  0.6137,  0.6514,
         0.5074,  0.5421,  0.4777,  0.6393,  0.5593,  0.6853,  0.4959,
         0.5096,  0.3830,  0.4679,  0.4365,  0.5551,  0.4662,  0.6236,
         0.6845,  0.5461,  0.4365,  0.5008,  0.6105,  0.5350,  0.3415,
         0.5225,  0.3252,  0.4724,  0.4894,  0.4060,  0.6154,  0.5970,
         0.5942,  0.4458,  0.5466,  0.5434,  0.5899,  0.5259,  0.4932,
         0.4617,  0.5951,  0.6262,  0.5425,  0.5444,  0.4853,  0.5156,
         0.4675,  0.5358,  0.5303,  0.6033,  0.3989,  0.6423,  0.5094,
         0.5588,  0.5092,  0.4945,  0.4806,  0.4421,  0.5251,  0.6146,
         0.4564,  0.4988,  0.6458,  0.4975,  0.4819,  0.3185,  0.5149,
         0.5573,  0.4701,  0.6166,  0.5165,  0.5456,  0.4645,  0.6648,
         0.5735,  0.5033,  0.5261,  0.5501,  0.4941,  0.4460,  0.4333,
         0.6368,  0.4713,  0.4602,  0.4953,  0.5852,  0.5128,  0.5366,
         0.6584,  0.4819,  0.5185,  0.5489,  0.5159,  0.5058,  0.5604,
         0.5720,  0.6362,  0.5664,  0.3518,  0.4605,  0.5684,  0.4197,
         0.5282,  0.5502,  0.6296,  0.3624,  0.5344,  0.5362,  0.4434,
         0.5334,  0.4527,  0.5155,  0.6607,  0.7351,  0.5715,  0.5162,
         0.3644,  0.6086,  0.5879,  0.6002,  0.5731,  0.5810,  0.5522,
         0.4852,  0.5942,  0.5190,  0.5339,  0.5128,  0.5705,  0.4479,
         0.5611,  0.5438,  0.4740,  0.5855,  0.4587,  0.5931,  0.6124,
         0.4911,  0.5184,  0.5774,  0.4859,  0.5350,  0.4368,  0.3599,
         0.6319,  0.3813,  0.5077,  0.5031,  0.4937,  0.3660,  0.4729,
         0.5710,  0.4219,  0.4977,  0.4360,  0.4267,  0.5604,  0.4466,
         0.3877,  0.5482,  0.4980,  0.4971,  0.4563,  0.5485,  0.5664,
         0.5764,  0.7118,  0.4762,  0.4720,  0.4765,  0.5430,  0.4324,
         0.4661,  0.4842,  0.4991,  0.4052,  0.4607,  0.5137,  0.5841,
         0.4539,  0.6701,  0.6217,  0.4869,  0.6595,  0.4325,  0.5492,
         0.4787,  0.5652,  0.5920,  0.4755,  0.3390,  0.5404,  0.4041,
         0.7627,  0.3366,  0.4014,  0.6844,  0.5006,  0.5845,  0.6192,
         0.4524,  0.5267,  0.4312,  0.6152,  0.5520,  0.5880,  0.5602,
         0.5350,  0.6112,  0.3890,  0.5149,  0.4622,  0.5727,  0.5029,
         0.6838,  0.3619,  0.5112,  0.5092,  0.5983,  0.3882,  0.4994,
         0.3752,  0.3971,  0.4719,  0.5042,  0.5435,  0.4805,  0.7990,
         0.5174,  0.7399,  0.5371,  0.3650,  0.3796,  0.3829,  0.5152,
         0.5084,  0.5496,  0.5031,  0.4584,  0.5731,  0.5452,  0.5145,
         0.5703,  0.4530,  0.4744,  0.5791,  0.5551,  0.4567,  0.3527,
         0.5132,  0.4857,  0.4744,  0.5038,  0.4964,  0.6197,  0.4296,
         0.4878,  0.4284,  0.5657,  0.4695,  0.4905,  0.5649,  0.5635,
         0.6061,  0.5528,  0.4948,  0.5004,  0.5546,  0.6793,  0.3965,
         0.4992,  0.5839,  0.4149,  0.4438,  0.5417,  0.5109,  0.5651,
         0.5589,  0.4637,  0.6077,  0.3833,  0.4921,  0.5376,  0.5892,
         0.5544,  0.6118,  0.5771,  0.5913,  0.4870,  0.4197,  0.6530,
         0.5028,  0.5328,  0.4942,  0.5067,  0.5671,  0.5872,  0.6906,
         0.5603,  0.4077,  0.3841,  0.4909,  0.5280,  0.4449,  0.5196,
         0.5308,  0.5490,  0.3880,  0.5698,  0.5207,  0.4550,  0.6798,
         0.6196,  0.2632,  0.5806,  0.6041,  0.5127,  0.4590,  0.5970,
         0.5274,  0.5507,  0.5661,  0.5314,  0.6405,  0.4920,  0.5162,
         0.5982,  0.5132,  0.5017,  0.5184,  0.4224,  0.5032,  0.4153,
         0.4780,  0.5717,  0.4617,  0.4701,  0.5419,  0.5364,  0.4623,
         0.4842,  0.5049,  0.5216,  0.6453,  0.4374,  0.3110,  0.5195,
         0.3844,  0.4147,  0.5665,  0.5571,  0.4507,  0.4789,  0.6095,
         0.4837,  0.3906,  0.6441,  0.4360,  0.5479,  0.4665,  0.5272,
         0.4754,  0.4442,  0.5003,  0.4546,  0.6995,  0.4196,  0.5505,
         0.5080,  0.4869,  0.4657,  0.4409,  0.3500,  0.4024,  0.7141,
         0.5641,  0.6093,  0.4389,  0.3028,  0.3647,  0.5173,  0.5653,
         0.3497,  0.4422,  0.5427,  0.5242,  0.4720,  0.4901,  0.5501,
         0.7054,  0.5179,  0.5708,  0.6388,  0.5760,  0.5262,  0.5902,
         0.4293], device='cuda:0')
tensor(0.6580, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5507,  0.5320,  0.5494,  0.5916,  0.5270,  0.5604,  0.6696,
         0.4464,  0.4863,  0.6041,  0.5992,  0.4936,  0.3962,  0.4440,
         0.5006,  0.4250,  0.5211,  0.7661,  0.4932,  0.4174,  0.4658,
         0.6628,  0.4955,  0.5410,  0.5503,  0.5336,  0.3916,  0.5911,
         0.6046,  0.4858,  0.5539,  0.3845,  0.5187,  0.4034,  0.5783,
         0.5204,  0.4448,  0.5744,  0.4697,  0.4789,  0.6261,  0.4963,
         0.5040,  0.5428,  0.5763,  0.5594,  0.5483,  0.5452,  0.7359,
         0.4343,  0.5427,  0.5853,  0.4537,  0.4872,  0.5346,  0.5931,
         0.5105,  0.5743,  0.5633,  0.5069,  0.5132,  0.5550,  0.5338,
         0.5949,  0.5049,  0.4165,  0.3815,  0.4582,  0.3645,  0.5404,
         0.4854,  0.6932,  0.5967,  0.5191,  0.5258,  0.5063,  0.4676,
         0.5506,  0.6567,  0.6069,  0.4942,  0.4862,  0.5195,  0.5929,
         0.4693,  0.4418,  0.5204,  0.4710,  0.4749,  0.5387,  0.5114,
         0.4544,  0.6249,  0.4753,  0.6735,  0.5743,  0.6029,  0.5082,
         0.5072,  0.5866,  0.5126,  0.4800,  0.4292,  0.5326,  0.6033,
         0.4703,  0.4880,  0.4869,  0.4280,  0.5182,  0.4165,  0.5885,
         0.4374,  0.4763,  0.3930,  0.5781,  0.6037,  0.5275,  0.5531,
         0.3736,  0.5432,  0.5218,  0.5614,  0.3853,  0.5315,  0.5185,
         0.5186,  0.5927,  0.5503,  0.4763,  0.7685,  0.4001,  0.6720,
         0.4903,  0.5123,  0.6230,  0.4701,  0.6381,  0.6086,  0.6274,
         0.5611,  0.5511,  0.5074,  0.4953,  0.3755,  0.5356,  0.7026,
         0.4600,  0.5454,  0.4484,  0.7238,  0.6782,  0.6701,  0.5284,
         0.4178,  0.5018,  0.5089,  0.6627,  0.5356,  0.5322,  0.5529,
         0.4970,  0.4874,  0.5233,  0.4576,  0.4077,  0.5259,  0.3372,
         0.5218,  0.5608,  0.4672,  0.5262,  0.5258,  0.4057,  0.6867,
         0.5694,  0.5472,  0.5320,  0.4617,  0.6331,  0.5497,  0.4945,
         0.5091,  0.5840,  0.4984,  0.4579,  0.5277,  0.4304,  0.5192,
         0.4738,  0.5251,  0.5347,  0.5040,  0.5494,  0.4497,  0.5962,
         0.4463,  0.5775,  0.5871,  0.4347,  0.5081,  0.5433,  0.5819,
         0.4822,  0.4869,  0.7189,  0.3529,  0.6006,  0.5826,  0.4293,
         0.4293,  0.6581,  0.5151,  0.5504,  0.5372,  0.3997,  0.4285,
         0.5085,  0.5871,  0.4748,  0.5839,  0.4002,  0.4830,  0.4466,
         0.6098,  0.5852,  0.5896,  0.5818,  0.4176,  0.5535,  0.4463,
         0.7248,  0.4858,  0.5214,  0.5206,  0.5822,  0.5461,  0.5390,
         0.3681,  0.5579,  0.3654,  0.6183,  0.3795,  0.4885,  0.5104,
         0.5028,  0.4130,  0.5136,  0.6111,  0.6158,  0.5756,  0.5488,
         0.5260,  0.6864,  0.5803,  0.4987,  0.5925,  0.4295,  0.6209,
         0.3588,  0.4880,  0.4497,  0.5008,  0.5243,  0.4899,  0.4965,
         0.3208,  0.6154,  0.5336,  0.4179,  0.4283,  0.3370,  0.3985,
         0.5456,  0.5213,  0.5816,  0.5114,  0.5902,  0.4936,  0.4911,
         0.4651,  0.2655,  0.5828,  0.4558,  0.4518,  0.5917,  0.5741,
         0.4478,  0.5936,  0.5010,  0.5343,  0.3465,  0.6529,  0.6029,
         0.5412,  0.5551,  0.5602,  0.5158,  0.5592,  0.4379,  0.4572,
         0.5315,  0.4998,  0.5363,  0.5169,  0.6860,  0.3560,  0.4592,
         0.5019,  0.4911,  0.4934,  0.6701,  0.4302,  0.4308,  0.6104,
         0.3794,  0.5222,  0.4910,  0.4811,  0.5028,  0.6240,  0.4991,
         0.5865,  0.4920,  0.4203,  0.5572,  0.5713,  0.5272,  0.4141,
         0.4993,  0.5235,  0.5876,  0.5458,  0.5528,  0.4899,  0.5112,
         0.5628,  0.4719,  0.4240,  0.5675,  0.4390,  0.5250,  0.4503,
         0.4100,  0.5054,  0.5206,  0.6477,  0.4562,  0.4484,  0.5219,
         0.4443,  0.4418,  0.5342,  0.5568,  0.4324,  0.5472,  0.5192,
         0.4636,  0.5743,  0.5364,  0.6853,  0.6887,  0.5000,  0.5425,
         0.5369,  0.4757,  0.5302,  0.3647,  0.6539,  0.3867,  0.5472,
         0.5553,  0.5140,  0.4878,  0.5163,  0.4996,  0.5450,  0.5140,
         0.5727,  0.5443,  0.5161,  0.4714,  0.5632,  0.5548,  0.5744,
         0.6826,  0.6805,  0.6357,  0.3940,  0.4707,  0.6735,  0.3468,
         0.5731,  0.6086,  0.4975,  0.6896,  0.4163,  0.5408,  0.4377,
         0.4728,  0.4701,  0.3513,  0.4474,  0.5922,  0.5292,  0.5109,
         0.5688,  0.5900,  0.4387,  0.5021,  0.4204,  0.6031,  0.4643,
         0.5304,  0.5142,  0.5487,  0.4738,  0.4115,  0.4213,  0.5811,
         0.5703,  0.5003,  0.4719,  0.4711,  0.5816,  0.4782,  0.3473,
         0.4541,  0.4572,  0.4950,  0.6064,  0.4615,  0.5394,  0.5164,
         0.6088,  0.6805,  0.5012,  0.3172,  0.4578,  0.4856,  0.4916,
         0.5039,  0.5514,  0.5670,  0.4167,  0.6011,  0.5385,  0.5294,
         0.5745,  0.6460,  0.4336,  0.4199,  0.3754,  0.4514,  0.5110,
         0.5823,  0.5313,  0.4687,  0.5396,  0.5028,  0.5988,  0.5997,
         0.3249,  0.5054,  0.4518,  0.6156,  0.5589,  0.5079,  0.6517,
         0.5503,  0.6163,  0.4584,  0.4807,  0.4392,  0.5683,  0.4284,
         0.3742,  0.4834,  0.5218,  0.5643,  0.5065,  0.5288,  0.6409,
         0.5594,  0.4742,  0.4890,  0.5843,  0.5427,  0.6273,  0.5037,
         0.5510,  0.6451,  0.4554,  0.5868,  0.5423,  0.3609,  0.5110,
         0.7090,  0.5211,  0.3338,  0.5431,  0.5123,  0.6005,  0.6589,
         0.5760,  0.5580,  0.5890,  0.5209,  0.4857,  0.4272,  0.6050,
         0.5171], device='cuda:0')
tensor(0.6617, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5120,  0.5031,  0.4524,  0.5800,  0.4587,  0.5408,  0.4194,
         0.4945,  0.6043,  0.5413,  0.4677,  0.5129,  0.5087,  0.4537,
         0.4877,  0.6195,  0.4957,  0.6086,  0.4740,  0.6128,  0.5071,
         0.4686,  0.4888,  0.4024,  0.3327,  0.4018,  0.4498,  0.5274,
         0.5906,  0.5581,  0.5545,  0.5577,  0.5656,  0.4571,  0.2985,
         0.5619,  0.5865,  0.6069,  0.5426,  0.5193,  0.5857,  0.5336,
         0.5688,  0.4703,  0.4615,  0.5023,  0.5115,  0.4923,  0.4119,
         0.4788,  0.5036,  0.5824,  0.4937,  0.5109,  0.5182,  0.5710,
         0.5726,  0.5060,  0.4141,  0.3894,  0.5427,  0.5333,  0.7008,
         0.5915,  0.5755,  0.6190,  0.5193,  0.4814,  0.6225,  0.4428,
         0.4468,  0.5220,  0.5194,  0.5759,  0.5414,  0.5660,  0.4880,
         0.5073,  0.3429,  0.5113,  0.5730,  0.5729,  0.4310,  0.4294,
         0.3889,  0.4806,  0.4715,  0.5423,  0.4770,  0.5137,  0.4228,
         0.4482,  0.6381,  0.5677,  0.5449,  0.4874,  0.5747,  0.4294,
         0.5947,  0.4297,  0.4851,  0.4807,  0.4906,  0.5973,  0.4191,
         0.5823,  0.5129,  0.5125,  0.5093,  0.5507,  0.4929,  0.6907,
         0.4702,  0.5613,  0.5823,  0.6627,  0.6037,  0.4013,  0.3811,
         0.5977,  0.4406,  0.6207,  0.6048,  0.5393,  0.4167,  0.7822,
         0.3802,  0.4914,  0.4875,  0.3038,  0.5837,  0.4842,  0.6442,
         0.5607,  0.4918,  0.6355,  0.5276,  0.4561,  0.4360,  0.6177,
         0.3993,  0.5906,  0.4146,  0.5746,  0.6176,  0.5179,  0.5879,
         0.5430,  0.5486,  0.4060,  0.4726,  0.4297,  0.5447,  0.5932,
         0.4572,  0.5695,  0.3981,  0.5439,  0.4919,  0.4564,  0.5074,
         0.5752,  0.4728,  0.5308,  0.6446,  0.5661,  0.6515,  0.6296,
         0.4196,  0.6064,  0.5258,  0.4962,  0.6005,  0.6131,  0.3875,
         0.4715,  0.5299,  0.4387,  0.6119,  0.5483,  0.5269,  0.6499,
         0.4285,  0.3929,  0.5457,  0.4820,  0.5706,  0.4176,  0.3302,
         0.5207,  0.3560,  0.4968,  0.5607,  0.4630,  0.6262,  0.4651,
         0.4307,  0.5162,  0.5121,  0.4336,  0.4323,  0.6305,  0.6265,
         0.5317,  0.7389,  0.5197,  0.5105,  0.5338,  0.5495,  0.5296,
         0.5363,  0.5031,  0.5510,  0.5218,  0.6311,  0.4666,  0.5162,
         0.6558,  0.4096,  0.6385,  0.5056,  0.4122,  0.5495,  0.4738,
         0.4730,  0.4646,  0.4505,  0.4531,  0.5696,  0.6119,  0.6116,
         0.5066,  0.5799,  0.6683,  0.5354,  0.5651,  0.5807,  0.2712,
         0.5893,  0.5300,  0.5326,  0.5273,  0.6883,  0.6792,  0.4658,
         0.4856,  0.4757,  0.5158,  0.5432,  0.7503,  0.6306,  0.4657,
         0.5193,  0.5392,  0.5179,  0.4196,  0.3551,  0.5763,  0.5206,
         0.4789,  0.3542,  0.5385,  0.4884,  0.5713,  0.4787,  0.4420,
         0.5451,  0.5087,  0.4943,  0.6378,  0.4670,  0.4342,  0.4038,
         0.3987,  0.5235,  0.5601,  0.4947,  0.4878,  0.6336,  0.3067,
         0.5179,  0.4393,  0.4783,  0.4602,  0.6397,  0.4817,  0.4753,
         0.3901,  0.5415,  0.4187,  0.4909,  0.6329,  0.5014,  0.5733,
         0.5240,  0.4971,  0.4627,  0.3675,  0.4557,  0.5278,  0.3883,
         0.4538,  0.5752,  0.4650,  0.5542,  0.5666,  0.5330,  0.5607,
         0.4564,  0.5014,  0.6084,  0.5705,  0.4972,  0.4988,  0.4773,
         0.2752,  0.5007,  0.5200,  0.4006,  0.4932,  0.5840,  0.4133,
         0.5465,  0.3495,  0.4754,  0.5123,  0.5965,  0.5075,  0.4817,
         0.5170,  0.6199,  0.4104,  0.4640,  0.5273,  0.5962,  0.6342,
         0.3786,  0.5143,  0.4840,  0.4590,  0.6489,  0.5792,  0.4155,
         0.5681,  0.5554,  0.4743,  0.5770,  0.3551,  0.4487,  0.5513,
         0.6244,  0.5780,  0.5938,  0.5886,  0.4335,  0.4772,  0.5497,
         0.5914,  0.5828,  0.4499,  0.4632,  0.4187,  0.7045,  0.3336,
         0.5228,  0.5347,  0.5297,  0.4058,  0.5007,  0.4972,  0.4494,
         0.5759,  0.4423,  0.4976,  0.5938,  0.4623,  0.5356,  0.6465,
         0.5033,  0.5155,  0.4381,  0.3953,  0.4703,  0.5005,  0.4826,
         0.5978,  0.7986,  0.4463,  0.4620,  0.5656,  0.4330,  0.4153,
         0.5087,  0.5432,  0.4583,  0.5378,  0.3713,  0.5101,  0.4837,
         0.4597,  0.6321,  0.4880,  0.5000,  0.5089,  0.5670,  0.4317,
         0.5290,  0.4902,  0.5362,  0.4084,  0.6743,  0.4672,  0.4658,
         0.4434,  0.4779,  0.4988,  0.5637,  0.5187,  0.4623,  0.3611,
         0.5821,  0.4033,  0.5800,  0.4580,  0.6134,  0.5757,  0.4652,
         0.3789,  0.5550,  0.4730,  0.5384,  0.4961,  0.4613,  0.5203,
         0.5477,  0.5123,  0.5439,  0.5360,  0.7334,  0.5619,  0.5887,
         0.3717,  0.4698,  0.6275,  0.4684,  0.6245,  0.4383,  0.4981,
         0.5434,  0.4515,  0.5636,  0.4835,  0.3472,  0.6962,  0.5284,
         0.6410,  0.4956,  0.5110,  0.4771,  0.6131,  0.4558,  0.5642,
         0.3694,  0.4047,  0.5507,  0.4530,  0.5003,  0.5844,  0.5867,
         0.5405,  0.4608,  0.4071,  0.5099,  0.5769,  0.4091,  0.4965,
         0.5452,  0.6777,  0.6786,  0.3613,  0.5259,  0.4088,  0.5394,
         0.4755,  0.5774,  0.3803,  0.5515,  0.6159,  0.2777,  0.6433,
         0.5355,  0.5631,  0.4460,  0.5234,  0.5293,  0.5399,  0.5030,
         0.5051,  0.5816,  0.4378,  0.6135,  0.4662,  0.6412,  0.5575,
         0.5854,  0.4544,  0.4532,  0.4882,  0.5301,  0.3689,  0.5201,
         0.5367], device='cuda:0')
tensor(0.6598, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3756,  0.4968,  0.5124,  0.4055,  0.4355,  0.6125,  0.5377,
         0.5853,  0.6036,  0.3410,  0.3809,  0.4526,  0.4244,  0.3370,
         0.4890,  0.6006,  0.3895,  0.5311,  0.4506,  0.4440,  0.4385,
         0.4515,  0.5570,  0.5034,  0.7213,  0.5982,  0.5257,  0.5162,
         0.6022,  0.5760,  0.5414,  0.5551,  0.4174,  0.4610,  0.6410,
         0.5720,  0.5290,  0.4916,  0.4107,  0.4619,  0.5981,  0.4877,
         0.6181,  0.4558,  0.5457,  0.4648,  0.4522,  0.6578,  0.5080,
         0.3927,  0.3448,  0.4025,  0.4549,  0.5578,  0.4586,  0.5058,
         0.4235,  0.4299,  0.4947,  0.4684,  0.3682,  0.4970,  0.4007,
         0.5683,  0.4501,  0.4873,  0.4766,  0.5028,  0.4868,  0.5710,
         0.4296,  0.4137,  0.5964,  0.6214,  0.6499,  0.3110,  0.6013,
         0.5589,  0.5180,  0.5231,  0.5281,  0.4363,  0.5330,  0.5397,
         0.5488,  0.5941,  0.4166,  0.5120,  0.5074,  0.4019,  0.5036,
         0.4384,  0.5507,  0.4547,  0.5425,  0.5522,  0.5007,  0.4926,
         0.5977,  0.5775,  0.3428,  0.4716,  0.4653,  0.4885,  0.4461,
         0.5219,  0.5211,  0.4560,  0.5253,  0.3192,  0.5628,  0.4923,
         0.4819,  0.4518,  0.4916,  0.5620,  0.4762,  0.5605,  0.4399,
         0.4143,  0.5705,  0.4323,  0.5407,  0.3929,  0.4917,  0.4968,
         0.5079,  0.4886,  0.3856,  0.5595,  0.4477,  0.6682,  0.5706,
         0.5043,  0.6562,  0.6573,  0.4281,  0.5737,  0.5276,  0.4932,
         0.4741,  0.5651,  0.6295,  0.5258,  0.6155,  0.3411,  0.4319,
         0.4524,  0.5419,  0.5402,  0.4462,  0.4094,  0.4811,  0.6435,
         0.3932,  0.6849,  0.5326,  0.4961,  0.7188,  0.5040,  0.4404,
         0.5270,  0.5005,  0.6548,  0.5301,  0.5180,  0.5205,  0.4528,
         0.4644,  0.6441,  0.4330,  0.5171,  0.4780,  0.5369,  0.4842,
         0.5316,  0.5357,  0.5015,  0.4790,  0.4958,  0.5838,  0.5936,
         0.5513,  0.4626,  0.6752,  0.5234,  0.4820,  0.5396,  0.5557,
         0.4785,  0.5307,  0.4215,  0.5401,  0.5209,  0.4760,  0.6213,
         0.4823,  0.5347,  0.4414,  0.6080,  0.5222,  0.5156,  0.4529,
         0.5776,  0.4865,  0.5097,  0.5818,  0.5041,  0.4986,  0.4857,
         0.5659,  0.6200,  0.5201,  0.6581,  0.3945,  0.5713,  0.3958,
         0.5669,  0.4342,  0.4411,  0.4818,  0.6293,  0.5579,  0.3267,
         0.5116,  0.5559,  0.6397,  0.6268,  0.5115,  0.7650,  0.6940,
         0.5546,  0.5076,  0.6455,  0.6241,  0.5006,  0.5837,  0.5674,
         0.4984,  0.5175,  0.7554,  0.5420,  0.4979,  0.4575,  0.5295,
         0.5456,  0.4898,  0.4787,  0.3108,  0.4697,  0.6194,  0.3926,
         0.4097,  0.4807,  0.4360,  0.3875,  0.5160,  0.6246,  0.4918,
         0.5222,  0.3528,  0.5648,  0.5242,  0.4109,  0.6021,  0.2919,
         0.4809,  0.5132,  0.5140,  0.4711,  0.6431,  0.4814,  0.4693,
         0.4569,  0.5170,  0.4044,  0.4264,  0.4451,  0.4208,  0.4288,
         0.4790,  0.4736,  0.4963,  0.3988,  0.5816,  0.5088,  0.3771,
         0.3229,  0.5541,  0.5410,  0.5819,  0.4455,  0.5649,  0.5314,
         0.4834,  0.5503,  0.5591,  0.5025,  0.4877,  0.3885,  0.4483,
         0.5033,  0.4534,  0.5814,  0.4939,  0.4666,  0.5040,  0.6701,
         0.6163,  0.5629,  0.5971,  0.4879,  0.5250,  0.4597,  0.5582,
         0.5729,  0.5357,  0.5270,  0.3786,  0.5951,  0.5304,  0.5661,
         0.7374,  0.4077,  0.5892,  0.6058,  0.5109,  0.5984,  0.6945,
         0.3532,  0.5620,  0.6743,  0.5003,  0.5568,  0.6534,  0.4674,
         0.5957,  0.5024,  0.4828,  0.5604,  0.4987,  0.4943,  0.4598,
         0.4617,  0.5141,  0.5605,  0.5409,  0.5905,  0.7059,  0.4809,
         0.4581,  0.5571,  0.4294,  0.5685,  0.5091,  0.4023,  0.5046,
         0.5223,  0.4468,  0.4303,  0.5542,  0.5231,  0.5624,  0.4985,
         0.4149,  0.4258,  0.5275,  0.4954,  0.5849,  0.4981,  0.4994,
         0.4843,  0.4367,  0.6013,  0.4314,  0.4945,  0.4726,  0.5489,
         0.2612,  0.4798,  0.2990,  0.3935,  0.5498,  0.5083,  0.4237,
         0.6000,  0.4884,  0.6510,  0.5213,  0.3835,  0.5573,  0.4718,
         0.5625,  0.4194,  0.5064,  0.4142,  0.4361,  0.6056,  0.4199,
         0.4174,  0.3494,  0.4799,  0.4826,  0.5529,  0.4170,  0.4077,
         0.5318,  0.5000,  0.3505,  0.5499,  0.6396,  0.5280,  0.6066,
         0.3965,  0.5593,  0.4594,  0.5529,  0.5743,  0.6157,  0.3494,
         0.4365,  0.5055,  0.4992,  0.6178,  0.5660,  0.6016,  0.4503,
         0.5594,  0.6277,  0.5832,  0.5321,  0.5411,  0.5316,  0.4451,
         0.5927,  0.5131,  0.5182,  0.5507,  0.4499,  0.5711,  0.3757,
         0.4732,  0.5209,  0.5259,  0.6497,  0.6216,  0.4311,  0.4910,
         0.5439,  0.4470,  0.4091,  0.3701,  0.5754,  0.5656,  0.6404,
         0.5776,  0.4836,  0.4427,  0.6057,  0.5077,  0.4769,  0.6985,
         0.3781,  0.4033,  0.5641,  0.4375,  0.4182,  0.5690,  0.8223,
         0.5262,  0.4553,  0.4152,  0.4535,  0.4275,  0.5374,  0.4399,
         0.6309,  0.4086,  0.5277,  0.5139,  0.5456,  0.4942,  0.5398,
         0.5801,  0.3007,  0.4858,  0.6258,  0.3867,  0.6243,  0.5695,
         0.5501,  0.3908,  0.4969,  0.6386,  0.5914,  0.4992,  0.5541,
         0.5702,  0.5876,  0.4641,  0.4967,  0.5506,  0.5211,  0.5755,
         0.6451,  0.4596,  0.5296,  0.5907,  0.4923,  0.5906,  0.4564,
         0.4634], device='cuda:0')
tensor(0.6617, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4377,  0.5990,  0.4599,  0.4958,  0.6582,  0.2123,  0.4511,
         0.4670,  0.5669,  0.5131,  0.5126,  0.4429,  0.6344,  0.4851,
         0.4823,  0.5109,  0.4621,  0.4645,  0.3990,  0.5276,  0.5431,
         0.5377,  0.7646,  0.5599,  0.4077,  0.4235,  0.3934,  0.5511,
         0.5883,  0.4539,  0.5090,  0.3063,  0.4437,  0.3033,  0.5899,
         0.5235,  0.6833,  0.5280,  0.5922,  0.4690,  0.4386,  0.5046,
         0.4495,  0.4665,  0.5852,  0.5162,  0.4230,  0.4258,  0.5932,
         0.5956,  0.5988,  0.5867,  0.3648,  0.3973,  0.5030,  0.5137,
         0.5371,  0.5510,  0.6274,  0.4259,  0.5648,  0.3939,  0.4793,
         0.6820,  0.4749,  0.4523,  0.7183,  0.5534,  0.4966,  0.5909,
         0.6026,  0.4649,  0.6155,  0.4893,  0.4258,  0.4867,  0.5468,
         0.5731,  0.5303,  0.4050,  0.3297,  0.5535,  0.6478,  0.5936,
         0.5687,  0.5037,  0.5480,  0.5472,  0.5289,  0.4571,  0.4677,
         0.4987,  0.5033,  0.4081,  0.5953,  0.5064,  0.3645,  0.6522,
         0.4595,  0.5633,  0.4456,  0.4802,  0.5413,  0.5468,  0.4263,
         0.5996,  0.5248,  0.5562,  0.3312,  0.5569,  0.4541,  0.4264,
         0.4956,  0.4389,  0.5348,  0.5959,  0.6750,  0.5298,  0.3886,
         0.4907,  0.4452,  0.5588,  0.4163,  0.7956,  0.5943,  0.5615,
         0.5689,  0.3597,  0.4425,  0.6353,  0.7014,  0.6542,  0.5241,
         0.3835,  0.4561,  0.5185,  0.6227,  0.3704,  0.5579,  0.5644,
         0.4489,  0.4605,  0.4810,  0.4775,  0.5359,  0.6760,  0.5600,
         0.5828,  0.4776,  0.2956,  0.4224,  0.5594,  0.6148,  0.4313,
         0.5432,  0.4731,  0.4417,  0.5594,  0.4185,  0.5954,  0.4083,
         0.5234,  0.5319,  0.5683,  0.3006,  0.5402,  0.4405,  0.4975,
         0.3631,  0.4770,  0.5249,  0.4462,  0.4523,  0.6227,  0.5431,
         0.6153,  0.4661,  0.4048,  0.5353,  0.5361,  0.4908,  0.4028,
         0.7261,  0.3723,  0.4747,  0.6383,  0.4633,  0.5464,  0.5250,
         0.5655,  0.5371,  0.5350,  0.4903,  0.4280,  0.5071,  0.5452,
         0.4843,  0.5178,  0.4829,  0.4634,  0.6632,  0.5049,  0.3805,
         0.6431,  0.4887,  0.4362,  0.6735,  0.5115,  0.4591,  0.4254,
         0.5775,  0.5225,  0.3846,  0.6114,  0.4626,  0.5400,  0.4911,
         0.4923,  0.4008,  0.6676,  0.7084,  0.3872,  0.6616,  0.4514,
         0.5921,  0.4794,  0.6083,  0.5723,  0.5889,  0.5262,  0.5497,
         0.3526,  0.5447,  0.5871,  0.5095,  0.5772,  0.3924,  0.4895,
         0.7837,  0.5833,  0.4696,  0.4819,  0.4735,  0.5168,  0.3536,
         0.5615,  0.5416,  0.5667,  0.5780,  0.5524,  0.6716,  0.5242,
         0.4913,  0.4704,  0.4395,  0.5370,  0.4692,  0.5135,  0.5083,
         0.5678,  0.4876,  0.6248,  0.6861,  0.6507,  0.4583,  0.6746,
         0.5409,  0.6268,  0.3306,  0.4788,  0.5355,  0.5768,  0.6912,
         0.3889,  0.7200,  0.5713,  0.4635,  0.4439,  0.5729,  0.4939,
         0.4977,  0.4423,  0.6270,  0.5287,  0.5269,  0.5910,  0.4606,
         0.6500,  0.4871,  0.5614,  0.4996,  0.5274,  0.5530,  0.4765,
         0.5302,  0.3515,  0.3571,  0.4603,  0.4363,  0.4819,  0.2968,
         0.3895,  0.4603,  0.5607,  0.5886,  0.4932,  0.3816,  0.5327,
         0.4877,  0.3867,  0.6982,  0.5487,  0.4837,  0.4845,  0.5239,
         0.4803,  0.3236,  0.5537,  0.6059,  0.4290,  0.4968,  0.5218,
         0.5442,  0.5886,  0.4477,  0.5476,  0.4566,  0.2734,  0.4224,
         0.5419,  0.7931,  0.5073,  0.4099,  0.5075,  0.5795,  0.5044,
         0.3874,  0.6703,  0.4125,  0.5101,  0.5191,  0.3862,  0.4965,
         0.4416,  0.4798,  0.3632,  0.6799,  0.5403,  0.5732,  0.5179,
         0.6305,  0.5830,  0.5340,  0.5244,  0.5254,  0.5132,  0.5478,
         0.4030,  0.5361,  0.5849,  0.3831,  0.4976,  0.5119,  0.5127,
         0.4368,  0.5498,  0.5130,  0.5536,  0.4036,  0.4171,  0.5818,
         0.5785,  0.5017,  0.4683,  0.5165,  0.6322,  0.4756,  0.4930,
         0.5872,  0.5253,  0.6964,  0.4206,  0.5225,  0.3885,  0.5874,
         0.6148,  0.5245,  0.5789,  0.4872,  0.5309,  0.5673,  0.5004,
         0.6116,  0.4998,  0.3743,  0.4699,  0.5974,  0.4765,  0.4997,
         0.4896,  0.3767,  0.4327,  0.6162,  0.4969,  0.4854,  0.3258,
         0.6142,  0.5364,  0.4100,  0.7134,  0.4622,  0.4779,  0.4847,
         0.5609,  0.3418,  0.4647,  0.4676,  0.2961,  0.3176,  0.5934,
         0.5407,  0.4687,  0.4693,  0.7198], device='cuda:0')
tensor(0.6548, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 1, BCELoss: 0.6762032472357458
tensor([ 0.5646,  0.5780,  0.4983,  0.4832,  0.5316,  0.5314,  0.4705,
         0.7770,  0.4525,  0.6506,  0.4146,  0.4583,  0.4560,  0.5339,
         0.3971,  0.3812,  0.5302,  0.4924,  0.4595,  0.4527,  0.5091,
         0.6029,  0.5647,  0.5289,  0.5544,  0.5929,  0.4562,  0.7133,
         0.5011,  0.5564,  0.6491,  0.6821,  0.5804,  0.6191,  0.5349,
         0.5121,  0.5575,  0.5482,  0.4804,  0.4303,  0.5360,  0.5635,
         0.4236,  0.4861,  0.5724,  0.5925,  0.4355,  0.5476,  0.5537,
         0.4257,  0.4820,  0.4829,  0.4606,  0.4183,  0.5511,  0.4283,
         0.7142,  0.5110,  0.6961,  0.7071,  0.4539,  0.4969,  0.4970,
         0.3277,  0.5964,  0.4769,  0.6337,  0.3998,  0.5235,  0.3519,
         0.4554,  0.5637,  0.5900,  0.3706,  0.7791,  0.7889,  0.3222,
         0.4831,  0.5245,  0.6040,  0.4764,  0.5736,  0.4456,  0.4657,
         0.5475,  0.6183,  0.3635,  0.5150,  0.4888,  0.4805,  0.4482,
         0.3746,  0.4338,  0.5410,  0.4631,  0.3484,  0.5769,  0.5534,
         0.5066,  0.4602,  0.5781,  0.5409,  0.4629,  0.6302,  0.4521,
         0.5833,  0.5306,  0.3483,  0.4232,  0.3947,  0.5535,  0.4550,
         0.4434,  0.5089,  0.4804,  0.4749,  0.4636,  0.6912,  0.5641,
         0.4952,  0.4377,  0.5208,  0.4698,  0.3936,  0.2967,  0.5098,
         0.5943,  0.3729,  0.5310,  0.4138,  0.5693,  0.4950,  0.3241,
         0.4785,  0.3491,  0.7327,  0.2820,  0.5564,  0.5171,  0.4598,
         0.4361,  0.4434,  0.6027,  0.5217,  0.4284,  0.3727,  0.3914,
         0.4247,  0.4286,  0.4456,  0.5117,  0.4298,  0.6517,  0.3717,
         0.6619,  0.5666,  0.5690,  0.5434,  0.5266,  0.4122,  0.5754,
         0.6096,  0.4827,  0.5184,  0.4651,  0.5156,  0.5505,  0.4611,
         0.5060,  0.4089,  0.5134,  0.6505,  0.4437,  0.6037,  0.2611,
         0.5515,  0.3678,  0.6209,  0.4220,  0.5332,  0.5618,  0.6032,
         0.7470,  0.6832,  0.5878,  0.4462,  0.5640,  0.6551,  0.3986,
         0.5026,  0.5438,  0.4009,  0.6988,  0.6235,  0.4556,  0.5033,
         0.6663,  0.6259,  0.4830,  0.3468,  0.5038,  0.5616,  0.5483,
         0.5490,  0.4718,  0.5390,  0.4537,  0.5382,  0.5329,  0.5963,
         0.5393,  0.4920,  0.3305,  0.4439,  0.4617,  0.5170,  0.7424,
         0.4285,  0.4689,  0.6545,  0.4944,  0.5581,  0.5624,  0.3519,
         0.3261,  0.6009,  0.4277,  0.5830,  0.4395,  0.4822,  0.6986,
         0.5032,  0.5052,  0.5195,  0.4682,  0.4511,  0.5199,  0.4996,
         0.5200,  0.3651,  0.5125,  0.5627,  0.5820,  0.5388,  0.4669,
         0.5623,  0.4811,  0.3985,  0.4999,  0.6053,  0.5288,  0.6623,
         0.5293,  0.4079,  0.6237,  0.4915,  0.5390,  0.5628,  0.4676,
         0.5115,  0.2799,  0.5674,  0.5633,  0.4956,  0.4873,  0.4765,
         0.6813,  0.4632,  0.6173,  0.5331,  0.5674,  0.4526,  0.4981,
         0.5274,  0.5029,  0.5721,  0.4994,  0.4885,  0.3542,  0.4884,
         0.5491,  0.4495,  0.6440,  0.4591,  0.5281,  0.4406,  0.4922,
         0.5888,  0.5499,  0.5481,  0.5314,  0.6358,  0.4867,  0.4450,
         0.5078,  0.4976,  0.7608,  0.5008,  0.4205,  0.4292,  0.5225,
         0.4209,  0.4882,  0.5404,  0.5980,  0.5446,  0.4707,  0.4436,
         0.5229,  0.5663,  0.5260,  0.5511,  0.7032,  0.4692,  0.6045,
         0.3466,  0.5924,  0.5524,  0.4028,  0.7041,  0.3790,  0.6291,
         0.5522,  0.5391,  0.4280,  0.5479,  0.3817,  0.4702,  0.3985,
         0.6165,  0.4141,  0.5189,  0.4382,  0.5093,  0.2940,  0.5138,
         0.3479,  0.4719,  0.5079,  0.4037,  0.6648,  0.6350,  0.6232,
         0.3475,  0.5263,  0.4729,  0.5314,  0.3531,  0.5884,  0.4927,
         0.6159,  0.5639,  0.5335,  0.4157,  0.5498,  0.4592,  0.5878,
         0.4891,  0.5396,  0.6062,  0.5292,  0.4614,  0.2614,  0.4174,
         0.3652,  0.4466,  0.6720,  0.4494,  0.4211,  0.3607,  0.3220,
         0.5893,  0.6071,  0.4334,  0.5231,  0.5905,  0.5837,  0.7095,
         0.4207,  0.6118,  0.5125,  0.4137,  0.5018,  0.6006,  0.7297,
         0.4119,  0.5416,  0.7923,  0.3763,  0.6112,  0.5009,  0.5583,
         0.3954,  0.3019,  0.4586,  0.5542,  0.5552,  0.6262,  0.4612,
         0.5389,  0.4531,  0.3286,  0.6397,  0.4400,  0.3607,  0.7156,
         0.4845,  0.4289,  0.5300,  0.5064,  0.3746,  0.5990,  0.4047,
         0.4763,  0.4101,  0.5352,  0.6234,  0.3083,  0.4554,  0.4453,
         0.6543,  0.5218,  0.5282,  0.3877,  0.7153,  0.4209,  0.5246,
         0.4321,  0.5109,  0.6279,  0.5451,  0.4805,  0.5737,  0.2831,
         0.4481,  0.4627,  0.5546,  0.4185,  0.4864,  0.5332,  0.5992,
         0.5404,  0.6951,  0.6207,  0.5560,  0.4840,  0.5694,  0.3163,
         0.4948,  0.4846,  0.5468,  0.6126,  0.3598,  0.5615,  0.3975,
         0.5827,  0.5279,  0.7574,  0.5351,  0.4296,  0.4444,  0.4914,
         0.5471,  0.4697,  0.4000,  0.4419,  0.5734,  0.4977,  0.5451,
         0.5179,  0.3706,  0.6095,  0.4242,  0.4590,  0.6215,  0.6271,
         0.5104,  0.4693,  0.5628,  0.6752,  0.5190,  0.3789,  0.4549,
         0.5923,  0.6329,  0.3933,  0.5760,  0.4839,  0.5010,  0.5259,
         0.4703,  0.5704,  0.4646,  0.5419,  0.4910,  0.6434,  0.4624,
         0.3620,  0.5079,  0.4525,  0.4623,  0.4380,  0.5940,  0.4054,
         0.5017,  0.4290,  0.6229,  0.5296,  0.5596,  0.6680,  0.5777,
         0.4209], device='cuda:0')
tensor(0.6502, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3276,  0.5417,  0.3007,  0.5018,  0.3626,  0.5114,  0.6593,
         0.6315,  0.5945,  0.4108,  0.5903,  0.3095,  0.5443,  0.5348,
         0.4402,  0.4292,  0.4620,  0.3413,  0.5997,  0.5418,  0.5611,
         0.5537,  0.5511,  0.6303,  0.4690,  0.5047,  0.4956,  0.4892,
         0.6018,  0.4153,  0.5198,  0.3695,  0.4708,  0.4729,  0.6407,
         0.5855,  0.6457,  0.2508,  0.5974,  0.4980,  0.5377,  0.3451,
         0.5665,  0.4627,  0.4834,  0.4927,  0.4671,  0.5172,  0.4783,
         0.5405,  0.4802,  0.4220,  0.3827,  0.5296,  0.6342,  0.4705,
         0.5846,  0.5171,  0.4336,  0.6267,  0.5633,  0.5873,  0.5397,
         0.4775,  0.4631,  0.5045,  0.5109,  0.6647,  0.4434,  0.3835,
         0.4327,  0.6014,  0.4610,  0.6151,  0.5474,  0.4662,  0.5067,
         0.4159,  0.4368,  0.6568,  0.5404,  0.4835,  0.5320,  0.5675,
         0.5282,  0.4011,  0.4747,  0.5268,  0.5403,  0.5395,  0.5817,
         0.5624,  0.4950,  0.5007,  0.5268,  0.6129,  0.5206,  0.5100,
         0.4553,  0.5486,  0.6091,  0.5390,  0.4366,  0.7505,  0.4303,
         0.3147,  0.3944,  0.3693,  0.4026,  0.5476,  0.2436,  0.4509,
         0.6539,  0.6296,  0.3979,  0.5184,  0.5555,  0.4571,  0.3875,
         0.3999,  0.5375,  0.3074,  0.5836,  0.6054,  0.3478,  0.5368,
         0.5278,  0.4447,  0.5043,  0.4943,  0.5275,  0.5904,  0.4850,
         0.6330,  0.4544,  0.4761,  0.3090,  0.4691,  0.5801,  0.5874,
         0.4259,  0.3484,  0.5711,  0.6247,  0.4174,  0.4085,  0.4871,
         0.5007,  0.3042,  0.5547,  0.4972,  0.5466,  0.4520,  0.4002,
         0.5863,  0.5497,  0.5323,  0.4923,  0.5045,  0.5741,  0.4731,
         0.5716,  0.3762,  0.5040,  0.5308,  0.5617,  0.4486,  0.4100,
         0.5980,  0.5316,  0.5116,  0.4996,  0.4873,  0.3830,  0.5671,
         0.4860,  0.4971,  0.4063,  0.5279,  0.4960,  0.4462,  0.3256,
         0.4589,  0.6679,  0.4165,  0.4085,  0.5358,  0.6382,  0.5755,
         0.4715,  0.2906,  0.5057,  0.5824,  0.2161,  0.4908,  0.5551,
         0.4561,  0.6379,  0.3485,  0.5367,  0.3667,  0.5356,  0.4337,
         0.3803,  0.4821,  0.4610,  0.4148,  0.6079,  0.4014,  0.5942,
         0.5390,  0.4966,  0.6560,  0.4642,  0.5679,  0.4656,  0.3189,
         0.4392,  0.5818,  0.4066,  0.4375,  0.5750,  0.4268,  0.5321,
         0.5404,  0.5430,  0.6081,  0.4171,  0.6108,  0.3878,  0.4512,
         0.6045,  0.6233,  0.5183,  0.5663,  0.5407,  0.7865,  0.4984,
         0.5825,  0.2707,  0.3464,  0.5896,  0.3774,  0.4620,  0.5487,
         0.5426,  0.5840,  0.4977,  0.6521,  0.6295,  0.5597,  0.6096,
         0.5000,  0.4562,  0.5069,  0.5232,  0.5867,  0.6381,  0.5842,
         0.4994,  0.6574,  0.3906,  0.5289,  0.4835,  0.6426,  0.6042,
         0.5133,  0.6739,  0.5788,  0.5421,  0.4661,  0.5053,  0.4903,
         0.5224,  0.5621,  0.5291,  0.5871,  0.4492,  0.5454,  0.5494,
         0.7161,  0.4611,  0.4769,  0.5646,  0.6441,  0.2688,  0.4010,
         0.4276,  0.2534,  0.5279,  0.5914,  0.4589,  0.5239,  0.5878,
         0.4926,  0.2184,  0.4989,  0.5412,  0.5745,  0.5049,  0.4489,
         0.3826,  0.3931,  0.7685,  0.5021,  0.4280,  0.5341,  0.6221,
         0.2559,  0.2957,  0.6472,  0.5689,  0.4279,  0.2590,  0.5579,
         0.5810,  0.3492,  0.4629,  0.5570,  0.5515,  0.5098,  0.5794,
         0.3611,  0.4847,  0.3898,  0.5733,  0.5357,  0.4882,  0.6212,
         0.6382,  0.5392,  0.7210,  0.4420,  0.4134,  0.5012,  0.4037,
         0.5080,  0.4475,  0.8178,  0.5982,  0.5098,  0.4914,  0.6363,
         0.4878,  0.4801,  0.5040,  0.4645,  0.5066,  0.4800,  0.4801,
         0.4787,  0.7605,  0.6521,  0.4721,  0.4719,  0.4419,  0.6584,
         0.4888,  0.6621,  0.4186,  0.5887,  0.3999,  0.4447,  0.5429,
         0.4063,  0.5744,  0.5876,  0.5354,  0.6967,  0.5339,  0.6590,
         0.6403,  0.4562,  0.5597,  0.5005,  0.5367,  0.5194,  0.5254,
         0.5422,  0.7597,  0.3084,  0.5059,  0.7792,  0.6488,  0.2540,
         0.4188,  0.3572,  0.5657,  0.5292,  0.5489,  0.5329,  0.6939,
         0.5243,  0.4802,  0.5586,  0.5855,  0.5980,  0.5128,  0.3999,
         0.5310,  0.5263,  0.4948,  0.4997,  0.4566,  0.5058,  0.5514,
         0.5397,  0.4468,  0.3882,  0.5200,  0.5058,  0.6698,  0.4662,
         0.4296,  0.6813,  0.5612,  0.5941,  0.4819,  0.4961,  0.5858,
         0.6358,  0.6636,  0.5669,  0.4631,  0.4127,  0.5655,  0.7021,
         0.3890,  0.5018,  0.7458,  0.5101,  0.5408,  0.5819,  0.4049,
         0.4830,  0.5053,  0.5329,  0.5738,  0.3126,  0.5382,  0.5749,
         0.4169,  0.6050,  0.4364,  0.5060,  0.5278,  0.5049,  0.4968,
         0.4145,  0.5442,  0.5843,  0.5973,  0.6123,  0.5138,  0.5530,
         0.5530,  0.4152,  0.3484,  0.4995,  0.5372,  0.5091,  0.4213,
         0.6668,  0.6211,  0.5841,  0.5079,  0.5350,  0.5197,  0.6706,
         0.5669,  0.6148,  0.6002,  0.4025,  0.5380,  0.6607,  0.4110,
         0.4814,  0.5575,  0.5708,  0.4584,  0.3645,  0.6580,  0.5294,
         0.3984,  0.5048,  0.3057,  0.6153,  0.6381,  0.5307,  0.4452,
         0.5379,  0.5936,  0.5142,  0.3854,  0.5235,  0.4870,  0.4768,
         0.6301,  0.4737,  0.5935,  0.5867,  0.5889,  0.6713,  0.6619,
         0.4870,  0.5105,  0.4629,  0.5116,  0.5828,  0.4795,  0.7546,
         0.4098], device='cuda:0')
tensor(0.6513, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5652,  0.5562,  0.5624,  0.4642,  0.5468,  0.4436,  0.5745,
         0.6201,  0.3623,  0.5582,  0.6564,  0.6731,  0.5762,  0.5958,
         0.4078,  0.5212,  0.4828,  0.5837,  0.4457,  0.5184,  0.3258,
         0.6066,  0.5464,  0.7178,  0.3132,  0.4378,  0.4372,  0.3995,
         0.3163,  0.5928,  0.3683,  0.5155,  0.3023,  0.4871,  0.6507,
         0.5311,  0.3706,  0.6030,  0.4230,  0.7054,  0.4953,  0.6139,
         0.4598,  0.4198,  0.4997,  0.6164,  0.5385,  0.4211,  0.6568,
         0.4712,  0.5165,  0.5735,  0.4035,  0.6179,  0.3775,  0.4570,
         0.4347,  0.4274,  0.4146,  0.4605,  0.5373,  0.5023,  0.5260,
         0.4747,  0.5891,  0.5890,  0.4863,  0.2148,  0.4779,  0.7272,
         0.5166,  0.6046,  0.5346,  0.5460,  0.5497,  0.7042,  0.3968,
         0.5117,  0.3131,  0.3693,  0.5110,  0.4045,  0.5280,  0.4969,
         0.5532,  0.4829,  0.5202,  0.5452,  0.4795,  0.6552,  0.4790,
         0.5991,  0.3009,  0.5592,  0.4203,  0.4457,  0.4289,  0.6421,
         0.5976,  0.5236,  0.6231,  0.6562,  0.3782,  0.4690,  0.5727,
         0.5519,  0.6803,  0.6012,  0.6299,  0.5156,  0.5239,  0.5586,
         0.3862,  0.5483,  0.4487,  0.6059,  0.5141,  0.5119,  0.4646,
         0.5550,  0.5472,  0.5348,  0.5100,  0.5846,  0.5359,  0.5355,
         0.5910,  0.5463,  0.4283,  0.4172,  0.5098,  0.4589,  0.4920,
         0.4904,  0.5114,  0.4164,  0.4520,  0.4198,  0.6282,  0.6299,
         0.4328,  0.4381,  0.5610,  0.4977,  0.5077,  0.5738,  0.4846,
         0.6261,  0.4930,  0.3413,  0.5480,  0.4639,  0.4921,  0.4541,
         0.4963,  0.5125,  0.5282,  0.5814,  0.4881,  0.4653,  0.4810,
         0.5965,  0.5111,  0.4264,  0.3348,  0.5120,  0.4800,  0.4786,
         0.5508,  0.3288,  0.6214,  0.4176,  0.6233,  0.4405,  0.4889,
         0.3881,  0.3286,  0.4826,  0.5811,  0.6435,  0.5696,  0.6984,
         0.4630,  0.4294,  0.7716,  0.5462,  0.4452,  0.5334,  0.5040,
         0.5499,  0.5240,  0.4306,  0.4009,  0.3642,  0.5661,  0.6767,
         0.4533,  0.4101,  0.4575,  0.3625,  0.5290,  0.4923,  0.5091,
         0.5781,  0.5068,  0.5343,  0.5566,  0.4551,  0.5071,  0.4383,
         0.5385,  0.5692,  0.5337,  0.6238,  0.4748,  0.4894,  0.5278,
         0.3226,  0.6121,  0.6843,  0.4445,  0.5827,  0.1581,  0.4500,
         0.4410,  0.4914,  0.6275,  0.4552,  0.4843,  0.5013,  0.7525,
         0.5158,  0.5234,  0.6336,  0.3247,  0.4432,  0.5923,  0.3150,
         0.5278,  0.3951,  0.3899,  0.5356,  0.4779,  0.5393,  0.3573,
         0.5970,  0.5902,  0.3741,  0.5053,  0.4259,  0.5288,  0.4826,
         0.4452,  0.4218,  0.4915,  0.5034,  0.6453,  0.3712,  0.4147,
         0.5448,  0.4263,  0.5430,  0.5087,  0.5777,  0.6245,  0.4622,
         0.5044,  0.5531,  0.3180,  0.5106,  0.4950,  0.4749,  0.5619,
         0.5633,  0.5678,  0.4235,  0.6587,  0.5445,  0.4997,  0.4018,
         0.4567,  0.6037,  0.3142,  0.3475,  0.5898,  0.5313,  0.3392,
         0.5020,  0.4229,  0.2656,  0.4436,  0.6232,  0.5275,  0.6182,
         0.5567,  0.4130,  0.5768,  0.3999,  0.4496,  0.5477,  0.6358,
         0.5656,  0.5202,  0.6069,  0.5989,  0.4530,  0.4814,  0.5004,
         0.4718,  0.3779,  0.5288,  0.3540,  0.3648,  0.4443,  0.5236,
         0.5942,  0.6047,  0.4259,  0.4728,  0.4010,  0.4219,  0.4468,
         0.6101,  0.5507,  0.4679,  0.5288,  0.3269,  0.4174,  0.6981,
         0.4418,  0.6909,  0.4151,  0.3937,  0.5043,  0.5792,  0.5192,
         0.4871,  0.5320,  0.4693,  0.4581,  0.6769,  0.5337,  0.5633,
         0.4333,  0.6234,  0.5507,  0.4847,  0.2294,  0.4187,  0.5247,
         0.3450,  0.4175,  0.5812,  0.4803,  0.5304,  0.6501,  0.5133,
         0.3135,  0.5328,  0.5455,  0.6052,  0.5563,  0.3517,  0.5250,
         0.5005,  0.7195,  0.5400,  0.6456,  0.5467,  0.4740,  0.5056,
         0.5597,  0.5290,  0.3278,  0.6556,  0.3855,  0.4107,  0.5297,
         0.4211,  0.4312,  0.6017,  0.6457,  0.4890,  0.4605,  0.5610,
         0.6172,  0.5901,  0.4053,  0.3986,  0.5900,  0.4670,  0.5557,
         0.7180,  0.4149,  0.5922,  0.4403,  0.5656,  0.5904,  0.4492,
         0.5826,  0.2541,  0.4848,  0.5367,  0.3309,  0.5065,  0.4732,
         0.5094,  0.5614,  0.5588,  0.3864,  0.3968,  0.5155,  0.6277,
         0.5604,  0.4609,  0.5826,  0.7250,  0.3712,  0.4122,  0.4633,
         0.2769,  0.5237,  0.4632,  0.4376,  0.5842,  0.5648,  0.5515,
         0.5320,  0.3854,  0.5278,  0.4639,  0.5254,  0.6501,  0.4732,
         0.5414,  0.4516,  0.5191,  0.5205,  0.3872,  0.4498,  0.5447,
         0.4768,  0.5226,  0.4129,  0.4903,  0.5330,  0.5406,  0.3795,
         0.6249,  0.5532,  0.5689,  0.4945,  0.5518,  0.4812,  0.3813,
         0.3993,  0.4404,  0.5083,  0.4756,  0.5313,  0.6594,  0.4589,
         0.6901,  0.5600,  0.5291,  0.5833,  0.6020,  0.3819,  0.4483,
         0.2641,  0.4030,  0.4124,  0.5888,  0.6073,  0.4890,  0.2541,
         0.4197,  0.5563,  0.6444,  0.5943,  0.6459,  0.6077,  0.5556,
         0.4299,  0.5096,  0.6586,  0.3544,  0.4408,  0.6645,  0.5318,
         0.5303,  0.4128,  0.5591,  0.5739,  0.4199,  0.7248,  0.4747,
         0.1911,  0.3444,  0.5171,  0.5574,  0.3365,  0.4298,  0.4849,
         0.3882,  0.4202,  0.5328,  0.2416,  0.3910,  0.6272,  0.6304,
         0.4981], device='cuda:0')
tensor(0.6506, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2901,  0.5388,  0.5623,  0.5812,  0.4434,  0.4044,  0.6103,
         0.4492,  0.6278,  0.4808,  0.4177,  0.4340,  0.5678,  0.5022,
         0.5104,  0.5162,  0.5798,  0.4671,  0.3979,  0.3527,  0.4057,
         0.4368,  0.3057,  0.3014,  0.5708,  0.6425,  0.6631,  0.4983,
         0.6051,  0.3190,  0.4662,  0.3287,  0.4987,  0.4571,  0.5720,
         0.5892,  0.5444,  0.4149,  0.5791,  0.5802,  0.5043,  0.4472,
         0.6521,  0.3678,  0.6382,  0.3886,  0.5904,  0.3964,  0.4229,
         0.5309,  0.4783,  0.5449,  0.4080,  0.5246,  0.4610,  0.6204,
         0.5899,  0.5782,  0.4774,  0.3864,  0.4331,  0.5493,  0.7212,
         0.4911,  0.3139,  0.5775,  0.4976,  0.5819,  0.2893,  0.5475,
         0.5328,  0.4475,  0.6658,  0.5618,  0.3747,  0.6832,  0.3682,
         0.4527,  0.5264,  0.4567,  0.5603,  0.5705,  0.2857,  0.4866,
         0.3620,  0.5516,  0.4576,  0.4917,  0.3691,  0.6140,  0.5532,
         0.5630,  0.3700,  0.6233,  0.5162,  0.6125,  0.5854,  0.4501,
         0.4991,  0.6383,  0.6158,  0.7407,  0.4764,  0.4091,  0.4601,
         0.4730,  0.4660,  0.6307,  0.5908,  0.5321,  0.4476,  0.4707,
         0.4740,  0.4887,  0.4702,  0.6448,  0.3586,  0.5336,  0.5226,
         0.4913,  0.7710,  0.6205,  0.4796,  0.4538,  0.4240,  0.3470,
         0.3499,  0.5875,  0.4647,  0.4125,  0.5127,  0.6414,  0.4785,
         0.6321,  0.3638,  0.4282,  0.4131,  0.6099,  0.4082,  0.5068,
         0.5781,  0.3626,  0.4743,  0.4064,  0.5815,  0.4162,  0.5215,
         0.6200,  0.3705,  0.3959,  0.2590,  0.4476,  0.5110,  0.3619,
         0.3482,  0.5031,  0.5429,  0.4832,  0.6128,  0.3989,  0.6024,
         0.4841,  0.6918,  0.4477,  0.2633,  0.5023,  0.3814,  0.4581,
         0.4356,  0.6765,  0.4472,  0.4952,  0.5359,  0.4158,  0.5374,
         0.4802,  0.3753,  0.4906,  0.2038,  0.6128,  0.4500,  0.4004,
         0.4835,  0.5611,  0.5668,  0.4197,  0.5175,  0.5032,  0.5682,
         0.6107,  0.5872,  0.5744,  0.4920,  0.2779,  0.4378,  0.6367,
         0.3812,  0.8087,  0.7485,  0.3675,  0.2903,  0.6041,  0.6114,
         0.6012,  0.5118,  0.4795,  0.5021,  0.7132,  0.5257,  0.6658,
         0.6075,  0.7229,  0.4688,  0.6153,  0.3423,  0.7810,  0.5355,
         0.3673,  0.4003,  0.4757,  0.6056,  0.4707,  0.3857,  0.4608,
         0.5292,  0.6070,  0.6013,  0.5099,  0.4477,  0.4924,  0.3869,
         0.6176,  0.2920,  0.3876,  0.7266,  0.4429,  0.3214,  0.6016,
         0.4194,  0.4516,  0.5247,  0.5263,  0.6821,  0.5790,  0.5445,
         0.5326,  0.5801,  0.6736,  0.3572,  0.5050,  0.5118,  0.5845,
         0.5548,  0.4525,  0.6450,  0.3804,  0.6608,  0.6619,  0.4899,
         0.6240,  0.3587,  0.4198,  0.3435,  0.2528,  0.4923,  0.7452,
         0.4532,  0.4986,  0.3688,  0.2631,  0.4815,  0.5116,  0.4647,
         0.5238,  0.4368,  0.6268,  0.4761,  0.6081,  0.6190,  0.3419,
         0.3922,  0.6095,  0.5070,  0.5172,  0.5225,  0.6584,  0.4650,
         0.5328,  0.4776,  0.7076,  0.4003,  0.6112,  0.5067,  0.3458,
         0.4604,  0.6505,  0.5258,  0.4877,  0.5508,  0.4184,  0.5440,
         0.5004,  0.5516,  0.5660,  0.8182,  0.4074,  0.5839,  0.5855,
         0.5836,  0.6317,  0.6737,  0.6748,  0.3857,  0.6390,  0.4600,
         0.4147,  0.4116,  0.6827,  0.3951,  0.5746,  0.6654,  0.5293,
         0.3364,  0.2932,  0.5922,  0.2767,  0.5106,  0.3700,  0.4987,
         0.5645,  0.4771,  0.5728,  0.4405,  0.5115,  0.4435,  0.4059,
         0.4606,  0.6069,  0.4006,  0.5255,  0.4841,  0.3614,  0.5664,
         0.2960,  0.5236,  0.4831,  0.8052,  0.4912,  0.5292,  0.5055,
         0.4758,  0.4380,  0.5496,  0.4451,  0.3643,  0.5762,  0.2956,
         0.5294,  0.4511,  0.5605,  0.4838,  0.5191,  0.5588,  0.5077,
         0.5394,  0.5391,  0.5018,  0.3981,  0.4650,  0.3892,  0.4362,
         0.5839,  0.4343,  0.5020,  0.6894,  0.6253,  0.2951,  0.5304,
         0.4774,  0.6238,  0.2069,  0.7911,  0.4404,  0.4383,  0.6179,
         0.4768,  0.6566,  0.5168,  0.5530,  0.4348,  0.6699,  0.5574,
         0.6177,  0.7197,  0.5032,  0.5591,  0.3884,  0.4395,  0.7190,
         0.5421,  0.6448,  0.6873,  0.4378,  0.5893,  0.6088,  0.3614,
         0.4939,  0.5690,  0.6148,  0.5653,  0.4648,  0.5709,  0.2505,
         0.3976,  0.3756,  0.5658,  0.6809,  0.5026,  0.3764,  0.3450,
         0.4843,  0.5445,  0.4713,  0.7397,  0.3802,  0.3741,  0.5955,
         0.4705,  0.5351,  0.5774,  0.4751,  0.5519,  0.3332,  0.3871,
         0.4376,  0.4035,  0.6496,  0.6465,  0.4753,  0.4917,  0.4899,
         0.5261,  0.5985,  0.5865,  0.6245,  0.5633,  0.5252,  0.2809,
         0.6024,  0.5442,  0.4409,  0.5355,  0.5292,  0.5940,  0.4937,
         0.5705,  0.5195,  0.4642,  0.4944,  0.5035,  0.6001,  0.3391,
         0.4445,  0.4274,  0.6392,  0.3982,  0.5395,  0.3873,  0.5181,
         0.5368,  0.4335,  0.4607,  0.6523,  0.3660,  0.4708,  0.4067,
         0.4326,  0.5548,  0.4100,  0.3852,  0.4344,  0.4007,  0.5496,
         0.5845,  0.4502,  0.3979,  0.2519,  0.5555,  0.4539,  0.3109,
         0.5012,  0.4597,  0.5695,  0.4662,  0.5299,  0.6542,  0.3688,
         0.5607,  0.5574,  0.4493,  0.4863,  0.5561,  0.5118,  0.5734,
         0.3069,  0.6475,  0.4006,  0.4010,  0.3495,  0.4715,  0.6262,
         0.5372], device='cuda:0')
tensor(0.6416, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5583,  0.5323,  0.4100,  0.4109,  0.4986,  0.2139,  0.4559,
         0.4632,  0.2535,  0.6042,  0.5915,  0.5538,  0.4018,  0.5341,
         0.3015,  0.4992,  0.5427,  0.5168,  0.5929,  0.4028,  0.4274,
         0.4237,  0.3421,  0.4605,  0.4711,  0.5860,  0.2838,  0.4992,
         0.2938,  0.4598,  0.4943,  0.5876,  0.6133,  0.6742,  0.5214,
         0.6238,  0.5351,  0.5298,  0.4827,  0.6986,  0.6161,  0.4158,
         0.5518,  0.5179,  0.5017,  0.8332,  0.4972,  0.4937,  0.5694,
         0.4817,  0.5503,  0.4656,  0.3882,  0.4741,  0.4241,  0.3504,
         0.4038,  0.4794,  0.4125,  0.4439,  0.5017,  0.6038,  0.5985,
         0.5652,  0.6113,  0.6782,  0.5447,  0.4253,  0.4395,  0.5755,
         0.2828,  0.5328,  0.4254,  0.6112,  0.6338,  0.5265,  0.7971,
         0.5367,  0.5127,  0.3262,  0.7055,  0.6014,  0.4823,  0.3163,
         0.4589,  0.6428,  0.2986,  0.4491,  0.6098,  0.3219,  0.3459,
         0.4740,  0.4192,  0.3001,  0.4463,  0.5483,  0.5434,  0.5887,
         0.5754,  0.4540,  0.4706,  0.3879,  0.6934,  0.5965,  0.3335,
         0.5368,  0.4275,  0.3612,  0.5277,  0.5749,  0.5568,  0.6791,
         0.5877,  0.4620,  0.4032,  0.4242,  0.4486,  0.3829,  0.5132,
         0.5555,  0.5300,  0.2902,  0.6629,  0.5107,  0.6361,  0.6015,
         0.5827,  0.5442,  0.3183,  0.5634,  0.3386,  0.3255,  0.3382,
         0.5718,  0.3475,  0.5486,  0.4021,  0.5272,  0.4636,  0.4370,
         0.3865,  0.4370,  0.2780,  0.6044,  0.2791,  0.2783,  0.5890,
         0.5451,  0.5579,  0.4284,  0.4463,  0.5391,  0.4813,  0.5498,
         0.3141,  0.5078,  0.7410,  0.3993,  0.4439,  0.6377,  0.5387,
         0.5707,  0.6449,  0.4159,  0.4617,  0.2139,  0.4506,  0.5055,
         0.3682,  0.6146,  0.5111,  0.3282,  0.3350,  0.4947,  0.2181,
         0.5339,  0.5776,  0.5048,  0.5271,  0.3527,  0.6772,  0.5271,
         0.5027,  0.5578,  0.4954,  0.5651,  0.4420,  0.4904,  0.4667,
         0.3722,  0.5117,  0.4489,  0.5088,  0.5886,  0.4074,  0.5150,
         0.5832,  0.4604,  0.7023,  0.5453,  0.3404,  0.4259,  0.6854,
         0.5938,  0.6092,  0.4613,  0.4069,  0.3632,  0.5354,  0.3441,
         0.4554,  0.3608,  0.4143,  0.5074,  0.5890,  0.5337,  0.3417,
         0.3849,  0.3555,  0.6426,  0.4907,  0.4346,  0.4894,  0.3472,
         0.4617,  0.5135,  0.5354,  0.4373,  0.5164,  0.3554,  0.5011,
         0.6100,  0.6442,  0.4949,  0.6599,  0.5504,  0.5967,  0.4915,
         0.4008,  0.4374,  0.5301,  0.5993,  0.3251,  0.5098,  0.4362,
         0.4836,  0.4510,  0.4114,  0.6351,  0.4997,  0.3045,  0.3555,
         0.2407,  0.2238,  0.5965,  0.4577,  0.4765,  0.5300,  0.5356,
         0.4245,  0.4557,  0.5540,  0.3967,  0.4938,  0.4364,  0.7823,
         0.5455,  0.2170,  0.6636,  0.3234,  0.4378,  0.7775,  0.2914,
         0.5221,  0.4648,  0.5539,  0.3126,  0.6713,  0.6443,  0.4253,
         0.5093,  0.5250,  0.5919,  0.2324,  0.6092,  0.5452,  0.3305,
         0.4737,  0.5102,  0.5467,  0.4398,  0.5026,  0.4526,  0.3928,
         0.4797,  0.5554,  0.4055,  0.3487,  0.5835,  0.3756,  0.5788,
         0.3243,  0.4923,  0.6790,  0.4983,  0.5060,  0.5551,  0.4458,
         0.5004,  0.6166,  0.4404,  0.5386,  0.3812,  0.2895,  0.4104,
         0.5224,  0.3488,  0.5520,  0.5535,  0.3263,  0.4641,  0.7006,
         0.5976,  0.3501,  0.3759,  0.4078,  0.5080,  0.4968,  0.4118,
         0.7139,  0.4431,  0.3324,  0.5373,  0.3810,  0.5254,  0.5601,
         0.3666,  0.5311,  0.3734,  0.4064,  0.6199,  0.7365,  0.5897,
         0.8327,  0.3162,  0.3576,  0.5165,  0.5959,  0.5856,  0.5513,
         0.7821,  0.5023,  0.5580,  0.4485,  0.5070,  0.5134,  0.6196,
         0.4803,  0.5222,  0.3149,  0.3036,  0.6390,  0.3626,  0.4338,
         0.7174,  0.4731,  0.5947,  0.4856,  0.4547,  0.5396,  0.5473,
         0.4346,  0.2059,  0.6026,  0.6815,  0.4466,  0.5683,  0.4579,
         0.3659,  0.3927,  0.4058,  0.4550,  0.6082,  0.4365,  0.3981,
         0.7212,  0.7326,  0.3752,  0.3714,  0.4441,  0.5314,  0.5156,
         0.6001,  0.4206,  0.4473,  0.5213,  0.5645,  0.5478,  0.5296,
         0.4519,  0.4025,  0.1916,  0.5703,  0.3198,  0.6052,  0.4516,
         0.3085,  0.6161,  0.5408,  0.4967,  0.3449,  0.5932,  0.5811,
         0.5036,  0.4942,  0.6520,  0.4867,  0.5890,  0.3774,  0.5376,
         0.4447,  0.4577,  0.4139,  0.2412,  0.4739,  0.2212,  0.4417,
         0.4931,  0.3506,  0.3910,  0.4864,  0.4485,  0.5918,  0.2682,
         0.4322,  0.4292,  0.4325,  0.3184,  0.4608,  0.5168,  0.7118,
         0.3751,  0.4287,  0.5269,  0.4730,  0.5893,  0.6407,  0.7507,
         0.5906,  0.5323,  0.5786,  0.5228,  0.6826,  0.4906,  0.6365,
         0.3415,  0.2733,  0.3518,  0.5947,  0.5131,  0.4959,  0.4561,
         0.3286,  0.4582,  0.4603,  0.4076,  0.5894,  0.5925,  0.6050,
         0.5084,  0.3406,  0.4322,  0.4407,  0.3768,  0.4301,  0.4758,
         0.4901,  0.2912,  0.3744,  0.4950,  0.6181,  0.5350,  0.2405,
         0.4019,  0.3735,  0.4740,  0.5977,  0.5889,  0.3753,  0.5546,
         0.4926,  0.6188,  0.5301,  0.5106,  0.3587,  0.5493,  0.4095,
         0.3547,  0.4010,  0.4841,  0.5750,  0.5575,  0.3763,  0.7925,
         0.3338,  0.4000,  0.4717,  0.4515,  0.6087,  0.3109,  0.5241,
         0.5090], device='cuda:0')
tensor(0.6440, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4861,  0.5725,  0.2614,  0.6014,  0.7982,  0.7566,  0.4383,
         0.3957,  0.4738,  0.2530,  0.4744,  0.6200,  0.3654,  0.4500,
         0.4725,  0.5513,  0.4306,  0.5908,  0.5262,  0.5400,  0.4084,
         0.3305,  0.3598,  0.3936,  0.3664,  0.5448,  0.4826,  0.6193,
         0.4556,  0.5974,  0.5372,  0.5290,  0.3435,  0.2715,  0.3776,
         0.4272,  0.1710,  0.5874,  0.5928,  0.3385,  0.2955,  0.3160,
         0.4422,  0.4551,  0.5126,  0.5144,  0.6152,  0.5933,  0.4148,
         0.3033,  0.2673,  0.1833,  0.3216,  0.2949,  0.2814,  0.3527,
         0.5030,  0.4165,  0.5401,  0.5881,  0.5407,  0.7112,  0.4403,
         0.5916,  0.4502,  0.6382,  0.6392,  0.1955,  0.4451,  0.4409,
         0.4070,  0.6150,  0.4679,  0.5841,  0.5539,  0.5195,  0.6473,
         0.3029,  0.6484,  0.2902,  0.2570,  0.2770,  0.5768,  0.6099,
         0.5255,  0.3953,  0.4355,  0.5519,  0.4976,  0.3908,  0.5999,
         0.6706,  0.5528,  0.3116,  0.3864,  0.6170,  0.2246,  0.6197,
         0.4884,  0.5600,  0.2992,  0.3672,  0.3448,  0.5959,  0.6257,
         0.6593,  0.4877,  0.5959,  0.6227,  0.1327,  0.5410,  0.4132,
         0.2526,  0.5175,  0.1084,  0.5497,  0.4560,  0.3498,  0.4049,
         0.2625,  0.5951,  0.4432,  0.4866,  0.5065,  0.2986,  0.9002,
         0.4478,  0.5358,  0.4285,  0.4248,  0.7062,  0.3475,  0.5950,
         0.4675,  0.3533,  0.5701,  0.4981,  0.2538,  0.4882,  0.5065,
         0.4685,  0.5324,  0.5260,  0.5798,  0.3919,  0.4812,  0.4140,
         0.5523,  0.3584,  0.2287,  0.4158,  0.5529,  0.2457,  0.4544,
         0.5762,  0.3165,  0.3171,  0.3778,  0.5880,  0.8192,  0.4737,
         0.5306,  0.4369,  0.4764,  0.6326,  0.4949,  0.4637,  0.5726,
         0.4306,  0.1624,  0.5028,  0.5309,  0.4143,  0.5101,  0.4169,
         0.6212,  0.6036,  0.3423,  0.4108,  0.6162,  0.3054,  0.3642,
         0.4819,  0.5204,  0.3817,  0.5291,  0.6583,  0.4179,  0.4302,
         0.3713,  0.7124,  0.5985,  0.5635,  0.4295,  0.1783,  0.5854,
         0.4919,  0.5025,  0.5626,  0.7976,  0.3259,  0.4754,  0.6413,
         0.4817,  0.4419,  0.4155,  0.4551,  0.4946,  0.2346,  0.5404,
         0.5013,  0.5489,  0.4600,  0.2517,  0.3538,  0.5555,  0.4067,
         0.5331,  0.5366,  0.6206,  0.6725,  0.3185,  0.5798,  0.2591,
         0.2002,  0.0967,  0.3026,  0.4765,  0.4118,  0.6203,  0.3876,
         0.2719,  0.4545,  0.4958,  0.5787,  0.4446,  0.4642,  0.3117,
         0.6609,  0.4092,  0.5074,  0.4288,  0.5405,  0.5698,  0.3547,
         0.4556,  0.5513,  0.4883,  0.6277,  0.4672,  0.5332,  0.4112,
         0.3870,  0.4701,  0.6310,  0.4877,  0.4741,  0.3022,  0.5285,
         0.5794,  0.6111,  0.5589,  0.5007,  0.6903,  0.3827,  0.0775,
         0.4864,  0.5973,  0.6077,  0.3789,  0.3127,  0.1087,  0.3146,
         0.3656,  0.5444,  0.4955,  0.4053,  0.4356,  0.4965,  0.4785,
         0.6130,  0.1025,  0.6846,  0.5403,  0.5473,  0.3613,  0.6367,
         0.3684,  0.4002,  0.3451,  0.6425,  0.6322,  0.7980,  0.4831,
         0.4186,  0.4470,  0.4740,  0.2551,  0.7026,  0.2022,  0.5135,
         0.6682,  0.3614,  0.4208,  0.4212,  0.5068,  0.5036,  0.7172,
         0.5182,  0.5485,  0.5574,  0.3609,  0.3410,  0.5682,  0.3813,
         0.4293,  0.4834,  0.5329,  0.3130,  0.5643,  0.6319,  0.2221,
         0.3416,  0.6647,  0.2488,  0.5155,  0.5888,  0.3698,  0.4117,
         0.5031,  0.5054,  0.5516,  0.3054,  0.5466,  0.5657,  0.2664,
         0.6833,  0.6491,  0.3078,  0.5043,  0.3739,  0.6163,  0.4280,
         0.4502,  0.5195,  0.3344,  0.4512,  0.4489,  0.5706,  0.4124,
         0.4627,  0.4424,  0.6956,  0.6596,  0.4671,  0.5191,  0.6622,
         0.2676,  0.4165,  0.5112,  0.1419,  0.6596,  0.3155,  0.5449,
         0.5996,  0.5070,  0.2447,  0.5193,  0.6163,  0.6230,  0.2423,
         0.5955,  0.4765,  0.4505,  0.4911,  0.5167,  0.1903,  0.4067,
         0.4025,  0.3822,  0.6703,  0.4319,  0.3015,  0.2445,  0.7258,
         0.4469,  0.3931,  0.4420,  0.6340,  0.5356,  0.3834,  0.2943,
         0.2827,  0.2757,  0.5691,  0.3871,  0.5243,  0.1657,  0.3131,
         0.7522,  0.4271,  0.2316,  0.3819,  0.4098,  0.4496,  0.4564,
         0.3656,  0.4966,  0.4273,  0.5058,  0.3644,  0.5086,  0.3459,
         0.4350,  0.2923,  0.4067,  0.5590,  0.3358,  0.3962,  0.3131,
         0.5199,  0.2989,  0.6993,  0.4934,  0.4849,  0.1703,  0.6305,
         0.6883,  0.5618,  0.3871,  0.6298,  0.3242,  0.3916,  0.3079,
         0.3098,  0.3483,  0.2259,  0.5093,  0.5788,  0.4700,  0.3091,
         0.5327,  0.6563,  0.3640,  0.3308,  0.4718,  0.2201,  0.5400,
         0.4480,  0.5146,  0.4527,  0.5320,  0.6149,  0.6444,  0.5320,
         0.6020,  0.3933,  0.6344,  0.5179,  0.3991,  0.5980,  0.8653,
         0.5135,  0.5850,  0.4405,  0.5980,  0.2840,  0.4050,  0.4525,
         0.7107,  0.4834,  0.4028,  0.2770,  0.6155,  0.4744,  0.3836,
         0.6467,  0.6924,  0.5684,  0.3987,  0.6212,  0.5532,  0.5714,
         0.1613,  0.3153,  0.5733,  0.3760,  0.3575,  0.5745,  0.3546,
         0.5499,  0.5109,  0.3814,  0.2719,  0.3418,  0.4681,  0.4762,
         0.5976,  0.5391,  0.2512,  0.4699,  0.5490,  0.5832,  0.5783,
         0.6307,  0.4265,  0.3542,  0.4646,  0.4697,  0.2117,  0.5031,
         0.1570], device='cuda:0')
tensor(0.6354, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5289,  0.2137,  0.1361,  0.1476,  0.3140,  0.4387,  0.5812,
         0.5622,  0.5718,  0.3216,  0.3675,  0.6241,  0.2478,  0.2476,
         0.6123,  0.5643,  0.5689,  0.4365,  0.1739,  0.7665,  0.3375,
         0.5007,  0.6740,  0.5580,  0.6076,  0.3440,  0.6847,  0.5835,
         0.4577,  0.5564,  0.3227,  0.1810,  0.1672,  0.6136,  0.4961,
         0.5846,  0.4924,  0.3599,  0.3718,  0.5335,  0.4494,  0.1981,
         0.2452,  0.4242,  0.3210,  0.3406,  0.0963,  0.6185,  0.5039,
         0.2888,  0.5501,  0.3681,  0.4292,  0.6096,  0.1756,  0.2390,
         0.4846,  0.2577,  0.2258,  0.3617,  0.5847,  0.2088,  0.5932,
         0.3607,  0.4298,  0.6049,  0.7145,  0.2134,  0.6572,  0.5943,
         0.6515,  0.1837,  0.2913,  0.3456,  0.6177,  0.4546,  0.2322,
         0.4837,  0.6945,  0.1676,  0.4603,  0.7793,  0.5428,  0.6156,
         0.0718,  0.5821,  0.6138,  0.5145,  0.2684,  0.3119,  0.3935,
         0.4957,  0.3186,  0.5679,  0.2957,  0.3749,  0.3463,  0.2248,
         0.1341,  0.2807,  0.6376,  0.1364,  0.4633,  0.3374,  0.5362,
         0.4641,  0.5200,  0.2693,  0.8798,  0.3465,  0.5515,  0.4354,
         0.4984,  0.3061,  0.3680,  0.3080,  0.4522,  0.1705,  0.6654,
         0.6006,  0.5578,  0.5890,  0.4089,  0.6069,  0.4822,  0.5060,
         0.2877,  0.3376,  0.5626,  0.3709,  0.5782,  0.2907,  0.1680,
         0.4304,  0.4749,  0.0779,  0.3814,  0.3156,  0.2905,  0.2321,
         0.2583,  0.6642,  0.4136,  0.1631,  0.5544,  0.5891,  0.4453,
         0.4817,  0.1033,  0.5848,  0.2162,  0.2676,  0.3307,  0.4568,
         0.4329,  0.4506,  0.5554,  0.5692,  0.5496,  0.3606,  0.5728,
         0.4961,  0.4463,  0.5290,  0.4637,  0.1525,  0.2369,  0.3976,
         0.2744,  0.1565,  0.2126,  0.4126,  0.2875,  0.1424,  0.4568,
         0.1851,  0.2432,  0.4514,  0.1639,  0.4186,  0.5804,  0.3394,
         0.2144,  0.5725,  0.5003,  0.5324,  0.2431,  0.4338,  0.5847,
         0.1269,  0.3397,  0.3913,  0.3477,  0.4374,  0.4080,  0.5059,
         0.4913,  0.3403,  0.2619,  0.3587,  0.5052,  0.6199,  0.6679,
         0.3229,  0.4059,  0.2372,  0.5436,  0.2817,  0.5092,  0.4121,
         0.1113,  0.1836,  0.3065,  0.2402,  0.3936,  0.4800,  0.3529,
         0.2082,  0.2972,  0.5845,  0.5049,  0.4963,  0.4785,  0.4773,
         0.2837,  0.2884,  0.3960,  0.3523,  0.5269,  0.1362,  0.1424,
         0.1904,  0.3427,  0.5961,  0.4313,  0.3031,  0.3011,  0.5179,
         0.5186,  0.3502,  0.7614,  0.4290,  0.4181,  0.3947,  0.2760,
         0.2872,  0.1374,  0.4426,  0.5324,  0.5662,  0.0765,  0.6620,
         0.4435,  0.3469,  0.2962,  0.4472,  0.4358,  0.3028,  0.5876,
         0.3606,  0.6425,  0.4940,  0.2878,  0.3568,  0.4552,  0.5422,
         0.5539,  0.4958,  0.3005,  0.4442,  0.6690,  0.4315,  0.3465,
         0.4043,  0.3073,  0.5489,  0.4310,  0.5436,  0.5858,  0.6263,
         0.4422,  0.6063,  0.2120,  0.7139,  0.1975,  0.1732,  0.4792,
         0.1238,  0.4835,  0.3680,  0.4195,  0.6357,  0.2798,  0.5336,
         0.6015,  0.5506,  0.4289,  0.2349,  0.7557,  0.1267,  0.5096,
         0.4978,  0.6159,  0.3552,  0.4236,  0.1863,  0.2087,  0.3470,
         0.5338,  0.3433,  0.6835,  0.4194,  0.7117,  0.5841,  0.6794,
         0.1372,  0.1250,  0.5658,  0.3691,  0.4155,  0.2521,  0.3239,
         0.4537,  0.1816,  0.4785,  0.3070,  0.5122,  0.6816,  0.4012,
         0.6109,  0.4652,  0.6424,  0.2785,  0.2544,  0.4101,  0.3516,
         0.5582,  0.2014,  0.3465,  0.5617,  0.4972,  0.3200,  0.7239,
         0.3880,  0.4784,  0.5290,  0.5806,  0.4570,  0.1869,  0.1960,
         0.3329,  0.3714,  0.6213,  0.5192,  0.6234,  0.2612,  0.5553,
         0.3664,  0.5024,  0.4990,  0.6477,  0.5247,  0.4855,  0.6453,
         0.5809,  0.3594,  0.5597,  0.5221,  0.6006,  0.4395,  0.3624,
         0.4604,  0.1076,  0.5312,  0.1787,  0.6290,  0.2748,  0.5897,
         0.1554,  0.5212,  0.5273,  0.5506,  0.1123,  0.2814,  0.6529,
         0.2156,  0.4112,  0.2354,  0.4634,  0.6692,  0.4480,  0.3000,
         0.4060,  0.3082,  0.5214,  0.6473,  0.6813,  0.3902,  0.0988,
         0.4898,  0.5154,  0.3986,  0.5128,  0.6434,  0.4972,  0.5412,
         0.5226,  0.4866,  0.6336,  0.6222,  0.6182,  0.2632,  0.5553,
         0.5528,  0.5982,  0.4215,  0.5273,  0.2808,  0.3242,  0.7053,
         0.5750,  0.5585,  0.3694,  0.6033,  0.6195,  0.1256,  0.3978,
         0.3813,  0.5477,  0.5537,  0.1578,  0.6784,  0.5429,  0.1703,
         0.3343,  0.5144,  0.3922,  0.5714,  0.3976,  0.5619,  0.4026,
         0.7062,  0.1801,  0.3464,  0.2385,  0.4992,  0.4262,  0.6154,
         0.7174,  0.3649,  0.1386,  0.3503,  0.2186,  0.7046,  0.4474,
         0.5090,  0.4867,  0.6218,  0.3288,  0.4937,  0.6056,  0.5940,
         0.2829,  0.7575,  0.5397,  0.2670,  0.6078,  0.3005,  0.1324,
         0.5535,  0.5426,  0.8073,  0.4055,  0.1337,  0.4724,  0.3795,
         0.2403,  0.4838,  0.1143,  0.5799,  0.3168,  0.4012,  0.4293,
         0.3922,  0.5089,  0.5896,  0.2955,  0.3763,  0.5495,  0.5959,
         0.3222,  0.0845,  0.5547,  0.4892,  0.6615,  0.2020,  0.5168,
         0.6657,  0.5160,  0.5472,  0.2264,  0.3283,  0.5138,  0.3654,
         0.1427,  0.3223,  0.3353,  0.5500,  0.2896,  0.7516,  0.1610,
         0.6388], device='cuda:0')
tensor(0.6335, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4341,  0.6102,  0.4185,  0.4677,  0.3911,  0.6465,  0.5885,
         0.6481,  0.2616,  0.3271,  0.2648,  0.2884,  0.4443,  0.4415,
         0.4192,  0.5380,  0.5373,  0.3810,  0.5514,  0.4132,  0.4942,
         0.3977,  0.3649,  0.2253,  0.7488,  0.5519,  0.4434,  0.3358,
         0.4051,  0.5426,  0.4850,  0.6113,  0.2468,  0.6577,  0.4748,
         0.7181,  0.1458,  0.2411,  0.6043,  0.6146,  0.2905,  0.5175,
         0.5705,  0.5561,  0.6114,  0.7068,  0.6179,  0.2991,  0.3849,
         0.6624,  0.5493,  0.4445,  0.2915,  0.4513,  0.5684,  0.5453,
         0.5145,  0.2669,  0.5579,  0.6249,  0.7215,  0.5510,  0.2569,
         0.4405,  0.4535,  0.4772,  0.1459,  0.1789,  0.3710,  0.5007,
         0.3097,  0.4740,  0.3630,  0.3292,  0.1858,  0.5083,  0.4312,
         0.4033,  0.1828,  0.4973,  0.6039,  0.5113,  0.6089,  0.1858,
         0.4057,  0.2953,  0.5440,  0.3507,  0.3746,  0.6371,  0.6882,
         0.4235,  0.5073,  0.2902,  0.5927,  0.1101,  0.5244,  0.5828,
         0.3704,  0.5427,  0.6128,  0.2859,  0.2798,  0.4284,  0.3046,
         0.4987,  0.6775,  0.6579,  0.3153,  0.2986,  0.5352,  0.4684,
         0.4380,  0.1554,  0.1572,  0.5121,  0.4564,  0.4498,  0.4840,
         0.8574,  0.6297,  0.6399,  0.3082,  0.4735,  0.4908,  0.2925,
         0.1781,  0.2476,  0.3553,  0.1264,  0.5300,  0.5509,  0.2836,
         0.2385,  0.5023,  0.6842,  0.6124,  0.5599,  0.3504,  0.3759,
         0.4692,  0.4284,  0.5408,  0.6612,  0.3542,  0.3179,  0.5491,
         0.3675,  0.5631,  0.6498,  0.2747,  0.6459,  0.6400,  0.4644,
         0.4903,  0.6566,  0.1150,  0.4722,  0.7194,  0.6279,  0.5107,
         0.5239,  0.1503,  0.0823,  0.4060,  0.8474,  0.7544,  0.5996,
         0.2604,  0.7562,  0.5127,  0.4781,  0.4181,  0.2848,  0.5292,
         0.6544,  0.1368,  0.2238,  0.3589,  0.1685,  0.3449,  0.1561,
         0.1524,  0.5888,  0.5771,  0.3462,  0.4184,  0.4979,  0.1383,
         0.2314,  0.2177,  0.6686,  0.5970,  0.5102,  0.5315,  0.0972,
         0.4784,  0.4371,  0.4796,  0.4325,  0.4582,  0.3641,  0.3877,
         0.1904,  0.5553,  0.5092,  0.4492,  0.6574,  0.4401,  0.4162,
         0.5282,  0.6389,  0.6196,  0.7116,  0.4451,  0.2660,  0.4152,
         0.6368,  0.4105,  0.7030,  0.5830,  0.2681,  0.5128,  0.7160,
         0.4467,  0.5267,  0.5323,  0.5001,  0.3479,  0.2420,  0.5786,
         0.7639,  0.7487,  0.5769,  0.0824,  0.5109,  0.6696,  0.2189,
         0.1890,  0.4704,  0.3439,  0.4745,  0.3175,  0.5477,  0.5702,
         0.4164,  0.3825,  0.5388,  0.3830,  0.2817,  0.6050,  0.4399,
         0.4870,  0.3634,  0.5080,  0.4903,  0.2451,  0.5438,  0.1136,
         0.5248,  0.5651,  0.5726,  0.4681,  0.3327,  0.3862,  0.3519,
         0.1499,  0.3391,  0.2069,  0.2668,  0.1180,  0.6389,  0.2813,
         0.3266,  0.4165,  0.7221,  0.4929,  0.4640,  0.1747,  0.1396,
         0.2650,  0.4284,  0.4836,  0.5995,  0.5945,  0.5347,  0.5138,
         0.3408,  0.4281,  0.4595,  0.5741,  0.2701,  0.5965,  0.6440,
         0.6735,  0.2539,  0.5693,  0.4904,  0.1198,  0.6959,  0.1591,
         0.4130,  0.5291,  0.0885,  0.3800,  0.4619,  0.4787,  0.1071,
         0.4352,  0.5631,  0.3207,  0.2703,  0.1765,  0.1901,  0.4156,
         0.5257,  0.1521,  0.5450,  0.2774,  0.0978,  0.2548,  0.5467,
         0.3561,  0.1726,  0.5284,  0.4638,  0.6200,  0.2771,  0.4298,
         0.6130,  0.1414,  0.7088,  0.7133,  0.2455,  0.1571,  0.2355,
         0.4886,  0.3540,  0.4767,  0.5717,  0.2406,  0.5523,  0.6214,
         0.5351,  0.6967,  0.4489,  0.7018,  0.6379,  0.6644,  0.6714,
         0.3161,  0.2590,  0.7856,  0.5374,  0.1387,  0.5182,  0.6286,
         0.5398,  0.5523,  0.3641,  0.2831,  0.3846,  0.1260,  0.6953,
         0.2882,  0.3653,  0.7442,  0.6139,  0.4975,  0.4521,  0.2245,
         0.3052,  0.1161,  0.1795,  0.0817,  0.1896,  0.6541,  0.5806,
         0.5343,  0.3821,  0.4726,  0.1630,  0.5192,  0.5764,  0.4344,
         0.5687,  0.2822,  0.6988,  0.3350,  0.5562,  0.5039,  0.4396,
         0.6896,  0.5256,  0.2976,  0.4277,  0.6139,  0.6917,  0.5584,
         0.2929,  0.1741,  0.3678,  0.5648,  0.3553,  0.5338,  0.2742,
         0.3900,  0.1308,  0.5925,  0.2192,  0.6451,  0.5384,  0.3224,
         0.6307,  0.1857,  0.4272,  0.7995,  0.2819,  0.2252,  0.5197,
         0.3708,  0.5715,  0.3301,  0.5213,  0.5803,  0.4785,  0.4034,
         0.5204,  0.2021,  0.4771,  0.5873,  0.5524,  0.6273,  0.3346,
         0.6242,  0.3857,  0.3569,  0.5427,  0.6113,  0.5831,  0.1701,
         0.3776,  0.4462,  0.5326,  0.4991,  0.1341,  0.5241,  0.6495,
         0.4043,  0.5886,  0.4840,  0.2286,  0.3848,  0.2351,  0.5225,
         0.4512,  0.5142,  0.5267,  0.1536,  0.4135,  0.5184,  0.6081,
         0.2022,  0.3894,  0.3129,  0.3419,  0.5784,  0.4120,  0.5784,
         0.2354,  0.5668,  0.4379,  0.2900,  0.3407,  0.7077,  0.5413,
         0.5073,  0.2624,  0.6131,  0.3896,  0.5524,  0.5791,  0.4226,
         0.4802,  0.5083,  0.2043,  0.6790,  0.3916,  0.4967,  0.5486,
         0.4554,  0.4288,  0.1761,  0.4852,  0.1637,  0.4028,  0.3493,
         0.4944,  0.3007,  0.5619,  0.5208,  0.6991,  0.6252,  0.5956,
         0.4693,  0.4487,  0.3494,  0.6021,  0.6334,  0.6498,  0.3350,
         0.2585], device='cuda:0')
tensor(0.6157, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3804,  0.3447,  0.5543,  0.7076,  0.5737,  0.5961,  0.4083,
         0.5341,  0.5281,  0.3443,  0.5610,  0.5606,  0.5286,  0.5684,
         0.5993,  0.1514,  0.1723,  0.4441,  0.4612,  0.5575,  0.3582,
         0.3210,  0.5068,  0.3880,  0.4708,  0.6281,  0.6541,  0.4400,
         0.3609,  0.6047,  0.4323,  0.3840,  0.4777,  0.3449,  0.6280,
         0.1783,  0.2425,  0.2021,  0.2506,  0.8322,  0.1430,  0.1011,
         0.4691,  0.6345,  0.3418,  0.6317,  0.5267,  0.5162,  0.2653,
         0.5377,  0.3925,  0.1014,  0.5586,  0.4224,  0.6103,  0.5536,
         0.2645,  0.6676,  0.5542,  0.6361,  0.4978,  0.6456,  0.4142,
         0.7250,  0.5617,  0.6143,  0.6078,  0.7056,  0.6006,  0.6161,
         0.3154,  0.6040,  0.6001,  0.1989,  0.7438,  0.4961,  0.6173,
         0.2535,  0.2467,  0.4006,  0.6042,  0.2847,  0.5333,  0.3427,
         0.1575,  0.7213,  0.1422,  0.5971,  0.5662,  0.4841,  0.1719,
         0.2596,  0.4474,  0.4946,  0.2307,  0.5120,  0.4338,  0.2360,
         0.5740,  0.5656,  0.4014,  0.5974,  0.1904,  0.4930,  0.4800,
         0.7735,  0.5806,  0.3972,  0.5668,  0.2037,  0.4546,  0.5778,
         0.5668,  0.6143,  0.4537,  0.5245,  0.4959,  0.2833,  0.4812,
         0.1675,  0.4911,  0.5672,  0.5007,  0.6016,  0.4247,  0.3477,
         0.6752,  0.5301,  0.8396,  0.4500,  0.2076,  0.5462,  0.6334,
         0.5016,  0.4255,  0.7981,  0.4950,  0.6086,  0.5500,  0.5476,
         0.2003,  0.3433,  0.4232,  0.4706,  0.6300,  0.3524,  0.4267,
         0.5374,  0.6257,  0.4862,  0.7365,  0.6587,  0.6781,  0.6095,
         0.4290,  0.3912,  0.4922,  0.2494,  0.5825,  0.3454,  0.1290,
         0.4662,  0.4403,  0.5657,  0.1268,  0.5342,  0.5993,  0.5111,
         0.5469,  0.2315,  0.5613,  0.4911,  0.3412,  0.5520,  0.3535,
         0.5525,  0.5559,  0.4332,  0.6535,  0.5249,  0.5691,  0.1955,
         0.2975,  0.1891,  0.2072,  0.4433,  0.6953,  0.5197,  0.6107,
         0.5222,  0.3905,  0.6842,  0.3293,  0.7122,  0.3566,  0.4854,
         0.3088,  0.4317,  0.4156,  0.3814,  0.4099,  0.2775,  0.1476,
         0.5179,  0.6339,  0.3267,  0.1463,  0.3041,  0.4045,  0.5622,
         0.4732,  0.4536,  0.1118,  0.4268,  0.1119,  0.3115,  0.3755,
         0.7444,  0.4262,  0.4598,  0.5904,  0.4954,  0.5889,  0.3822,
         0.7285,  0.3323,  0.4170,  0.3704,  0.3888,  0.2423,  0.5936,
         0.7172,  0.5116,  0.5216,  0.1466,  0.3466,  0.1905,  0.4949,
         0.5006,  0.4831,  0.6756,  0.6069,  0.5731,  0.5355,  0.5571,
         0.2555,  0.2164,  0.3322,  0.1714,  0.7449,  0.4657,  0.6474,
         0.6319,  0.5416,  0.1465,  0.4930,  0.1096,  0.4975,  0.6304,
         0.5025,  0.4088,  0.3305,  0.4221,  0.3706,  0.6271,  0.3028,
         0.5022,  0.4739,  0.4693,  0.1292,  0.3966,  0.1024,  0.6480,
         0.2486,  0.5431,  0.5049,  0.1413,  0.3203,  0.4523,  0.2146,
         0.4304,  0.6327,  0.6777,  0.6315,  0.4161,  0.3885,  0.2004,
         0.6535,  0.5607,  0.3433,  0.2439,  0.4344,  0.5959,  0.2780,
         0.6454,  0.5621,  0.4261,  0.3052,  0.2738,  0.0976,  0.4557,
         0.3835,  0.1951,  0.6489,  0.7065,  0.5000,  0.2720,  0.4994,
         0.5990,  0.6172,  0.6722,  0.5304,  0.5067,  0.1200,  0.3013,
         0.5437,  0.3152,  0.2447,  0.5481,  0.6593,  0.5750,  0.5352,
         0.2592,  0.1743,  0.5326,  0.3813,  0.1750,  0.4494,  0.5258,
         0.3659,  0.1467,  0.1948,  0.6568,  0.2365,  0.7318,  0.4772,
         0.2904,  0.4590,  0.6411,  0.4574,  0.6990,  0.5013,  0.3235,
         0.3718,  0.5551,  0.3017,  0.7144,  0.5665,  0.4917,  0.3156,
         0.6975,  0.3557,  0.4132,  0.3738,  0.6425,  0.4710,  0.4398,
         0.6288,  0.6506,  0.8256,  0.4839,  0.3321,  0.4281,  0.4786,
         0.4778,  0.2375,  0.6348,  0.5899,  0.6578,  0.4750,  0.3808,
         0.3467,  0.5151,  0.4752,  0.5652,  0.5597,  0.5957,  0.4551,
         0.1901,  0.3680,  0.3927,  0.8079,  0.5589,  0.5248,  0.4278,
         0.6794,  0.6065,  0.5312,  0.4985,  0.5699,  0.3526,  0.3827,
         0.4415,  0.7036,  0.5383,  0.4463,  0.6153,  0.1910,  0.2888,
         0.2711,  0.3787,  0.3611,  0.6083,  0.4898,  0.5204,  0.2813,
         0.1640,  0.5484,  0.6305,  0.1547,  0.4928,  0.3410,  0.5153,
         0.1948,  0.5030,  0.3495,  0.5601,  0.1784,  0.4376,  0.5707,
         0.3342,  0.5123,  0.3019,  0.5396,  0.6120,  0.3262,  0.2738,
         0.1434,  0.4467,  0.3693,  0.4792,  0.5399,  0.5946,  0.6267,
         0.4294,  0.4724,  0.1408,  0.6397,  0.4712,  0.5936,  0.2728,
         0.5466,  0.3692,  0.1313,  0.4702,  0.2879,  0.3414,  0.6743,
         0.6158,  0.5122,  0.5817,  0.3822,  0.4948,  0.1185,  0.5783,
         0.5051,  0.4392,  0.6764,  0.4609,  0.6166,  0.7263,  0.6124,
         0.5997,  0.2562,  0.6926,  0.3745,  0.5576,  0.6433,  0.5872,
         0.3929,  0.5743,  0.3051,  0.5510,  0.4777,  0.2609,  0.4695,
         0.2386,  0.4738,  0.5888,  0.3343,  0.4807,  0.6068,  0.5614,
         0.7483,  0.6053,  0.3103,  0.4853,  0.3984,  0.1639,  0.6403,
         0.6039,  0.6246,  0.5632,  0.2212,  0.3971,  0.5849,  0.8051,
         0.4136,  0.5293,  0.1234,  0.5816,  0.3897,  0.3660,  0.3838,
         0.4259,  0.5818,  0.5310,  0.4775,  0.3490,  0.3511,  0.5125,
         0.4302], device='cuda:0')
tensor(0.6351, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5727,  0.4307,  0.7260,  0.6163,  0.4729,  0.4721,  0.4940,
         0.5096,  0.7144,  0.6402,  0.8784,  0.1684,  0.4951,  0.8303,
         0.5081,  0.5191,  0.3000,  0.6898,  0.2236,  0.3655,  0.4585,
         0.2988,  0.2860,  0.5143,  0.4122,  0.5440,  0.5240,  0.6182,
         0.6614,  0.3279,  0.3960,  0.5785,  0.1497,  0.6291,  0.3364,
         0.4206,  0.5185,  0.6043,  0.2957,  0.5297,  0.1631,  0.8140,
         0.3210,  0.2919,  0.5276,  0.6139,  0.5990,  0.5617,  0.5761,
         0.6440,  0.4918,  0.6041,  0.3167,  0.3855,  0.4854,  0.6085,
         0.4686,  0.0809,  0.4605,  0.4670,  0.4659,  0.7274,  0.2529,
         0.3831,  0.3892,  0.5856,  0.4305,  0.5291,  0.4702,  0.6668,
         0.4588,  0.6020,  0.4739,  0.5242,  0.4945,  0.4679,  0.5110,
         0.3764,  0.1159,  0.6175,  0.7010,  0.6704,  0.5887,  0.5204,
         0.4566,  0.4370,  0.5058,  0.4829,  0.6451,  0.6742,  0.5027,
         0.4196,  0.3549,  0.3852,  0.4085,  0.6859,  0.6514,  0.1855,
         0.6559,  0.6936,  0.2813,  0.4785,  0.4390,  0.5750,  0.6857,
         0.7974,  0.6191,  0.3747,  0.5575,  0.3054,  0.5731,  0.6037,
         0.6825,  0.5612,  0.4881,  0.5325,  0.3907,  0.8679,  0.5022,
         0.4256,  0.5533,  0.2412,  0.4315,  0.8569,  0.4225,  0.5557,
         0.6114,  0.6185,  0.4683,  0.5371,  0.4213,  0.7557,  0.4511,
         0.7378,  0.5909,  0.4678,  0.4095,  0.8319,  0.2158,  0.7390,
         0.6474,  0.5515,  0.5119,  0.5409,  0.4232,  0.5914,  0.5948,
         0.4357,  0.4985,  0.6498,  0.5606,  0.6124,  0.4880,  0.5381,
         0.5839,  0.4795,  0.4871,  0.4433,  0.4815,  0.8692,  0.7358,
         0.6702,  0.2221,  0.6838,  0.2354,  0.4936,  0.3454,  0.5275,
         0.6662,  0.8489,  0.4189,  0.3916,  0.5188,  0.7267,  0.3168,
         0.6555,  0.6866,  0.4906,  0.5711,  0.2707,  0.5038,  0.5709,
         0.7590,  0.2522,  0.2231,  0.6680,  0.3132,  0.5877,  0.4885,
         0.6577,  0.1620,  0.5627,  0.5413,  0.4626,  0.1000,  0.7006,
         0.6864,  0.3789,  0.6917,  0.1080,  0.2013,  0.4866,  0.1016,
         0.5073,  0.6632,  0.3907,  0.7199,  0.2451,  0.3633,  0.5937,
         0.7709,  0.5633,  0.3313,  0.3324,  0.5444,  0.5085,  0.5850,
         0.5527,  0.5123,  0.7186,  0.5002,  0.5211,  0.2446,  0.4337,
         0.1433,  0.4094,  0.1539,  0.4541,  0.3952,  0.4309,  0.5275,
         0.5781,  0.7296,  0.5353,  0.6082,  0.5468,  0.3793,  0.4542,
         0.6299,  0.4733,  0.5005,  0.4624,  0.4260,  0.3950,  0.5898,
         0.5883,  0.8382,  0.5439,  0.5825,  0.6766,  0.3527,  0.5116,
         0.6000,  0.2951,  0.4877,  0.6403,  0.5090,  0.5718,  0.5082,
         0.6773,  0.3927,  0.4537,  0.4582,  0.5866,  0.8367,  0.5144,
         0.8019,  0.5629,  0.3969,  0.1937,  0.3444,  0.4467,  0.2981,
         0.3908,  0.5590,  0.7505,  0.1649,  0.5168,  0.5918,  0.5974,
         0.8615,  0.1742,  0.7287,  0.8511,  0.4891,  0.5951,  0.3614,
         0.5007,  0.4204,  0.7751,  0.5744,  0.4924,  0.3841,  0.5459,
         0.5937,  0.4554,  0.5347,  0.3307,  0.5684,  0.4412,  0.3589,
         0.3110,  0.3806,  0.8555,  0.6126,  0.6087,  0.3498,  0.6956,
         0.6881,  0.2997,  0.6426,  0.4574,  0.3590,  0.2537,  0.6899,
         0.5368,  0.5733,  0.6673,  0.2810,  0.5058,  0.3375,  0.5250,
         0.2296,  0.5718,  0.5210,  0.5471,  0.6251,  0.3492,  0.7497,
         0.5149,  0.6411,  0.1979,  0.4060,  0.4392,  0.4196,  0.5848,
         0.5500,  0.5889,  0.4952,  0.4964,  0.8125,  0.6297,  0.0906,
         0.1699,  0.3483,  0.5248,  0.3811,  0.5328,  0.5153,  0.3526,
         0.5225,  0.4430,  0.6869,  0.6376,  0.7062,  0.4585,  0.4944,
         0.3459,  0.5841,  0.6157,  0.4949,  0.3353,  0.3000,  0.2593,
         0.6132,  0.4431,  0.6091,  0.5603,  0.6919,  0.2124,  0.2218,
         0.2553,  0.5854,  0.4110,  0.1875,  0.4633,  0.3212,  0.7128,
         0.5060,  0.4386,  0.6299,  0.5745,  0.6088,  0.5547,  0.5898,
         0.2115,  0.0770,  0.7112,  0.3996,  0.5864,  0.4288,  0.5616,
         0.5511,  0.5377,  0.6241,  0.6110,  0.4234,  0.6469,  0.6009,
         0.7219,  0.4437,  0.6469,  0.7266,  0.7012,  0.4067,  0.1761,
         0.4491,  0.6603,  0.1976,  0.6287,  0.5458,  0.3157,  0.5658,
         0.2754,  0.7595,  0.5381,  0.1165,  0.4653,  0.4476,  0.4037,
         0.5618,  0.4405,  0.4530,  0.3888,  0.5194,  0.3755,  0.4081,
         0.1137,  0.8143,  0.7065,  0.5993,  0.4931,  0.4695,  0.5227,
         0.3704,  0.6059,  0.4080,  0.6237,  0.4959,  0.6452,  0.2757,
         0.1260,  0.6888,  0.4549,  0.5733,  0.6594,  0.6192,  0.4758,
         0.6315,  0.2883,  0.3210,  0.5194,  0.5399,  0.2286,  0.3645,
         0.7121,  0.5494,  0.4058,  0.6275,  0.3269,  0.5922,  0.3963,
         0.4567,  0.6954,  0.5295,  0.5014,  0.4405,  0.5765,  0.5447,
         0.4343,  0.4264,  0.4601,  0.5765,  0.6746,  0.7235,  0.6240,
         0.2484,  0.4489,  0.3814,  0.7366,  0.6860,  0.4215,  0.4758,
         0.6141,  0.6104,  0.5412,  0.4827,  0.7061,  0.2765,  0.6440,
         0.6904,  0.5172,  0.4540,  0.6770,  0.6971,  0.7922,  0.5630,
         0.2631,  0.5374,  0.5239,  0.2745,  0.6428,  0.4988,  0.4737,
         0.8904,  0.4476,  0.3166,  0.4543,  0.6349,  0.4546,  0.5709,
         0.4207], device='cuda:0')
tensor(0.6175, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5470,  0.5459,  0.7087,  0.4403,  0.3275,  0.4040,  0.5202,
         0.5744,  0.3050,  0.4421,  0.3462,  0.6159,  0.2548,  0.5457,
         0.6115,  0.4567,  0.7481,  0.6620,  0.8548,  0.4148,  0.6990,
         0.6117,  0.4453,  0.5206,  0.2758,  0.6671,  0.5488,  0.4793,
         0.3544,  0.3464,  0.3531,  0.7136,  0.2518,  0.4461,  0.6268,
         0.0869,  0.5248,  0.7518,  0.4408,  0.5834,  0.5731,  0.7263,
         0.4684,  0.6722,  0.6582,  0.6263,  0.6471,  0.2567,  0.3594,
         0.6906,  0.5010,  0.7069,  0.3753,  0.6770,  0.6731,  0.6693,
         0.6529,  0.5935,  0.3549,  0.4942,  0.4895,  0.5904,  0.4542,
         0.2209,  0.6160,  0.3330,  0.6093,  0.5259,  0.6930,  0.3055,
         0.7200,  0.7218,  0.5009,  0.6878,  0.1707,  0.6966,  0.6519,
         0.6723,  0.4156,  0.5597,  0.5120,  0.4655,  0.3577,  0.5146,
         0.7079,  0.2578,  0.4948,  0.3946,  0.5751,  0.7669,  0.6820,
         0.5640,  0.7146,  0.7737,  0.3962,  0.5479,  0.5787,  0.5049,
         0.4417,  0.6238,  0.7067,  0.7065,  0.3208,  0.5348,  0.2535,
         0.7229,  0.6287,  0.6821,  0.4850,  0.3749,  0.5930,  0.6294,
         0.3768,  0.2613,  0.7313,  0.5300,  0.5729,  0.6622,  0.5932,
         0.4007,  0.7958,  0.6146,  0.6591,  0.6777,  0.5206,  0.3973,
         0.4586,  0.4350,  0.3704,  0.7363,  0.4421,  0.6715,  0.5192,
         0.4925,  0.4941,  0.8568,  0.6048,  0.5402,  0.5911,  0.6462,
         0.6566,  0.7405,  0.4819,  0.5270,  0.5012,  0.5953,  0.5941,
         0.7146,  0.5631,  0.6682,  0.3770,  0.6423,  0.5842,  0.2861,
         0.5622,  0.3402,  0.5734,  0.3635,  0.7015,  0.4159,  0.6730,
         0.5531,  0.4590,  0.8557,  0.3663,  0.5418,  0.3346,  0.5063,
         0.4178,  0.6098,  0.4537,  0.3836,  0.6580,  0.5347,  0.5862,
         0.3547,  0.5567,  0.7463,  0.4778,  0.5970,  0.2472,  0.5737,
         0.3218,  0.3678,  0.3091,  0.6045,  0.3750,  0.5364,  0.6781,
         0.5303,  0.6942,  0.6402,  0.2197,  0.6088,  0.5495,  0.6722,
         0.3749,  0.8862,  0.6185,  0.2811,  0.3869,  0.5669,  0.6479,
         0.6191,  0.4054,  0.1960,  0.5654,  0.6985,  0.4114,  0.6785,
         0.5163,  0.3646,  0.5053,  0.5529,  0.5722,  0.7929,  0.3586,
         0.4733,  0.4740,  0.6848,  0.3021,  0.6773,  0.5222,  0.5934,
         0.4046,  0.7041,  0.3638,  0.5332,  0.3497,  0.6633,  0.4317,
         0.2627,  0.6839,  0.5661,  0.3321,  0.5936,  0.7676,  0.0977,
         0.6716,  0.5714,  0.5692,  0.4997,  0.3141,  0.6255,  0.3154,
         0.4248,  0.4685,  0.2276,  0.4577,  0.5196,  0.6058,  0.5544,
         0.5721,  0.4095,  0.5346,  0.2119,  0.5710,  0.7371,  0.2226,
         0.2950,  0.3391,  0.6742,  0.6034,  0.5090,  0.5941,  0.6715,
         0.3708,  0.6770,  0.6358,  0.5789,  0.5287,  0.7894,  0.4803,
         0.6694,  0.7240,  0.6067,  0.2138,  0.2894,  0.5733,  0.3856,
         0.3385,  0.3181,  0.4770,  0.5391,  0.5962,  0.6902,  0.7110,
         0.5386,  0.5759,  0.4470,  0.5899,  0.3889,  0.6487,  0.6206,
         0.2990,  0.4957,  0.5096,  0.6825,  0.2802,  0.5421,  0.6004,
         0.6843,  0.3211,  0.4873,  0.6671,  0.7539,  0.4115,  0.5988,
         0.4448,  0.5845,  0.3968,  0.4910,  0.5344,  0.5481,  0.4421,
         0.7521,  0.7112,  0.6082,  0.5278,  0.7017,  0.0931,  0.4384,
         0.4579,  0.3869,  0.3356,  0.7196,  0.4096,  0.5723,  0.5491,
         0.7002,  0.5009,  0.4190,  0.4459,  0.6099,  0.7163,  0.4779,
         0.4193,  0.3784,  0.8041,  0.3727,  0.3395,  0.4908,  0.6259,
         0.4040,  0.4359,  0.6391,  0.5931,  0.7273,  0.4365,  0.6824,
         0.4428,  0.5196,  0.1444,  0.4643,  0.3791,  0.6663,  0.4566,
         0.5831,  0.5335,  0.4496,  0.6603,  0.4512,  0.5129,  0.4659,
         0.4350,  0.5218,  0.7967,  0.5510,  0.5482,  0.7410,  0.6051,
         0.5544,  0.4052,  0.4430,  0.5157,  0.6288,  0.4350,  0.5184,
         0.4720,  0.6707,  0.4995,  0.6310,  0.2799,  0.6059,  0.4523,
         0.2215,  0.6780,  0.5009,  0.3319,  0.4006,  0.4154,  0.4466,
         0.4136,  0.4063,  0.1624,  0.4411,  0.9063,  0.6813,  0.7712,
         0.5897,  0.7096,  0.3571,  0.2770,  0.2384,  0.4082,  0.5263,
         0.6899,  0.2080,  0.6308,  0.7123,  0.5396,  0.3648,  0.4097,
         0.4965,  0.2690,  0.4370,  0.2220,  0.2636,  0.4239,  0.7299,
         0.7584,  0.6198,  0.2808,  0.5784,  0.7351,  0.6199,  0.5053,
         0.8057,  0.5113,  0.5446,  0.6654,  0.2088,  0.3530,  0.4612,
         0.3929,  0.6810,  0.4986,  0.5601,  0.2007,  0.4620,  0.4225,
         0.4460,  0.2261,  0.3531,  0.5593,  0.3351,  0.5055,  0.3047,
         0.5235,  0.6603,  0.2273,  0.5962,  0.6302,  0.2358,  0.4425,
         0.5461,  0.4085,  0.4873,  0.6176,  0.6858,  0.1105,  0.6069,
         0.5423,  0.3756,  0.6456,  0.3753,  0.5085,  0.3793,  0.6455,
         0.5175,  0.5961,  0.8826,  0.5782,  0.5873,  0.2911,  0.2720,
         0.5901,  0.3890,  0.5386,  0.6573,  0.6838,  0.5151,  0.2272,
         0.6861,  0.4957,  0.5215,  0.6987,  0.2229,  0.5891,  0.5655,
         0.5469,  0.6017,  0.4618,  0.3765,  0.3774,  0.5802,  0.5079,
         0.3329,  0.6259,  0.6359,  0.5355,  0.7146,  0.7544,  0.5228,
         0.6139,  0.4480,  0.6878,  0.8069,  0.2916,  0.2338,  0.5760,
         0.5883], device='cuda:0')
tensor(0.6385, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5519,  0.4706,  0.3676,  0.1737,  0.5767,  0.7097,  0.4406,
         0.7102,  0.5894,  0.7141,  0.4634,  0.5869,  0.4527,  0.6505,
         0.6205,  0.5540,  0.5044,  0.4975,  0.4565,  0.5610,  0.6469,
         0.6437,  0.5903,  0.4616,  0.3878,  0.7783,  0.5021,  0.4078,
         0.4723,  0.6507,  0.3148,  0.8035,  0.5447,  0.5085,  0.7265,
         0.5915,  0.5226,  0.7039,  0.7731,  0.4579,  0.8873,  0.1950,
         0.1908,  0.4813,  0.8773,  0.2432,  0.5149,  0.4128,  0.5164,
         0.4266,  0.7611,  0.7480,  0.6689,  0.4236,  0.4245,  0.5820,
         0.6322,  0.6760,  0.6240,  0.4885,  0.7215,  0.6458,  0.5910,
         0.6081,  0.5107,  0.1514,  0.4371,  0.4302,  0.7879,  0.5058,
         0.6767,  0.7319,  0.6096,  0.7100,  0.2908,  0.6518,  0.6565,
         0.5856,  0.3147,  0.7224,  0.5005,  0.4542,  0.5312,  0.2866,
         0.5985,  0.6672,  0.5665,  0.3623,  0.7049,  0.4671,  0.7643,
         0.7368,  0.5294,  0.6386,  0.3066,  0.7457,  0.5411,  0.7433,
         0.6623,  0.4353,  0.9161,  0.5485,  0.5956,  0.1633,  0.4972,
         0.2175,  0.4300,  0.5169,  0.7092,  0.3776,  0.5242,  0.3220,
         0.6999,  0.6253,  0.5119,  0.5037,  0.6517,  0.5947,  0.5268,
         0.7487,  0.4017,  0.3896,  0.6198,  0.5438,  0.7337,  0.6160,
         0.6947,  0.5360,  0.5887,  0.6099,  0.4855,  0.7552,  0.3700,
         0.6640,  0.5252,  0.4330,  0.6559,  0.5883,  0.4962,  0.6003,
         0.4841,  0.6826,  0.6933,  0.4757,  0.6922,  0.7437,  0.3670,
         0.7627,  0.5938,  0.6105,  0.3923,  0.3426,  0.5838,  0.5375,
         0.5592,  0.7162,  0.6615,  0.4526,  0.6427,  0.2183,  0.5968,
         0.4518,  0.3976,  0.2626,  0.6399,  0.5303,  0.2975,  0.3412,
         0.1004,  0.5789,  0.6772,  0.7011,  0.5613,  0.6664,  0.6552,
         0.4150,  0.8111,  0.3809,  0.8770,  0.5501,  0.6051,  0.6582,
         0.7898,  0.3965,  0.7365,  0.2691,  0.8399,  0.6653,  0.5450,
         0.5759,  0.4480,  0.6110,  0.3015,  0.5249,  0.6268,  0.3789,
         0.6200,  0.4191,  0.4885,  0.5985,  0.3900,  0.5486,  0.5317,
         0.4725,  0.4397,  0.4682,  0.4395,  0.4307,  0.5076,  0.4402,
         0.8190,  0.6383,  0.4481,  0.5718,  0.1553,  0.5196,  0.4025,
         0.7708,  0.2936,  0.3222,  0.2682,  0.6066,  0.6837,  0.6973,
         0.5138,  0.5277,  0.4250,  0.6404,  0.6925,  0.3324,  0.5854,
         0.8978,  0.7194,  0.5691,  0.7028,  0.2837,  0.7332,  0.6150,
         0.7694,  0.4942,  0.5589,  0.3176,  0.5157,  0.6846,  0.3387,
         0.2293,  0.5486,  0.6715,  0.5631,  0.3219,  0.7514,  0.3860,
         0.6994,  0.4944,  0.6110,  0.1871,  0.3221,  0.5262,  0.4259,
         0.6714,  0.3556,  0.7284,  0.3670,  0.5473,  0.5382,  0.6815,
         0.7242,  0.4134,  0.4502,  0.5137,  0.5351,  0.1507,  0.4451,
         0.3879,  0.7979,  0.5611,  0.6226,  0.6674,  0.6442,  0.3630,
         0.6417,  0.4426,  0.4555,  0.6297,  0.6015,  0.7732,  0.4385,
         0.6016,  0.7016,  0.4692,  0.3806,  0.5934,  0.7623,  0.5296,
         0.4614,  0.5152,  0.7321,  0.6266,  0.5091,  0.5347,  0.3852,
         0.3845,  0.4025,  0.5590,  0.6004,  0.6644,  0.6349,  0.3947,
         0.4634,  0.5518,  0.6531,  0.4573,  0.4081,  0.5765,  0.5895,
         0.4211,  0.8196,  0.5589,  0.6456,  0.6388,  0.6473,  0.5513,
         0.7074,  0.3775,  0.5582,  0.7264,  0.3412,  0.3045,  0.5281,
         0.4726,  0.5743,  0.5357,  0.7381,  0.6429,  0.5770,  0.2472,
         0.4827,  0.6367,  0.6613,  0.5867,  0.7014,  0.6644,  0.6794,
         0.4994,  0.4730,  0.3755,  0.4268,  0.6613,  0.1711,  0.4135,
         0.2979,  0.4647,  0.6213,  0.8298,  0.5442,  0.4748,  0.7463,
         0.5218,  0.5261,  0.4180,  0.4608,  0.7647,  0.5422,  0.5652,
         0.5412,  0.6157,  0.5531,  0.6245,  0.5254,  0.6611,  0.6620,
         0.3453,  0.3980,  0.1469,  0.5121,  0.4559,  0.3380,  0.6132,
         0.6893,  0.5195,  0.6534,  0.7226,  0.5838,  0.5239,  0.4082,
         0.3259,  0.6088,  0.5903,  0.4470,  0.4036,  0.7285,  0.6397,
         0.6556,  0.6143,  0.6690,  0.4291,  0.5975,  0.6010,  0.5569,
         0.6124,  0.4828,  0.2279,  0.4848,  0.6226,  0.5045,  0.6128,
         0.7203,  0.7168,  0.6378,  0.6375,  0.8123,  0.7072,  0.4776,
         0.4417,  0.4963,  0.5085,  0.5110,  0.2640,  0.5700,  0.7257,
         0.5426,  0.6114,  0.5164,  0.2503,  0.8865,  0.7644,  0.6167,
         0.4014,  0.7339,  0.8044,  0.6359,  0.6421,  0.6138,  0.7370,
         0.6575,  0.4493,  0.7412,  0.6693,  0.6608,  0.6814,  0.6833,
         0.4987,  0.6569,  0.3592,  0.6415,  0.6349,  0.6825,  0.2278,
         0.6402,  0.5927,  0.6572,  0.7582,  0.2976,  0.6538,  0.5040,
         0.7354,  0.2750,  0.4259,  0.5874,  0.3768,  0.4793,  0.5517,
         0.3403,  0.5973,  0.5029,  0.3830,  0.4630,  0.5144,  0.4291,
         0.5939,  0.7068,  0.5029,  0.2665,  0.4771,  0.4303,  0.6941,
         0.3944,  0.5529,  0.6835,  0.4345,  0.5315,  0.6140,  0.6551,
         0.4060,  0.4612,  0.4214,  0.3879,  0.7425,  0.6150,  0.7172,
         0.5696,  0.4130,  0.6958,  0.4693,  0.6470,  0.4942,  0.5660,
         0.5339,  0.5362,  0.6263,  0.4699,  0.7997,  0.3086,  0.7409,
         0.3058,  0.1363,  0.5504,  0.6559,  0.1469,  0.5337,  0.6510,
         0.3557], device='cuda:0')
tensor(0.6293, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6809,  0.1460,  0.5391,  0.5397,  0.5641,  0.3586,  0.5412,
         0.3258,  0.5272,  0.2505,  0.2502,  0.6282,  0.6014,  0.2999,
         0.7317,  0.3090,  0.5419,  0.3103,  0.6008,  0.7230,  0.6663,
         0.7368,  0.2388,  0.2154,  0.5488,  0.8164,  0.3862,  0.5319,
         0.6594,  0.1790,  0.6368,  0.4776,  0.3300,  0.5317,  0.4157,
         0.4051,  0.8302,  0.4632,  0.3812,  0.4360,  0.5717,  0.5125,
         0.2896,  0.3946,  0.6504,  0.6078,  0.3022,  0.5130,  0.5625,
         0.6540,  0.5217,  0.5999,  0.4202,  0.5016,  0.4274,  0.7006,
         0.4140,  0.3692,  0.5678,  0.1747,  0.5595,  0.5817,  0.5685,
         0.5947,  0.5691,  0.4495,  0.7389,  0.4647,  0.3958,  0.6504,
         0.4333,  0.6700,  0.1509,  0.3182,  0.6560,  0.5702,  0.5720,
         0.5320,  0.5683,  0.5876,  0.3484,  0.2137,  0.5961,  0.6395,
         0.3497,  0.4690,  0.4523,  0.6439,  0.7228,  0.3306,  0.1189,
         0.3625,  0.5794,  0.2610,  0.4392,  0.6093,  0.5125,  0.4563,
         0.6424,  0.6080,  0.4221,  0.6061,  0.6635,  0.1331,  0.6494,
         0.6190,  0.3044,  0.6386,  0.5071,  0.4840,  0.6083,  0.6641,
         0.6441,  0.6222,  0.5437,  0.5806,  0.5427,  0.6595,  0.5748,
         0.6504,  0.7613,  0.6412,  0.7225,  0.8044,  0.4645,  0.6330,
         0.5241,  0.5816,  0.6046,  0.4653,  0.5394,  0.5447,  0.6230,
         0.4651,  0.6173,  0.8430,  0.7417,  0.3881,  0.1714,  0.3638,
         0.5950,  0.5775,  0.2602,  0.3785,  0.6831,  0.6030,  0.1592,
         0.2557,  0.5473,  0.2949,  0.4534,  0.5601,  0.7875,  0.4080,
         0.2810,  0.7262,  0.5588,  0.5325,  0.6074,  0.6747,  0.3490,
         0.5129,  0.4797,  0.4579,  0.5949,  0.6689,  0.3238,  0.5758,
         0.5078,  0.6130,  0.4670,  0.7315,  0.3635,  0.5195,  0.4688,
         0.5216,  0.4937,  0.7140,  0.8334,  0.4694,  0.5055,  0.3864,
         0.6173,  0.1315,  0.7788,  0.6447,  0.7564,  0.5590,  0.5763,
         0.1690,  0.6258,  0.4583,  0.6503,  0.4518,  0.6692,  0.3933,
         0.5049,  0.5989,  0.5311,  0.6228,  0.7580,  0.6006,  0.5180,
         0.5204,  0.2658,  0.5331,  0.3826,  0.2537,  0.6781,  0.6925,
         0.6095,  0.8397,  0.5243,  0.4276,  0.6723,  0.6211,  0.6024,
         0.4794,  0.2417,  0.2077,  0.5160,  0.7797,  0.3864,  0.8580,
         0.7697,  0.5154,  0.6082,  0.1983,  0.5758,  0.8697,  0.5154,
         0.5597,  0.5291,  0.2283,  0.6583,  0.6435,  0.5659,  0.7219,
         0.6499,  0.5907,  0.6756,  0.4204,  0.4635,  0.6811,  0.2810,
         0.5548,  0.4704,  0.6634,  0.3703,  0.4347,  0.2387,  0.4642,
         0.3653,  0.5483,  0.4715,  0.5986,  0.6711,  0.2956,  0.4800,
         0.5531,  0.5296,  0.4751,  0.5018,  0.5359,  0.4227,  0.5646,
         0.5248,  0.3910,  0.3782,  0.6800,  0.3920,  0.6161,  0.7291,
         0.5757,  0.6874,  0.7140,  0.5843,  0.6001,  0.2664,  0.7330,
         0.7032,  0.4482,  0.6333,  0.6386,  0.2409,  0.4937,  0.7074,
         0.2480,  0.6286,  0.5206,  0.4558,  0.5419,  0.6376,  0.6823,
         0.5009,  0.3098,  0.6319,  0.5391,  0.8731,  0.3219,  0.5602,
         0.2280,  0.3611,  0.2277,  0.3827,  0.5996,  0.5538,  0.4604,
         0.3032,  0.5118,  0.4867,  0.3875,  0.4602,  0.3418,  0.5177,
         0.5947,  0.2993,  0.6325,  0.3827,  0.5711,  0.6215,  0.6098,
         0.5368,  0.5912,  0.3674,  0.6445,  0.2597,  0.5007,  0.3945,
         0.3901,  0.7621,  0.4248,  0.7663,  0.3539,  0.5064,  0.8087,
         0.1444,  0.3432,  0.5140,  0.4830,  0.4092,  0.3939,  0.4756,
         0.6429,  0.6334,  0.2919,  0.2048,  0.6001,  0.3930,  0.1900,
         0.5361,  0.6456,  0.6631,  0.3301,  0.3448,  0.7704,  0.5806,
         0.8481,  0.6622,  0.5248,  0.3328,  0.4930,  0.6395,  0.3803,
         0.6898,  0.4276,  0.5670,  0.5722,  0.3433,  0.7567,  0.8094,
         0.4342,  0.4381,  0.5936,  0.2794,  0.6075,  0.3664,  0.8625,
         0.6303,  0.2248,  0.5723,  0.2971,  0.5632,  0.3349,  0.4474,
         0.6538,  0.5823,  0.4004,  0.4822,  0.5967,  0.4134,  0.7894,
         0.5736,  0.6073,  0.3787,  0.5377,  0.4375,  0.1442,  0.4439,
         0.3643,  0.4031,  0.6514,  0.7097,  0.7957,  0.4756,  0.4451,
         0.4640,  0.3506,  0.3207,  0.3415,  0.4126,  0.6830,  0.3022,
         0.6464,  0.4897,  0.4589,  0.3845,  0.5774,  0.6815,  0.2651,
         0.2917,  0.6793,  0.1648,  0.7753,  0.5402,  0.5031,  0.6148,
         0.7562,  0.7021,  0.5295,  0.5103,  0.6393,  0.4716,  0.6201,
         0.4100,  0.5300,  0.6154,  0.5705,  0.5374,  0.6697,  0.4198,
         0.4704,  0.5042,  0.7028,  0.5513,  0.7521,  0.1574,  0.6251,
         0.2770,  0.8378,  0.4164,  0.5001,  0.5008,  0.5826,  0.5198,
         0.6660,  0.6451,  0.6930,  0.3566,  0.3908,  0.1743,  0.4736,
         0.7211,  0.7010,  0.6710,  0.7418,  0.5700,  0.8404,  0.5136,
         0.4807,  0.3909,  0.5764,  0.6853,  0.2513,  0.1980,  0.5462,
         0.6651,  0.7937,  0.5858,  0.4584,  0.7256,  0.5959,  0.6286,
         0.3422,  0.6490,  0.4922,  0.5044,  0.6589,  0.5361,  0.8413,
         0.4022,  0.5422,  0.2505,  0.3064,  0.2812,  0.5846,  0.5883,
         0.6008,  0.6360,  0.7034,  0.4228,  0.4070,  0.3859,  0.3381,
         0.4974,  0.6685,  0.6788,  0.7833,  0.4938,  0.5008,  0.3694,
         0.5620], device='cuda:0')
tensor(0.6540, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3937,  0.4335,  0.3024,  0.5878,  0.4702,  0.3801,  0.4989,
         0.0977,  0.5845,  0.7634,  0.5927,  0.3923,  0.3586,  0.6459,
         0.4624,  0.3115,  0.5768,  0.3519,  0.5836,  0.6717,  0.5952,
         0.1829,  0.3880,  0.5066,  0.2428,  0.6049,  0.5672,  0.5809,
         0.1944,  0.4565,  0.3589,  0.3592,  0.7351,  0.7466,  0.5709,
         0.1583,  0.4757,  0.7966,  0.6344,  0.6165,  0.5865,  0.9256,
         0.7235,  0.6285,  0.5521,  0.5010,  0.6468,  0.6506,  0.5182,
         0.2900,  0.4360,  0.5608,  0.3338,  0.2820,  0.4712,  0.3538,
         0.5496,  0.2766,  0.6366,  0.7641,  0.5935,  0.3832,  0.7671,
         0.7363,  0.6406,  0.6374,  0.6932,  0.6284,  0.8180,  0.7333,
         0.2745,  0.5117,  0.3819,  0.5543,  0.4824,  0.4578,  0.3919,
         0.5878,  0.7521,  0.2059,  0.2071,  0.6822,  0.6615,  0.1631,
         0.7498,  0.5718,  0.5204,  0.5715,  0.7783,  0.4337,  0.7156,
         0.5506,  0.5110,  0.5177,  0.5204,  0.4708,  0.4811,  0.6777,
         0.6791,  0.4579,  0.5591,  0.5987,  0.6742,  0.4483,  0.6544,
         0.7183,  0.5319,  0.4020,  0.5997,  0.2776,  0.7884,  0.7007,
         0.5921,  0.3062,  0.6033,  0.3065,  0.6177,  0.4150,  0.4943,
         0.6762,  0.6926,  0.1999,  0.5718,  0.6506,  0.2455,  0.6635,
         0.7089,  0.3626,  0.6730,  0.6916,  0.6944,  0.6426,  0.4423,
         0.4795,  0.5917,  0.4504,  0.5953,  0.6678,  0.3459,  0.5594,
         0.2439,  0.5528,  0.4936,  0.6360,  0.2377,  0.4710,  0.5133,
         0.3974,  0.5463,  0.5405,  0.3932,  0.5739,  0.3824,  0.8371,
         0.3316,  0.5522,  0.5723,  0.6222,  0.3321,  0.2114,  0.2264,
         0.6011,  0.3868,  0.5896,  0.5515,  0.3040,  0.6204,  0.4982,
         0.7278,  0.3351,  0.6201,  0.4830,  0.7162,  0.3587,  0.3831,
         0.4958,  0.5801,  0.4567,  0.4792,  0.6307,  0.5325,  0.5751,
         0.5084,  0.3854,  0.7179,  0.6210,  0.5485,  0.6481,  0.6391,
         0.8236,  0.2543,  0.3912,  0.5714,  0.3604,  0.6737,  0.7391,
         0.4416,  0.3005,  0.5789,  0.3279,  0.6093,  0.6952,  0.2094,
         0.2530,  0.3846,  0.5517,  0.2734,  0.3496,  0.5562,  0.7566,
         0.8023,  0.4560,  0.4701,  0.6701,  0.6260,  0.6214,  0.6227,
         0.7207,  0.7918,  0.5211,  0.4326,  0.1992,  0.5471,  0.4305,
         0.4997,  0.5677,  0.4807,  0.7520,  0.4341,  0.6310,  0.7399,
         0.3088,  0.2604,  0.6156,  0.2282,  0.6835,  0.6524,  0.6222,
         0.5827,  0.7076,  0.4002,  0.3030,  0.1819,  0.6390,  0.6947,
         0.6519,  0.5360,  0.6329,  0.5483,  0.4758,  0.4556,  0.4652,
         0.4647,  0.6601,  0.6909,  0.6656,  0.7024,  0.6816,  0.7373,
         0.6293,  0.6459,  0.6725,  0.1869,  0.1840,  0.6655,  0.5004,
         0.5895,  0.5745,  0.5983,  0.3764,  0.5446,  0.6737,  0.3158,
         0.4858,  0.5072,  0.7626,  0.5836,  0.3169,  0.7039,  0.6398,
         0.5906,  0.4409,  0.4921,  0.7118,  0.2166,  0.7190,  0.5038,
         0.7114,  0.8203,  0.5405,  0.2812,  0.5979,  0.6238,  0.5076,
         0.6721,  0.6506,  0.7275,  0.1947,  0.6261,  0.6224,  0.7066,
         0.7034,  0.7005,  0.7329,  0.6088,  0.6767,  0.5882,  0.4892,
         0.6977,  0.3699,  0.5589,  0.6757,  0.6520,  0.5612,  0.4848,
         0.7398,  0.5298,  0.7981,  0.3630,  0.4517,  0.2065,  0.4658,
         0.6044,  0.3515,  0.5975,  0.6000,  0.2858,  0.2111,  0.4362,
         0.5870,  0.8379,  0.5987,  0.8211,  0.7999,  0.4908,  0.8774,
         0.7174,  0.5190,  0.4818,  0.5712,  0.7797,  0.6148,  0.6295,
         0.6900,  0.5489,  0.3194,  0.5406,  0.6758,  0.5330,  0.6657,
         0.5559,  0.3584,  0.6013,  0.7960,  0.7353,  0.5334,  0.6117,
         0.5663,  0.4681,  0.6922,  0.6555,  0.3722,  0.3075,  0.3373,
         0.4062,  0.2173,  0.4797,  0.6865,  0.7946,  0.6641,  0.5278,
         0.6593,  0.3780,  0.5313,  0.3649,  0.6461,  0.6390,  0.2477,
         0.3454,  0.1674,  0.4012,  0.6007,  0.6429,  0.1522,  0.8217,
         0.3206,  0.3083,  0.6445,  0.5742,  0.7677,  0.4071,  0.6626,
         0.2582,  0.5611,  0.5123,  0.4003,  0.6316,  0.6189,  0.7396,
         0.6880,  0.7968,  0.6631,  0.4802,  0.2570,  0.3937,  0.6959,
         0.5683,  0.3362,  0.6655,  0.3735,  0.1500,  0.2898,  0.7383,
         0.7145,  0.4129,  0.5646,  0.4235,  0.6365,  0.6380,  0.3037,
         0.5021,  0.1839,  0.2820,  0.5473,  0.6410,  0.5967,  0.3590,
         0.2526,  0.3451,  0.4630,  0.2968,  0.2667,  0.2244,  0.5351,
         0.3950,  0.5200,  0.5743,  0.5722,  0.3521,  0.1889,  0.5798,
         0.3097,  0.4693,  0.2788,  0.3454,  0.6151,  0.7551,  0.5046,
         0.6469,  0.5593,  0.1798,  0.3300,  0.6821,  0.1753,  0.5805,
         0.4295,  0.4767,  0.6933,  0.5963,  0.3272,  0.6298,  0.5455,
         0.2691,  0.4664,  0.6967,  0.5554,  0.6523,  0.6700,  0.6973,
         0.2447,  0.7162,  0.4346,  0.6231,  0.6172,  0.6893,  0.6733,
         0.2512,  0.8599,  0.4671,  0.6846,  0.4368,  0.3966,  0.5136,
         0.5335,  0.6822,  0.4168,  0.6243,  0.7375,  0.4769,  0.5350,
         0.1117,  0.5215,  0.3885,  0.5693,  0.5102,  0.5578,  0.5203,
         0.2846,  0.7359,  0.6204,  0.6747,  0.4139,  0.1596,  0.3425,
         0.2774,  0.6025,  0.3299,  0.5050,  0.6056,  0.6411,  0.5073,
         0.7231], device='cuda:0')
tensor(0.6037, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1435,  0.7654,  0.3204,  0.1308,  0.4270,  0.1462,  0.3074,
         0.2411,  0.8452,  0.5075,  0.2547,  0.5162,  0.5237,  0.6848,
         0.6481,  0.1654,  0.6800,  0.5931,  0.6074,  0.2282,  0.5810,
         0.4212,  0.3347,  0.5459,  0.5480,  0.1866,  0.4927,  0.6955,
         0.4953,  0.7353,  0.4741,  0.6451,  0.5435,  0.5453,  0.2916,
         0.6706,  0.2148,  0.4908,  0.3459,  0.6934,  0.4103,  0.2077,
         0.3427,  0.1399,  0.6175,  0.5138,  0.3768,  0.3576,  0.6412,
         0.7018,  0.8021,  0.4722,  0.3768,  0.3464,  0.3588,  0.1068,
         0.6992,  0.1830,  0.3036,  0.4508,  0.6208,  0.5631,  0.4459,
         0.5659,  0.7646,  0.3112,  0.5796,  0.5278,  0.6392,  0.4175,
         0.3728,  0.5892,  0.6578,  0.4812,  0.6481,  0.2206,  0.1336,
         0.4368,  0.1620,  0.5792,  0.3372,  0.4080,  0.7463,  0.4192,
         0.4325,  0.5858,  0.6421,  0.2756,  0.7236,  0.6599,  0.3124,
         0.1375,  0.2664,  0.5135,  0.5109,  0.5619,  0.2280,  0.2345,
         0.4646,  0.6471,  0.4554,  0.6865,  0.6656,  0.6165,  0.4628,
         0.6816,  0.4609,  0.6743,  0.6749,  0.1859,  0.7214,  0.1894,
         0.2469,  0.6613,  0.6804,  0.1608,  0.6116,  0.2686,  0.3282,
         0.3551,  0.8449,  0.6197,  0.5374,  0.3689,  0.7030,  0.6560,
         0.6681,  0.3274,  0.6138,  0.5418,  0.5088,  0.2115,  0.5933,
         0.1569,  0.7478,  0.7662,  0.6631,  0.7018,  0.0980,  0.4880,
         0.6107,  0.6980,  0.3426,  0.4712,  0.3514,  0.5567,  0.4024,
         0.7651,  0.5078,  0.6387,  0.6751,  0.6178,  0.3875,  0.4413,
         0.6313,  0.1935,  0.6262,  0.3538,  0.6617,  0.5393,  0.1071,
         0.1227,  0.5394,  0.5285,  0.3907,  0.1277,  0.6038,  0.5586,
         0.8307,  0.6159,  0.7178,  0.2750,  0.5567,  0.4670,  0.5209,
         0.8636,  0.7425,  0.5685,  0.3604,  0.3559,  0.6136,  0.7273,
         0.6352,  0.5351,  0.5800,  0.6149,  0.4310,  0.5801,  0.2674,
         0.6022,  0.5798,  0.1984,  0.7505,  0.5882,  0.2365,  0.5799,
         0.1393,  0.3505,  0.1858,  0.5463,  0.5947,  0.6788,  0.1882,
         0.4432,  0.5837,  0.1053,  0.5184,  0.6891,  0.7040,  0.2308,
         0.4569,  0.5874,  0.5479,  0.7556,  0.1239,  0.3087,  0.6820,
         0.4796,  0.4787,  0.4952,  0.4058,  0.6859,  0.4048,  0.5210,
         0.4768,  0.6775,  0.7832,  0.4256,  0.1873,  0.7079,  0.8716,
         0.7242,  0.4790,  0.5153,  0.6936,  0.4606,  0.3813,  0.5241,
         0.7269,  0.6377,  0.5516,  0.6282,  0.6742,  0.9177,  0.1701,
         0.1434,  0.2323,  0.8473,  0.7112,  0.8872,  0.5571,  0.5697,
         0.2605,  0.3010,  0.7148,  0.7136,  0.6215,  0.5736,  0.6617,
         0.6512,  0.7232,  0.5753,  0.5506,  0.4287,  0.7868,  0.5073,
         0.5041,  0.4419,  0.6872,  0.5932,  0.2124,  0.6395,  0.6065,
         0.5739,  0.3168,  0.5226,  0.7082,  0.3808,  0.6551,  0.2958,
         0.3606,  0.2459,  0.8565,  0.6997,  0.3856,  0.3428,  0.8411,
         0.7094,  0.4711,  0.7551,  0.3583,  0.1051,  0.4444,  0.3765,
         0.5185,  0.5809,  0.1812,  0.5602,  0.7367,  0.5003,  0.5105,
         0.2821,  0.6552,  0.2977,  0.0967,  0.5544,  0.5695,  0.8450,
         0.2933,  0.6284,  0.2544,  0.5140,  0.1422,  0.4326,  0.6204,
         0.2004,  0.4346,  0.5684,  0.6925,  0.7272,  0.2766,  0.3933,
         0.4137,  0.1780,  0.1620,  0.4887,  0.3773,  0.1609,  0.5778,
         0.3415,  0.5554,  0.6371,  0.2503,  0.3584,  0.5788,  0.7632,
         0.6305,  0.5352,  0.2801,  0.5279,  0.6304,  0.4248,  0.6775,
         0.1361,  0.4595,  0.7111,  0.3302,  0.4075,  0.2900,  0.6815,
         0.4224,  0.1539,  0.2532,  0.4962,  0.2983,  0.6361,  0.5297,
         0.7588,  0.4965,  0.4950,  0.4280,  0.6334,  0.6652,  0.2777,
         0.3841,  0.1951,  0.1870,  0.1512,  0.4143,  0.3544,  0.3550,
         0.3160,  0.3682,  0.6484,  0.7729,  0.6833,  0.1154,  0.7336,
         0.4332,  0.5334,  0.1693,  0.0708,  0.4370,  0.1630,  0.4175,
         0.2132,  0.7923,  0.3282,  0.4347,  0.4432,  0.4728,  0.7427,
         0.3315,  0.1101,  0.7845,  0.1841,  0.5859,  0.3125,  0.2658,
         0.7192,  0.5688,  0.6447,  0.8232,  0.5180,  0.1265,  0.6509,
         0.6667,  0.7042,  0.5353,  0.2621,  0.5026,  0.6058,  0.6154,
         0.4718,  0.3473,  0.5033,  0.1612,  0.7973,  0.3749,  0.7555,
         0.6805,  0.7480,  0.2170,  0.8146,  0.4914,  0.4018,  0.7798,
         0.5385,  0.1918,  0.3500,  0.3417,  0.5567,  0.4301,  0.7168,
         0.2092,  0.7118,  0.2838,  0.6197,  0.2654,  0.7286,  0.3705,
         0.5277,  0.3206,  0.6511,  0.5721,  0.7459,  0.4977,  0.7215,
         0.5864,  0.4986,  0.4883,  0.6438,  0.7651,  0.1299,  0.1485,
         0.2171,  0.7465,  0.2278,  0.2834,  0.6998,  0.1049,  0.1873,
         0.3846,  0.1992,  0.6636,  0.1271,  0.6600,  0.4224,  0.5910,
         0.2520,  0.6009,  0.5738,  0.5295,  0.6740,  0.7414,  0.4312,
         0.3113,  0.2079,  0.6616,  0.7717,  0.1114,  0.5669,  0.5300,
         0.7657,  0.4447,  0.5261,  0.2609,  0.2972,  0.2819,  0.8445,
         0.1494,  0.1641,  0.6665,  0.5578,  0.7590,  0.5610,  0.4841,
         0.1236,  0.7387,  0.5414,  0.6491,  0.7616,  0.4895,  0.5152,
         0.6966,  0.5898,  0.6314,  0.5065,  0.8628,  0.4581,  0.6036,
         0.8196], device='cuda:0')
tensor(0.6211, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1187,  0.1814,  0.7310,  0.1778,  0.3142,  0.3928,  0.8242,
         0.1881,  0.6962,  0.3930,  0.1781,  0.4153,  0.3193,  0.7557,
         0.1284,  0.2348,  0.7018,  0.8360,  0.5473,  0.1750,  0.5870,
         0.8662,  0.4790,  0.1739,  0.1191,  0.1547,  0.6767,  0.5072,
         0.5622,  0.6897,  0.7035,  0.2194,  0.6558,  0.5978,  0.4741,
         0.0785,  0.2508,  0.4421,  0.5358,  0.6469,  0.1328,  0.3900,
         0.5893,  0.2283,  0.3053,  0.1842,  0.4279,  0.1781,  0.6266,
         0.1366,  0.2751,  0.4870,  0.5541,  0.1028,  0.1656,  0.5360,
         0.6124,  0.1332,  0.6966,  0.4028,  0.1159,  0.1312,  0.1005,
         0.6790,  0.6366,  0.6781,  0.3258,  0.1027,  0.1201,  0.0755,
         0.4340,  0.7064,  0.1927,  0.1227,  0.7058,  0.1985,  0.5892,
         0.2121,  0.6195,  0.6130,  0.5435,  0.3210,  0.4119,  0.2636,
         0.0812,  0.7603,  0.0965,  0.6516,  0.1754,  0.6343,  0.6278,
         0.2793,  0.1975,  0.5665,  0.1701,  0.2222,  0.2311,  0.6116,
         0.5376,  0.1553,  0.2346,  0.7569,  0.2057,  0.5126,  0.1191,
         0.1789,  0.1484,  0.1064,  0.5943,  0.1162,  0.6559,  0.1665,
         0.3515,  0.1792,  0.1622,  0.1215,  0.3894,  0.2008,  0.2041,
         0.6317,  0.4694,  0.1934,  0.7470,  0.6537,  0.2545,  0.1387,
         0.4095,  0.1239,  0.6136,  0.6857,  0.6955,  0.1738,  0.4094,
         0.1571,  0.1687,  0.1685,  0.2048,  0.6901,  0.0907,  0.1181,
         0.1670,  0.6331,  0.3041,  0.5324,  0.7079,  0.1238,  0.4062,
         0.4745,  0.1646,  0.5703,  0.5401,  0.4905,  0.5783,  0.5579,
         0.1242,  0.5282,  0.0952,  0.1674,  0.1925,  0.6634,  0.0998,
         0.1965,  0.1788,  0.7846,  0.2372,  0.0861,  0.1811,  0.6411,
         0.6326,  0.2230,  0.5431,  0.1508,  0.5025,  0.4492,  0.5602,
         0.3500,  0.2344,  0.4557,  0.2279,  0.6254,  0.2020,  0.6303,
         0.3012,  0.1762,  0.2527,  0.8101,  0.7501,  0.2718,  0.1195,
         0.4516,  0.4840,  0.2471,  0.7996,  0.7784,  0.1653,  0.8239,
         0.1304,  0.0983,  0.6393,  0.4153,  0.3744,  0.3565,  0.7408,
         0.1760,  0.5511,  0.7089,  0.1026,  0.1782,  0.2237,  0.1459,
         0.3352,  0.4954,  0.4377,  0.6522,  0.5454,  0.1908,  0.4407,
         0.2927,  0.1956,  0.5202,  0.1679,  0.5817,  0.5413,  0.2974,
         0.8221,  0.0902,  0.4224,  0.5858,  0.7251,  0.6603,  0.4948,
         0.1146,  0.2315,  0.0905,  0.4861,  0.7769,  0.0963,  0.0927,
         0.2365,  0.1024,  0.4953,  0.1532,  0.7121,  0.5030,  0.4318,
         0.1113,  0.7489,  0.1352,  0.2215,  0.1668,  0.2466,  0.7264,
         0.4972,  0.7478,  0.7341,  0.6872,  0.2318,  0.1566,  0.6752,
         0.5761,  0.3504,  0.1263,  0.2735,  0.1552,  0.1711,  0.1496,
         0.6045,  0.8001,  0.6723,  0.6104,  0.5723,  0.1187,  0.1605,
         0.7228,  0.3537,  0.2654,  0.1687,  0.1498,  0.1564,  0.5704,
         0.0700,  0.5306,  0.4524,  0.7479,  0.7202,  0.1911,  0.6122,
         0.0921,  0.6941,  0.1437,  0.5265,  0.1162,  0.0937,  0.4148,
         0.2802,  0.4904,  0.7618,  0.3115,  0.6958,  0.6702,  0.3791,
         0.4733,  0.4853,  0.4286,  0.6853,  0.7571,  0.6674,  0.3273,
         0.6957,  0.2844,  0.1767,  0.1279,  0.6576,  0.0849,  0.7200,
         0.5246,  0.1629,  0.3951,  0.1720,  0.5399,  0.6455,  0.1144,
         0.5012,  0.5747,  0.2438,  0.1018,  0.1960,  0.2168,  0.4808,
         0.6913,  0.1522,  0.5991,  0.7163,  0.4283,  0.5951,  0.2429,
         0.6820,  0.0943,  0.5798,  0.5611,  0.8275,  0.1520,  0.6180,
         0.5861,  0.1288,  0.2027,  0.6005,  0.3021,  0.6992,  0.1808,
         0.4126,  0.4844,  0.4402,  0.6382,  0.1176,  0.4125,  0.6575,
         0.8286,  0.4922,  0.0981,  0.4787,  0.1032,  0.6176,  0.1955,
         0.1960,  0.1699,  0.4121,  0.6008,  0.1588,  0.6736,  0.6883,
         0.1793,  0.1215,  0.1282,  0.5025,  0.7429,  0.2627,  0.2511,
         0.1926,  0.7663,  0.1889,  0.1431,  0.6031,  0.1373,  0.7534,
         0.5461,  0.6695,  0.1895,  0.3766,  0.1159,  0.6535,  0.1464,
         0.2058,  0.4931,  0.1810,  0.3652,  0.6453,  0.2873,  0.0977,
         0.7377,  0.1930,  0.6531,  0.1392,  0.4245,  0.5779,  0.2336,
         0.6264,  0.6723,  0.2179,  0.1165,  0.2169,  0.6170,  0.2655,
         0.6198,  0.1486,  0.2107,  0.3872,  0.5513,  0.5360,  0.0954,
         0.4363,  0.1592,  0.1827,  0.1343,  0.5099,  0.5113,  0.2116,
         0.1062,  0.5758,  0.1610,  0.4371,  0.2005,  0.2053,  0.1883,
         0.1736,  0.3707,  0.3062,  0.2939,  0.1631,  0.1742,  0.7425,
         0.6170,  0.0965,  0.3707,  0.1058,  0.8326,  0.6816,  0.1630,
         0.4105,  0.6343,  0.1199,  0.1442,  0.5270,  0.7254,  0.6048,
         0.1148,  0.1041,  0.6391,  0.4201,  0.1255,  0.1290,  0.1416,
         0.4327,  0.2472,  0.4784,  0.1458,  0.1314,  0.4894,  0.7584,
         0.0842,  0.1174,  0.6225,  0.7141,  0.5419,  0.1546,  0.2518,
         0.1221,  0.6570,  0.1440,  0.4638,  0.2979,  0.0883,  0.2159,
         0.1263,  0.2171,  0.2114,  0.2885,  0.2495,  0.1909,  0.1466,
         0.7369,  0.8100,  0.1131,  0.4256,  0.2107,  0.2515,  0.0692,
         0.0795,  0.1803,  0.2238,  0.1224,  0.6078,  0.2233,  0.1058,
         0.1443,  0.5181,  0.1911,  0.6031,  0.3658,  0.1887,  0.3418,
         0.3482], device='cuda:0')
tensor(0.6860, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2309,  0.6485,  0.6057,  0.5077,  0.6988,  0.5112,  0.1652,
         0.5889,  0.4411,  0.8289,  0.6356,  0.7764,  0.6016,  0.6263,
         0.5335,  0.3661,  0.5251,  0.7363,  0.7829,  0.2757,  0.7369,
         0.1833,  0.6400,  0.2932,  0.7156,  0.5588,  0.5379,  0.6234,
         0.5917,  0.5932,  0.6958,  0.5891,  0.3715,  0.1834,  0.4929,
         0.4907,  0.3741,  0.5586,  0.5649,  0.4609,  0.6120,  0.2983,
         0.2107,  0.5336,  0.3933,  0.5490,  0.4966,  0.5911,  0.7009,
         0.1843,  0.3501,  0.6547,  0.4688,  0.7864,  0.2328,  0.3609,
         0.2044,  0.4618,  0.6062,  0.3996,  0.1735,  0.6095,  0.4966,
         0.5064,  0.3465,  0.8394,  0.8401,  0.5402,  0.1821,  0.6476,
         0.6929,  0.1569,  0.7149,  0.7295,  0.7008,  0.7020,  0.7115,
         0.2251,  0.2440,  0.2732,  0.7908,  0.7173,  0.4773,  0.4575,
         0.3633,  0.4719,  0.3406,  0.6314,  0.4587,  0.7316,  0.7089,
         0.4189,  0.7025,  0.5224,  0.3675,  0.5643,  0.2246,  0.5539,
         0.5919,  0.5758,  0.7847,  0.2878,  0.3661,  0.6780,  0.3725,
         0.6698,  0.3831,  0.4193,  0.5246,  0.5241,  0.6621,  0.4240,
         0.4349,  0.6536,  0.4653,  0.3061,  0.6425,  0.4612,  0.7275,
         0.5674,  0.6194,  0.7080,  0.1669,  0.4719,  0.2849,  0.5078,
         0.6831,  0.4814,  0.4978,  0.4196,  0.5864,  0.6489,  0.3315,
         0.8050,  0.5535,  0.7133,  0.5390,  0.4394,  0.8433,  0.5725,
         0.6344,  0.1701,  0.1747,  0.5853,  0.5039,  0.5747,  0.6096,
         0.6258,  0.5902,  0.3984,  0.4927,  0.6972,  0.6902,  0.2336,
         0.3163,  0.5955,  0.4530,  0.5746,  0.3583,  0.6239,  0.5823,
         0.6467,  0.8138,  0.7512,  0.1473,  0.6777,  0.5129,  0.1492,
         0.5054,  0.5105,  0.6342,  0.6180,  0.3746,  0.4586,  0.3075,
         0.3067,  0.4761,  0.6102,  0.4969,  0.3511,  0.6376,  0.1419,
         0.1157,  0.3706,  0.4806,  0.6126,  0.5752,  0.6795,  0.6609,
         0.6161,  0.6256,  0.6552,  0.6351,  0.8120,  0.2753,  0.5392,
         0.2719,  0.3546,  0.1664,  0.8375,  0.1838,  0.5549,  0.7818,
         0.3462,  0.5745,  0.8336,  0.7168,  0.5021,  0.1605,  0.6797,
         0.5681,  0.5803,  0.7857,  0.7374,  0.4871,  0.6302,  0.6416,
         0.5304,  0.4550,  0.2625,  0.1725,  0.7941,  0.4936,  0.5147,
         0.3925,  0.3990,  0.6218,  0.4560,  0.1147,  0.7137,  0.1884,
         0.2694,  0.7233,  0.4036,  0.3539,  0.6696,  0.6500,  0.7905,
         0.5086,  0.6166,  0.5662,  0.7142,  0.5686,  0.5629,  0.6284,
         0.7600,  0.6798,  0.7505,  0.6301,  0.7361,  0.6233,  0.6143,
         0.6117,  0.8119,  0.6032,  0.3294,  0.2353,  0.6255,  0.4864,
         0.6804,  0.4615,  0.5142,  0.7335,  0.6124,  0.1976,  0.6711,
         0.1494,  0.6745,  0.6566,  0.6501,  0.8525,  0.6106,  0.6746,
         0.5470,  0.3963,  0.4402,  0.6300,  0.4686,  0.6399,  0.7524,
         0.4727,  0.6407,  0.3018,  0.6660,  0.6296,  0.2456,  0.5287,
         0.5672,  0.8742,  0.5318,  0.4933,  0.5034,  0.4440,  0.3154,
         0.3997,  0.7647,  0.8606,  0.6456,  0.1840,  0.3325,  0.3820,
         0.7214,  0.7150,  0.1500,  0.3541,  0.4177,  0.7736,  0.8154,
         0.5072,  0.5412,  0.6612,  0.6408,  0.7013,  0.4462,  0.7983,
         0.6480,  0.5510,  0.3346,  0.4124,  0.6035,  0.5232,  0.6636,
         0.6109,  0.5673,  0.3568,  0.6382,  0.2823,  0.5793,  0.7691,
         0.6264,  0.6276,  0.2484,  0.3638,  0.3295,  0.2824,  0.3672,
         0.2231,  0.5662,  0.2502,  0.4330,  0.6409,  0.4946,  0.5879,
         0.4875,  0.7036,  0.3317,  0.2026,  0.4373,  0.3636,  0.8148,
         0.4543,  0.5204,  0.7122,  0.8106,  0.3563,  0.4555,  0.6841,
         0.4123,  0.7503,  0.4455,  0.2639,  0.5885,  0.6308,  0.7701,
         0.6243,  0.5725,  0.4513,  0.7629,  0.4169,  0.5095,  0.4551,
         0.4982,  0.1985,  0.5402,  0.4971,  0.6428,  0.5295,  0.2887,
         0.6677,  0.3943,  0.6182,  0.4452,  0.1365,  0.7067,  0.5667,
         0.7239,  0.7847,  0.5117,  0.7213,  0.4124,  0.4760,  0.4490,
         0.7325,  0.4385,  0.7042,  0.5781,  0.1221,  0.7320,  0.4629,
         0.3098,  0.1916,  0.5465,  0.6266,  0.7849,  0.3956,  0.5158,
         0.8001,  0.6002,  0.1605,  0.6023,  0.3811,  0.5445,  0.7045,
         0.9188,  0.5735,  0.4491,  0.2943,  0.6271,  0.2166,  0.4098,
         0.5585,  0.6137,  0.2074,  0.5345,  0.2925,  0.6764,  0.4801,
         0.6515,  0.4259,  0.7969,  0.5085,  0.3498,  0.6891,  0.5347,
         0.3254,  0.7623,  0.8211,  0.3935,  0.7235,  0.4896,  0.5246,
         0.6343,  0.1969,  0.7180,  0.6273,  0.2254,  0.5022,  0.7641,
         0.4741,  0.4079,  0.5165,  0.6751,  0.6305,  0.6202,  0.5946,
         0.7151,  0.5127,  0.7235,  0.5486,  0.5607,  0.2736,  0.6134,
         0.7186,  0.4380,  0.3982,  0.5674,  0.7182,  0.6362,  0.2542,
         0.6414,  0.5255,  0.7644,  0.7093,  0.5736,  0.6079,  0.6852,
         0.7877,  0.1709,  0.4196,  0.7960,  0.6525,  0.7818,  0.7844,
         0.7354,  0.7294,  0.6163,  0.2907,  0.6275,  0.6795,  0.4663,
         0.4598,  0.2387,  0.6922,  0.5350,  0.4009,  0.9286,  0.6527,
         0.4749,  0.5523,  0.2571,  0.5107,  0.5573,  0.6640,  0.5406,
         0.3965,  0.6098,  0.4906,  0.4256,  0.5373,  0.5843,  0.3468,
         0.5940], device='cuda:0')
tensor(0.6451, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3509,  0.7731,  0.5392,  0.6800,  0.5947,  0.3999,  0.7599,
         0.3039,  0.7163,  0.4176,  0.5478,  0.6055,  0.3549,  0.5385,
         0.6414,  0.7016,  0.7503,  0.7541,  0.7206,  0.6295,  0.6507,
         0.4246,  0.3979,  0.7647,  0.6787,  0.6183,  0.6647,  0.5474,
         0.4101,  0.5688,  0.4375,  0.4727,  0.2542,  0.3799,  0.6613,
         0.3451,  0.4227,  0.6420,  0.5756,  0.1644,  0.7961,  0.3486,
         0.4598,  0.3865,  0.6517,  0.6277,  0.5448,  0.6847,  0.6241,
         0.6655,  0.4300,  0.6523,  0.5952,  0.6203,  0.4850,  0.3523,
         0.6898,  0.6890,  0.4079,  0.7409,  0.4327,  0.3774,  0.5542,
         0.4205,  0.6012,  0.3769,  0.6727,  0.6420,  0.5790,  0.3022,
         0.7906,  0.3323,  0.4334,  0.3356,  0.7075,  0.4976,  0.5293,
         0.2624,  0.5530,  0.4383,  0.6639,  0.6874,  0.1427,  0.7632,
         0.6264,  0.6020,  0.6829,  0.5458,  0.7456,  0.7286,  0.3636,
         0.7601,  0.1915,  0.5148,  0.7409,  0.2681,  0.7194,  0.5010,
         0.6240,  0.6454,  0.3407,  0.5578,  0.5750,  0.6200,  0.3240,
         0.6290,  0.3050,  0.3791,  0.6020,  0.6011,  0.7417,  0.5789,
         0.7287,  0.4316,  0.5906,  0.8023,  0.2283,  0.4336,  0.5039,
         0.6223,  0.3248,  0.2984,  0.5062,  0.4297,  0.6750,  0.4441,
         0.3283,  0.5947,  0.4584,  0.6025,  0.4716,  0.2761,  0.8026,
         0.6231,  0.5175,  0.6367,  0.6059,  0.3371,  0.5688,  0.2769,
         0.6094,  0.5609,  0.6429,  0.7351,  0.7499,  0.6077,  0.2949,
         0.5208,  0.5264,  0.7604,  0.6123,  0.8184,  0.3974,  0.5977,
         0.4594,  0.5369,  0.3817,  0.3693,  0.6291,  0.5227,  0.5732,
         0.5502,  0.5704,  0.4597,  0.6354,  0.4729,  0.6248,  0.5237,
         0.5733,  0.6279,  0.6209,  0.6480,  0.5295,  0.4719,  0.3130,
         0.8163,  0.5121,  0.3958,  0.6887,  0.3781,  0.5239,  0.6223,
         0.2145,  0.6431,  0.6638,  0.5112,  0.2311,  0.6787,  0.6717,
         0.8677,  0.8043,  0.5242,  0.2432,  0.6934,  0.3414,  0.4911,
         0.7008,  0.4949,  0.5460,  0.7373,  0.5611,  0.5312,  0.7596,
         0.5376,  0.8850,  0.6437,  0.7288,  0.4815,  0.3216,  0.6259,
         0.5759,  0.1924,  0.7989,  0.6631,  0.5897,  0.7352,  0.1762,
         0.8577,  0.6019,  0.4799,  0.2360,  0.4737,  0.4337,  0.4711,
         0.4961,  0.7641,  0.5663,  0.5446,  0.6401,  0.9546,  0.2951,
         0.2566,  0.4959,  0.2558,  0.5255,  0.7347,  0.6594,  0.4472,
         0.5380,  0.7189,  0.5904,  0.4342,  0.5732,  0.6407,  0.5278,
         0.3709,  0.6585,  0.7000,  0.4275,  0.4354,  0.4676,  0.6760,
         0.4186,  0.3654,  0.7578,  0.3182,  0.6734,  0.3408,  0.6319,
         0.7361,  0.6658,  0.4890,  0.5555,  0.6561,  0.6279,  0.2934,
         0.3916,  0.6693,  0.4960,  0.3603,  0.7140,  0.4491,  0.3229,
         0.7399,  0.6160,  0.5805,  0.5761,  0.2395,  0.3550,  0.5436,
         0.6741,  0.3599,  0.7387,  0.7527,  0.6000,  0.5092,  0.5962,
         0.7180,  0.3342,  0.4052,  0.7183,  0.6548,  0.5583,  0.6375,
         0.3209,  0.5282,  0.5512,  0.7414,  0.5494,  0.6253,  0.6483,
         0.3742,  0.5763,  0.4013,  0.5717,  0.2864,  0.4747,  0.5359,
         0.4773,  0.7000,  0.4541,  0.5124,  0.7244,  0.4910,  0.4770,
         0.5763,  0.6116,  0.6919,  0.5103,  0.3402,  0.6154,  0.5021,
         0.6047,  0.6923,  0.6031,  0.6441,  0.7081,  0.7092,  0.4525,
         0.4854,  0.8993,  0.6480,  0.4384,  0.8664,  0.4063,  0.5813,
         0.5834,  0.7000,  0.6818,  0.5904,  0.3644,  0.7830,  0.5283,
         0.7002,  0.4355,  0.5386,  0.8974,  0.4878,  0.6700,  0.3287,
         0.4705,  0.2071,  0.4791,  0.6779,  0.5434,  0.6563,  0.3144,
         0.4414,  0.5017,  0.3953,  0.7693,  0.6488,  0.2991,  0.4263,
         0.4431,  0.6503,  0.6470,  0.6369,  0.6158,  0.6420,  0.3855,
         0.7113,  0.5463,  0.3347,  0.1532,  0.4452,  0.5570,  0.6580,
         0.7593,  0.5993,  0.6983,  0.3358,  0.4056,  0.6424,  0.4888,
         0.7990,  0.4850,  0.5063,  0.5917,  0.3273,  0.5524,  0.5953,
         0.6716,  0.6140,  0.4789,  0.6629,  0.4750,  0.8507,  0.5147,
         0.6030,  0.6250,  0.7404,  0.5639,  0.6703,  0.5241,  0.4138,
         0.7285,  0.3887,  0.4073,  0.6296,  0.5795,  0.4936,  0.5478,
         0.8002,  0.5950,  0.5513,  0.3627,  0.3682,  0.6031,  0.7262,
         0.6228,  0.4711,  0.2768,  0.5854,  0.7293,  0.6400,  0.6482,
         0.7107,  0.6636,  0.2414,  0.8793,  0.6407,  0.5342,  0.4631,
         0.3127,  0.5183,  0.7258,  0.4415,  0.7325,  0.5534,  0.5821,
         0.5094,  0.7106,  0.4519,  0.3721,  0.3690,  0.4812,  0.6411,
         0.4090,  0.4355,  0.2231,  0.2845,  0.5038,  0.5041,  0.4823,
         0.5696,  0.7614,  0.7126,  0.7078,  0.6485,  0.6985,  0.3617,
         0.5936,  0.6129,  0.8285,  0.4174,  0.3663,  0.6364,  0.6080,
         0.6325,  0.2720,  0.4049,  0.5074,  0.3471,  0.4606,  0.5797,
         0.6650,  0.8441,  0.5521,  0.3234,  0.4692,  0.6436,  0.6063,
         0.4260,  0.6136,  0.7256,  0.7908,  0.4876,  0.4050,  0.5547,
         0.7930,  0.5318,  0.5019,  0.3896,  0.7464,  0.2345,  0.5148,
         0.6936,  0.7535,  0.6826,  0.4712,  0.6984,  0.3011,  0.3578,
         0.2894,  0.8016,  0.6042,  0.4312,  0.7128,  0.6740,  0.5582,
         0.6805], device='cuda:0')
tensor(0.6087, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4868,  0.4150,  0.5354,  0.5720,  0.7303,  0.7913,  0.5849,
         0.6160,  0.5836,  0.6064,  0.7187,  0.6445,  0.7387,  0.7459,
         0.6267,  0.5391,  0.7256,  0.4284,  0.3536,  0.3111,  0.3389,
         0.4845,  0.6524,  0.5556,  0.2365,  0.4632,  0.3009,  0.5306,
         0.6909,  0.7291,  0.4364,  0.7211,  0.8145,  0.4999,  0.5448,
         0.7242,  0.6927,  0.6370,  0.4198,  0.4863,  0.2923,  0.8250,
         0.7697,  0.3662,  0.5918,  0.6056,  0.6166,  0.7155,  0.8970,
         0.4124,  0.6958,  0.5876,  0.7068,  0.6887,  0.4374,  0.6230,
         0.4274,  0.4798,  0.5747,  0.5561,  0.7546,  0.4050,  0.3873,
         0.3645,  0.5263,  0.4933,  0.5889,  0.6067,  0.4547,  0.3511,
         0.6148,  0.5264,  0.3685,  0.3391,  0.4483,  0.6386,  0.4254,
         0.7036,  0.6128,  0.3464,  0.4678,  0.5689,  0.7516,  0.4403,
         0.8407,  0.6190,  0.5287,  0.5739,  0.5822,  0.7731,  0.4265,
         0.3661,  0.5221,  0.7407,  0.4553,  0.3351,  0.5043,  0.4966,
         0.5953,  0.3849,  0.5229,  0.7303,  0.6940,  0.7125,  0.6885,
         0.2757,  0.7019,  0.5692,  0.4368,  0.5289,  0.6872,  0.5720,
         0.6373,  0.3321,  0.5014,  0.4109,  0.4589,  0.8595,  0.6369,
         0.1622,  0.5465,  0.5503,  0.7272,  0.5529,  0.7072,  0.3553,
         0.5233,  0.7311,  0.6362,  0.6063,  0.9033,  0.7024,  0.5893,
         0.7859,  0.6909,  0.4472,  0.6799,  0.4798,  0.8009,  0.5042,
         0.4905,  0.4295,  0.6461,  0.3854,  0.6683,  0.3272,  0.5323,
         0.7571,  0.3140,  0.4351,  0.6169,  0.7646,  0.7073,  0.5483,
         0.5614,  0.5682,  0.5788,  0.5430,  0.7659,  0.6222,  0.9250,
         0.7835,  0.2815,  0.4596,  0.6300,  0.5281,  0.7442,  0.5938,
         0.2107,  0.3188,  0.4638,  0.5366,  0.5089,  0.4442,  0.3309,
         0.4842,  0.3682,  0.2958,  0.7648,  0.6470,  0.3471,  0.5848,
         0.5604,  0.6074,  0.6886,  0.7542,  0.7643,  0.6619,  0.4889,
         0.3375,  0.6518,  0.5946,  0.6542,  0.6995,  0.4973,  0.5958,
         0.3672,  0.6734,  0.4872,  0.6146,  0.4683,  0.6076,  0.3389,
         0.3669,  0.4936,  0.5765,  0.5403,  0.6409,  0.6403,  0.5655,
         0.6735,  0.3906,  0.5426,  0.5160,  0.7230,  0.5761,  0.5243,
         0.3675,  0.5083,  0.3923,  0.5430,  0.3795,  0.3077,  0.4667,
         0.4334,  0.7614,  0.3806,  0.5752,  0.6164,  0.7134,  0.5769,
         0.4878,  0.4867,  0.5429,  0.7116,  0.5324,  0.5334,  0.7099,
         0.6309,  0.5873,  0.5698,  0.2947,  0.7153,  0.7022,  0.5848,
         0.3290,  0.6039,  0.3620,  0.6401,  0.5560,  0.6478,  0.8313,
         0.6157,  0.7238,  0.4621,  0.4516,  0.5440,  0.4761,  0.4460,
         0.5940,  0.5625,  0.5567,  0.5661,  0.5699,  0.7088,  0.6759,
         0.4405,  0.6276,  0.5008,  0.6975,  0.5472,  0.5185,  0.2344,
         0.3377,  0.5908,  0.5997,  0.3643,  0.4290,  0.5234,  0.2277,
         0.6010,  0.7553,  0.1841,  0.5642,  0.4527,  0.4773,  0.5203,
         0.6560,  0.4510,  0.6121,  0.6564,  0.8739,  0.4692,  0.6238,
         0.5753,  0.6268,  0.6850,  0.6998,  0.7910,  0.3551,  0.4354,
         0.5825,  0.7407,  0.2606,  0.4147,  0.5907,  0.5377,  0.4626,
         0.5632,  0.7545,  0.6093,  0.4640,  0.4728,  0.4851,  0.5896,
         0.6932,  0.5297,  0.7332,  0.4077,  0.8469,  0.6780,  0.5522,
         0.6946,  0.5162,  0.7277,  0.5918,  0.6930,  0.6009,  0.4642,
         0.7267,  0.5336,  0.4271,  0.6671,  0.4544,  0.4593,  0.5156,
         0.5180,  0.5498,  0.3421,  0.7281,  0.5689,  0.5405,  0.5905,
         0.6384,  0.4035,  0.7012,  0.5154,  0.6810,  0.5868,  0.6087,
         0.5750,  0.5621,  0.6827,  0.8317,  0.3642,  0.6021,  0.6304,
         0.6734,  0.5238,  0.4295,  0.7557,  0.4747,  0.6469,  0.4155,
         0.5525,  0.7254,  0.6551,  0.5805,  0.4639,  0.3257,  0.6740,
         0.6555,  0.7162,  0.6335,  0.7436,  0.5986,  0.5669,  0.5875,
         0.6754,  0.6739,  0.6227,  0.5301,  0.4837,  0.4386,  0.3290,
         0.2060,  0.6853,  0.5159,  0.2455,  0.5130,  0.5558,  0.6748,
         0.5841,  0.5632,  0.6737,  0.6829,  0.7127,  0.5345,  0.5297,
         0.3769,  0.6281,  0.7326,  0.6574,  0.4706,  0.6256,  0.3315,
         0.6087,  0.3601,  0.5179,  0.8164,  0.4635,  0.4218,  0.4388,
         0.4550,  0.4353,  0.4870,  0.3368,  0.3124,  0.8076,  0.5349,
         0.5832,  0.7342,  0.6875,  0.3339,  0.5996,  0.2628,  0.7076,
         0.5980,  0.7585,  0.3895,  0.5706,  0.4622,  0.7164,  0.3390,
         0.5349,  0.5121,  0.6417,  0.4120,  0.3663,  0.6548,  0.6890,
         0.5617,  0.5432,  0.8047,  0.9143,  0.6111,  0.6284,  0.3348,
         0.6843,  0.5624,  0.6864,  0.4350,  0.5755,  0.5818,  0.6760,
         0.7860,  0.7943,  0.6612,  0.5223,  0.7595,  0.2280,  0.4879,
         0.4922,  0.4034,  0.4319,  0.7406,  0.6662,  0.3539,  0.6642,
         0.5579,  0.4563,  0.7348,  0.6983,  0.4233,  0.2248,  0.5142,
         0.4415,  0.9116,  0.5754,  0.4855,  0.7153,  0.6253,  0.6584,
         0.3656,  0.6950,  0.7603,  0.5850,  0.6620,  0.9189,  0.5466,
         0.5819,  0.7950,  0.8217,  0.3157,  0.5661,  0.3869,  0.5675,
         0.2810,  0.5429,  0.4196,  0.5917,  0.5530,  0.5648,  0.6860,
         0.7845,  0.5597,  0.6204,  0.4389,  0.6569,  0.6832,  0.4991,
         0.2725], device='cuda:0')
tensor(0.6264, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4033,  0.7163,  0.4623,  0.5386,  0.4906,  0.4338,  0.3663,
         0.4381,  0.3670,  0.3667,  0.5937,  0.4430,  0.5887,  0.4748,
         0.7849,  0.5232,  0.7124,  0.3503,  0.7813,  0.6581,  0.6301,
         0.4295,  0.6672,  0.6417,  0.5434,  0.5723,  0.9165,  0.5073,
         0.5011,  0.6742,  0.5551,  0.7057,  0.6447,  0.7630,  0.7417,
         0.5872,  0.5164,  0.6839,  0.4051,  0.4712,  0.4839,  0.3324,
         0.5851,  0.6109,  0.7219,  0.4929,  0.5926,  0.4307,  0.5271,
         0.4148,  0.6141,  0.6655,  0.7273,  0.6007,  0.7933,  0.4194,
         0.5958,  0.5695,  0.8876,  0.5380,  0.8157,  0.4956,  0.5740,
         0.4416,  0.6667,  0.7866,  0.6001,  0.7547,  0.5767,  0.4013,
         0.4853,  0.5632,  0.7812,  0.7710,  0.5461,  0.5466,  0.6501,
         0.7237,  0.5689,  0.5684,  0.2766,  0.4345,  0.4878,  0.5348,
         0.4998,  0.6467,  0.6801,  0.3775,  0.6481,  0.5147,  0.5185,
         0.5704,  0.4693,  0.4223,  0.5834,  0.6414,  0.5961,  0.3669,
         0.6000,  0.6157,  0.4478,  0.6193,  0.5697,  0.9170,  0.5727,
         0.5184,  0.4797,  0.6581,  0.6726,  0.4854,  0.4658,  0.7238,
         0.5710,  0.5949,  0.5331,  0.6740,  0.4918,  0.6980,  0.6357,
         0.3246,  0.4428,  0.7551,  0.4941,  0.5915,  0.7144,  0.4774,
         0.8297,  0.4703,  0.5700,  0.6411,  0.7300,  0.6156,  0.6485,
         0.4281,  0.4566,  0.6961,  0.5053,  0.4333,  0.4711,  0.3786,
         0.7272,  0.6623,  0.4195,  0.3465,  0.6150,  0.4741,  0.5112,
         0.2986,  0.7927,  0.3981,  0.5124,  0.5890,  0.5883,  0.5371,
         0.7123,  0.7509,  0.4343,  0.5689,  0.6234,  0.3414,  0.3980,
         0.4920,  0.6222,  0.3909,  0.5448,  0.6646,  0.4825,  0.5963,
         0.5551,  0.5787,  0.5029,  0.7032,  0.4971,  0.5338,  0.4957,
         0.7416,  0.6803,  0.7201,  0.4444,  0.6625,  0.6038,  0.7600,
         0.4999,  0.4959,  0.6000,  0.6731,  0.3242,  0.6138,  0.6549,
         0.5997,  0.5881,  0.3311,  0.5766,  0.3601,  0.5070,  0.6475,
         0.5550,  0.4080,  0.6791,  0.5800,  0.5344,  0.6207,  0.6466,
         0.4509,  0.6404,  0.7002,  0.5026,  0.6183,  0.7865,  0.5700,
         0.7407,  0.2836,  0.4174,  0.6596,  0.5977,  0.5196,  0.5030,
         0.6081,  0.6298,  0.6198,  0.6372,  0.6104,  0.5930,  0.6016,
         0.5315,  0.6371,  0.3647,  0.5508,  0.4049,  0.2335,  0.7133,
         0.6008,  0.2789,  0.6108,  0.6768,  0.6810,  0.6172,  0.3060,
         0.6565,  0.5686,  0.5605,  0.6339,  0.5975,  0.6366,  0.5392,
         0.6419,  0.6666,  0.6547,  0.5995,  0.5850,  0.8587,  0.5592,
         0.6514,  0.8021,  0.5857,  0.3737,  0.8579,  0.5761,  0.2660,
         0.7001,  0.2674,  0.5049,  0.8782,  0.4191,  0.7210,  0.5008,
         0.6139,  0.6495,  0.7478,  0.6208,  0.5508,  0.3854,  0.6791,
         0.7905,  0.6524,  0.5531,  0.6620,  0.6423,  0.3463,  0.6220,
         0.6433,  0.5773,  0.5864,  0.4959,  0.6796,  0.6196,  0.7371,
         0.7864,  0.3037,  0.6306,  0.5473,  0.6823,  0.7224,  0.5508,
         0.7651,  0.6511,  0.8148,  0.6517,  0.6974,  0.5662,  0.6546,
         0.7686,  0.7311,  0.7097,  0.4422,  0.4679,  0.5664,  0.7070,
         0.4473,  0.4710,  0.5854,  0.3872,  0.3867,  0.6558,  0.6701,
         0.6192,  0.5491,  0.4529,  0.5138,  0.5961,  0.4764,  0.6408,
         0.4782,  0.6575,  0.5296,  0.4595,  0.5628,  0.6168,  0.6287,
         0.5953,  0.6557,  0.4284,  0.4545,  0.6450,  0.7254,  0.7828,
         0.5926,  0.4565,  0.8395,  0.5811,  0.4070,  0.6102,  0.4732,
         0.4889,  0.7291,  0.7636,  0.3655,  0.4328,  0.5065,  0.4808,
         0.5924,  0.6781,  0.7079,  0.6217,  0.5771,  0.4540,  0.7026,
         0.5660,  0.1650,  0.4661,  0.4157,  0.5980,  0.6131,  0.5518,
         0.5033,  0.3316,  0.4326,  0.6018,  0.4823,  0.7318,  0.5665,
         0.5346,  0.6280,  0.6465,  0.6917,  0.7082,  0.8373,  0.6909,
         0.3326,  0.3706,  0.6911,  0.3392,  0.6765,  0.5981,  0.3988,
         0.6659,  0.5618,  0.4722,  0.7655,  0.5473,  0.2429,  0.4462,
         0.6623,  0.6224,  0.5118,  0.6567,  0.6920,  0.4844,  0.6940,
         0.5853,  0.7584,  0.8492,  0.5552,  0.6105,  0.7641,  0.5824,
         0.6340,  0.7541,  0.5040,  0.5444,  0.5800,  0.5887,  0.9072,
         0.6542,  0.4033,  0.5387,  0.6346,  0.5761,  0.7602,  0.6542,
         0.2810,  0.6819,  0.6712,  0.6029,  0.6287,  0.2749,  0.6418,
         0.5636,  0.4758,  0.5711,  0.2791,  0.6653,  0.4153,  0.8814,
         0.7043,  0.6390,  0.5150,  0.6837,  0.5327,  0.6588,  0.3468,
         0.7746,  0.4962,  0.4105,  0.6300,  0.5837,  0.7800,  0.4356,
         0.5895,  0.6918,  0.5579,  0.6220,  0.7620,  0.6470,  0.5502,
         0.7015,  0.5699,  0.7759,  0.5078,  0.4114,  0.7439,  0.4335,
         0.2512,  0.3894,  0.5443,  0.5204,  0.7262,  0.5926,  0.3730,
         0.5996,  0.3622,  0.5333,  0.6555,  0.7073,  0.5876,  0.7195,
         0.6632,  0.3736,  0.4383,  0.4677,  0.6394,  0.5357,  0.3419,
         0.8069,  0.7788,  0.4969,  0.5241,  0.7524,  0.4932,  0.3840,
         0.6483,  0.6846,  0.8160,  0.5673,  0.6429,  0.7497,  0.2941,
         0.6925,  0.4879,  0.5420,  0.6254,  0.6087,  0.6696,  0.6777,
         0.7314,  0.6096,  0.5349,  0.7134,  0.6084,  0.5758,  0.2880,
         0.6593], device='cuda:0')
tensor(0.6573, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5906,  0.3968,  0.4176,  0.2533,  0.4294,  0.5314,  0.4073,
         0.4063,  0.4636,  0.5203,  0.6367,  0.8407,  0.3969,  0.6455,
         0.5162,  0.4706,  0.6891,  0.3977,  0.7474,  0.5617,  0.5163,
         0.6692,  0.6039,  0.6545,  0.3777,  0.5878,  0.4180,  0.4831,
         0.3888,  0.6726,  0.4352,  0.7441,  0.6403,  0.6197,  0.4097,
         0.5488,  0.6529,  0.6131,  0.4249,  0.6556,  0.7684,  0.7082,
         0.6872,  0.5861,  0.3013,  0.5540,  0.7207,  0.8143,  0.5504,
         0.6730,  0.5292,  0.7566,  0.6078,  0.4794,  0.5939,  0.4934,
         0.7268,  0.5245,  0.6904,  0.7461,  0.4156,  0.4991,  0.5656,
         0.5111,  0.5257,  0.7246,  0.3567,  0.6764,  0.8092,  0.4258,
         0.6200,  0.6862,  0.6650,  0.6436,  0.6238,  0.5376,  0.5460,
         0.5363,  0.5168,  0.7968,  0.7914,  0.5500,  0.5317,  0.6705,
         0.5844,  0.4168,  0.2501,  0.5305,  0.7065,  0.3397,  0.7107,
         0.3368,  0.8088,  0.5701,  0.6049,  0.5960,  0.6105,  0.2481,
         0.5213,  0.4523,  0.6951,  0.6795,  0.6644,  0.6624,  0.4971,
         0.5579,  0.3689,  0.5710,  0.6394,  0.6585,  0.7522,  0.6859,
         0.6271,  0.6552,  0.6926,  0.5370,  0.7143,  0.5968,  0.4561,
         0.6221,  0.5376,  0.5948,  0.6040,  0.7717,  0.4107,  0.6160,
         0.6954,  0.6521,  0.4610,  0.5777,  0.5651,  0.7783,  0.7707,
         0.5400,  0.5463,  0.4825,  0.5648,  0.4280,  0.6481,  0.5952,
         0.6120,  0.4721,  0.3569,  0.6990,  0.6350,  0.5252,  0.5123,
         0.4995,  0.5269,  0.6110,  0.4820,  0.4378,  0.3194,  0.7386,
         0.5903,  0.9008,  0.2028,  0.4046,  0.4259,  0.5078,  0.6677,
         0.5392,  0.5707,  0.6937,  0.3751,  0.6472,  0.3730,  0.5883,
         0.4765,  0.5710,  0.4995,  0.5879,  0.5353,  0.5480,  0.5627,
         0.6650,  0.4887,  0.4807,  0.5287,  0.3071,  0.5414,  0.4859,
         0.4899,  0.5294,  0.6408,  0.5024,  0.6166,  0.6659,  0.5801,
         0.3646,  0.7411,  0.6722,  0.5999,  0.3042,  0.5977,  0.4442,
         0.6450,  0.4030,  0.5193,  0.3589,  0.6441,  0.7518,  0.3829,
         0.6625,  0.6919,  0.4713,  0.4754,  0.6661,  0.7807,  0.7141,
         0.5773,  0.3712,  0.5730,  0.5396,  0.5866,  0.4168,  0.5448,
         0.2787,  0.5051,  0.6058,  0.4876,  0.3488,  0.5319,  0.5636,
         0.6474,  0.5267,  0.4921,  0.6640,  0.6883,  0.5678,  0.6461,
         0.5893,  0.6898,  0.6956,  0.3703,  0.3941,  0.5874,  0.5814,
         0.4022,  0.5425,  0.5767,  0.4450,  0.5462,  0.6011,  0.5331,
         0.7316,  0.8896,  0.6275,  0.4941,  0.4343,  0.4457,  0.7228,
         0.5224,  0.5309,  0.6676,  0.5787,  0.6614,  0.6254,  0.6262,
         0.4495,  0.5604,  0.5523,  0.5736,  0.5280,  0.5369,  0.5634,
         0.6441,  0.4540,  0.5122,  0.5365,  0.6646,  0.4535,  0.7372,
         0.7022,  0.4656,  0.7574,  0.5291,  0.5155,  0.5322,  0.4519,
         0.5144,  0.4518,  0.7867,  0.6372,  0.6224,  0.2585,  0.6770,
         0.4799,  0.5504,  0.5179,  0.4746,  0.5294,  0.6087,  0.5432,
         0.8091,  0.6216,  0.6005,  0.6396,  0.5192,  0.6008,  0.4912,
         0.4827,  0.6410,  0.6134,  0.7637,  0.4704,  0.6864,  0.7320,
         0.3932,  0.5101,  0.5830,  0.7690,  0.5190,  0.6889,  0.2695,
         0.6509,  0.6401,  0.5234,  0.5248,  0.4995,  0.6732,  0.6493,
         0.5349,  0.4461,  0.5775,  0.2547,  0.2825,  0.4628,  0.5984,
         0.4910,  0.4568,  0.5169,  0.6804,  0.8921,  0.4234,  0.5823,
         0.2725,  0.5267,  0.3203,  0.4744,  0.4523,  0.4987,  0.3587,
         0.5941,  0.5776,  0.5173,  0.6580,  0.6271,  0.5568,  0.5944,
         0.5510,  0.6002,  0.7780,  0.7127,  0.5098,  0.5698,  0.3700,
         0.4877,  0.5634,  0.4482,  0.7561,  0.4334,  0.7978,  0.2032,
         0.6527,  0.6677,  0.5525,  0.5588,  0.6712,  0.6592,  0.6006,
         0.6184,  0.6523,  0.5967,  0.6127,  0.5731,  0.7491,  0.5279,
         0.5731,  0.6829,  0.3009,  0.5500,  0.8040,  0.8621,  0.3953,
         0.6494,  0.6098,  0.6556,  0.5839,  0.4366,  0.4938,  0.8458,
         0.8027,  0.5074,  0.7073,  0.6647,  0.4542,  0.5378,  0.5639,
         0.6532,  0.5045,  0.4662,  0.6517,  0.2617,  0.3414,  0.6310,
         0.5112,  0.5040,  0.7792,  0.5862,  0.6643,  0.7632,  0.7372,
         0.5938,  0.5556,  0.8873,  0.5253,  0.7146,  0.7252,  0.4540,
         0.6656,  0.4248,  0.3561,  0.6094,  0.2596,  0.5904,  0.7715,
         0.5469,  0.5426,  0.7094,  0.5344,  0.5360,  0.5759,  0.5199,
         0.6166,  0.4294,  0.6094,  0.4387,  0.5333,  0.3580,  0.4821,
         0.3283,  0.7373,  0.4827,  0.8146,  0.4809,  0.5387,  0.5880,
         0.7552,  0.5335,  0.4079,  0.7802,  0.7735,  0.6029,  0.5963,
         0.5940,  0.5550,  0.6283,  0.5226,  0.4937,  0.6193,  0.3420,
         0.6088,  0.8013,  0.4170,  0.6308,  0.5452,  0.2598,  0.5957,
         0.7319,  0.5326,  0.5984,  0.6958,  0.6173,  0.8693,  0.5224,
         0.4352,  0.5447,  0.3455,  0.6223,  0.2257,  0.6258,  0.7129,
         0.6371,  0.4537,  0.6165,  0.6735,  0.5220,  0.7275,  0.4600,
         0.4087,  0.4464,  0.6752,  0.4596,  0.4987,  0.6513,  0.7472,
         0.4320,  0.6863,  0.6968,  0.3958,  0.6543,  0.7224,  0.4133,
         0.5188,  0.6955,  0.5606,  0.6971,  0.6959,  0.7370,  0.4796,
         0.4441], device='cuda:0')
tensor(0.6384, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5634,  0.4892,  0.5773,  0.3786,  0.2841,  0.6337,  0.2825,
         0.6636,  0.3428,  0.5256,  0.4021,  0.4768,  0.6544,  0.7298,
         0.4380,  0.4234,  0.5530,  0.6289,  0.6079,  0.6439,  0.6793,
         0.6031,  0.6734,  0.6656,  0.3234,  0.5526,  0.3697,  0.5244,
         0.6102,  0.5565,  0.4380,  0.5653,  0.4130,  0.3720,  0.6174,
         0.5875,  0.5399,  0.5706,  0.7307,  0.6123,  0.5507,  0.5536,
         0.4658,  0.3113,  0.4004,  0.4582,  0.3031,  0.5446,  0.6937,
         0.4684,  0.6857,  0.4634,  0.4370,  0.4631,  0.8568,  0.6343,
         0.4915,  0.2918,  0.6514,  0.4898,  0.7248,  0.5918,  0.6100,
         0.5017,  0.5830,  0.3576,  0.5289,  0.3005,  0.5964,  0.4018,
         0.7087,  0.3827,  0.4267,  0.4135,  0.5651,  0.5040,  0.2802,
         0.5393,  0.5861,  0.6366,  0.3012,  0.7428,  0.4892,  0.5398,
         0.5915,  0.4440,  0.5032,  0.4325,  0.4650,  0.4325,  0.3321,
         0.6532,  0.6179,  0.4214,  0.5440,  0.3125,  0.5442,  0.3930,
         0.5573,  0.4091,  0.4957,  0.5646,  0.5720,  0.6289,  0.6271,
         0.2979,  0.3716,  0.4617,  0.5156,  0.4938,  0.5545,  0.8130,
         0.8913,  0.6622,  0.5339,  0.5568,  0.6704,  0.4995,  0.6207,
         0.5675,  0.3623,  0.4959,  0.6401,  0.6324,  0.3192,  0.5948,
         0.4249,  0.6785,  0.5915,  0.5277,  0.5047,  0.6536,  0.4889,
         0.4461,  0.6418,  0.6119,  0.6470,  0.4535,  0.4161,  0.4981,
         0.6634,  0.5051,  0.2584,  0.5954,  0.4683,  0.7985,  0.4456,
         0.3868,  0.8058,  0.4521,  0.7249,  0.4135,  0.4953,  0.5415,
         0.7197,  0.9146,  0.7397,  0.3661,  0.8065,  0.4067,  0.5089,
         0.4994,  0.4526,  0.5451,  0.4230,  0.4813,  0.4566,  0.5014,
         0.5036,  0.7102,  0.4888,  0.5953,  0.5463,  0.5681,  0.5485,
         0.4778,  0.5732,  0.5010,  0.6047,  0.3129,  0.5114,  0.5478,
         0.7363,  0.4675,  0.5903,  0.4038,  0.7245,  0.6985,  0.6788,
         0.4160,  0.3534,  0.7869,  0.6717,  0.4567,  0.8093,  0.3634,
         0.3623,  0.6594,  0.3901,  0.5419,  0.6902,  0.3891,  0.6101,
         0.4840,  0.3598,  0.5460,  0.5215,  0.3321,  0.7131,  0.3937,
         0.2664,  0.5889,  0.3423,  0.4490,  0.6079,  0.5826,  0.6365,
         0.6752,  0.6346,  0.5043,  0.6930,  0.5426,  0.5917,  0.4728,
         0.5018,  0.3065,  0.8964,  0.6758,  0.5707,  0.6726,  0.7020,
         0.4425,  0.6658,  0.5528,  0.6955,  0.5622,  0.6073,  0.5735,
         0.6122,  0.7009,  0.2247,  0.5249,  0.5249,  0.8333,  0.4787,
         0.5768,  0.4679,  0.7514,  0.5623,  0.6037,  0.3518,  0.8569,
         0.5583,  0.4661,  0.4934,  0.6483,  0.6673,  0.4574,  0.5246,
         0.5374,  0.7376,  0.8112,  0.3975,  0.5195,  0.5817,  0.5380,
         0.7681,  0.4548,  0.4494,  0.4577,  0.6304,  0.6104,  0.7076,
         0.6717,  0.4367,  0.5981,  0.4155,  0.5893,  0.6536,  0.5958,
         0.7185,  0.4137,  0.4297,  0.8299,  0.6264,  0.5005,  0.5747,
         0.5609,  0.6785,  0.3322,  0.5280,  0.5243,  0.4967,  0.2869,
         0.5606,  0.5708,  0.6139,  0.6705,  0.5766,  0.6296,  0.3532,
         0.6387,  0.6293,  0.5941,  0.5809,  0.3879,  0.6585,  0.6837,
         0.4096,  0.6667,  0.5792,  0.4895,  0.5193,  0.6618,  0.3593,
         0.5107,  0.6089,  0.8069,  0.5488,  0.4718,  0.5977,  0.3522,
         0.3034,  0.6772,  0.6736,  0.4661,  0.4867,  0.7608,  0.7916,
         0.6674,  0.6197,  0.6779,  0.6544,  0.6261,  0.6569,  0.5844,
         0.5922,  0.5983,  0.4553,  0.8735,  0.5155,  0.4616,  0.4791,
         0.3917,  0.7647,  0.3655,  0.6097,  0.6789,  0.6110,  0.6274,
         0.5674,  0.4537,  0.6369,  0.3837,  0.4536,  0.3052,  0.5284,
         0.6065,  0.5774,  0.4115,  0.4065,  0.7134,  0.7113,  0.6048,
         0.5213,  0.6237,  0.4190,  0.6515,  0.5788,  0.5968,  0.4826,
         0.4843,  0.4618,  0.5611,  0.8654,  0.5067,  0.6307,  0.6901,
         0.6695,  0.6698,  0.2909,  0.5171,  0.6763,  0.2928,  0.6209,
         0.7670,  0.5041,  0.6680,  0.7802,  0.4776,  0.4280,  0.4131,
         0.4894,  0.5516,  0.4835,  0.6189,  0.7429,  0.6812,  0.5040,
         0.5684,  0.7597,  0.6731,  0.6542,  0.5712,  0.4861,  0.5626,
         0.4545,  0.4327,  0.6620,  0.7300,  0.7157,  0.7651,  0.4437,
         0.4638,  0.7806,  0.6120,  0.6329,  0.4773,  0.7403,  0.6363,
         0.3226,  0.6573,  0.6399,  0.6448,  0.8434,  0.3290,  0.5495,
         0.3153,  0.2077,  0.4732,  0.5473,  0.4767,  0.7962,  0.4920,
         0.4681,  0.6234,  0.4862,  0.5487,  0.6489,  0.5740,  0.4602,
         0.3775,  0.6854,  0.6206,  0.6305,  0.5612,  0.6682,  0.7139,
         0.6535,  0.6646,  0.6367,  0.4153,  0.5216,  0.6691,  0.2712,
         0.3390,  0.6472,  0.6624,  0.3703,  0.6896,  0.5575,  0.2403,
         0.5676,  0.4409,  0.7392,  0.5630,  0.2909,  0.5135,  0.5550,
         0.4815,  0.4331,  0.4617,  0.6223,  0.5066,  0.4645,  0.4599,
         0.4897,  0.6532,  0.4357,  0.5942,  0.4692,  0.6299,  0.5756,
         0.9225,  0.5674,  0.8136,  0.6136,  0.4344,  0.3588,  0.5523,
         0.4339,  0.6889,  0.5834,  0.7025,  0.4642,  0.5921,  0.3111,
         0.3858,  0.4103,  0.5934,  0.3759,  0.3386,  0.6283,  0.6133,
         0.5679,  0.7389,  0.4396,  0.4950,  0.3175,  0.5839,  0.3572,
         0.4604], device='cuda:0')
tensor(0.6326, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5754,  0.4156,  0.6966,  0.8312,  0.3894,  0.3271,  0.4321,
         0.5191,  0.7782,  0.4634,  0.5515,  0.5723,  0.3038,  0.5919,
         0.6213,  0.6124,  0.6205,  0.9300,  0.4457,  0.5042,  0.6174,
         0.4575,  0.4136,  0.4713,  0.5442,  0.3471,  0.4527,  0.4570,
         0.5017,  0.3734,  0.4296,  0.5726,  0.5492,  0.5987,  0.4292,
         0.7925,  0.5187,  0.5034,  0.6614,  0.3457,  0.6272,  0.5259,
         0.4592,  0.5618,  0.4674,  0.6808,  0.7730,  0.4874,  0.7104,
         0.6029,  0.4486,  0.7193,  0.3886,  0.4457,  0.3748,  0.6030,
         0.7114,  0.4903,  0.6303,  0.3487,  0.3427,  0.6718,  0.5716,
         0.5228,  0.6778,  0.5246,  0.5863,  0.4704,  0.4758,  0.4060,
         0.5208,  0.6818,  0.5324,  0.5064,  0.4833,  0.5603,  0.6279,
         0.3894,  0.6790,  0.5093,  0.6815,  0.5170,  0.6590,  0.5149,
         0.3366,  0.4991,  0.6160,  0.4660,  0.4107,  0.4589,  0.6919,
         0.5916,  0.5914,  0.3855,  0.4315,  0.5115,  0.4949,  0.6603,
         0.4677,  0.7576,  0.5451,  0.5554,  0.4812,  0.3577,  0.4835,
         0.3077,  0.3856,  0.7489,  0.2429,  0.4335,  0.4729,  0.4411,
         0.5331,  0.2973,  0.7277,  0.4946,  0.6135,  0.4392,  0.3940,
         0.7653,  0.5667,  0.6267,  0.6396,  0.4507,  0.6195,  0.4290,
         0.5613,  0.3295,  0.7973,  0.6255,  0.5822,  0.4612,  0.5200,
         0.4294,  0.4759,  0.4663,  0.6287,  0.5494,  0.7396,  0.3317,
         0.4971,  0.4508,  0.7223,  0.6585,  0.7925,  0.4830,  0.6290,
         0.6324,  0.5131,  0.4331,  0.8015,  0.6575,  0.5312,  0.5992,
         0.5950,  0.3535,  0.3954,  0.5280,  0.7827,  0.2975,  0.5873,
         0.5061,  0.4010,  0.5207,  0.4851,  0.4841,  0.5775,  0.6850,
         0.5777,  0.7246,  0.5647,  0.6743,  0.7128,  0.4055,  0.6875,
         0.6331,  0.7658,  0.5830,  0.5776,  0.3599,  0.5991,  0.5229,
         0.6061,  0.5468,  0.5508,  0.6784,  0.5535,  0.3138,  0.5211,
         0.2834,  0.8199,  0.5972,  0.7473,  0.7587,  0.3659,  0.5808,
         0.6439,  0.6603,  0.4450,  0.6245,  0.4299,  0.7394,  0.3192,
         0.4309,  0.4994,  0.5301,  0.5691,  0.6728,  0.4981,  0.4486,
         0.6234,  0.4344,  0.5757,  0.5644,  0.5121,  0.3183,  0.4986,
         0.6309,  0.5073,  0.5446,  0.7020,  0.3396,  0.3866,  0.6115,
         0.3879,  0.6174,  0.7234,  0.8427,  0.6200,  0.6296,  0.6376,
         0.4636,  0.5783,  0.2355,  0.5704,  0.4611,  0.4638,  0.5126,
         0.3792,  0.4996,  0.7007,  0.5966,  0.6999,  0.5148,  0.6062,
         0.6020,  0.5456,  0.6479,  0.6773,  0.6638,  0.5925,  0.4069,
         0.4598,  0.5316,  0.3353,  0.5694,  0.3264,  0.5038,  0.2903,
         0.6819,  0.4816,  0.6138,  0.5757,  0.5086,  0.5979,  0.4288,
         0.5133,  0.4899,  0.3469,  0.6731,  0.6826,  0.3428,  0.4586,
         0.7014,  0.5017,  0.4773,  0.6076,  0.4349,  0.6512,  0.1613,
         0.7446,  0.6673,  0.4231,  0.4970,  0.5558,  0.5054,  0.3122,
         0.6414,  0.4369,  0.4218,  0.7061,  0.6540,  0.5799,  0.5251,
         0.5283,  0.6190,  0.5725,  0.4246,  0.5137,  0.7087,  0.7572,
         0.8293,  0.4362,  0.5694,  0.5756,  0.2811,  0.4320,  0.4999,
         0.6283,  0.6142,  0.5419,  0.6409,  0.4892,  0.4828,  0.5780,
         0.5364,  0.3779,  0.4261,  0.8746,  0.4866,  0.5860,  0.4925,
         0.7238,  0.5873,  0.6561,  0.5498,  0.3047,  0.3031,  0.3732,
         0.4332,  0.6570,  0.6926,  0.6366,  0.6836,  0.7011,  0.5318,
         0.4705,  0.5931,  0.6621,  0.5995,  0.6218,  0.5855,  0.4999,
         0.5674,  0.4681,  0.3701,  0.5277,  0.5748,  0.6681,  0.5517,
         0.4206,  0.6600,  0.6621,  0.6063,  0.4539,  0.7852,  0.8952,
         0.4986,  0.5109,  0.4281,  0.4909,  0.3361,  0.4517,  0.6812,
         0.3580,  0.8081,  0.5197,  0.5341,  0.4280,  0.5436,  0.4754,
         0.5823,  0.5839,  0.5764,  0.4767,  0.6854,  0.4566,  0.6782,
         0.5034,  0.2949,  0.3008,  0.5792,  0.5296,  0.5798,  0.7191,
         0.6864,  0.7779,  0.3243,  0.5738,  0.4557,  0.3450,  0.4723,
         0.4969,  0.5359,  0.3624,  0.6195,  0.6956,  0.5988,  0.6517,
         0.5266,  0.5096,  0.3303,  0.6999,  0.5465,  0.7846,  0.4982,
         0.5320,  0.6107,  0.6423,  0.6015,  0.5996,  0.6466,  0.4786,
         0.6358,  0.6663,  0.5725,  0.4395,  0.5824,  0.4830,  0.5274,
         0.6555,  0.3867,  0.3336,  0.5321,  0.6668,  0.3544,  0.4858,
         0.5700,  0.8350,  0.5014,  0.5226,  0.5701,  0.5100,  0.5457,
         0.4648,  0.6634,  0.3862,  0.5962,  0.6533,  0.3266,  0.7318,
         0.5308,  0.5234,  0.5121,  0.6457,  0.6191,  0.4797,  0.6386,
         0.6613,  0.7107,  0.7716,  0.3073,  0.4879,  0.3728,  0.5665,
         0.7523,  0.6338,  0.6608,  0.5624,  0.6413,  0.6744,  0.6874,
         0.3922,  0.4458,  0.5620,  0.4477,  0.9455,  0.5864,  0.6760,
         0.3726,  0.6795,  0.4696,  0.5604,  0.5017,  0.4705,  0.5083,
         0.7739,  0.3850,  0.3876,  0.5068,  0.3450,  0.4480,  0.5816,
         0.2826,  0.4752,  0.3386,  0.7418,  0.2739,  0.4179,  0.5474,
         0.6411,  0.4656,  0.4521,  0.7933,  0.6617,  0.4790,  0.5395,
         0.4789,  0.7523,  0.4121,  0.4804,  0.4207,  0.6348,  0.3520,
         0.4335,  0.7727,  0.6771,  0.7048,  0.5977,  0.7583,  0.5356,
         0.5939], device='cuda:0')
tensor(0.6275, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6562,  0.6106,  0.6372,  0.4428,  0.4169,  0.5229,  0.6700,
         0.5722,  0.7632,  0.4940,  0.3704,  0.7742,  0.3956,  0.6196,
         0.4988,  0.6881,  0.5992,  0.5832,  0.3613,  0.3882,  0.5663,
         0.4658,  0.6363,  0.3949,  0.4622,  0.4890,  0.3382,  0.4967,
         0.3800,  0.3550,  0.3900,  0.4820,  0.5920,  0.6509,  0.4693,
         0.7540,  0.7664,  0.6301,  0.7742,  0.4579,  0.6728,  0.5284,
         0.5992,  0.6827,  0.6296,  0.5209,  0.4972,  0.5145,  0.6125,
         0.5856,  0.5755,  0.6934,  0.5590,  0.6303,  0.6701,  0.4600,
         0.6233,  0.4792,  0.5097,  0.7286,  0.3166,  0.4450,  0.4717,
         0.5264,  0.4155,  0.4701,  0.7761,  0.3582,  0.4303,  0.5364,
         0.6307,  0.4552,  0.3638,  0.5295,  0.6699,  0.6548,  0.6391,
         0.4949,  0.7499,  0.5673,  0.4701,  0.5025,  0.5951,  0.5516,
         0.5357,  0.4895,  0.5624,  0.3050,  0.6507,  0.6634,  0.6971,
         0.4845,  0.6865,  0.3633,  0.6530,  0.4964,  0.4351,  0.4893,
         0.5441,  0.7106,  0.4272,  0.5074,  0.6585,  0.3590,  0.4041,
         0.3513,  0.1690,  0.4296,  0.6648,  0.4447,  0.6626,  0.5990,
         0.3609,  0.5854,  0.5261,  0.6392,  0.6659,  0.4833,  0.5775,
         0.6495,  0.3595,  0.5896,  0.4581,  0.5151,  0.4650,  0.5237,
         0.5967,  0.5253,  0.5989,  0.6339,  0.4876,  0.8060,  0.5902,
         0.4492,  0.6354,  0.4710,  0.5436,  0.5881,  0.6993,  0.4325,
         0.4605,  0.3220,  0.8153,  0.6730,  0.6092,  0.6738,  0.4088,
         0.4870,  0.4880,  0.6877,  0.5097,  0.3888,  0.4970,  0.9041,
         0.5730,  0.6002,  0.6163,  0.6657,  0.3933,  0.7618,  0.6865,
         0.6928,  0.4387,  0.3933,  0.8425,  0.4093,  0.5934,  0.4617,
         0.5061,  0.7269,  0.4144,  0.7200,  0.6213,  0.5944,  0.8247,
         0.7149,  0.5462,  0.6444,  0.5766,  0.3587,  0.6237,  0.5908,
         0.6353,  0.3800,  0.5284,  0.3721,  0.5721,  0.5814,  0.6070,
         0.5593,  0.4517,  0.4835,  0.6153,  0.4839,  0.3345,  0.3190,
         0.6277,  0.6000,  0.3624,  0.4514,  0.8122,  0.4703,  0.5201,
         0.5135,  0.4302,  0.6953,  0.6159,  0.6025,  0.5326,  0.4495,
         0.4710,  0.5538,  0.7712,  0.4839,  0.5651,  0.8055,  0.5695,
         0.3888,  0.5696,  0.3845,  0.6121,  0.3658,  0.4474,  0.5482,
         0.5879,  0.3948,  0.6241,  0.4562,  0.4382,  0.6079,  0.4979,
         0.5770,  0.4772,  0.3463,  0.5919,  0.4489,  0.3992,  0.4445,
         0.4741,  0.7503,  0.6737,  0.4411,  0.7594,  0.5725,  0.4789,
         0.6943,  0.2782,  0.5572,  0.5929,  0.5264,  0.3232,  0.4563,
         0.7233,  0.5024,  0.5283,  0.5939,  0.5569,  0.3549,  0.5401,
         0.6512,  0.5421,  0.3978,  0.7646,  0.4948,  0.8013,  0.5672,
         0.5732,  0.4305,  0.5210,  0.6787,  0.4023,  0.5341,  0.5698,
         0.2473,  0.6184,  0.4304,  0.6746,  0.4037,  0.5062,  0.6370,
         0.7474,  0.6832,  0.6786,  0.5395,  0.6873,  0.5800,  0.6865,
         0.5545,  0.4490,  0.2432,  0.4962,  0.5031,  0.3260,  0.4157,
         0.7531,  0.7400,  0.6601,  0.4116,  0.9068,  0.5046,  0.5040,
         0.5967,  0.6477,  0.7406,  0.3159,  0.6349,  0.5039,  0.6846,
         0.5941,  0.6707,  0.5605,  0.7475,  0.6207,  0.4647,  0.4856,
         0.4798,  0.7363,  0.5043,  0.2365,  0.6407,  0.6304,  0.3689,
         0.4040,  0.5798,  0.6530,  0.5933,  0.5915,  0.7302,  0.3487,
         0.6123,  0.6178,  0.6566,  0.4186,  0.5308,  0.4021,  0.6210,
         0.5991,  0.3028,  0.4409,  0.5506,  0.4609,  0.6682,  0.5979,
         0.5680,  0.4197,  0.6366,  0.5147,  0.7406,  0.4801,  0.5787,
         0.3938,  0.5684,  0.6833,  0.7274,  0.3322,  0.5668,  0.4960,
         0.6135,  0.6793,  0.3772,  0.5541,  0.7851,  0.6210,  0.4827,
         0.5545,  0.5578,  0.3763,  0.5045,  0.6772,  0.5050,  0.5708,
         0.4434,  0.4254,  0.5488,  0.7414,  0.4873,  0.3320,  0.6580,
         0.2852,  0.2318,  0.5391,  0.6559,  0.5842,  0.5855,  0.3921,
         0.5081,  0.5921,  0.4660,  0.6075,  0.6096,  0.5536,  0.5895,
         0.5671,  0.3483,  0.6450,  0.9268,  0.5392,  0.5031,  0.6938,
         0.7089,  0.4299,  0.4952,  0.2081,  0.5073,  0.4809,  0.5245,
         0.6990,  0.3264,  0.4982,  0.6993,  0.3862,  0.6344,  0.5275,
         0.4659,  0.4635,  0.5487,  0.6570,  0.3634,  0.5762,  0.3559,
         0.6361,  0.3349,  0.3264,  0.7545,  0.5368,  0.5300,  0.4605,
         0.4965,  0.3964,  0.5240,  0.4636,  0.4257,  0.4517,  0.5375,
         0.4995,  0.5641,  0.7522,  0.5931,  0.6690,  0.4036,  0.6617,
         0.5894,  0.4430,  0.5199,  0.6867,  0.6071,  0.4142,  0.5743,
         0.3439,  0.5799,  0.4983,  0.4902,  0.3714,  0.5110,  0.6229,
         0.3272,  0.3724,  0.3751,  0.5684,  0.6466,  0.5190,  0.5769,
         0.7186,  0.5939,  0.7787,  0.7118,  0.4058,  0.5804,  0.5163,
         0.5253,  0.7563,  0.6413,  0.6183,  0.4428,  0.7864,  0.4931,
         0.5197,  0.4580,  0.4934,  0.3538,  0.4909,  0.4590,  0.7334,
         0.5468,  0.6270,  0.2991,  0.5393,  0.5405,  0.5008,  0.5483,
         0.5036,  0.5433,  0.4235,  0.5324,  0.5259,  0.5849,  0.4389,
         0.7730,  0.3964,  0.3319,  0.7313,  0.7265,  0.4849,  0.4618,
         0.4070,  0.6893,  0.6137,  0.3352,  0.3677,  0.6586,  0.4513,
         0.7867], device='cuda:0')
tensor(0.6296, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5137,  0.6771,  0.5071,  0.5197,  0.5119,  0.3700,  0.4655,
         0.7127,  0.3068,  0.2705,  0.6266,  0.3289,  0.7335,  0.5634,
         0.3609,  0.4511,  0.4866,  0.5143,  0.4628,  0.3596,  0.4895,
         0.4139,  0.6074,  0.5052,  0.5861,  0.6755,  0.5395,  0.6835,
         0.6179,  0.6379,  0.5560,  0.6972,  0.3832,  0.4511,  0.6513,
         0.3887,  0.4415,  0.5498,  0.3376,  0.4544,  0.5500,  0.5956,
         0.5069,  0.5096,  0.4378,  0.2416,  0.6753,  0.5116,  0.5641,
         0.5678,  0.2895,  0.7076,  0.6461,  0.4827,  0.4956,  0.6415,
         0.4816,  0.6590,  0.7375,  0.5246,  0.6246,  0.6662,  0.5572,
         0.5406,  0.5670,  0.7697,  0.3313,  0.5091,  0.7002,  0.5598,
         0.5090,  0.6764,  0.4198,  0.3954,  0.3829,  0.6011,  0.5130,
         0.3570,  0.5884,  0.3726,  0.4517,  0.6556,  0.5688,  0.5700,
         0.3467,  0.5262,  0.5576,  0.4839,  0.4173,  0.5989,  0.7528,
         0.4889,  0.5911,  0.5112,  0.6629,  0.3649,  0.5096,  0.2185,
         0.4024,  0.4297,  0.6644,  0.6106,  0.3866,  0.5873,  0.5262,
         0.4734,  0.6227,  0.7668,  0.5588,  0.3252,  0.5665,  0.8067,
         0.4234,  0.6531,  0.6081,  0.6574,  0.4730,  0.4842,  0.5733,
         0.6439,  0.7607,  0.5726,  0.5922,  0.4878,  0.4679,  0.3801,
         0.6081,  0.7249,  0.5428,  0.3820,  0.6109,  0.4339,  0.4640,
         0.4034,  0.8003,  0.4831,  0.5005,  0.1441,  0.5671,  0.3774,
         0.5287,  0.4353,  0.5187,  0.5509,  0.4379,  0.5809,  0.5906,
         0.7856,  0.6364,  0.7003,  0.5297,  0.5513,  0.7434,  0.6557,
         0.5283,  0.3499,  0.5958,  0.3877,  0.5271,  0.4736,  0.5924,
         0.4435,  0.6009,  0.3119,  0.6055,  0.3260,  0.6132,  0.4817,
         0.3619,  0.4010,  0.2735,  0.5591,  0.7250,  0.6470,  0.5192,
         0.4312,  0.3127,  0.6222,  0.4517,  0.5328,  0.4151,  0.6203,
         0.4222,  0.4321,  0.7378,  0.4898,  0.4865,  0.6145,  0.8544,
         0.6842,  0.3882,  0.6282,  0.4689,  0.4420,  0.3603,  0.6842,
         0.4702,  0.4780,  0.4955,  0.4171,  0.4677,  0.6184,  0.4901,
         0.6587,  0.5077,  0.4607,  0.5994,  0.6885,  0.7072,  0.5858,
         0.3021,  0.4099,  0.7543,  0.6299,  0.4545,  0.3492,  0.5154,
         0.6225,  0.7817,  0.2039,  0.7386,  0.5464,  0.5848,  0.4617,
         0.4456,  0.6851,  0.4913,  0.6216,  0.6014,  0.5621,  0.3820,
         0.6225,  0.7370,  0.5870,  0.3985,  0.4998,  0.4419,  0.7375,
         0.3728,  0.7356,  0.4672,  0.2491,  0.4049,  0.7174,  0.5164,
         0.7281,  0.5021,  0.3292,  0.4378,  0.2464,  0.4519,  0.4949,
         0.3970,  0.5045,  0.5443,  0.4256,  0.6382,  0.5521,  0.4712,
         0.6696,  0.3739,  0.6171,  0.4674,  0.6426,  0.5655,  0.5842,
         0.4457,  0.6849,  0.8853,  0.6048,  0.5171,  0.4249,  0.7487,
         0.5615,  0.7276,  0.6366,  0.7071,  0.5162,  0.4010,  0.4169,
         0.3997,  0.5586,  0.4980,  0.4158,  0.7381,  0.4059,  0.4083,
         0.6509,  0.3653,  0.5399,  0.5249,  0.6593,  0.6744,  0.5143,
         0.5429,  0.6382,  0.3560,  0.4402,  0.5042,  0.3409,  0.4219,
         0.4695,  0.5459,  0.4836,  0.2886,  0.4125,  0.4136,  0.3997,
         0.4645,  0.4375,  0.5770,  0.4726,  0.6242,  0.4647,  0.3556,
         0.7082,  0.7148,  0.6952,  0.2350,  0.5637,  0.4937,  0.7709,
         0.6345,  0.6962,  0.4459,  0.5853,  0.4639,  0.4519,  0.3463,
         0.6593,  0.4968,  0.6000,  0.7402,  0.7053,  0.5021,  0.2762,
         0.7310,  0.5019,  0.4971,  0.5733,  0.4175,  0.6362,  0.4401,
         0.4823,  0.6726,  0.5498,  0.5578,  0.5367,  0.4434,  0.5731,
         0.4691,  0.4406,  0.5953,  0.4238,  0.7077,  0.4538,  0.6531,
         0.6492,  0.4662,  0.6376,  0.3735,  0.6620,  0.4606,  0.4864,
         0.3581,  0.5439,  0.7832,  0.4892,  0.7889,  0.4881,  0.8236,
         0.4732,  0.6937,  0.3908,  0.7540,  0.3549,  0.4021,  0.5427,
         0.5605,  0.6535,  0.6818,  0.5636,  0.7500,  0.4527,  0.3062,
         0.5498,  0.5477,  0.6738,  0.5942,  0.7620,  0.4362,  0.4098,
         0.6162,  0.3969,  0.5415,  0.7378,  0.7313,  0.7056,  0.3129,
         0.5671,  0.4887,  0.6836,  0.7103,  0.7763,  0.4519,  0.5189,
         0.7380,  0.6360,  0.2949,  0.6268,  0.6272,  0.5459,  0.5657,
         0.5814,  0.7080,  0.6419,  0.5689,  0.4989,  0.6029,  0.5424,
         0.4810,  0.4960,  0.2786,  0.3272,  0.4115,  0.6195,  0.5723,
         0.7478,  0.5703,  0.4068,  0.3747,  0.4220,  0.2433,  0.6418,
         0.4063,  0.6212,  0.5198,  0.4066,  0.5302,  0.5844,  0.5279,
         0.5411,  0.5584,  0.4765,  0.4263,  0.4776,  0.5676,  0.5485,
         0.8380,  0.5670,  0.6127,  0.5640,  0.3106,  0.5865,  0.5486,
         0.3484,  0.6508,  0.4960,  0.6499,  0.6816,  0.4392,  0.5028,
         0.5029,  0.6694,  0.2651,  0.3048,  0.5819,  0.5172,  0.6303,
         0.5147,  0.5308,  0.8306,  0.5957,  0.4695,  0.3248,  0.4479,
         0.4795,  0.3448,  0.4267,  0.5771,  0.3739,  0.4147,  0.5755,
         0.5707,  0.6439,  0.5092,  0.7086,  0.5684,  0.3066,  0.3642,
         0.4768,  0.6657,  0.6753,  0.5250,  0.3791,  0.6649,  0.5703,
         0.5197,  0.5849,  0.3109,  0.5978,  0.4444,  0.5882,  0.7504,
         0.5190,  0.5977,  0.5957,  0.5284,  0.3706,  0.7946,  0.6400,
         0.3174], device='cuda:0')
tensor(0.6138, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5210,  0.6109,  0.6176,  0.5555,  0.4310,  0.6831,  0.6927,
         0.6260,  0.5322,  0.4362,  0.3839,  0.3144,  0.7644,  0.5848,
         0.4950,  0.5828,  0.3285,  0.2903,  0.5852,  0.4843,  0.5411,
         0.5768,  0.4144,  0.2551,  0.6383,  0.5914,  0.6987,  0.4861,
         0.3624,  0.4940,  0.6458,  0.5706,  0.5588,  0.4643,  0.3554,
         0.7622,  0.4082,  0.4304,  0.4459,  0.3919,  0.4729,  0.4184,
         0.6469,  0.4640,  0.6302,  0.3669,  0.5001,  0.3006,  0.5715,
         0.6540,  0.6559,  0.5744,  0.2871,  0.3867,  0.7365,  0.6830,
         0.5203,  0.7098,  0.3797,  0.6193,  0.7362,  0.4291,  0.6957,
         0.5533,  0.5645,  0.4341,  0.2050,  0.5332,  0.2610,  0.5684,
         0.2849,  0.4649,  0.7881,  0.4703,  0.4996,  0.3313,  0.4397,
         0.5665,  0.8474,  0.6000,  0.5769,  0.3516,  0.6032,  0.6122,
         0.5545,  0.4487,  0.5870,  0.7331,  0.6146,  0.4393,  0.5767,
         0.4606,  0.6469,  0.4618,  0.5221,  0.3065,  0.5588,  0.5450,
         0.5161,  0.5045,  0.4865,  0.5752,  0.5147,  0.5083,  0.5597,
         0.4969,  0.4697,  0.5782,  0.6534,  0.6515,  0.4012,  0.3343,
         0.4954,  0.3870,  0.5661,  0.6969,  0.2123,  0.4632,  0.4460,
         0.4160,  0.5111,  0.4644,  0.2963,  0.6129,  0.5737,  0.6651,
         0.2969,  0.4287,  0.4589,  0.5409,  0.6576,  0.7736,  0.7418,
         0.5677,  0.4489,  0.4515,  0.6643,  0.7876,  0.7468,  0.4015,
         0.5995,  0.6600,  0.7540,  0.5271,  0.5254,  0.4897,  0.4863,
         0.4116,  0.6412,  0.5230,  0.4703,  0.5951,  0.5501,  0.3538,
         0.6142,  0.5067,  0.4267,  0.4668,  0.6651,  0.3355,  0.6773,
         0.5917,  0.5402,  0.4954,  0.7160,  0.3124,  0.7572,  0.4097,
         0.6517,  0.4634,  0.6107,  0.2857,  0.5649,  0.7269,  0.4775,
         0.4590,  0.7196,  0.8398,  0.4247,  0.5503,  0.5926,  0.5300,
         0.7025,  0.6181,  0.5083,  0.6814,  0.5807,  0.6441,  0.5658,
         0.5205,  0.4461,  0.6349,  0.6612,  0.3403,  0.5175,  0.5779,
         0.6422,  0.6015,  0.4880,  0.3282,  0.5287,  0.3552,  0.4809,
         0.4197,  0.8402,  0.4378,  0.7178,  0.6349,  0.3378,  0.3647,
         0.4523,  0.4638,  0.6809,  0.5659,  0.7743,  0.5496,  0.6149,
         0.5824,  0.5197,  0.3689,  0.6484,  0.5919,  0.4399,  0.5907,
         0.3811,  0.6351,  0.6453,  0.3776,  0.2656,  0.5490,  0.4737,
         0.4357,  0.5369,  0.3832,  0.6926,  0.3651,  0.4183,  0.4741,
         0.4148,  0.5702,  0.5930,  0.4354,  0.7578,  0.4940,  0.6501,
         0.7137,  0.2818,  0.5269,  0.5918,  0.5393,  0.7156,  0.5044,
         0.4633,  0.3669,  0.6396,  0.3943,  0.6404,  0.7080,  0.5127,
         0.5363,  0.5639,  0.6520,  0.3494,  0.5709,  0.3956,  0.3254,
         0.3310,  0.5022,  0.5356,  0.5464,  0.7199,  0.4518,  0.8058,
         0.5283,  0.6524,  0.6181,  0.5553,  0.6715,  0.5121,  0.5461,
         0.7676,  0.7300,  0.7488,  0.4572,  0.5724,  0.6036,  0.5190,
         0.5390,  0.4502,  0.5203,  0.4176,  0.7927,  0.4495,  0.7721,
         0.5806,  0.6834,  0.7105,  0.6969,  0.3806,  0.6168,  0.5098,
         0.4154,  0.7310,  0.6500,  0.3984,  0.5056,  0.4752,  0.5557,
         0.5741,  0.4623,  0.5246,  0.4267,  0.4236,  0.6404,  0.4410,
         0.5385,  0.4367,  0.7055,  0.2812,  0.5575,  0.7310,  0.5163,
         0.6252,  0.5242,  0.4028,  0.6513,  0.6091,  0.7112,  0.4023,
         0.4006,  0.6483,  0.3954,  0.3832,  0.4787,  0.5628,  0.5182,
         0.4658,  0.5993,  0.3278,  0.5108,  0.5566,  0.4581,  0.3698,
         0.5722,  0.3429,  0.4400,  0.4596,  0.6927,  0.3337,  0.5094,
         0.6640,  0.3446,  0.5657,  0.4978,  0.5854,  0.6445,  0.3584,
         0.5421,  0.6444,  0.4297,  0.7050,  0.6862,  0.3958,  0.4884,
         0.4650,  0.6388,  0.6986,  0.5605,  0.7206,  0.4568,  0.5566,
         0.5992,  0.3085,  0.6007,  0.4363,  0.3771,  0.4179,  0.5372,
         0.3262,  0.2379,  0.5529,  0.4668,  0.5591,  0.3207,  0.5292,
         0.6549,  0.3864,  0.4999,  0.4646,  0.5259,  0.3132,  0.4334,
         0.5508,  0.4885,  0.5771,  0.6320,  0.5171,  0.4557,  0.6242,
         0.4741,  0.4713,  0.6888,  0.7090,  0.4491,  0.5094,  0.5547,
         0.6730,  0.5878,  0.5324,  0.5138,  0.6615,  0.6988,  0.6157,
         0.5741,  0.7671,  0.5038,  0.5865,  0.5284,  0.3772,  0.4053,
         0.3357,  0.6161,  0.6597,  0.6745,  0.5333,  0.5462,  0.4240,
         0.7998,  0.4384,  0.6970,  0.2349,  0.2544,  0.5892,  0.4340,
         0.5875,  0.7983,  0.7101,  0.5261,  0.5094,  0.6085,  0.5439,
         0.4382,  0.3588,  0.6657,  0.3100,  0.6094,  0.7152,  0.3420,
         0.5559,  0.3375,  0.4684,  0.4093,  0.6549,  0.3768,  0.2090,
         0.3266,  0.5963,  0.4984,  0.4149,  0.5010,  0.7674,  0.6673,
         0.4520,  0.4396,  0.6314,  0.7995,  0.7107,  0.7405,  0.6879,
         0.4336,  0.4241,  0.5370,  0.4298,  0.4096,  0.5236,  0.5595,
         0.4775,  0.6390,  0.8100,  0.4633,  0.4091,  0.6801,  0.6446,
         0.8931,  0.4035,  0.4802,  0.3882,  0.3564,  0.5616,  0.5397,
         0.4794,  0.7999,  0.4819,  0.6664,  0.4480,  0.7127,  0.4799,
         0.5333,  0.6805,  0.6773,  0.7959,  0.3169,  0.6605,  0.4097,
         0.5842,  0.5026,  0.4457,  0.6393,  0.4663,  0.7214,  0.6097,
         0.6162], device='cuda:0')
tensor(0.6322, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4055,  0.4605,  0.5194,  0.2575,  0.6862,  0.2369,  0.6019,
         0.4175,  0.4890,  0.4773,  0.4249,  0.4659,  0.5369,  0.6834,
         0.5738,  0.4829,  0.4266,  0.5838,  0.6094,  0.6063,  0.7723,
         0.5055,  0.4090,  0.4633,  0.3389,  0.4715,  0.3821,  0.4362,
         0.5071,  0.5719,  0.6554,  0.3505,  0.5732,  0.5037,  0.2741,
         0.5170,  0.5485,  0.3636,  0.6165,  0.6978,  0.4197,  0.2310,
         0.7959,  0.6612,  0.7310,  0.5819,  0.6039,  0.7183,  0.5573,
         0.9090,  0.7685,  0.6512,  0.4978,  0.3374,  0.2464,  0.5939,
         0.5433,  0.7888,  0.4718,  0.5381,  0.5331,  0.5843,  0.2817,
         0.4323,  0.4617,  0.5004,  0.5383,  0.5794,  0.6054,  0.2605,
         0.5753,  0.3642,  0.3952,  0.2477,  0.3726,  0.4293,  0.3873,
         0.6800,  0.5013,  0.5504,  0.4333,  0.5365,  0.3673,  0.3763,
         0.5005,  0.2993,  0.5522,  0.2979,  0.5414,  0.5712,  0.4376,
         0.5201,  0.4715,  0.5262,  0.3772,  0.6705,  0.5168,  0.6164,
         0.5739,  0.4968,  0.3337,  0.5797,  0.4043,  0.4806,  0.4807,
         0.6533,  0.4418,  0.5622,  0.5027,  0.2349,  0.5758,  0.6052,
         0.4547,  0.4418,  0.6371,  0.4848,  0.6323,  0.5890,  0.5855,
         0.4209,  0.7957,  0.6980,  0.4272,  0.5386,  0.4665,  0.6351,
         0.4101,  0.3141,  0.5915,  0.5351,  0.6545,  0.5871,  0.4460,
         0.5321,  0.4748,  0.4560,  0.8494,  0.6558,  0.6810,  0.4201,
         0.5342,  0.5428,  0.3564,  0.4969,  0.6377,  0.5395,  0.4185,
         0.7245,  0.5700,  0.6252,  0.5252,  0.4289,  0.5384,  0.5710,
         0.5665,  0.5591,  0.6393,  0.5041,  0.6091,  0.2150,  0.4871,
         0.5396,  0.7694,  0.4910,  0.3658,  0.4521,  0.1911,  0.3009,
         0.4407,  0.4143,  0.5522,  0.6197,  0.4170,  0.6142,  0.5952,
         0.6033,  0.6736,  0.6783,  0.6990,  0.6852,  0.2955,  0.4439,
         0.5889,  0.3385,  0.7019,  0.3556,  0.6025,  0.2602,  0.6962,
         0.5399,  0.4027,  0.4783,  0.5725,  0.5000,  0.4960,  0.4171,
         0.6620,  0.5739,  0.4661,  0.5048,  0.5049,  0.7140,  0.4322,
         0.5475,  0.6394,  0.8235,  0.5435,  0.5321,  0.5044,  0.5842,
         0.4402,  0.6974,  0.4504,  0.6655,  0.5300,  0.5114,  0.5469,
         0.4856,  0.5262,  0.6457,  0.5868,  0.1973,  0.5534,  0.3611,
         0.4962,  0.6814,  0.6567,  0.7028,  0.4770,  0.3708,  0.3654,
         0.4695,  0.6554,  0.5062,  0.5662,  0.5565,  0.4658,  0.3527,
         0.4616,  0.6346,  0.5327,  0.7498,  0.4525,  0.3525,  0.3854,
         0.3432,  0.5617,  0.2632,  0.4012,  0.4625,  0.7219,  0.6772,
         0.2740,  0.6614,  0.7382,  0.6261,  0.1926,  0.4063,  0.5872,
         0.4718,  0.7078,  0.5766,  0.6475,  0.4605,  0.6308,  0.5378,
         0.4726,  0.7009,  0.6554,  0.6436,  0.4164,  0.6043,  0.6422,
         0.5697,  0.4614,  0.5577,  0.5822,  0.4693,  0.4894,  0.8165,
         0.3413,  0.3763,  0.3445,  0.5839,  0.6250,  0.6563,  0.6425,
         0.5689,  0.6128,  0.3476,  0.3866,  0.4726,  0.5783,  0.5070,
         0.3585,  0.7516,  0.5119,  0.4262,  0.4498,  0.4792,  0.4909,
         0.5130,  0.3868,  0.5869,  0.3539,  0.4389,  0.5493,  0.5090,
         0.5114,  0.5543,  0.4312,  0.3942,  0.6791,  0.5433,  0.5694,
         0.4211,  0.5133,  0.3969,  0.5543,  0.5736,  0.4182,  0.5120,
         0.4020,  0.4233,  0.4041,  0.4991,  0.4417,  0.6059,  0.3919,
         0.4918,  0.3914,  0.4247,  0.4424,  0.4546,  0.3655,  0.6987,
         0.6642,  0.5043,  0.7992,  0.5878,  0.5006,  0.6739,  0.7945,
         0.5190,  0.4731,  0.6205,  0.5357,  0.4621,  0.3843,  0.6270,
         0.4153,  0.5134,  0.4230,  0.5162,  0.2636,  0.3396,  0.3790,
         0.2519,  0.5843,  0.7249,  0.5882,  0.5529,  0.5570,  0.4730,
         0.2768,  0.4703,  0.7393,  0.4682,  0.6560,  0.4493,  0.5420,
         0.4292,  0.5761,  0.3925,  0.6384,  0.4030,  0.6998,  0.5231,
         0.4638,  0.7577,  0.5926,  0.5407,  0.4556,  0.4753,  0.3200,
         0.3309,  0.4952,  0.5704,  0.4968,  0.7725,  0.6818,  0.3144,
         0.4945,  0.4090,  0.6367,  0.4998,  0.4696,  0.3763,  0.5747,
         0.5569,  0.5414,  0.3757,  0.6369,  0.7642,  0.8136,  0.3755,
         0.4809,  0.5907,  0.4674,  0.4323,  0.3127,  0.5053,  0.5397,
         0.6258,  0.6412,  0.6648,  0.8299,  0.7641,  0.4092,  0.8079,
         0.3842,  0.4181,  0.5497,  0.6611,  0.4935,  0.4082,  0.7055,
         0.5932,  0.4733,  0.5939,  0.5920,  0.2000,  0.4911,  0.4828,
         0.3868,  0.8510,  0.6906,  0.6986,  0.5422,  0.4090,  0.7365,
         0.6323,  0.4504,  0.4247,  0.4985,  0.3383,  0.4363,  0.4674,
         0.4563,  0.6459,  0.5631,  0.5956,  0.3721,  0.6937,  0.5381,
         0.5878,  0.4456,  0.5133,  0.4767,  0.4544,  0.5912,  0.7623,
         0.5305,  0.6831,  0.6381,  0.6786,  0.4750,  0.5434,  0.5285,
         0.4562,  0.4423,  0.5545,  0.8088,  0.4522,  0.7022,  0.5035,
         0.5272,  0.4510,  0.8659,  0.7231,  0.4216,  0.4202,  0.4572,
         0.4659,  0.3652,  0.8332,  0.7265,  0.3535,  0.5659,  0.7501,
         0.4446,  0.5167,  0.2166,  0.5142,  0.6331,  0.5531,  0.5272,
         0.5798,  0.5611,  0.3885,  0.5807,  0.3963,  0.4729,  0.5164,
         0.3175,  0.5935,  0.4651,  0.6657,  0.5288,  0.6935,  0.5712,
         0.6054], device='cuda:0')
tensor(0.6170, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4547,  0.7505,  0.3374,  0.4231,  0.6595,  0.6180,  0.3458,
         0.2024,  0.6278,  0.6270,  0.4652,  0.3219,  0.7460,  0.5055,
         0.4139,  0.4344,  0.7384,  0.6303,  0.4322,  0.3607,  0.5590,
         0.7052,  0.4469,  0.5033,  0.5156,  0.4759,  0.5454,  0.7763,
         0.5809,  0.4899,  0.6481,  0.2674,  0.5855,  0.5178,  0.4556,
         0.6997,  0.4681,  0.6015,  0.5978,  0.4370,  0.7478,  0.4247,
         0.3312,  0.5383,  0.5813,  0.3166,  0.4804,  0.5009,  0.3896,
         0.4975,  0.2163,  0.3713,  0.3811,  0.6693,  0.6489,  0.5245,
         0.5651,  0.2997,  0.4288,  0.3302,  0.3948,  0.6381,  0.4968,
         0.4704,  0.4179,  0.6241,  0.3516,  0.5831,  0.3440,  0.3778,
         0.4063,  0.5118,  0.3119,  0.7933,  0.5746,  0.5810,  0.4776,
         0.4751,  0.3794,  0.4416,  0.4495,  0.3229,  0.4048,  0.3865,
         0.4839,  0.4598,  0.7469,  0.5136,  0.3723,  0.3914,  0.7091,
         0.7921,  0.4385,  0.5983,  0.5999,  0.4608,  0.7791,  0.1445,
         0.8131,  0.5643,  0.4568,  0.4476,  0.3471,  0.4213,  0.7115,
         0.7633,  0.3071,  0.4903,  0.6553,  0.5672,  0.7201,  0.4906,
         0.8366,  0.6929,  0.2965,  0.2922,  0.6973,  0.5720,  0.3917,
         0.4701,  0.3165,  0.8829,  0.5246,  0.6591,  0.6335,  0.3906,
         0.5222,  0.6227,  0.6044,  0.4078,  0.6590,  0.4441,  0.8029,
         0.6423,  0.3311,  0.5437,  0.4486,  0.5476,  0.4787,  0.6341,
         0.4928,  0.4534,  0.3432,  0.6238,  0.5914,  0.5497,  0.6312,
         0.8822,  0.4224,  0.3079,  0.4433,  0.5324,  0.5759,  0.5105,
         0.3044,  0.4190,  0.5990,  0.8043,  0.3155,  0.7098,  0.5919,
         0.5515,  0.6268,  0.6367,  0.5526,  0.4542,  0.5404,  0.6308,
         0.4778,  0.5267,  0.7054,  0.5432,  0.3282,  0.8017,  0.3415,
         0.3459,  0.6610,  0.6178,  0.6150,  0.3997,  0.6193,  0.4384,
         0.8313,  0.4240,  0.3601,  0.6339,  0.6928,  0.8255,  0.5754,
         0.7366,  0.5776,  0.3976,  0.5639,  0.7648,  0.5033,  0.5963,
         0.6388,  0.5471,  0.4111,  0.3101,  0.3485,  0.4579,  0.3004,
         0.5235,  0.6823,  0.6918,  0.4707,  0.4882,  0.5835,  0.6047,
         0.4234,  0.6499,  0.5729,  0.4590,  0.5630,  0.4906,  0.3268,
         0.6171,  0.8343,  0.7127,  0.3632,  0.4788,  0.3381,  0.5208,
         0.2462,  0.4599,  0.5791,  0.4578,  0.4021,  0.4165,  0.6564,
         0.6984,  0.6027,  0.5936,  0.4861,  0.5466,  0.4128,  0.8257,
         0.5685,  0.6620,  0.2682,  0.2719,  0.4708,  0.5268,  0.5177,
         0.5581,  0.5405,  0.7102,  0.6047,  0.3402,  0.4706,  0.9007,
         0.4193,  0.8705,  0.7469,  0.5078,  0.4293,  0.6454,  0.5128,
         0.4588,  0.4819,  0.5577,  0.4965,  0.4486,  0.4534,  0.5971,
         0.5440,  0.4501,  0.5420,  0.7359,  0.6809,  0.8564,  0.2724,
         0.6715,  0.5663,  0.6345,  0.6332,  0.3463,  0.5048,  0.4729,
         0.4020,  0.3618,  0.4258,  0.3619,  0.3910,  0.5259,  0.4647,
         0.4053,  0.4919,  0.3906,  0.4971,  0.4489,  0.4538,  0.6077,
         0.5064,  0.5705,  0.5633,  0.6343,  0.6613,  0.5483,  0.5135,
         0.6774,  0.2774,  0.6359,  0.4493,  0.2698,  0.4921,  0.5117,
         0.4415,  0.5262,  0.3555,  0.6621,  0.5096,  0.5676,  0.7081,
         0.5051,  0.6269,  0.4519,  0.3806,  0.1843,  0.6945,  0.6289,
         0.5106,  0.5313,  0.4948,  0.5081,  0.5676,  0.7408,  0.5825,
         0.3999,  0.6796,  0.3355,  0.4986,  0.4325,  0.4774,  0.4148,
         0.5772,  0.3687,  0.4456,  0.5567,  0.5739,  0.4863,  0.7155,
         0.2532,  0.5040,  0.4795,  0.4665,  0.4028,  0.5576,  0.5407,
         0.5652,  0.5586,  0.5194,  0.4488,  0.4995,  0.4775,  0.3833,
         0.4843,  0.5615,  0.3826,  0.8205,  0.4352,  0.6149,  0.6481,
         0.6897,  0.3971,  0.4924,  0.5110,  0.2049,  0.4597,  0.5763,
         0.5921,  0.6463,  0.5253,  0.6170,  0.3834,  0.5382,  0.2837,
         0.4871,  0.6352,  0.2439,  0.3712,  0.6086,  0.6077,  0.4807,
         0.6589,  0.6086,  0.5623,  0.5698,  0.5904,  0.6405,  0.3401,
         0.5305,  0.3565,  0.5423,  0.5888,  0.5558,  0.4258,  0.6108,
         0.6110,  0.5633,  0.5007,  0.5752,  0.3626,  0.6720,  0.2805,
         0.5592,  0.6962,  0.3610,  0.4183,  0.3602,  0.6435,  0.2917,
         0.5956,  0.7204,  0.3518,  0.3893,  0.5265,  0.9236,  0.5040,
         0.5343,  0.4819,  0.6846,  0.5403,  0.5846,  0.7268,  0.7014,
         0.7595,  0.6236,  0.3278,  0.5386,  0.4592,  0.6785,  0.5358,
         0.5836,  0.6500,  0.3183,  0.4993,  0.5461,  0.7011,  0.6449,
         0.7089,  0.5672,  0.4979,  0.3601,  0.5097,  0.5632,  0.4156,
         0.4095,  0.3340,  0.8111,  0.7975,  0.8717,  0.4451,  0.4816,
         0.2678,  0.5174,  0.4003,  0.5007,  0.5003,  0.4590,  0.4561,
         0.5262,  0.4966,  0.4743,  0.2801,  0.3416,  0.7690,  0.6778,
         0.7836,  0.4408,  0.8585,  0.3239,  0.3662,  0.6070,  0.5594,
         0.4595,  0.5229,  0.7020,  0.3464,  0.5820,  0.3650,  0.7493,
         0.2534,  0.2578,  0.3931,  0.4947,  0.6781,  0.3058,  0.4918,
         0.4254,  0.3951,  0.5017,  0.4055,  0.2061,  0.2953,  0.6704,
         0.4037,  0.1880,  0.6109,  0.5605,  0.3399,  0.5911,  0.7493,
         0.6755,  0.2267,  0.3909,  0.6228,  0.5274,  0.3782,  0.5130,
         0.4700], device='cuda:0')
tensor(0.6102, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3912,  0.5863,  0.7370,  0.4041,  0.5656,  0.3881,  0.4262,
         0.3497,  0.3826,  0.3922,  0.5295,  0.5712,  0.5708,  0.5772,
         0.4573,  0.6943,  0.3429,  0.6057,  0.6520,  0.7254,  0.7124,
         0.8834,  0.4181,  0.5421,  0.3322,  0.5161,  0.4478,  0.5269,
         0.5384,  0.6556,  0.5979,  0.6412,  0.4414,  0.5945,  0.4886,
         0.3711,  0.6801,  0.6495,  0.5322,  0.6377,  0.9151,  0.6211,
         0.4496,  0.5985,  0.5136,  0.3780,  0.5968,  0.3186,  0.3879,
         0.3173,  0.5394,  0.3255,  0.3791,  0.3487,  0.3231,  0.5673,
         0.3334,  0.6462,  0.7402,  0.4172,  0.6009,  0.4815,  0.6247,
         0.7206,  0.8279,  0.4521,  0.7017,  0.4956,  0.4059,  0.5965,
         0.6215,  0.8973,  0.4871,  0.7448,  0.4065,  0.4491,  0.4945,
         0.6496,  0.6327,  0.6338,  0.3761,  0.2930,  0.4056,  0.5856,
         0.3168,  0.4684,  0.6630,  0.5857,  0.6252,  0.6554,  0.3739,
         0.3817,  0.6919,  0.4466,  0.4854,  0.7257,  0.4225,  0.7397,
         0.5778,  0.4153,  0.6610,  0.5641,  0.2792,  0.9090,  0.4991,
         0.5996,  0.5283,  0.5301,  0.2542,  0.6976,  0.3912,  0.5279,
         0.4047,  0.3241,  0.9362,  0.5996,  0.8096,  0.4688,  0.4255,
         0.3156,  0.3699,  0.4474,  0.7958,  0.4848,  0.6421,  0.6256,
         0.4070,  0.2735,  0.4370,  0.6295,  0.6567,  0.2430,  0.6631,
         0.3268,  0.4639,  0.3028,  0.4329,  0.5247,  0.6812,  0.5321,
         0.4927,  0.5804,  0.3358,  0.8246,  0.5264,  0.4259,  0.4212,
         0.6622,  0.4820,  0.5312,  0.5032,  0.5939,  0.4836,  0.4540,
         0.3486,  0.6337,  0.6182,  0.2352,  0.6061,  0.5209,  0.3465,
         0.5284,  0.4234,  0.6001,  0.5000,  0.6371,  0.6967,  0.5296,
         0.4610,  0.4724,  0.5653,  0.6714,  0.5206,  0.3153,  0.5249,
         0.5515,  0.7367,  0.2017,  0.2836,  0.3802,  0.4665,  0.4348,
         0.4612,  0.4116,  0.8370,  0.6627,  0.7536,  0.5938,  0.6214,
         0.7005,  0.7599,  0.4375,  0.3653,  0.5131,  0.5671,  0.6092,
         0.7888,  0.4804,  0.7005,  0.6286,  0.5991,  0.5371,  0.4647,
         0.7938,  0.4997,  0.8312,  0.5103,  0.6167,  0.3283,  0.7276,
         0.3175,  0.3619,  0.4867,  0.6041,  0.3766,  0.3264,  0.3851,
         0.3570,  0.5715,  0.4069,  0.3901,  0.5727,  0.6063,  0.4887,
         0.1651,  0.7020,  0.4436,  0.5773,  0.3524,  0.3334,  0.5768,
         0.4360,  0.5671,  0.3417,  0.5627,  0.6592,  0.3037,  0.4857,
         0.4704,  0.6639,  0.5584,  0.4232,  0.5782,  0.7397,  0.6818,
         0.4008,  0.2962,  0.3471,  0.5334,  0.3755,  0.7147,  0.5998,
         0.5885,  0.4557,  0.8086,  0.5665,  0.3416,  0.5094,  0.5912,
         0.6564,  0.5353,  0.4037,  0.7268,  0.4885,  0.3783,  0.5211,
         0.4731,  0.5373,  0.3656,  0.4202,  0.3793,  0.3212,  0.6026,
         0.4740,  0.6218,  0.5358,  0.4506,  0.5404,  0.4910,  0.3671,
         0.3201,  0.8582,  0.4750,  0.4119,  0.4934,  0.6767,  0.2798,
         0.3370,  0.6365,  0.5609,  0.6695,  0.4956,  0.6562,  0.5417,
         0.4994,  0.3581,  0.6655,  0.5938,  0.6228,  0.5116,  0.6121,
         0.3659,  0.4443,  0.3979,  0.8304,  0.5984,  0.4410,  0.6340,
         0.4758,  0.4382,  0.4509,  0.4797,  0.8988,  0.7735,  0.4600,
         0.5361,  0.5792,  0.9156,  0.4320,  0.2540,  0.4428,  0.5191,
         0.6383,  0.2274,  0.5887,  0.3651,  0.5625,  0.4884,  0.2010,
         0.6216,  0.5299,  0.4864,  0.5851,  0.7743,  0.5487,  0.5784,
         0.4225,  0.3450,  0.3395,  0.3876,  0.3424,  0.3221,  0.5388,
         0.4056,  0.4977,  0.4997,  0.3700,  0.7083,  0.7734,  0.6481,
         0.6426,  0.6932,  0.3115,  0.4968,  0.3690,  0.5044,  0.4415,
         0.4882,  0.3302,  0.3899,  0.6480,  0.4256,  0.4950,  0.3685,
         0.3503,  0.5650,  0.6267,  0.4673,  0.5939,  0.7545,  0.5479,
         0.4829,  0.3284,  0.7126,  0.6801,  0.4429,  0.5333,  0.4094,
         0.6486,  0.7185,  0.5401,  0.5641,  0.6059,  0.4208,  0.6254,
         0.5588,  0.4443,  0.5708,  0.6022,  0.4826,  0.7322,  0.3569,
         0.7237,  0.3303,  0.5565,  0.4587,  0.4616,  0.5512,  0.4935,
         0.5326,  0.7421,  0.4766,  0.2500,  0.4024,  0.5770,  0.3913,
         0.3914,  0.4582,  0.7463,  0.4975,  0.7052,  0.5624,  0.4954,
         0.6748,  0.6609,  0.1737,  0.5213,  0.6253,  0.4765,  0.6178,
         0.8205,  0.7270,  0.3637,  0.5414,  0.4458,  0.7861,  0.5549,
         0.3824,  0.6477,  0.6469,  0.4966,  0.6799,  0.7343,  0.7327,
         0.6633,  0.4805,  0.4814,  0.7209,  0.6308,  0.4907,  0.5386,
         0.4618,  0.6718,  0.5374,  0.6097,  0.4568,  0.3610,  0.6247,
         0.5886,  0.4534,  0.6887,  0.3247,  0.4526,  0.2865,  0.8551,
         0.4613,  0.7343,  0.5076,  0.5859,  0.4366,  0.4381,  0.4864,
         0.3964,  0.5067,  0.5797,  0.6136,  0.6103,  0.8553,  0.6832,
         0.5824,  0.6644,  0.3265,  0.5931,  0.4893,  0.8765,  0.4282,
         0.4836,  0.5368,  0.6615,  0.4069,  0.6155,  0.3022,  0.5045,
         0.5552,  0.4046,  0.5660,  0.4903,  0.1998,  0.3603,  0.6093,
         0.3636,  0.6310,  0.5628,  0.6496,  0.6241,  0.6387,  0.5846,
         0.4720,  0.3952,  0.4429,  0.5416,  0.3710,  0.5468,  0.6402,
         0.5068,  0.6734,  0.7635,  0.2857,  0.5126,  0.5247,  0.5499,
         0.4200], device='cuda:0')
tensor(0.6197, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3860,  0.5130,  0.6660,  0.7509,  0.8817,  0.7235,  0.6472,
         0.5177,  0.4366,  0.4451,  0.4922,  0.5424,  0.5935,  0.4559,
         0.8353,  0.3942,  0.5172,  0.2226,  0.5238,  0.6685,  0.4729,
         0.3732,  0.5034,  0.5561,  0.5269,  0.4768,  0.2915,  0.4903,
         0.7823,  0.6833,  0.6633,  0.8339,  0.5747,  0.7179,  0.5042,
         0.5077,  0.4379,  0.3711,  0.4722,  0.6786,  0.6896,  0.5603,
         0.9107,  0.4145,  0.4347,  0.6587,  0.5398,  0.5485,  0.5669,
         0.3775,  0.5060,  0.4279,  0.3465,  0.7231,  0.5045,  0.6720,
         0.7492,  0.6308,  0.4171,  0.4514,  0.4478,  0.3556,  0.5435,
         0.5661,  0.5786,  0.5385,  0.5408,  0.3531,  0.5291,  0.2990,
         0.8152,  0.4204,  0.2932,  0.7966,  0.7738,  0.4679,  0.8391,
         0.5295,  0.4924,  0.6058,  0.7369,  0.6106,  0.7961,  0.3002,
         0.9119,  0.7357,  0.4812,  0.2526,  0.5693,  0.7110,  0.6619,
         0.5569,  0.4147,  0.4755,  0.4125,  0.3940,  0.4469,  0.5632,
         0.1825,  0.6467,  0.5917,  0.5743,  0.5838,  0.8133,  0.4772,
         0.5297,  0.7679,  0.8287,  0.6014,  0.3027,  0.4761,  0.4370,
         0.5246,  0.5412,  0.7790,  0.2966,  0.5922,  0.7717,  0.8952,
         0.5946,  0.6938,  0.3156,  0.7028,  0.8260,  0.3998,  0.8665,
         0.5001,  0.6660,  0.4015,  0.3364,  0.4459,  0.7007,  0.8066,
         0.6708,  0.4436,  0.7858,  0.3194,  0.5447,  0.8126,  0.4957,
         0.7860,  0.3941,  0.6774,  0.3121,  0.5596,  0.6968,  0.5459,
         0.5961,  0.3878,  0.7052,  0.4249,  0.4916,  0.8037,  0.7244,
         0.3187,  0.4177,  0.4337,  0.6742,  0.5360,  0.3508,  0.3648,
         0.7849,  0.5336,  0.6550,  0.5694,  0.6044,  0.3672,  0.8635,
         0.5122,  0.7075,  0.3525,  0.2524,  0.3683,  0.6699,  0.1830,
         0.4664,  0.3890,  0.7059,  0.6557,  0.6024,  0.6578,  0.4610,
         0.7175,  0.5589,  0.4487,  0.4813,  0.6678,  0.7050,  0.7523,
         0.6875,  0.7366,  0.5679,  0.5724,  0.3607,  0.5445,  0.2874,
         0.3186,  0.5062,  0.6430,  0.8397,  0.5481,  0.4318,  0.7087,
         0.7140,  0.6305,  0.6408,  0.6259,  0.6732,  0.5885,  0.4898,
         0.6616,  0.4703,  0.5379,  0.3756,  0.7120,  0.6041,  0.4765,
         0.5374,  0.3739,  0.7113,  0.3402,  0.2239,  0.3326,  0.3983,
         0.6707,  0.8045,  0.3847,  0.7267,  0.3387,  0.6588,  0.4733,
         0.4038,  0.6683,  0.4985,  0.6610,  0.8117,  0.8270,  0.4683,
         0.3782,  0.6698,  0.5469,  0.4369,  0.4099,  0.6329,  0.3538,
         0.5830,  0.5501,  0.5703,  0.4412,  0.8144,  0.7067,  0.5251,
         0.5387,  0.7785,  0.5631,  0.5697,  0.8066,  0.7018,  0.7375,
         0.3866,  0.6141,  0.3264,  0.4780,  0.3920,  0.8089,  0.6361,
         0.6692,  0.5338,  0.8149,  0.5480,  0.1683,  0.3444,  0.6918,
         0.5418,  0.5063,  0.6702,  0.8128,  0.6935,  0.5101,  0.3864,
         0.5512,  0.7010,  0.4087,  0.4675,  0.4951,  0.5445,  0.7304,
         0.3455,  0.5264,  0.8253,  0.5927,  0.8562,  0.3194,  0.2941,
         0.2937,  0.5291,  0.5614,  0.2903,  0.5381,  0.4267,  0.5245,
         0.5162,  0.4224,  0.2516,  0.7541,  0.6388,  0.4049,  0.4784,
         0.7758,  0.5906,  0.2757,  0.7258,  0.5697,  0.5611,  0.7067,
         0.5427,  0.6520,  0.3168,  0.7329,  0.5493,  0.3901,  0.7481,
         0.4080,  0.5807,  0.2945,  0.6964,  0.6010,  0.3675,  0.5955,
         0.5443,  0.4852,  0.5107,  0.4619,  0.5762,  0.6668,  0.5646,
         0.4404,  0.6535,  0.3632,  0.4597,  0.4888,  0.3726,  0.5013,
         0.4613,  0.3910,  0.6207,  0.2794,  0.2698,  0.8152,  0.5145,
         0.2896,  0.3188,  0.8425,  0.4437,  0.5749,  0.3966,  0.4148,
         0.4179,  0.3070,  0.5665,  0.8001,  0.6206,  0.5144,  0.6620,
         0.4457,  0.5731,  0.7697,  0.3677,  0.6285,  0.5195,  0.2741,
         0.5837,  0.6308,  0.4976,  0.6192,  0.5326,  0.4683,  0.6385,
         0.6291,  0.5558,  0.7898,  0.5030,  0.2978,  0.3367,  0.8003,
         0.4687,  0.6585,  0.6417,  0.6263,  0.3395,  0.7614,  0.3372,
         0.3317,  0.7408,  0.6504,  0.3527,  0.6809,  0.4831,  0.4059,
         0.4853,  0.5269,  0.4481,  0.8064,  0.5731,  0.4900,  0.4986,
         0.7479,  0.3812,  0.5652,  0.8092,  0.4371,  0.6481,  0.4567,
         0.6047,  0.6444,  0.6716,  0.8653,  0.6248,  0.5921,  0.2731,
         0.4657,  0.7263,  0.4423,  0.5129,  0.6156,  0.7589,  0.3988,
         0.4073,  0.6473,  0.4569,  0.7106,  0.4553,  0.4764,  0.5186,
         0.8570,  0.3124,  0.7201,  0.3939,  0.6551,  0.5751,  0.4939,
         0.3461,  0.6255,  0.4822,  0.3973,  0.4751,  0.3280,  0.7486,
         0.6088,  0.4499,  0.3011,  0.4318,  0.2770,  0.5242,  0.2824,
         0.5567,  0.7526,  0.5994,  0.4675,  0.5239,  0.4708,  0.5455,
         0.5063,  0.4601,  0.7691,  0.3894,  0.4263,  0.3969,  0.2982,
         0.5416,  0.4313,  0.2892,  0.4689,  0.9349,  0.4678,  0.5191,
         0.7976,  0.6615,  0.7536,  0.7389,  0.6677,  0.3194,  0.7420,
         0.5133,  0.3906,  0.4355,  0.6754,  0.4039,  0.7990,  0.6812,
         0.5379,  0.6290,  0.3892,  0.5041,  0.7072,  0.2085,  0.4849,
         0.5290,  0.7014,  0.7732,  0.7160,  0.4755,  0.3695,  0.2259,
         0.8239,  0.4463,  0.4034,  0.6801,  0.4129,  0.6828,  0.6895,
         0.4571], device='cuda:0')
tensor(0.5849, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7437,  0.5845,  0.4235,  0.7784,  0.7700,  0.8682,  0.6586,
         0.6477,  0.8404,  0.6389,  0.6209,  0.3738,  0.5522,  0.3893,
         0.8034,  0.5668,  0.6641,  0.8721,  0.4757,  0.8519,  0.2916,
         0.2271,  0.3667,  0.3714,  0.6595,  0.4738,  0.8785,  0.5269,
         0.7671,  0.8084,  0.7052,  0.6821,  0.2020,  0.4076,  0.7100,
         0.3898,  0.7215,  0.7279,  0.5215,  0.4190,  0.4812,  0.4136,
         0.3983,  0.8341,  0.8177,  0.2879,  0.5157,  0.5252,  0.6037,
         0.4026,  0.5693,  0.4408,  0.5811,  0.4389,  0.4929,  0.5288,
         0.7296,  0.6643,  0.7012,  0.8316,  0.6755,  0.8735,  0.4710,
         0.3332,  0.6152,  0.6483,  0.7819,  0.7520,  0.6341,  0.5136,
         0.7136,  0.7014,  0.5566,  0.3968,  0.4445,  0.4902,  0.6771,
         0.7880,  0.4608,  0.7491,  0.1522,  0.6918,  0.5106,  0.4068,
         0.6932,  0.5995,  0.6129,  0.4169,  0.5704,  0.7503,  0.5482,
         0.3658,  0.3149,  0.8687,  0.4416,  0.3720,  0.5272,  0.5403,
         0.2903,  0.4758,  0.7749,  0.6425,  0.8497,  0.5349,  0.6347,
         0.7639,  0.3943,  0.6558,  0.7140,  0.5042,  0.5055,  0.8662,
         0.4188,  0.6518,  0.5976,  0.5976,  0.5758,  0.4855,  0.7905,
         0.5064,  0.6655,  0.8434,  0.7176,  0.6866,  0.5520,  0.3813,
         0.3112,  0.8039,  0.3769,  0.4464,  0.8601,  0.6175,  0.6720,
         0.6436,  0.7242,  0.4367,  0.7371,  0.3722,  0.4436,  0.4381,
         0.5157,  0.4343,  0.6930,  0.3468,  0.6718,  0.4381,  0.4928,
         0.5461,  0.3666,  0.5228,  0.5276,  0.5387,  0.6181,  0.2490,
         0.2498,  0.6146,  0.3951,  0.4207,  0.3740,  0.8608,  0.6734,
         0.5898,  0.4586,  0.7763,  0.3888,  0.9168,  0.2002,  0.8913,
         0.5766,  0.8917,  0.6259,  0.3447,  0.8512,  0.5892,  0.8291,
         0.8174,  0.6846,  0.4024,  0.3110,  0.2770,  0.4847,  0.5241,
         0.6069,  0.3922,  0.6046,  0.4887,  0.8349,  0.8219,  0.6499,
         0.5109,  0.3514,  0.4167,  0.5399,  0.5007,  0.7308,  0.6915,
         0.3885,  0.6196,  0.9006,  0.2639,  0.3930,  0.4303,  0.5075,
         0.4952,  0.5989,  0.4164,  0.7921,  0.6243,  0.4021,  0.3916,
         0.4641,  0.9581,  0.4258,  0.4067,  0.8616,  0.4561,  0.6749,
         0.5745,  0.3044,  0.5115,  0.7567,  0.4347,  0.7221,  0.8035,
         0.3633,  0.3453,  0.4079,  0.5332,  0.7846,  0.4381,  0.3596,
         0.5282,  0.7108,  0.7564,  0.3774,  0.5673,  0.7634,  0.5268,
         0.6356,  0.4792,  0.8253,  0.4802,  0.5164,  0.5809,  0.7309,
         0.6796,  0.5425,  0.5582,  0.7955,  0.6383,  0.6797,  0.6639,
         0.4544,  0.6069,  0.4833,  0.8942,  0.8744,  0.4981,  0.3350,
         0.3403,  0.3547,  0.7909,  0.4869,  0.5921,  0.2889,  0.4699,
         0.5748,  0.5533,  0.3443,  0.5752,  0.4796,  0.3174,  0.3549,
         0.6249,  0.3663,  0.5428,  0.7846,  0.3171,  0.9174,  0.3721,
         0.6224,  0.8163,  0.7667,  0.6712,  0.4759,  0.4738,  0.3805,
         0.3086,  0.3863,  0.7530,  0.8042,  0.4769,  0.5861,  0.2877,
         0.3994,  0.5442,  0.8610,  0.7605,  0.3541,  0.6585,  0.8278,
         0.8163,  0.7290,  0.5559,  0.3406,  0.6864,  0.2552,  0.8188,
         0.4444,  0.3469,  0.7136,  0.6029,  0.4572,  0.5322,  0.2655,
         0.3387,  0.7052,  0.5753,  0.2005,  0.3741,  0.8669,  0.5135,
         0.8049,  0.6066,  0.3974,  0.5661,  0.7213,  0.5357,  0.2162,
         0.4495,  0.4813,  0.8284,  0.7238,  0.4240,  0.5268,  0.3544,
         0.4001,  0.7328,  0.6701,  0.5136,  0.8922,  0.5071,  0.6031,
         0.2623,  0.6028,  0.5138,  0.6366,  0.6913,  0.3523,  0.4862,
         0.3181,  0.5073,  0.6988,  0.7199,  0.7753,  0.4794,  0.3494,
         0.7026,  0.4068,  0.5547,  0.2124,  0.5855,  0.7012,  0.4883,
         0.9105,  0.8987,  0.2797,  0.7771,  0.3645,  0.2365,  0.5634,
         0.5339,  0.5046,  0.7425,  0.7226,  0.7370,  0.3442,  0.6194,
         0.3446,  0.2438,  0.5501,  0.4323,  0.8804,  0.5173,  0.5156,
         0.7588,  0.8409,  0.3379,  0.5194,  0.5234,  0.5095,  0.4469,
         0.7646,  0.3907,  0.3583,  0.4732,  0.6067,  0.6891,  0.7419,
         0.7515,  0.6915,  0.3685,  0.3885,  0.6951,  0.8116,  0.5270,
         0.5813,  0.3850,  0.4363,  0.3953,  0.3538,  0.4319,  0.7763,
         0.7410,  0.4790,  0.8328,  0.5761,  0.5784,  0.5623,  0.3696,
         0.5724,  0.7710,  0.4493,  0.4394,  0.4879,  0.5025,  0.5297,
         0.4411,  0.8015,  0.4325,  0.8765,  0.6394,  0.4934,  0.6941,
         0.6759,  0.4882,  0.4709,  0.3649,  0.7152,  0.3456,  0.5361,
         0.7315,  0.2953,  0.6032,  0.3429,  0.3857,  0.7503,  0.6589,
         0.6223,  0.8676,  0.4222,  0.5331,  0.6789,  0.2917,  0.4191,
         0.6886,  0.6203,  0.2605,  0.8285,  0.6830,  0.6829,  0.4057,
         0.8744,  0.4433,  0.7674,  0.5370,  0.6342,  0.7817,  0.5562,
         0.7909,  0.4039,  0.7247,  0.7819,  0.7342,  0.7525,  0.4735,
         0.8451,  0.3454,  0.4815,  0.8119,  0.6911,  0.3246,  0.4932,
         0.8631,  0.3630,  0.8987,  0.7279,  0.5297,  0.4718,  0.5786,
         0.2353,  0.9425,  0.6604,  0.3442,  0.3536,  0.6973,  0.7929,
         0.5740,  0.5743,  0.2912,  0.7415,  0.2968,  0.7227,  0.3456,
         0.7856,  0.4773,  0.2766,  0.4791,  0.6181,  0.6692,  0.5523,
         0.4481], device='cuda:0')
tensor(0.6351, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4296,  0.5113,  0.5055,  0.3588,  0.3376,  0.6185,  0.3234,
         0.4091,  0.3536,  0.4396,  0.3821,  0.5677,  0.8666,  0.7870,
         0.5688,  0.5284,  0.6699,  0.7071,  0.7982,  0.4125,  0.5795,
         0.4958,  0.3369,  0.3591,  0.6115,  0.6513,  0.7617,  0.6594,
         0.8328,  0.4115,  0.3356,  0.5609,  0.7011,  0.4337,  0.4548,
         0.6949,  0.7962,  0.5783,  0.6008,  0.5274,  0.8370,  0.3016,
         0.2577,  0.7258,  0.6856,  0.3718,  0.3737,  0.5332,  0.5122,
         0.6931,  0.7591,  0.6935,  0.4564,  0.3882,  0.3845,  0.3866,
         0.4039,  0.7068,  0.8322,  0.4866,  0.2996,  0.4802,  0.4787,
         0.4460,  0.4536,  0.4168,  0.3517,  0.5899,  0.5529,  0.3945,
         0.6834,  0.4993,  0.6431,  0.3249,  0.4989,  0.6034,  0.7472,
         0.5939,  0.2194,  0.6166,  0.4409,  0.1965,  0.7769,  0.5884,
         0.2509,  0.4759,  0.3961,  0.8063,  0.8977,  0.5264,  0.5002,
         0.6165,  0.4258,  0.8496,  0.7687,  0.6736,  0.4328,  0.7228,
         0.8697,  0.7555,  0.6167,  0.3519,  0.3098,  0.7622,  0.3002,
         0.7553,  0.7637,  0.3633,  0.8506,  0.5171,  0.4599,  0.4413,
         0.3587,  0.4780,  0.6461,  0.7271,  0.7990,  0.5071,  0.4968,
         0.3981,  0.6254,  0.4224,  0.8386,  0.7909,  0.4001,  0.6727,
         0.6312,  0.4963,  0.7310,  0.7229,  0.1566,  0.4790,  0.5101,
         0.5302,  0.7923,  0.5716,  0.7644,  0.6235,  0.5612,  0.8283,
         0.5590,  0.5094,  0.5001,  0.4240,  0.6273,  0.4179,  0.8118,
         0.4186,  0.7426,  0.4509,  0.4736,  0.7605,  0.8356,  0.4491,
         0.5129,  0.3433,  0.4663,  0.7573,  0.4986,  0.7468,  0.4357,
         0.5042,  0.3368,  0.7643,  0.5015,  0.4110,  0.5387,  0.6097,
         0.4760,  0.3678,  0.7695,  0.2248,  0.6167,  0.7941,  0.5302,
         0.4003,  0.3444,  0.3981,  0.5848,  0.3057,  0.5336,  0.3102,
         0.4395,  0.4222,  0.6833,  0.7790,  0.3004,  0.4278,  0.3320,
         0.5869,  0.2542,  0.4472,  0.6776,  0.5755,  0.6237,  0.7513,
         0.5454,  0.4824,  0.7795,  0.3257,  0.7162,  0.8206,  0.6633,
         0.7924,  0.5869,  0.5514,  0.4111,  0.3805,  0.4003,  0.4497,
         0.2362,  0.5137,  0.3827,  0.5546,  0.6228,  0.6301,  0.7816,
         0.6953,  0.7850,  0.3443,  0.7288,  0.3994,  0.3757,  0.5212,
         0.8420,  0.4417,  0.4176,  0.5427,  0.2073,  0.2692,  0.7655,
         0.8321,  0.7818,  0.6857,  0.3126,  0.6114,  0.6220,  0.2597,
         0.1876,  0.3116,  0.4743,  0.4915,  0.7578,  0.4612,  0.4919,
         0.6176,  0.5923,  0.6295,  0.5834,  0.4340,  0.7786,  0.5622,
         0.4396,  0.3432,  0.5330,  0.5357,  0.3127,  0.4479,  0.4469,
         0.6264,  0.4456,  0.5003,  0.6644,  0.5071,  0.4426,  0.6469,
         0.7189,  0.6415,  0.5822,  0.3446,  0.6677,  0.6879,  0.4059,
         0.5207,  0.4334,  0.4419,  0.6075,  0.2291,  0.7701,  0.3706,
         0.3097,  0.7291,  0.5716,  0.4587,  0.3669,  0.1995,  0.6718,
         0.5679,  0.6286,  0.1906,  0.3945,  0.4058,  0.5708,  0.7155,
         0.6188,  0.3136,  0.4331,  0.4231,  0.5284,  0.3785,  0.4122,
         0.5303,  0.3460,  0.8142,  0.7000,  0.3793,  0.5662,  0.4393,
         0.4551,  0.2990,  0.4682,  0.8385,  0.5286,  0.6443,  0.3194,
         0.6064,  0.6286,  0.5239,  0.8345,  0.5359,  0.4259,  0.3455,
         0.4213,  0.4409,  0.2618,  0.6473,  0.5529,  0.5702,  0.5583,
         0.3980,  0.5688,  0.6881,  0.3021,  0.3485,  0.4432,  0.4580,
         0.5534,  0.3615,  0.5533,  0.4252,  0.7107,  0.4241,  0.5573,
         0.6026,  0.7286,  0.5771,  0.4469,  0.8430,  0.6849,  0.3272,
         0.4578,  0.4381,  0.5042,  0.3341,  0.4446,  0.5934,  0.3713,
         0.4866,  0.6037,  0.6595,  0.8281,  0.6643,  0.4369,  0.5356,
         0.3615,  0.4616,  0.8346,  0.4417,  0.4917,  0.5841,  0.7425,
         0.4109,  0.4063,  0.3501,  0.4145,  0.4178,  0.5969,  0.6823,
         0.8983,  0.3020,  0.5511,  0.7286,  0.3933,  0.3659,  0.3682,
         0.4880,  0.7801,  0.4278,  0.7533,  0.7544,  0.5395,  0.5629,
         0.7530,  0.5428,  0.4860,  0.3740,  0.5225,  0.6892,  0.5724,
         0.5964,  0.7547,  0.4425,  0.7201,  0.3713,  0.6531,  0.6957,
         0.4576,  0.8480,  0.7138,  0.5516,  0.7608,  0.2396,  0.5204,
         0.4514,  0.6033,  0.5205,  0.3510,  0.7862,  0.5536,  0.4660,
         0.5353,  0.6853,  0.6589,  0.7190,  0.4059,  0.3958,  0.5111,
         0.7334,  0.3221,  0.3866,  0.7987,  0.3608,  0.2592,  0.7934,
         0.5447,  0.4506,  0.7335,  0.1633,  0.4190,  0.4798,  0.1407,
         0.3529,  0.3770,  0.3113,  0.5984,  0.5750,  0.6149,  0.6686,
         0.8046,  0.2633,  0.5289,  0.2928,  0.3727,  0.3212,  0.8167,
         0.6901,  0.1855,  0.7114,  0.6356,  0.8206,  0.4314,  0.6820,
         0.4623,  0.8217,  0.5462,  0.5549,  0.6199,  0.8243,  0.3772,
         0.6510,  0.5069,  0.4493,  0.5492,  0.2243,  0.7772,  0.5639,
         0.4857,  0.7323,  0.4883,  0.3214,  0.3230,  0.7166,  0.2770,
         0.4619,  0.4847,  0.8693,  0.7846,  0.5134,  0.2801,  0.2896,
         0.5509,  0.3019,  0.6259,  0.5325,  0.5808,  0.4156,  0.4946,
         0.4043,  0.5730,  0.3997,  0.6873,  0.4881,  0.4794,  0.5667,
         0.2238,  0.6715,  0.4762,  0.8775,  0.3015,  0.3745,  0.3444,
         0.3000], device='cuda:0')
tensor(0.6173, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7775,  0.4724,  0.5565,  0.7736,  0.4694,  0.5547,  0.6751,
         0.9303,  0.5628,  0.4013,  0.2422,  0.4127,  0.3833,  0.3002,
         0.4776,  0.6107,  0.4689,  0.3117,  0.7038,  0.7458,  0.3395,
         0.2596,  0.4843,  0.6760,  0.3287,  0.5478,  0.9535,  0.5804,
         0.3779,  0.4034,  0.3384,  0.3184,  0.1239,  0.5225,  0.5219,
         0.4622,  0.4028,  0.2770,  0.5458,  0.4748,  0.7729,  0.4165,
         0.5645,  0.5283,  0.7596,  0.5346,  0.6007,  0.6307,  0.5142,
         0.6523,  0.3036,  0.8665,  0.8788,  0.7995,  0.5757,  0.8162,
         0.4294,  0.4024,  0.6053,  0.7343,  0.5654,  0.4223,  0.4654,
         0.8454,  0.6649,  0.4856,  0.7424,  0.4944,  0.3761,  0.5612,
         0.4180,  0.4152,  0.4022,  0.3109,  0.2883,  0.6213,  0.7162,
         0.3746,  0.7788,  0.8156,  0.6125,  0.2017,  0.4691,  0.2807,
         0.2654,  0.3073,  0.4670,  0.7187,  0.2877,  0.3717,  0.7021,
         0.3725,  0.6075,  0.3175,  0.3341,  0.4845,  0.3773,  0.4131,
         0.6665,  0.3143,  0.4050,  0.3338,  0.4561,  0.3544,  0.3910,
         0.3308,  0.5591,  0.3786,  0.3627,  0.4784,  0.6399,  0.5601,
         0.7478,  0.3749,  0.7917,  0.4193,  0.6451,  0.3213,  0.2982,
         0.4612,  0.4909,  0.6779,  0.8166,  0.6410,  0.7243,  0.8543,
         0.4466,  0.3983,  0.1599,  0.7356,  0.3304,  0.2379,  0.8549,
         0.5165,  0.5920,  0.3974,  0.2130,  0.2938,  0.8278,  0.7532,
         0.7785,  0.4755,  0.4693,  0.1404,  0.8483,  0.2862,  0.4724,
         0.5900,  0.4496,  0.6640,  0.7039,  0.8869,  0.5170,  0.6553,
         0.2412,  0.4516,  0.3763,  0.5938,  0.5948,  0.9235,  0.2780,
         0.4098,  0.7128,  0.3999,  0.5305,  0.3756,  0.7701,  0.4131,
         0.2200,  0.3655,  0.7683,  0.4713,  0.5862,  0.5210,  0.3879,
         0.4355,  0.5741,  0.3703,  0.8053,  0.8618,  0.5459,  0.6356,
         0.5597,  0.3984,  0.7119,  0.5175,  0.4195,  0.4099,  0.3506,
         0.5034,  0.4716,  0.5062,  0.3238,  0.3499,  0.5709,  0.3843,
         0.3581,  0.5470,  0.5576,  0.4903,  0.2994,  0.4924,  0.4073,
         0.3353,  0.3807,  0.2646,  0.8631,  0.4781,  0.4559,  0.6452,
         0.3210,  0.5150,  0.3917,  0.4125,  0.3590,  0.4350,  0.6501,
         0.6363,  0.5026,  0.7725,  0.3100,  0.5461,  0.7595,  0.5822,
         0.5031,  0.4557,  0.8353,  0.8521,  0.6249,  0.3457,  0.4432,
         0.5286,  0.6341,  0.4121,  0.5873,  0.4645,  0.3499,  0.3852,
         0.4840,  0.3440,  0.7110,  0.2657,  0.5196,  0.2960,  0.3655,
         0.3842,  0.5399,  0.3348,  0.2937,  0.2611,  0.1354,  0.4445,
         0.3409,  0.5332,  0.5149,  0.5780,  0.7060,  0.6864,  0.3672,
         0.4429,  0.7225,  0.4533,  0.5514,  0.2974,  0.2605,  0.5093,
         0.1695,  0.4463,  0.6553,  0.5368,  0.5342,  0.3184,  0.4450,
         0.7506,  0.5208,  0.5064,  0.3945,  0.3668,  0.3400,  0.4766,
         0.6310,  0.7908,  0.8408,  0.2650,  0.2608,  0.5205,  0.5455,
         0.7659,  0.4076,  0.4060,  0.5475,  0.8076,  0.6983,  0.6602,
         0.5363,  0.2925,  0.4587,  0.5244,  0.2960,  0.3940,  0.3121,
         0.8068,  0.4032,  0.4462,  0.6480,  0.6327,  0.7575,  0.3124,
         0.8342,  0.3051,  0.6334,  0.3527,  0.3853,  0.4314,  0.4646,
         0.6972,  0.4143,  0.1994,  0.4146,  0.3224,  0.5932,  0.5311,
         0.3346,  0.7648,  0.3255,  0.5599,  0.8623,  0.7852,  0.2866,
         0.7733,  0.7095,  0.4988,  0.7496,  0.3756,  0.2854,  0.1850,
         0.5467,  0.5787,  0.3337,  0.4040,  0.4790,  0.3574,  0.4390,
         0.5550,  0.4080,  0.2951,  0.8822,  0.4415,  0.6987,  0.1853,
         0.8995,  0.6270,  0.4045,  0.2204,  0.3824,  0.5500,  0.1359,
         0.3755,  0.3396,  0.6711,  0.7809,  0.2961,  0.4812,  0.4614,
         0.5762,  0.5832,  0.8263,  0.5181,  0.5605,  0.4214,  0.8442,
         0.4722,  0.3572,  0.5070,  0.3899,  0.3128,  0.5719,  0.4157,
         0.4613,  0.3759,  0.4397,  0.5035,  0.6356,  0.2453,  0.9130,
         0.6741,  0.5778,  0.4289,  0.4016,  0.6098,  0.1322,  0.5993,
         0.5972,  0.7251,  0.4815,  0.2724,  0.3312,  0.5411,  0.3752,
         0.7508,  0.3428,  0.7771,  0.7027,  0.4376,  0.4193,  0.3492,
         0.4955,  0.8929,  0.3093,  0.5100,  0.5505,  0.6106,  0.5213,
         0.4072,  0.7053,  0.5726,  0.7089,  0.5697,  0.4922,  0.5774,
         0.5127,  0.2598,  0.7592,  0.4196,  0.5977,  0.6038,  0.5353,
         0.5612,  0.3911,  0.3375,  0.1640,  0.3555,  0.3844,  0.2380,
         0.4803,  0.4110,  0.2992,  0.5402,  0.4692,  0.2129,  0.4738,
         0.6016,  0.7412,  0.6695,  0.2723,  0.5691,  0.1589,  0.6212,
         0.6564,  0.7899,  0.3279,  0.3877,  0.5037,  0.4080,  0.7911,
         0.3369,  0.2870,  0.3379,  0.2071,  0.6376,  0.3409,  0.6489,
         0.2874,  0.4627,  0.8581,  0.2727,  0.3602,  0.4080,  0.4517,
         0.4593,  0.4247,  0.7389,  0.6263,  0.6600,  0.5346,  0.3177,
         0.5063,  0.3337,  0.7988,  0.5851,  0.5941,  0.8500,  0.4213,
         0.4507,  0.3932,  0.3063,  0.7269,  0.4649,  0.7852,  0.2840,
         0.3501,  0.5000,  0.5580,  0.3432,  0.6488,  0.4727,  0.4855,
         0.6405,  0.4802,  0.3830,  0.7034,  0.4244,  0.6721,  0.2553,
         0.7527,  0.4917,  0.6342,  0.8261,  0.2944,  0.3329,  0.7335,
         0.4634], device='cuda:0')
tensor(0.6340, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2691,  0.3825,  0.5604,  0.4839,  0.4660,  0.3838,  0.5120,
         0.4575,  0.8530,  0.5318,  0.2493,  0.1364,  0.2824,  0.5436,
         0.2156,  0.5040,  0.8091,  0.6389,  0.4383,  0.3685,  0.3233,
         0.3901,  0.6099,  0.3056,  0.6556,  0.3053,  0.5792,  0.3571,
         0.4568,  0.6020,  0.4613,  0.8429,  0.4093,  0.3628,  0.3071,
         0.2954,  0.4260,  0.2790,  0.4554,  0.3263,  0.4931,  0.3270,
         0.6617,  0.7020,  0.2950,  0.6726,  0.7039,  0.2375,  0.2831,
         0.7441,  0.3086,  0.5024,  0.3469,  0.5714,  0.4692,  0.4927,
         0.4697,  0.8731,  0.4485,  0.4371,  0.5890,  0.4837,  0.7114,
         0.3456,  0.5289,  0.3052,  0.4604,  0.3619,  0.3396,  0.2516,
         0.6901,  0.3614,  0.2988,  0.3743,  0.3988,  0.4076,  0.4389,
         0.2454,  0.5179,  0.1836,  0.3199,  0.6506,  0.2684,  0.1865,
         0.3125,  0.4195,  0.4573,  0.3112,  0.3871,  0.6664,  0.4542,
         0.3426,  0.5282,  0.5755,  0.4447,  0.7210,  0.3532,  0.2808,
         0.4185,  0.4814,  0.3301,  0.5188,  0.3534,  0.2218,  0.3872,
         0.3777,  0.5205,  0.4780,  0.4871,  0.7184,  0.3746,  0.3839,
         0.3518,  0.3869,  0.3703,  0.5932,  0.3743,  0.3571,  0.4565,
         0.3554,  0.4996,  0.5988,  0.6073,  0.6237,  0.3667,  0.4960,
         0.5197,  0.5537,  0.3863,  0.4016,  0.4879,  0.7342,  0.2050,
         0.7446,  0.6599,  0.4043,  0.6859,  0.3070,  0.7789,  0.7099,
         0.4511,  0.5109,  0.3831,  0.4166,  0.7470,  0.6416,  0.5093,
         0.3169,  0.5125,  0.4446,  0.5639,  0.3668,  0.2292,  0.8682,
         0.4853,  0.4062,  0.3113,  0.4642,  0.4254,  0.6865,  0.9076,
         0.3462,  0.5833,  0.5054,  0.2862,  0.4035,  0.3907,  0.7118,
         0.4915,  0.7973,  0.3331,  0.3546,  0.4212,  0.3468,  0.6964,
         0.4769,  0.2829,  0.8093,  0.8167,  0.2953,  0.7941,  0.4564,
         0.6731,  0.8178,  0.4345,  0.4958,  0.6369,  0.6893,  0.4066,
         0.4835,  0.7996,  0.5238,  0.4481,  0.2750,  0.3806,  0.3369,
         0.5103,  0.7091,  0.3507,  0.5879,  0.3543,  0.4537,  0.4256,
         0.4762,  0.8455,  0.4093,  0.2846,  0.4853,  0.3589,  0.7560,
         0.4524,  0.3921,  0.4179,  0.4904,  0.4571,  0.9128,  0.5148,
         0.2079,  0.4015,  0.5607,  0.4599,  0.2932,  0.3982,  0.3058,
         0.2488,  0.7122,  0.7800,  0.6822,  0.8169,  0.5740,  0.6723,
         0.3447,  0.4348,  0.5521,  0.4806,  0.4295,  0.4251,  0.2549,
         0.3721,  0.2299,  0.6822,  0.2894,  0.6179,  0.3612,  0.7624,
         0.3318,  0.6472,  0.5200,  0.3717,  0.3673,  0.7016,  0.3496,
         0.4289,  0.6890,  0.7687,  0.6410,  0.5960,  0.3983,  0.6586,
         0.2796,  0.2303,  0.6792,  0.3906,  0.4552,  0.5022,  0.6095,
         0.3508,  0.4801,  0.3711,  0.3752,  0.2759,  0.2286,  0.3715,
         0.4861,  0.5251,  0.6906,  0.3985,  0.3641,  0.6841,  0.3010,
         0.2417,  0.3371,  0.2518,  0.4077,  0.8268,  0.5834,  0.1714,
         0.2068,  0.4855,  0.9280,  0.1995,  0.3852,  0.3294,  0.8108,
         0.4472,  0.3797,  0.3147,  0.3010,  0.6430,  0.3749,  0.5696,
         0.2367,  0.4883,  0.3853,  0.4662,  0.7534,  0.2472,  0.3374,
         0.5657,  0.4222,  0.6605,  0.4525,  0.1855,  0.2775,  0.4497,
         0.4287,  0.3958,  0.8308,  0.6187,  0.3878,  0.6080,  0.6418,
         0.3958,  0.2671,  0.7334,  0.3585,  0.6861,  0.3854,  0.6174,
         0.4368,  0.3786,  0.4070,  0.6025,  0.4806,  0.3141,  0.4371,
         0.3091,  0.2799,  0.4336,  0.3698,  0.6099,  0.4816,  0.6323,
         0.8586,  0.2334,  0.3692,  0.7092,  0.4554,  0.3089,  0.4485,
         0.3766,  0.3716,  0.5461,  0.4627,  0.5385,  0.3151,  0.5275,
         0.6455,  0.3026,  0.5474,  0.4732,  0.2812,  0.8068,  0.5192,
         0.5161,  0.3210,  0.3608,  0.6805,  0.4872,  0.1737,  0.7824,
         0.4786,  0.3960,  0.7604,  0.4484,  0.3596,  0.4787,  0.5040,
         0.6198,  0.3602,  0.3295,  0.5923,  0.7266,  0.6851,  0.2681,
         0.5347,  0.4221,  0.4617,  0.5387,  0.3427,  0.4891,  0.3655,
         0.3887,  0.6122,  0.4191,  0.4961,  0.3517,  0.7292,  0.3541,
         0.7891,  0.6242,  0.2462,  0.5982,  0.4575,  0.3090,  0.4987,
         0.2638,  0.6269,  0.2968,  0.1661,  0.5180,  0.5889,  0.4061,
         0.3926,  0.4846,  0.4739,  0.2325,  0.1138,  0.2687,  0.4053,
         0.3651,  0.6996,  0.3047,  0.3371,  0.5915,  0.3386,  0.2938,
         0.8052,  0.6415,  0.6946,  0.3188,  0.4237,  0.5260,  0.7772,
         0.4244,  0.2936,  0.3217,  0.8278,  0.5242,  0.1468,  0.7263,
         0.2664,  0.4462,  0.4604,  0.6988,  0.6033,  0.3881,  0.8614,
         0.5220,  0.3834,  0.1631,  0.4509,  0.9163,  0.4435,  0.3165,
         0.4618,  0.1618,  0.5285,  0.2237,  0.3914,  0.5288,  0.7756,
         0.3860,  0.2815,  0.2098,  0.3211,  0.3060,  0.8174,  0.7454,
         0.8018,  0.6817,  0.4716,  0.4131,  0.3334,  0.2488,  0.4491,
         0.4686,  0.7526,  0.4883,  0.2872,  0.4290,  0.3651,  0.3509,
         0.5690,  0.5793,  0.7072,  0.5146,  0.6744,  0.5218,  0.4855,
         0.3992,  0.6423,  0.7480,  0.3517,  0.6573,  0.3850,  0.6685,
         0.4516,  0.3517,  0.2984,  0.5587,  0.4967,  0.6393,  0.6486,
         0.8442,  0.8147,  0.4531,  0.4438,  0.4464,  0.5441,  0.4903,
         0.4431], device='cuda:0')
tensor(0.6196, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1948,  0.7825,  0.2974,  0.4137,  0.5912,  0.4867,  0.2027,
         0.4224,  0.5246,  0.4348,  0.6477,  0.2933,  0.3114,  0.2926,
         0.2489,  0.4625,  0.7321,  0.6841,  0.2255,  0.5385,  0.5396,
         0.5360,  0.4745,  0.6384,  0.8848,  0.8759,  0.4146,  0.3179,
         0.5385,  0.1579,  0.2693,  0.3463,  0.5921,  0.6093,  0.6335,
         0.8444,  0.4951,  0.6115,  0.3621,  0.2979,  0.4586,  0.7054,
         0.4286,  0.4309,  0.3081,  0.2014,  0.4611,  0.2745,  0.4104,
         0.3602,  0.5452,  0.2568,  0.4141,  0.2749,  0.3619,  0.2922,
         0.4135,  0.3198,  0.5536,  0.4009,  0.5738,  0.8194,  0.6381,
         0.6010,  0.2867,  0.2364,  0.4974,  0.4117,  0.2824,  0.4226,
         0.4755,  0.2929,  0.3058,  0.4961,  0.8208,  0.5125,  0.3769,
         0.2902,  0.3590,  0.2060,  0.5711,  0.3923,  0.5410,  0.2311,
         0.3374,  0.3818,  0.4060,  0.4288,  0.3099,  0.5898,  0.5122,
         0.5406,  0.2023,  0.3386,  0.3980,  0.4826,  0.4203,  0.8514,
         0.3816,  0.4461,  0.4184,  0.4005,  0.3280,  0.4129,  0.4123,
         0.7412,  0.6490,  0.3518,  0.8738,  0.5107,  0.6547,  0.3035,
         0.4295,  0.2971,  0.5316,  0.3716,  0.3569,  0.7707,  0.6875,
         0.6871,  0.2900,  0.5232,  0.3302,  0.5790,  0.3006,  0.2595,
         0.5927,  0.4701,  0.4934,  0.4148,  0.3290,  0.9056,  0.3066,
         0.6515,  0.5740,  0.2397,  0.4548,  0.6542,  0.3281,  0.7867,
         0.2154,  0.5827,  0.6819,  0.3381,  0.4496,  0.3517,  0.4808,
         0.5596,  0.7010,  0.3790,  0.5658,  0.5829,  0.5055,  0.4532,
         0.2791,  0.4688,  0.6322,  0.1261,  0.5176,  0.3323,  0.4595,
         0.3638,  0.4073,  0.4058,  0.2273,  0.4995,  0.2076,  0.3565,
         0.2939,  0.5900,  0.4885,  0.4626,  0.3543,  0.4799,  0.4752,
         0.6295,  0.4055,  0.4645,  0.4400,  0.5448,  0.2179,  0.5494,
         0.9074,  0.8197,  0.3333,  0.4946,  0.3060,  0.7015,  0.7525,
         0.6673,  0.4066,  0.5050,  0.2720,  0.5751,  0.2339,  0.3831,
         0.5270,  0.4744,  0.3964,  0.3621,  0.4794,  0.7757,  0.5126,
         0.9223,  0.1574,  0.2859,  0.8598,  0.3403,  0.5009,  0.6367,
         0.5169,  0.7804,  0.6631,  0.4935,  0.4575,  0.7392,  0.2665,
         0.2467,  0.2089,  0.3430,  0.3438,  0.6931,  0.2343,  0.3880,
         0.4558,  0.2980,  0.8460,  0.4865,  0.3659,  0.3499,  0.3259,
         0.3314,  0.1751,  0.5879,  0.7106,  0.4548,  0.7489,  0.5329,
         0.5935,  0.2790,  0.3255,  0.1175,  0.3865,  0.4264,  0.3937,
         0.4984,  0.4860,  0.3840,  0.4187,  0.2277,  0.6847,  0.3376,
         0.5739,  0.5458,  0.3154,  0.6660,  0.3389,  0.8523,  0.8053,
         0.2605,  0.3183,  0.6124,  0.3420,  0.4875,  0.2949,  0.3080,
         0.2134,  0.3138,  0.3819,  0.4684,  0.3752,  0.3508,  0.7113,
         0.2632,  0.3475,  0.4220,  0.3753,  0.2914,  0.8914,  0.1870,
         0.2156,  0.3612,  0.7364,  0.6334,  0.3123,  0.3641,  0.3499,
         0.3833,  0.6200,  0.4044,  0.6466,  0.3036,  0.2434,  0.6160,
         0.2907,  0.2744,  0.3662,  0.2010,  0.6283,  0.6941,  0.3498,
         0.3284,  0.8449,  0.6568,  0.7042,  0.4839,  0.5784,  0.5679,
         0.3345,  0.4022,  0.2023,  0.6943,  0.5045,  0.4040,  0.5012,
         0.2395,  0.6052,  0.8503,  0.8768,  0.4923,  0.3924,  0.4503,
         0.5452,  0.5081,  0.1943,  0.4857,  0.2302,  0.3425,  0.2820,
         0.2991,  0.4840,  0.5256,  0.2045,  0.3412,  0.7589,  0.9251,
         0.4573,  0.3587,  0.3137,  0.3940,  0.8927,  0.4992,  0.2791,
         0.4924,  0.6056,  0.2995,  0.2736,  0.9379,  0.5959,  0.3521,
         0.2239,  0.3154,  0.4423,  0.3799,  0.6304,  0.3627,  0.3865,
         0.3397,  0.6968,  0.5780,  0.2559,  0.7447,  0.4249,  0.8776,
         0.3278,  0.6206,  0.7867,  0.5208,  0.5111,  0.3422,  0.3476,
         0.6181,  0.5050,  0.6264,  0.4887,  0.4509,  0.8654,  0.3849,
         0.2540,  0.4527,  0.3622,  0.2687,  0.4847,  0.4582,  0.3028,
         0.3651,  0.4519,  0.5432,  0.5538,  0.2773,  0.5551,  0.3776,
         0.3027,  0.4271,  0.8306,  0.5889,  0.8359,  0.6355,  0.7721,
         0.4124,  0.3983,  0.6420,  0.5924,  0.8406,  0.4994,  0.7145,
         0.2868,  0.6308,  0.2152,  0.1954,  0.3022,  0.4451,  0.3428,
         0.4342,  0.2862,  0.5563,  0.4736,  0.4531,  0.6320,  0.3325,
         0.3966,  0.6199,  0.7895,  0.4205,  0.5174,  0.6288,  0.5854,
         0.2670,  0.6292,  0.6010,  0.4885,  0.6376,  0.4524,  0.2482,
         0.4530,  0.3165,  0.4808,  0.2868,  0.3006,  0.7332,  0.3609,
         0.3741,  0.4046,  0.4476,  0.9265,  0.4180,  0.7102,  0.4931,
         0.3120,  0.3579,  0.1800,  0.2972,  0.5104,  0.5828,  0.3084,
         0.4032,  0.3001,  0.6390,  0.2996,  0.4615,  0.4384,  0.3196,
         0.8563,  0.4582,  0.5336,  0.3557,  0.3900,  0.2304,  0.4869,
         0.2711,  0.3410,  0.5583,  0.5086,  0.7815,  0.4625,  0.7176,
         0.4265,  0.4528,  0.4139,  0.4383,  0.4191,  0.4024,  0.2297,
         0.8252,  0.4665,  0.4459,  0.1914,  0.4535,  0.4762,  0.3151,
         0.2964,  0.7627,  0.4149,  0.8380,  0.3523,  0.2009,  0.3643,
         0.3592,  0.5776,  0.4739,  0.5311,  0.7058,  0.4239,  0.4920,
         0.2946,  0.3442,  0.4360,  0.3007,  0.4308,  0.7012,  0.7709,
         0.3402], device='cuda:0')
tensor(0.5750, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7962,  0.2759,  0.7875,  0.3529,  0.5701,  0.5439,  0.7415,
         0.5166,  0.9147,  0.4932,  0.3599,  0.9443,  0.8782,  0.3682,
         0.2759,  0.1570,  0.3594,  0.1888,  0.7107,  0.4620,  0.8861,
         0.2635,  0.3838,  0.5218,  0.8961,  0.6909,  0.5578,  0.5437,
         0.9522,  0.8458,  0.7627,  0.4472,  0.4798,  0.8022,  0.3686,
         0.4130,  0.2928,  0.3587,  0.6392,  0.5085,  0.8916,  0.4746,
         0.5014,  0.3269,  0.5129,  0.2900,  0.2927,  0.2299,  0.1688,
         0.2255,  0.5906,  0.7721,  0.2800,  0.3103,  0.2349,  0.7917,
         0.8030,  0.5439,  0.4645,  0.4836,  0.2733,  0.7716,  0.2902,
         0.3485,  0.6430,  0.3337,  0.3413,  0.3535,  0.3396,  0.1477,
         0.3459,  0.3644,  0.3243,  0.3299,  0.3881,  0.6053,  0.5699,
         0.5863,  0.4014,  0.4484,  0.3311,  0.3555,  0.3040,  0.8860,
         0.9274,  0.2908,  0.2589,  0.7527,  0.6999,  0.6379,  0.7913,
         0.4726,  0.7343,  0.4612,  0.7304,  0.7811,  0.3268,  0.1613,
         0.3221,  0.2990,  0.8537,  0.4007,  0.3453,  0.3924,  0.8194,
         0.5150,  0.4719,  0.7082,  0.7975,  0.6149,  0.3894,  0.6117,
         0.1356,  0.7898,  0.8151,  0.5417,  0.3794,  0.5825,  0.5937,
         0.4235,  0.3819,  0.5361,  0.4679,  0.3528,  0.5503,  0.8473,
         0.5373,  0.5044,  0.2639,  0.5416,  0.6557,  0.7833,  0.3727,
         0.4366,  0.2441,  0.7892,  0.6174,  0.4347,  0.3972,  0.6468,
         0.4582,  0.7800,  0.5761,  0.5835,  0.8168,  0.5271,  0.7372,
         0.7052,  0.6352,  0.7592,  0.7948,  0.1687,  0.6868,  0.3710,
         0.8766,  0.6969,  0.5863,  0.8338,  0.5209,  0.4369,  0.3697,
         0.6212,  0.3134,  0.7918,  0.2901,  0.5785,  0.9468,  0.6861,
         0.3570,  0.3528,  0.2099,  0.5551,  0.4366,  0.3087,  0.2487,
         0.5810,  0.6317,  0.5701,  0.6659,  0.8710,  0.2225,  0.8115,
         0.7313,  0.2454,  0.5147,  0.7433,  0.7099,  0.3270,  0.4498,
         0.7922,  0.1467,  0.6897,  0.1855,  0.7512,  0.0961,  0.6802,
         0.4175,  0.6298,  0.3183,  0.3911,  0.6390,  0.4062,  0.2162,
         0.8868,  0.4401,  0.5190,  0.7629,  0.2238,  0.3554,  0.7049,
         0.3416,  0.6359,  0.3737,  0.5361,  0.3599,  0.7101,  0.5479,
         0.7713,  0.4634,  0.8064,  0.6637,  0.6015,  0.7791,  0.3518,
         0.3705,  0.7089,  0.4025,  0.6170,  0.9434,  0.1075,  0.4419,
         0.6455,  0.4588,  0.2549,  0.4885,  0.8193,  0.3116,  0.5992,
         0.4210,  0.2449,  0.4787,  0.2800,  0.7298,  0.2546,  0.6114,
         0.8731,  0.2576,  0.3843,  0.5561,  0.4634,  0.3941,  0.6808,
         0.6815,  0.3887,  0.2733,  0.8978,  0.4224,  0.3785,  0.8440,
         0.9463,  0.4582,  0.6854,  0.3064,  0.4328,  0.7192,  0.4481,
         0.7108,  0.5835,  0.4817,  0.6196,  0.7021,  0.4422,  0.2960,
         0.7891,  0.3217,  0.3631,  0.8541,  0.7909,  0.4060,  0.7290,
         0.3644,  0.2759,  0.3852,  0.5128,  0.3157,  0.3883,  0.8726,
         0.3952,  0.5076,  0.6784,  0.2778,  0.5260,  0.5304,  0.3280,
         0.3174,  0.3779,  0.8326,  0.6234,  0.7308,  0.3374,  0.3095,
         0.2842,  0.4197,  0.2771,  0.5586,  0.6864,  0.2669,  0.3073,
         0.3325,  0.8480,  0.7609,  0.5230,  0.3885,  0.4030,  0.3833,
         0.3820,  0.6125,  0.2170,  0.3203,  0.9122,  0.6000,  0.8059,
         0.7976,  0.3462,  0.5494,  0.6639,  0.3057,  0.6906,  0.9452,
         0.2828,  0.7919,  0.5953,  0.3379,  0.1874,  0.7938,  0.3014,
         0.5525,  0.4215,  0.7450,  0.7151,  0.6317,  0.3298,  0.7800,
         0.4656,  0.4895,  0.4252,  0.7330,  0.4973,  0.7826,  0.1444,
         0.3837,  0.2936,  0.5205,  0.8272,  0.2772,  0.5007,  0.3475,
         0.3905,  0.4950,  0.8230,  0.6448,  0.8376,  0.3170,  0.3722,
         0.7401,  0.8484,  0.5058,  0.5959,  0.8858,  0.3768,  0.8874,
         0.3975,  0.5376,  0.3887,  0.3762,  0.6405,  0.8259,  0.4822,
         0.3273,  0.5793,  0.4070,  0.5274,  0.3880,  0.8406,  0.8442,
         0.4127,  0.3781,  0.5140,  0.3636,  0.4316,  0.7830,  0.8634,
         0.3773,  0.3602,  0.4257,  0.6545,  0.7776,  0.6183,  0.8413,
         0.1344,  0.8100,  0.3118,  0.4838,  0.4107,  0.4477,  0.4832,
         0.1768,  0.3883,  0.1679,  0.6160,  0.8189,  0.8354,  0.8689,
         0.2182,  0.4632,  0.6589,  0.8405,  0.7607,  0.7723,  0.3792,
         0.4355,  0.4623,  0.2904,  0.5172,  0.4348,  0.8240,  0.6897,
         0.4220,  0.5296,  0.4610,  0.4256,  0.4479,  0.7702,  0.4957,
         0.5884,  0.7470,  0.4187,  0.6253,  0.1590,  0.2733,  0.7836,
         0.2901,  0.4854,  0.2732,  0.7731,  0.8398,  0.2703,  0.4178,
         0.3982,  0.8117,  0.9515,  0.2568,  0.7108,  0.3180,  0.3923,
         0.4480,  0.3233,  0.2168,  0.6758,  0.2232,  0.5118,  0.5721,
         0.3084,  0.8219,  0.5355,  0.2941,  0.2164,  0.7101,  0.7250,
         0.7690,  0.1934,  0.5850,  0.2974,  0.2713,  0.3316,  0.4405,
         0.2980,  0.3436,  0.3059,  0.4711,  0.5339,  0.2759,  0.4681,
         0.3541,  0.2750,  0.6833,  0.2575,  0.6822,  0.2252,  0.7456,
         0.8589,  0.5543,  0.8218,  0.3612,  0.7128,  0.1691,  0.2591,
         0.3822,  0.4906,  0.4304,  0.3161,  0.7829,  0.3906,  0.3950,
         0.3310,  0.7836,  0.6725,  0.3864,  0.7944,  0.7465,  0.2977,
         0.2997], device='cuda:0')
tensor(0.5909, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3912,  0.8813,  0.8916,  0.7321,  0.2374,  0.1771,  0.2483,
         0.6860,  0.7637,  0.3694,  0.5679,  0.8376,  0.8835,  0.2418,
         0.4693,  0.6849,  0.3652,  0.1678,  0.2236,  0.5812,  0.7652,
         0.8635,  0.4453,  0.5331,  0.2927,  0.8144,  0.4085,  0.6947,
         0.8858,  0.5370,  0.5204,  0.1378,  0.4662,  0.4527,  0.2856,
         0.5214,  0.2412,  0.5460,  0.4206,  0.8015,  0.2759,  0.3056,
         0.2974,  0.5725,  0.3580,  0.8751,  0.5157,  0.4374,  0.4432,
         0.5181,  0.4031,  0.9657,  0.4699,  0.2906,  0.3258,  0.3598,
         0.8656,  0.7086,  0.3025,  0.3579,  0.4407,  0.7024,  0.7498,
         0.6522,  0.5042,  0.8269,  0.3828,  0.5552,  0.8863,  0.9259,
         0.7115,  0.2666,  0.6558,  0.9472,  0.4211,  0.7942,  0.6651,
         0.3485,  0.4818,  0.7539,  0.2821,  0.6648,  0.6115,  0.3648,
         0.5976,  0.2916,  0.5609,  0.8678,  0.3735,  0.3042,  0.8487,
         0.6908,  0.8677,  0.3106,  0.3575,  0.6001,  0.5372,  0.9133,
         0.8043,  0.3300,  0.3830,  0.2463,  0.7147,  0.5828,  0.7627,
         0.3360,  0.4564,  0.4008,  0.6137,  0.3223,  0.2536,  0.7804,
         0.8638,  0.2512,  0.4811,  0.3625,  0.2724,  0.7910,  0.3524,
         0.2636,  0.3512,  0.5241,  0.2495,  0.8144,  0.6887,  0.4469,
         0.2652,  0.7423,  0.8053,  0.6755,  0.4452,  0.3793,  0.8030,
         0.8128,  0.8176,  0.6083,  0.8328,  0.4120,  0.5872,  0.6857,
         0.2259,  0.7268,  0.8824,  0.8781,  0.7782,  0.2805,  0.2998,
         0.7632,  0.5121,  0.3232,  0.8512,  0.8557,  0.5567,  0.7434,
         0.4633,  0.6979,  0.3210,  0.7356,  0.8237,  0.7784,  0.5190,
         0.6402,  0.1991,  0.8204,  0.2695,  0.4485,  0.3938,  0.8426,
         0.8596,  0.8178,  0.4484,  0.2709,  0.3131,  0.2160,  0.7487,
         0.3075,  0.2167,  0.4285,  0.4962,  0.7267,  0.8423,  0.4060,
         0.4189,  0.4514,  0.7852,  0.7436,  0.7398,  0.7466,  0.6776,
         0.3152,  0.8414,  0.5019,  0.6393,  0.2434,  0.4496,  0.8795,
         0.2128,  0.2073,  0.5978,  0.8492,  0.4583,  0.8558,  0.8768,
         0.6680,  0.4951,  0.8278,  0.4035,  0.5279,  0.2728,  0.2195,
         0.2233,  0.5177,  0.3377,  0.6690,  0.5532,  0.8940,  0.7761,
         0.3390,  0.7237,  0.6711,  0.3982,  0.3451,  0.4397,  0.7663,
         0.2585,  0.2615,  0.3475,  0.4347,  0.2425,  0.7275,  0.3536,
         0.4203,  0.9003,  0.6598,  0.4175,  0.7987,  0.4176,  0.4903,
         0.5173,  0.8624,  0.8242,  0.8449,  0.8724,  0.4386,  0.4870,
         0.6184,  0.3223,  0.5373,  0.3801,  0.8207,  0.8018,  0.6536,
         0.3429,  0.4458,  0.4243,  0.5129,  0.3457,  0.5970,  0.3529,
         0.6015,  0.8213,  0.2184,  0.4360,  0.8305,  0.8130,  0.8405,
         0.3829,  0.8806,  0.6085,  0.3022,  0.2378,  0.3734,  0.8052,
         0.5409,  0.6862,  0.3137,  0.8255,  0.9604,  0.8992,  0.4824,
         0.3739,  0.5750,  0.8767,  0.2111,  0.7958,  0.7995,  0.4845,
         0.4028,  0.7949,  0.3549,  0.5451,  0.3932,  0.2837,  0.8091,
         0.3596,  0.2516,  0.6350,  0.4254,  0.8538,  0.2820,  0.8518,
         0.3879,  0.4627,  0.3381,  0.6317,  0.6201,  0.4743,  0.6867,
         0.8643,  0.4936,  0.3428,  0.4662,  0.4684,  0.8564,  0.7759,
         0.1944,  0.7906,  0.4183,  0.7177,  0.3509,  0.3816,  0.4277,
         0.2448,  0.8487,  0.7865,  0.3395,  0.6892,  0.5057,  0.5755,
         0.8976,  0.8888,  0.5310,  0.3047,  0.8804,  0.6313,  0.7686,
         0.7997,  0.3012,  0.7158,  0.3779,  0.4378,  0.8729,  0.4679,
         0.2084,  0.8559,  0.7186,  0.2821,  0.6331,  0.8252,  0.5261,
         0.8472,  0.4932,  0.7211,  0.4003,  0.4003,  0.8442,  0.3897,
         0.4640,  0.8348,  0.2541,  0.2444,  0.4294,  0.5973,  0.4420,
         0.5745,  0.8459,  0.6835,  0.1567,  0.6552,  0.2949,  0.8745,
         0.3493,  0.8152,  0.7582,  0.2755,  0.3687,  0.7817,  0.4162,
         0.6552,  0.5763,  0.3366,  0.7931,  0.8259,  0.2409,  0.3768,
         0.4662,  0.4452,  0.8707,  0.5392,  0.8695,  0.8112,  0.3475,
         0.3792,  0.8436,  0.6993,  0.4589,  0.5380,  0.3122,  0.8490,
         0.7514,  0.6478,  0.8829,  0.8056,  0.8236,  0.4318,  0.8378,
         0.4993,  0.2464,  0.4773,  0.8872,  0.4077,  0.7924,  0.2170,
         0.8448,  0.3367,  0.3935,  0.6547,  0.6336,  0.2105,  0.5180,
         0.8325,  0.7411,  0.4217,  0.6562,  0.8172,  0.3799,  0.1673,
         0.6168,  0.8635,  0.8479,  0.2480,  0.2580,  0.2507,  0.6475,
         0.3142,  0.7556,  0.8913,  0.4852,  0.5134,  0.8187,  0.3477,
         0.2196,  0.3407,  0.4077,  0.2920,  0.7084,  0.5294,  0.1284,
         0.5844,  0.8075,  0.2462,  0.3785,  0.1964,  0.6903,  0.6011,
         0.3284,  0.8372,  0.2732,  0.3125,  0.8678,  0.2700,  0.3942,
         0.4938,  0.2806,  0.8099,  0.1983,  0.3374,  0.4801,  0.2720,
         0.3404,  0.7762,  0.8670,  0.8451,  0.7068,  0.8471,  0.2878,
         0.4650,  0.7562,  0.5147,  0.3572,  0.3686,  0.3240,  0.8011,
         0.6168,  0.7360,  0.3558,  0.2912,  0.8378,  0.5492,  0.6072,
         0.2789,  0.5706,  0.8766,  0.2346,  0.8567,  0.3668,  0.7291,
         0.7211,  0.8968,  0.7435,  0.8844,  0.3488,  0.2061,  0.7893,
         0.5375,  0.8569,  0.3243,  0.1613,  0.8215,  0.7970,  0.2894,
         0.5729], device='cuda:0')
tensor(0.6092, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2879,  0.4165,  0.7188,  0.2744,  0.2321,  0.8288,  0.5340,
         0.3104,  0.3653,  0.6163,  0.4388,  0.7747,  0.8404,  0.8403,
         0.8122,  0.6855,  0.3924,  0.2769,  0.2507,  0.6967,  0.1091,
         0.3157,  0.7966,  0.7889,  0.7541,  0.7539,  0.8574,  0.3286,
         0.2846,  0.2419,  0.3960,  0.3120,  0.2465,  0.6376,  0.1962,
         0.1815,  0.7903,  0.5411,  0.4387,  0.6032,  0.6177,  0.3823,
         0.7879,  0.6462,  0.6531,  0.2817,  0.8567,  0.3624,  0.4083,
         0.7081,  0.3628,  0.8277,  0.5805,  0.1874,  0.3633,  0.8851,
         0.2423,  0.3227,  0.3925,  0.3238,  0.6544,  0.7809,  0.2222,
         0.8148,  0.4846,  0.7967,  0.7979,  0.3464,  0.2182,  0.3108,
         0.7378,  0.8628,  0.8597,  0.7850,  0.4199,  0.4461,  0.4681,
         0.7129,  0.4673,  0.4364,  0.1626,  0.6822,  0.2478,  0.7059,
         0.1115,  0.3105,  0.5821,  0.5272,  0.5039,  0.1652,  0.8337,
         0.5152,  0.1869,  0.3942,  0.2407,  0.3186,  0.3546,  0.2028,
         0.7705,  0.4463,  0.4153,  0.2916,  0.7660,  0.5780,  0.3658,
         0.6742,  0.7282,  0.8402,  0.8669,  0.3060,  0.3706,  0.2907,
         0.5928,  0.8051,  0.7874,  0.7083,  0.6872,  0.2659,  0.1943,
         0.6040,  0.1863,  0.3198,  0.1933,  0.2400,  0.3747,  0.2056,
         0.2852,  0.8379,  0.8628,  0.2562,  0.5296,  0.3326,  0.7826,
         0.8232,  0.2722,  0.5115,  0.5099,  0.3116,  0.6432,  0.8020,
         0.5559,  0.2263,  0.8171,  0.3047,  0.8895,  0.5186,  0.7610,
         0.8084,  0.3797,  0.3338,  0.7799,  0.3876,  0.3644,  0.4889,
         0.5536,  0.8880,  0.3088,  0.5266,  0.6464,  0.7947,  0.5293,
         0.1793,  0.3021,  0.7209,  0.8135,  0.3652,  0.3525,  0.5970,
         0.9083,  0.2278,  0.7562,  0.5676,  0.3714,  0.3327,  0.1835,
         0.6939,  0.2469,  0.7501,  0.5155,  0.2672,  0.2409,  0.6132,
         0.1698,  0.7715,  0.4618,  0.8476,  0.5523,  0.2699,  0.5995,
         0.7420,  0.5925,  0.5717,  0.3172,  0.5297,  0.3008,  0.2197,
         0.1577,  0.3912,  0.2976,  0.6359,  0.4098,  0.3390,  0.5353,
         0.8597,  0.3038,  0.5534,  0.3040,  0.5565,  0.8151,  0.3206,
         0.7569,  0.7506,  0.3081,  0.2715,  0.6524,  0.2294,  0.8372,
         0.4270,  0.3574,  0.4253,  0.2737,  0.2769,  0.6855,  0.6595,
         0.7434,  0.3034,  0.5476,  0.8934,  0.6166,  0.8040,  0.2907,
         0.6502,  0.4896,  0.4606,  0.5320,  0.2447,  0.7651,  0.9351,
         0.8280,  0.6202,  0.2962,  0.4202,  0.5861,  0.8344,  0.8673,
         0.3241,  0.4032,  0.3743,  0.2514,  0.3032,  0.4888,  0.4026,
         0.3489,  0.8365,  0.4233,  0.3831,  0.3533,  0.3821,  0.4454,
         0.5599,  0.7236,  0.3113,  0.7493,  0.9539,  0.3741,  0.8033,
         0.8980,  0.7591,  0.3069,  0.8882,  0.4316,  0.3495,  0.7364,
         0.7779,  0.3281,  0.7048,  0.7613,  0.1574,  0.8086,  0.2866,
         0.6912,  0.8548,  0.2977,  0.7118,  0.6393,  0.2539,  0.2505,
         0.2994,  0.4053,  0.6386,  0.5246,  0.6181,  0.7453,  0.1793,
         0.5588,  0.5087,  0.3893,  0.7726,  0.3168,  0.8627,  0.5339,
         0.7747,  0.3103,  0.2983,  0.8536,  0.3273,  0.3955,  0.6787,
         0.2633,  0.8425,  0.8503,  0.2588,  0.8294,  0.3000,  0.6633,
         0.5404,  0.3621,  0.4413,  0.4677,  0.5418,  0.8565,  0.8915,
         0.2094,  0.2364,  0.7885,  0.2449,  0.8994,  0.8302,  0.3662,
         0.7675,  0.6691,  0.4427,  0.4087,  0.8340,  0.3468,  0.7535,
         0.7055,  0.2568,  0.8773,  0.8316,  0.2574,  0.2924,  0.9369,
         0.7416,  0.2562,  0.5645,  0.3641,  0.4535,  0.3482,  0.8456,
         0.1984,  0.3405,  0.1824,  0.7945,  0.6234,  0.7992,  0.3937,
         0.7190,  0.6986,  0.3095,  0.3672,  0.8387,  0.2377,  0.3952,
         0.4221,  0.3124,  0.2899,  0.2664,  0.8781,  0.2437,  0.8099,
         0.8384,  0.3421,  0.7284,  0.3475,  0.3618,  0.7861,  0.3842,
         0.4236,  0.6176,  0.3480,  0.8052,  0.5580,  0.8270,  0.3835,
         0.2678,  0.5203,  0.2105,  0.3256,  0.2826,  0.1322,  0.8701,
         0.1600,  0.7220,  0.2255,  0.4775,  0.6788,  0.1753,  0.6148,
         0.7479,  0.2705,  0.3382,  0.3862,  0.8065,  0.2352,  0.7636,
         0.2841,  0.1316,  0.6578,  0.4162,  0.2707,  0.2756,  0.4154,
         0.2870,  0.8862,  0.2972,  0.7517,  0.7525,  0.7194,  0.8159,
         0.4635,  0.3586,  0.7731,  0.3395,  0.3643,  0.4050,  0.7561,
         0.2390,  0.6711,  0.8267,  0.1782,  0.7823,  0.3870,  0.3303,
         0.2748,  0.5928,  0.6280,  0.8580,  0.2686,  0.3391,  0.7362,
         0.8770,  0.8114,  0.8324,  0.1987,  0.7254,  0.6581,  0.3364,
         0.8293,  0.7831,  0.2148,  0.3522,  0.3387,  0.6263,  0.3251,
         0.5904,  0.4530,  0.6816,  0.7338,  0.1607,  0.3247,  0.9465,
         0.3897,  0.3735,  0.4293,  0.8219,  0.4212,  0.5009,  0.7614,
         0.7936,  0.1882,  0.3115,  0.3685,  0.4861,  0.4548,  0.3795,
         0.7877,  0.4030,  0.2250,  0.8325,  0.8481,  0.5872,  0.3748,
         0.6822,  0.7856,  0.2266,  0.2199,  0.1868,  0.3577,  0.4124,
         0.6269,  0.7573,  0.3501,  0.5705,  0.6853,  0.5863,  0.6750,
         0.3582,  0.3727,  0.4454,  0.8732,  0.3353,  0.5299,  0.1072,
         0.5215,  0.7322,  0.2400,  0.6773,  0.2782,  0.9447,  0.4692,
         0.2323], device='cuda:0')
tensor(0.5962, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5665,  0.4164,  0.7622,  0.9473,  0.3775,  0.9017,  0.2662,
         0.8885,  0.6240,  0.4817,  0.3418,  0.6632,  0.5628,  0.6453,
         0.3300,  0.4790,  0.5318,  0.3327,  0.6746,  0.4613,  0.8761,
         0.4979,  0.1231,  0.2434,  0.2506,  0.8284,  0.6670,  0.7405,
         0.5272,  0.5849,  0.3214,  0.3757,  0.5180,  0.5305,  0.8803,
         0.4087,  0.8005,  0.5667,  0.3290,  0.2796,  0.8721,  0.7345,
         0.7252,  0.3756,  0.7672,  0.2108,  0.8555,  0.8457,  0.4849,
         0.1841,  0.2002,  0.7065,  0.3054,  0.5750,  0.4151,  0.4441,
         0.5973,  0.2247,  0.6395,  0.6984,  0.6088,  0.3042,  0.3614,
         0.4455,  0.2951,  0.4633,  0.1462,  0.2385,  0.6952,  0.3379,
         0.2197,  0.3273,  0.1257,  0.6764,  0.3986,  0.4279,  0.3306,
         0.6481,  0.4478,  0.2536,  0.1841,  0.5791,  0.2749,  0.8052,
         0.2946,  0.2964,  0.6966,  0.5831,  0.6273,  0.4374,  0.6154,
         0.7862,  0.5149,  0.8044,  0.2011,  0.3063,  0.4914,  0.5281,
         0.7069,  0.6008,  0.3152,  0.3470,  0.8751,  0.4458,  0.7467,
         0.3706,  0.2035,  0.6651,  0.3573,  0.4060,  0.2846,  0.4388,
         0.5658,  0.5106,  0.2241,  0.3527,  0.5143,  0.3278,  0.7679,
         0.8422,  0.7106,  0.7649,  0.7661,  0.6805,  0.7612,  0.2163,
         0.4768,  0.4565,  0.3982,  0.4706,  0.2970,  0.7680,  0.3619,
         0.4400,  0.3620,  0.6750,  0.4933,  0.7884,  0.8558,  0.7232,
         0.6344,  0.4204,  0.2081,  0.7062,  0.6454,  0.7145,  0.2751,
         0.7646,  0.3378,  0.2566,  0.3893,  0.7081,  0.5416,  0.7923,
         0.3453,  0.3947,  0.4128,  0.6503,  0.7866,  0.4535,  0.1913,
         0.6661,  0.3228,  0.2658,  0.2340,  0.8708,  0.5700,  0.7114,
         0.2956,  0.4153,  0.2904,  0.5617,  0.7750,  0.6614,  0.3403,
         0.6619,  0.4080,  0.3587,  0.6371,  0.5389,  0.3061,  0.7775,
         0.4088,  0.2763,  0.9621,  0.9253,  0.2940,  0.7907,  0.8377,
         0.1261,  0.4754,  0.2585,  0.3291,  0.6926,  0.8001,  0.7121,
         0.4647,  0.3549,  0.7104,  0.8477,  0.1502,  0.3806,  0.8525,
         0.5905,  0.4625,  0.4493,  0.3413,  0.1797,  0.5016,  0.6452,
         0.5215,  0.5818,  0.5402,  0.2835,  0.2909,  0.2349,  0.2251,
         0.2528,  0.4712,  0.7037,  0.5973,  0.1081,  0.1195,  0.3126,
         0.5669,  0.3463,  0.5074,  0.4482,  0.4099,  0.3926,  0.3707,
         0.6378,  0.3128,  0.8265,  0.4059,  0.7429,  0.6643,  0.8673,
         0.3032,  0.1781,  0.1757,  0.3327,  0.8999,  0.2686,  0.5215,
         0.3288,  0.4082,  0.3887,  0.7853,  0.5877,  0.4298,  0.7361,
         0.2982,  0.2699,  0.2477,  0.3432,  0.6049,  0.2465,  0.2418,
         0.4782,  0.8856,  0.4032,  0.2970,  0.5938,  0.5847,  0.2966,
         0.3720,  0.2727,  0.3834,  0.2954,  0.3932,  0.6951,  0.7453,
         0.3025,  0.4396,  0.4278,  0.8761,  0.8081,  0.1441,  0.4251,
         0.4112,  0.7531,  0.9361,  0.2878,  0.4854,  0.2323,  0.7476,
         0.4004,  0.2912,  0.1985,  0.7796,  0.4719,  0.2428,  0.2463,
         0.8883,  0.3797,  0.7267,  0.6276,  0.5014,  0.4382,  0.4228,
         0.6177,  0.3426,  0.5080,  0.4765,  0.2386,  0.4197,  0.6754,
         0.3688,  0.4007,  0.1489,  0.8467,  0.5262,  0.5739,  0.5364,
         0.7257,  0.8508,  0.4357,  0.3939,  0.6792,  0.3802,  0.5804,
         0.3750,  0.7519,  0.3590,  0.2145,  0.3868,  0.4490,  0.2745,
         0.7181,  0.4083,  0.2718,  0.8809,  0.2833,  0.7121,  0.1606,
         0.4444,  0.7742,  0.6853,  0.3213,  0.5280,  0.4817,  0.4776,
         0.5577,  0.7557,  0.3429,  0.3679,  0.6920,  0.4555,  0.2755,
         0.3094,  0.3315,  0.3701,  0.2344,  0.4208,  0.5259,  0.4549,
         0.3743,  0.2746,  0.8713,  0.2107,  0.2029,  0.3261,  0.7169,
         0.7168,  0.8279,  0.3631,  0.7460,  0.8036,  0.5028,  0.2537,
         0.2134,  0.2672,  0.6873,  0.7397,  0.2203,  0.2761,  0.5352,
         0.3420,  0.1653,  0.5827,  0.6194,  0.4454,  0.4141,  0.4541,
         0.3499,  0.6776,  0.4075,  0.1728,  0.8307,  0.7826,  0.3528,
         0.2749,  0.1916,  0.8010,  0.7834,  0.3939,  0.2031,  0.6352,
         0.3865,  0.6539,  0.2567,  0.2122,  0.5938,  0.3971,  0.1870,
         0.8714,  0.7632,  0.3603,  0.1229,  0.1655,  0.5549,  0.3511,
         0.5306,  0.3617,  0.3564,  0.8186,  0.1569,  0.4685,  0.7148,
         0.1940,  0.6739,  0.6458,  0.4157,  0.3053,  0.5567,  0.4928,
         0.7711,  0.4200,  0.6031,  0.4205,  0.5354,  0.5047,  0.4376,
         0.9683,  0.7628,  0.5442,  0.2425,  0.5671,  0.8708,  0.2926,
         0.2541,  0.2802,  0.5103,  0.3165,  0.3563,  0.6731,  0.1884,
         0.7502,  0.6525,  0.2890,  0.2664,  0.3634,  0.7673,  0.2537,
         0.8047,  0.6707,  0.6745,  0.3077,  0.5280,  0.4377,  0.8399,
         0.3638,  0.8941,  0.2073,  0.3619,  0.7330,  0.2933,  0.4870,
         0.9519,  0.3590,  0.4271,  0.2974,  0.7359,  0.4222,  0.7890,
         0.2048,  0.2174,  0.8448,  0.4134,  0.8475,  0.4447,  0.7773,
         0.3141,  0.2633,  0.1996,  0.3450,  0.2230,  0.3259,  0.3545,
         0.2741,  0.3054,  0.7336,  0.2438,  0.3116,  0.3931,  0.3947,
         0.5809,  0.9282,  0.3057,  0.4424,  0.3294,  0.5691,  0.4461,
         0.7098,  0.8694,  0.2685,  0.1770,  0.8726,  0.8457,  0.5822,
         0.5310], device='cuda:0')
tensor(0.5657, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6669,  0.2795,  0.5464,  0.8803,  0.7492,  0.5548,  0.2552,
         0.6042,  0.7932,  0.8075,  0.6878,  0.3901,  0.3452,  0.5425,
         0.3099,  0.6484,  0.4017,  0.8070,  0.2883,  0.3344,  0.4620,
         0.4841,  0.8040,  0.7974,  0.5215,  0.4181,  0.8136,  0.2502,
         0.6568,  0.2681,  0.4052,  0.4871,  0.2951,  0.4437,  0.5362,
         0.7372,  0.3971,  0.4677,  0.4808,  0.3084,  0.6211,  0.2642,
         0.4270,  0.3968,  0.2973,  0.6801,  0.5131,  0.6783,  0.4848,
         0.7747,  0.9351,  0.5569,  0.3498,  0.8220,  0.3547,  0.7253,
         0.3669,  0.4367,  0.2496,  0.2370,  0.6367,  0.2407,  0.5566,
         0.5876,  0.7288,  0.2501,  0.7250,  0.6807,  0.3763,  0.3699,
         0.7997,  0.7793,  0.3510,  0.2459,  0.3191,  0.4560,  0.3627,
         0.5731,  0.2746,  0.7559,  0.4954,  0.4262,  0.9343,  0.2834,
         0.7162,  0.7601,  0.7184,  0.2808,  0.7244,  0.2157,  0.2395,
         0.3632,  0.3709,  0.2326,  0.8704,  0.2290,  0.8181,  0.3730,
         0.3499,  0.5268,  0.2850,  0.8536,  0.3075,  0.8912,  0.4624,
         0.7365,  0.3481,  0.7729,  0.3916,  0.2807,  0.6049,  0.2961,
         0.3528,  0.3025,  0.2534,  0.6351,  0.2351,  0.4278,  0.4479,
         0.4456,  0.6306,  0.7268,  0.3787,  0.6501,  0.2384,  0.7300,
         0.3460,  0.7043,  0.2919,  0.3687,  0.5240,  0.3413,  0.4374,
         0.2894,  0.6508,  0.3803,  0.4638,  0.2913,  0.4476,  0.8296,
         0.8093,  0.3409,  0.6201,  0.7668,  0.6861,  0.3424,  0.4722,
         0.8893,  0.6483,  0.6322,  0.2401,  0.6456,  0.7513,  0.3709,
         0.4385,  0.8593,  0.5350,  0.2578,  0.2596,  0.2940,  0.8004,
         0.6300,  0.5370,  0.8573,  0.3799,  0.2061,  0.2743,  0.4433,
         0.6733,  0.7642,  0.5763,  0.2397,  0.2845,  0.4497,  0.5574,
         0.2867,  0.3643,  0.3631,  0.6526,  0.7654,  0.8143,  0.3895,
         0.3610,  0.7241,  0.3514,  0.4618,  0.7652,  0.3220,  0.6335,
         0.3159,  0.8870,  0.5308,  0.3387,  0.2894,  0.5380,  0.2720,
         0.7857,  0.7512,  0.8244,  0.8230,  0.1761,  0.8406,  0.8043,
         0.5792,  0.3467,  0.4027,  0.3598,  0.4199,  0.2524,  0.7478,
         0.6299,  0.6261,  0.7823,  0.5285,  0.6652,  0.7663,  0.5279,
         0.4156,  0.5135,  0.7564,  0.4241,  0.4728,  0.5651,  0.3820,
         0.5400,  0.7572,  0.4955,  0.4563,  0.4918,  0.5469,  0.2790,
         0.4477,  0.7069,  0.7976,  0.4584,  0.6570,  0.8823,  0.4047,
         0.6802,  0.6177,  0.7769,  0.3749,  0.5383,  0.6513,  0.5234,
         0.8131,  0.8099,  0.8719,  0.4067,  0.3303,  0.8121,  0.2876,
         0.6530,  0.6299,  0.8496,  0.7816,  0.8344,  0.4794,  0.6872,
         0.4223,  0.4968,  0.3280,  0.5129,  0.9365,  0.2871,  0.8342,
         0.3855,  0.8871,  0.3354,  0.3116,  0.4167,  0.3128,  0.6310,
         0.2074,  0.1812,  0.6441,  0.8433,  0.8771,  0.6273,  0.8002,
         0.6267,  0.5078,  0.5110,  0.2454,  0.4033,  0.5135,  0.7296,
         0.4216,  0.5988,  0.5995,  0.2268,  0.4191,  0.4846,  0.8445,
         0.4189,  0.7275,  0.6895,  0.6881,  0.4270,  0.6844,  0.3187,
         0.1677,  0.8240,  0.9080,  0.4424,  0.3947,  0.7707,  0.8626,
         0.3449,  0.3581,  0.2972,  0.7644,  0.7212,  0.7667,  0.2411,
         0.3359,  0.4671,  0.3867,  0.5275,  0.9354,  0.7108,  0.4070,
         0.7651,  0.4999,  0.6101,  0.2633,  0.8827,  0.2872,  0.7267,
         0.6703,  0.6534,  0.4493,  0.2430,  0.8185,  0.5873,  0.3751,
         0.4163,  0.8534,  0.3536,  0.1943,  0.6453,  0.2829,  0.4604,
         0.4043,  0.8198,  0.2296,  0.2993,  0.6528,  0.3878,  0.3711,
         0.7975,  0.2687,  0.3366,  0.7639,  0.3118,  0.7111,  0.7482,
         0.5350,  0.3593,  0.3953,  0.6597,  0.3366,  0.7532,  0.3002,
         0.5611,  0.6910,  0.8854,  0.7302,  0.8071,  0.7249,  0.7957,
         0.4917,  0.5366,  0.7774,  0.7595,  0.5141,  0.8308,  0.5352,
         0.7237,  0.4294,  0.1971,  0.3508,  0.2290,  0.4532,  0.6556,
         0.2110,  0.4794,  0.7509,  0.6578,  0.8028,  0.4089,  0.2302,
         0.6548,  0.7949,  0.3197,  0.2329,  0.3158,  0.3108,  0.6278,
         0.2818,  0.8483,  0.1562,  0.5275,  0.2417,  0.7423,  0.4463,
         0.2084,  0.7540,  0.7551,  0.3170,  0.7985,  0.6394,  0.6891,
         0.7291,  0.6889,  0.6661,  0.7087,  0.6023,  0.2603,  0.8733,
         0.4167,  0.3962,  0.1710,  0.3375,  0.7503,  0.7936,  0.3777,
         0.7060,  0.5503,  0.8267,  0.2202,  0.2818,  0.7624,  0.5354,
         0.3898,  0.1684,  0.4156,  0.8325,  0.4933,  0.4147,  0.3732,
         0.6099,  0.6448,  0.2884,  0.4416,  0.2247,  0.1820,  0.8636,
         0.2143,  0.7763,  0.3523,  0.3277,  0.6446,  0.3744,  0.4248,
         0.8054,  0.1387,  0.6250,  0.5386,  0.7739,  0.8815,  0.6582,
         0.6226,  0.3450,  0.7454,  0.8463,  0.3422,  0.4706,  0.2954,
         0.8132,  0.3361,  0.4036,  0.8568,  0.3255,  0.7043,  0.7996,
         0.1735,  0.4383,  0.5202,  0.3244,  0.7761,  0.5436,  0.4181,
         0.8973,  0.4947,  0.6593,  0.3196,  0.1804,  0.2376,  0.7787,
         0.4892,  0.4225,  0.4957,  0.7475,  0.2631,  0.9336,  0.2842,
         0.6265,  0.2697,  0.3018,  0.4285,  0.2684,  0.5896,  0.3938,
         0.5251,  0.7824,  0.8406,  0.7962,  0.4119,  0.8270,  0.6123,
         0.2784], device='cuda:0')
tensor(0.6191, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5994,  0.2193,  0.7969,  0.8267,  0.5507,  0.3697,  0.4052,
         0.6704,  0.2569,  0.8496,  0.1783,  0.7543,  0.2377,  0.3658,
         0.6458,  0.1643,  0.4520,  0.4381,  0.8241,  0.2380,  0.8772,
         0.6108,  0.8867,  0.8147,  0.3056,  0.6822,  0.2921,  0.4437,
         0.9733,  0.8553,  0.2232,  0.4352,  0.3536,  0.4748,  0.7739,
         0.8377,  0.8350,  0.1795,  0.2539,  0.4978,  0.7100,  0.3971,
         0.7006,  0.6698,  0.7863,  0.7698,  0.7107,  0.7643,  0.4261,
         0.7629,  0.8726,  0.3352,  0.5089,  0.8439,  0.2847,  0.7937,
         0.6290,  0.7527,  0.1841,  0.7144,  0.2668,  0.3723,  0.2427,
         0.6031,  0.4118,  0.2037,  0.3804,  0.9126,  0.4985,  0.7634,
         0.9543,  0.7443,  0.4431,  0.3098,  0.7354,  0.2642,  0.6605,
         0.2898,  0.4158,  0.6660,  0.6442,  0.2951,  0.8431,  0.1181,
         0.4814,  0.9391,  0.3674,  0.9250,  0.3792,  0.2443,  0.4228,
         0.7275,  0.3579,  0.2856,  0.8288,  0.4832,  0.7624,  0.6544,
         0.8427,  0.8293,  0.7941,  0.3816,  0.6944,  0.2546,  0.2241,
         0.8190,  0.7634,  0.7034,  0.2056,  0.3520,  0.6007,  0.5440,
         0.8180,  0.7096,  0.2030,  0.6407,  0.5591,  0.6654,  0.8238,
         0.3665,  0.9408,  0.2772,  0.8387,  0.8721,  0.4605,  0.6452,
         0.4297,  0.3359,  0.4077,  0.3965,  0.7789,  0.7807,  0.3355,
         0.5612,  0.7396,  0.6587,  0.8622,  0.7035,  0.2681,  0.7664,
         0.9290,  0.8039,  0.4498,  0.4653,  0.2509,  0.2587,  0.6626,
         0.3846,  0.2574,  0.6845,  0.1366,  0.4533,  0.8737,  0.6909,
         0.5097,  0.4439,  0.2413,  0.5004,  0.5947,  0.5141,  0.4021,
         0.4647,  0.8653,  0.2281,  0.7878,  0.5793,  0.7923,  0.3574,
         0.4784,  0.5688,  0.4049,  0.1470,  0.6722,  0.7560,  0.4521,
         0.8127,  0.7670,  0.8025,  0.6778,  0.3394,  0.4564,  0.5973,
         0.8061,  0.2902,  0.1888,  0.7235,  0.4207,  0.3606,  0.4980,
         0.1957,  0.7212,  0.3986,  0.5003,  0.2858,  0.7846,  0.2455,
         0.7359,  0.5799,  0.2802,  0.2119,  0.3291,  0.2837,  0.5200,
         0.4253,  0.6393,  0.9143,  0.7267,  0.8506,  0.8499,  0.5332,
         0.2344,  0.7865,  0.3105,  0.3205,  0.7939,  0.1568,  0.6540,
         0.6873,  0.2914,  0.8508,  0.5127,  0.8191,  0.7749,  0.2900,
         0.1742,  0.4375,  0.7181,  0.7803,  0.5059,  0.8424,  0.6069,
         0.3318,  0.6352,  0.7992,  0.5934,  0.7896,  0.2124,  0.7470,
         0.5383,  0.4443,  0.9498,  0.3000,  0.8154,  0.7867,  0.6425,
         0.8081,  0.4182,  0.7995,  0.2506,  0.4958,  0.6488,  0.3282,
         0.4850,  0.7601,  0.3347,  0.7922,  0.6948,  0.4129,  0.4293,
         0.4155,  0.3397,  0.5726,  0.3284,  0.3149,  0.8383,  0.8603,
         0.4515,  0.6821,  0.7570,  0.6105,  0.5865,  0.1970,  0.0755,
         0.8809,  0.6835,  0.8254,  0.3340,  0.4841,  0.3096,  0.2831,
         0.3182,  0.5242,  0.1009,  0.4458,  0.2492,  0.6502,  0.2396,
         0.2122,  0.7665,  0.7002,  0.8178,  0.2094,  0.5910,  0.2178,
         0.7411,  0.6022,  0.7988,  0.7864,  0.5212,  0.6872,  0.6830,
         0.4921,  0.5234,  0.6675,  0.7923,  0.0911,  0.2241,  0.7269,
         0.2341,  0.2951,  0.8196,  0.3389,  0.8379,  0.7743,  0.5563,
         0.8886,  0.4575,  0.4401,  0.7413,  0.5520,  0.1664,  0.9054,
         0.7409,  0.8557,  0.6709,  0.8364,  0.4823,  0.7084,  0.9335,
         0.3456,  0.3081,  0.7232,  0.7881,  0.8217,  0.3363,  0.3908,
         0.3359,  0.2852,  0.8777,  0.2892,  0.2174,  0.7086,  0.7773,
         0.3724,  0.3879,  0.2353,  0.5376,  0.8264,  0.4892,  0.5599,
         0.4666,  0.7822,  0.4590,  0.4171,  0.5351,  0.2870,  0.3831,
         0.2934,  0.4674,  0.3740,  0.3030,  0.3546,  0.7852,  0.5632,
         0.6916,  0.3852,  0.7487,  0.6640,  0.7970,  0.3273,  0.1389,
         0.2842,  0.7799,  0.1456,  0.5523,  0.4827,  0.3719,  0.6397,
         0.7111,  0.4369,  0.7827,  0.4307,  0.8039,  0.3042,  0.6066,
         0.6167,  0.5899,  0.5943,  0.6722,  0.7407,  0.5723,  0.2048,
         0.6837,  0.7398,  0.5619,  0.7584,  0.2871,  0.5636,  0.7730,
         0.8611,  0.7290,  0.2975,  0.7532,  0.7189,  0.3955,  0.9601,
         0.7602,  0.2605,  0.4665,  0.3421,  0.6874,  0.5275,  0.6513,
         0.3289,  0.7129,  0.8387,  0.1636,  0.2978,  0.2699,  0.3069,
         0.5592,  0.7441,  0.4573,  0.8298,  0.4924,  0.1121,  0.6837,
         0.3550,  0.5485,  0.6762,  0.3602,  0.7361,  0.4750,  0.8494,
         0.9560,  0.3556,  0.7861,  0.6047,  0.2184,  0.4149,  0.2569,
         0.3974,  0.3537,  0.2978,  0.8278,  0.7788,  0.5453,  0.2170,
         0.2787,  0.7321,  0.6119,  0.7010,  0.2265,  0.3769,  0.7154,
         0.3395,  0.6623,  0.6801,  0.2842,  0.5969,  0.2742,  0.6903,
         0.7095,  0.2461,  0.3435,  0.2713,  0.6876,  0.3714,  0.3453,
         0.4735,  0.9353,  0.6706,  0.5313,  0.6584,  0.1426,  0.3005,
         0.7358,  0.7274,  0.3226,  0.5421,  0.1431,  0.6233,  0.2890,
         0.2916,  0.2032,  0.4874,  0.7692,  0.2547,  0.3769,  0.3497,
         0.2490,  0.9531,  0.5001,  0.3391,  0.2452,  0.6874,  0.3281,
         0.5267,  0.8810,  0.7621,  0.7966,  0.2989,  0.5938,  0.7054,
         0.7852,  0.3267,  0.2631,  0.7089,  0.6173,  0.7628,  0.5596,
         0.2408], device='cuda:0')
tensor(0.5694, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7468,  0.7551,  0.7071,  0.6057,  0.2366,  0.3983,  0.8010,
         0.4324,  0.7285,  0.2559,  0.4913,  0.2990,  0.5275,  0.5982,
         0.3261,  0.7412,  0.5090,  0.3023,  0.2767,  0.5473,  0.7810,
         0.4873,  0.4127,  0.3332,  0.3439,  0.2911,  0.4826,  0.7588,
         0.2701,  0.3777,  0.2914,  0.4572,  0.4396,  0.8568,  0.8259,
         0.4350,  0.3166,  0.9363,  0.3887,  0.2107,  0.2172,  0.3624,
         0.7391,  0.3188,  0.1177,  0.7474,  0.5771,  0.3886,  0.6303,
         0.5225,  0.4575,  0.4105,  0.3299,  0.3485,  0.4800,  0.2914,
         0.4250,  0.5431,  0.3118,  0.3898,  0.7249,  0.5181,  0.3128,
         0.6700,  0.2855,  0.2776,  0.8297,  0.1763,  0.4653,  0.7446,
         0.5518,  0.4829,  0.7235,  0.7998,  0.4209,  0.2870,  0.2644,
         0.1784,  0.7493,  0.2022,  0.6588,  0.3878,  0.3923,  0.3713,
         0.4142,  0.3558,  0.1536,  0.3483,  0.3859,  0.6394,  0.2597,
         0.3979,  0.2862,  0.2574,  0.4013,  0.6577,  0.4651,  0.5539,
         0.3236,  0.6478,  0.2943,  0.4140,  0.7389,  0.2429,  0.7921,
         0.4013,  0.5632,  0.5299,  0.3924,  0.6663,  0.5742,  0.2796,
         0.2376,  0.1208,  0.3659,  0.4930,  0.5897,  0.3607,  0.5633,
         0.5616,  0.2442,  0.8159,  0.5861,  0.3097,  0.6415,  0.5957,
         0.3149,  0.2506,  0.3310,  0.3478,  0.4948,  0.7726,  0.1620,
         0.2529,  0.5097,  0.3202,  0.4727,  0.2748,  0.6066,  0.5591,
         0.7198,  0.5443,  0.5740,  0.2586,  0.6039,  0.3845,  0.6831,
         0.5613,  0.6946,  0.8307,  0.3651,  0.5203,  0.7177,  0.6774,
         0.2837,  0.4449,  0.4712,  0.3198,  0.3621,  0.7401,  0.5672,
         0.5612,  0.7517,  0.3197,  0.2721,  0.8311,  0.5403,  0.3335,
         0.5918,  0.3196,  0.3471,  0.2335,  0.4817,  0.5717,  0.4927,
         0.4640,  0.7207,  0.2312,  0.2197,  0.6384,  0.3967,  0.3270,
         0.0848,  0.5375,  0.5498,  0.6263,  0.6808,  0.2435,  0.3626,
         0.3616,  0.4559,  0.5289,  0.3324,  0.3326,  0.2395,  0.4070,
         0.4405,  0.6044,  0.1907,  0.3779,  0.2910,  0.8408,  0.2436,
         0.4469,  0.7052,  0.1099,  0.6612,  0.4743,  0.4491,  0.3299,
         0.2243,  0.5488,  0.2211,  0.8421,  0.4882,  0.5485,  0.2776,
         0.4670,  0.6184,  0.6032,  0.4042,  0.1606,  0.6738,  0.3762,
         0.1908,  0.3089,  0.7032,  0.3828,  0.4993,  0.2201,  0.3696,
         0.7371,  0.4006,  0.5844,  0.2403,  0.3680,  0.4152,  0.7893,
         0.8202,  0.3262,  0.2947,  0.4574,  0.5346,  0.7049,  0.3062,
         0.5677,  0.2543,  0.2257,  0.7316,  0.2941,  0.2897,  0.6969,
         0.5773,  0.3407,  0.3009,  0.3883,  0.5996,  0.6245,  0.2957,
         0.3772,  0.5833,  0.3499,  0.4661,  0.6741,  0.3339,  0.8113,
         0.4556,  0.7893,  0.4953,  0.2027,  0.6830,  0.6996,  0.6036,
         0.3690,  0.3581,  0.7158,  0.2499,  0.6773,  0.3646,  0.2343,
         0.2985,  0.7811,  0.6480,  0.4775,  0.3278,  0.4696,  0.3027,
         0.7511,  0.3457,  0.6821,  0.2998,  0.5429,  0.3111,  0.2471,
         0.7685,  0.1851,  0.3245,  0.2856,  0.7076,  0.3545,  0.5565,
         0.4280,  0.4538,  0.6872,  0.3251,  0.6093,  0.3847,  0.7551,
         0.3486,  0.5232,  0.7211,  0.4442,  0.7561,  0.4430,  0.5136,
         0.2831,  0.3515,  0.5375,  0.7162,  0.4957,  0.4655,  0.2831,
         0.3006,  0.5189,  0.2913,  0.2950,  0.5684,  0.5091,  0.6096,
         0.7798,  0.2567,  0.8347,  0.2329,  0.4971,  0.7555,  0.6012,
         0.2941,  0.6029,  0.4486,  0.4624,  0.6608,  0.2291,  0.7457,
         0.6634,  0.2689,  0.8170,  0.3732,  0.5439,  0.4034,  0.2912,
         0.2532,  0.4579,  0.7533,  0.3349,  0.5618,  0.3575,  0.6905,
         0.5446,  0.8134,  0.3831,  0.6024,  0.2056,  0.4360,  0.3864,
         0.3974,  0.1213,  0.2651,  0.7700,  0.3032,  0.5790,  0.7729,
         0.3272,  0.5957,  0.6507,  0.8871,  0.2342,  0.4441,  0.7535,
         0.3739,  0.4121,  0.3452,  0.3898,  0.6638,  0.1500,  0.2754,
         0.7094,  0.3266,  0.5280,  0.5116,  0.5706,  0.5920,  0.3508,
         0.7918,  0.3071,  0.7782,  0.3680,  0.8241,  0.5537,  0.4314,
         0.3209,  0.4790,  0.2088,  0.4285,  0.3199,  0.5147,  0.8114,
         0.5954,  0.7705,  0.5333,  0.7035,  0.3678,  0.3034,  0.5087,
         0.2290,  0.6312,  0.5503,  0.6271,  0.2029,  0.4616,  0.4275,
         0.8963,  0.7637,  0.1864,  0.1937,  0.8486,  0.1820,  0.8104,
         0.2579,  0.2771,  0.7965,  0.4170,  0.5082,  0.7930,  0.4352,
         0.7303,  0.3600,  0.3686,  0.8383,  0.6414,  0.3837,  0.6099,
         0.3700,  0.6192,  0.2773,  0.2942,  0.3100,  0.6727,  0.7762,
         0.7685,  0.1916,  0.3354,  0.6255,  0.6640,  0.6757,  0.5649,
         0.5725,  0.6007,  0.3800,  0.2941,  0.3673,  0.7704,  0.6242,
         0.6775,  0.2935,  0.6112,  0.4070,  0.7541,  0.1620,  0.6758,
         0.4790,  0.2593,  0.4831,  0.3194,  0.4586,  0.3593,  0.2919,
         0.3537,  0.9160,  0.2530,  0.6703,  0.4027,  0.6844,  0.5865,
         0.7621,  0.2521,  0.2734,  0.3555,  0.7191,  0.3622,  0.5273,
         0.9653,  0.2597,  0.7974,  0.2505,  0.2681,  0.5744,  0.7016,
         0.2824,  0.6253,  0.3485,  0.7659,  0.6427,  0.2353,  0.7745,
         0.7052,  0.5140,  0.2453,  0.6058,  0.3933,  0.5575,  0.5295,
         0.4549], device='cuda:0')
tensor(0.5812, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5341,  0.6714,  0.5033,  0.5035,  0.3737,  0.4422,  0.3593,
         0.8583,  0.3469,  0.2615,  0.7971,  0.7764,  0.7750,  0.7368,
         0.2852,  0.9164,  0.3037,  0.4469,  0.6680,  0.6666,  0.5416,
         0.4888,  0.3573,  0.2958,  0.5772,  0.7660,  0.4319,  0.5215,
         0.5923,  0.3995,  0.3925,  0.4281,  0.8749,  0.1756,  0.5344,
         0.8262,  0.1895,  0.6356,  0.2433,  0.4323,  0.4877,  0.5077,
         0.5705,  0.5724,  0.4451,  0.5372,  0.2797,  0.2654,  0.4698,
         0.4016,  0.1425,  0.2338,  0.3566,  0.5045,  0.4351,  0.4580,
         0.5256,  0.3685,  0.5011,  0.3351,  0.6405,  0.2663,  0.7737,
         0.3976,  0.4306,  0.3431,  0.2712,  0.6860,  0.3569,  0.8459,
         0.3978,  0.3265,  0.4035,  0.2761,  0.3905,  0.1558,  0.7360,
         0.2806,  0.3602,  0.6223,  0.4223,  0.3827,  0.6093,  0.3832,
         0.4825,  0.4154,  0.2875,  0.3313,  0.5402,  0.7635,  0.2863,
         0.7377,  0.4325,  0.2617,  0.3325,  0.1310,  0.3500,  0.4297,
         0.4866,  0.7410,  0.6929,  0.3417,  0.2696,  0.3824,  0.4956,
         0.8224,  0.1898,  0.6950,  0.6174,  0.3090,  0.5075,  0.3346,
         0.5624,  0.6758,  0.2828,  0.4372,  0.4415,  0.3497,  0.6270,
         0.5361,  0.3623,  0.4341,  0.2997,  0.6764,  0.5301,  0.2522,
         0.5855,  0.7730,  0.7398,  0.3743,  0.4173,  0.2801,  0.2979,
         0.4973,  0.3385,  0.3547,  0.7175,  0.3642,  0.5055,  0.3579,
         0.3214,  0.4334,  0.6050,  0.0953,  0.8507,  0.2729,  0.4095,
         0.4855,  0.2836,  0.2368,  0.3800,  0.1209,  0.3719,  0.3511,
         0.6093,  0.5211,  0.4500,  0.4303,  0.6067,  0.6523,  0.3745,
         0.6755,  0.6556,  0.4728,  0.4767,  0.3221,  0.2020,  0.2274,
         0.3977,  0.1882,  0.8195,  0.2055,  0.6138,  0.6464,  0.4273,
         0.3852,  0.5150,  0.5860,  0.8022,  0.1514,  0.4208,  0.7025,
         0.1431,  0.1422,  0.3062,  0.2455,  0.2527,  0.2935,  0.6290,
         0.2209,  0.2398,  0.6905,  0.2044,  0.5803,  0.6913,  0.6040,
         0.2728,  0.2066,  0.4511,  0.3533,  0.2334,  0.6037,  0.7307,
         0.4062,  0.3006,  0.5057,  0.2745,  0.4828,  0.4895,  0.1670,
         0.3572,  0.3661,  0.5085,  0.4499,  0.5452,  0.2235,  0.2071,
         0.6067,  0.7291,  0.3384,  0.2650,  0.3845,  0.4809,  0.2531,
         0.5355,  0.8170,  0.7121,  0.6541,  0.3056,  0.2907,  0.3214,
         0.5937,  0.2438,  0.8731,  0.2648,  0.4254,  0.2942,  0.2543,
         0.2369,  0.4406,  0.4763,  0.4430,  0.2414,  0.4739,  0.5612,
         0.2710,  0.2987,  0.6032,  0.2691,  0.4770,  0.7131,  0.4487,
         0.5440,  0.4568,  0.7322,  0.4303,  0.5455,  0.2965,  0.3407,
         0.4714,  0.5552,  0.4321,  0.5221,  0.2888,  0.5426,  0.2837,
         0.3371,  0.5643,  0.3563,  0.2551,  0.3014,  0.5838,  0.2715,
         0.3777,  0.5092,  0.4738,  0.2293,  0.6547,  0.5294,  0.6645,
         0.6815,  0.5735,  0.7014,  0.3512,  0.7301,  0.2772,  0.3914,
         0.4901,  0.3971,  0.7800,  0.2700,  0.5414,  0.3856,  0.4749,
         0.3718,  0.5626,  0.5025,  0.4566,  0.5700,  0.2505,  0.5100,
         0.2896,  0.3535,  0.3175,  0.4654,  0.3497,  0.2934,  0.2003,
         0.3883,  0.3237,  0.4648,  0.6947,  0.2682,  0.2752,  0.3344,
         0.2644,  0.1588,  0.4218,  0.5588,  0.2045,  0.6855,  0.4077,
         0.3095,  0.3486,  0.5445,  0.6631,  0.4838,  0.5966,  0.2023,
         0.3470,  0.3393,  0.2794,  0.3406,  0.7832,  0.3196,  0.4539,
         0.2411,  0.2908,  0.4639,  0.2824,  0.5768,  0.3909,  0.4984,
         0.3273,  0.3251,  0.4581,  0.2884,  0.6250,  0.3528,  0.1693,
         0.6215,  0.4670,  0.4112,  0.6482,  0.6621,  0.3464,  0.5134,
         0.2931,  0.5821,  0.7375,  0.3942,  0.4025,  0.1210,  0.2281,
         0.3004,  0.1223,  0.2742,  0.7113,  0.5609,  0.3665,  0.8136,
         0.4227,  0.3143,  0.2112,  0.4236,  0.6759,  0.3696,  0.7483,
         0.1599,  0.4105,  0.7095,  0.7144,  0.4523,  0.5728,  0.1036,
         0.2030,  0.3028,  0.6901,  0.3616,  0.5934,  0.2405,  0.3030,
         0.2074,  0.2927,  0.3551,  0.4228,  0.5506,  0.6397,  0.7054,
         0.4516,  0.6023,  0.1744,  0.4299,  0.5564,  0.4759,  0.3308,
         0.3693,  0.3595,  0.5040,  0.7307,  0.4521,  0.7511,  0.7604,
         0.5955,  0.6901,  0.4518,  0.4625,  0.7515,  0.3492,  0.8684,
         0.2893,  0.4709,  0.5095,  0.6813,  0.2838,  0.6334,  0.5070,
         0.3566,  0.2759,  0.4688,  0.2300,  0.3169,  0.1982,  0.3138,
         0.2058,  0.4165,  0.2193,  0.3582,  0.2100,  0.5792,  0.1412,
         0.6599,  0.3532,  0.2166,  0.3026,  0.2860,  0.4419,  0.4343,
         0.7062,  0.3698,  0.5404,  0.7041,  0.4186,  0.2293,  0.4055,
         0.1847,  0.3378,  0.5088,  0.5524,  0.5198,  0.5225,  0.2345,
         0.5229,  0.5727,  0.3131,  0.3696,  0.6960,  0.2956,  0.2525,
         0.3094,  0.2481,  0.3436,  0.2376,  0.3420,  0.4606,  0.2222,
         0.4431,  0.3998,  0.2472,  0.5907,  0.2267,  0.1913,  0.3529,
         0.3845,  0.2963,  0.4935,  0.2692,  0.3239,  0.5452,  0.2007,
         0.3796,  0.2366,  0.6320,  0.7717,  0.6370,  0.3679,  0.6847,
         0.7155,  0.7069,  0.3737,  0.8928,  0.3095,  0.4275,  0.7718,
         0.4679,  0.5613,  0.1715,  0.4709,  0.3465,  0.3555,  0.5925,
         0.2994], device='cuda:0')
tensor(0.6056, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5528,  0.3047,  0.2215,  0.5841,  0.1187,  0.4190,  0.7110,
         0.4397,  0.4434,  0.2862,  0.5963,  0.3037,  0.6796,  0.2303,
         0.5599,  0.5282,  0.3116,  0.4027,  0.4627,  0.5638,  0.6113,
         0.3777,  0.4471,  0.5899,  0.1619,  0.6510,  0.3242,  0.2556,
         0.4459,  0.3611,  0.5151,  0.2020,  0.5128,  0.3646,  0.4987,
         0.6542,  0.2540,  0.4438,  0.4823,  0.4760,  0.5376,  0.5360,
         0.5391,  0.6822,  0.2852,  0.4121,  0.3648,  0.4284,  0.1865,
         0.2437,  0.3919,  0.2854,  0.3738,  0.4281,  0.5544,  0.4229,
         0.7569,  0.3044,  0.3673,  0.5640,  0.1825,  0.7011,  0.2733,
         0.7584,  0.3721,  0.4177,  0.2835,  0.6145,  0.3446,  0.5279,
         0.4810,  0.6928,  0.5145,  0.2654,  0.5793,  0.3417,  0.1986,
         0.5598,  0.5608,  0.3657,  0.5463,  0.7137,  0.4843,  0.3648,
         0.6516,  0.6256,  0.4800,  0.4514,  0.1023,  0.4456,  0.5981,
         0.6866,  0.5522,  0.3247,  0.5394,  0.6131,  0.6776,  0.3266,
         0.8513,  0.3823,  0.1997,  0.5737,  0.6475,  0.2163,  0.2813,
         0.3049,  0.5597,  0.2779,  0.5054,  0.3364,  0.1771,  0.6401,
         0.5491,  0.4179,  0.2950,  0.4181,  0.7132,  0.3016,  0.6820,
         0.3842,  0.6505,  0.3876,  0.7076,  0.2697,  0.2325,  0.7078,
         0.1757,  0.3280,  0.5833,  0.3670,  0.2790,  0.4048,  0.5260,
         0.6049,  0.4190,  0.4705,  0.3817,  0.1977,  0.2846,  0.4513,
         0.6715,  0.4072,  0.1784,  0.3996,  0.2644,  0.3153,  0.3333,
         0.2708,  0.3129,  0.2374,  0.7870,  0.4163,  0.1145,  0.5785,
         0.8050,  0.3587,  0.4010,  0.3803,  0.4694,  0.3827,  0.4002,
         0.4219,  0.1618,  0.3041,  0.7188,  0.3520,  0.3507,  0.7032,
         0.3820,  0.6401,  0.5841,  0.2661,  0.1872,  0.1769,  0.3083,
         0.2016,  0.1694,  0.3342,  0.4640,  0.6966,  0.5625,  0.4439,
         0.6436,  0.4294,  0.3219,  0.3057,  0.5319,  0.3480,  0.2919,
         0.3204,  0.4693,  0.8048,  0.3422,  0.3250,  0.4224,  0.2938,
         0.6818,  0.6112,  0.3616,  0.3927,  0.2565,  0.7478,  0.5684,
         0.3859,  0.3020,  0.2871,  0.5666,  0.3339,  0.6925,  0.6224,
         0.4275,  0.4275,  0.4480,  0.6980,  0.4550,  0.4983,  0.4633,
         0.1799,  0.4791,  0.4716,  0.3679,  0.6681,  0.3229,  0.2624,
         0.3229,  0.5707,  0.2075,  0.3456,  0.1849,  0.9422,  0.1865,
         0.3997,  0.3936,  0.9531,  0.3741,  0.4532,  0.4520,  0.4109,
         0.6403,  0.5084,  0.2877,  0.6721,  0.2140,  0.3755,  0.3553,
         0.4788,  0.4573,  0.4945,  0.5109,  0.4280,  0.6928,  0.3326,
         0.4293,  0.6668,  0.8184,  0.7404,  0.2176,  0.6271,  0.2871,
         0.3228,  0.7085,  0.8373,  0.2771,  0.5979,  0.4762,  0.2676,
         0.5666,  0.2829,  0.2868,  0.3755,  0.5436,  0.6709,  0.8014,
         0.1890,  0.5981,  0.3939,  0.4486,  0.4697,  0.1945,  0.5858,
         0.5088,  0.2623,  0.6872,  0.4221,  0.6587,  0.4570,  0.6779,
         0.4034,  0.2552,  0.5788,  0.3094,  0.5397,  0.3900,  0.3431,
         0.5408,  0.2473,  0.4733,  0.5197,  0.7421,  0.3954,  0.6808,
         0.4904,  0.2379,  0.5887,  0.3190,  0.2813,  0.3998,  0.3540,
         0.4272,  0.2329,  0.5003,  0.2221,  0.4161,  0.7456,  0.6782,
         0.6629,  0.4031,  0.9397,  0.3918,  0.5701,  0.2925,  0.3628,
         0.2669,  0.7928,  0.2123,  0.6052,  0.4983,  0.3710,  0.6362,
         0.2574,  0.6200,  0.2857,  0.2832,  0.5265,  0.5186,  0.1826,
         0.5260,  0.5203,  0.0904,  0.4318,  0.1246,  0.5187,  0.3855,
         0.3281,  0.6132,  0.7646,  0.8470,  0.2415,  0.7763,  0.2604,
         0.7324,  0.2041,  0.5259,  0.2882,  0.4462,  0.2646,  0.3387,
         0.7157,  0.6605,  0.5197,  0.4842,  0.2712,  0.1524,  0.3365,
         0.2286,  0.5407,  0.7728,  0.3628,  0.8522,  0.3295,  0.4988,
         0.3611,  0.4930,  0.5492,  0.2649,  0.4215,  0.2626,  0.2677,
         0.5193,  0.1154,  0.5928,  0.8100,  0.5679,  0.3274,  0.8382,
         0.7219,  0.4341,  0.2013,  0.2162,  0.6597,  0.6059,  0.3906,
         0.1991,  0.1749,  0.2119,  0.2930,  0.7557,  0.6302,  0.3330,
         0.4613,  0.5797,  0.4838,  0.4764,  0.4429,  0.7633,  0.7034,
         0.6060,  0.6045,  0.5555,  0.5052,  0.4095,  0.5460,  0.7101,
         0.7030,  0.7139,  0.1830,  0.5311,  0.4423,  0.7544,  0.2853,
         0.6716,  0.2743,  0.3575,  0.4833,  0.5567,  0.4452,  0.4153,
         0.6860,  0.2299,  0.2117,  0.1785,  0.4174,  0.4493,  0.2647,
         0.3548,  0.5778,  0.2036,  0.5042,  0.7059,  0.4917,  0.5704,
         0.5139,  0.4632,  0.6987,  0.4633,  0.2156,  0.3187,  0.5401,
         0.3866,  0.3420,  0.2835,  0.6310,  0.2391,  0.3439,  0.4150,
         0.5088,  0.6841,  0.3489,  0.1994,  0.2600,  0.2189,  0.5767,
         0.5832,  0.7198,  0.4130,  0.4814,  0.2328,  0.1792,  0.6160,
         0.7337,  0.2582,  0.3877,  0.2163,  0.2847,  0.1846,  0.5367,
         0.3375,  0.2577,  0.3827,  0.4303,  0.2037,  0.5035,  0.3766,
         0.5700,  0.5904,  0.3261,  0.4565,  0.6830,  0.2961,  0.4516,
         0.5598,  0.4847,  0.2837,  0.8179,  0.5083,  0.6777,  0.2628,
         0.3668,  0.3786,  0.3436,  0.2949,  0.3004,  0.3228,  0.4803,
         0.6311,  0.4144,  0.2604,  0.2856,  0.7508,  0.5702,  0.3276,
         0.4516], device='cuda:0')
tensor(0.5779, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4470,  0.2374,  0.8938,  0.4531,  0.3421,  0.5303,  0.6879,
         0.1509,  0.5872,  0.4697,  0.4820,  0.3654,  0.8412,  0.6373,
         0.6733,  0.4314,  0.2924,  0.2341,  0.5575,  0.2341,  0.6508,
         0.4428,  0.7604,  0.3189,  0.3455,  0.2093,  0.4807,  0.1955,
         0.3241,  0.3509,  0.2765,  0.3507,  0.3355,  0.7424,  0.1400,
         0.3207,  0.1179,  0.3617,  0.3419,  0.6002,  0.3021,  0.2857,
         0.1690,  0.7879,  0.4284,  0.2309,  0.1640,  0.3442,  0.3688,
         0.5560,  0.2217,  0.4744,  0.3800,  0.2817,  0.2796,  0.5240,
         0.3358,  0.5098,  0.2263,  0.3293,  0.2696,  0.5985,  0.7897,
         0.5778,  0.2676,  0.5447,  0.3472,  0.5923,  0.5570,  0.3354,
         0.2291,  0.2884,  0.7788,  0.1986,  0.5768,  0.3483,  0.4818,
         0.5051,  0.5883,  0.2636,  0.2742,  0.3004,  0.3398,  0.4284,
         0.5998,  0.2727,  0.2338,  0.5166,  0.2823,  0.7283,  0.4450,
         0.3856,  0.5363,  0.8630,  0.8924,  0.3482,  0.6009,  0.4731,
         0.3899,  0.6333,  0.2014,  0.1921,  0.6714,  0.3551,  0.3465,
         0.2935,  0.2345,  0.7120,  0.2166,  0.2704,  0.3291,  0.5279,
         0.2795,  0.6218,  0.5234,  0.3736,  0.2470,  0.5716,  0.5844,
         0.3040,  0.3170,  0.2742,  0.8038,  0.4619,  0.7514,  0.2443,
         0.3201,  0.1542,  0.4042,  0.2897,  0.6427,  0.2627,  0.6947,
         0.6835,  0.4277,  0.2584,  0.6534,  0.5612,  0.4788,  0.1657,
         0.4128,  0.1534,  0.4137,  0.6081,  0.2315,  0.4812,  0.4886,
         0.2788,  0.4104,  0.7214,  0.3027,  0.5711,  0.4271,  0.2900,
         0.2626,  0.5417,  0.7703,  0.7066,  0.3655,  0.4464,  0.6848,
         0.3080,  0.3930,  0.6129,  0.7073,  0.2469,  0.8313,  0.3988,
         0.6445,  0.3615,  0.4240,  0.5651,  0.3205,  0.4449,  0.4179,
         0.4449,  0.4845,  0.8196,  0.5078,  0.2835,  0.2054,  0.3925,
         0.5084,  0.4515,  0.7688,  0.3648,  0.5439,  0.6326,  0.6983,
         0.6284,  0.3091,  0.6052,  0.3521,  0.4737,  0.3213,  0.2480,
         0.3367,  0.4374,  0.2286,  0.4294,  0.6304,  0.3838,  0.4502,
         0.7866,  0.3901,  0.4237,  0.4493,  0.6318,  0.4063,  0.3588,
         0.6428,  0.7115,  0.5851,  0.1747,  0.2669,  0.7030,  0.4389,
         0.5703,  0.4562,  0.4938,  0.2011,  0.4572,  0.3556,  0.3446,
         0.5612,  0.4336,  0.4101,  0.7439,  0.9203,  0.7236,  0.6947,
         0.1921,  0.4879,  0.5420,  0.4647,  0.7125,  0.4605,  0.5522,
         0.2952,  0.7515,  0.4053,  0.5510,  0.4445,  0.4363,  0.3065,
         0.4916,  0.7736,  0.4178,  0.6742,  0.5144,  0.7360,  0.3880,
         0.2011,  0.4653,  0.4259,  0.3459,  0.4481,  0.3484,  0.1789,
         0.7424,  0.2319,  0.4037,  0.5109,  0.3643,  0.2195,  0.3261,
         0.7199,  0.1981,  0.6223,  0.3771,  0.2178,  0.4416,  0.2406,
         0.2638,  0.6379,  0.3720,  0.3693,  0.4201,  0.3980,  0.3941,
         0.6711,  0.8773,  0.4774,  0.3687,  0.5028,  0.6581,  0.1906,
         0.2658,  0.3984,  0.3961,  0.1980,  0.3043,  0.4281,  0.5795,
         0.3036,  0.5246,  0.7587,  0.3283,  0.8062,  0.4235,  0.4405,
         0.2503,  0.4174,  0.4872,  0.3881,  0.1242,  0.6181,  0.2154,
         0.9540,  0.2000,  0.3532,  0.7086,  0.3500,  0.3986,  0.5378,
         0.3260,  0.4976,  0.2643,  0.7844,  0.5986,  0.5257,  0.6864,
         0.3811,  0.6126,  0.3768,  0.3061,  0.2781,  0.5613,  0.3060,
         0.8247,  0.1819,  0.3899,  0.3552,  0.5313,  0.1936,  0.3780,
         0.1807,  0.2154,  0.4885,  0.3837,  0.6152,  0.3574,  0.9107,
         0.3303,  0.9243,  0.5668,  0.2304,  0.1393,  0.2295,  0.3231,
         0.3439,  0.6735,  0.3359,  0.2702,  0.4122,  0.4096,  0.5967,
         0.6061,  0.3177,  0.4113,  0.4752,  0.5783,  0.2460,  0.1696,
         0.5252,  0.3877,  0.4593,  0.5943,  0.2684,  0.5232,  0.2293,
         0.5513,  0.2064,  0.3479,  0.4836,  0.3667,  0.7423,  0.5044,
         0.5518,  0.5036,  0.2595,  0.3453,  0.5424,  0.6775,  0.2580,
         0.3862,  0.5190,  0.2517,  0.2857,  0.4305,  0.3014,  0.5911,
         0.6612,  0.5083,  0.6160,  0.1487,  0.3303,  0.3365,  0.7529,
         0.3390,  0.7554,  0.7207,  0.6223,  0.3521,  0.2180,  0.6793,
         0.2993,  0.5062,  0.2425,  0.5378,  0.5547,  0.7305,  0.8340,
         0.5531,  0.2496,  0.3699,  0.4747,  0.6496,  0.2171,  0.2182,
         0.6309,  0.4841,  0.1067,  0.6973,  0.4290,  0.1973,  0.8538,
         0.5461,  0.0894,  0.6878,  0.7289,  0.2989,  0.2764,  0.5404,
         0.6449,  0.3454,  0.6229,  0.3378,  0.5364,  0.3608,  0.4002,
         0.7515,  0.4169,  0.5090,  0.3814,  0.2768,  0.3677,  0.1868,
         0.2707,  0.5035,  0.2677,  0.6123,  0.4367,  0.5836,  0.3149,
         0.4949,  0.4487,  0.6367,  0.7383,  0.3594,  0.1152,  0.5860,
         0.2109,  0.2263,  0.3555,  0.5201,  0.2238,  0.4197,  0.6935,
         0.4216,  0.1489,  0.7530,  0.1967,  0.3921,  0.3691,  0.3612,
         0.2924,  0.6481,  0.3449,  0.4796,  0.8396,  0.2370,  0.5984,
         0.6472,  0.5229,  0.3296,  0.3869,  0.1050,  0.2006,  0.8294,
         0.7062,  0.8378,  0.4611,  0.1771,  0.3131,  0.4161,  0.5647,
         0.3050,  0.2318,  0.3856,  0.4816,  0.3901,  0.3393,  0.6406,
         0.8508,  0.4566,  0.4960,  0.6869,  0.4262,  0.3340,  0.7088,
         0.4040], device='cuda:0')
tensor(0.5801, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6927,  0.4361,  0.6313,  0.7472,  0.5135,  0.5580,  0.5813,
         0.2288,  0.5163,  0.7989,  0.7394,  0.5588,  0.2827,  0.4435,
         0.3732,  0.4370,  0.4887,  0.9429,  0.3282,  0.2802,  0.1495,
         0.6476,  0.2412,  0.5497,  0.4892,  0.4424,  0.2711,  0.7787,
         0.7199,  0.5625,  0.4393,  0.1537,  0.6740,  0.2154,  0.6603,
         0.6489,  0.2912,  0.3166,  0.2298,  0.4670,  0.6924,  0.3002,
         0.5265,  0.4624,  0.4245,  0.3863,  0.6171,  0.4190,  0.8944,
         0.3064,  0.5093,  0.7272,  0.2119,  0.3734,  0.3832,  0.7276,
         0.6880,  0.7953,  0.3665,  0.3434,  0.2942,  0.5715,  0.2759,
         0.7368,  0.4503,  0.3600,  0.2114,  0.3598,  0.3115,  0.7387,
         0.6038,  0.8487,  0.6926,  0.2832,  0.4969,  0.3582,  0.2996,
         0.5270,  0.8206,  0.4581,  0.5824,  0.2752,  0.5475,  0.6276,
         0.5405,  0.2277,  0.6286,  0.2374,  0.3103,  0.4769,  0.2578,
         0.2420,  0.8047,  0.3093,  0.8067,  0.5395,  0.7882,  0.3663,
         0.4574,  0.5091,  0.5844,  0.2316,  0.5215,  0.3365,  0.5775,
         0.2335,  0.3510,  0.4140,  0.4817,  0.5930,  0.3300,  0.7370,
         0.2720,  0.3843,  0.2190,  0.5209,  0.4834,  0.5000,  0.5263,
         0.1665,  0.6125,  0.4109,  0.7131,  0.3559,  0.4665,  0.5573,
         0.6257,  0.6672,  0.3785,  0.2867,  0.8290,  0.1736,  0.5494,
         0.2843,  0.4728,  0.4602,  0.4030,  0.7828,  0.7005,  0.7395,
         0.6444,  0.5988,  0.4855,  0.2677,  0.2253,  0.2875,  0.7132,
         0.6483,  0.6037,  0.3926,  0.9036,  0.8333,  0.8184,  0.4566,
         0.2147,  0.5427,  0.5563,  0.4952,  0.4575,  0.3538,  0.5860,
         0.3240,  0.2662,  0.4463,  0.2455,  0.3072,  0.2812,  0.1365,
         0.5379,  0.7017,  0.5009,  0.5921,  0.3638,  0.2690,  0.6051,
         0.3171,  0.4082,  0.7085,  0.4973,  0.7227,  0.7196,  0.3330,
         0.3661,  0.6799,  0.3797,  0.3303,  0.3356,  0.3852,  0.7351,
         0.3825,  0.3495,  0.5933,  0.5967,  0.4295,  0.3336,  0.7175,
         0.2762,  0.6692,  0.4787,  0.2380,  0.5437,  0.4154,  0.6381,
         0.4260,  0.3354,  0.9094,  0.2343,  0.5355,  0.7514,  0.2553,
         0.2672,  0.8834,  0.3894,  0.6752,  0.6115,  0.1531,  0.1740,
         0.3554,  0.8222,  0.2966,  0.4483,  0.1863,  0.3968,  0.2110,
         0.8611,  0.7346,  0.6867,  0.4674,  0.2339,  0.5827,  0.2622,
         0.8140,  0.4798,  0.5830,  0.2736,  0.7910,  0.3984,  0.3805,
         0.1864,  0.7104,  0.2140,  0.5182,  0.2764,  0.3379,  0.6025,
         0.5672,  0.1701,  0.3237,  0.7853,  0.7668,  0.4334,  0.4784,
         0.5944,  0.8937,  0.4957,  0.2992,  0.6688,  0.1850,  0.5061,
         0.3871,  0.4227,  0.2174,  0.2842,  0.6216,  0.2877,  0.7538,
         0.1127,  0.7260,  0.4937,  0.1964,  0.2718,  0.2191,  0.2691,
         0.5482,  0.5325,  0.7456,  0.6107,  0.6293,  0.6239,  0.2640,
         0.2773,  0.1085,  0.6529,  0.2603,  0.4653,  0.7045,  0.8101,
         0.2903,  0.7382,  0.3004,  0.5853,  0.1491,  0.7023,  0.4355,
         0.6353,  0.3799,  0.4581,  0.6201,  0.5221,  0.2978,  0.4118,
         0.4785,  0.3076,  0.5807,  0.3863,  0.7100,  0.1322,  0.2759,
         0.2743,  0.6783,  0.6187,  0.5738,  0.3803,  0.2791,  0.6439,
         0.2060,  0.6487,  0.5657,  0.4783,  0.3196,  0.5991,  0.3467,
         0.6899,  0.2626,  0.3444,  0.6224,  0.6234,  0.5077,  0.4417,
         0.6939,  0.5475,  0.3763,  0.3593,  0.7394,  0.2703,  0.2820,
         0.4952,  0.3071,  0.4107,  0.7466,  0.4766,  0.6086,  0.2539,
         0.1998,  0.3470,  0.5189,  0.8426,  0.2666,  0.4717,  0.3793,
         0.4418,  0.2883,  0.6375,  0.5884,  0.1801,  0.7437,  0.6612,
         0.2376,  0.7841,  0.4890,  0.5901,  0.8655,  0.3635,  0.3947,
         0.3864,  0.3856,  0.5110,  0.3044,  0.6138,  0.3200,  0.7509,
         0.3543,  0.3073,  0.2638,  0.2907,  0.4527,  0.3145,  0.4525,
         0.7276,  0.5793,  0.5643,  0.2713,  0.5899,  0.5948,  0.4828,
         0.5553,  0.7899,  0.7154,  0.1398,  0.2629,  0.8317,  0.1542,
         0.6371,  0.7116,  0.4975,  0.6650,  0.2165,  0.3793,  0.2665,
         0.2527,  0.3918,  0.1715,  0.2454,  0.5239,  0.3780,  0.6660,
         0.3771,  0.7096,  0.2166,  0.4123,  0.3588,  0.3511,  0.3623,
         0.5367,  0.3190,  0.4395,  0.2697,  0.3000,  0.1769,  0.7603,
         0.4133,  0.2485,  0.2656,  0.5326,  0.4927,  0.2997,  0.1314,
         0.3315,  0.6273,  0.3978,  0.5828,  0.2832,  0.4086,  0.4580,
         0.6715,  0.8140,  0.4446,  0.1366,  0.2180,  0.4282,  0.4412,
         0.2878,  0.7882,  0.4164,  0.2576,  0.3614,  0.3969,  0.3731,
         0.4892,  0.5745,  0.2374,  0.2040,  0.1361,  0.2636,  0.4433,
         0.7297,  0.3038,  0.2828,  0.6567,  0.2517,  0.7782,  0.2659,
         0.0805,  0.7000,  0.3283,  0.7656,  0.4780,  0.4088,  0.5817,
         0.5334,  0.7168,  0.5212,  0.2868,  0.4166,  0.6472,  0.4175,
         0.2037,  0.6680,  0.3900,  0.6202,  0.6485,  0.4580,  0.7601,
         0.6175,  0.5880,  0.3416,  0.8026,  0.5769,  0.4853,  0.5623,
         0.4797,  0.4814,  0.4850,  0.4609,  0.3242,  0.3338,  0.3439,
         0.7246,  0.6580,  0.4023,  0.5986,  0.3296,  0.4248,  0.6177,
         0.6347,  0.4330,  0.5979,  0.3899,  0.4829,  0.3654,  0.7014,
         0.4286], device='cuda:0')
tensor(0.5862, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6804,  0.3811,  0.5349,  0.7647,  0.6070,  0.3784,  0.2227,
         0.2447,  0.6221,  0.5764,  0.3244,  0.4344,  0.3534,  0.6170,
         0.5609,  0.7207,  0.7455,  0.4394,  0.2638,  0.7186,  0.5230,
         0.3189,  0.4338,  0.3062,  0.2062,  0.3363,  0.5448,  0.6063,
         0.7693,  0.6158,  0.5894,  0.4521,  0.7265,  0.6208,  0.2050,
         0.5538,  0.7079,  0.6166,  0.6349,  0.6652,  0.7894,  0.3147,
         0.5610,  0.5301,  0.4236,  0.2834,  0.3417,  0.6561,  0.4919,
         0.2755,  0.5645,  0.6001,  0.2817,  0.3370,  0.1917,  0.3790,
         0.7289,  0.6294,  0.3259,  0.1835,  0.7284,  0.6053,  0.7120,
         0.3841,  0.6041,  0.7501,  0.5853,  0.2727,  0.6580,  0.4862,
         0.3542,  0.7203,  0.6005,  0.7036,  0.7964,  0.4265,  0.5392,
         0.6945,  0.1457,  0.3818,  0.7172,  0.3475,  0.3045,  0.3061,
         0.1817,  0.6330,  0.6434,  0.4122,  0.3398,  0.6388,  0.6383,
         0.3446,  0.8191,  0.6362,  0.7681,  0.3885,  0.6964,  0.1874,
         0.7457,  0.2599,  0.2841,  0.3254,  0.5976,  0.4207,  0.5596,
         0.4479,  0.6404,  0.3003,  0.4297,  0.3414,  0.4209,  0.7709,
         0.3971,  0.6621,  0.6871,  0.8528,  0.4406,  0.2095,  0.3047,
         0.6255,  0.4955,  0.8104,  0.7571,  0.3951,  0.2791,  0.9590,
         0.3373,  0.4547,  0.5703,  0.1082,  0.8227,  0.2944,  0.6164,
         0.3550,  0.4738,  0.7830,  0.6449,  0.4186,  0.2549,  0.6118,
         0.6880,  0.7601,  0.2854,  0.3791,  0.7575,  0.7061,  0.6129,
         0.6777,  0.4163,  0.4201,  0.2499,  0.4212,  0.3302,  0.7959,
         0.6063,  0.7113,  0.2313,  0.6938,  0.6920,  0.4808,  0.3525,
         0.8070,  0.2492,  0.6932,  0.8279,  0.6983,  0.7905,  0.7553,
         0.3072,  0.6675,  0.4352,  0.3833,  0.8025,  0.8796,  0.3912,
         0.2868,  0.4131,  0.2509,  0.7098,  0.7419,  0.6787,  0.7646,
         0.5627,  0.2210,  0.4517,  0.6615,  0.7209,  0.2717,  0.2882,
         0.6445,  0.2938,  0.5553,  0.5959,  0.2133,  0.6954,  0.5843,
         0.2135,  0.3852,  0.5715,  0.3686,  0.3963,  0.7213,  0.7127,
         0.6123,  0.9246,  0.6066,  0.7089,  0.3056,  0.6955,  0.4669,
         0.7661,  0.6667,  0.7409,  0.5127,  0.7905,  0.5920,  0.4804,
         0.7933,  0.3617,  0.7335,  0.3761,  0.2681,  0.6963,  0.2309,
         0.4118,  0.2236,  0.5110,  0.3759,  0.7024,  0.4413,  0.7431,
         0.3169,  0.6923,  0.9220,  0.5519,  0.7219,  0.4683,  0.1379,
         0.7343,  0.4506,  0.6581,  0.5497,  0.6409,  0.6917,  0.6734,
         0.3872,  0.5894,  0.4105,  0.7208,  0.9477,  0.7127,  0.6505,
         0.3030,  0.7226,  0.4731,  0.2336,  0.1688,  0.4266,  0.6449,
         0.6131,  0.2274,  0.6327,  0.2531,  0.7218,  0.5523,  0.2405,
         0.6482,  0.3534,  0.2826,  0.5801,  0.2435,  0.2808,  0.2322,
         0.6370,  0.6333,  0.7186,  0.3944,  0.4813,  0.8404,  0.2413,
         0.2990,  0.3908,  0.1824,  0.3142,  0.8191,  0.7378,  0.3379,
         0.3034,  0.7304,  0.2548,  0.5228,  0.7390,  0.4788,  0.4924,
         0.4523,  0.2735,  0.3102,  0.2924,  0.4939,  0.2889,  0.2196,
         0.5002,  0.5529,  0.4310,  0.4939,  0.7562,  0.3849,  0.7487,
         0.4338,  0.7003,  0.7712,  0.6344,  0.4441,  0.2834,  0.5044,
         0.2094,  0.3686,  0.5333,  0.2688,  0.7206,  0.7320,  0.2180,
         0.3249,  0.1652,  0.7149,  0.3376,  0.4899,  0.6705,  0.5097,
         0.5376,  0.8461,  0.3590,  0.1860,  0.5880,  0.5735,  0.7587,
         0.1167,  0.3144,  0.6621,  0.5477,  0.8399,  0.6651,  0.3218,
         0.6815,  0.7517,  0.5677,  0.4382,  0.1875,  0.4465,  0.7963,
         0.8338,  0.5665,  0.7704,  0.5679,  0.4001,  0.3533,  0.3600,
         0.6595,  0.7874,  0.3667,  0.2220,  0.2744,  0.6976,  0.0740,
         0.3483,  0.6520,  0.4245,  0.2765,  0.6760,  0.7055,  0.5764,
         0.7313,  0.5526,  0.3140,  0.7414,  0.3081,  0.6902,  0.4519,
         0.5364,  0.6505,  0.2912,  0.1433,  0.6308,  0.4149,  0.5389,
         0.7313,  0.9401,  0.2633,  0.3874,  0.4325,  0.1896,  0.1933,
         0.2051,  0.3162,  0.2044,  0.7210,  0.2267,  0.3264,  0.4086,
         0.6753,  0.7795,  0.4108,  0.7271,  0.4410,  0.4154,  0.3730,
         0.6154,  0.6074,  0.4228,  0.3401,  0.8777,  0.2108,  0.2856,
         0.2586,  0.6007,  0.6405,  0.4870,  0.3060,  0.2391,  0.1386,
         0.6905,  0.3951,  0.3338,  0.4834,  0.5767,  0.4912,  0.4174,
         0.2074,  0.5788,  0.4085,  0.4212,  0.3236,  0.4179,  0.6424,
         0.4551,  0.5261,  0.6852,  0.3191,  0.9163,  0.5531,  0.6242,
         0.1748,  0.2268,  0.7852,  0.5326,  0.7701,  0.3857,  0.3233,
         0.7560,  0.4174,  0.5958,  0.3555,  0.3366,  0.6009,  0.6223,
         0.8738,  0.2317,  0.2745,  0.3734,  0.6714,  0.4520,  0.4815,
         0.1653,  0.1812,  0.3321,  0.5715,  0.5980,  0.7255,  0.7888,
         0.5784,  0.2549,  0.3151,  0.6317,  0.5806,  0.1851,  0.6491,
         0.7689,  0.8796,  0.8015,  0.3490,  0.2733,  0.2409,  0.4826,
         0.6565,  0.6900,  0.2874,  0.5113,  0.7201,  0.2077,  0.6313,
         0.7411,  0.7271,  0.1667,  0.7419,  0.2683,  0.2831,  0.4710,
         0.5853,  0.6078,  0.2453,  0.7993,  0.4572,  0.7784,  0.7373,
         0.6811,  0.5812,  0.2868,  0.5389,  0.6374,  0.1875,  0.3251,
         0.6695], device='cuda:0')
tensor(0.5662, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1609,  0.4068,  0.3441,  0.3324,  0.5775,  0.8311,  0.6823,
         0.7907,  0.8065,  0.2202,  0.1679,  0.6478,  0.5292,  0.1241,
         0.7078,  0.8404,  0.3088,  0.7565,  0.5433,  0.6602,  0.2260,
         0.2253,  0.7307,  0.2683,  0.9379,  0.4869,  0.4081,  0.6850,
         0.7215,  0.7770,  0.6495,  0.3541,  0.5788,  0.3410,  0.8013,
         0.8778,  0.7321,  0.2877,  0.2045,  0.5704,  0.7709,  0.2243,
         0.7497,  0.5987,  0.6904,  0.6891,  0.5234,  0.9086,  0.7213,
         0.1835,  0.1117,  0.3203,  0.2460,  0.6578,  0.6612,  0.2564,
         0.6106,  0.5363,  0.1566,  0.5474,  0.1562,  0.6504,  0.3795,
         0.3631,  0.3709,  0.4204,  0.7321,  0.2860,  0.6627,  0.4297,
         0.1941,  0.1585,  0.6936,  0.8561,  0.8318,  0.2230,  0.7097,
         0.6499,  0.7296,  0.7001,  0.7643,  0.6267,  0.6630,  0.7358,
         0.7529,  0.8631,  0.2913,  0.3989,  0.3343,  0.1717,  0.5432,
         0.4743,  0.7743,  0.5856,  0.6361,  0.4228,  0.6268,  0.7083,
         0.8077,  0.5504,  0.0779,  0.2547,  0.2220,  0.2695,  0.3359,
         0.6729,  0.6755,  0.5181,  0.6896,  0.5119,  0.7395,  0.4247,
         0.6924,  0.3664,  0.3411,  0.5037,  0.3200,  0.6722,  0.3737,
         0.3908,  0.7049,  0.2239,  0.7595,  0.5590,  0.4050,  0.7427,
         0.6793,  0.6023,  0.1322,  0.6522,  0.6114,  0.7517,  0.4311,
         0.2680,  0.8152,  0.8715,  0.4974,  0.6820,  0.6959,  0.6185,
         0.4663,  0.6807,  0.7554,  0.5682,  0.7911,  0.1676,  0.2151,
         0.6124,  0.6786,  0.2939,  0.6418,  0.4269,  0.3138,  0.7866,
         0.1513,  0.7757,  0.6987,  0.3914,  0.9125,  0.7236,  0.5809,
         0.5558,  0.3158,  0.8618,  0.7116,  0.3326,  0.3918,  0.1793,
         0.5807,  0.8549,  0.3165,  0.7630,  0.6407,  0.4677,  0.4407,
         0.7463,  0.7915,  0.2721,  0.6715,  0.3582,  0.5436,  0.7856,
         0.5035,  0.5942,  0.4915,  0.5809,  0.5239,  0.7627,  0.7955,
         0.6129,  0.6841,  0.6277,  0.3228,  0.6524,  0.7372,  0.7747,
         0.6201,  0.3439,  0.6221,  0.9048,  0.2291,  0.8304,  0.1855,
         0.5595,  0.6886,  0.7052,  0.7950,  0.5290,  0.2783,  0.2355,
         0.7750,  0.8076,  0.7806,  0.7995,  0.6117,  0.7517,  0.6011,
         0.7511,  0.4000,  0.4340,  0.7172,  0.5560,  0.7062,  0.1595,
         0.7351,  0.8047,  0.8215,  0.5530,  0.5816,  0.9304,  0.8060,
         0.7179,  0.3152,  0.8603,  0.6418,  0.6710,  0.3906,  0.2762,
         0.6092,  0.2806,  0.9177,  0.6748,  0.3630,  0.4426,  0.5533,
         0.7763,  0.5433,  0.6451,  0.3632,  0.3304,  0.4938,  0.2007,
         0.5183,  0.7051,  0.4099,  0.3661,  0.7428,  0.7800,  0.5322,
         0.7255,  0.2180,  0.7073,  0.6270,  0.6122,  0.7812,  0.4806,
         0.3874,  0.6666,  0.5601,  0.3975,  0.5692,  0.7569,  0.5548,
         0.3452,  0.5113,  0.1941,  0.1731,  0.5145,  0.2022,  0.5588,
         0.2807,  0.5737,  0.6701,  0.1861,  0.3567,  0.7098,  0.1691,
         0.0954,  0.3670,  0.7053,  0.7664,  0.1963,  0.7116,  0.8080,
         0.3595,  0.6271,  0.7218,  0.7302,  0.2723,  0.1648,  0.7122,
         0.5508,  0.3537,  0.4989,  0.5846,  0.6192,  0.3209,  0.7209,
         0.7898,  0.3170,  0.7839,  0.7022,  0.7094,  0.5105,  0.7085,
         0.4002,  0.6295,  0.3162,  0.5040,  0.7057,  0.1770,  0.8290,
         0.9264,  0.5512,  0.7642,  0.7087,  0.7711,  0.6174,  0.8583,
         0.2214,  0.4590,  0.8635,  0.6942,  0.7347,  0.8363,  0.2719,
         0.5486,  0.6986,  0.3094,  0.3507,  0.2729,  0.6277,  0.2327,
         0.6807,  0.6010,  0.3686,  0.3862,  0.6157,  0.7241,  0.5627,
         0.6817,  0.8056,  0.2860,  0.5347,  0.5393,  0.5464,  0.5110,
         0.6714,  0.2546,  0.4114,  0.7422,  0.5771,  0.8010,  0.3415,
         0.5316,  0.1608,  0.7504,  0.5923,  0.6617,  0.4667,  0.7116,
         0.7631,  0.1948,  0.4072,  0.1956,  0.3393,  0.6190,  0.6905,
         0.1529,  0.6799,  0.1293,  0.4050,  0.4711,  0.3581,  0.4167,
         0.8587,  0.2601,  0.8351,  0.3290,  0.1224,  0.6066,  0.5446,
         0.5542,  0.1870,  0.4739,  0.4337,  0.1819,  0.8523,  0.5809,
         0.1915,  0.6132,  0.2775,  0.2300,  0.3044,  0.2168,  0.2622,
         0.3512,  0.5182,  0.1345,  0.7055,  0.8158,  0.7219,  0.7647,
         0.2144,  0.8018,  0.5497,  0.4707,  0.7415,  0.5903,  0.1320,
         0.2291,  0.3093,  0.5971,  0.8488,  0.4449,  0.7496,  0.4177,
         0.6439,  0.7988,  0.7793,  0.7257,  0.7921,  0.7348,  0.2073,
         0.7726,  0.6094,  0.7041,  0.6860,  0.7095,  0.6721,  0.4531,
         0.2091,  0.3403,  0.5669,  0.5901,  0.7968,  0.2503,  0.7337,
         0.7730,  0.6938,  0.4947,  0.3007,  0.7625,  0.6854,  0.8588,
         0.7662,  0.6594,  0.4213,  0.7687,  0.6665,  0.3240,  0.8419,
         0.5106,  0.4185,  0.7277,  0.3162,  0.2648,  0.3824,  0.9605,
         0.2787,  0.5937,  0.1476,  0.3840,  0.7221,  0.5220,  0.2929,
         0.7933,  0.1952,  0.6367,  0.4202,  0.6986,  0.6038,  0.4506,
         0.8170,  0.1080,  0.4517,  0.8050,  0.3635,  0.5216,  0.6490,
         0.7267,  0.3682,  0.6647,  0.7818,  0.3504,  0.3733,  0.5570,
         0.5236,  0.7435,  0.2055,  0.5717,  0.7561,  0.3069,  0.4689,
         0.4652,  0.6762,  0.5302,  0.6935,  0.6551,  0.8408,  0.2265,
         0.4047], device='cuda:0')
tensor(0.5745, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2137,  0.6436,  0.6865,  0.7111,  0.3593,  0.1215,  0.2083,
         0.6447,  0.7169,  0.7014,  0.3478,  0.2508,  0.7761,  0.3142,
         0.6673,  0.6729,  0.2051,  0.1828,  0.4399,  0.4786,  0.7240,
         0.7854,  0.9522,  0.8435,  0.1674,  0.1685,  0.1331,  0.3215,
         0.8600,  0.3686,  0.4107,  0.1159,  0.5345,  0.0634,  0.7476,
         0.7439,  0.5201,  0.7169,  0.8009,  0.7905,  0.5684,  0.2800,
         0.6446,  0.3714,  0.7750,  0.6197,  0.3056,  0.3009,  0.7944,
         0.3309,  0.8044,  0.3446,  0.4518,  0.6765,  0.6424,  0.7645,
         0.7240,  0.7445,  0.7895,  0.1894,  0.4191,  0.5657,  0.5299,
         0.8466,  0.6913,  0.7276,  0.8272,  0.7647,  0.2680,  0.7705,
         0.4730,  0.1778,  0.7904,  0.2588,  0.1868,  0.7016,  0.7904,
         0.6405,  0.7241,  0.1343,  0.3480,  0.7733,  0.8142,  0.7641,
         0.4023,  0.7086,  0.7458,  0.6881,  0.6904,  0.7686,  0.5015,
         0.7760,  0.7103,  0.1802,  0.7078,  0.3001,  0.3819,  0.8588,
         0.6698,  0.7718,  0.6262,  0.2825,  0.8165,  0.7182,  0.1879,
         0.7906,  0.8164,  0.7640,  0.1395,  0.7617,  0.1324,  0.6417,
         0.3738,  0.6655,  0.2793,  0.7721,  0.8261,  0.7458,  0.1507,
         0.4206,  0.1850,  0.7047,  0.1972,  0.9497,  0.7183,  0.7440,
         0.7812,  0.3666,  0.2105,  0.7941,  0.9161,  0.8631,  0.5599,
         0.2430,  0.5481,  0.6132,  0.8135,  0.4389,  0.2660,  0.7318,
         0.2216,  0.7239,  0.7267,  0.6066,  0.7490,  0.8140,  0.3036,
         0.6312,  0.6178,  0.1180,  0.1769,  0.7999,  0.8301,  0.1993,
         0.7430,  0.8009,  0.3249,  0.5247,  0.3260,  0.7675,  0.1930,
         0.5597,  0.2961,  0.7501,  0.1088,  0.8337,  0.2987,  0.7420,
         0.1185,  0.6033,  0.2459,  0.6784,  0.4690,  0.5988,  0.5612,
         0.4555,  0.6060,  0.3542,  0.7966,  0.7520,  0.6438,  0.5958,
         0.7714,  0.5586,  0.6037,  0.8646,  0.6386,  0.6986,  0.7309,
         0.8087,  0.7334,  0.1706,  0.6422,  0.3570,  0.7300,  0.2957,
         0.6974,  0.7436,  0.6617,  0.5585,  0.8797,  0.4940,  0.5970,
         0.8533,  0.7592,  0.5659,  0.9463,  0.3049,  0.6898,  0.6116,
         0.5831,  0.3028,  0.6179,  0.8367,  0.4516,  0.7999,  0.2482,
         0.5191,  0.1658,  0.8978,  0.7233,  0.1944,  0.8604,  0.5567,
         0.8020,  0.4852,  0.4297,  0.7654,  0.7952,  0.2251,  0.6929,
         0.1182,  0.3593,  0.7724,  0.6799,  0.4236,  0.1493,  0.6808,
         0.9588,  0.8146,  0.7066,  0.6934,  0.7256,  0.2486,  0.3286,
         0.5672,  0.7957,  0.6411,  0.7431,  0.3275,  0.4033,  0.4393,
         0.5954,  0.3290,  0.1984,  0.6940,  0.6719,  0.7179,  0.3870,
         0.4606,  0.2285,  0.7966,  0.9250,  0.8450,  0.2560,  0.8427,
         0.8233,  0.8590,  0.1713,  0.7151,  0.5723,  0.7853,  0.9000,
         0.6202,  0.9033,  0.4258,  0.5169,  0.6458,  0.3866,  0.1922,
         0.6582,  0.2483,  0.6819,  0.7405,  0.3011,  0.7762,  0.1976,
         0.4311,  0.8032,  0.6805,  0.6987,  0.7889,  0.6840,  0.6439,
         0.7600,  0.1384,  0.1745,  0.2159,  0.1592,  0.3011,  0.2985,
         0.1924,  0.2190,  0.6330,  0.7977,  0.6931,  0.5729,  0.3150,
         0.6328,  0.5409,  0.8974,  0.3423,  0.2359,  0.7560,  0.7338,
         0.2255,  0.1294,  0.4158,  0.7431,  0.1824,  0.6850,  0.7151,
         0.7186,  0.3817,  0.6063,  0.6919,  0.7462,  0.0935,  0.2026,
         0.7676,  0.9615,  0.4180,  0.6420,  0.3676,  0.7415,  0.6709,
         0.5822,  0.8585,  0.5746,  0.7010,  0.2543,  0.2714,  0.7815,
         0.6469,  0.2004,  0.1457,  0.6127,  0.7587,  0.7902,  0.2950,
         0.7969,  0.4221,  0.2815,  0.8460,  0.7226,  0.6317,  0.6645,
         0.6775,  0.7865,  0.8023,  0.1608,  0.2430,  0.7145,  0.7016,
         0.2314,  0.7566,  0.7107,  0.7363,  0.6198,  0.6559,  0.7622,
         0.3551,  0.1761,  0.6002,  0.6358,  0.8495,  0.5082,  0.6274,
         0.3236,  0.8106,  0.9263,  0.6296,  0.7344,  0.3712,  0.8010,
         0.7840,  0.6779,  0.7453,  0.2414,  0.6539,  0.3531,  0.5465,
         0.8529,  0.2510,  0.1620,  0.7052,  0.7222,  0.2885,  0.6922,
         0.4047,  0.2662,  0.5206,  0.8546,  0.2674,  0.2886,  0.1529,
         0.8112,  0.7483,  0.1848,  0.9117,  0.4174,  0.7246,  0.4540,
         0.5983,  0.3696,  0.2627,  0.2601,  0.1121,  0.1028,  0.8309,
         0.5702,  0.2370,  0.6738,  0.7817], device='cuda:0')
tensor(0.5782, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 2, BCELoss: 0.6169814199817424
tensor([ 0.6731,  0.8256,  0.2857,  0.7486,  0.6970,  0.2376,  0.1369,
         0.9338,  0.6126,  0.8532,  0.1974,  0.4537,  0.2415,  0.7621,
         0.1249,  0.5811,  0.3072,  0.6983,  0.5825,  0.1847,  0.7186,
         0.8354,  0.2806,  0.7395,  0.3052,  0.4163,  0.6746,  0.9157,
         0.6776,  0.2907,  0.8622,  0.8871,  0.3786,  0.6233,  0.5137,
         0.1817,  0.7731,  0.7723,  0.3757,  0.2273,  0.7335,  0.7081,
         0.0818,  0.5506,  0.7759,  0.2964,  0.5463,  0.7784,  0.7941,
         0.1621,  0.1794,  0.1983,  0.6996,  0.2276,  0.2586,  0.3195,
         0.4342,  0.6473,  0.3941,  0.8887,  0.4692,  0.6865,  0.2420,
         0.2816,  0.8007,  0.2542,  0.8516,  0.5416,  0.7674,  0.4916,
         0.3333,  0.7683,  0.2567,  0.4021,  0.9598,  0.7868,  0.1502,
         0.2713,  0.4662,  0.4029,  0.1832,  0.7988,  0.6414,  0.1521,
         0.8076,  0.7928,  0.1238,  0.6008,  0.7781,  0.6730,  0.2074,
         0.6164,  0.5909,  0.2557,  0.5914,  0.5479,  0.8084,  0.8389,
         0.2011,  0.3384,  0.6926,  0.4552,  0.6301,  0.8128,  0.6458,
         0.8003,  0.3807,  0.2325,  0.6137,  0.1441,  0.7477,  0.7115,
         0.6954,  0.6794,  0.6681,  0.2019,  0.2135,  0.6376,  0.7712,
         0.6716,  0.6342,  0.9089,  0.7392,  0.1284,  0.1439,  0.2333,
         0.7923,  0.6010,  0.6753,  0.3497,  0.7420,  0.2613,  0.4951,
         0.6563,  0.1089,  0.8877,  0.4193,  0.6935,  0.6878,  0.5804,
         0.2074,  0.6328,  0.8119,  0.6574,  0.5716,  0.5858,  0.3900,
         0.1790,  0.6867,  0.1463,  0.7666,  0.3140,  0.8631,  0.5305,
         0.3889,  0.4274,  0.8202,  0.5349,  0.5397,  0.4323,  0.8227,
         0.8190,  0.7255,  0.5861,  0.6688,  0.6770,  0.7656,  0.7022,
         0.7781,  0.2830,  0.7162,  0.8047,  0.6527,  0.7935,  0.3666,
         0.7693,  0.4216,  0.8001,  0.2649,  0.2187,  0.7369,  0.7595,
         0.9207,  0.8900,  0.7889,  0.1697,  0.7761,  0.8867,  0.5921,
         0.1954,  0.3472,  0.1759,  0.8842,  0.8633,  0.3012,  0.7699,
         0.8501,  0.6687,  0.5442,  0.4867,  0.5786,  0.6757,  0.7833,
         0.7603,  0.2303,  0.7505,  0.5060,  0.2674,  0.7054,  0.7177,
         0.2645,  0.5544,  0.2995,  0.5311,  0.1885,  0.6782,  0.6421,
         0.1714,  0.6573,  0.4508,  0.4761,  0.7777,  0.8920,  0.3852,
         0.1510,  0.8426,  0.5277,  0.7726,  0.7019,  0.7403,  0.9240,
         0.6953,  0.6518,  0.7455,  0.1689,  0.4595,  0.7441,  0.4915,
         0.6964,  0.2758,  0.6725,  0.7657,  0.7398,  0.7224,  0.6636,
         0.7863,  0.1667,  0.1609,  0.6120,  0.8429,  0.7251,  0.8509,
         0.2479,  0.1826,  0.8151,  0.1852,  0.6562,  0.6978,  0.6635,
         0.7523,  0.3184,  0.8256,  0.7666,  0.7054,  0.7018,  0.5078,
         0.7478,  0.1669,  0.8226,  0.2884,  0.2541,  0.1363,  0.2230,
         0.7161,  0.7645,  0.7453,  0.3272,  0.2951,  0.4951,  0.7174,
         0.6824,  0.1549,  0.8033,  0.7256,  0.2452,  0.1612,  0.2762,
         0.3174,  0.7998,  0.7451,  0.3259,  0.2963,  0.6729,  0.2164,
         0.7375,  0.7191,  0.9518,  0.6360,  0.6465,  0.5561,  0.7264,
         0.3520,  0.5645,  0.8298,  0.7665,  0.8845,  0.1302,  0.5307,
         0.7034,  0.7269,  0.3322,  0.5311,  0.8481,  0.5566,  0.4009,
         0.2057,  0.8197,  0.4351,  0.1484,  0.9054,  0.1073,  0.7202,
         0.7253,  0.3737,  0.1632,  0.7529,  0.6888,  0.4841,  0.1488,
         0.8518,  0.4432,  0.1742,  0.1390,  0.4265,  0.1005,  0.6822,
         0.0988,  0.1524,  0.2902,  0.6190,  0.8331,  0.5433,  0.6845,
         0.1553,  0.6857,  0.6981,  0.7854,  0.1487,  0.8081,  0.5454,
         0.3000,  0.7662,  0.8312,  0.6418,  0.2377,  0.2180,  0.7708,
         0.7500,  0.6941,  0.5392,  0.6353,  0.6545,  0.0854,  0.1544,
         0.1570,  0.2985,  0.9443,  0.1877,  0.4344,  0.4637,  0.1525,
         0.7207,  0.7937,  0.6477,  0.2751,  0.3742,  0.4394,  0.4810,
         0.6561,  0.7691,  0.4485,  0.1900,  0.7020,  0.7470,  0.5249,
         0.4035,  0.4818,  0.9515,  0.3651,  0.8285,  0.4691,  0.6358,
         0.1266,  0.2864,  0.6712,  0.7521,  0.5722,  0.2975,  0.6647,
         0.2531,  0.7457,  0.1082,  0.8628,  0.1968,  0.1210,  0.9285,
         0.2492,  0.5122,  0.6358,  0.7529,  0.1558,  0.8320,  0.2548,
         0.6920,  0.1668,  0.5213,  0.8325,  0.0975,  0.6244,  0.5402,
         0.8789,  0.7584,  0.6472,  0.6211,  0.8873,  0.1689,  0.6444,
         0.1620,  0.7360,  0.3289,  0.7113,  0.1900,  0.2890,  0.0947,
         0.6232,  0.6644,  0.7389,  0.6901,  0.2878,  0.7384,  0.7979,
         0.2613,  0.6369,  0.8195,  0.6701,  0.4106,  0.7400,  0.4344,
         0.1741,  0.6909,  0.7537,  0.7527,  0.5075,  0.4116,  0.1604,
         0.7462,  0.5043,  0.9438,  0.7698,  0.5933,  0.5950,  0.6061,
         0.7700,  0.6342,  0.1565,  0.1893,  0.4330,  0.6941,  0.6404,
         0.6051,  0.5773,  0.7901,  0.6697,  0.2150,  0.3320,  0.3376,
         0.6751,  0.4799,  0.6600,  0.8992,  0.5286,  0.5755,  0.1563,
         0.2895,  0.8253,  0.5118,  0.8374,  0.7554,  0.3596,  0.6780,
         0.7331,  0.7964,  0.2144,  0.7680,  0.7116,  0.4081,  0.1944,
         0.1468,  0.3687,  0.6450,  0.4524,  0.2135,  0.8111,  0.6245,
         0.6977,  0.6056,  0.8300,  0.4100,  0.7379,  0.3415,  0.7562,
         0.4482], device='cuda:0')
tensor(0.5565, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1023,  0.1481,  0.1068,  0.3786,  0.1182,  0.4854,  0.8525,
         0.7867,  0.8085,  0.1299,  0.5931,  0.1249,  0.7594,  0.2213,
         0.7012,  0.1217,  0.1814,  0.2396,  0.2546,  0.7725,  0.2311,
         0.7606,  0.6984,  0.7938,  0.6389,  0.6315,  0.7149,  0.7010,
         0.7305,  0.2519,  0.6986,  0.1238,  0.6533,  0.6554,  0.6538,
         0.2553,  0.8748,  0.0903,  0.7644,  0.3777,  0.7264,  0.1256,
         0.2405,  0.5875,  0.4877,  0.6038,  0.7357,  0.2055,  0.7342,
         0.3546,  0.2100,  0.1415,  0.5752,  0.6793,  0.5366,  0.6758,
         0.6937,  0.2191,  0.6193,  0.8312,  0.2288,  0.2873,  0.8088,
         0.7343,  0.1494,  0.7223,  0.1306,  0.5728,  0.1554,  0.1200,
         0.1111,  0.7610,  0.1632,  0.7878,  0.6290,  0.0817,  0.6853,
         0.1069,  0.1299,  0.8066,  0.7152,  0.1977,  0.1886,  0.1752,
         0.7541,  0.1502,  0.2693,  0.2220,  0.7737,  0.3306,  0.8076,
         0.7953,  0.7027,  0.2164,  0.1469,  0.7920,  0.7384,  0.2921,
         0.6908,  0.2005,  0.6586,  0.6544,  0.1433,  0.7974,  0.1600,
         0.0955,  0.1530,  0.5754,  0.6419,  0.3015,  0.0738,  0.6548,
         0.7511,  0.8630,  0.1427,  0.7660,  0.7611,  0.6362,  0.5617,
         0.1644,  0.8027,  0.1280,  0.6543,  0.2434,  0.5332,  0.1902,
         0.7650,  0.5846,  0.2175,  0.1957,  0.5241,  0.8207,  0.1713,
         0.8551,  0.6884,  0.2344,  0.0741,  0.1442,  0.2197,  0.7958,
         0.1308,  0.2280,  0.1956,  0.2326,  0.1831,  0.1369,  0.3584,
         0.6966,  0.4740,  0.2701,  0.7020,  0.2402,  0.6642,  0.1453,
         0.1961,  0.2952,  0.6435,  0.1325,  0.6397,  0.7069,  0.5699,
         0.7799,  0.1160,  0.7271,  0.7330,  0.5307,  0.5823,  0.1350,
         0.7722,  0.7597,  0.7847,  0.7676,  0.1387,  0.1029,  0.2905,
         0.2778,  0.4786,  0.1610,  0.2196,  0.2513,  0.1810,  0.1125,
         0.5523,  0.7363,  0.0777,  0.5678,  0.7122,  0.7509,  0.4333,
         0.1616,  0.0461,  0.7152,  0.6870,  0.1312,  0.3781,  0.2737,
         0.6454,  0.8735,  0.0964,  0.8103,  0.1073,  0.2005,  0.1675,
         0.4709,  0.1424,  0.1968,  0.6191,  0.7325,  0.0843,  0.7986,
         0.8035,  0.3125,  0.7465,  0.5551,  0.2513,  0.1622,  0.0943,
         0.1381,  0.3058,  0.1509,  0.1320,  0.1888,  0.2003,  0.7306,
         0.2068,  0.1880,  0.8016,  0.5913,  0.4188,  0.4707,  0.6014,
         0.7376,  0.3427,  0.4400,  0.7810,  0.8037,  0.5140,  0.1649,
         0.7278,  0.0540,  0.3711,  0.8569,  0.1009,  0.3870,  0.2297,
         0.2391,  0.8004,  0.1598,  0.8213,  0.3147,  0.6056,  0.2353,
         0.7343,  0.3567,  0.1988,  0.7885,  0.8265,  0.8632,  0.1932,
         0.6959,  0.3712,  0.4934,  0.7572,  0.1818,  0.8728,  0.3875,
         0.1955,  0.4485,  0.3988,  0.2114,  0.6320,  0.5868,  0.1522,
         0.6869,  0.7258,  0.8195,  0.2713,  0.1461,  0.7274,  0.8383,
         0.3900,  0.1421,  0.1414,  0.7894,  0.3540,  0.4741,  0.0975,
         0.6861,  0.0662,  0.7323,  0.7362,  0.6374,  0.2282,  0.2407,
         0.1748,  0.2009,  0.5562,  0.6435,  0.3120,  0.6412,  0.3929,
         0.5842,  0.4830,  0.8883,  0.1623,  0.1434,  0.7049,  0.7979,
         0.1367,  0.3064,  0.7247,  0.7499,  0.4249,  0.0827,  0.7654,
         0.7651,  0.0900,  0.1110,  0.1933,  0.5903,  0.1599,  0.2420,
         0.5329,  0.2062,  0.1938,  0.2651,  0.2542,  0.3320,  0.7581,
         0.2314,  0.2379,  0.3567,  0.1453,  0.6406,  0.7808,  0.6029,
         0.5055,  0.6140,  0.8225,  0.2387,  0.6871,  0.1514,  0.3732,
         0.6833,  0.3812,  0.1363,  0.1502,  0.7975,  0.1578,  0.5952,
         0.1856,  0.9560,  0.3953,  0.1601,  0.1636,  0.0981,  0.3736,
         0.2047,  0.8435,  0.5679,  0.4901,  0.0730,  0.1981,  0.4257,
         0.1106,  0.2271,  0.1872,  0.2260,  0.3229,  0.6047,  0.7814,
         0.8892,  0.1610,  0.7176,  0.4050,  0.3039,  0.6921,  0.2726,
         0.7249,  0.3221,  0.3689,  0.7350,  0.4157,  0.8506,  0.0397,
         0.2696,  0.3836,  0.3717,  0.7094,  0.7338,  0.1851,  0.9367,
         0.1610,  0.1350,  0.7301,  0.2423,  0.3357,  0.7167,  0.1546,
         0.4680,  0.3560,  0.6355,  0.2682,  0.4831,  0.1952,  0.5521,
         0.2130,  0.1828,  0.1144,  0.7289,  0.1312,  0.4797,  0.1361,
         0.2046,  0.8364,  0.7703,  0.7679,  0.1973,  0.8315,  0.2482,
         0.8479,  0.3057,  0.2041,  0.6214,  0.3817,  0.8051,  0.8609,
         0.5698,  0.7401,  0.8999,  0.2072,  0.6583,  0.7762,  0.1101,
         0.6447,  0.2226,  0.1499,  0.2698,  0.5304,  0.5982,  0.7749,
         0.2659,  0.8242,  0.4679,  0.7932,  0.4511,  0.1840,  0.1472,
         0.1082,  0.7192,  0.8473,  0.7581,  0.8160,  0.6897,  0.6816,
         0.7196,  0.7212,  0.5408,  0.2069,  0.2097,  0.1537,  0.6718,
         0.8796,  0.2864,  0.2933,  0.1757,  0.5359,  0.6555,  0.3541,
         0.1739,  0.2787,  0.7773,  0.6617,  0.1785,  0.8571,  0.1782,
         0.6368,  0.5917,  0.8338,  0.5260,  0.5270,  0.2953,  0.7366,
         0.1124,  0.1672,  0.0472,  0.8193,  0.8114,  0.1769,  0.1569,
         0.2179,  0.7449,  0.6744,  0.5003,  0.7912,  0.1739,  0.7229,
         0.2682,  0.1709,  0.7630,  0.6941,  0.6823,  0.8233,  0.8749,
         0.6023,  0.7235,  0.1212,  0.7160,  0.3499,  0.6128,  0.4402,
         0.1040], device='cuda:0')
tensor(0.5900, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7846,  0.2441,  0.1954,  0.5885,  0.7406,  0.6658,  0.2385,
         0.4542,  0.1153,  0.5092,  0.8202,  0.8470,  0.6854,  0.8565,
         0.2322,  0.7739,  0.1661,  0.7978,  0.6690,  0.1852,  0.1243,
         0.8188,  0.7039,  0.8756,  0.3636,  0.6148,  0.1830,  0.6433,
         0.2213,  0.2518,  0.2031,  0.6314,  0.1988,  0.1534,  0.9129,
         0.5778,  0.6316,  0.3848,  0.1494,  0.8132,  0.2173,  0.7264,
         0.1765,  0.1641,  0.6270,  0.6742,  0.5780,  0.5900,  0.8267,
         0.6682,  0.7523,  0.3417,  0.1550,  0.3490,  0.1694,  0.6804,
         0.5811,  0.1714,  0.2995,  0.5465,  0.2502,  0.7536,  0.5997,
         0.6729,  0.7215,  0.7814,  0.6900,  0.2806,  0.8177,  0.3039,
         0.2558,  0.8108,  0.7223,  0.2496,  0.7595,  0.4959,  0.1399,
         0.2207,  0.4016,  0.1645,  0.7557,  0.1501,  0.7678,  0.7063,
         0.8228,  0.3673,  0.1840,  0.2467,  0.2418,  0.8592,  0.6395,
         0.8163,  0.2291,  0.5978,  0.5105,  0.5511,  0.1636,  0.5458,
         0.7730,  0.6703,  0.6500,  0.8460,  0.1439,  0.5940,  0.1860,
         0.7455,  0.8746,  0.7548,  0.6865,  0.2588,  0.1951,  0.8203,
         0.2301,  0.6999,  0.1466,  0.7348,  0.7159,  0.3341,  0.2088,
         0.1956,  0.3041,  0.4912,  0.6978,  0.7746,  0.6720,  0.4595,
         0.8224,  0.3552,  0.6240,  0.2713,  0.7409,  0.1853,  0.5935,
         0.6643,  0.7190,  0.6413,  0.2395,  0.1749,  0.3497,  0.8032,
         0.6188,  0.4440,  0.7657,  0.6920,  0.2150,  0.2233,  0.6281,
         0.8242,  0.2591,  0.2897,  0.3998,  0.2388,  0.1728,  0.3507,
         0.1709,  0.6465,  0.2417,  0.7545,  0.2052,  0.2024,  0.7453,
         0.2056,  0.2178,  0.6680,  0.3082,  0.6956,  0.5647,  0.3560,
         0.8328,  0.1068,  0.7763,  0.1289,  0.8079,  0.5405,  0.2027,
         0.2656,  0.3492,  0.7075,  0.4641,  0.8307,  0.7177,  0.7556,
         0.7495,  0.6205,  0.9274,  0.2654,  0.5989,  0.6363,  0.5144,
         0.7210,  0.7299,  0.5807,  0.5649,  0.0734,  0.7706,  0.8564,
         0.4984,  0.6344,  0.6609,  0.1104,  0.7660,  0.2205,  0.1528,
         0.2125,  0.2837,  0.2130,  0.6729,  0.1681,  0.7537,  0.4748,
         0.2601,  0.2186,  0.3269,  0.6596,  0.1581,  0.1925,  0.7482,
         0.4012,  0.7648,  0.4802,  0.5490,  0.7907,  0.0405,  0.6504,
         0.5217,  0.6554,  0.5396,  0.6940,  0.6413,  0.2201,  0.9311,
         0.7565,  0.7726,  0.4301,  0.1060,  0.5141,  0.7321,  0.1249,
         0.2517,  0.1929,  0.5875,  0.1408,  0.2411,  0.5007,  0.1520,
         0.7549,  0.6486,  0.6510,  0.7391,  0.6203,  0.7096,  0.2214,
         0.6073,  0.5454,  0.1743,  0.3014,  0.8038,  0.5059,  0.1654,
         0.7372,  0.1359,  0.6465,  0.7048,  0.7619,  0.6214,  0.3888,
         0.4949,  0.2356,  0.1430,  0.7372,  0.7156,  0.1455,  0.8511,
         0.7531,  0.6129,  0.3005,  0.8178,  0.2738,  0.1922,  0.5541,
         0.1945,  0.3011,  0.1095,  0.1255,  0.7748,  0.8130,  0.1792,
         0.6768,  0.1450,  0.0633,  0.3460,  0.8914,  0.7034,  0.2660,
         0.7550,  0.2590,  0.7618,  0.3724,  0.6241,  0.7576,  0.7602,
         0.3031,  0.2705,  0.6015,  0.7997,  0.6959,  0.5974,  0.6903,
         0.5975,  0.2240,  0.4539,  0.4662,  0.4535,  0.1691,  0.2055,
         0.7704,  0.7062,  0.1789,  0.6865,  0.1385,  0.4085,  0.6795,
         0.4361,  0.7110,  0.6260,  0.7584,  0.3817,  0.5969,  0.8490,
         0.2084,  0.4138,  0.3357,  0.6180,  0.4189,  0.7525,  0.6088,
         0.1758,  0.2180,  0.1516,  0.5130,  0.8279,  0.6645,  0.1879,
         0.5144,  0.8258,  0.7056,  0.2034,  0.0572,  0.1653,  0.2135,
         0.3262,  0.5886,  0.7788,  0.1874,  0.2166,  0.5968,  0.2501,
         0.1352,  0.6305,  0.5044,  0.8144,  0.5526,  0.1500,  0.6986,
         0.7087,  0.9108,  0.7402,  0.7276,  0.6841,  0.6458,  0.4713,
         0.6272,  0.6820,  0.1053,  0.3640,  0.5296,  0.5138,  0.7963,
         0.2175,  0.1482,  0.7841,  0.8317,  0.2111,  0.1878,  0.7836,
         0.8023,  0.8186,  0.6730,  0.5536,  0.6956,  0.4608,  0.8809,
         0.4886,  0.2776,  0.8611,  0.1788,  0.2114,  0.8145,  0.1575,
         0.8011,  0.4974,  0.2014,  0.6972,  0.2067,  0.7169,  0.2624,
         0.1493,  0.6982,  0.4647,  0.5119,  0.1427,  0.5728,  0.8136,
         0.4093,  0.1364,  0.7603,  0.9005,  0.4674,  0.2498,  0.1743,
         0.0796,  0.2736,  0.1710,  0.5935,  0.8042,  0.3593,  0.7895,
         0.7189,  0.4667,  0.3024,  0.1818,  0.7163,  0.8428,  0.3074,
         0.7778,  0.2837,  0.2452,  0.2978,  0.3583,  0.5149,  0.6430,
         0.6142,  0.1967,  0.6863,  0.6728,  0.3816,  0.7070,  0.1152,
         0.3448,  0.6698,  0.5839,  0.2695,  0.3382,  0.2143,  0.1519,
         0.4344,  0.4652,  0.6316,  0.1833,  0.6537,  0.2958,  0.2828,
         0.8785,  0.2781,  0.3091,  0.7272,  0.7553,  0.4707,  0.3173,
         0.0741,  0.6295,  0.1573,  0.2813,  0.8081,  0.5611,  0.0954,
         0.5028,  0.7776,  0.7847,  0.2868,  0.8441,  0.7340,  0.2826,
         0.3550,  0.2648,  0.3381,  0.1359,  0.1561,  0.8509,  0.7097,
         0.7410,  0.5946,  0.8131,  0.6695,  0.3077,  0.6640,  0.6136,
         0.0384,  0.2191,  0.6617,  0.6940,  0.0836,  0.3316,  0.6570,
         0.2553,  0.5427,  0.6257,  0.0725,  0.1556,  0.4206,  0.8118,
         0.7668], device='cuda:0')
tensor(0.5481, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2216,  0.6181,  0.3450,  0.7812,  0.2198,  0.2833,  0.7972,
         0.3996,  0.5546,  0.4966,  0.1457,  0.2038,  0.3778,  0.5564,
         0.2279,  0.2950,  0.8064,  0.5890,  0.1809,  0.3672,  0.6561,
         0.1513,  0.1836,  0.4974,  0.7060,  0.7918,  0.7895,  0.6575,
         0.4771,  0.2326,  0.6420,  0.1241,  0.5853,  0.1290,  0.7727,
         0.2629,  0.7268,  0.5857,  0.3057,  0.7750,  0.2535,  0.2997,
         0.7134,  0.2437,  0.5219,  0.3196,  0.6937,  0.3339,  0.1814,
         0.6614,  0.4936,  0.7360,  0.7060,  0.5511,  0.6445,  0.5694,
         0.6729,  0.2714,  0.5716,  0.1947,  0.1952,  0.6998,  0.5674,
         0.6721,  0.1361,  0.7410,  0.6114,  0.7252,  0.0928,  0.6266,
         0.4771,  0.2275,  0.8196,  0.8505,  0.1624,  0.6544,  0.3193,
         0.5039,  0.2750,  0.2377,  0.6704,  0.5933,  0.1345,  0.2331,
         0.1331,  0.6206,  0.5723,  0.7608,  0.1655,  0.2930,  0.5804,
         0.7610,  0.1630,  0.7656,  0.6875,  0.7814,  0.4538,  0.4964,
         0.2570,  0.7542,  0.7166,  0.8708,  0.5568,  0.5648,  0.4164,
         0.2411,  0.1948,  0.7884,  0.7131,  0.4543,  0.5979,  0.2800,
         0.2931,  0.3665,  0.2565,  0.7785,  0.1321,  0.6452,  0.1886,
         0.2498,  0.9351,  0.7757,  0.2568,  0.2716,  0.4185,  0.1520,
         0.1596,  0.7052,  0.6195,  0.1795,  0.2863,  0.5608,  0.4491,
         0.7685,  0.1574,  0.1123,  0.5125,  0.8192,  0.1739,  0.6757,
         0.3607,  0.1582,  0.4879,  0.1575,  0.6574,  0.2470,  0.4725,
         0.8095,  0.5001,  0.1906,  0.1337,  0.5844,  0.4784,  0.1310,
         0.3460,  0.5857,  0.3484,  0.2545,  0.7478,  0.1958,  0.3613,
         0.4421,  0.8812,  0.6275,  0.1060,  0.2726,  0.0740,  0.6013,
         0.3700,  0.8122,  0.5939,  0.6970,  0.6182,  0.5173,  0.2978,
         0.6527,  0.2636,  0.4506,  0.0491,  0.5902,  0.5196,  0.2503,
         0.4380,  0.6137,  0.7003,  0.5156,  0.3448,  0.2423,  0.5422,
         0.4517,  0.5998,  0.4008,  0.6743,  0.1754,  0.1362,  0.3824,
         0.4510,  0.9388,  0.7746,  0.2720,  0.2223,  0.7877,  0.7137,
         0.7663,  0.7351,  0.5701,  0.6555,  0.8691,  0.6739,  0.7792,
         0.7378,  0.8335,  0.1953,  0.8027,  0.3814,  0.9038,  0.7170,
         0.1980,  0.1739,  0.2265,  0.6154,  0.1996,  0.2287,  0.6604,
         0.7206,  0.4289,  0.6888,  0.7050,  0.2082,  0.3138,  0.2859,
         0.7938,  0.1055,  0.1937,  0.8282,  0.2275,  0.1275,  0.6379,
         0.2049,  0.5415,  0.2218,  0.5359,  0.8360,  0.6886,  0.3045,
         0.7201,  0.2891,  0.8518,  0.1021,  0.6814,  0.7425,  0.2729,
         0.6174,  0.4357,  0.7934,  0.1277,  0.5338,  0.8098,  0.2404,
         0.8652,  0.3562,  0.2430,  0.2946,  0.1609,  0.5198,  0.8555,
         0.5870,  0.4135,  0.3915,  0.1333,  0.3539,  0.7588,  0.6653,
         0.6486,  0.2157,  0.8432,  0.5483,  0.7322,  0.7846,  0.2933,
         0.3744,  0.8158,  0.6224,  0.6149,  0.7045,  0.7326,  0.5724,
         0.1897,  0.2168,  0.8480,  0.3613,  0.8197,  0.5506,  0.1778,
         0.6505,  0.8281,  0.5596,  0.5873,  0.3762,  0.6419,  0.3917,
         0.5571,  0.5993,  0.8266,  0.9467,  0.2137,  0.7540,  0.4995,
         0.2851,  0.7884,  0.8274,  0.7963,  0.4130,  0.7952,  0.5220,
         0.2391,  0.1963,  0.8234,  0.4227,  0.7416,  0.8850,  0.6971,
         0.4391,  0.2019,  0.5530,  0.2104,  0.6219,  0.2384,  0.5610,
         0.6636,  0.6785,  0.6823,  0.6730,  0.7611,  0.1946,  0.1819,
         0.1224,  0.7616,  0.2088,  0.3601,  0.2247,  0.1628,  0.6379,
         0.1664,  0.7466,  0.5765,  0.9626,  0.3039,  0.2696,  0.6048,
         0.5934,  0.6753,  0.6416,  0.5626,  0.3891,  0.6722,  0.5320,
         0.5349,  0.1730,  0.6646,  0.2114,  0.4162,  0.7642,  0.6678,
         0.5380,  0.3266,  0.2391,  0.2651,  0.2580,  0.4418,  0.6370,
         0.4293,  0.5304,  0.3333,  0.8423,  0.6762,  0.1416,  0.2180,
         0.6762,  0.7557,  0.0791,  0.9442,  0.5660,  0.4286,  0.4806,
         0.5914,  0.8373,  0.4971,  0.6210,  0.6359,  0.8209,  0.3487,
         0.6646,  0.5340,  0.5780,  0.3735,  0.5111,  0.2713,  0.7420,
         0.5866,  0.7678,  0.8891,  0.5159,  0.4479,  0.7316,  0.1698,
         0.5770,  0.6926,  0.4821,  0.6968,  0.1915,  0.6012,  0.0900,
         0.3254,  0.3085,  0.7706,  0.8334,  0.7003,  0.7032,  0.1445,
         0.1878,  0.3073,  0.6342,  0.7744,  0.3027,  0.2744,  0.5490,
         0.3256,  0.7106,  0.8140,  0.6379,  0.6799,  0.3050,  0.3886,
         0.5990,  0.1411,  0.7757,  0.3974,  0.4553,  0.2978,  0.6704,
         0.6692,  0.4441,  0.7326,  0.8168,  0.5594,  0.6118,  0.1066,
         0.8468,  0.7289,  0.5859,  0.2688,  0.5167,  0.7707,  0.3176,
         0.3464,  0.5904,  0.2139,  0.2185,  0.2391,  0.7920,  0.1737,
         0.4850,  0.4903,  0.7877,  0.3040,  0.2805,  0.6066,  0.7203,
         0.6863,  0.2270,  0.2843,  0.8059,  0.1261,  0.2385,  0.1448,
         0.5072,  0.3588,  0.1923,  0.1715,  0.1942,  0.4835,  0.7049,
         0.3456,  0.6662,  0.1624,  0.1313,  0.5580,  0.6337,  0.2492,
         0.5310,  0.5573,  0.7965,  0.2601,  0.3542,  0.7986,  0.4746,
         0.7505,  0.3927,  0.5726,  0.5894,  0.8132,  0.2003,  0.7484,
         0.1756,  0.4234,  0.2198,  0.1867,  0.1489,  0.5066,  0.7708,
         0.7080], device='cuda:0')
tensor(0.5475, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7233,  0.5701,  0.4794,  0.3031,  0.4504,  0.2750,  0.4424,
         0.2684,  0.1669,  0.4925,  0.7391,  0.7105,  0.5521,  0.5990,
         0.1549,  0.3078,  0.4805,  0.5512,  0.5584,  0.5705,  0.5642,
         0.1657,  0.1880,  0.5041,  0.2430,  0.6227,  0.3830,  0.5913,
         0.2061,  0.4825,  0.3644,  0.7524,  0.7137,  0.7880,  0.5842,
         0.6741,  0.5133,  0.7119,  0.4881,  0.7731,  0.7268,  0.5181,
         0.3505,  0.3835,  0.6343,  0.9249,  0.3032,  0.2579,  0.5583,
         0.6038,  0.5618,  0.1942,  0.4650,  0.4125,  0.3101,  0.2097,
         0.3609,  0.6392,  0.2040,  0.2784,  0.7625,  0.5616,  0.6281,
         0.6247,  0.2411,  0.5589,  0.5512,  0.4240,  0.2039,  0.6004,
         0.1469,  0.6381,  0.4203,  0.7428,  0.7282,  0.2906,  0.9357,
         0.6829,  0.6503,  0.1668,  0.8562,  0.7884,  0.3664,  0.1817,
         0.7097,  0.6941,  0.3808,  0.6297,  0.6901,  0.3505,  0.1847,
         0.5280,  0.5162,  0.1895,  0.4113,  0.5082,  0.6126,  0.6675,
         0.7489,  0.4192,  0.3453,  0.1967,  0.7034,  0.6846,  0.1773,
         0.7399,  0.2271,  0.2451,  0.5706,  0.6571,  0.6560,  0.8146,
         0.7162,  0.4140,  0.2502,  0.4284,  0.4871,  0.2669,  0.5864,
         0.3480,  0.6634,  0.1585,  0.7840,  0.4463,  0.7219,  0.6337,
         0.4719,  0.4680,  0.2467,  0.3134,  0.1973,  0.3033,  0.1543,
         0.4355,  0.2597,  0.4043,  0.2301,  0.3615,  0.3843,  0.2184,
         0.1430,  0.3811,  0.2774,  0.7272,  0.1653,  0.1416,  0.6199,
         0.6318,  0.5535,  0.3763,  0.5399,  0.5793,  0.5643,  0.5913,
         0.3862,  0.2521,  0.8720,  0.2848,  0.2554,  0.7228,  0.4756,
         0.4636,  0.8114,  0.2120,  0.2149,  0.1350,  0.6440,  0.7207,
         0.1050,  0.5914,  0.7280,  0.1683,  0.2023,  0.6250,  0.0732,
         0.3859,  0.6079,  0.6407,  0.2599,  0.1987,  0.8069,  0.4178,
         0.6197,  0.7046,  0.3127,  0.5916,  0.2549,  0.5896,  0.6933,
         0.2455,  0.5303,  0.1794,  0.4979,  0.3962,  0.3526,  0.5585,
         0.5128,  0.5404,  0.8499,  0.6811,  0.2051,  0.3183,  0.7903,
         0.6338,  0.6205,  0.2143,  0.4404,  0.2718,  0.5928,  0.1940,
         0.4651,  0.1909,  0.3133,  0.5770,  0.7028,  0.3532,  0.3818,
         0.2118,  0.2373,  0.4966,  0.5214,  0.2714,  0.2810,  0.1961,
         0.5649,  0.5885,  0.6552,  0.2725,  0.6422,  0.4399,  0.3470,
         0.7117,  0.6546,  0.5669,  0.7128,  0.6184,  0.3742,  0.2072,
         0.6019,  0.2383,  0.3132,  0.5562,  0.2156,  0.7105,  0.2757,
         0.3527,  0.4139,  0.4714,  0.5262,  0.5031,  0.3073,  0.3824,
         0.2760,  0.1505,  0.5043,  0.3103,  0.3142,  0.5249,  0.5983,
         0.4033,  0.2391,  0.4403,  0.5210,  0.5751,  0.3921,  0.9316,
         0.5045,  0.1265,  0.7331,  0.1804,  0.3688,  0.8398,  0.0866,
         0.3065,  0.3114,  0.4812,  0.1545,  0.8109,  0.4010,  0.5884,
         0.4186,  0.5234,  0.7598,  0.1628,  0.6612,  0.2937,  0.2012,
         0.2573,  0.4848,  0.5083,  0.3689,  0.5848,  0.2367,  0.1804,
         0.5424,  0.6336,  0.3940,  0.3081,  0.3633,  0.4117,  0.5776,
         0.2156,  0.6394,  0.8205,  0.5816,  0.3115,  0.5264,  0.5801,
         0.5229,  0.5064,  0.3083,  0.6624,  0.2383,  0.1768,  0.3721,
         0.5744,  0.1728,  0.5427,  0.6694,  0.3049,  0.6253,  0.8724,
         0.6804,  0.1547,  0.4818,  0.2265,  0.2884,  0.4160,  0.4060,
         0.8512,  0.4732,  0.3207,  0.7340,  0.3097,  0.5029,  0.6355,
         0.4034,  0.4852,  0.2622,  0.2675,  0.5081,  0.8977,  0.5041,
         0.9572,  0.1745,  0.3850,  0.4587,  0.7095,  0.3559,  0.7212,
         0.9291,  0.3307,  0.7040,  0.5242,  0.6299,  0.4732,  0.7441,
         0.5409,  0.6983,  0.2290,  0.2862,  0.5504,  0.3854,  0.2789,
         0.8465,  0.4364,  0.5180,  0.4275,  0.2355,  0.7647,  0.6125,
         0.2312,  0.1438,  0.7867,  0.5278,  0.4573,  0.6503,  0.3711,
         0.1981,  0.3231,  0.2193,  0.6218,  0.5323,  0.2944,  0.4799,
         0.7443,  0.7637,  0.5939,  0.1929,  0.3034,  0.6631,  0.3874,
         0.7333,  0.3931,  0.6575,  0.5628,  0.4336,  0.6667,  0.4577,
         0.6815,  0.2435,  0.1934,  0.7320,  0.1542,  0.7344,  0.3246,
         0.1792,  0.7528,  0.3156,  0.3805,  0.1121,  0.7448,  0.5683,
         0.2542,  0.6858,  0.7728,  0.2415,  0.4890,  0.2517,  0.6456,
         0.2860,  0.2997,  0.3352,  0.1475,  0.2534,  0.0679,  0.4425,
         0.3490,  0.1931,  0.2081,  0.5807,  0.3950,  0.6847,  0.1130,
         0.2085,  0.2481,  0.4577,  0.1716,  0.5345,  0.4185,  0.7407,
         0.3467,  0.4688,  0.6546,  0.2935,  0.6798,  0.7001,  0.9096,
         0.5575,  0.6218,  0.6302,  0.3091,  0.6527,  0.5882,  0.7354,
         0.4568,  0.2493,  0.2365,  0.6876,  0.2934,  0.3242,  0.4876,
         0.2019,  0.2422,  0.3165,  0.5612,  0.6770,  0.3958,  0.7492,
         0.3697,  0.3542,  0.3446,  0.4921,  0.2139,  0.5253,  0.4757,
         0.6901,  0.3243,  0.2597,  0.4458,  0.4843,  0.6877,  0.0996,
         0.5144,  0.1953,  0.4207,  0.6319,  0.6199,  0.3903,  0.6419,
         0.4698,  0.7673,  0.6411,  0.3640,  0.5227,  0.4358,  0.4706,
         0.2922,  0.6519,  0.4876,  0.3187,  0.6970,  0.2487,  0.9516,
         0.3278,  0.3988,  0.3557,  0.3020,  0.7094,  0.1579,  0.7269,
         0.3438], device='cuda:0')
tensor(0.5652, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2427,  0.4783,  0.1746,  0.6465,  0.8921,  0.8825,  0.4130,
         0.4585,  0.5568,  0.3055,  0.3642,  0.5369,  0.4021,  0.4713,
         0.5754,  0.6659,  0.5682,  0.6904,  0.6098,  0.7094,  0.2653,
         0.2001,  0.3742,  0.4023,  0.2225,  0.4987,  0.3048,  0.6920,
         0.6593,  0.7061,  0.5654,  0.5899,  0.3974,  0.2071,  0.3321,
         0.5088,  0.1963,  0.6775,  0.6212,  0.2303,  0.2598,  0.1963,
         0.4883,  0.6675,  0.3323,  0.5323,  0.6006,  0.6782,  0.3419,
         0.4787,  0.3228,  0.2056,  0.1567,  0.1829,  0.3318,  0.2762,
         0.5420,  0.5414,  0.6054,  0.8194,  0.6006,  0.7890,  0.4704,
         0.6646,  0.4182,  0.7192,  0.6419,  0.2318,  0.3523,  0.3640,
         0.4550,  0.6331,  0.5644,  0.6047,  0.5259,  0.4409,  0.7975,
         0.1478,  0.7918,  0.3641,  0.1293,  0.2222,  0.6665,  0.7338,
         0.4729,  0.3432,  0.5371,  0.6820,  0.6825,  0.2231,  0.5760,
         0.8397,  0.4862,  0.2223,  0.4077,  0.6088,  0.2453,  0.8019,
         0.4308,  0.5495,  0.1604,  0.2623,  0.3202,  0.8273,  0.7773,
         0.7806,  0.6100,  0.4696,  0.7517,  0.1695,  0.5922,  0.3663,
         0.2688,  0.6447,  0.1156,  0.6254,  0.3790,  0.2694,  0.2837,
         0.1655,  0.7734,  0.3604,  0.5559,  0.5626,  0.3661,  0.9741,
         0.4213,  0.5735,  0.4185,  0.6195,  0.8557,  0.2728,  0.7500,
         0.5302,  0.4593,  0.5425,  0.6790,  0.1789,  0.6033,  0.2901,
         0.4486,  0.6554,  0.4317,  0.6055,  0.3803,  0.7143,  0.2556,
         0.6951,  0.2788,  0.1629,  0.2377,  0.6495,  0.1592,  0.3123,
         0.6656,  0.4813,  0.2439,  0.3078,  0.7110,  0.9460,  0.5151,
         0.6738,  0.6503,  0.4092,  0.5345,  0.2895,  0.3596,  0.7011,
         0.2912,  0.1981,  0.4794,  0.6299,  0.6697,  0.3874,  0.4710,
         0.6408,  0.5057,  0.4378,  0.2765,  0.5018,  0.2081,  0.2478,
         0.4754,  0.4308,  0.3953,  0.4380,  0.8534,  0.4647,  0.3580,
         0.2369,  0.8453,  0.7321,  0.5998,  0.2821,  0.1956,  0.8287,
         0.7363,  0.4863,  0.5521,  0.9512,  0.2055,  0.5093,  0.6667,
         0.7790,  0.4960,  0.4454,  0.3025,  0.5863,  0.1709,  0.4772,
         0.6099,  0.2246,  0.2457,  0.1902,  0.3037,  0.6573,  0.7370,
         0.6237,  0.6545,  0.5687,  0.7972,  0.1897,  0.6829,  0.2450,
         0.1731,  0.1361,  0.4834,  0.3836,  0.4204,  0.6918,  0.3684,
         0.2890,  0.7218,  0.7203,  0.6340,  0.5654,  0.2957,  0.2933,
         0.6901,  0.3752,  0.3977,  0.3047,  0.6750,  0.4956,  0.3157,
         0.6071,  0.3726,  0.6326,  0.8009,  0.4071,  0.4194,  0.4352,
         0.1983,  0.6348,  0.7188,  0.3961,  0.6906,  0.2433,  0.4260,
         0.3980,  0.5380,  0.6821,  0.5904,  0.8141,  0.3803,  0.0458,
         0.4724,  0.5820,  0.6790,  0.4136,  0.2736,  0.1202,  0.2485,
         0.3431,  0.6550,  0.5856,  0.3888,  0.3561,  0.3420,  0.3625,
         0.6791,  0.0771,  0.8023,  0.2783,  0.8734,  0.4806,  0.7637,
         0.2252,  0.4345,  0.4501,  0.6407,  0.6139,  0.8556,  0.5475,
         0.3183,  0.7204,  0.5241,  0.2220,  0.8584,  0.1855,  0.3064,
         0.7804,  0.3373,  0.3898,  0.2496,  0.4850,  0.5216,  0.8058,
         0.5611,  0.5713,  0.7039,  0.2217,  0.2749,  0.7671,  0.4097,
         0.5489,  0.4883,  0.6378,  0.3365,  0.7249,  0.8208,  0.2137,
         0.2040,  0.7649,  0.2979,  0.6509,  0.7960,  0.4189,  0.2867,
         0.5158,  0.4905,  0.6067,  0.2436,  0.6381,  0.6708,  0.1306,
         0.7699,  0.7622,  0.2783,  0.7738,  0.9059,  0.7275,  0.4974,
         0.3137,  0.3783,  0.2426,  0.4663,  0.4720,  0.5941,  0.4933,
         0.4420,  0.4555,  0.7984,  0.7464,  0.5308,  0.4781,  0.6874,
         0.3183,  0.3762,  0.3669,  0.0851,  0.8292,  0.2298,  0.6604,
         0.6529,  0.4499,  0.3252,  0.3379,  0.7137,  0.6881,  0.4453,
         0.6643,  0.5394,  0.4578,  0.5789,  0.4132,  0.2049,  0.3503,
         0.3743,  0.3647,  0.7139,  0.4403,  0.1983,  0.2883,  0.8446,
         0.5821,  0.2869,  0.5740,  0.7952,  0.6177,  0.6901,  0.3315,
         0.1623,  0.2005,  0.7363,  0.3014,  0.4336,  0.2027,  0.1649,
         0.8646,  0.3804,  0.1994,  0.3838,  0.2450,  0.4637,  0.5600,
         0.2156,  0.6063,  0.4184,  0.4853,  0.3496,  0.5397,  0.1895,
         0.5927,  0.1924,  0.5937,  0.5652,  0.2692,  0.4025,  0.2681,
         0.4078,  0.3581,  0.5850,  0.4136,  0.6435,  0.0886,  0.6480,
         0.6859,  0.6395,  0.3640,  0.7737,  0.3007,  0.5133,  0.3856,
         0.3032,  0.1820,  0.2764,  0.7034,  0.8076,  0.4786,  0.4093,
         0.5677,  0.8366,  0.2616,  0.2814,  0.2900,  0.2441,  0.4525,
         0.6336,  0.6125,  0.3169,  0.4417,  0.5805,  0.7094,  0.5685,
         0.6625,  0.2660,  0.7244,  0.3969,  0.4126,  0.6993,  0.9411,
         0.4175,  0.6409,  0.3827,  0.7118,  0.4786,  0.4867,  0.5208,
         0.8218,  0.3246,  0.6579,  0.2577,  0.6559,  0.2767,  0.2501,
         0.7322,  0.8528,  0.7497,  0.4571,  0.6833,  0.6206,  0.4925,
         0.2018,  0.2002,  0.5441,  0.2981,  0.3422,  0.7549,  0.4059,
         0.3472,  0.6143,  0.3450,  0.1899,  0.2084,  0.4591,  0.3642,
         0.6002,  0.5381,  0.2415,  0.5857,  0.5115,  0.3870,  0.6688,
         0.7423,  0.3885,  0.2750,  0.3759,  0.6747,  0.1237,  0.6304,
         0.1695], device='cuda:0')
tensor(0.5643, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6869,  0.3321,  0.3179,  0.2807,  0.3969,  0.4326,  0.5043,
         0.6701,  0.6669,  0.1973,  0.4698,  0.6141,  0.2052,  0.2279,
         0.5871,  0.5466,  0.4315,  0.5862,  0.1618,  0.9405,  0.5745,
         0.4853,  0.9104,  0.3626,  0.6332,  0.4280,  0.8297,  0.7246,
         0.4950,  0.4754,  0.3329,  0.3283,  0.2292,  0.6893,  0.3987,
         0.6694,  0.5321,  0.4725,  0.3326,  0.5594,  0.3445,  0.2454,
         0.2278,  0.4636,  0.8139,  0.2468,  0.2553,  0.7847,  0.5513,
         0.3124,  0.4050,  0.3417,  0.3443,  0.4900,  0.2309,  0.2147,
         0.5597,  0.4104,  0.3028,  0.2108,  0.6298,  0.2962,  0.5661,
         0.5034,  0.4694,  0.5461,  0.7803,  0.1932,  0.8345,  0.4947,
         0.6879,  0.0877,  0.2723,  0.4218,  0.7428,  0.3771,  0.3323,
         0.3569,  0.7740,  0.3655,  0.4213,  0.9155,  0.5117,  0.7204,
         0.1037,  0.7900,  0.6598,  0.5831,  0.1547,  0.2948,  0.5981,
         0.6812,  0.4277,  0.6092,  0.4675,  0.5100,  0.5250,  0.3542,
         0.2813,  0.3811,  0.7986,  0.1550,  0.3782,  0.3724,  0.6413,
         0.5538,  0.5808,  0.5919,  0.9791,  0.3889,  0.7460,  0.5953,
         0.4376,  0.3098,  0.3705,  0.4026,  0.3075,  0.3727,  0.7989,
         0.6881,  0.6381,  0.6618,  0.2993,  0.7494,  0.5360,  0.8390,
         0.5379,  0.3449,  0.5497,  0.3901,  0.5046,  0.2826,  0.2813,
         0.4582,  0.5253,  0.1225,  0.3945,  0.2820,  0.2497,  0.5073,
         0.2233,  0.8449,  0.6103,  0.2636,  0.5575,  0.6119,  0.5518,
         0.5997,  0.0845,  0.5088,  0.4819,  0.3618,  0.3714,  0.5190,
         0.7017,  0.4931,  0.5308,  0.7160,  0.6571,  0.4086,  0.6855,
         0.5322,  0.7694,  0.4634,  0.4071,  0.0962,  0.2869,  0.4715,
         0.3881,  0.2377,  0.3954,  0.3647,  0.5348,  0.2635,  0.3935,
         0.4189,  0.2603,  0.3930,  0.3295,  0.3200,  0.7503,  0.3649,
         0.3311,  0.5224,  0.4620,  0.5310,  0.2764,  0.3605,  0.7764,
         0.2813,  0.3533,  0.5335,  0.2714,  0.3134,  0.6577,  0.5780,
         0.5889,  0.4376,  0.2575,  0.4251,  0.5785,  0.6875,  0.7460,
         0.3269,  0.4516,  0.5395,  0.7218,  0.3394,  0.5048,  0.4176,
         0.2865,  0.3485,  0.3877,  0.1866,  0.4939,  0.4774,  0.4383,
         0.2494,  0.3486,  0.6532,  0.4141,  0.5832,  0.6376,  0.5620,
         0.2481,  0.2867,  0.5179,  0.2621,  0.5676,  0.3361,  0.2726,
         0.2897,  0.2388,  0.7023,  0.5787,  0.3056,  0.3171,  0.4186,
         0.4751,  0.4168,  0.8810,  0.8183,  0.3918,  0.5387,  0.2564,
         0.3383,  0.1732,  0.5353,  0.4677,  0.6572,  0.1247,  0.7334,
         0.6111,  0.3555,  0.4526,  0.6260,  0.5834,  0.3261,  0.6684,
         0.4709,  0.7649,  0.4145,  0.3259,  0.5310,  0.3672,  0.6862,
         0.6368,  0.7295,  0.3640,  0.6277,  0.6504,  0.6072,  0.2712,
         0.3018,  0.2805,  0.6532,  0.5167,  0.4587,  0.5612,  0.6407,
         0.5451,  0.7126,  0.2375,  0.7532,  0.2149,  0.1701,  0.6567,
         0.1714,  0.5261,  0.3148,  0.2909,  0.6420,  0.3196,  0.5734,
         0.6695,  0.7182,  0.4725,  0.3161,  0.9046,  0.1954,  0.6241,
         0.5056,  0.6449,  0.3600,  0.5549,  0.1643,  0.2479,  0.3497,
         0.5881,  0.5341,  0.7587,  0.3776,  0.8895,  0.4461,  0.7446,
         0.1695,  0.2525,  0.6210,  0.3756,  0.4442,  0.2192,  0.2122,
         0.5000,  0.4048,  0.3736,  0.3322,  0.5557,  0.7086,  0.4475,
         0.5815,  0.5067,  0.7499,  0.1886,  0.1590,  0.5400,  0.4934,
         0.7582,  0.2552,  0.3537,  0.5064,  0.5873,  0.5545,  0.8142,
         0.4417,  0.4623,  0.5511,  0.7687,  0.4121,  0.3000,  0.4033,
         0.3926,  0.6420,  0.6389,  0.5492,  0.6381,  0.4602,  0.7094,
         0.3065,  0.6681,  0.6119,  0.7714,  0.5425,  0.6138,  0.7394,
         0.6859,  0.4519,  0.7016,  0.5475,  0.6885,  0.5405,  0.3990,
         0.5104,  0.0982,  0.6960,  0.2703,  0.7492,  0.2236,  0.6435,
         0.1832,  0.9243,  0.5536,  0.7139,  0.2087,  0.6687,  0.8736,
         0.4990,  0.6550,  0.2712,  0.3436,  0.8044,  0.5503,  0.1285,
         0.3217,  0.2367,  0.5979,  0.6684,  0.8316,  0.5327,  0.1995,
         0.5180,  0.6558,  0.3625,  0.5623,  0.6702,  0.6951,  0.6501,
         0.5858,  0.5223,  0.7159,  0.6208,  0.6506,  0.2872,  0.5883,
         0.8504,  0.6447,  0.5174,  0.7148,  0.2474,  0.5003,  0.8384,
         0.6370,  0.6532,  0.4003,  0.6648,  0.6554,  0.2041,  0.4164,
         0.6327,  0.4906,  0.5428,  0.2909,  0.7473,  0.6200,  0.4870,
         0.4233,  0.5886,  0.4073,  0.5995,  0.2648,  0.4001,  0.2657,
         0.8355,  0.2698,  0.2686,  0.4879,  0.7445,  0.4938,  0.5285,
         0.8995,  0.4793,  0.2223,  0.3058,  0.3214,  0.7287,  0.4387,
         0.6287,  0.6316,  0.7207,  0.3778,  0.6741,  0.6487,  0.6665,
         0.1817,  0.8272,  0.6140,  0.2779,  0.6927,  0.2459,  0.1508,
         0.6605,  0.7296,  0.9025,  0.4045,  0.1946,  0.4502,  0.3730,
         0.6677,  0.4297,  0.2118,  0.7142,  0.3126,  0.2721,  0.3180,
         0.3941,  0.5402,  0.6828,  0.3130,  0.4082,  0.5242,  0.6016,
         0.4842,  0.0611,  0.5864,  0.4224,  0.7163,  0.2554,  0.5166,
         0.7989,  0.3634,  0.5990,  0.2244,  0.4670,  0.4809,  0.2839,
         0.1864,  0.2178,  0.2053,  0.5146,  0.4455,  0.8684,  0.3618,
         0.7430], device='cuda:0')
tensor(0.5727, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5994,  0.6134,  0.4337,  0.4525,  0.5363,  0.6783,  0.7816,
         0.5872,  0.2567,  0.3464,  0.6744,  0.5405,  0.3242,  0.3935,
         0.5099,  0.4304,  0.7003,  0.4525,  0.7193,  0.4061,  0.5826,
         0.2417,  0.3303,  0.2878,  0.8832,  0.7649,  0.5552,  0.3982,
         0.2855,  0.4255,  0.3905,  0.6928,  0.3716,  0.8079,  0.2955,
         0.7564,  0.2228,  0.4862,  0.6856,  0.7170,  0.3309,  0.6314,
         0.6282,  0.6465,  0.5774,  0.7236,  0.5819,  0.7484,  0.3097,
         0.7060,  0.4393,  0.5241,  0.2529,  0.4618,  0.3734,  0.6142,
         0.7034,  0.2945,  0.5979,  0.7262,  0.8473,  0.6901,  0.1863,
         0.5222,  0.4473,  0.5546,  0.2458,  0.2190,  0.4294,  0.3354,
         0.2223,  0.4581,  0.2949,  0.3367,  0.2846,  0.4736,  0.5446,
         0.4186,  0.2969,  0.6214,  0.6668,  0.5074,  0.6644,  0.1625,
         0.5052,  0.1319,  0.5289,  0.2546,  0.3385,  0.8036,  0.6426,
         0.4308,  0.5704,  0.5868,  0.5654,  0.1879,  0.4867,  0.6377,
         0.3783,  0.5537,  0.5960,  0.3007,  0.2129,  0.5535,  0.2669,
         0.3726,  0.7650,  0.7363,  0.2603,  0.3011,  0.4904,  0.7831,
         0.3297,  0.1058,  0.3286,  0.5761,  0.6270,  0.3788,  0.5201,
         0.9678,  0.6206,  0.7209,  0.2721,  0.5894,  0.6197,  0.3686,
         0.2580,  0.3327,  0.3384,  0.1932,  0.6320,  0.5697,  0.1737,
         0.6842,  0.3140,  0.7722,  0.6376,  0.5383,  0.3620,  0.4055,
         0.4505,  0.3209,  0.2684,  0.7288,  0.3364,  0.3260,  0.5404,
         0.2240,  0.4339,  0.7565,  0.2380,  0.7182,  0.7096,  0.3924,
         0.6314,  0.7310,  0.2274,  0.3881,  0.8127,  0.7215,  0.5304,
         0.5394,  0.1026,  0.1101,  0.2844,  0.9395,  0.8548,  0.6299,
         0.2234,  0.8412,  0.5428,  0.4660,  0.4534,  0.3117,  0.6476,
         0.7384,  0.2289,  0.2439,  0.2086,  0.1578,  0.4755,  0.1845,
         0.2666,  0.4557,  0.6701,  0.3835,  0.4898,  0.5779,  0.0845,
         0.2294,  0.3733,  0.7257,  0.6527,  0.7685,  0.5335,  0.1624,
         0.4898,  0.3601,  0.5151,  0.5851,  0.3809,  0.3997,  0.3623,
         0.4399,  0.8081,  0.6594,  0.4452,  0.8085,  0.3466,  0.3778,
         0.6650,  0.6918,  0.7111,  0.7713,  0.5685,  0.3007,  0.3956,
         0.5675,  0.2555,  0.7700,  0.6126,  0.2825,  0.7231,  0.6993,
         0.5614,  0.6923,  0.4500,  0.6590,  0.4898,  0.2910,  0.6852,
         0.7977,  0.8367,  0.4758,  0.1675,  0.5865,  0.6926,  0.3351,
         0.2522,  0.4906,  0.7324,  0.5849,  0.2399,  0.5277,  0.5834,
         0.4675,  0.5312,  0.6740,  0.6002,  0.3795,  0.6705,  0.3832,
         0.5170,  0.3827,  0.5250,  0.6293,  0.2765,  0.5000,  0.1807,
         0.6086,  0.5985,  0.5540,  0.4323,  0.2768,  0.2823,  0.3206,
         0.2295,  0.4231,  0.4992,  0.1657,  0.2029,  0.7569,  0.2262,
         0.2572,  0.2669,  0.7900,  0.4741,  0.2455,  0.3137,  0.2542,
         0.2009,  0.4354,  0.3325,  0.7012,  0.7463,  0.5539,  0.5055,
         0.2562,  0.6114,  0.4561,  0.4966,  0.3259,  0.6143,  0.6717,
         0.7369,  0.4155,  0.6220,  0.4799,  0.2168,  0.7523,  0.2877,
         0.3444,  0.6074,  0.1348,  0.4368,  0.4277,  0.5576,  0.1254,
         0.5242,  0.6787,  0.2902,  0.2855,  0.2487,  0.2297,  0.3121,
         0.6050,  0.2373,  0.3616,  0.1533,  0.2218,  0.3106,  0.5372,
         0.2995,  0.2065,  0.6010,  0.3939,  0.5975,  0.4184,  0.6023,
         0.5625,  0.2866,  0.8773,  0.7869,  0.3353,  0.1339,  0.5267,
         0.5223,  0.2323,  0.6174,  0.5658,  0.3322,  0.6637,  0.8152,
         0.6100,  0.7898,  0.5934,  0.8284,  0.5971,  0.7586,  0.6339,
         0.2744,  0.2873,  0.8596,  0.4062,  0.2556,  0.7024,  0.5167,
         0.3863,  0.5392,  0.3959,  0.3423,  0.3502,  0.2854,  0.7957,
         0.1857,  0.3360,  0.8333,  0.6479,  0.4663,  0.6261,  0.2257,
         0.2276,  0.1660,  0.6437,  0.1142,  0.1951,  0.7563,  0.5229,
         0.4634,  0.4401,  0.5830,  0.3401,  0.5712,  0.6282,  0.4607,
         0.4363,  0.2304,  0.8007,  0.5259,  0.7427,  0.6037,  0.3350,
         0.8242,  0.6031,  0.2032,  0.6038,  0.6789,  0.7492,  0.6755,
         0.3999,  0.2347,  0.2467,  0.6424,  0.3801,  0.4226,  0.2914,
         0.5046,  0.1448,  0.6167,  0.2735,  0.4127,  0.5092,  0.2418,
         0.7536,  0.2913,  0.5612,  0.8716,  0.2349,  0.3179,  0.4576,
         0.3915,  0.6213,  0.4214,  0.4301,  0.6832,  0.3361,  0.3772,
         0.6518,  0.1331,  0.3716,  0.6445,  0.6206,  0.7323,  0.2427,
         0.7389,  0.3364,  0.3193,  0.7169,  0.6700,  0.7184,  0.1774,
         0.4849,  0.5375,  0.4279,  0.5085,  0.3102,  0.4038,  0.8212,
         0.2804,  0.5396,  0.5185,  0.2683,  0.6501,  0.3672,  0.5875,
         0.6156,  0.5935,  0.5104,  0.4179,  0.4870,  0.6798,  0.6281,
         0.2836,  0.4318,  0.3427,  0.3556,  0.5196,  0.4066,  0.6035,
         0.2022,  0.5685,  0.6034,  0.2842,  0.3015,  0.8236,  0.6928,
         0.6588,  0.1592,  0.6380,  0.4270,  0.5429,  0.4976,  0.6315,
         0.4840,  0.5060,  0.1925,  0.7720,  0.3379,  0.3839,  0.5824,
         0.4079,  0.6848,  0.7495,  0.5143,  0.3758,  0.5775,  0.3594,
         0.4186,  0.3119,  0.7343,  0.4081,  0.7008,  0.6016,  0.5471,
         0.4839,  0.7381,  0.4530,  0.5190,  0.8463,  0.7380,  0.3993,
         0.2314], device='cuda:0')
tensor(0.5569, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6229,  0.2541,  0.4844,  0.7415,  0.6675,  0.5664,  0.4234,
         0.5399,  0.3752,  0.5062,  0.6361,  0.6600,  0.7370,  0.4915,
         0.7228,  0.1566,  0.2352,  0.5283,  0.4068,  0.4556,  0.2033,
         0.6101,  0.3969,  0.3474,  0.3399,  0.5071,  0.7102,  0.2484,
         0.2403,  0.7998,  0.3694,  0.4334,  0.4437,  0.2683,  0.4683,
         0.1526,  0.1287,  0.1850,  0.3761,  0.9127,  0.1850,  0.1765,
         0.5255,  0.6481,  0.3988,  0.7931,  0.6449,  0.5100,  0.2224,
         0.4259,  0.4632,  0.1504,  0.5331,  0.2198,  0.7932,  0.4632,
         0.3221,  0.5816,  0.5454,  0.8189,  0.4548,  0.5525,  0.3483,
         0.7829,  0.6698,  0.6848,  0.4107,  0.7531,  0.5773,  0.7149,
         0.4781,  0.5914,  0.4838,  0.3281,  0.8024,  0.7195,  0.6998,
         0.3354,  0.2860,  0.3163,  0.6284,  0.3275,  0.5170,  0.3078,
         0.2296,  0.8089,  0.2428,  0.6237,  0.5540,  0.3008,  0.1945,
         0.2595,  0.4551,  0.3644,  0.3749,  0.6467,  0.3415,  0.2356,
         0.4304,  0.6160,  0.3834,  0.7226,  0.2640,  0.3010,  0.4505,
         0.8607,  0.3792,  0.3682,  0.5794,  0.4595,  0.3510,  0.4672,
         0.5581,  0.6539,  0.5868,  0.4875,  0.4545,  0.3667,  0.6015,
         0.5035,  0.6156,  0.5358,  0.3945,  0.6950,  0.4833,  0.4244,
         0.8415,  0.4546,  0.9000,  0.5862,  0.4251,  0.5888,  0.5945,
         0.4317,  0.2509,  0.7847,  0.7298,  0.6295,  0.5365,  0.5316,
         0.4259,  0.2873,  0.3699,  0.3088,  0.5494,  0.1811,  0.5555,
         0.5594,  0.6073,  0.5794,  0.9126,  0.7834,  0.6941,  0.6362,
         0.4425,  0.3784,  0.3212,  0.2864,  0.4436,  0.4718,  0.1277,
         0.3361,  0.3981,  0.5366,  0.1103,  0.6791,  0.7073,  0.4803,
         0.7006,  0.2431,  0.6127,  0.4302,  0.5037,  0.4306,  0.4587,
         0.4438,  0.5918,  0.4971,  0.7687,  0.5078,  0.4947,  0.2665,
         0.3097,  0.3403,  0.3399,  0.4785,  0.7548,  0.5922,  0.5459,
         0.6809,  0.3956,  0.6848,  0.2778,  0.6919,  0.4352,  0.4467,
         0.1970,  0.5026,  0.4803,  0.3643,  0.3723,  0.1618,  0.2860,
         0.3625,  0.5452,  0.3750,  0.2244,  0.2855,  0.5940,  0.6059,
         0.5334,  0.4494,  0.1902,  0.4583,  0.1931,  0.3185,  0.2871,
         0.8868,  0.3245,  0.4820,  0.5790,  0.4718,  0.6097,  0.2707,
         0.7421,  0.3790,  0.4016,  0.2364,  0.4924,  0.2746,  0.6202,
         0.7922,  0.5022,  0.5891,  0.2235,  0.3303,  0.4764,  0.6547,
         0.6839,  0.4760,  0.6454,  0.6790,  0.3822,  0.6350,  0.3982,
         0.6595,  0.5296,  0.1559,  0.1400,  0.7777,  0.3804,  0.6957,
         0.5277,  0.5108,  0.1913,  0.4383,  0.1918,  0.5987,  0.7202,
         0.6223,  0.3729,  0.1778,  0.4959,  0.4117,  0.6760,  0.2381,
         0.5190,  0.4946,  0.3150,  0.1784,  0.5345,  0.1076,  0.7050,
         0.3078,  0.5622,  0.5350,  0.2478,  0.2361,  0.3506,  0.1252,
         0.3264,  0.6394,  0.8216,  0.5368,  0.2361,  0.3384,  0.4340,
         0.6776,  0.5640,  0.4104,  0.3048,  0.3437,  0.6457,  0.3034,
         0.6534,  0.6451,  0.3593,  0.4950,  0.2928,  0.1765,  0.4166,
         0.4058,  0.2344,  0.7965,  0.9436,  0.2829,  0.2747,  0.2371,
         0.6602,  0.7128,  0.4994,  0.5316,  0.4386,  0.2180,  0.2054,
         0.4687,  0.3081,  0.2157,  0.6274,  0.5911,  0.3461,  0.5054,
         0.3219,  0.2685,  0.6020,  0.5438,  0.1818,  0.3533,  0.4663,
         0.2209,  0.2882,  0.2570,  0.4796,  0.2683,  0.7269,  0.3051,
         0.2263,  0.6808,  0.5931,  0.2942,  0.7546,  0.5581,  0.2466,
         0.4756,  0.6464,  0.2719,  0.7765,  0.6324,  0.4791,  0.3007,
         0.7569,  0.2568,  0.5416,  0.3082,  0.6450,  0.5865,  0.5221,
         0.6835,  0.7611,  0.9215,  0.5980,  0.6327,  0.5540,  0.4596,
         0.5804,  0.4243,  0.7476,  0.6040,  0.6317,  0.4378,  0.3701,
         0.2567,  0.4886,  0.5721,  0.4667,  0.7086,  0.6175,  0.3031,
         0.2427,  0.3507,  0.3067,  0.8877,  0.6724,  0.5392,  0.4322,
         0.8651,  0.5801,  0.5176,  0.3499,  0.7050,  0.2906,  0.5135,
         0.2801,  0.7938,  0.5970,  0.4226,  0.7371,  0.1174,  0.1878,
         0.2763,  0.3728,  0.3928,  0.6189,  0.5020,  0.5745,  0.2290,
         0.1625,  0.5856,  0.5838,  0.4778,  0.5380,  0.1560,  0.6074,
         0.1915,  0.4930,  0.5228,  0.4613,  0.3333,  0.2752,  0.5046,
         0.2050,  0.3154,  0.5550,  0.4857,  0.7095,  0.2821,  0.5143,
         0.1838,  0.4597,  0.3251,  0.3926,  0.4593,  0.5357,  0.6751,
         0.4078,  0.4100,  0.4307,  0.7723,  0.4769,  0.7027,  0.2714,
         0.6524,  0.2162,  0.2602,  0.5317,  0.2922,  0.6063,  0.6615,
         0.6383,  0.3185,  0.4759,  0.2634,  0.6498,  0.2035,  0.6363,
         0.3715,  0.4245,  0.7717,  0.6017,  0.6531,  0.8266,  0.6815,
         0.6176,  0.3117,  0.7666,  0.4502,  0.3697,  0.7403,  0.6676,
         0.4061,  0.5539,  0.1435,  0.5647,  0.5806,  0.3523,  0.5235,
         0.1498,  0.4360,  0.5722,  0.3300,  0.4564,  0.5681,  0.5674,
         0.9224,  0.6123,  0.4286,  0.4089,  0.2962,  0.2888,  0.7100,
         0.7872,  0.3972,  0.5722,  0.4180,  0.3137,  0.4511,  0.8703,
         0.3149,  0.5611,  0.1670,  0.4264,  0.3391,  0.2385,  0.3739,
         0.4248,  0.5889,  0.4190,  0.6304,  0.4609,  0.4138,  0.6038,
         0.4343], device='cuda:0')
tensor(0.5683, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5162,  0.2744,  0.7424,  0.7461,  0.5039,  0.5295,  0.4804,
         0.2904,  0.7188,  0.8045,  0.9530,  0.2164,  0.5425,  0.8573,
         0.5251,  0.2800,  0.1512,  0.7779,  0.1147,  0.3083,  0.3759,
         0.2351,  0.3048,  0.4135,  0.3718,  0.5506,  0.4770,  0.5455,
         0.7516,  0.2954,  0.3498,  0.3855,  0.1705,  0.5546,  0.3258,
         0.3002,  0.6277,  0.5003,  0.2381,  0.5643,  0.1225,  0.8686,
         0.2960,  0.2418,  0.6783,  0.6743,  0.6251,  0.4736,  0.6923,
         0.5252,  0.2984,  0.6805,  0.2940,  0.4901,  0.5174,  0.6308,
         0.3055,  0.0871,  0.4202,  0.3422,  0.4849,  0.6905,  0.3571,
         0.3900,  0.2671,  0.5345,  0.3497,  0.5849,  0.4060,  0.6893,
         0.4885,  0.4503,  0.2687,  0.5875,  0.6310,  0.2438,  0.5541,
         0.2814,  0.1448,  0.6326,  0.7132,  0.5987,  0.4436,  0.5493,
         0.3777,  0.2566,  0.3683,  0.3407,  0.6950,  0.7642,  0.5411,
         0.3352,  0.3324,  0.3971,  0.3361,  0.7296,  0.6373,  0.1608,
         0.8003,  0.7163,  0.1915,  0.3869,  0.3760,  0.5889,  0.7396,
         0.8564,  0.4863,  0.3886,  0.6076,  0.1945,  0.4427,  0.6316,
         0.6983,  0.6219,  0.5427,  0.6134,  0.2351,  0.9610,  0.2702,
         0.2616,  0.5050,  0.2459,  0.4795,  0.9246,  0.2412,  0.4083,
         0.7005,  0.6331,  0.2815,  0.4117,  0.4771,  0.6876,  0.4596,
         0.8485,  0.5310,  0.5759,  0.3549,  0.9375,  0.2653,  0.8658,
         0.4432,  0.7404,  0.4301,  0.5165,  0.2694,  0.6887,  0.5508,
         0.5698,  0.2980,  0.6949,  0.3446,  0.5750,  0.5059,  0.7588,
         0.4170,  0.3817,  0.4328,  0.2135,  0.6069,  0.9573,  0.7118,
         0.8444,  0.0881,  0.5657,  0.1799,  0.2965,  0.2646,  0.2951,
         0.8794,  0.9434,  0.2989,  0.2425,  0.4277,  0.8234,  0.2433,
         0.5424,  0.8286,  0.4569,  0.5978,  0.3304,  0.6124,  0.4635,
         0.9249,  0.1448,  0.2673,  0.7815,  0.2329,  0.4925,  0.5999,
         0.7830,  0.2192,  0.5311,  0.5308,  0.3371,  0.0802,  0.6945,
         0.8557,  0.3173,  0.6800,  0.1127,  0.1801,  0.4394,  0.1490,
         0.3357,  0.7970,  0.2903,  0.8043,  0.1312,  0.3269,  0.7353,
         0.8625,  0.5841,  0.3557,  0.3156,  0.6720,  0.5025,  0.6332,
         0.3169,  0.2824,  0.8584,  0.5961,  0.6081,  0.3602,  0.3715,
         0.1103,  0.3178,  0.1177,  0.3973,  0.4132,  0.5719,  0.5289,
         0.5034,  0.7345,  0.5900,  0.6335,  0.3642,  0.3793,  0.6619,
         0.6669,  0.5321,  0.4955,  0.2928,  0.4852,  0.2802,  0.4996,
         0.6966,  0.9352,  0.5888,  0.6164,  0.6185,  0.2507,  0.5072,
         0.4457,  0.2575,  0.4716,  0.8176,  0.5665,  0.6681,  0.4406,
         0.7799,  0.1716,  0.4385,  0.4489,  0.5164,  0.9124,  0.5127,
         0.9054,  0.5645,  0.2382,  0.1715,  0.2463,  0.4996,  0.4619,
         0.2299,  0.4256,  0.8634,  0.1502,  0.6971,  0.5439,  0.7148,
         0.9468,  0.2114,  0.8315,  0.9432,  0.8971,  0.6950,  0.2000,
         0.5038,  0.3331,  0.8759,  0.4638,  0.6178,  0.2719,  0.3653,
         0.6400,  0.2967,  0.3184,  0.2084,  0.5938,  0.3964,  0.1870,
         0.2087,  0.3643,  0.9539,  0.5513,  0.4988,  0.2214,  0.7068,
         0.7054,  0.2424,  0.5055,  0.4819,  0.3735,  0.1414,  0.8205,
         0.4965,  0.6877,  0.6605,  0.3408,  0.7068,  0.2068,  0.2223,
         0.2929,  0.6763,  0.4468,  0.3945,  0.4059,  0.4112,  0.8475,
         0.4884,  0.4735,  0.2169,  0.4124,  0.3386,  0.2946,  0.5431,
         0.6633,  0.4760,  0.3026,  0.4838,  0.8559,  0.6719,  0.1104,
         0.1720,  0.1771,  0.3692,  0.2322,  0.4691,  0.2500,  0.6572,
         0.4470,  0.3082,  0.7225,  0.6538,  0.8172,  0.5153,  0.5463,
         0.2160,  0.4609,  0.6886,  0.5804,  0.3385,  0.3764,  0.1315,
         0.4997,  0.5052,  0.4911,  0.6071,  0.7173,  0.1246,  0.1281,
         0.2483,  0.4970,  0.3068,  0.2826,  0.2274,  0.1871,  0.6619,
         0.5062,  0.3855,  0.7263,  0.7311,  0.5001,  0.5630,  0.6538,
         0.2517,  0.0878,  0.6581,  0.2462,  0.3408,  0.3684,  0.3756,
         0.4319,  0.2912,  0.6393,  0.7418,  0.3605,  0.7705,  0.6122,
         0.8265,  0.4174,  0.7201,  0.8121,  0.7440,  0.4342,  0.3072,
         0.3985,  0.6269,  0.1684,  0.7050,  0.6026,  0.2548,  0.5121,
         0.1829,  0.8467,  0.5143,  0.1284,  0.3674,  0.4436,  0.2897,
         0.6144,  0.5211,  0.2441,  0.2781,  0.6245,  0.2114,  0.4176,
         0.1460,  0.8941,  0.7319,  0.6608,  0.3335,  0.2092,  0.4087,
         0.3167,  0.6403,  0.3491,  0.7823,  0.4041,  0.6805,  0.2081,
         0.1213,  0.6218,  0.3392,  0.7329,  0.7331,  0.5998,  0.5844,
         0.5218,  0.5086,  0.3446,  0.5327,  0.5672,  0.3901,  0.5089,
         0.7617,  0.4940,  0.2374,  0.5949,  0.2039,  0.5241,  0.2965,
         0.2811,  0.7468,  0.4556,  0.3778,  0.4488,  0.5393,  0.5875,
         0.4658,  0.2438,  0.3854,  0.6322,  0.6469,  0.8267,  0.6283,
         0.3059,  0.3681,  0.3892,  0.7382,  0.7932,  0.3451,  0.2999,
         0.5434,  0.6719,  0.4553,  0.6832,  0.7553,  0.1756,  0.7744,
         0.7382,  0.5402,  0.6159,  0.7337,  0.6361,  0.8813,  0.4312,
         0.1426,  0.3625,  0.4897,  0.3183,  0.6943,  0.4869,  0.3382,
         0.9453,  0.2828,  0.2499,  0.5105,  0.6169,  0.3764,  0.7014,
         0.5137], device='cuda:0')
tensor(0.5624, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6040,  0.5717,  0.6705,  0.4774,  0.2044,  0.4583,  0.5558,
         0.6321,  0.1743,  0.5577,  0.1727,  0.4211,  0.3948,  0.3970,
         0.3499,  0.2792,  0.7740,  0.7585,  0.9121,  0.2274,  0.7687,
         0.5596,  0.2730,  0.4919,  0.1351,  0.7977,  0.3132,  0.2571,
         0.1773,  0.1426,  0.1738,  0.6534,  0.1672,  0.2663,  0.6486,
         0.0298,  0.6072,  0.7237,  0.2402,  0.5534,  0.6046,  0.8096,
         0.4946,  0.5284,  0.7264,  0.5718,  0.4164,  0.4810,  0.1194,
         0.6653,  0.5885,  0.6528,  0.4366,  0.5546,  0.4668,  0.6850,
         0.3692,  0.5525,  0.2737,  0.4828,  0.3456,  0.7299,  0.5604,
         0.1769,  0.7396,  0.2550,  0.7349,  0.4408,  0.7756,  0.1292,
         0.8425,  0.8645,  0.2419,  0.4675,  0.1331,  0.6391,  0.7216,
         0.7632,  0.2798,  0.6557,  0.5808,  0.3899,  0.1882,  0.3073,
         0.7831,  0.3207,  0.4682,  0.3601,  0.4007,  0.8733,  0.7061,
         0.6235,  0.7695,  0.7496,  0.2230,  0.4477,  0.5352,  0.4352,
         0.2326,  0.6409,  0.7892,  0.6303,  0.1394,  0.4922,  0.2884,
         0.7920,  0.4335,  0.5001,  0.3607,  0.2629,  0.3821,  0.6186,
         0.5379,  0.1526,  0.7958,  0.6297,  0.3956,  0.5076,  0.5392,
         0.5599,  0.9237,  0.4934,  0.7644,  0.7557,  0.2354,  0.1703,
         0.5195,  0.2646,  0.2085,  0.7165,  0.2680,  0.7363,  0.5091,
         0.3126,  0.4804,  0.9379,  0.6163,  0.6286,  0.4692,  0.6657,
         0.5646,  0.8360,  0.4360,  0.4060,  0.5644,  0.6798,  0.6713,
         0.7336,  0.3128,  0.6590,  0.2769,  0.5284,  0.5652,  0.1542,
         0.3749,  0.1595,  0.3529,  0.1835,  0.7577,  0.4822,  0.7394,
         0.5363,  0.4658,  0.9707,  0.1958,  0.5318,  0.1987,  0.4896,
         0.2320,  0.6490,  0.3756,  0.3672,  0.4861,  0.4011,  0.7844,
         0.4428,  0.6415,  0.7613,  0.2270,  0.4502,  0.1575,  0.6552,
         0.2985,  0.3291,  0.1221,  0.4270,  0.2949,  0.5855,  0.7518,
         0.4173,  0.5014,  0.7139,  0.4246,  0.4985,  0.4899,  0.7495,
         0.1838,  0.9550,  0.4115,  0.2898,  0.3267,  0.5864,  0.7537,
         0.6236,  0.6241,  0.2272,  0.3660,  0.7452,  0.3960,  0.7241,
         0.3922,  0.4714,  0.2554,  0.4392,  0.3164,  0.6009,  0.2123,
         0.3646,  0.2116,  0.5783,  0.1669,  0.8133,  0.5020,  0.5837,
         0.3750,  0.7711,  0.2601,  0.5337,  0.1730,  0.6469,  0.2339,
         0.2775,  0.6908,  0.5274,  0.2404,  0.5890,  0.8402,  0.0692,
         0.7394,  0.5215,  0.4180,  0.2372,  0.1569,  0.4669,  0.2365,
         0.2519,  0.4056,  0.1772,  0.1521,  0.3058,  0.6564,  0.4943,
         0.5606,  0.3302,  0.6422,  0.0962,  0.6294,  0.8503,  0.2155,
         0.2184,  0.3005,  0.7510,  0.5824,  0.4038,  0.6954,  0.3655,
         0.2359,  0.4103,  0.7476,  0.3557,  0.5285,  0.8601,  0.5024,
         0.7631,  0.7710,  0.5729,  0.1542,  0.1855,  0.2771,  0.2272,
         0.3193,  0.2676,  0.4144,  0.5892,  0.6061,  0.8005,  0.7458,
         0.2585,  0.3362,  0.3199,  0.6236,  0.5522,  0.5570,  0.5943,
         0.1814,  0.4953,  0.4052,  0.5328,  0.4083,  0.5266,  0.6769,
         0.5989,  0.2709,  0.3486,  0.5524,  0.8536,  0.5184,  0.4312,
         0.4829,  0.5999,  0.3328,  0.4701,  0.3337,  0.3747,  0.2561,
         0.8218,  0.7588,  0.7847,  0.4099,  0.7796,  0.0505,  0.4731,
         0.6492,  0.3287,  0.4288,  0.7278,  0.4575,  0.4583,  0.5415,
         0.6508,  0.4817,  0.3888,  0.3152,  0.6287,  0.8287,  0.4546,
         0.2086,  0.2549,  0.8265,  0.2398,  0.2746,  0.1760,  0.7051,
         0.2915,  0.2885,  0.7314,  0.4904,  0.7562,  0.1773,  0.7102,
         0.1822,  0.3664,  0.1039,  0.3996,  0.3244,  0.7773,  0.2962,
         0.6451,  0.4863,  0.3243,  0.6936,  0.4991,  0.4168,  0.2512,
         0.3950,  0.5116,  0.8467,  0.3974,  0.4601,  0.8127,  0.5977,
         0.4449,  0.3229,  0.3975,  0.3454,  0.5951,  0.3411,  0.5419,
         0.2224,  0.6216,  0.4517,  0.3799,  0.1413,  0.6936,  0.6095,
         0.0861,  0.7451,  0.2107,  0.2444,  0.1564,  0.5170,  0.5775,
         0.4781,  0.2360,  0.1201,  0.3032,  0.9726,  0.7782,  0.8541,
         0.6039,  0.7424,  0.3649,  0.1432,  0.0864,  0.4711,  0.3584,
         0.5681,  0.1813,  0.5071,  0.7318,  0.3365,  0.1573,  0.2129,
         0.4521,  0.2054,  0.2157,  0.0951,  0.2045,  0.1558,  0.8104,
         0.8866,  0.6743,  0.2182,  0.3176,  0.8160,  0.4579,  0.5903,
         0.8226,  0.5149,  0.5665,  0.7881,  0.2139,  0.3232,  0.2685,
         0.2722,  0.5741,  0.3125,  0.4564,  0.0946,  0.2729,  0.2390,
         0.3966,  0.1703,  0.3874,  0.5600,  0.2248,  0.3363,  0.3247,
         0.6366,  0.7214,  0.2588,  0.4058,  0.6904,  0.1837,  0.2493,
         0.7103,  0.1891,  0.4909,  0.7141,  0.7315,  0.0887,  0.5746,
         0.5339,  0.2531,  0.7388,  0.3200,  0.5511,  0.1419,  0.2325,
         0.3052,  0.6344,  0.9703,  0.6610,  0.6327,  0.3778,  0.3204,
         0.3313,  0.2186,  0.6588,  0.7405,  0.7278,  0.5744,  0.1723,
         0.5528,  0.3424,  0.3894,  0.6490,  0.1204,  0.6228,  0.5780,
         0.2498,  0.7484,  0.3755,  0.4528,  0.2115,  0.3532,  0.5676,
         0.2331,  0.6087,  0.6649,  0.4510,  0.6845,  0.7775,  0.4187,
         0.6856,  0.3581,  0.7768,  0.9148,  0.2566,  0.1886,  0.6391,
         0.5390], device='cuda:0')
tensor(0.5621, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5404,  0.4107,  0.5394,  0.1861,  0.6936,  0.8047,  0.3523,
         0.7184,  0.6266,  0.8646,  0.1716,  0.6280,  0.4709,  0.5151,
         0.4303,  0.4968,  0.2476,  0.1642,  0.1598,  0.2777,  0.7057,
         0.3347,  0.6481,  0.4121,  0.1916,  0.8600,  0.3216,  0.3089,
         0.2414,  0.6786,  0.2728,  0.9055,  0.2340,  0.2924,  0.8312,
         0.5550,  0.2729,  0.5801,  0.8925,  0.4165,  0.9214,  0.1358,
         0.1694,  0.4926,  0.9571,  0.2224,  0.4190,  0.1961,  0.5541,
         0.3505,  0.8793,  0.8383,  0.3986,  0.3553,  0.1873,  0.6717,
         0.5958,  0.3252,  0.7504,  0.4429,  0.4393,  0.4468,  0.5461,
         0.5546,  0.3754,  0.1250,  0.2054,  0.7065,  0.8792,  0.5591,
         0.7451,  0.8884,  0.2893,  0.8052,  0.1380,  0.7668,  0.5353,
         0.7265,  0.2530,  0.8792,  0.3036,  0.1071,  0.2374,  0.2295,
         0.4151,  0.7813,  0.2909,  0.1121,  0.8743,  0.4382,  0.8353,
         0.6893,  0.2865,  0.4616,  0.1797,  0.8751,  0.5843,  0.8809,
         0.4655,  0.1882,  0.9740,  0.5548,  0.6111,  0.1085,  0.5954,
         0.1809,  0.1912,  0.5234,  0.6141,  0.4415,  0.1383,  0.1072,
         0.8262,  0.3350,  0.3065,  0.4774,  0.6224,  0.4431,  0.2234,
         0.7430,  0.1677,  0.2090,  0.4401,  0.6494,  0.7416,  0.6786,
         0.8408,  0.5904,  0.6388,  0.5063,  0.5831,  0.5117,  0.2226,
         0.4370,  0.2957,  0.4265,  0.4051,  0.3475,  0.2928,  0.6287,
         0.5107,  0.7897,  0.4630,  0.2210,  0.4778,  0.8633,  0.1875,
         0.8351,  0.4493,  0.2576,  0.2187,  0.2158,  0.4964,  0.2844,
         0.7674,  0.6921,  0.7455,  0.4701,  0.6605,  0.1309,  0.4745,
         0.2965,  0.6113,  0.1063,  0.5031,  0.6074,  0.1459,  0.1726,
         0.0758,  0.7681,  0.6497,  0.6580,  0.3006,  0.4239,  0.7378,
         0.4311,  0.8719,  0.4063,  0.9569,  0.6587,  0.7087,  0.8206,
         0.8813,  0.1752,  0.8545,  0.1109,  0.9154,  0.7442,  0.5567,
         0.6298,  0.2293,  0.3152,  0.1579,  0.2564,  0.3413,  0.2845,
         0.6558,  0.1921,  0.6550,  0.5158,  0.3380,  0.2333,  0.5703,
         0.5389,  0.2844,  0.5685,  0.2387,  0.4758,  0.2606,  0.2218,
         0.9246,  0.4706,  0.2871,  0.6331,  0.1348,  0.3144,  0.1953,
         0.8336,  0.1418,  0.1353,  0.1618,  0.5583,  0.7911,  0.7914,
         0.6543,  0.3188,  0.2760,  0.7091,  0.7690,  0.3205,  0.2572,
         0.9673,  0.7758,  0.6594,  0.8100,  0.1729,  0.8229,  0.5665,
         0.8662,  0.4517,  0.3328,  0.1780,  0.2974,  0.8475,  0.2380,
         0.1603,  0.2811,  0.7328,  0.6239,  0.1986,  0.8551,  0.2900,
         0.7580,  0.5041,  0.6745,  0.1009,  0.2281,  0.3993,  0.1869,
         0.4323,  0.2377,  0.8238,  0.3274,  0.6241,  0.5142,  0.6046,
         0.8221,  0.3359,  0.3270,  0.4824,  0.3699,  0.1492,  0.1574,
         0.2161,  0.8054,  0.3113,  0.3802,  0.4634,  0.7449,  0.5669,
         0.5649,  0.2210,  0.2446,  0.4669,  0.4013,  0.7127,  0.2437,
         0.3123,  0.7241,  0.2425,  0.3989,  0.5001,  0.8508,  0.2292,
         0.4639,  0.2222,  0.8745,  0.4299,  0.4515,  0.6297,  0.2733,
         0.2756,  0.1867,  0.3940,  0.4182,  0.4380,  0.4038,  0.2041,
         0.1899,  0.3318,  0.7717,  0.4611,  0.2045,  0.5306,  0.7591,
         0.1986,  0.9309,  0.7730,  0.6981,  0.7224,  0.7748,  0.3567,
         0.4284,  0.3750,  0.7061,  0.7941,  0.1354,  0.2125,  0.1454,
         0.3321,  0.6554,  0.5947,  0.3871,  0.6029,  0.3695,  0.1700,
         0.3770,  0.6862,  0.5700,  0.6064,  0.7078,  0.7203,  0.4655,
         0.6899,  0.8024,  0.0798,  0.3242,  0.7638,  0.2774,  0.1912,
         0.2423,  0.5914,  0.2977,  0.9153,  0.3893,  0.4337,  0.7112,
         0.3086,  0.5360,  0.3461,  0.6082,  0.8331,  0.3445,  0.6605,
         0.2649,  0.3746,  0.5344,  0.5370,  0.3479,  0.4003,  0.5845,
         0.4106,  0.1650,  0.0951,  0.3113,  0.6348,  0.1787,  0.6200,
         0.6905,  0.2976,  0.6909,  0.8116,  0.4498,  0.4759,  0.5169,
         0.1406,  0.4406,  0.7105,  0.3841,  0.5827,  0.7376,  0.6900,
         0.6681,  0.7654,  0.7308,  0.3812,  0.5010,  0.4384,  0.3038,
         0.5049,  0.5781,  0.0902,  0.2783,  0.6801,  0.2754,  0.4252,
         0.8041,  0.5770,  0.7123,  0.6667,  0.9196,  0.7194,  0.2903,
         0.1032,  0.4116,  0.2120,  0.7035,  0.1444,  0.3085,  0.4359,
         0.5345,  0.3594,  0.2745,  0.0997,  0.9749,  0.8658,  0.7425,
         0.4089,  0.8430,  0.8642,  0.7771,  0.6376,  0.5737,  0.7628,
         0.5642,  0.2457,  0.8620,  0.6081,  0.7730,  0.7318,  0.3848,
         0.3680,  0.6572,  0.1276,  0.6730,  0.7114,  0.7786,  0.1341,
         0.6522,  0.6394,  0.4460,  0.8452,  0.0610,  0.6867,  0.1260,
         0.8111,  0.1833,  0.6141,  0.4988,  0.0875,  0.5452,  0.5845,
         0.1345,  0.4351,  0.4134,  0.5628,  0.2879,  0.3183,  0.2792,
         0.4041,  0.7420,  0.4645,  0.1840,  0.3118,  0.1908,  0.7284,
         0.1412,  0.5740,  0.7920,  0.2843,  0.6261,  0.6990,  0.6681,
         0.3175,  0.3547,  0.1613,  0.3587,  0.6147,  0.5740,  0.7834,
         0.5350,  0.1645,  0.7996,  0.2636,  0.5888,  0.5701,  0.7032,
         0.5497,  0.4937,  0.6012,  0.2655,  0.8850,  0.3168,  0.7460,
         0.1343,  0.1219,  0.1886,  0.4969,  0.1370,  0.5994,  0.6057,
         0.4392], device='cuda:0')
tensor(0.5331, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7729,  0.1422,  0.6335,  0.6805,  0.6328,  0.4958,  0.3814,
         0.4371,  0.5120,  0.1915,  0.2083,  0.7076,  0.7526,  0.2275,
         0.6451,  0.1124,  0.2557,  0.1203,  0.6877,  0.8825,  0.6776,
         0.9066,  0.1106,  0.1168,  0.2368,  0.9019,  0.4719,  0.6936,
         0.6486,  0.1707,  0.7415,  0.4673,  0.1704,  0.3866,  0.4991,
         0.3164,  0.9317,  0.5265,  0.1203,  0.4743,  0.4380,  0.5510,
         0.8434,  0.1045,  0.6291,  0.7125,  0.2479,  0.5636,  0.2638,
         0.6005,  0.4746,  0.6936,  0.5889,  0.3342,  0.1881,  0.7986,
         0.4591,  0.0990,  0.5993,  0.0882,  0.7838,  0.4881,  0.6733,
         0.5681,  0.5050,  0.2055,  0.8407,  0.1411,  0.2283,  0.6151,
         0.3800,  0.4378,  0.0842,  0.1729,  0.3661,  0.5331,  0.2208,
         0.6212,  0.5958,  0.5598,  0.1762,  0.1519,  0.3768,  0.7489,
         0.1232,  0.5965,  0.2151,  0.7987,  0.2818,  0.4345,  0.0599,
         0.2129,  0.4874,  0.2833,  0.2122,  0.7729,  0.2190,  0.7246,
         0.3382,  0.2215,  0.1444,  0.6298,  0.7145,  0.1022,  0.8197,
         0.3834,  0.1165,  0.3497,  0.5171,  0.1777,  0.4211,  0.7686,
         0.7347,  0.5834,  0.5524,  0.7412,  0.3739,  0.6210,  0.5927,
         0.4492,  0.8583,  0.3608,  0.7353,  0.9179,  0.3016,  0.5370,
         0.2252,  0.2537,  0.7858,  0.4942,  0.6793,  0.2094,  0.6846,
         0.1830,  0.5776,  0.7346,  0.6734,  0.1501,  0.1258,  0.3111,
         0.5617,  0.6218,  0.1357,  0.2011,  0.3971,  0.6294,  0.1230,
         0.1183,  0.2189,  0.2671,  0.2279,  0.2859,  0.9044,  0.2222,
         0.1004,  0.3413,  0.4742,  0.3838,  0.5474,  0.8860,  0.1242,
         0.2131,  0.2363,  0.2086,  0.5011,  0.7649,  0.0977,  0.7281,
         0.3929,  0.2732,  0.1976,  0.8556,  0.3238,  0.6011,  0.4864,
         0.5959,  0.3185,  0.6909,  0.9620,  0.5873,  0.3273,  0.1427,
         0.7511,  0.1603,  0.8854,  0.7260,  0.6287,  0.7080,  0.6344,
         0.1549,  0.7048,  0.3774,  0.6054,  0.4488,  0.7464,  0.4113,
         0.2175,  0.6289,  0.5559,  0.5114,  0.8900,  0.2730,  0.2676,
         0.4964,  0.1689,  0.3915,  0.2023,  0.2295,  0.7781,  0.8625,
         0.7585,  0.9068,  0.6555,  0.2294,  0.7703,  0.4555,  0.5557,
         0.2047,  0.1225,  0.0914,  0.2052,  0.8985,  0.2421,  0.5875,
         0.8286,  0.1689,  0.2984,  0.1413,  0.5880,  0.9136,  0.4088,
         0.2551,  0.5875,  0.1306,  0.7194,  0.7244,  0.5562,  0.8332,
         0.7194,  0.5255,  0.7889,  0.3116,  0.2768,  0.6857,  0.2745,
         0.2471,  0.1503,  0.8093,  0.6159,  0.5220,  0.2048,  0.4688,
         0.1197,  0.3626,  0.3330,  0.5318,  0.6112,  0.0735,  0.5880,
         0.3807,  0.6657,  0.5511,  0.5455,  0.6978,  0.1185,  0.5797,
         0.6477,  0.2804,  0.1980,  0.7457,  0.2718,  0.7297,  0.8318,
         0.3399,  0.6602,  0.8273,  0.6598,  0.4172,  0.0552,  0.8694,
         0.8185,  0.2087,  0.6126,  0.7216,  0.0949,  0.5049,  0.7313,
         0.1925,  0.7407,  0.1881,  0.3929,  0.6611,  0.4142,  0.7940,
         0.2092,  0.2524,  0.6817,  0.2192,  0.9451,  0.0984,  0.5719,
         0.1681,  0.1453,  0.1583,  0.1839,  0.1917,  0.5787,  0.5127,
         0.1248,  0.4715,  0.2695,  0.2982,  0.5417,  0.3411,  0.1776,
         0.7057,  0.3511,  0.3610,  0.1573,  0.4421,  0.7537,  0.6696,
         0.4992,  0.6976,  0.2101,  0.6883,  0.2605,  0.2890,  0.2429,
         0.6308,  0.6126,  0.2939,  0.8419,  0.3280,  0.6870,  0.8554,
         0.1116,  0.1379,  0.6117,  0.3640,  0.1920,  0.3928,  0.5465,
         0.7501,  0.6712,  0.4677,  0.1411,  0.5614,  0.1015,  0.1699,
         0.5408,  0.4394,  0.7100,  0.1410,  0.4770,  0.8772,  0.2420,
         0.9443,  0.5364,  0.3359,  0.4763,  0.2485,  0.7341,  0.2056,
         0.6934,  0.4219,  0.6214,  0.6081,  0.1538,  0.8596,  0.7087,
         0.6573,  0.2974,  0.3412,  0.1052,  0.5823,  0.2679,  0.7794,
         0.6607,  0.1599,  0.2390,  0.1551,  0.5591,  0.1067,  0.3006,
         0.7916,  0.7839,  0.2348,  0.3301,  0.3196,  0.1951,  0.8672,
         0.3737,  0.7131,  0.4827,  0.3070,  0.1662,  0.1168,  0.3206,
         0.0859,  0.3516,  0.7712,  0.8032,  0.9084,  0.2200,  0.2021,
         0.2331,  0.3937,  0.1666,  0.1423,  0.4379,  0.8152,  0.2176,
         0.6823,  0.5795,  0.5760,  0.2759,  0.6245,  0.8035,  0.1336,
         0.1482,  0.7483,  0.1247,  0.7780,  0.4328,  0.6417,  0.2965,
         0.8717,  0.8223,  0.5927,  0.2252,  0.6159,  0.3786,  0.3550,
         0.1881,  0.6293,  0.5738,  0.6503,  0.2431,  0.3074,  0.4175,
         0.5355,  0.2575,  0.8001,  0.7048,  0.8615,  0.0925,  0.5960,
         0.2670,  0.9695,  0.1567,  0.3036,  0.6572,  0.3329,  0.2101,
         0.5745,  0.6490,  0.7728,  0.3964,  0.2857,  0.0737,  0.5777,
         0.7033,  0.4112,  0.7542,  0.8131,  0.5584,  0.9188,  0.2354,
         0.7123,  0.2241,  0.7991,  0.8173,  0.2052,  0.1187,  0.5834,
         0.8115,  0.8677,  0.2535,  0.5183,  0.7770,  0.8205,  0.6940,
         0.2634,  0.7444,  0.2027,  0.7264,  0.7036,  0.3540,  0.9297,
         0.1049,  0.4766,  0.0849,  0.1318,  0.1623,  0.9002,  0.6834,
         0.6330,  0.2162,  0.7900,  0.3078,  0.2304,  0.5800,  0.4683,
         0.2821,  0.8151,  0.7937,  0.9032,  0.1900,  0.2750,  0.3128,
         0.6391], device='cuda:0')
tensor(0.5972, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1578,  0.4265,  0.2255,  0.6095,  0.5262,  0.2259,  0.6081,
         0.0469,  0.6880,  0.8414,  0.7189,  0.3103,  0.2628,  0.4123,
         0.3476,  0.2123,  0.5434,  0.2829,  0.7714,  0.7177,  0.7618,
         0.1155,  0.2692,  0.2137,  0.0592,  0.5570,  0.2908,  0.4308,
         0.0800,  0.1521,  0.1989,  0.3027,  0.8664,  0.4846,  0.6922,
         0.1140,  0.4145,  0.5331,  0.7304,  0.3364,  0.6123,  0.9841,
         0.8177,  0.6890,  0.2611,  0.6271,  0.7426,  0.7077,  0.3834,
         0.1452,  0.3015,  0.1930,  0.1909,  0.1368,  0.2619,  0.1477,
         0.7329,  0.1631,  0.6885,  0.8476,  0.5587,  0.2740,  0.2672,
         0.8608,  0.7406,  0.2339,  0.8358,  0.5714,  0.9272,  0.8235,
         0.1178,  0.1739,  0.5390,  0.4191,  0.1701,  0.6816,  0.4805,
         0.1453,  0.8229,  0.1382,  0.0911,  0.7424,  0.7981,  0.0660,
         0.8634,  0.6890,  0.3127,  0.5889,  0.8660,  0.4937,  0.8332,
         0.3995,  0.4035,  0.2236,  0.2016,  0.6095,  0.7310,  0.8227,
         0.7638,  0.1574,  0.3334,  0.2243,  0.8395,  0.1390,  0.6720,
         0.8283,  0.3475,  0.1233,  0.5886,  0.1256,  0.8916,  0.5800,
         0.5658,  0.1499,  0.7497,  0.2371,  0.4038,  0.3105,  0.4700,
         0.3366,  0.8348,  0.0464,  0.6573,  0.5689,  0.1825,  0.4332,
         0.8066,  0.6007,  0.8321,  0.2976,  0.5630,  0.7798,  0.4001,
         0.1460,  0.5251,  0.5166,  0.6553,  0.7841,  0.0928,  0.7725,
         0.1776,  0.2522,  0.6394,  0.7536,  0.1017,  0.4978,  0.6867,
         0.1079,  0.5328,  0.6062,  0.2985,  0.6669,  0.1468,  0.9373,
         0.1480,  0.2250,  0.8655,  0.7650,  0.1988,  0.1626,  0.1991,
         0.7805,  0.3235,  0.5286,  0.6772,  0.1269,  0.7561,  0.5389,
         0.7868,  0.2961,  0.7036,  0.5597,  0.7917,  0.1217,  0.4388,
         0.2521,  0.2591,  0.1938,  0.1689,  0.7597,  0.5781,  0.2509,
         0.6217,  0.1702,  0.8039,  0.7133,  0.6486,  0.7147,  0.6183,
         0.8213,  0.5028,  0.2182,  0.6783,  0.1368,  0.6079,  0.8760,
         0.5920,  0.1761,  0.6313,  0.2720,  0.5955,  0.8525,  0.1803,
         0.0999,  0.1121,  0.5949,  0.1904,  0.2316,  0.6597,  0.8523,
         0.8929,  0.2728,  0.2559,  0.7780,  0.6718,  0.6764,  0.5203,
         0.8387,  0.8474,  0.1780,  0.2917,  0.0864,  0.6456,  0.1748,
         0.3551,  0.7069,  0.1741,  0.8208,  0.2550,  0.8006,  0.8145,
         0.2135,  0.3104,  0.5946,  0.1103,  0.8102,  0.6337,  0.7473,
         0.7542,  0.4177,  0.3697,  0.1322,  0.0993,  0.7368,  0.7861,
         0.7721,  0.3138,  0.8534,  0.4092,  0.4142,  0.1601,  0.5735,
         0.1658,  0.6989,  0.7948,  0.7430,  0.3904,  0.7478,  0.8439,
         0.6154,  0.2668,  0.7889,  0.1354,  0.0392,  0.4984,  0.7822,
         0.6695,  0.6197,  0.7336,  0.2332,  0.7447,  0.3220,  0.2048,
         0.1911,  0.5539,  0.3885,  0.7419,  0.1147,  0.6703,  0.8214,
         0.7474,  0.6374,  0.4000,  0.7839,  0.0599,  0.4868,  0.6258,
         0.7969,  0.9072,  0.7009,  0.3487,  0.7259,  0.7384,  0.5603,
         0.7103,  0.5523,  0.8782,  0.0979,  0.3207,  0.6581,  0.6822,
         0.8749,  0.6969,  0.8449,  0.8154,  0.4936,  0.2541,  0.4319,
         0.7651,  0.2242,  0.2474,  0.4316,  0.3160,  0.7631,  0.0928,
         0.8549,  0.3092,  0.8376,  0.3057,  0.4344,  0.1456,  0.5088,
         0.7553,  0.2239,  0.7327,  0.6313,  0.2346,  0.0998,  0.4545,
         0.3752,  0.8882,  0.5817,  0.8024,  0.9569,  0.6448,  0.9730,
         0.8239,  0.7721,  0.2752,  0.7148,  0.9300,  0.7552,  0.7557,
         0.7951,  0.6729,  0.1120,  0.7929,  0.4485,  0.2564,  0.7790,
         0.5972,  0.1802,  0.5609,  0.8664,  0.8204,  0.6526,  0.5006,
         0.5946,  0.1416,  0.8859,  0.3311,  0.1805,  0.2421,  0.5709,
         0.5400,  0.0580,  0.5360,  0.4080,  0.9086,  0.7566,  0.6182,
         0.7799,  0.6762,  0.6103,  0.3713,  0.3097,  0.4417,  0.4472,
         0.3973,  0.0699,  0.1759,  0.7344,  0.7548,  0.1312,  0.9137,
         0.1287,  0.6208,  0.8473,  0.5340,  0.8221,  0.1242,  0.7585,
         0.1199,  0.6163,  0.1827,  0.4226,  0.2797,  0.1731,  0.8553,
         0.7959,  0.6311,  0.7836,  0.2069,  0.1607,  0.5219,  0.8307,
         0.7586,  0.4361,  0.7559,  0.1703,  0.0799,  0.1494,  0.7884,
         0.6388,  0.2949,  0.3464,  0.2881,  0.8152,  0.6458,  0.1773,
         0.2622,  0.1415,  0.6935,  0.7688,  0.7914,  0.7938,  0.1312,
         0.1835,  0.3706,  0.2955,  0.3090,  0.1318,  0.0430,  0.1869,
         0.5843,  0.5507,  0.2481,  0.7851,  0.3174,  0.1436,  0.2006,
         0.1264,  0.5379,  0.1300,  0.2365,  0.7122,  0.7511,  0.6570,
         0.6889,  0.8047,  0.0912,  0.1164,  0.7302,  0.1730,  0.2878,
         0.4175,  0.5028,  0.7588,  0.8177,  0.0956,  0.7629,  0.6198,
         0.1199,  0.4866,  0.5276,  0.4702,  0.7815,  0.8266,  0.8139,
         0.0904,  0.8125,  0.2168,  0.6775,  0.7591,  0.8033,  0.7987,
         0.2113,  0.9558,  0.1371,  0.7630,  0.5745,  0.3983,  0.2177,
         0.6333,  0.8606,  0.3416,  0.7900,  0.8900,  0.6659,  0.6401,
         0.0742,  0.6625,  0.4060,  0.2531,  0.7679,  0.4767,  0.3693,
         0.1272,  0.8686,  0.5513,  0.8067,  0.5335,  0.1082,  0.4569,
         0.1752,  0.3811,  0.1562,  0.2891,  0.8156,  0.5619,  0.4747,
         0.8840], device='cuda:0')
tensor(0.5032, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1087,  0.8842,  0.4878,  0.1413,  0.8711,  0.1320,  0.2722,
         0.1758,  0.9499,  0.4242,  0.6101,  0.2768,  0.6501,  0.6525,
         0.8145,  0.1151,  0.7398,  0.8107,  0.7802,  0.2478,  0.7566,
         0.3588,  0.7170,  0.6512,  0.5823,  0.1483,  0.6954,  0.4322,
         0.5153,  0.8212,  0.2235,  0.3371,  0.8757,  0.6792,  0.1514,
         0.8325,  0.1778,  0.1657,  0.2473,  0.7648,  0.1829,  0.1263,
         0.5765,  0.1047,  0.8082,  0.4968,  0.6267,  0.2853,  0.7835,
         0.8106,  0.9058,  0.5385,  0.8161,  0.2507,  0.1657,  0.0643,
         0.8139,  0.1119,  0.8035,  0.6940,  0.8210,  0.7348,  0.6576,
         0.9195,  0.8341,  0.8222,  0.6901,  0.6601,  0.6733,  0.8601,
         0.1102,  0.8892,  0.8241,  0.4267,  0.7904,  0.2835,  0.0956,
         0.5442,  0.1284,  0.7076,  0.4155,  0.3089,  0.8260,  0.2704,
         0.2333,  0.7601,  0.6459,  0.1716,  0.8803,  0.8315,  0.1148,
         0.5229,  0.3596,  0.6829,  0.7767,  0.6901,  0.3161,  0.6842,
         0.2286,  0.7604,  0.7935,  0.8850,  0.8307,  0.7466,  0.7915,
         0.5557,  0.7077,  0.6767,  0.8209,  0.0643,  0.7930,  0.1569,
         0.2414,  0.8201,  0.6888,  0.2360,  0.7824,  0.4090,  0.2281,
         0.4606,  0.8899,  0.8479,  0.8276,  0.6768,  0.8563,  0.7601,
         0.7580,  0.1116,  0.7274,  0.2321,  0.5670,  0.2103,  0.6211,
         0.1426,  0.8865,  0.8657,  0.7680,  0.8102,  0.0899,  0.7180,
         0.3307,  0.3528,  0.2944,  0.1536,  0.5788,  0.4147,  0.7104,
         0.8656,  0.2653,  0.7060,  0.6269,  0.7198,  0.1462,  0.5058,
         0.6758,  0.1793,  0.6024,  0.1307,  0.8650,  0.7060,  0.0716,
         0.0937,  0.6332,  0.7215,  0.1455,  0.1215,  0.7170,  0.8309,
         0.9477,  0.7673,  0.3485,  0.1290,  0.7430,  0.4640,  0.6720,
         0.9727,  0.8206,  0.8492,  0.5625,  0.1946,  0.7729,  0.8099,
         0.7619,  0.7201,  0.7589,  0.7093,  0.1172,  0.7102,  0.4721,
         0.6000,  0.7454,  0.1748,  0.5454,  0.5536,  0.0986,  0.7368,
         0.1157,  0.4487,  0.1677,  0.7378,  0.2706,  0.7688,  0.1868,
         0.9241,  0.7471,  0.0997,  0.8817,  0.7711,  0.8236,  0.1690,
         0.5404,  0.7168,  0.2309,  0.6573,  0.1022,  0.5243,  0.7796,
         0.2735,  0.6918,  0.4553,  0.4386,  0.8325,  0.6476,  0.6729,
         0.2509,  0.8037,  0.7568,  0.2848,  0.2152,  0.7776,  0.9663,
         0.8510,  0.3590,  0.7303,  0.8328,  0.6676,  0.6416,  0.7684,
         0.8149,  0.8372,  0.8638,  0.7547,  0.8454,  0.9769,  0.1679,
         0.0926,  0.2188,  0.9545,  0.8213,  0.9765,  0.5192,  0.4046,
         0.7018,  0.4311,  0.8150,  0.8949,  0.4648,  0.4851,  0.8262,
         0.8417,  0.8879,  0.5969,  0.7085,  0.5113,  0.8801,  0.1879,
         0.2768,  0.4378,  0.8342,  0.8354,  0.3392,  0.7597,  0.6150,
         0.7383,  0.6412,  0.8590,  0.8215,  0.5017,  0.7650,  0.3688,
         0.3214,  0.2250,  0.9539,  0.8042,  0.3512,  0.3644,  0.9289,
         0.8666,  0.7821,  0.8529,  0.2286,  0.1198,  0.2074,  0.3554,
         0.4442,  0.8422,  0.1957,  0.6076,  0.8497,  0.7367,  0.3821,
         0.3261,  0.8458,  0.1196,  0.1164,  0.7708,  0.3463,  0.9346,
         0.1775,  0.7764,  0.2706,  0.4036,  0.1769,  0.2390,  0.4399,
         0.0935,  0.2840,  0.7041,  0.7901,  0.7990,  0.6178,  0.6594,
         0.2698,  0.6668,  0.1996,  0.2524,  0.2124,  0.0692,  0.5320,
         0.2876,  0.6857,  0.7798,  0.1346,  0.3326,  0.8318,  0.8697,
         0.3280,  0.2357,  0.1298,  0.1802,  0.8020,  0.1268,  0.5772,
         0.1795,  0.6773,  0.8959,  0.1931,  0.7092,  0.5450,  0.8394,
         0.2013,  0.0825,  0.2608,  0.5828,  0.2585,  0.6590,  0.2222,
         0.8942,  0.5241,  0.5621,  0.6496,  0.7553,  0.7873,  0.5053,
         0.6518,  0.3808,  0.1553,  0.1644,  0.1996,  0.4413,  0.3165,
         0.0796,  0.6551,  0.6875,  0.8630,  0.8216,  0.0941,  0.8355,
         0.6145,  0.6451,  0.1760,  0.0489,  0.1438,  0.1885,  0.4373,
         0.1612,  0.8729,  0.1851,  0.5609,  0.1545,  0.4397,  0.8419,
         0.5356,  0.1529,  0.8626,  0.2428,  0.7391,  0.2433,  0.1635,
         0.8144,  0.4828,  0.4701,  0.9176,  0.1949,  0.1165,  0.7784,
         0.7973,  0.6244,  0.7247,  0.5632,  0.5291,  0.3604,  0.8124,
         0.1858,  0.2317,  0.4439,  0.2025,  0.9134,  0.4847,  0.8744,
         0.7968,  0.8844,  0.1588,  0.9029,  0.4113,  0.4141,  0.8861,
         0.7181,  0.1114,  0.2278,  0.2742,  0.2121,  0.1606,  0.8263,
         0.2224,  0.7484,  0.3051,  0.7545,  0.2680,  0.8673,  0.2958,
         0.6914,  0.4448,  0.8009,  0.7334,  0.8875,  0.2246,  0.8282,
         0.4234,  0.3285,  0.7564,  0.7008,  0.8840,  0.1214,  0.4006,
         0.2286,  0.8904,  0.7411,  0.5563,  0.8714,  0.0933,  0.2517,
         0.1981,  0.0489,  0.8484,  0.0813,  0.8466,  0.4602,  0.7197,
         0.2315,  0.4285,  0.3120,  0.4815,  0.8085,  0.9158,  0.2910,
         0.6872,  0.1977,  0.3664,  0.9105,  0.0930,  0.8390,  0.7459,
         0.7893,  0.2217,  0.7511,  0.5623,  0.1000,  0.0546,  0.9581,
         0.0997,  0.0405,  0.7468,  0.5148,  0.8881,  0.7323,  0.6674,
         0.1496,  0.8449,  0.2223,  0.7685,  0.8734,  0.7852,  0.7026,
         0.7922,  0.7080,  0.7192,  0.2923,  0.9619,  0.1494,  0.8781,
         0.9534], device='cuda:0')
tensor(0.5482, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6421,  0.2679,  0.8441,  0.1835,  0.3533,  0.6686,  0.9144,
         0.3268,  0.8740,  0.6262,  0.2478,  0.1265,  0.2786,  0.8830,
         0.1153,  0.1132,  0.8071,  0.9151,  0.5660,  0.3767,  0.3082,
         0.9624,  0.8077,  0.2212,  0.1203,  0.5372,  0.7898,  0.6428,
         0.7187,  0.8333,  0.1253,  0.2229,  0.7025,  0.8359,  0.6121,
         0.0870,  0.1527,  0.3535,  0.2216,  0.8165,  0.1455,  0.6752,
         0.7506,  0.6521,  0.2994,  0.4208,  0.6338,  0.4202,  0.7691,
         0.1480,  0.2619,  0.2843,  0.2873,  0.1079,  0.1330,  0.1480,
         0.7596,  0.3625,  0.9014,  0.7129,  0.1344,  0.2780,  0.0902,
         0.7590,  0.9105,  0.8750,  0.3425,  0.1267,  0.1088,  0.0613,
         0.6811,  0.8266,  0.2054,  0.1288,  0.5276,  0.1269,  0.7284,
         0.2609,  0.1795,  0.7408,  0.7439,  0.2882,  0.7642,  0.3769,
         0.0653,  0.8760,  0.0770,  0.8029,  0.1787,  0.7907,  0.8202,
         0.9596,  0.1781,  0.1496,  0.3029,  0.5387,  0.6656,  0.7573,
         0.5952,  0.1503,  0.0625,  0.7966,  0.3721,  0.6130,  0.1366,
         0.1412,  0.2009,  0.1130,  0.4687,  0.1265,  0.8018,  0.1575,
         0.6248,  0.2627,  0.2392,  0.1398,  0.5782,  0.0763,  0.2907,
         0.6330,  0.6559,  0.2064,  0.8892,  0.7672,  0.4623,  0.1420,
         0.7826,  0.1138,  0.7269,  0.3887,  0.3525,  0.2165,  0.5309,
         0.0968,  0.6174,  0.1254,  0.3232,  0.7953,  0.2257,  0.1293,
         0.1958,  0.7590,  0.2570,  0.7173,  0.7779,  0.1587,  0.3186,
         0.5982,  0.2491,  0.6582,  0.9091,  0.2834,  0.3792,  0.6847,
         0.1121,  0.6749,  0.0758,  0.7732,  0.6656,  0.7700,  0.0983,
         0.7669,  0.1635,  0.9185,  0.1248,  0.0768,  0.1998,  0.7199,
         0.6933,  0.8424,  0.7314,  0.6847,  0.6703,  0.2370,  0.6328,
         0.1114,  0.3252,  0.5817,  0.0934,  0.3348,  0.0859,  0.4040,
         0.9509,  0.2275,  0.7089,  0.7718,  0.8361,  0.1817,  0.1353,
         0.7698,  0.7015,  0.2739,  0.8758,  0.8458,  0.1804,  0.9499,
         0.1821,  0.1253,  0.6764,  0.6812,  0.8907,  0.3741,  0.9039,
         0.0923,  0.6160,  0.8227,  0.0866,  0.2070,  0.6755,  0.1499,
         0.2319,  0.7337,  0.6691,  0.7725,  0.7684,  0.4619,  0.6957,
         0.7284,  0.1195,  0.7093,  0.4389,  0.7743,  0.7053,  0.8211,
         0.9175,  0.1113,  0.6392,  0.7577,  0.8419,  0.8239,  0.6719,
         0.1096,  0.1788,  0.0940,  0.1275,  0.8320,  0.1026,  0.0879,
         0.8990,  0.0901,  0.3174,  0.5793,  0.8278,  0.3731,  0.2131,
         0.1419,  0.9100,  0.1239,  0.2558,  0.5325,  0.2273,  0.8483,
         0.2351,  0.8443,  0.9409,  0.6234,  0.8192,  0.1624,  0.4798,
         0.8068,  0.5576,  0.1236,  0.2399,  0.1887,  0.2465,  0.1582,
         0.7471,  0.9161,  0.8349,  0.7288,  0.6396,  0.1949,  0.1782,
         0.8673,  0.7391,  0.3916,  0.1303,  0.1796,  0.1387,  0.5730,
         0.0393,  0.6945,  0.6926,  0.8277,  0.8500,  0.2031,  0.4780,
         0.0907,  0.8070,  0.1488,  0.4300,  0.1178,  0.0893,  0.2000,
         0.1089,  0.8248,  0.9335,  0.8779,  0.8395,  0.8587,  0.5712,
         0.1863,  0.4553,  0.7114,  0.8097,  0.8522,  0.8543,  0.3137,
         0.8036,  0.0586,  0.1721,  0.1682,  0.8952,  0.1234,  0.8059,
         0.7387,  0.5376,  0.7207,  0.3309,  0.7752,  0.8400,  0.1149,
         0.6809,  0.1535,  0.2296,  0.0784,  0.2197,  0.1910,  0.2217,
         0.7931,  0.5382,  0.7659,  0.8459,  0.1855,  0.5221,  0.0886,
         0.7830,  0.0534,  0.8335,  0.6876,  0.9536,  0.1508,  0.7486,
         0.8399,  0.5013,  0.8102,  0.7497,  0.2100,  0.7400,  0.1957,
         0.6944,  0.5613,  0.7575,  0.8410,  0.0841,  0.7673,  0.7529,
         0.9048,  0.6523,  0.1026,  0.6263,  0.1236,  0.7345,  0.1360,
         0.1321,  0.7022,  0.2357,  0.7068,  0.4681,  0.5960,  0.7734,
         0.1904,  0.1544,  0.5029,  0.7151,  0.8740,  0.7752,  0.0842,
         0.2260,  0.9796,  0.1892,  0.1285,  0.7604,  0.1897,  0.8955,
         0.7409,  0.8447,  0.2262,  0.3212,  0.1145,  0.7789,  0.2764,
         0.2719,  0.8058,  0.3407,  0.9187,  0.8521,  0.1009,  0.1145,
         0.8945,  0.2757,  0.3528,  0.1318,  0.1573,  0.8167,  0.0689,
         0.8242,  0.6386,  0.3280,  0.2235,  0.4143,  0.5817,  0.2871,
         0.3575,  0.4312,  0.3890,  0.5793,  0.6664,  0.8380,  0.0863,
         0.3993,  0.2951,  0.8692,  0.1469,  0.6879,  0.1474,  0.2133,
         0.0948,  0.6162,  0.2011,  0.6708,  0.3081,  0.2264,  0.1650,
         0.2118,  0.5854,  0.6469,  0.5117,  0.1322,  0.1460,  0.7896,
         0.8727,  0.0861,  0.7683,  0.1125,  0.9196,  0.7884,  0.2068,
         0.1944,  0.2778,  0.3707,  0.1696,  0.4944,  0.8645,  0.7705,
         0.4654,  0.1070,  0.4094,  0.1374,  0.1288,  0.2088,  0.3828,
         0.5561,  0.1894,  0.4572,  0.1329,  0.1235,  0.5985,  0.8337,
         0.0614,  0.1336,  0.7661,  0.8136,  0.8039,  0.1200,  0.3358,
         0.1592,  0.9157,  0.2220,  0.4130,  0.3670,  0.0796,  0.1660,
         0.1147,  0.1672,  0.2336,  0.1232,  0.1818,  0.1802,  0.2011,
         0.9089,  0.9349,  0.1117,  0.2378,  0.2597,  0.1168,  0.0445,
         0.0623,  0.1925,  0.2499,  0.1332,  0.7491,  0.2438,  0.0717,
         0.1362,  0.2449,  0.3278,  0.6246,  0.3473,  0.6873,  0.2422,
         0.1872], device='cuda:0')
tensor(0.5821, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1338,  0.3308,  0.3607,  0.5548,  0.7378,  0.6896,  0.0610,
         0.1946,  0.1363,  0.9505,  0.2611,  0.8473,  0.7481,  0.1267,
         0.6785,  0.1387,  0.6204,  0.8533,  0.8269,  0.1627,  0.8985,
         0.1313,  0.8352,  0.0666,  0.7909,  0.7169,  0.0924,  0.3548,
         0.1381,  0.7304,  0.9595,  0.7422,  0.4782,  0.1897,  0.8031,
         0.1946,  0.1469,  0.6735,  0.8127,  0.2149,  0.2746,  0.1463,
         0.0585,  0.7187,  0.1046,  0.2542,  0.2345,  0.7105,  0.8769,
         0.0575,  0.1099,  0.2365,  0.2752,  0.8699,  0.0951,  0.1349,
         0.5998,  0.6963,  0.7003,  0.1145,  0.1178,  0.8050,  0.1512,
         0.6958,  0.1550,  0.9324,  0.9631,  0.5930,  0.1199,  0.3000,
         0.2472,  0.0563,  0.8579,  0.5223,  0.8104,  0.8307,  0.4309,
         0.1311,  0.1171,  0.0671,  0.9017,  0.8359,  0.4713,  0.1269,
         0.1778,  0.2015,  0.0644,  0.8748,  0.2373,  0.8602,  0.8109,
         0.6151,  0.8471,  0.5973,  0.3119,  0.1382,  0.1322,  0.3674,
         0.1711,  0.6115,  0.8567,  0.3959,  0.4458,  0.2585,  0.2485,
         0.8746,  0.5756,  0.1161,  0.6973,  0.1898,  0.8096,  0.1150,
         0.1451,  0.1597,  0.6688,  0.1330,  0.2074,  0.5266,  0.8498,
         0.1472,  0.3458,  0.8669,  0.0622,  0.1397,  0.0658,  0.6875,
         0.4672,  0.1734,  0.7473,  0.6819,  0.1633,  0.8035,  0.1781,
         0.3735,  0.7609,  0.7939,  0.5019,  0.3581,  0.9061,  0.2382,
         0.8341,  0.0639,  0.0538,  0.7249,  0.6889,  0.7205,  0.1570,
         0.7610,  0.2449,  0.4200,  0.2539,  0.6621,  0.8465,  0.0962,
         0.5128,  0.7238,  0.1640,  0.2643,  0.6982,  0.2544,  0.1676,
         0.8168,  0.9360,  0.8866,  0.0901,  0.8781,  0.2116,  0.0269,
         0.2022,  0.8203,  0.7678,  0.8019,  0.1563,  0.2542,  0.1794,
         0.0356,  0.3057,  0.1223,  0.2452,  0.1291,  0.7731,  0.0760,
         0.0755,  0.1621,  0.2033,  0.7603,  0.7611,  0.7669,  0.8186,
         0.4028,  0.8084,  0.7874,  0.8385,  0.4597,  0.4817,  0.3048,
         0.1622,  0.1619,  0.0997,  0.6734,  0.1113,  0.7255,  0.6983,
         0.0943,  0.1486,  0.8725,  0.8500,  0.3225,  0.0686,  0.8119,
         0.7504,  0.5511,  0.7809,  0.8531,  0.3370,  0.8073,  0.5186,
         0.1111,  0.2185,  0.1605,  0.1015,  0.5481,  0.1789,  0.1987,
         0.1528,  0.3317,  0.9067,  0.1702,  0.0489,  0.4069,  0.1304,
         0.1753,  0.2348,  0.5365,  0.3440,  0.2480,  0.1935,  0.8748,
         0.1602,  0.8440,  0.7368,  0.8537,  0.8751,  0.4945,  0.8037,
         0.6353,  0.6985,  0.2333,  0.1758,  0.8757,  0.7301,  0.1561,
         0.7971,  0.8964,  0.4423,  0.3978,  0.0968,  0.7739,  0.2936,
         0.8281,  0.7805,  0.5534,  0.2199,  0.7270,  0.0871,  0.2570,
         0.0697,  0.8702,  0.7653,  0.8222,  0.9432,  0.7412,  0.4902,
         0.7937,  0.1705,  0.1511,  0.7628,  0.4979,  0.5031,  0.9106,
         0.2476,  0.3573,  0.1622,  0.4074,  0.7701,  0.1613,  0.2077,
         0.1957,  0.9758,  0.7974,  0.4225,  0.1668,  0.7447,  0.1558,
         0.5588,  0.3911,  0.9512,  0.1904,  0.0391,  0.1135,  0.5939,
         0.8311,  0.8576,  0.0917,  0.0747,  0.2192,  0.9197,  0.8723,
         0.6747,  0.6151,  0.8125,  0.7670,  0.4797,  0.2118,  0.9145,
         0.3833,  0.4582,  0.4952,  0.0960,  0.7875,  0.1423,  0.8024,
         0.6249,  0.7485,  0.1518,  0.7275,  0.1780,  0.7585,  0.8837,
         0.8232,  0.7413,  0.1767,  0.1443,  0.1139,  0.1346,  0.2351,
         0.1085,  0.2067,  0.1277,  0.2355,  0.3046,  0.7368,  0.1552,
         0.6602,  0.8722,  0.0873,  0.1012,  0.3305,  0.1506,  0.9269,
         0.6847,  0.2503,  0.3026,  0.9435,  0.8672,  0.0859,  0.8192,
         0.1109,  0.5559,  0.1183,  0.2020,  0.1575,  0.1760,  0.8161,
         0.0626,  0.4030,  0.1548,  0.8675,  0.7325,  0.3043,  0.1325,
         0.6232,  0.1192,  0.2097,  0.1625,  0.8227,  0.7207,  0.3220,
         0.2139,  0.2096,  0.1826,  0.2205,  0.0707,  0.8901,  0.1071,
         0.8454,  0.8589,  0.0901,  0.8257,  0.2724,  0.1151,  0.1980,
         0.7921,  0.4802,  0.7889,  0.5517,  0.0629,  0.3669,  0.7243,
         0.1373,  0.1453,  0.7724,  0.2496,  0.5865,  0.1255,  0.2193,
         0.5916,  0.1113,  0.0700,  0.6938,  0.4251,  0.7230,  0.8446,
         0.9749,  0.6893,  0.5621,  0.1985,  0.7787,  0.1125,  0.0847,
         0.8079,  0.7121,  0.0856,  0.2641,  0.5291,  0.8934,  0.1674,
         0.1644,  0.2463,  0.1405,  0.6316,  0.6334,  0.2923,  0.2015,
         0.1049,  0.8304,  0.9597,  0.0920,  0.8614,  0.1865,  0.6819,
         0.8745,  0.0616,  0.8595,  0.2828,  0.1020,  0.7645,  0.9050,
         0.6276,  0.1315,  0.7042,  0.5664,  0.1893,  0.2322,  0.6507,
         0.6346,  0.6854,  0.8779,  0.7403,  0.1275,  0.0679,  0.7238,
         0.2777,  0.3506,  0.1468,  0.5671,  0.8030,  0.7764,  0.1254,
         0.7744,  0.1347,  0.4344,  0.7913,  0.1984,  0.1643,  0.8017,
         0.2000,  0.0763,  0.1687,  0.5566,  0.6003,  0.2661,  0.8780,
         0.8276,  0.8594,  0.7257,  0.1289,  0.7154,  0.8579,  0.7023,
         0.1015,  0.1506,  0.8179,  0.5488,  0.1246,  0.9830,  0.4182,
         0.8087,  0.1816,  0.0728,  0.4560,  0.2555,  0.7668,  0.2025,
         0.2005,  0.8040,  0.2222,  0.6110,  0.2926,  0.8204,  0.3133,
         0.7915], device='cuda:0')
tensor(0.6293, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1814,  0.8662,  0.4657,  0.2667,  0.3179,  0.3145,  0.8844,
         0.1055,  0.8340,  0.3637,  0.2753,  0.8356,  0.1027,  0.2450,
         0.7825,  0.4198,  0.4563,  0.8601,  0.8163,  0.8081,  0.2708,
         0.1799,  0.1618,  0.8712,  0.2732,  0.7682,  0.8015,  0.5258,
         0.1138,  0.2188,  0.2225,  0.6888,  0.1237,  0.1986,  0.5891,
         0.2461,  0.1712,  0.2871,  0.2836,  0.0823,  0.9101,  0.0969,
         0.1768,  0.4088,  0.8073,  0.7712,  0.2683,  0.8181,  0.2720,
         0.2956,  0.2261,  0.5005,  0.2582,  0.6866,  0.1399,  0.1697,
         0.2933,  0.8267,  0.5318,  0.9028,  0.3765,  0.1498,  0.4893,
         0.2343,  0.6250,  0.1831,  0.8433,  0.8065,  0.8431,  0.1265,
         0.8667,  0.1198,  0.7281,  0.4425,  0.5352,  0.4358,  0.7580,
         0.1019,  0.2910,  0.1501,  0.2897,  0.8335,  0.0748,  0.9283,
         0.7149,  0.1730,  0.8570,  0.6639,  0.9368,  0.8678,  0.1549,
         0.8375,  0.0699,  0.0844,  0.8778,  0.3855,  0.7987,  0.2042,
         0.8639,  0.8004,  0.0627,  0.2131,  0.2325,  0.7409,  0.1786,
         0.7310,  0.1286,  0.1825,  0.2139,  0.3588,  0.8364,  0.6015,
         0.3902,  0.5153,  0.4376,  0.8716,  0.1135,  0.6965,  0.2615,
         0.7525,  0.3814,  0.0764,  0.6149,  0.1842,  0.8227,  0.1636,
         0.1704,  0.4326,  0.1228,  0.7528,  0.3923,  0.1874,  0.8883,
         0.7624,  0.2804,  0.7782,  0.7616,  0.1831,  0.8930,  0.0855,
         0.3245,  0.3753,  0.3937,  0.5938,  0.8950,  0.2966,  0.0789,
         0.3139,  0.3028,  0.8973,  0.2815,  0.9103,  0.6472,  0.1868,
         0.5757,  0.2832,  0.5857,  0.1970,  0.6279,  0.2173,  0.7682,
         0.3098,  0.6462,  0.7354,  0.1829,  0.6725,  0.3095,  0.4826,
         0.2911,  0.8040,  0.5089,  0.4539,  0.6057,  0.2980,  0.1117,
         0.8931,  0.5171,  0.4040,  0.7865,  0.3308,  0.7143,  0.6790,
         0.1202,  0.2110,  0.8270,  0.2900,  0.0934,  0.7174,  0.8063,
         0.9559,  0.9428,  0.1395,  0.0403,  0.4487,  0.1418,  0.7415,
         0.8103,  0.1114,  0.4660,  0.8147,  0.2130,  0.4996,  0.3392,
         0.4976,  0.8522,  0.5809,  0.8770,  0.1408,  0.1755,  0.7269,
         0.7937,  0.0663,  0.9233,  0.8168,  0.8112,  0.7957,  0.0585,
         0.9460,  0.7197,  0.5450,  0.1072,  0.2084,  0.1433,  0.5034,
         0.5657,  0.9157,  0.7605,  0.6520,  0.8486,  0.9904,  0.0781,
         0.1071,  0.3663,  0.1215,  0.6421,  0.8721,  0.7947,  0.0852,
         0.4773,  0.7919,  0.2694,  0.2500,  0.4604,  0.7429,  0.1488,
         0.1332,  0.7618,  0.8016,  0.2105,  0.2411,  0.5485,  0.7511,
         0.1643,  0.1684,  0.8399,  0.1195,  0.6163,  0.1444,  0.8154,
         0.6537,  0.7932,  0.2835,  0.6492,  0.8038,  0.7902,  0.2187,
         0.1268,  0.3028,  0.6025,  0.1634,  0.8314,  0.5651,  0.1192,
         0.4753,  0.2603,  0.4501,  0.3217,  0.1204,  0.2402,  0.7133,
         0.4925,  0.1919,  0.8109,  0.4062,  0.5750,  0.5995,  0.6281,
         0.8579,  0.1686,  0.4261,  0.8267,  0.8328,  0.7121,  0.4321,
         0.1907,  0.3686,  0.5989,  0.8948,  0.2318,  0.2492,  0.7175,
         0.1863,  0.7615,  0.1678,  0.6544,  0.3989,  0.2773,  0.4161,
         0.1317,  0.8147,  0.3346,  0.7071,  0.7636,  0.1486,  0.6713,
         0.3988,  0.6895,  0.8128,  0.2553,  0.1871,  0.8099,  0.2897,
         0.6981,  0.8212,  0.3459,  0.8053,  0.8475,  0.8692,  0.1696,
         0.4479,  0.8984,  0.7896,  0.6989,  0.9644,  0.6002,  0.8374,
         0.6126,  0.5376,  0.2334,  0.7257,  0.1200,  0.9321,  0.7544,
         0.3782,  0.1922,  0.7966,  0.9622,  0.7221,  0.5757,  0.1458,
         0.2055,  0.0823,  0.1499,  0.8503,  0.7903,  0.4339,  0.3256,
         0.3409,  0.2277,  0.1310,  0.8083,  0.7643,  0.4255,  0.0926,
         0.1964,  0.7178,  0.2672,  0.7697,  0.2126,  0.7081,  0.2253,
         0.5342,  0.7917,  0.1602,  0.0387,  0.2467,  0.3343,  0.8200,
         0.8513,  0.3891,  0.7964,  0.1500,  0.4145,  0.5591,  0.1929,
         0.8977,  0.1430,  0.2985,  0.7021,  0.1828,  0.4130,  0.6121,
         0.8169,  0.8867,  0.3336,  0.7927,  0.7030,  0.9562,  0.1006,
         0.2086,  0.7829,  0.8643,  0.7407,  0.8184,  0.2002,  0.0990,
         0.7740,  0.1240,  0.2561,  0.2615,  0.7373,  0.1659,  0.2450,
         0.9030,  0.7550,  0.2879,  0.4962,  0.1697,  0.3183,  0.7262,
         0.5950,  0.2334,  0.0733,  0.7163,  0.9089,  0.3940,  0.7893,
         0.8262,  0.8219,  0.1958,  0.9747,  0.7737,  0.7942,  0.5249,
         0.1378,  0.2002,  0.8068,  0.3850,  0.8568,  0.7073,  0.1851,
         0.7399,  0.8189,  0.5779,  0.1479,  0.1727,  0.5778,  0.2940,
         0.1655,  0.6272,  0.0818,  0.0816,  0.2194,  0.7405,  0.6591,
         0.6607,  0.8913,  0.8631,  0.8299,  0.2992,  0.8206,  0.1349,
         0.7895,  0.3444,  0.8412,  0.2201,  0.1368,  0.7791,  0.7136,
         0.6335,  0.1423,  0.3598,  0.6952,  0.6218,  0.1573,  0.7388,
         0.8055,  0.6613,  0.6231,  0.1653,  0.4049,  0.7815,  0.7959,
         0.3094,  0.7708,  0.8591,  0.8786,  0.4062,  0.3686,  0.3106,
         0.5983,  0.2625,  0.2616,  0.2043,  0.8861,  0.3406,  0.6077,
         0.8142,  0.8469,  0.7992,  0.2922,  0.8165,  0.0930,  0.1465,
         0.1746,  0.8741,  0.7822,  0.1161,  0.8728,  0.3693,  0.5578,
         0.7839], device='cuda:0')
tensor(0.5012, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2363,  0.3891,  0.7254,  0.6652,  0.3800,  0.8711,  0.6342,
         0.5467,  0.7525,  0.5372,  0.8009,  0.6872,  0.7850,  0.7969,
         0.6672,  0.7068,  0.8194,  0.1179,  0.3054,  0.1969,  0.1105,
         0.7504,  0.6385,  0.6581,  0.2034,  0.3558,  0.1550,  0.7163,
         0.7378,  0.6860,  0.2166,  0.8284,  0.8818,  0.2972,  0.5721,
         0.8512,  0.5674,  0.2914,  0.1811,  0.2471,  0.1219,  0.8768,
         0.6643,  0.1532,  0.7356,  0.7910,  0.6930,  0.6833,  0.9593,
         0.4530,  0.8122,  0.6551,  0.7405,  0.6905,  0.2057,  0.7455,
         0.5958,  0.5499,  0.7434,  0.2236,  0.8782,  0.2303,  0.1571,
         0.1790,  0.5519,  0.4460,  0.2006,  0.7480,  0.5985,  0.1809,
         0.6916,  0.4166,  0.1236,  0.1171,  0.2859,  0.3738,  0.2028,
         0.3355,  0.7896,  0.2036,  0.4067,  0.6834,  0.8418,  0.2652,
         0.9211,  0.6950,  0.3601,  0.2327,  0.3122,  0.8197,  0.3396,
         0.0990,  0.3206,  0.8134,  0.4703,  0.3243,  0.4994,  0.5997,
         0.6949,  0.2077,  0.2545,  0.8506,  0.8358,  0.6567,  0.8052,
         0.1699,  0.7732,  0.7544,  0.1562,  0.7885,  0.8658,  0.7662,
         0.3583,  0.1666,  0.2583,  0.5240,  0.5703,  0.8909,  0.7437,
         0.0798,  0.5969,  0.5687,  0.7726,  0.4643,  0.7972,  0.1500,
         0.6843,  0.8674,  0.8662,  0.6971,  0.9709,  0.8368,  0.6138,
         0.8920,  0.7378,  0.0943,  0.3158,  0.4062,  0.8705,  0.3959,
         0.2298,  0.4176,  0.7490,  0.2788,  0.7910,  0.1601,  0.3033,
         0.5972,  0.2384,  0.2887,  0.7913,  0.8482,  0.8246,  0.5334,
         0.4910,  0.5937,  0.3885,  0.7057,  0.8169,  0.7070,  0.9754,
         0.8659,  0.1618,  0.3188,  0.5138,  0.5859,  0.8093,  0.6922,
         0.1047,  0.1628,  0.4242,  0.4547,  0.4646,  0.2669,  0.3596,
         0.3004,  0.2002,  0.0809,  0.7613,  0.7808,  0.3216,  0.6289,
         0.6227,  0.3013,  0.6932,  0.8702,  0.8083,  0.7679,  0.2118,
         0.0985,  0.7049,  0.3203,  0.7675,  0.8087,  0.3091,  0.3869,
         0.2131,  0.3997,  0.3309,  0.5973,  0.2819,  0.1919,  0.3579,
         0.1537,  0.5826,  0.6584,  0.3438,  0.6360,  0.2409,  0.4789,
         0.7615,  0.1657,  0.3220,  0.4982,  0.8598,  0.6802,  0.2001,
         0.2692,  0.1676,  0.2551,  0.5509,  0.2328,  0.1622,  0.1976,
         0.4055,  0.4368,  0.6352,  0.1676,  0.6878,  0.7830,  0.7369,
         0.2443,  0.1487,  0.3990,  0.8650,  0.2656,  0.6694,  0.8786,
         0.7354,  0.2711,  0.7140,  0.1483,  0.7325,  0.6889,  0.7588,
         0.2987,  0.2901,  0.1523,  0.3118,  0.6397,  0.3444,  0.9499,
         0.4441,  0.6458,  0.3052,  0.1532,  0.6779,  0.3771,  0.4395,
         0.6264,  0.3171,  0.6386,  0.7707,  0.3825,  0.5881,  0.2359,
         0.2690,  0.8355,  0.5308,  0.2976,  0.2385,  0.3560,  0.1366,
         0.1421,  0.2660,  0.2903,  0.1640,  0.3820,  0.2666,  0.1148,
         0.6849,  0.8481,  0.1083,  0.6803,  0.5549,  0.5247,  0.5525,
         0.8405,  0.2762,  0.3143,  0.3312,  0.9571,  0.2204,  0.7570,
         0.7041,  0.4298,  0.7812,  0.3650,  0.8776,  0.2104,  0.2739,
         0.5652,  0.8743,  0.0948,  0.1584,  0.2368,  0.5739,  0.6142,
         0.5425,  0.7641,  0.4495,  0.5210,  0.5926,  0.3094,  0.6231,
         0.8394,  0.5285,  0.7487,  0.5459,  0.8580,  0.7828,  0.7094,
         0.5115,  0.2759,  0.8204,  0.2843,  0.7757,  0.4748,  0.1708,
         0.7687,  0.6535,  0.7067,  0.8215,  0.1482,  0.3070,  0.3839,
         0.4443,  0.5420,  0.0944,  0.8509,  0.6706,  0.6529,  0.6057,
         0.4237,  0.3425,  0.8253,  0.3298,  0.5602,  0.4572,  0.7533,
         0.6665,  0.4137,  0.4146,  0.9458,  0.6021,  0.3499,  0.4918,
         0.7400,  0.4737,  0.4730,  0.8618,  0.6218,  0.6364,  0.3788,
         0.7085,  0.7897,  0.7501,  0.6680,  0.1004,  0.1045,  0.5083,
         0.3857,  0.7334,  0.6819,  0.7418,  0.6866,  0.7197,  0.7106,
         0.6908,  0.7853,  0.6405,  0.5802,  0.2205,  0.3005,  0.3463,
         0.0715,  0.7023,  0.7586,  0.1243,  0.1784,  0.3851,  0.6415,
         0.2924,  0.6702,  0.7736,  0.8051,  0.8578,  0.3720,  0.6767,
         0.1851,  0.6247,  0.6494,  0.3803,  0.1487,  0.7289,  0.1378,
         0.7958,  0.2316,  0.3288,  0.8957,  0.4926,  0.2244,  0.2114,
         0.6656,  0.2009,  0.5500,  0.1560,  0.1826,  0.6548,  0.5830,
         0.3036,  0.8719,  0.7754,  0.2069,  0.6316,  0.1697,  0.7342,
         0.3697,  0.8807,  0.1616,  0.3380,  0.5099,  0.8241,  0.2968,
         0.6793,  0.6398,  0.1783,  0.2302,  0.3879,  0.5470,  0.7097,
         0.3863,  0.1901,  0.8627,  0.9743,  0.5425,  0.7131,  0.4509,
         0.7552,  0.2794,  0.7962,  0.2200,  0.6972,  0.7758,  0.7484,
         0.8403,  0.8609,  0.6540,  0.6409,  0.8892,  0.1373,  0.7072,
         0.6230,  0.2140,  0.2333,  0.8708,  0.8263,  0.1595,  0.7552,
         0.5082,  0.5287,  0.5044,  0.8494,  0.2155,  0.1229,  0.4861,
         0.2827,  0.9466,  0.7421,  0.4394,  0.5834,  0.5780,  0.8566,
         0.2369,  0.8399,  0.5921,  0.7354,  0.7040,  0.9679,  0.5191,
         0.3480,  0.8782,  0.9136,  0.1771,  0.3004,  0.5033,  0.6927,
         0.1071,  0.3241,  0.3592,  0.5099,  0.6342,  0.4995,  0.7290,
         0.8437,  0.6086,  0.3938,  0.2010,  0.6478,  0.6454,  0.3678,
         0.1606], device='cuda:0')
tensor(0.5171, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2422,  0.6433,  0.2312,  0.5381,  0.3289,  0.1720,  0.1587,
         0.2618,  0.1590,  0.2080,  0.7161,  0.3421,  0.4694,  0.2248,
         0.8886,  0.6049,  0.7716,  0.1686,  0.7501,  0.5226,  0.7779,
         0.2191,  0.7716,  0.6754,  0.5823,  0.3877,  0.9529,  0.3114,
         0.3763,  0.7199,  0.3728,  0.7040,  0.7905,  0.7662,  0.8137,
         0.4132,  0.4131,  0.7735,  0.2114,  0.1898,  0.5195,  0.2124,
         0.7246,  0.7073,  0.6925,  0.3244,  0.4955,  0.3010,  0.5939,
         0.2125,  0.8302,  0.7255,  0.8271,  0.6676,  0.8955,  0.2415,
         0.6277,  0.4041,  0.9625,  0.3805,  0.8178,  0.3440,  0.6120,
         0.2917,  0.7568,  0.8739,  0.4882,  0.8617,  0.5275,  0.2367,
         0.2875,  0.5817,  0.5876,  0.7332,  0.5826,  0.3392,  0.7821,
         0.7090,  0.7199,  0.4380,  0.0827,  0.2060,  0.2526,  0.3371,
         0.3480,  0.5381,  0.8057,  0.2097,  0.5745,  0.4700,  0.4919,
         0.4653,  0.4727,  0.3124,  0.6620,  0.6686,  0.5615,  0.4752,
         0.7348,  0.5224,  0.5841,  0.7935,  0.3248,  0.9681,  0.5416,
         0.3694,  0.5820,  0.4718,  0.6138,  0.2151,  0.4617,  0.5399,
         0.4299,  0.5067,  0.5453,  0.5961,  0.3988,  0.4734,  0.3799,
         0.2154,  0.2836,  0.7976,  0.2978,  0.5303,  0.7724,  0.4778,
         0.9370,  0.3649,  0.6015,  0.7427,  0.8769,  0.6072,  0.6472,
         0.2507,  0.5681,  0.7468,  0.5879,  0.1845,  0.3903,  0.2591,
         0.7602,  0.8061,  0.2447,  0.2821,  0.7223,  0.3403,  0.1737,
         0.1027,  0.8541,  0.1944,  0.2964,  0.6109,  0.6560,  0.6180,
         0.6389,  0.8473,  0.5568,  0.6939,  0.6325,  0.1976,  0.3550,
         0.2440,  0.6359,  0.2100,  0.6705,  0.6917,  0.2430,  0.4675,
         0.7121,  0.6222,  0.6962,  0.4613,  0.3235,  0.6330,  0.6259,
         0.8045,  0.6705,  0.7940,  0.4722,  0.4845,  0.7574,  0.5556,
         0.2980,  0.2876,  0.5885,  0.3799,  0.2365,  0.7695,  0.3353,
         0.5965,  0.4643,  0.2601,  0.6372,  0.1763,  0.6020,  0.7329,
         0.4812,  0.1882,  0.6484,  0.6832,  0.4833,  0.7444,  0.7169,
         0.5712,  0.3973,  0.6744,  0.2616,  0.7041,  0.7885,  0.6695,
         0.6377,  0.1606,  0.3629,  0.6443,  0.3989,  0.3168,  0.6217,
         0.7002,  0.6754,  0.4811,  0.6356,  0.4228,  0.6697,  0.5765,
         0.3008,  0.2582,  0.1489,  0.2657,  0.3558,  0.1859,  0.7600,
         0.4052,  0.0995,  0.6614,  0.6129,  0.7650,  0.6814,  0.2257,
         0.6569,  0.3514,  0.5353,  0.6732,  0.6266,  0.7108,  0.5314,
         0.7431,  0.7520,  0.7040,  0.6050,  0.6653,  0.9386,  0.3195,
         0.7531,  0.8898,  0.6391,  0.1507,  0.9323,  0.5957,  0.1632,
         0.5086,  0.1114,  0.5551,  0.9500,  0.2098,  0.7499,  0.5361,
         0.8218,  0.8235,  0.7452,  0.6177,  0.5730,  0.3903,  0.8283,
         0.9032,  0.6733,  0.3582,  0.5999,  0.7806,  0.2414,  0.7169,
         0.5165,  0.3638,  0.5781,  0.6771,  0.7681,  0.6054,  0.8816,
         0.8762,  0.2966,  0.4740,  0.6220,  0.7718,  0.7389,  0.6098,
         0.8845,  0.6967,  0.8822,  0.7480,  0.4132,  0.4535,  0.7402,
         0.8425,  0.6013,  0.7101,  0.3661,  0.3982,  0.8261,  0.6530,
         0.4750,  0.2380,  0.5122,  0.1999,  0.4956,  0.8207,  0.7361,
         0.6299,  0.5936,  0.7005,  0.6067,  0.4887,  0.5699,  0.6943,
         0.5626,  0.7718,  0.5781,  0.3854,  0.4402,  0.7066,  0.6173,
         0.7061,  0.7071,  0.3702,  0.2749,  0.7472,  0.7929,  0.8448,
         0.3462,  0.3326,  0.9293,  0.6465,  0.4062,  0.6266,  0.4596,
         0.2885,  0.8413,  0.8230,  0.2271,  0.3697,  0.3442,  0.3536,
         0.6832,  0.6984,  0.7886,  0.6508,  0.3519,  0.2777,  0.8120,
         0.3985,  0.1391,  0.2353,  0.2504,  0.5974,  0.6410,  0.6464,
         0.3400,  0.0832,  0.2615,  0.3552,  0.4167,  0.8157,  0.5328,
         0.4317,  0.7574,  0.4355,  0.8104,  0.4415,  0.9375,  0.4841,
         0.1322,  0.2448,  0.7693,  0.2477,  0.6965,  0.4237,  0.5689,
         0.7934,  0.6971,  0.2924,  0.8127,  0.7135,  0.0955,  0.3210,
         0.7843,  0.6919,  0.6010,  0.7907,  0.8128,  0.3927,  0.7968,
         0.6388,  0.8536,  0.9021,  0.3987,  0.6007,  0.8296,  0.3592,
         0.7216,  0.7465,  0.6753,  0.6360,  0.4023,  0.4602,  0.9595,
         0.5753,  0.2930,  0.4590,  0.6883,  0.3736,  0.8897,  0.4904,
         0.1893,  0.7357,  0.5263,  0.6266,  0.5414,  0.1268,  0.5864,
         0.3199,  0.4847,  0.5922,  0.1245,  0.7341,  0.2487,  0.9545,
         0.4792,  0.6884,  0.6439,  0.7722,  0.7298,  0.7643,  0.2307,
         0.8366,  0.5573,  0.2507,  0.4855,  0.1838,  0.6336,  0.5425,
         0.3560,  0.8345,  0.3438,  0.4363,  0.7586,  0.5669,  0.4664,
         0.7732,  0.5024,  0.7698,  0.4256,  0.3090,  0.8288,  0.2701,
         0.1322,  0.2319,  0.3829,  0.4598,  0.8637,  0.4221,  0.1988,
         0.4217,  0.3370,  0.3248,  0.7303,  0.8029,  0.5849,  0.6859,
         0.8204,  0.2928,  0.1792,  0.5221,  0.6496,  0.5405,  0.2684,
         0.8928,  0.8721,  0.6082,  0.5139,  0.8296,  0.2832,  0.2298,
         0.4555,  0.5973,  0.7662,  0.2803,  0.7718,  0.8805,  0.1573,
         0.5165,  0.4317,  0.3394,  0.3659,  0.5327,  0.4974,  0.7901,
         0.7623,  0.6976,  0.5259,  0.8357,  0.5732,  0.3033,  0.1865,
         0.7954], device='cuda:0')
tensor(0.5609, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5407,  0.2052,  0.3587,  0.1264,  0.3076,  0.3617,  0.1020,
         0.2601,  0.3781,  0.5890,  0.4357,  0.8715,  0.2572,  0.6551,
         0.3191,  0.3830,  0.6929,  0.2406,  0.8986,  0.4764,  0.3085,
         0.7235,  0.6029,  0.3580,  0.1502,  0.4177,  0.3003,  0.5425,
         0.2854,  0.7669,  0.4458,  0.6068,  0.6123,  0.7207,  0.2513,
         0.3979,  0.5713,  0.3899,  0.3867,  0.7465,  0.7689,  0.7703,
         0.6815,  0.1747,  0.1652,  0.6462,  0.7083,  0.8101,  0.5565,
         0.6935,  0.3678,  0.9308,  0.5974,  0.5290,  0.6582,  0.5691,
         0.7716,  0.6462,  0.6772,  0.8021,  0.2345,  0.4497,  0.7063,
         0.3775,  0.5174,  0.8061,  0.1438,  0.4871,  0.8627,  0.3060,
         0.4179,  0.8321,  0.7378,  0.6880,  0.6157,  0.5350,  0.4987,
         0.4355,  0.5499,  0.8701,  0.8893,  0.3036,  0.3027,  0.7341,
         0.4283,  0.3043,  0.1054,  0.2635,  0.5527,  0.2482,  0.7416,
         0.2002,  0.8857,  0.2947,  0.3669,  0.6466,  0.5858,  0.2189,
         0.4009,  0.3461,  0.5378,  0.8267,  0.5284,  0.4261,  0.1683,
         0.7261,  0.2084,  0.4762,  0.5390,  0.7168,  0.7170,  0.6785,
         0.6522,  0.2560,  0.7218,  0.6284,  0.7403,  0.3930,  0.3099,
         0.3837,  0.4564,  0.3409,  0.7017,  0.8886,  0.3792,  0.7142,
         0.8093,  0.4846,  0.5911,  0.3848,  0.6578,  0.8715,  0.8923,
         0.4629,  0.5348,  0.3866,  0.3122,  0.2482,  0.7072,  0.6121,
         0.7599,  0.5545,  0.1555,  0.7338,  0.7653,  0.6546,  0.4411,
         0.2650,  0.3316,  0.6965,  0.3605,  0.5291,  0.1686,  0.8069,
         0.4478,  0.9603,  0.1057,  0.2881,  0.2722,  0.5099,  0.7790,
         0.4951,  0.6754,  0.7599,  0.3802,  0.5420,  0.2295,  0.6533,
         0.2809,  0.3580,  0.5038,  0.7245,  0.3869,  0.3883,  0.5290,
         0.5440,  0.2366,  0.5645,  0.3647,  0.1277,  0.6112,  0.3617,
         0.3029,  0.3608,  0.6872,  0.5964,  0.3848,  0.5888,  0.6102,
         0.1950,  0.8177,  0.5136,  0.5438,  0.1093,  0.4240,  0.1812,
         0.7044,  0.4225,  0.2186,  0.2136,  0.6921,  0.7757,  0.2726,
         0.4088,  0.8311,  0.2154,  0.2805,  0.7189,  0.7832,  0.6783,
         0.6060,  0.2495,  0.4815,  0.4838,  0.4623,  0.3296,  0.5788,
         0.3199,  0.5659,  0.5184,  0.6511,  0.2191,  0.3048,  0.4812,
         0.7634,  0.6661,  0.3574,  0.7792,  0.6285,  0.4666,  0.4401,
         0.6351,  0.5860,  0.6777,  0.2856,  0.2684,  0.4610,  0.4468,
         0.2049,  0.3790,  0.5760,  0.2452,  0.4166,  0.7019,  0.5745,
         0.8096,  0.9507,  0.5715,  0.2944,  0.3887,  0.1578,  0.6675,
         0.3665,  0.3120,  0.6434,  0.7535,  0.6744,  0.6019,  0.5202,
         0.3001,  0.2915,  0.4125,  0.5363,  0.4377,  0.3334,  0.6279,
         0.6180,  0.3602,  0.5850,  0.5460,  0.3372,  0.3088,  0.6561,
         0.7701,  0.3358,  0.8267,  0.6861,  0.4976,  0.3374,  0.2812,
         0.4279,  0.5630,  0.8163,  0.7211,  0.5843,  0.1438,  0.6107,
         0.3946,  0.4567,  0.5055,  0.5902,  0.5357,  0.4764,  0.5942,
         0.8621,  0.5718,  0.6277,  0.4519,  0.4216,  0.6873,  0.5795,
         0.5489,  0.7588,  0.6918,  0.8870,  0.4403,  0.3450,  0.8464,
         0.1531,  0.3715,  0.5943,  0.6123,  0.1353,  0.6229,  0.1035,
         0.7154,  0.6041,  0.3930,  0.6264,  0.6458,  0.4185,  0.5262,
         0.6221,  0.4788,  0.3138,  0.1084,  0.1647,  0.3331,  0.2855,
         0.4710,  0.3466,  0.3636,  0.7739,  0.8946,  0.2971,  0.5588,
         0.2345,  0.3898,  0.1610,  0.3024,  0.5192,  0.3958,  0.2230,
         0.6190,  0.5855,  0.2921,  0.6808,  0.6583,  0.4800,  0.5817,
         0.4403,  0.7428,  0.8501,  0.7708,  0.5663,  0.6097,  0.2303,
         0.4127,  0.4846,  0.2365,  0.8232,  0.6080,  0.8114,  0.0707,
         0.6336,  0.5910,  0.2894,  0.7394,  0.6552,  0.5754,  0.7024,
         0.6604,  0.7860,  0.7227,  0.6259,  0.6538,  0.6461,  0.7163,
         0.5781,  0.7310,  0.1373,  0.5658,  0.8871,  0.9493,  0.2610,
         0.6553,  0.7150,  0.7747,  0.4728,  0.3307,  0.5245,  0.8337,
         0.8367,  0.3397,  0.7031,  0.6024,  0.3007,  0.3053,  0.7121,
         0.7327,  0.4579,  0.2973,  0.6444,  0.1579,  0.3166,  0.5299,
         0.3473,  0.2829,  0.8453,  0.5743,  0.7718,  0.7896,  0.7255,
         0.4663,  0.3609,  0.9587,  0.6249,  0.6921,  0.8061,  0.2889,
         0.8197,  0.1812,  0.2053,  0.7185,  0.1308,  0.5816,  0.8354,
         0.4245,  0.5197,  0.7820,  0.5183,  0.5005,  0.4220,  0.4894,
         0.2579,  0.2436,  0.3317,  0.4218,  0.5901,  0.2416,  0.2535,
         0.1618,  0.7098,  0.2695,  0.8885,  0.5316,  0.5983,  0.3415,
         0.6348,  0.4371,  0.3010,  0.8413,  0.8285,  0.6471,  0.7185,
         0.5084,  0.4050,  0.6537,  0.4595,  0.4329,  0.5762,  0.1805,
         0.4440,  0.9459,  0.2842,  0.6528,  0.2924,  0.1073,  0.5072,
         0.8165,  0.6078,  0.5344,  0.7209,  0.7076,  0.9501,  0.3058,
         0.3277,  0.4138,  0.1968,  0.7116,  0.0587,  0.5672,  0.5931,
         0.6233,  0.4142,  0.7110,  0.7843,  0.4236,  0.7339,  0.2345,
         0.3195,  0.2527,  0.4721,  0.5106,  0.3956,  0.7236,  0.8486,
         0.1707,  0.6077,  0.8258,  0.2641,  0.6076,  0.8251,  0.2780,
         0.3282,  0.6848,  0.6669,  0.6693,  0.7663,  0.5379,  0.4939,
         0.3771], device='cuda:0')
tensor(0.5407, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5384,  0.3522,  0.4606,  0.2306,  0.1030,  0.7473,  0.1389,
         0.7037,  0.2062,  0.6140,  0.2647,  0.5858,  0.6273,  0.8115,
         0.2541,  0.2558,  0.4276,  0.5021,  0.6194,  0.6863,  0.7855,
         0.7815,  0.7061,  0.7394,  0.1505,  0.5337,  0.2083,  0.3486,
         0.6495,  0.5512,  0.4870,  0.4364,  0.2333,  0.4088,  0.3662,
         0.6833,  0.5567,  0.6085,  0.8833,  0.5647,  0.4933,  0.6024,
         0.2867,  0.1402,  0.4427,  0.2583,  0.2858,  0.5788,  0.7274,
         0.3650,  0.7930,  0.3678,  0.2475,  0.3220,  0.9380,  0.6856,
         0.3366,  0.2263,  0.5472,  0.2950,  0.7940,  0.4651,  0.5496,
         0.4466,  0.6504,  0.2277,  0.2571,  0.3370,  0.5505,  0.1894,
         0.6689,  0.1824,  0.3666,  0.2484,  0.5563,  0.3043,  0.1643,
         0.4684,  0.3698,  0.3979,  0.1242,  0.8176,  0.6089,  0.2870,
         0.4647,  0.4740,  0.2843,  0.3086,  0.4338,  0.2647,  0.1622,
         0.7202,  0.3272,  0.2772,  0.3041,  0.1206,  0.4894,  0.2116,
         0.5842,  0.2680,  0.5000,  0.4617,  0.4105,  0.7668,  0.7877,
         0.1556,  0.2273,  0.5065,  0.4631,  0.5144,  0.6583,  0.9298,
         0.9111,  0.4342,  0.3390,  0.4079,  0.7554,  0.4250,  0.2972,
         0.6793,  0.3806,  0.4277,  0.4664,  0.7059,  0.1351,  0.3967,
         0.3129,  0.7666,  0.6100,  0.5055,  0.5907,  0.4297,  0.3536,
         0.3522,  0.5989,  0.7082,  0.7348,  0.4878,  0.2984,  0.2964,
         0.4464,  0.4264,  0.1001,  0.3990,  0.2656,  0.8598,  0.5795,
         0.1595,  0.8302,  0.3291,  0.8068,  0.3446,  0.4013,  0.4309,
         0.7474,  0.9326,  0.7685,  0.2014,  0.8490,  0.3253,  0.6542,
         0.3303,  0.3212,  0.3868,  0.5702,  0.2643,  0.3596,  0.3911,
         0.5824,  0.8339,  0.3098,  0.6376,  0.5549,  0.3934,  0.5951,
         0.3262,  0.4186,  0.2730,  0.6763,  0.1625,  0.4413,  0.5821,
         0.7285,  0.5085,  0.7053,  0.2839,  0.8086,  0.7869,  0.4585,
         0.4108,  0.1984,  0.8544,  0.7921,  0.2619,  0.9238,  0.4277,
         0.3052,  0.6890,  0.2725,  0.6604,  0.7792,  0.6013,  0.5083,
         0.3238,  0.1276,  0.4967,  0.3792,  0.1881,  0.8530,  0.5141,
         0.1395,  0.4727,  0.1804,  0.1854,  0.4272,  0.5745,  0.5882,
         0.4510,  0.4844,  0.3456,  0.3706,  0.5886,  0.6468,  0.2383,
         0.4348,  0.1663,  0.9684,  0.7132,  0.3645,  0.7281,  0.8396,
         0.3893,  0.5776,  0.6980,  0.7311,  0.5490,  0.7688,  0.3781,
         0.6780,  0.7074,  0.0754,  0.5012,  0.4684,  0.8399,  0.4496,
         0.5152,  0.2778,  0.8721,  0.4069,  0.6808,  0.1571,  0.8699,
         0.3629,  0.2778,  0.6743,  0.7578,  0.7959,  0.2834,  0.4045,
         0.4910,  0.7271,  0.9129,  0.2191,  0.4965,  0.2643,  0.3496,
         0.9009,  0.3782,  0.2255,  0.5628,  0.7153,  0.6040,  0.8264,
         0.7614,  0.4253,  0.4377,  0.2708,  0.6557,  0.7352,  0.6385,
         0.8553,  0.2975,  0.5765,  0.8950,  0.7471,  0.3883,  0.5656,
         0.6250,  0.6814,  0.2759,  0.6768,  0.4667,  0.3408,  0.1843,
         0.2414,  0.4492,  0.5096,  0.6433,  0.3516,  0.7296,  0.2110,
         0.7279,  0.6904,  0.4723,  0.4056,  0.2395,  0.6125,  0.7730,
         0.5105,  0.6538,  0.4555,  0.2285,  0.4020,  0.7085,  0.2567,
         0.4266,  0.4339,  0.8616,  0.3920,  0.3274,  0.4199,  0.2440,
         0.1684,  0.5345,  0.5560,  0.4043,  0.6833,  0.8543,  0.7936,
         0.7750,  0.7081,  0.7415,  0.3132,  0.7125,  0.5362,  0.4340,
         0.4487,  0.5675,  0.2698,  0.8928,  0.2893,  0.3499,  0.3154,
         0.3501,  0.8217,  0.2438,  0.5338,  0.4988,  0.5399,  0.4978,
         0.6338,  0.4549,  0.6181,  0.1811,  0.1746,  0.2451,  0.6055,
         0.4670,  0.5763,  0.3523,  0.3147,  0.7336,  0.5598,  0.4431,
         0.3995,  0.3798,  0.3929,  0.5921,  0.5946,  0.8148,  0.2790,
         0.4081,  0.3106,  0.4639,  0.9405,  0.4144,  0.7782,  0.6882,
         0.8284,  0.5827,  0.1495,  0.4075,  0.5911,  0.1471,  0.4697,
         0.8427,  0.7439,  0.7760,  0.7758,  0.2882,  0.2613,  0.1467,
         0.3919,  0.3805,  0.4542,  0.7213,  0.7955,  0.7151,  0.2472,
         0.5403,  0.8300,  0.6273,  0.8327,  0.5750,  0.3484,  0.5591,
         0.2902,  0.2369,  0.8097,  0.7530,  0.8066,  0.8313,  0.4106,
         0.2158,  0.8751,  0.4600,  0.6395,  0.5164,  0.8376,  0.6288,
         0.1497,  0.7388,  0.4526,  0.4764,  0.9153,  0.2001,  0.3766,
         0.3062,  0.1085,  0.3548,  0.3639,  0.3353,  0.8574,  0.2970,
         0.3077,  0.6542,  0.4229,  0.2875,  0.6527,  0.7263,  0.2012,
         0.1857,  0.8389,  0.5103,  0.5904,  0.6615,  0.6875,  0.6935,
         0.3699,  0.7790,  0.6782,  0.3079,  0.5747,  0.6502,  0.0962,
         0.1908,  0.4328,  0.7516,  0.3026,  0.6475,  0.6050,  0.1061,
         0.6889,  0.2599,  0.7246,  0.3477,  0.2444,  0.5087,  0.5333,
         0.6081,  0.2833,  0.2969,  0.5549,  0.5253,  0.3353,  0.3371,
         0.3711,  0.7062,  0.4921,  0.6009,  0.3363,  0.5350,  0.5942,
         0.9661,  0.5353,  0.8923,  0.6897,  0.2700,  0.2183,  0.5226,
         0.5032,  0.7518,  0.6342,  0.7701,  0.3764,  0.7190,  0.1624,
         0.2280,  0.3099,  0.7002,  0.2756,  0.1341,  0.6070,  0.5009,
         0.4442,  0.7461,  0.3134,  0.3717,  0.3901,  0.3135,  0.1787,
         0.6059], device='cuda:0')
tensor(0.5366, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3740,  0.3469,  0.4765,  0.9447,  0.2432,  0.1647,  0.2976,
         0.4593,  0.9199,  0.3406,  0.6810,  0.4253,  0.1388,  0.7135,
         0.6024,  0.5851,  0.5635,  0.9820,  0.3099,  0.2949,  0.7316,
         0.4025,  0.2363,  0.6942,  0.5657,  0.1651,  0.3473,  0.2874,
         0.3265,  0.4434,  0.2954,  0.5464,  0.3429,  0.5270,  0.3557,
         0.8772,  0.5244,  0.4328,  0.5561,  0.1399,  0.6576,  0.5807,
         0.4070,  0.5723,  0.1637,  0.5929,  0.8514,  0.3263,  0.7982,
         0.4260,  0.4952,  0.5822,  0.3283,  0.2969,  0.1854,  0.4457,
         0.8541,  0.2923,  0.6914,  0.1685,  0.2486,  0.7277,  0.5862,
         0.5804,  0.6725,  0.5271,  0.7092,  0.2997,  0.3559,  0.3095,
         0.4318,  0.8048,  0.3965,  0.3419,  0.3960,  0.3983,  0.5730,
         0.2165,  0.6404,  0.5215,  0.4857,  0.4442,  0.3769,  0.3203,
         0.1853,  0.3843,  0.6338,  0.3799,  0.3871,  0.1962,  0.8067,
         0.4191,  0.7606,  0.2191,  0.3157,  0.5931,  0.2901,  0.7027,
         0.3206,  0.8666,  0.4345,  0.5372,  0.6195,  0.2558,  0.3276,
         0.1276,  0.1674,  0.7690,  0.1183,  0.2312,  0.6491,  0.3174,
         0.3952,  0.1524,  0.8005,  0.6525,  0.7294,  0.4003,  0.5304,
         0.8032,  0.4115,  0.5707,  0.6009,  0.2752,  0.7165,  0.4303,
         0.3154,  0.2146,  0.7878,  0.7011,  0.7465,  0.3345,  0.4399,
         0.2008,  0.2884,  0.5122,  0.7647,  0.3103,  0.8791,  0.2569,
         0.2676,  0.2408,  0.7391,  0.7666,  0.8680,  0.4192,  0.7174,
         0.6910,  0.5009,  0.2153,  0.8685,  0.7184,  0.3686,  0.4693,
         0.7432,  0.2364,  0.2248,  0.3791,  0.6586,  0.1297,  0.6250,
         0.4137,  0.2590,  0.4157,  0.3963,  0.5321,  0.3414,  0.7611,
         0.6599,  0.8472,  0.5356,  0.8403,  0.4578,  0.2543,  0.7851,
         0.7613,  0.8889,  0.6720,  0.5363,  0.2611,  0.6645,  0.3945,
         0.6234,  0.4060,  0.3240,  0.7462,  0.3797,  0.1836,  0.7180,
         0.1639,  0.8753,  0.4879,  0.4158,  0.8730,  0.1577,  0.4470,
         0.7824,  0.7861,  0.4064,  0.7276,  0.4658,  0.5287,  0.1781,
         0.2563,  0.3319,  0.4224,  0.4725,  0.8089,  0.4431,  0.3091,
         0.6994,  0.2678,  0.5528,  0.4234,  0.3899,  0.1696,  0.5707,
         0.4474,  0.4215,  0.4640,  0.8162,  0.1444,  0.1858,  0.5355,
         0.2762,  0.5691,  0.8024,  0.9707,  0.4462,  0.4088,  0.7789,
         0.2962,  0.5184,  0.1131,  0.5131,  0.5918,  0.2798,  0.4349,
         0.1827,  0.3142,  0.5329,  0.4412,  0.6986,  0.3714,  0.6258,
         0.6085,  0.6812,  0.4500,  0.5310,  0.7584,  0.6756,  0.2165,
         0.2477,  0.6272,  0.1879,  0.4786,  0.2433,  0.6459,  0.1381,
         0.5745,  0.3164,  0.7611,  0.4374,  0.6185,  0.5330,  0.2596,
         0.2120,  0.3244,  0.2173,  0.5847,  0.7691,  0.3799,  0.2612,
         0.6828,  0.5190,  0.5861,  0.6674,  0.2933,  0.7041,  0.0619,
         0.7909,  0.7456,  0.4888,  0.5599,  0.5807,  0.3215,  0.1722,
         0.6321,  0.1970,  0.3271,  0.8832,  0.7266,  0.4664,  0.4117,
         0.2725,  0.7061,  0.3043,  0.3540,  0.3477,  0.8281,  0.8818,
         0.8076,  0.5616,  0.5777,  0.4642,  0.1319,  0.3445,  0.3737,
         0.6313,  0.4566,  0.4706,  0.7372,  0.3196,  0.5832,  0.5889,
         0.6673,  0.3466,  0.1532,  0.9587,  0.3466,  0.6494,  0.3664,
         0.8244,  0.2351,  0.7111,  0.4164,  0.0971,  0.1756,  0.2924,
         0.2402,  0.7166,  0.6287,  0.6308,  0.7008,  0.7605,  0.6076,
         0.4125,  0.4166,  0.5049,  0.5904,  0.6904,  0.6276,  0.3874,
         0.5964,  0.4530,  0.3415,  0.3920,  0.5936,  0.5536,  0.4495,
         0.3043,  0.5568,  0.6388,  0.6516,  0.5615,  0.7690,  0.9078,
         0.5050,  0.3148,  0.5524,  0.4801,  0.1406,  0.2782,  0.7592,
         0.2561,  0.9017,  0.6663,  0.6070,  0.2072,  0.5936,  0.3233,
         0.5022,  0.6314,  0.3541,  0.4496,  0.7486,  0.3226,  0.4584,
         0.3442,  0.0772,  0.1769,  0.4886,  0.3486,  0.6507,  0.8183,
         0.7880,  0.9203,  0.1828,  0.5562,  0.5045,  0.1817,  0.2498,
         0.5731,  0.4107,  0.3455,  0.6089,  0.7634,  0.7179,  0.7458,
         0.3776,  0.4794,  0.1657,  0.8248,  0.3351,  0.9072,  0.3955,
         0.6073,  0.6753,  0.7136,  0.4935,  0.5065,  0.5705,  0.3605,
         0.5716,  0.5702,  0.4033,  0.3221,  0.5395,  0.2487,  0.4402,
         0.7209,  0.2200,  0.2009,  0.6830,  0.5733,  0.1621,  0.3964,
         0.4978,  0.9216,  0.3005,  0.3899,  0.3587,  0.5508,  0.4725,
         0.3172,  0.6087,  0.5402,  0.3154,  0.6398,  0.1373,  0.8300,
         0.7358,  0.3749,  0.5685,  0.6498,  0.4284,  0.5221,  0.6154,
         0.7295,  0.7691,  0.8270,  0.1766,  0.3735,  0.2272,  0.6564,
         0.8663,  0.3219,  0.6356,  0.5099,  0.5325,  0.8350,  0.5389,
         0.2147,  0.4928,  0.6337,  0.6397,  0.9771,  0.6711,  0.6980,
         0.2591,  0.7945,  0.3305,  0.4838,  0.2803,  0.3708,  0.3864,
         0.8647,  0.2817,  0.2394,  0.3994,  0.2469,  0.3064,  0.6296,
         0.2758,  0.3020,  0.1680,  0.8922,  0.0714,  0.2352,  0.5322,
         0.7722,  0.2824,  0.6515,  0.8918,  0.5121,  0.3181,  0.6252,
         0.5914,  0.8165,  0.3010,  0.4164,  0.2424,  0.6575,  0.3088,
         0.3682,  0.7700,  0.5348,  0.8256,  0.4675,  0.8560,  0.6632,
         0.7101], device='cuda:0')
tensor(0.5367, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5783,  0.5283,  0.5591,  0.5723,  0.2299,  0.3970,  0.6929,
         0.5640,  0.8299,  0.4535,  0.2490,  0.8071,  0.1427,  0.7828,
         0.6076,  0.7366,  0.7078,  0.4460,  0.2735,  0.2607,  0.2767,
         0.3776,  0.8074,  0.2084,  0.3015,  0.4143,  0.1542,  0.6508,
         0.2246,  0.1987,  0.2846,  0.5319,  0.4664,  0.7895,  0.3658,
         0.8603,  0.9038,  0.6413,  0.8966,  0.5922,  0.5134,  0.2926,
         0.7641,  0.7194,  0.7941,  0.6064,  0.4054,  0.1921,  0.4198,
         0.3884,  0.4115,  0.6778,  0.3964,  0.7951,  0.4328,  0.4190,
         0.7866,  0.4441,  0.4660,  0.7838,  0.2117,  0.2790,  0.3087,
         0.6200,  0.1408,  0.3760,  0.8927,  0.1832,  0.2417,  0.6270,
         0.7724,  0.5651,  0.3836,  0.6058,  0.4610,  0.7210,  0.7527,
         0.5046,  0.8141,  0.4698,  0.3352,  0.5258,  0.4720,  0.3546,
         0.4165,  0.4668,  0.6569,  0.1296,  0.4405,  0.6722,  0.8120,
         0.4909,  0.7532,  0.4957,  0.7506,  0.5478,  0.3740,  0.4056,
         0.6948,  0.6135,  0.2722,  0.4218,  0.6856,  0.1871,  0.2099,
         0.2007,  0.0520,  0.2797,  0.6940,  0.2251,  0.6244,  0.6572,
         0.2063,  0.5510,  0.6363,  0.7545,  0.7681,  0.3264,  0.3883,
         0.7251,  0.2247,  0.5883,  0.5478,  0.5379,  0.5580,  0.4487,
         0.4748,  0.4952,  0.3648,  0.7155,  0.4084,  0.8718,  0.6579,
         0.4824,  0.6442,  0.4945,  0.4755,  0.6930,  0.8200,  0.2515,
         0.3195,  0.1415,  0.9070,  0.5423,  0.4199,  0.7430,  0.1686,
         0.3097,  0.5899,  0.4556,  0.3044,  0.2052,  0.6939,  0.9600,
         0.4823,  0.3938,  0.4297,  0.7329,  0.2188,  0.8547,  0.7813,
         0.6202,  0.2749,  0.3366,  0.9143,  0.1840,  0.4932,  0.3601,
         0.5763,  0.8676,  0.4036,  0.8779,  0.5868,  0.5374,  0.8629,
         0.8299,  0.4698,  0.7526,  0.5500,  0.2084,  0.7497,  0.7210,
         0.6002,  0.1200,  0.4388,  0.1849,  0.3192,  0.7706,  0.7469,
         0.5044,  0.3025,  0.5738,  0.6237,  0.3149,  0.2289,  0.2659,
         0.6573,  0.7492,  0.2812,  0.3195,  0.7781,  0.6882,  0.4177,
         0.3771,  0.2766,  0.7824,  0.2986,  0.7962,  0.3684,  0.2452,
         0.3333,  0.3078,  0.8629,  0.2240,  0.6608,  0.8223,  0.3899,
         0.6009,  0.7866,  0.2461,  0.7274,  0.1554,  0.6577,  0.7346,
         0.6441,  0.2747,  0.4408,  0.2764,  0.5102,  0.7736,  0.5238,
         0.5001,  0.4174,  0.3531,  0.3640,  0.3726,  0.2377,  0.4984,
         0.6129,  0.8933,  0.6891,  0.3805,  0.8838,  0.7098,  0.2816,
         0.7938,  0.1041,  0.3203,  0.8204,  0.4059,  0.2008,  0.3098,
         0.8411,  0.3075,  0.3602,  0.6529,  0.4370,  0.3047,  0.6702,
         0.6588,  0.5532,  0.1885,  0.8253,  0.4787,  0.8669,  0.3583,
         0.4420,  0.3460,  0.4486,  0.7739,  0.6340,  0.8218,  0.5777,
         0.1103,  0.5636,  0.2585,  0.4258,  0.1433,  0.3203,  0.4875,
         0.7448,  0.7765,  0.6749,  0.3729,  0.7347,  0.4064,  0.7478,
         0.4036,  0.5571,  0.1123,  0.5997,  0.3792,  0.3649,  0.3710,
         0.6685,  0.7566,  0.7425,  0.3707,  0.9578,  0.3578,  0.5960,
         0.5180,  0.5385,  0.6583,  0.1764,  0.4747,  0.6850,  0.8305,
         0.5462,  0.7779,  0.6594,  0.8540,  0.4755,  0.3392,  0.2875,
         0.6007,  0.7041,  0.3632,  0.1171,  0.7825,  0.7956,  0.1545,
         0.2317,  0.5209,  0.5093,  0.5569,  0.6144,  0.8279,  0.1066,
         0.3224,  0.5453,  0.5118,  0.3432,  0.5872,  0.2537,  0.5214,
         0.4982,  0.1368,  0.2193,  0.4899,  0.3121,  0.7557,  0.3356,
         0.4202,  0.2825,  0.4849,  0.5276,  0.7458,  0.6375,  0.5148,
         0.3479,  0.7548,  0.8266,  0.7872,  0.1455,  0.6137,  0.7092,
         0.5299,  0.7882,  0.4020,  0.2615,  0.8498,  0.4302,  0.6485,
         0.6969,  0.5487,  0.3136,  0.3748,  0.7606,  0.3413,  0.3588,
         0.2546,  0.2689,  0.5614,  0.8091,  0.2840,  0.1033,  0.8491,
         0.2221,  0.2347,  0.3788,  0.7664,  0.7553,  0.6624,  0.2410,
         0.5248,  0.5137,  0.2640,  0.5741,  0.4447,  0.6253,  0.7317,
         0.4646,  0.0950,  0.7474,  0.9766,  0.3682,  0.5133,  0.6268,
         0.8142,  0.3624,  0.3676,  0.0604,  0.6127,  0.2906,  0.5680,
         0.4790,  0.1819,  0.3491,  0.6582,  0.2539,  0.7030,  0.6215,
         0.4172,  0.5751,  0.5191,  0.6645,  0.2348,  0.6294,  0.1083,
         0.4686,  0.2552,  0.1863,  0.8042,  0.3569,  0.4947,  0.2760,
         0.5321,  0.2658,  0.5721,  0.3788,  0.3113,  0.6829,  0.4077,
         0.6878,  0.6704,  0.7066,  0.7481,  0.6046,  0.3418,  0.7445,
         0.4789,  0.4572,  0.3817,  0.6952,  0.7286,  0.2668,  0.6143,
         0.3492,  0.6823,  0.6033,  0.3445,  0.1926,  0.3223,  0.5295,
         0.2074,  0.3736,  0.3588,  0.6236,  0.6564,  0.3686,  0.4971,
         0.7570,  0.7591,  0.8380,  0.6205,  0.2649,  0.6735,  0.3010,
         0.4466,  0.8609,  0.6557,  0.3878,  0.3702,  0.8813,  0.5797,
         0.3675,  0.2686,  0.4212,  0.1875,  0.4142,  0.2633,  0.7261,
         0.3691,  0.5984,  0.1821,  0.7106,  0.5839,  0.4683,  0.5630,
         0.5245,  0.6666,  0.4085,  0.7088,  0.5151,  0.5912,  0.2313,
         0.8228,  0.2966,  0.1707,  0.9174,  0.6958,  0.3614,  0.2234,
         0.2080,  0.6886,  0.5150,  0.1729,  0.3537,  0.7742,  0.2928,
         0.8410], device='cuda:0')
tensor(0.5113, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7501,  0.6461,  0.4327,  0.3920,  0.6322,  0.2772,  0.2700,
         0.7503,  0.1532,  0.1171,  0.5918,  0.2443,  0.7299,  0.3831,
         0.1969,  0.4084,  0.5849,  0.3379,  0.3576,  0.2726,  0.5491,
         0.1311,  0.4401,  0.4403,  0.7541,  0.7999,  0.6016,  0.7948,
         0.7711,  0.4603,  0.3977,  0.7701,  0.2824,  0.2954,  0.7376,
         0.6012,  0.2380,  0.6929,  0.2091,  0.2440,  0.3677,  0.3947,
         0.5821,  0.3315,  0.4380,  0.0820,  0.8359,  0.3553,  0.6037,
         0.4221,  0.1027,  0.7883,  0.3644,  0.5529,  0.2712,  0.7385,
         0.7228,  0.7745,  0.7835,  0.3650,  0.4112,  0.6767,  0.6714,
         0.6647,  0.4384,  0.7669,  0.3404,  0.6327,  0.7334,  0.5821,
         0.5400,  0.7802,  0.6118,  0.2218,  0.2565,  0.4451,  0.3711,
         0.2006,  0.7047,  0.2157,  0.6833,  0.8572,  0.3533,  0.6545,
         0.1441,  0.3766,  0.4322,  0.6495,  0.4896,  0.6875,  0.8715,
         0.4463,  0.4893,  0.2767,  0.6522,  0.1596,  0.5617,  0.0727,
         0.2584,  0.2210,  0.6586,  0.6745,  0.2123,  0.7191,  0.4258,
         0.6321,  0.7359,  0.9325,  0.4314,  0.1774,  0.4259,  0.8866,
         0.2427,  0.6842,  0.7800,  0.6153,  0.3356,  0.3561,  0.6623,
         0.7358,  0.8731,  0.3079,  0.6613,  0.2429,  0.2666,  0.1934,
         0.7467,  0.8360,  0.6660,  0.1859,  0.7630,  0.5797,  0.5802,
         0.1626,  0.7942,  0.4312,  0.6734,  0.0320,  0.3524,  0.4331,
         0.6637,  0.2686,  0.5955,  0.7248,  0.1596,  0.2910,  0.5143,
         0.8984,  0.3952,  0.6965,  0.7120,  0.1897,  0.7175,  0.6349,
         0.4815,  0.2208,  0.5866,  0.1768,  0.6835,  0.5730,  0.4764,
         0.3632,  0.6229,  0.1448,  0.7691,  0.2487,  0.7748,  0.5468,
         0.1157,  0.2431,  0.0932,  0.3388,  0.8171,  0.7012,  0.2232,
         0.2327,  0.1518,  0.7641,  0.4435,  0.3563,  0.2630,  0.2469,
         0.3004,  0.6055,  0.8047,  0.5606,  0.5026,  0.6155,  0.9459,
         0.8043,  0.5401,  0.6077,  0.2916,  0.2569,  0.1824,  0.8175,
         0.3226,  0.3450,  0.6874,  0.4110,  0.3950,  0.7186,  0.6088,
         0.7388,  0.2888,  0.2841,  0.5791,  0.8221,  0.9054,  0.2935,
         0.1158,  0.2722,  0.7210,  0.4424,  0.2773,  0.2511,  0.3604,
         0.6961,  0.8357,  0.0579,  0.8844,  0.7614,  0.7951,  0.2173,
         0.2789,  0.7515,  0.4250,  0.5183,  0.5260,  0.7637,  0.4925,
         0.8247,  0.5663,  0.5285,  0.2559,  0.5919,  0.3808,  0.8458,
         0.4765,  0.8519,  0.5911,  0.2454,  0.4013,  0.7682,  0.3635,
         0.9260,  0.3207,  0.1914,  0.2814,  0.0758,  0.3941,  0.6667,
         0.2100,  0.4968,  0.6739,  0.2795,  0.7132,  0.7240,  0.5054,
         0.7062,  0.3788,  0.7505,  0.4080,  0.6151,  0.5238,  0.7522,
         0.2621,  0.5225,  0.9554,  0.3584,  0.5759,  0.2927,  0.9220,
         0.4808,  0.8087,  0.7354,  0.8271,  0.3108,  0.4629,  0.4468,
         0.2340,  0.5301,  0.4928,  0.2592,  0.6090,  0.2414,  0.2475,
         0.5524,  0.2054,  0.5395,  0.2661,  0.6785,  0.8465,  0.5125,
         0.4430,  0.5958,  0.1654,  0.2926,  0.3128,  0.4068,  0.2614,
         0.2563,  0.7532,  0.3491,  0.1284,  0.1870,  0.3978,  0.1949,
         0.2413,  0.6829,  0.6423,  0.3144,  0.7452,  0.2266,  0.2593,
         0.8362,  0.7014,  0.5001,  0.0917,  0.3644,  0.6870,  0.7329,
         0.4913,  0.8353,  0.2108,  0.7529,  0.4236,  0.2462,  0.1600,
         0.6790,  0.3188,  0.6801,  0.8507,  0.8238,  0.5486,  0.1055,
         0.8202,  0.4355,  0.3064,  0.5635,  0.3894,  0.5951,  0.2647,
         0.2697,  0.7878,  0.3782,  0.3981,  0.3056,  0.5754,  0.3677,
         0.5558,  0.2026,  0.7427,  0.2761,  0.8367,  0.2407,  0.7162,
         0.8021,  0.6226,  0.5660,  0.1946,  0.4830,  0.5577,  0.3379,
         0.5140,  0.6921,  0.7076,  0.3306,  0.9331,  0.3429,  0.9648,
         0.2873,  0.8307,  0.2372,  0.8395,  0.2098,  0.2309,  0.5254,
         0.3709,  0.7312,  0.6897,  0.4378,  0.8552,  0.2765,  0.1356,
         0.2677,  0.4313,  0.8372,  0.7033,  0.8057,  0.4359,  0.2439,
         0.3566,  0.4565,  0.3528,  0.8448,  0.5706,  0.8860,  0.1326,
         0.6244,  0.3277,  0.7954,  0.5762,  0.8744,  0.6660,  0.4525,
         0.7343,  0.7686,  0.1427,  0.7016,  0.6724,  0.3165,  0.4166,
         0.4068,  0.9026,  0.6959,  0.4336,  0.4148,  0.8068,  0.6956,
         0.4880,  0.5992,  0.1434,  0.2292,  0.2252,  0.7913,  0.6548,
         0.8367,  0.6311,  0.5511,  0.1926,  0.1950,  0.0802,  0.5111,
         0.2743,  0.7566,  0.6971,  0.2626,  0.6903,  0.6848,  0.3083,
         0.6295,  0.7169,  0.4653,  0.3018,  0.3197,  0.6785,  0.3661,
         0.9300,  0.4443,  0.4101,  0.4388,  0.1056,  0.4598,  0.3533,
         0.2014,  0.8210,  0.3421,  0.8186,  0.8299,  0.2293,  0.7432,
         0.3822,  0.5557,  0.1186,  0.2542,  0.8198,  0.4699,  0.7554,
         0.6740,  0.3536,  0.9395,  0.6051,  0.3907,  0.2524,  0.2794,
         0.3529,  0.2201,  0.2420,  0.5102,  0.1589,  0.2220,  0.5238,
         0.4231,  0.5559,  0.2651,  0.8065,  0.7821,  0.0977,  0.1688,
         0.4427,  0.7594,  0.8561,  0.3259,  0.2002,  0.6362,  0.7612,
         0.3072,  0.6183,  0.1570,  0.8152,  0.3169,  0.3536,  0.8762,
         0.6392,  0.5880,  0.5267,  0.5972,  0.1984,  0.9068,  0.5642,
         0.2031], device='cuda:0')
tensor(0.5226, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3462,  0.4826,  0.3098,  0.8252,  0.2801,  0.8241,  0.8220,
         0.8529,  0.4656,  0.2484,  0.1803,  0.2313,  0.8259,  0.6298,
         0.2737,  0.6493,  0.1516,  0.1234,  0.7210,  0.6168,  0.2568,
         0.7100,  0.1149,  0.1793,  0.4314,  0.7181,  0.8041,  0.6278,
         0.1681,  0.4367,  0.5099,  0.3436,  0.3882,  0.2966,  0.1470,
         0.8461,  0.2107,  0.7413,  0.5764,  0.2206,  0.3454,  0.2780,
         0.7913,  0.2545,  0.7571,  0.6736,  0.2475,  0.2045,  0.3504,
         0.4125,  0.8256,  0.5990,  0.1061,  0.1784,  0.8427,  0.5509,
         0.6606,  0.8468,  0.1515,  0.7788,  0.8790,  0.2472,  0.6924,
         0.3569,  0.2316,  0.5792,  0.0513,  0.4025,  0.0942,  0.4852,
         0.4094,  0.6523,  0.9606,  0.3371,  0.6628,  0.1285,  0.7647,
         0.7301,  0.9709,  0.7782,  0.6871,  0.1670,  0.3626,  0.3859,
         0.7771,  0.4661,  0.4253,  0.8680,  0.6821,  0.2277,  0.4200,
         0.2684,  0.5277,  0.2715,  0.3873,  0.1811,  0.4254,  0.5770,
         0.7399,  0.3222,  0.5662,  0.4851,  0.5738,  0.5638,  0.4259,
         0.2721,  0.5516,  0.4004,  0.3407,  0.7015,  0.2122,  0.1694,
         0.2416,  0.1930,  0.4277,  0.8698,  0.4129,  0.7648,  0.2627,
         0.6791,  0.7802,  0.2692,  0.3114,  0.8391,  0.8023,  0.8336,
         0.2088,  0.3092,  0.2662,  0.7446,  0.3843,  0.8932,  0.8591,
         0.6507,  0.1105,  0.2848,  0.6073,  0.8674,  0.8516,  0.5214,
         0.8078,  0.7034,  0.9419,  0.7861,  0.5690,  0.6043,  0.4743,
         0.1483,  0.6621,  0.3126,  0.2781,  0.4892,  0.4520,  0.5376,
         0.6548,  0.3228,  0.2095,  0.6229,  0.5818,  0.4739,  0.7985,
         0.5045,  0.8126,  0.3634,  0.8505,  0.1420,  0.9575,  0.1978,
         0.8335,  0.3025,  0.3652,  0.1234,  0.7003,  0.8823,  0.2468,
         0.2584,  0.8821,  0.9374,  0.6164,  0.7498,  0.7852,  0.7655,
         0.9319,  0.3740,  0.3237,  0.6112,  0.6329,  0.8684,  0.3760,
         0.7496,  0.5665,  0.4490,  0.8122,  0.4356,  0.6555,  0.8391,
         0.4282,  0.4525,  0.5162,  0.1670,  0.5802,  0.1609,  0.5160,
         0.2239,  0.9602,  0.2666,  0.9107,  0.8043,  0.1885,  0.2014,
         0.7632,  0.6469,  0.8138,  0.7409,  0.8856,  0.7263,  0.7564,
         0.8541,  0.2602,  0.1912,  0.5747,  0.7638,  0.6162,  0.7799,
         0.2825,  0.7966,  0.7829,  0.1774,  0.1153,  0.7453,  0.2759,
         0.3092,  0.2773,  0.3071,  0.8228,  0.2379,  0.2116,  0.5359,
         0.6260,  0.6984,  0.4519,  0.6063,  0.8504,  0.4571,  0.7755,
         0.5820,  0.1138,  0.1948,  0.5056,  0.2981,  0.8587,  0.4814,
         0.2397,  0.2450,  0.7454,  0.2250,  0.5326,  0.8184,  0.2163,
         0.3359,  0.3832,  0.8258,  0.1555,  0.3535,  0.3054,  0.1126,
         0.1494,  0.5366,  0.3794,  0.2980,  0.8863,  0.5001,  0.9208,
         0.3021,  0.4500,  0.7676,  0.7320,  0.4492,  0.3375,  0.4922,
         0.8588,  0.8378,  0.8651,  0.6140,  0.3852,  0.3928,  0.8126,
         0.7185,  0.2385,  0.7202,  0.2284,  0.9608,  0.6310,  0.9110,
         0.6195,  0.7938,  0.8859,  0.8872,  0.1431,  0.6977,  0.7566,
         0.3526,  0.8778,  0.3134,  0.2090,  0.1963,  0.3215,  0.3383,
         0.7555,  0.2638,  0.3038,  0.2877,  0.4707,  0.7903,  0.7390,
         0.5184,  0.2792,  0.9365,  0.2526,  0.5745,  0.9374,  0.6482,
         0.5971,  0.7330,  0.2447,  0.6140,  0.4448,  0.8855,  0.5317,
         0.2080,  0.4342,  0.2428,  0.1426,  0.2912,  0.7106,  0.7190,
         0.5490,  0.3427,  0.1495,  0.7480,  0.7421,  0.4197,  0.4734,
         0.4784,  0.1758,  0.3183,  0.5772,  0.8178,  0.1665,  0.2155,
         0.7418,  0.1288,  0.6707,  0.2570,  0.8059,  0.8476,  0.2132,
         0.5884,  0.8538,  0.5107,  0.7941,  0.6234,  0.1781,  0.6647,
         0.8202,  0.8042,  0.7478,  0.3707,  0.6674,  0.1636,  0.3664,
         0.7261,  0.1738,  0.5355,  0.2230,  0.6351,  0.3616,  0.2515,
         0.2107,  0.0924,  0.2758,  0.6379,  0.3901,  0.1473,  0.5686,
         0.6259,  0.2980,  0.3063,  0.4800,  0.8057,  0.1438,  0.5978,
         0.6856,  0.7424,  0.2357,  0.5448,  0.8034,  0.2709,  0.8380,
         0.2263,  0.6638,  0.8389,  0.8121,  0.2780,  0.3790,  0.3130,
         0.8361,  0.7503,  0.8047,  0.3719,  0.7268,  0.7910,  0.8230,
         0.6422,  0.8718,  0.2586,  0.5559,  0.3446,  0.2114,  0.1651,
         0.1693,  0.4297,  0.5048,  0.7726,  0.5703,  0.7362,  0.5818,
         0.8590,  0.1848,  0.5206,  0.1071,  0.1049,  0.8575,  0.1760,
         0.2671,  0.8992,  0.6138,  0.5475,  0.3316,  0.8217,  0.8348,
         0.1923,  0.1495,  0.6522,  0.1817,  0.3980,  0.6715,  0.2805,
         0.6397,  0.1749,  0.2762,  0.4700,  0.6422,  0.1955,  0.1724,
         0.5161,  0.5282,  0.2866,  0.2491,  0.3681,  0.9343,  0.6503,
         0.5676,  0.2429,  0.3819,  0.9235,  0.6964,  0.8605,  0.4959,
         0.2926,  0.6167,  0.2819,  0.2296,  0.2287,  0.2621,  0.6060,
         0.7011,  0.7740,  0.9639,  0.2968,  0.1670,  0.8653,  0.9190,
         0.9648,  0.1930,  0.3084,  0.2894,  0.1722,  0.7637,  0.8321,
         0.6795,  0.9031,  0.2632,  0.6973,  0.2292,  0.5529,  0.4416,
         0.5457,  0.8405,  0.9132,  0.7650,  0.1626,  0.9127,  0.2251,
         0.3890,  0.4073,  0.6840,  0.8561,  0.2272,  0.8603,  0.3937,
         0.4793], device='cuda:0')
tensor(0.5021, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1737,  0.2608,  0.3653,  0.0997,  0.9006,  0.0978,  0.4240,
         0.5562,  0.7831,  0.2869,  0.7078,  0.2418,  0.5500,  0.7728,
         0.5930,  0.3056,  0.2203,  0.3259,  0.8750,  0.8804,  0.6564,
         0.2981,  0.6987,  0.6891,  0.6312,  0.2977,  0.4381,  0.4979,
         0.8092,  0.8608,  0.4559,  0.1394,  0.7925,  0.8804,  0.0637,
         0.3009,  0.7617,  0.1581,  0.8479,  0.8645,  0.1949,  0.0734,
         0.9189,  0.4182,  0.9405,  0.6397,  0.8330,  0.6339,  0.4216,
         0.9804,  0.9394,  0.7532,  0.7471,  0.1541,  0.0894,  0.8594,
         0.4721,  0.9267,  0.2420,  0.8355,  0.3723,  0.8875,  0.1079,
         0.2347,  0.1990,  0.3292,  0.3228,  0.3443,  0.4631,  0.1007,
         0.3251,  0.5621,  0.1663,  0.1154,  0.1582,  0.6371,  0.2221,
         0.9052,  0.8111,  0.2472,  0.8381,  0.8080,  0.1810,  0.1703,
         0.3160,  0.1107,  0.8402,  0.1284,  0.7961,  0.4585,  0.3480,
         0.5006,  0.7570,  0.7766,  0.5608,  0.7007,  0.7833,  0.8484,
         0.8527,  0.2887,  0.1343,  0.4291,  0.4339,  0.8185,  0.8156,
         0.4729,  0.2841,  0.4073,  0.7288,  0.1266,  0.9583,  0.6788,
         0.3091,  0.7686,  0.4367,  0.2691,  0.4299,  0.8492,  0.5653,
         0.2043,  0.8301,  0.8214,  0.2329,  0.4252,  0.3829,  0.8436,
         0.2238,  0.1530,  0.6042,  0.7903,  0.6688,  0.8176,  0.7544,
         0.4397,  0.3109,  0.6899,  0.9872,  0.8699,  0.6386,  0.3496,
         0.8445,  0.7701,  0.1944,  0.7637,  0.8927,  0.3370,  0.4041,
         0.5715,  0.7901,  0.7857,  0.2794,  0.7357,  0.2504,  0.4276,
         0.8716,  0.8194,  0.9145,  0.2883,  0.8570,  0.0667,  0.7830,
         0.2911,  0.9259,  0.2377,  0.5462,  0.2585,  0.0611,  0.1418,
         0.6694,  0.2416,  0.7375,  0.4267,  0.2371,  0.4117,  0.3784,
         0.4865,  0.5878,  0.8302,  0.9075,  0.7719,  0.0875,  0.8214,
         0.8539,  0.0971,  0.9161,  0.1755,  0.6333,  0.1152,  0.8895,
         0.3297,  0.1964,  0.7860,  0.7769,  0.7063,  0.4340,  0.2292,
         0.8196,  0.7952,  0.8176,  0.7778,  0.7923,  0.9125,  0.2305,
         0.4399,  0.8185,  0.8973,  0.3215,  0.7794,  0.5731,  0.8158,
         0.1688,  0.8766,  0.5263,  0.8441,  0.7084,  0.6977,  0.7791,
         0.3446,  0.7746,  0.8483,  0.2686,  0.3756,  0.3581,  0.7017,
         0.8091,  0.5672,  0.8766,  0.8533,  0.2560,  0.2105,  0.1298,
         0.2662,  0.8971,  0.1671,  0.8496,  0.3178,  0.8244,  0.1811,
         0.1686,  0.6330,  0.8124,  0.9098,  0.7269,  0.2035,  0.2516,
         0.1477,  0.2526,  0.1228,  0.2261,  0.2415,  0.8002,  0.4331,
         0.1081,  0.3949,  0.8954,  0.5846,  0.0595,  0.6700,  0.3874,
         0.2380,  0.7618,  0.7909,  0.8843,  0.2361,  0.8322,  0.3975,
         0.3229,  0.8832,  0.9138,  0.8818,  0.5980,  0.4669,  0.7362,
         0.3861,  0.2341,  0.4998,  0.5491,  0.2410,  0.6379,  0.7249,
         0.1403,  0.2072,  0.1692,  0.9622,  0.8301,  0.8773,  0.8561,
         0.7283,  0.7792,  0.1533,  0.1397,  0.2692,  0.8712,  0.7320,
         0.6235,  0.5950,  0.7726,  0.6643,  0.7398,  0.7568,  0.2439,
         0.2175,  0.1928,  0.6263,  0.1083,  0.2619,  0.2314,  0.7636,
         0.4512,  0.8118,  0.6117,  0.1892,  0.9497,  0.2891,  0.4304,
         0.3000,  0.6159,  0.2543,  0.3300,  0.8006,  0.2289,  0.8263,
         0.5469,  0.7138,  0.6931,  0.7636,  0.2534,  0.6734,  0.1864,
         0.7521,  0.1865,  0.8234,  0.7560,  0.2455,  0.1670,  0.7397,
         0.8710,  0.6164,  0.9838,  0.8468,  0.3108,  0.2458,  0.9235,
         0.3430,  0.7487,  0.8512,  0.8187,  0.3376,  0.1296,  0.4753,
         0.7821,  0.6198,  0.2099,  0.3123,  0.1060,  0.1493,  0.5311,
         0.0865,  0.3647,  0.9115,  0.5369,  0.4228,  0.9024,  0.7330,
         0.0817,  0.7614,  0.8053,  0.2720,  0.8056,  0.5015,  0.3146,
         0.1971,  0.4264,  0.1783,  0.5651,  0.1981,  0.8670,  0.7553,
         0.6666,  0.8803,  0.3733,  0.2885,  0.2422,  0.2258,  0.1512,
         0.0969,  0.7536,  0.4988,  0.3441,  0.9290,  0.9055,  0.1649,
         0.2314,  0.7483,  0.7076,  0.2366,  0.2797,  0.6907,  0.7895,
         0.2669,  0.7851,  0.1279,  0.4033,  0.7026,  0.7396,  0.1279,
         0.8163,  0.3024,  0.8147,  0.7282,  0.1156,  0.3339,  0.3789,
         0.7356,  0.8422,  0.8457,  0.7340,  0.8805,  0.6817,  0.9173,
         0.1896,  0.7295,  0.3407,  0.8652,  0.5590,  0.4375,  0.9206,
         0.4714,  0.2855,  0.4774,  0.8713,  0.0567,  0.7551,  0.6756,
         0.7699,  0.9520,  0.8514,  0.8725,  0.3558,  0.7187,  0.9132,
         0.7396,  0.2976,  0.6826,  0.2523,  0.1935,  0.1750,  0.3078,
         0.2988,  0.8229,  0.7521,  0.3795,  0.1828,  0.9041,  0.3794,
         0.7542,  0.5478,  0.2809,  0.2299,  0.8240,  0.3909,  0.9427,
         0.3525,  0.8725,  0.8479,  0.4464,  0.2814,  0.4668,  0.7683,
         0.5073,  0.5221,  0.3767,  0.9367,  0.7834,  0.9365,  0.3748,
         0.7224,  0.3044,  0.9810,  0.8899,  0.2009,  0.4682,  0.3455,
         0.2738,  0.3196,  0.9731,  0.9164,  0.1386,  0.5947,  0.8494,
         0.2688,  0.5306,  0.2600,  0.3324,  0.4074,  0.7353,  0.3825,
         0.7880,  0.5588,  0.2116,  0.4283,  0.4258,  0.2187,  0.2299,
         0.1320,  0.9154,  0.7752,  0.8483,  0.8189,  0.7348,  0.4767,
         0.7790], device='cuda:0')
tensor(0.5320, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8045,  0.9105,  0.1521,  0.6990,  0.8913,  0.8365,  0.8581,
         0.0448,  0.4612,  0.3528,  0.8810,  0.5731,  0.8785,  0.2871,
         0.8495,  0.2917,  0.9293,  0.5649,  0.2701,  0.1952,  0.8184,
         0.9583,  0.1944,  0.2964,  0.2538,  0.2473,  0.5012,  0.9636,
         0.8998,  0.7696,  0.7484,  0.1057,  0.5920,  0.8606,  0.2061,
         0.4985,  0.2429,  0.3768,  0.4181,  0.7590,  0.9226,  0.1718,
         0.2249,  0.2652,  0.8227,  0.1059,  0.8793,  0.2355,  0.7244,
         0.4318,  0.0757,  0.1695,  0.7985,  0.8708,  0.8596,  0.8664,
         0.3095,  0.1532,  0.2823,  0.1069,  0.7466,  0.7212,  0.7900,
         0.2008,  0.2674,  0.9097,  0.8162,  0.3600,  0.1234,  0.1657,
         0.3177,  0.2939,  0.1455,  0.8043,  0.7269,  0.8202,  0.6848,
         0.3279,  0.7961,  0.1878,  0.8616,  0.6327,  0.6995,  0.3386,
         0.2107,  0.1733,  0.9393,  0.7884,  0.1525,  0.4981,  0.4864,
         0.9801,  0.2107,  0.8242,  0.3059,  0.2114,  0.9079,  0.0424,
         0.9325,  0.7869,  0.1745,  0.8101,  0.1648,  0.2237,  0.8527,
         0.9195,  0.1348,  0.6585,  0.8740,  0.4137,  0.8845,  0.2727,
         0.9700,  0.9003,  0.1100,  0.1034,  0.8950,  0.5586,  0.2004,
         0.2296,  0.1650,  0.9758,  0.2365,  0.8912,  0.8614,  0.6927,
         0.3778,  0.3638,  0.9147,  0.1285,  0.8347,  0.8118,  0.9107,
         0.8626,  0.1574,  0.4083,  0.2680,  0.3062,  0.7554,  0.8766,
         0.8329,  0.2403,  0.7958,  0.4026,  0.7820,  0.6650,  0.4324,
         0.9748,  0.1757,  0.1152,  0.1604,  0.3795,  0.8583,  0.2657,
         0.1396,  0.1617,  0.8767,  0.9575,  0.5409,  0.8979,  0.8404,
         0.9375,  0.4695,  0.5585,  0.8982,  0.2412,  0.5030,  0.3627,
         0.7008,  0.7628,  0.9399,  0.8627,  0.0828,  0.9834,  0.1367,
         0.1514,  0.6737,  0.9057,  0.6375,  0.3025,  0.8284,  0.2457,
         0.9795,  0.6187,  0.1778,  0.8387,  0.6167,  0.9540,  0.3198,
         0.9108,  0.8169,  0.7459,  0.3760,  0.9545,  0.7465,  0.8871,
         0.6046,  0.2631,  0.5693,  0.1382,  0.1368,  0.2457,  0.1077,
         0.4490,  0.8860,  0.5303,  0.2012,  0.7951,  0.8697,  0.9369,
         0.2532,  0.4300,  0.8782,  0.2452,  0.8502,  0.3523,  0.1335,
         0.6574,  0.9278,  0.9065,  0.7551,  0.2394,  0.1697,  0.2289,
         0.0849,  0.8625,  0.8859,  0.2143,  0.1987,  0.7470,  0.9411,
         0.9047,  0.8496,  0.8837,  0.3643,  0.3508,  0.7443,  0.9808,
         0.3844,  0.8887,  0.1048,  0.0969,  0.8394,  0.8398,  0.3273,
         0.7802,  0.2928,  0.8439,  0.5571,  0.1681,  0.2150,  0.9767,
         0.5537,  0.9890,  0.9526,  0.8459,  0.2076,  0.7081,  0.4832,
         0.8415,  0.2828,  0.8228,  0.8289,  0.1927,  0.8722,  0.6450,
         0.4099,  0.3313,  0.8587,  0.9332,  0.8076,  0.9508,  0.4212,
         0.8821,  0.8191,  0.3318,  0.3698,  0.7486,  0.9028,  0.7607,
         0.7864,  0.3874,  0.2442,  0.6643,  0.7850,  0.8066,  0.7383,
         0.1411,  0.2487,  0.3483,  0.8623,  0.3403,  0.7952,  0.3869,
         0.9048,  0.8784,  0.8617,  0.3878,  0.8898,  0.8641,  0.2467,
         0.8878,  0.1198,  0.8910,  0.5477,  0.1326,  0.8119,  0.5421,
         0.7057,  0.8631,  0.1538,  0.5467,  0.8468,  0.5917,  0.4209,
         0.2888,  0.8538,  0.1653,  0.1993,  0.2203,  0.9147,  0.2992,
         0.7674,  0.2839,  0.2143,  0.9217,  0.8062,  0.7168,  0.8705,
         0.6643,  0.8654,  0.5859,  0.8042,  0.7691,  0.8419,  0.6159,
         0.8354,  0.1505,  0.7563,  0.8769,  0.8386,  0.2609,  0.9220,
         0.7185,  0.8226,  0.8630,  0.6859,  0.2261,  0.8122,  0.8858,
         0.7992,  0.8567,  0.6520,  0.2407,  0.3112,  0.3004,  0.1926,
         0.7894,  0.9087,  0.1567,  0.9500,  0.1950,  0.8532,  0.8891,
         0.9186,  0.2305,  0.8487,  0.3666,  0.0539,  0.2858,  0.8410,
         0.9099,  0.6588,  0.2957,  0.8471,  0.8422,  0.7880,  0.1039,
         0.2788,  0.9599,  0.0610,  0.7356,  0.8435,  0.8915,  0.8097,
         0.9249,  0.8628,  0.8235,  0.6946,  0.9049,  0.5284,  0.8240,
         0.8496,  0.1891,  0.8602,  0.8772,  0.3750,  0.2196,  0.7844,
         0.8861,  0.7833,  0.5612,  0.7958,  0.1775,  0.9385,  0.0735,
         0.8128,  0.9606,  0.6499,  0.6801,  0.7167,  0.8878,  0.1144,
         0.6253,  0.9166,  0.1480,  0.1844,  0.8480,  0.9915,  0.4179,
         0.3902,  0.5592,  0.9407,  0.8362,  0.2491,  0.9151,  0.9036,
         0.8993,  0.8417,  0.1634,  0.6440,  0.2396,  0.8903,  0.8166,
         0.8828,  0.8549,  0.3207,  0.7714,  0.7251,  0.8599,  0.9097,
         0.8901,  0.3442,  0.2107,  0.4787,  0.8414,  0.8367,  0.2603,
         0.4378,  0.7396,  0.9472,  0.9123,  0.9819,  0.2126,  0.7826,
         0.0696,  0.8963,  0.1398,  0.2808,  0.3259,  0.7612,  0.7476,
         0.7503,  0.3658,  0.8588,  0.1272,  0.1538,  0.9038,  0.8521,
         0.9312,  0.8651,  0.9700,  0.1349,  0.6322,  0.8390,  0.8886,
         0.3396,  0.8554,  0.9170,  0.1548,  0.8295,  0.1695,  0.9044,
         0.4759,  0.5654,  0.1943,  0.8134,  0.4341,  0.3888,  0.8244,
         0.7313,  0.1746,  0.8614,  0.2142,  0.0710,  0.1310,  0.7799,
         0.7396,  0.0545,  0.8316,  0.8494,  0.1419,  0.9339,  0.9419,
         0.8494,  0.1017,  0.5042,  0.4221,  0.8601,  0.1616,  0.8078,
         0.6945], device='cuda:0')
tensor(0.5796, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1980,  0.3065,  0.5337,  0.2726,  0.8645,  0.1615,  0.2022,
         0.0946,  0.0930,  0.6588,  0.6366,  0.3033,  0.3014,  0.4678,
         0.3228,  0.3251,  0.1359,  0.2556,  0.2571,  0.8585,  0.4977,
         0.9487,  0.7586,  0.2293,  0.1453,  0.5322,  0.2787,  0.5521,
         0.6340,  0.5453,  0.3724,  0.3635,  0.2797,  0.3112,  0.2685,
         0.6699,  0.8316,  0.6913,  0.4571,  0.3396,  0.9163,  0.4718,
         0.7861,  0.3254,  0.2102,  0.4101,  0.4096,  0.1432,  0.4796,
         0.1228,  0.2658,  0.1577,  0.1408,  0.1081,  0.1442,  0.3477,
         0.1401,  0.5469,  0.4423,  0.1964,  0.8577,  0.4640,  0.3946,
         0.9709,  0.9209,  0.2500,  0.4058,  0.3941,  0.3750,  0.8464,
         0.3318,  0.9791,  0.2123,  0.4670,  0.6961,  0.6038,  0.2796,
         0.2830,  0.3733,  0.6487,  0.6203,  0.0897,  0.1422,  0.6189,
         0.0887,  0.1531,  0.4391,  0.7544,  0.8223,  0.3215,  0.6334,
         0.1740,  0.8760,  0.7455,  0.2047,  0.9051,  0.7561,  0.9225,
         0.3270,  0.1489,  0.3446,  0.8003,  0.0960,  0.9841,  0.2039,
         0.8705,  0.7194,  0.2382,  0.0560,  0.4106,  0.1801,  0.6287,
         0.2083,  0.1291,  0.9878,  0.8276,  0.7249,  0.3502,  0.1523,
         0.1670,  0.1981,  0.1991,  0.9620,  0.7144,  0.8170,  0.4321,
         0.1556,  0.2785,  0.2205,  0.8563,  0.6050,  0.1063,  0.4475,
         0.1463,  0.2245,  0.1262,  0.2549,  0.2780,  0.3004,  0.3084,
         0.1965,  0.2066,  0.5963,  0.8145,  0.2651,  0.1478,  0.3152,
         0.7867,  0.2435,  0.3794,  0.2620,  0.8675,  0.2589,  0.2137,
         0.3443,  0.3891,  0.7652,  0.0725,  0.8509,  0.2426,  0.1926,
         0.7569,  0.2139,  0.3366,  0.7003,  0.2004,  0.3728,  0.2965,
         0.2443,  0.4783,  0.3534,  0.8365,  0.6562,  0.1351,  0.2325,
         0.7955,  0.4206,  0.0714,  0.1136,  0.1979,  0.1969,  0.3556,
         0.7539,  0.1665,  0.9384,  0.8763,  0.9505,  0.8195,  0.3294,
         0.8527,  0.9130,  0.2141,  0.1775,  0.7829,  0.7947,  0.1734,
         0.7387,  0.2196,  0.8444,  0.7712,  0.3185,  0.3169,  0.4946,
         0.9017,  0.3885,  0.9104,  0.2113,  0.2812,  0.1701,  0.7746,
         0.1128,  0.1674,  0.2684,  0.3165,  0.2699,  0.1187,  0.1275,
         0.7113,  0.8025,  0.1799,  0.1937,  0.3748,  0.9174,  0.1805,
         0.0517,  0.9246,  0.1962,  0.7943,  0.5565,  0.1425,  0.2189,
         0.1741,  0.7984,  0.1070,  0.8199,  0.9050,  0.1404,  0.7480,
         0.3476,  0.8750,  0.8062,  0.2243,  0.3005,  0.8996,  0.8874,
         0.3597,  0.1081,  0.2073,  0.4641,  0.5630,  0.9237,  0.7624,
         0.8095,  0.2900,  0.8085,  0.4605,  0.1608,  0.2673,  0.8016,
         0.8372,  0.3072,  0.2648,  0.7836,  0.8390,  0.1661,  0.2419,
         0.7839,  0.2766,  0.1319,  0.2394,  0.5455,  0.2246,  0.5263,
         0.8022,  0.3164,  0.8459,  0.5985,  0.8643,  0.8140,  0.5577,
         0.1283,  0.7676,  0.7846,  0.1497,  0.3590,  0.2996,  0.0940,
         0.1505,  0.4376,  0.2957,  0.6284,  0.8131,  0.3073,  0.3509,
         0.7684,  0.1104,  0.8704,  0.8887,  0.8924,  0.2792,  0.3193,
         0.5989,  0.2315,  0.1379,  0.9046,  0.7909,  0.1782,  0.5295,
         0.7545,  0.2500,  0.2929,  0.1536,  0.9306,  0.3411,  0.2077,
         0.8754,  0.4208,  0.9824,  0.6841,  0.0651,  0.1977,  0.2346,
         0.8328,  0.0686,  0.8479,  0.7011,  0.6979,  0.2908,  0.0689,
         0.7506,  0.8092,  0.6490,  0.2657,  0.8785,  0.2892,  0.8305,
         0.1683,  0.1234,  0.1553,  0.5426,  0.1302,  0.4003,  0.8552,
         0.1979,  0.2348,  0.2484,  0.6374,  0.5879,  0.9457,  0.3225,
         0.9336,  0.8001,  0.7916,  0.8304,  0.6120,  0.8320,  0.6867,
         0.8024,  0.0958,  0.1926,  0.8284,  0.1766,  0.8060,  0.5070,
         0.1553,  0.7631,  0.3527,  0.8642,  0.3194,  0.8897,  0.8226,
         0.8462,  0.0942,  0.8487,  0.8576,  0.7121,  0.3168,  0.1844,
         0.3279,  0.6084,  0.2366,  0.3042,  0.6386,  0.1824,  0.8869,
         0.8631,  0.2476,  0.3209,  0.3767,  0.6587,  0.9093,  0.1666,
         0.5199,  0.6934,  0.2965,  0.2117,  0.7029,  0.4585,  0.2269,
         0.8411,  0.7063,  0.6121,  0.0847,  0.1362,  0.8514,  0.1722,
         0.1673,  0.1473,  0.9044,  0.2563,  0.3809,  0.4036,  0.7694,
         0.8983,  0.3699,  0.0334,  0.7583,  0.7745,  0.2461,  0.8767,
         0.6290,  0.9109,  0.1893,  0.7792,  0.2236,  0.9182,  0.2690,
         0.1205,  0.8477,  0.8452,  0.6457,  0.8700,  0.7397,  0.6887,
         0.3068,  0.2677,  0.6962,  0.8886,  0.3919,  0.2774,  0.8999,
         0.2507,  0.9703,  0.7774,  0.8281,  0.8370,  0.1323,  0.3805,
         0.2936,  0.7440,  0.9522,  0.1536,  0.8123,  0.1089,  0.9526,
         0.1853,  0.8813,  0.2140,  0.8695,  0.7024,  0.2024,  0.2504,
         0.1792,  0.2827,  0.3697,  0.5548,  0.8237,  0.9617,  0.9173,
         0.3194,  0.5911,  0.1514,  0.3519,  0.2507,  0.9787,  0.7947,
         0.5953,  0.8488,  0.8161,  0.7423,  0.8419,  0.0635,  0.8218,
         0.8574,  0.7738,  0.7679,  0.7818,  0.0521,  0.1733,  0.4180,
         0.0926,  0.8540,  0.7289,  0.8181,  0.7573,  0.7007,  0.3513,
         0.2473,  0.1910,  0.2944,  0.7486,  0.3811,  0.8005,  0.7288,
         0.2514,  0.8940,  0.4185,  0.1479,  0.7737,  0.2502,  0.2376,
         0.1597], device='cuda:0')
tensor(0.5368, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6274,  0.3021,  0.8739,  0.7854,  0.9159,  0.8722,  0.6979,
         0.5372,  0.2272,  0.2445,  0.2627,  0.3022,  0.4731,  0.8465,
         0.9368,  0.1825,  0.8611,  0.0811,  0.2545,  0.8436,  0.7126,
         0.2225,  0.2657,  0.7331,  0.3988,  0.2750,  0.1261,  0.7493,
         0.8845,  0.3674,  0.3132,  0.9324,  0.6736,  0.8286,  0.1407,
         0.2034,  0.5133,  0.2592,  0.2961,  0.9283,  0.8107,  0.2876,
         0.9815,  0.1977,  0.2393,  0.4364,  0.6513,  0.2690,  0.3076,
         0.2067,  0.3127,  0.2307,  0.0622,  0.8123,  0.1934,  0.3346,
         0.6280,  0.8165,  0.1404,  0.3136,  0.4137,  0.1967,  0.7306,
         0.1836,  0.3281,  0.3167,  0.2099,  0.1524,  0.4102,  0.1499,
         0.8759,  0.2502,  0.5683,  0.9638,  0.6310,  0.2623,  0.9089,
         0.8129,  0.4345,  0.5288,  0.8351,  0.8407,  0.8826,  0.0978,
         0.9669,  0.5415,  0.5471,  0.0776,  0.5720,  0.3677,  0.8450,
         0.7666,  0.5801,  0.4091,  0.9253,  0.6781,  0.2770,  0.7291,
         0.0582,  0.8146,  0.8485,  0.9563,  0.3267,  0.8190,  0.3167,
         0.4110,  0.8637,  0.8960,  0.8203,  0.5913,  0.1660,  0.7301,
         0.3064,  0.1960,  0.8109,  0.1084,  0.6840,  0.7341,  0.9196,
         0.8107,  0.8126,  0.1462,  0.7644,  0.9129,  0.5829,  0.9672,
         0.7863,  0.7357,  0.1580,  0.1421,  0.2701,  0.7096,  0.8846,
         0.7592,  0.4155,  0.8588,  0.1215,  0.3517,  0.8713,  0.2836,
         0.9198,  0.1608,  0.2437,  0.1463,  0.3292,  0.8068,  0.7878,
         0.3635,  0.1937,  0.6721,  0.6118,  0.6997,  0.9041,  0.6033,
         0.1333,  0.1604,  0.2324,  0.7747,  0.2754,  0.1770,  0.1471,
         0.8468,  0.6174,  0.4359,  0.3579,  0.7966,  0.1573,  0.9598,
         0.7951,  0.7842,  0.1414,  0.0959,  0.1089,  0.4921,  0.0437,
         0.3831,  0.5298,  0.8329,  0.3072,  0.4457,  0.7584,  0.2733,
         0.6748,  0.5372,  0.2057,  0.6336,  0.4655,  0.8775,  0.7560,
         0.8247,  0.8462,  0.8156,  0.8545,  0.6617,  0.7300,  0.1149,
         0.2589,  0.7045,  0.7625,  0.9213,  0.4059,  0.2381,  0.3636,
         0.5060,  0.4010,  0.4878,  0.6750,  0.5513,  0.7517,  0.7161,
         0.8149,  0.4977,  0.6793,  0.1433,  0.4938,  0.7635,  0.7996,
         0.7509,  0.4307,  0.8948,  0.1014,  0.1789,  0.1785,  0.1766,
         0.7569,  0.7681,  0.3406,  0.8216,  0.4555,  0.9030,  0.2752,
         0.7070,  0.3590,  0.3710,  0.6865,  0.8588,  0.8621,  0.1270,
         0.2389,  0.7141,  0.2854,  0.5198,  0.4325,  0.8333,  0.1858,
         0.2920,  0.2509,  0.5947,  0.6436,  0.9064,  0.8558,  0.2510,
         0.7348,  0.8442,  0.8511,  0.7338,  0.8779,  0.5289,  0.9235,
         0.1716,  0.3664,  0.4337,  0.8565,  0.1476,  0.8866,  0.7866,
         0.8239,  0.6729,  0.8918,  0.3473,  0.0563,  0.1623,  0.5649,
         0.3024,  0.3587,  0.8289,  0.8820,  0.6408,  0.2508,  0.1711,
         0.2825,  0.8883,  0.4249,  0.7001,  0.2761,  0.7786,  0.8571,
         0.1316,  0.7423,  0.9194,  0.5530,  0.8172,  0.1103,  0.0967,
         0.1248,  0.3278,  0.3392,  0.1258,  0.8293,  0.6784,  0.4578,
         0.5999,  0.2208,  0.1172,  0.8197,  0.8199,  0.1614,  0.4323,
         0.8685,  0.3068,  0.2557,  0.7984,  0.5521,  0.7292,  0.8940,
         0.3050,  0.2399,  0.1420,  0.8954,  0.2847,  0.1767,  0.8338,
         0.7796,  0.3858,  0.3711,  0.8916,  0.8095,  0.1636,  0.7599,
         0.3155,  0.3762,  0.6849,  0.7327,  0.7752,  0.7494,  0.1389,
         0.2286,  0.4201,  0.1901,  0.2301,  0.2475,  0.1053,  0.3203,
         0.2811,  0.1817,  0.4009,  0.1492,  0.1213,  0.9159,  0.5114,
         0.1205,  0.1198,  0.8672,  0.2373,  0.3206,  0.1681,  0.7277,
         0.1915,  0.2060,  0.7548,  0.8974,  0.7177,  0.2169,  0.6953,
         0.2059,  0.7319,  0.8369,  0.2150,  0.4146,  0.3165,  0.0839,
         0.3427,  0.4022,  0.2858,  0.6913,  0.7884,  0.5833,  0.5514,
         0.6690,  0.3776,  0.5890,  0.2718,  0.1100,  0.5498,  0.8924,
         0.2407,  0.5823,  0.8347,  0.8247,  0.4882,  0.8891,  0.2059,
         0.1601,  0.8380,  0.7985,  0.1778,  0.8278,  0.7482,  0.2793,
         0.7305,  0.3430,  0.6784,  0.9196,  0.4571,  0.2785,  0.3737,
         0.7924,  0.1841,  0.2763,  0.8430,  0.1893,  0.2313,  0.2709,
         0.7849,  0.7407,  0.7990,  0.9490,  0.7549,  0.7597,  0.3332,
         0.2575,  0.8379,  0.8262,  0.6935,  0.7017,  0.9041,  0.1674,
         0.2220,  0.7709,  0.2624,  0.8308,  0.5483,  0.3077,  0.6380,
         0.9056,  0.1319,  0.8635,  0.2507,  0.8799,  0.2917,  0.6643,
         0.1789,  0.7775,  0.4411,  0.2019,  0.5139,  0.2462,  0.8049,
         0.3957,  0.1976,  0.1105,  0.2727,  0.0844,  0.8157,  0.1089,
         0.7919,  0.6089,  0.7573,  0.3632,  0.4102,  0.2082,  0.3233,
         0.1658,  0.8343,  0.9028,  0.1580,  0.2317,  0.2123,  0.2623,
         0.6885,  0.2050,  0.2292,  0.2176,  0.9851,  0.3701,  0.2849,
         0.8465,  0.5674,  0.7966,  0.8170,  0.8310,  0.1900,  0.4762,
         0.6056,  0.1970,  0.7445,  0.7514,  0.1879,  0.7684,  0.7902,
         0.2379,  0.3898,  0.1938,  0.2667,  0.7944,  0.0832,  0.2304,
         0.6333,  0.7742,  0.8576,  0.8738,  0.2907,  0.1610,  0.0753,
         0.8652,  0.2792,  0.2027,  0.5123,  0.1519,  0.7581,  0.5594,
         0.2305], device='cuda:0')
tensor(0.4865, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2571,  0.3396,  0.1808,  0.7658,  0.8041,  0.8512,  0.5350,
         0.5248,  0.8628,  0.1451,  0.3731,  0.4453,  0.4662,  0.2267,
         0.6641,  0.3275,  0.8888,  0.8349,  0.2901,  0.8083,  0.1033,
         0.0696,  0.1984,  0.1489,  0.3148,  0.4885,  0.8684,  0.7297,
         0.7759,  0.7496,  0.6652,  0.6157,  0.0461,  0.2721,  0.7582,
         0.2208,  0.4957,  0.6481,  0.4665,  0.2226,  0.2770,  0.2554,
         0.1611,  0.7687,  0.8641,  0.1329,  0.7031,  0.6531,  0.2782,
         0.3194,  0.3311,  0.6320,  0.4635,  0.2637,  0.2974,  0.2382,
         0.3378,  0.4100,  0.7912,  0.7605,  0.5932,  0.8771,  0.2648,
         0.1686,  0.6070,  0.6860,  0.7333,  0.7051,  0.5241,  0.4283,
         0.7671,  0.7806,  0.3235,  0.2376,  0.2636,  0.3423,  0.7294,
         0.7344,  0.6917,  0.7629,  0.0437,  0.6527,  0.2060,  0.2324,
         0.7126,  0.2892,  0.6768,  0.2540,  0.2870,  0.8419,  0.3198,
         0.1837,  0.1553,  0.8820,  0.5394,  0.2261,  0.5249,  0.1968,
         0.1411,  0.2743,  0.3035,  0.4423,  0.8212,  0.5091,  0.5415,
         0.5474,  0.1229,  0.5341,  0.3750,  0.2246,  0.6525,  0.8308,
         0.2640,  0.5061,  0.5118,  0.2596,  0.4062,  0.1161,  0.6251,
         0.2734,  0.5241,  0.7631,  0.3396,  0.7909,  0.3645,  0.1620,
         0.1351,  0.3611,  0.1601,  0.1754,  0.6954,  0.3572,  0.4632,
         0.4885,  0.6933,  0.2335,  0.4579,  0.1624,  0.2600,  0.4033,
         0.4899,  0.2401,  0.4421,  0.1578,  0.2956,  0.2450,  0.4575,
         0.6554,  0.1640,  0.1967,  0.2554,  0.4836,  0.6288,  0.0795,
         0.1253,  0.7963,  0.1960,  0.1962,  0.1615,  0.8667,  0.5368,
         0.4008,  0.3203,  0.6747,  0.6114,  0.9229,  0.0768,  0.9143,
         0.6070,  0.8486,  0.3433,  0.1653,  0.8633,  0.4364,  0.7518,
         0.8011,  0.7837,  0.4314,  0.0955,  0.2598,  0.3513,  0.3648,
         0.4592,  0.2222,  0.4274,  0.5796,  0.8779,  0.7855,  0.4174,
         0.3276,  0.2101,  0.2079,  0.2823,  0.5468,  0.7888,  0.6286,
         0.1941,  0.5792,  0.7585,  0.1058,  0.2309,  0.2823,  0.2977,
         0.2860,  0.8215,  0.4423,  0.7243,  0.7564,  0.2807,  0.2117,
         0.2543,  0.9681,  0.1991,  0.2228,  0.7581,  0.4581,  0.4598,
         0.6725,  0.1287,  0.3029,  0.8554,  0.3259,  0.4531,  0.7480,
         0.3814,  0.1799,  0.2046,  0.2445,  0.6759,  0.2324,  0.1522,
         0.3092,  0.3937,  0.4678,  0.1369,  0.3279,  0.2141,  0.4496,
         0.5980,  0.2054,  0.8449,  0.2744,  0.4403,  0.3574,  0.6040,
         0.5662,  0.2892,  0.4032,  0.7084,  0.5595,  0.4149,  0.4260,
         0.2393,  0.3780,  0.1909,  0.8922,  0.8763,  0.2879,  0.1598,
         0.1684,  0.1834,  0.6225,  0.4429,  0.4118,  0.1671,  0.2346,
         0.5194,  0.3423,  0.1944,  0.2689,  0.3783,  0.4139,  0.2038,
         0.4351,  0.4275,  0.3564,  0.7429,  0.1608,  0.9255,  0.2059,
         0.5516,  0.7511,  0.6704,  0.6063,  0.2742,  0.2369,  0.5510,
         0.1458,  0.1816,  0.7077,  0.5711,  0.3222,  0.2865,  0.1216,
         0.1853,  0.4861,  0.8609,  0.3930,  0.1252,  0.5683,  0.7934,
         0.7728,  0.5624,  0.4231,  0.1602,  0.3255,  0.2383,  0.7878,
         0.3472,  0.3356,  0.7142,  0.1605,  0.2581,  0.5241,  0.1228,
         0.1829,  0.7971,  0.2287,  0.0731,  0.3066,  0.8959,  0.2269,
         0.5434,  0.4307,  0.2380,  0.2284,  0.6756,  0.1957,  0.0921,
         0.1655,  0.5905,  0.8067,  0.7806,  0.2669,  0.3582,  0.2088,
         0.1644,  0.5502,  0.4119,  0.5365,  0.9522,  0.6843,  0.4659,
         0.1263,  0.2867,  0.3794,  0.2523,  0.5201,  0.1921,  0.2822,
         0.1537,  0.4440,  0.7852,  0.7760,  0.7601,  0.3267,  0.4605,
         0.6316,  0.2446,  0.3254,  0.1017,  0.5033,  0.7528,  0.2563,
         0.9782,  0.9576,  0.1301,  0.7462,  0.1518,  0.1145,  0.4953,
         0.6918,  0.2998,  0.7284,  0.6271,  0.7908,  0.1549,  0.6522,
         0.1557,  0.1133,  0.4026,  0.3456,  0.8940,  0.2157,  0.1778,
         0.3178,  0.7932,  0.1738,  0.4816,  0.3578,  0.2963,  0.2549,
         0.7596,  0.2326,  0.1455,  0.2796,  0.7082,  0.8013,  0.5376,
         0.6082,  0.7053,  0.1856,  0.1972,  0.1110,  0.8044,  0.4025,
         0.5974,  0.2018,  0.3975,  0.1946,  0.1489,  0.4989,  0.6984,
         0.5381,  0.2208,  0.8739,  0.3767,  0.4252,  0.5581,  0.2700,
         0.4109,  0.3035,  0.2022,  0.3889,  0.2937,  0.3808,  0.4419,
         0.2756,  0.9312,  0.6393,  0.8419,  0.6178,  0.1062,  0.5341,
         0.8032,  0.5333,  0.6652,  0.1949,  0.5328,  0.3303,  0.5203,
         0.6964,  0.1139,  0.5689,  0.2927,  0.2297,  0.4574,  0.3469,
         0.2984,  0.8542,  0.2709,  0.3244,  0.2835,  0.1134,  0.2255,
         0.4607,  0.7645,  0.0826,  0.7452,  0.7185,  0.4192,  0.3482,
         0.7749,  0.1993,  0.7346,  0.2959,  0.7056,  0.8177,  0.2937,
         0.8762,  0.2733,  0.5316,  0.8097,  0.7339,  0.2726,  0.2631,
         0.7973,  0.1574,  0.2282,  0.8079,  0.1395,  0.1771,  0.5144,
         0.8412,  0.2101,  0.9720,  0.8133,  0.6282,  0.4575,  0.4972,
         0.1142,  0.9491,  0.3853,  0.1516,  0.2206,  0.7759,  0.5463,
         0.3326,  0.5554,  0.1374,  0.7797,  0.1478,  0.5165,  0.1879,
         0.7446,  0.2796,  0.1139,  0.2934,  0.5308,  0.7256,  0.2083,
         0.3287], device='cuda:0')
tensor(0.5167, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5763,  0.3626,  0.5679,  0.2077,  0.1588,  0.6004,  0.1929,
         0.2402,  0.1586,  0.4427,  0.2320,  0.4560,  0.8565,  0.8286,
         0.4002,  0.2961,  0.5537,  0.5660,  0.7496,  0.4790,  0.3886,
         0.3669,  0.1619,  0.2188,  0.5529,  0.5195,  0.7632,  0.5537,
         0.8276,  0.3801,  0.2044,  0.6092,  0.8207,  0.3055,  0.3095,
         0.6817,  0.7335,  0.4148,  0.6491,  0.3719,  0.7951,  0.1575,
         0.1236,  0.8088,  0.5634,  0.2305,  0.2090,  0.3945,  0.3849,
         0.6251,  0.7651,  0.7272,  0.2600,  0.3313,  0.3128,  0.5194,
         0.2316,  0.6832,  0.8215,  0.6936,  0.1386,  0.3126,  0.4283,
         0.2578,  0.4436,  0.2603,  0.2796,  0.5681,  0.6585,  0.2759,
         0.6837,  0.3318,  0.6110,  0.2133,  0.5429,  0.4359,  0.7224,
         0.4539,  0.0724,  0.6746,  0.2996,  0.0688,  0.8292,  0.7135,
         0.1013,  0.5266,  0.2708,  0.7529,  0.7791,  0.3953,  0.3179,
         0.5222,  0.3247,  0.8287,  0.7702,  0.4131,  0.6934,  0.6617,
         0.8944,  0.9630,  0.4239,  0.1593,  0.2353,  0.5317,  0.1075,
         0.6952,  0.7399,  0.2077,  0.9072,  0.6717,  0.2410,  0.2472,
         0.2528,  0.3945,  0.6959,  0.6517,  0.8427,  0.6146,  0.4513,
         0.4193,  0.4886,  0.3489,  0.9143,  0.6665,  0.2853,  0.7217,
         0.5809,  0.3807,  0.7212,  0.7408,  0.0376,  0.3278,  0.2140,
         0.4874,  0.8020,  0.4116,  0.7523,  0.7899,  0.6526,  0.6957,
         0.2903,  0.4911,  0.4316,  0.2916,  0.3898,  0.3156,  0.7804,
         0.2649,  0.5964,  0.3407,  0.3027,  0.7835,  0.8198,  0.2621,
         0.4675,  0.1994,  0.3431,  0.6060,  0.4045,  0.6142,  0.3951,
         0.4262,  0.1724,  0.8480,  0.5281,  0.3936,  0.4377,  0.7246,
         0.2733,  0.2463,  0.7064,  0.1578,  0.6001,  0.7477,  0.3060,
         0.2237,  0.2030,  0.3431,  0.4038,  0.1913,  0.4031,  0.1571,
         0.3793,  0.2434,  0.7563,  0.8826,  0.1397,  0.2503,  0.2850,
         0.4168,  0.1720,  0.4099,  0.4767,  0.4665,  0.6405,  0.7459,
         0.4653,  0.5248,  0.7130,  0.1516,  0.7014,  0.7916,  0.5576,
         0.8027,  0.5430,  0.5247,  0.2324,  0.1412,  0.4747,  0.2473,
         0.1027,  0.3331,  0.6055,  0.6475,  0.6701,  0.1628,  0.7233,
         0.6512,  0.8140,  0.1820,  0.6137,  0.2669,  0.2316,  0.4840,
         0.8277,  0.1652,  0.2561,  0.3375,  0.0743,  0.1705,  0.7193,
         0.8134,  0.6878,  0.5696,  0.1792,  0.2868,  0.4330,  0.1411,
         0.0764,  0.2077,  0.3495,  0.2679,  0.7161,  0.2814,  0.3654,
         0.5606,  0.4930,  0.7120,  0.5542,  0.2746,  0.4504,  0.6654,
         0.2981,  0.2687,  0.4641,  0.2623,  0.1513,  0.4207,  0.2670,
         0.3643,  0.3264,  0.6006,  0.4591,  0.3430,  0.3229,  0.5069,
         0.7629,  0.3439,  0.4582,  0.1838,  0.8704,  0.7157,  0.2293,
         0.6602,  0.4874,  0.4892,  0.6612,  0.0877,  0.7186,  0.1464,
         0.1443,  0.7873,  0.6602,  0.3005,  0.2058,  0.0754,  0.6347,
         0.6431,  0.7588,  0.0586,  0.4956,  0.5102,  0.7516,  0.6590,
         0.5494,  0.1184,  0.5895,  0.3865,  0.7218,  0.1763,  0.2533,
         0.6295,  0.1663,  0.7953,  0.8002,  0.2354,  0.3817,  0.5541,
         0.3013,  0.1930,  0.3203,  0.8175,  0.3430,  0.6087,  0.2191,
         0.7395,  0.6328,  0.5866,  0.8792,  0.3752,  0.3504,  0.1577,
         0.2803,  0.2754,  0.3295,  0.6737,  0.4287,  0.5419,  0.3657,
         0.2602,  0.4242,  0.8413,  0.1060,  0.1762,  0.4987,  0.1770,
         0.5031,  0.1801,  0.3325,  0.3140,  0.6666,  0.3186,  0.6964,
         0.7423,  0.6438,  0.3615,  0.3380,  0.8172,  0.5086,  0.2917,
         0.4539,  0.2805,  0.2303,  0.2082,  0.6226,  0.6887,  0.2502,
         0.5329,  0.6229,  0.6396,  0.8598,  0.6120,  0.6410,  0.5231,
         0.1863,  0.3981,  0.5963,  0.3680,  0.4283,  0.6733,  0.9165,
         0.2680,  0.2706,  0.1519,  0.2430,  0.3326,  0.5880,  0.6965,
         0.9533,  0.2707,  0.4518,  0.7016,  0.4845,  0.2347,  0.2322,
         0.3415,  0.4254,  0.2986,  0.6487,  0.4734,  0.5368,  0.4774,
         0.6083,  0.4249,  0.3266,  0.2017,  0.3904,  0.4701,  0.2852,
         0.6053,  0.6457,  0.3487,  0.7350,  0.2251,  0.7137,  0.7328,
         0.2594,  0.8441,  0.8826,  0.5028,  0.7695,  0.1054,  0.2230,
         0.2960,  0.5386,  0.6013,  0.2343,  0.9249,  0.6911,  0.3080,
         0.4307,  0.6653,  0.2273,  0.5582,  0.3744,  0.2528,  0.7044,
         0.5820,  0.1955,  0.2239,  0.7681,  0.3257,  0.1258,  0.7924,
         0.6341,  0.2662,  0.7108,  0.0628,  0.2309,  0.6412,  0.0404,
         0.2291,  0.2157,  0.2197,  0.5982,  0.5545,  0.6130,  0.6230,
         0.8862,  0.1282,  0.7628,  0.1755,  0.2683,  0.2883,  0.8256,
         0.7994,  0.0835,  0.6653,  0.4175,  0.8021,  0.5268,  0.7049,
         0.3105,  0.7108,  0.5246,  0.4279,  0.4168,  0.6696,  0.2746,
         0.7402,  0.4052,  0.3273,  0.4253,  0.1331,  0.7645,  0.5830,
         0.4947,  0.6957,  0.6036,  0.1652,  0.1254,  0.8367,  0.0898,
         0.6328,  0.5910,  0.8600,  0.6977,  0.3321,  0.1756,  0.3006,
         0.5233,  0.1588,  0.7918,  0.4923,  0.4224,  0.2432,  0.2134,
         0.3104,  0.5344,  0.5658,  0.7712,  0.1826,  0.2491,  0.6439,
         0.0991,  0.5472,  0.3053,  0.9585,  0.1545,  0.2762,  0.1837,
         0.1702], device='cuda:0')
tensor(0.5303, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7790,  0.5781,  0.6613,  0.6815,  0.4717,  0.8483,  0.8408,
         0.9693,  0.7405,  0.4577,  0.3036,  0.4174,  0.2799,  0.1772,
         0.7027,  0.5273,  0.3744,  0.1849,  0.6610,  0.6902,  0.2391,
         0.2072,  0.4848,  0.7017,  0.1783,  0.5397,  0.9745,  0.4653,
         0.2082,  0.2801,  0.2352,  0.1716,  0.0391,  0.7507,  0.3661,
         0.3567,  0.6180,  0.1746,  0.6257,  0.3216,  0.7124,  0.3014,
         0.5561,  0.6624,  0.8251,  0.4119,  0.6076,  0.5834,  0.5665,
         0.6311,  0.4447,  0.8704,  0.8091,  0.7161,  0.3671,  0.7363,
         0.4688,  0.5797,  0.4717,  0.7756,  0.6509,  0.2885,  0.3252,
         0.8511,  0.4628,  0.5098,  0.6838,  0.4531,  0.5803,  0.5938,
         0.6488,  0.4755,  0.3636,  0.2111,  0.3153,  0.5201,  0.6833,
         0.3076,  0.8640,  0.9033,  0.6386,  0.0895,  0.3568,  0.2571,
         0.1109,  0.1912,  0.4375,  0.7548,  0.6276,  0.2891,  0.7022,
         0.2262,  0.5623,  0.1711,  0.2753,  0.5847,  0.2137,  0.2826,
         0.6249,  0.2590,  0.3463,  0.2655,  0.5162,  0.3228,  0.4723,
         0.4017,  0.6188,  0.5611,  0.2178,  0.3923,  0.7475,  0.6078,
         0.6194,  0.2898,  0.8947,  0.3252,  0.7282,  0.2058,  0.2799,
         0.4573,  0.4016,  0.5859,  0.7747,  0.7831,  0.8071,  0.8993,
         0.2557,  0.3449,  0.0631,  0.7763,  0.2223,  0.3659,  0.9175,
         0.4294,  0.4451,  0.4867,  0.0882,  0.2985,  0.8663,  0.6994,
         0.8018,  0.3072,  0.3832,  0.0630,  0.8500,  0.1361,  0.4985,
         0.6871,  0.3530,  0.6309,  0.8278,  0.8954,  0.7063,  0.7528,
         0.1720,  0.3261,  0.4699,  0.5543,  0.8187,  0.9748,  0.1996,
         0.6796,  0.5505,  0.2204,  0.5799,  0.4357,  0.6454,  0.3505,
         0.0983,  0.2263,  0.8058,  0.4399,  0.5979,  0.5528,  0.2536,
         0.3011,  0.6083,  0.2164,  0.8347,  0.9055,  0.4725,  0.5516,
         0.5181,  0.4017,  0.6161,  0.6187,  0.6648,  0.3114,  0.2833,
         0.5438,  0.3357,  0.4613,  0.3574,  0.2186,  0.4139,  0.2545,
         0.2299,  0.5263,  0.6549,  0.5393,  0.1484,  0.3306,  0.2644,
         0.1187,  0.2159,  0.2746,  0.8539,  0.3975,  0.3648,  0.9040,
         0.6451,  0.7027,  0.2980,  0.3299,  0.2541,  0.4899,  0.7437,
         0.4962,  0.6210,  0.7426,  0.6186,  0.7854,  0.5415,  0.7642,
         0.3838,  0.4136,  0.7972,  0.8077,  0.5503,  0.3370,  0.3542,
         0.5550,  0.4162,  0.3176,  0.5396,  0.6130,  0.1827,  0.3537,
         0.5057,  0.1942,  0.7596,  0.2305,  0.4195,  0.3197,  0.2425,
         0.3120,  0.6863,  0.1468,  0.1957,  0.1442,  0.0442,  0.6657,
         0.2149,  0.4781,  0.6474,  0.5266,  0.6047,  0.5374,  0.2660,
         0.4683,  0.7559,  0.5859,  0.5250,  0.1644,  0.1601,  0.6885,
         0.0647,  0.3662,  0.5119,  0.6227,  0.4191,  0.1695,  0.3069,
         0.7341,  0.4996,  0.2827,  0.7614,  0.4244,  0.2523,  0.4659,
         0.6091,  0.9028,  0.7583,  0.1552,  0.1140,  0.6355,  0.6167,
         0.6453,  0.4866,  0.3352,  0.6602,  0.7727,  0.6858,  0.8145,
         0.5763,  0.1650,  0.3970,  0.5262,  0.1605,  0.5390,  0.6268,
         0.8210,  0.2622,  0.7410,  0.7443,  0.5700,  0.6841,  0.1515,
         0.8062,  0.1757,  0.7109,  0.4341,  0.2143,  0.2960,  0.2565,
         0.7178,  0.3751,  0.0779,  0.1574,  0.3841,  0.4095,  0.6570,
         0.2529,  0.8295,  0.2289,  0.6187,  0.8958,  0.7528,  0.2267,
         0.7106,  0.6222,  0.4229,  0.7619,  0.2269,  0.1696,  0.0692,
         0.6613,  0.6086,  0.1814,  0.4263,  0.4627,  0.5034,  0.3101,
         0.3359,  0.3784,  0.1506,  0.8267,  0.4392,  0.7490,  0.0830,
         0.9001,  0.8539,  0.3463,  0.0984,  0.2771,  0.6357,  0.0481,
         0.3483,  0.5448,  0.7723,  0.8002,  0.1399,  0.5456,  0.5621,
         0.6717,  0.5661,  0.8452,  0.4583,  0.5401,  0.4866,  0.9068,
         0.3693,  0.2251,  0.6252,  0.2952,  0.3019,  0.7575,  0.3166,
         0.3304,  0.6098,  0.6963,  0.4998,  0.7644,  0.1606,  0.8946,
         0.7453,  0.4912,  0.3778,  0.4687,  0.6880,  0.0414,  0.6529,
         0.7091,  0.5435,  0.1935,  0.2169,  0.2599,  0.6017,  0.2222,
         0.8306,  0.1902,  0.8676,  0.7499,  0.4634,  0.3836,  0.1949,
         0.4726,  0.8862,  0.1918,  0.4063,  0.4869,  0.6866,  0.6329,
         0.2751,  0.7769,  0.4943,  0.6424,  0.4611,  0.6551,  0.4585,
         0.6160,  0.1280,  0.7252,  0.2694,  0.5909,  0.7163,  0.4087,
         0.4139,  0.2037,  0.2021,  0.0583,  0.3595,  0.5971,  0.1176,
         0.3937,  0.4254,  0.1484,  0.3940,  0.5194,  0.0766,  0.5461,
         0.7843,  0.7701,  0.5699,  0.1415,  0.7325,  0.0882,  0.7340,
         0.3463,  0.7810,  0.2702,  0.3659,  0.3391,  0.5079,  0.6989,
         0.1671,  0.3494,  0.2037,  0.0791,  0.6521,  0.5710,  0.4029,
         0.4296,  0.4702,  0.9136,  0.1663,  0.4817,  0.3502,  0.6104,
         0.3535,  0.4092,  0.6837,  0.6556,  0.8459,  0.6148,  0.2124,
         0.5990,  0.3126,  0.7595,  0.8279,  0.6766,  0.8527,  0.3931,
         0.6970,  0.1945,  0.1990,  0.7419,  0.4967,  0.7924,  0.1323,
         0.2432,  0.3194,  0.6385,  0.4456,  0.7549,  0.6145,  0.6150,
         0.5704,  0.7167,  0.5557,  0.7725,  0.4731,  0.5950,  0.1108,
         0.7957,  0.2187,  0.8048,  0.7729,  0.2973,  0.1966,  0.6974,
         0.4516], device='cuda:0')
tensor(0.5401, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1980,  0.4315,  0.6984,  0.2867,  0.4602,  0.2801,  0.4619,
         0.4387,  0.8158,  0.4793,  0.1296,  0.0556,  0.1495,  0.4258,
         0.1057,  0.7147,  0.9076,  0.6190,  0.3939,  0.2507,  0.2822,
         0.6489,  0.5048,  0.2708,  0.6770,  0.2184,  0.7885,  0.2206,
         0.4201,  0.5460,  0.5839,  0.8360,  0.6257,  0.4406,  0.3474,
         0.2018,  0.4737,  0.1779,  0.3893,  0.5400,  0.5113,  0.2631,
         0.6910,  0.7089,  0.1593,  0.7655,  0.7393,  0.0932,  0.1743,
         0.7313,  0.1855,  0.7211,  0.2152,  0.6467,  0.5151,  0.5525,
         0.6223,  0.9123,  0.5881,  0.2819,  0.6863,  0.2989,  0.7632,
         0.2394,  0.5276,  0.1672,  0.4374,  0.3081,  0.2108,  0.1774,
         0.7445,  0.2333,  0.2254,  0.3228,  0.4694,  0.4587,  0.4257,
         0.1428,  0.5320,  0.1704,  0.3468,  0.6545,  0.4980,  0.0917,
         0.2696,  0.2985,  0.4007,  0.3543,  0.3438,  0.8693,  0.4266,
         0.3912,  0.5596,  0.6710,  0.3480,  0.7338,  0.2624,  0.2049,
         0.3677,  0.7730,  0.2097,  0.6095,  0.2412,  0.1886,  0.3092,
         0.4892,  0.6803,  0.4134,  0.3332,  0.7896,  0.3081,  0.3261,
         0.2527,  0.4684,  0.5245,  0.7620,  0.2995,  0.2696,  0.6712,
         0.3583,  0.5699,  0.5655,  0.6318,  0.6467,  0.3530,  0.4526,
         0.5427,  0.6974,  0.2955,  0.3458,  0.6080,  0.7384,  0.1145,
         0.8408,  0.7750,  0.4728,  0.5918,  0.2111,  0.8065,  0.8171,
         0.4138,  0.3512,  0.4351,  0.5576,  0.7909,  0.6625,  0.3308,
         0.3306,  0.5976,  0.4875,  0.7011,  0.2354,  0.1217,  0.8581,
         0.8543,  0.7534,  0.3274,  0.3521,  0.4279,  0.6526,  0.9106,
         0.2694,  0.6318,  0.5175,  0.1205,  0.5101,  0.5374,  0.5936,
         0.4477,  0.7490,  0.2530,  0.2143,  0.5300,  0.3204,  0.7112,
         0.2875,  0.3090,  0.7808,  0.7701,  0.2298,  0.7909,  0.3880,
         0.8176,  0.8670,  0.4846,  0.5168,  0.6720,  0.5431,  0.5401,
         0.6397,  0.8067,  0.4858,  0.4573,  0.1956,  0.2993,  0.3415,
         0.4047,  0.8989,  0.2418,  0.8293,  0.2383,  0.5281,  0.5837,
         0.4500,  0.8855,  0.3059,  0.1448,  0.5517,  0.2993,  0.8398,
         0.4992,  0.1890,  0.3367,  0.5140,  0.3874,  0.9553,  0.7888,
         0.4844,  0.6005,  0.6329,  0.4685,  0.2679,  0.4942,  0.2272,
         0.1755,  0.7312,  0.7080,  0.7265,  0.8610,  0.5146,  0.7892,
         0.2842,  0.5171,  0.7356,  0.3914,  0.3286,  0.6865,  0.1063,
         0.3269,  0.1058,  0.6147,  0.5251,  0.9104,  0.5324,  0.6255,
         0.2169,  0.6719,  0.5668,  0.2184,  0.3345,  0.5547,  0.2579,
         0.5183,  0.8564,  0.7484,  0.7481,  0.4823,  0.7092,  0.7122,
         0.1541,  0.1542,  0.7800,  0.2993,  0.6201,  0.4757,  0.7104,
         0.2450,  0.6206,  0.3012,  0.2381,  0.1510,  0.1238,  0.2661,
         0.7218,  0.4153,  0.7971,  0.3678,  0.2967,  0.7442,  0.3685,
         0.1227,  0.4017,  0.3140,  0.3410,  0.9089,  0.6993,  0.0847,
         0.0771,  0.3721,  0.9810,  0.1052,  0.3250,  0.5780,  0.7832,
         0.4093,  0.4756,  0.1900,  0.1916,  0.7637,  0.3536,  0.5629,
         0.1898,  0.5563,  0.4176,  0.5418,  0.8789,  0.4880,  0.2515,
         0.8183,  0.5737,  0.7766,  0.5359,  0.0806,  0.2167,  0.3010,
         0.5337,  0.4049,  0.8319,  0.6971,  0.3507,  0.4866,  0.2901,
         0.3350,  0.2205,  0.8320,  0.3356,  0.6947,  0.2134,  0.7201,
         0.4259,  0.5289,  0.2770,  0.8123,  0.3522,  0.1631,  0.3184,
         0.1796,  0.2177,  0.5334,  0.3865,  0.5426,  0.3887,  0.7204,
         0.8349,  0.1341,  0.4618,  0.6750,  0.4345,  0.2519,  0.5660,
         0.2574,  0.2474,  0.6437,  0.3346,  0.4547,  0.3945,  0.6734,
         0.5848,  0.5062,  0.5320,  0.6038,  0.1504,  0.7562,  0.6431,
         0.4394,  0.2387,  0.4905,  0.7314,  0.5619,  0.0726,  0.9314,
         0.4680,  0.4514,  0.8738,  0.3336,  0.2310,  0.6216,  0.6876,
         0.5884,  0.3785,  0.2867,  0.6597,  0.6263,  0.8180,  0.2387,
         0.5666,  0.4030,  0.7096,  0.7691,  0.3895,  0.4201,  0.3038,
         0.3355,  0.7156,  0.3340,  0.6935,  0.1879,  0.7480,  0.2128,
         0.8151,  0.6744,  0.1396,  0.7033,  0.3773,  0.2440,  0.6350,
         0.1682,  0.7373,  0.1664,  0.0704,  0.5709,  0.6343,  0.3026,
         0.4535,  0.6845,  0.5773,  0.1521,  0.0522,  0.1384,  0.3635,
         0.1951,  0.6773,  0.2092,  0.2697,  0.6400,  0.2288,  0.2024,
         0.8738,  0.6676,  0.7034,  0.3410,  0.4401,  0.6507,  0.7856,
         0.4506,  0.1835,  0.2030,  0.7734,  0.5264,  0.0812,  0.8017,
         0.1336,  0.3338,  0.3018,  0.8710,  0.6149,  0.3175,  0.8773,
         0.6202,  0.3314,  0.0759,  0.5255,  0.9374,  0.3956,  0.3713,
         0.3809,  0.0636,  0.8634,  0.2655,  0.4035,  0.6134,  0.8303,
         0.3182,  0.1254,  0.0766,  0.3123,  0.3351,  0.8204,  0.6949,
         0.7181,  0.6632,  0.3323,  0.3961,  0.3118,  0.1896,  0.4737,
         0.6302,  0.6984,  0.4919,  0.1647,  0.4001,  0.4549,  0.2400,
         0.7160,  0.6341,  0.7618,  0.5368,  0.5255,  0.6942,  0.4010,
         0.2780,  0.6813,  0.8783,  0.2663,  0.6893,  0.5208,  0.8425,
         0.4553,  0.4253,  0.3801,  0.5361,  0.7501,  0.6328,  0.6527,
         0.8530,  0.9042,  0.4112,  0.3302,  0.5546,  0.5732,  0.5646,
         0.4084], device='cuda:0')
tensor(0.5387, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1142,  0.7612,  0.1871,  0.3609,  0.7264,  0.6762,  0.1278,
         0.5368,  0.6978,  0.6145,  0.6663,  0.1918,  0.2722,  0.4451,
         0.1493,  0.4100,  0.7090,  0.6418,  0.1303,  0.6599,  0.8251,
         0.6335,  0.4144,  0.5650,  0.8789,  0.9377,  0.6784,  0.3462,
         0.7241,  0.0610,  0.3482,  0.6578,  0.6815,  0.5948,  0.5852,
         0.8442,  0.5405,  0.7040,  0.2725,  0.2337,  0.6336,  0.6857,
         0.3474,  0.3412,  0.2039,  0.1353,  0.4729,  0.1813,  0.5633,
         0.4713,  0.8096,  0.1764,  0.3755,  0.1571,  0.2536,  0.2585,
         0.3127,  0.2269,  0.8241,  0.4228,  0.7099,  0.8865,  0.8112,
         0.6778,  0.2263,  0.2194,  0.5065,  0.5703,  0.1240,  0.5340,
         0.4230,  0.1671,  0.3117,  0.6252,  0.7881,  0.6780,  0.4086,
         0.1604,  0.5419,  0.6166,  0.5874,  0.4374,  0.7618,  0.1673,
         0.2701,  0.5383,  0.6099,  0.3789,  0.4435,  0.7136,  0.3597,
         0.6413,  0.1322,  0.2978,  0.4363,  0.4452,  0.5964,  0.8317,
         0.2458,  0.4127,  0.4835,  0.2718,  0.1712,  0.5812,  0.2900,
         0.8553,  0.7675,  0.2530,  0.8774,  0.5472,  0.6951,  0.5231,
         0.6384,  0.1868,  0.6971,  0.2669,  0.5784,  0.8001,  0.8248,
         0.7352,  0.3624,  0.5295,  0.1799,  0.6288,  0.2454,  0.1807,
         0.7357,  0.6640,  0.5932,  0.3724,  0.2643,  0.9681,  0.2536,
         0.7090,  0.7317,  0.1215,  0.7803,  0.4434,  0.6669,  0.8698,
         0.1396,  0.7465,  0.6877,  0.3655,  0.6762,  0.2844,  0.3620,
         0.5621,  0.7416,  0.3601,  0.4869,  0.4804,  0.5644,  0.8301,
         0.3387,  0.5762,  0.6924,  0.0503,  0.7943,  0.4380,  0.5505,
         0.3324,  0.4901,  0.3698,  0.1383,  0.5574,  0.2015,  0.2492,
         0.2607,  0.8552,  0.4439,  0.2947,  0.2656,  0.4947,  0.5441,
         0.6035,  0.2439,  0.4935,  0.3113,  0.7593,  0.1303,  0.6023,
         0.9619,  0.8431,  0.2613,  0.6347,  0.2368,  0.8258,  0.8662,
         0.5408,  0.3507,  0.4822,  0.1675,  0.6708,  0.1841,  0.2765,
         0.7476,  0.3581,  0.3687,  0.2802,  0.6309,  0.8632,  0.6301,
         0.9318,  0.1644,  0.4124,  0.8292,  0.5041,  0.6753,  0.4588,
         0.8541,  0.7451,  0.7399,  0.5914,  0.3727,  0.7773,  0.4643,
         0.1388,  0.1583,  0.3760,  0.3382,  0.8573,  0.1370,  0.2981,
         0.4946,  0.3238,  0.8731,  0.6309,  0.5586,  0.4546,  0.2053,
         0.4455,  0.0458,  0.2966,  0.7290,  0.5775,  0.8423,  0.5333,
         0.5764,  0.2136,  0.4699,  0.0389,  0.3282,  0.2625,  0.3699,
         0.4713,  0.7677,  0.3147,  0.5086,  0.1290,  0.7503,  0.1937,
         0.6197,  0.5760,  0.2051,  0.7551,  0.2951,  0.8514,  0.7727,
         0.4020,  0.1980,  0.6221,  0.2947,  0.5051,  0.1763,  0.3656,
         0.1078,  0.2453,  0.3032,  0.7909,  0.2327,  0.2571,  0.8634,
         0.1642,  0.6727,  0.3876,  0.4703,  0.1930,  0.8883,  0.0983,
         0.1473,  0.2383,  0.6579,  0.7730,  0.1767,  0.3082,  0.5899,
         0.6452,  0.7471,  0.3215,  0.6578,  0.2040,  0.2462,  0.7236,
         0.2369,  0.2144,  0.2873,  0.1339,  0.7275,  0.9127,  0.2090,
         0.3148,  0.8264,  0.6842,  0.6478,  0.4321,  0.3778,  0.5873,
         0.3057,  0.2780,  0.0963,  0.5645,  0.7027,  0.5784,  0.7594,
         0.3631,  0.7241,  0.9098,  0.8703,  0.6410,  0.3127,  0.6782,
         0.5250,  0.4142,  0.1414,  0.4624,  0.1375,  0.2420,  0.2942,
         0.2108,  0.4436,  0.8143,  0.0733,  0.4968,  0.8143,  0.9600,
         0.5635,  0.2808,  0.2959,  0.4406,  0.9199,  0.5404,  0.2357,
         0.5471,  0.8311,  0.3105,  0.1744,  0.9622,  0.7943,  0.2407,
         0.1090,  0.2212,  0.6863,  0.5840,  0.6543,  0.2969,  0.6010,
         0.3154,  0.6914,  0.7240,  0.1669,  0.6955,  0.5724,  0.8409,
         0.1547,  0.8389,  0.8594,  0.6197,  0.7157,  0.2351,  0.2349,
         0.6057,  0.6909,  0.7050,  0.6984,  0.5633,  0.8729,  0.5966,
         0.1603,  0.6263,  0.3803,  0.2746,  0.4613,  0.5996,  0.2260,
         0.5211,  0.5088,  0.6725,  0.6194,  0.1814,  0.6521,  0.5154,
         0.5426,  0.4377,  0.8479,  0.5302,  0.8002,  0.6272,  0.8500,
         0.3293,  0.7166,  0.6318,  0.4965,  0.8297,  0.6833,  0.7631,
         0.3578,  0.7155,  0.1154,  0.1119,  0.2288,  0.2016,  0.2721,
         0.4122,  0.2392,  0.5898,  0.4437,  0.7022,  0.7580,  0.2276,
         0.4944,  0.6425,  0.8409,  0.5778,  0.4816,  0.6367,  0.6582,
         0.2031,  0.7739,  0.4258,  0.4866,  0.7039,  0.4080,  0.0993,
         0.5208,  0.6204,  0.7682,  0.2577,  0.1941,  0.8768,  0.2906,
         0.2868,  0.5253,  0.5452,  0.9688,  0.6410,  0.7485,  0.6226,
         0.2317,  0.3456,  0.0874,  0.2388,  0.6431,  0.7703,  0.4252,
         0.4931,  0.2228,  0.6873,  0.3087,  0.4638,  0.3918,  0.2757,
         0.8928,  0.4487,  0.4876,  0.3032,  0.3116,  0.1851,  0.4235,
         0.1790,  0.4327,  0.5822,  0.6255,  0.8236,  0.4628,  0.7031,
         0.5898,  0.4159,  0.3807,  0.4527,  0.6219,  0.4903,  0.1240,
         0.8284,  0.6334,  0.3498,  0.1032,  0.5275,  0.4918,  0.2047,
         0.2339,  0.7546,  0.6517,  0.8241,  0.3111,  0.0945,  0.2986,
         0.3275,  0.5934,  0.5448,  0.3434,  0.7559,  0.5155,  0.5145,
         0.3550,  0.2785,  0.5042,  0.2208,  0.4015,  0.7715,  0.7679,
         0.4129], device='cuda:0')
tensor(0.4926, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6806,  0.5444,  0.7289,  0.3064,  0.9085,  0.4827,  0.6052,
         0.7509,  0.9457,  0.6688,  0.4528,  0.9585,  0.8724,  0.2814,
         0.1976,  0.0536,  0.5351,  0.0993,  0.6351,  0.4608,  0.9143,
         0.2139,  0.5601,  0.5588,  0.9509,  0.7888,  0.4523,  0.1570,
         0.9591,  0.7563,  0.5805,  0.4515,  0.6828,  0.7886,  0.5563,
         0.3686,  0.5078,  0.5930,  0.7415,  0.6363,  0.8595,  0.6667,
         0.5899,  0.4960,  0.4928,  0.1850,  0.1640,  0.1485,  0.0689,
         0.1128,  0.3104,  0.8773,  0.2405,  0.6253,  0.1425,  0.5061,
         0.8622,  0.5970,  0.6499,  0.4451,  0.2443,  0.7003,  0.2218,
         0.2966,  0.7041,  0.5032,  0.2466,  0.2046,  0.2055,  0.0725,
         0.3473,  0.1900,  0.3502,  0.4240,  0.3664,  0.5390,  0.6058,
         0.7022,  0.3805,  0.5252,  0.6757,  0.3972,  0.2149,  0.7797,
         0.9265,  0.2245,  0.2145,  0.6594,  0.7198,  0.5538,  0.5905,
         0.5268,  0.7629,  0.3449,  0.8415,  0.6351,  0.1561,  0.0595,
         0.2201,  0.1822,  0.7648,  0.5336,  0.2829,  0.4864,  0.6820,
         0.4503,  0.5603,  0.8738,  0.7018,  0.5629,  0.5220,  0.8836,
         0.0401,  0.8567,  0.6470,  0.5919,  0.2958,  0.7224,  0.6927,
         0.5175,  0.2939,  0.6332,  0.6197,  0.3007,  0.8449,  0.7752,
         0.5932,  0.7780,  0.1557,  0.6092,  0.7294,  0.7508,  0.6568,
         0.5311,  0.4600,  0.9345,  0.7021,  0.4114,  0.3495,  0.8920,
         0.6435,  0.7201,  0.6217,  0.7096,  0.7129,  0.4780,  0.8758,
         0.7695,  0.6057,  0.6500,  0.5946,  0.0835,  0.8744,  0.4696,
         0.8052,  0.6137,  0.5227,  0.7857,  0.6926,  0.2878,  0.2912,
         0.4148,  0.2542,  0.7676,  0.4047,  0.3485,  0.9506,  0.5560,
         0.3247,  0.2415,  0.1846,  0.4403,  0.5036,  0.2388,  0.1482,
         0.7743,  0.7268,  0.6743,  0.7501,  0.8451,  0.1654,  0.7861,
         0.6171,  0.1913,  0.4949,  0.6950,  0.6297,  0.2596,  0.5536,
         0.6546,  0.0735,  0.8904,  0.1008,  0.6391,  0.0252,  0.6174,
         0.4830,  0.7602,  0.2415,  0.2758,  0.5211,  0.3096,  0.2069,
         0.9303,  0.5067,  0.6309,  0.7139,  0.1415,  0.4502,  0.4576,
         0.2850,  0.8825,  0.2784,  0.5682,  0.3218,  0.7330,  0.6188,
         0.7037,  0.5533,  0.6897,  0.7019,  0.5645,  0.8540,  0.1823,
         0.6350,  0.7544,  0.6020,  0.6610,  0.9386,  0.0367,  0.3554,
         0.6530,  0.6807,  0.3598,  0.5210,  0.7560,  0.2006,  0.7331,
         0.3274,  0.3830,  0.6037,  0.2493,  0.7435,  0.2077,  0.8784,
         0.8910,  0.1588,  0.5562,  0.6733,  0.4951,  0.4601,  0.7500,
         0.7736,  0.7544,  0.1568,  0.8939,  0.2455,  0.5941,  0.7391,
         0.9567,  0.7239,  0.7890,  0.2943,  0.5327,  0.7944,  0.3615,
         0.6306,  0.7920,  0.4387,  0.7808,  0.8097,  0.4655,  0.1928,
         0.8292,  0.7661,  0.2818,  0.7291,  0.7354,  0.2877,  0.7901,
         0.5183,  0.1803,  0.2701,  0.5865,  0.3054,  0.7037,  0.8322,
         0.4467,  0.4697,  0.6040,  0.1749,  0.7626,  0.5414,  0.5084,
         0.5562,  0.5164,  0.7791,  0.4514,  0.6993,  0.2433,  0.1773,
         0.2408,  0.5037,  0.3591,  0.5973,  0.8175,  0.2132,  0.4737,
         0.3558,  0.8380,  0.7809,  0.8719,  0.4427,  0.3947,  0.3824,
         0.7025,  0.7718,  0.1910,  0.3255,  0.8954,  0.7955,  0.5693,
         0.8857,  0.7121,  0.5298,  0.5865,  0.6064,  0.6620,  0.9650,
         0.2682,  0.6192,  0.7507,  0.2384,  0.1045,  0.8308,  0.3113,
         0.7190,  0.6754,  0.7171,  0.7606,  0.7322,  0.3041,  0.6325,
         0.4054,  0.8290,  0.6661,  0.8213,  0.5033,  0.7577,  0.0711,
         0.3344,  0.1807,  0.4111,  0.6681,  0.3001,  0.6701,  0.2954,
         0.3664,  0.6568,  0.7731,  0.8644,  0.6085,  0.5555,  0.4351,
         0.6247,  0.6531,  0.3672,  0.8884,  0.7772,  0.2291,  0.8591,
         0.4317,  0.8050,  0.3466,  0.3007,  0.6667,  0.8067,  0.9545,
         0.2348,  0.6531,  0.3212,  0.4364,  0.4012,  0.7425,  0.9285,
         0.3234,  0.4967,  0.5339,  0.2182,  0.6453,  0.6713,  0.7916,
         0.1863,  0.3798,  0.3293,  0.7295,  0.7272,  0.4003,  0.8082,
         0.1022,  0.7046,  0.2395,  0.5994,  0.3153,  0.6699,  0.8372,
         0.0593,  0.5149,  0.0767,  0.7335,  0.8473,  0.8510,  0.8386,
         0.1317,  0.3602,  0.6113,  0.7054,  0.6499,  0.6693,  0.4802,
         0.3181,  0.5741,  0.4382,  0.3456,  0.7970,  0.9633,  0.3924,
         0.5279,  0.7555,  0.6075,  0.2600,  0.5179,  0.6110,  0.3596,
         0.7237,  0.8152,  0.5245,  0.6565,  0.0713,  0.3979,  0.8234,
         0.3406,  0.5812,  0.2286,  0.7644,  0.8034,  0.3068,  0.3999,
         0.3136,  0.8721,  0.9704,  0.1546,  0.7211,  0.2758,  0.6670,
         0.5814,  0.3938,  0.1469,  0.7355,  0.1333,  0.8314,  0.6675,
         0.2352,  0.8878,  0.5161,  0.2454,  0.0940,  0.7305,  0.5701,
         0.7736,  0.0767,  0.5731,  0.3169,  0.1644,  0.3755,  0.4812,
         0.2321,  0.5512,  0.4592,  0.4782,  0.7354,  0.3011,  0.6851,
         0.3859,  0.3255,  0.5900,  0.1700,  0.6872,  0.1252,  0.6170,
         0.8656,  0.5678,  0.6953,  0.3801,  0.7155,  0.0696,  0.1677,
         0.2904,  0.6143,  0.5098,  0.2694,  0.7111,  0.2508,  0.3224,
         0.3373,  0.8053,  0.7243,  0.6494,  0.4748,  0.6387,  0.1736,
         0.2079], device='cuda:0')
tensor(0.5115, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3085,  0.7928,  0.8557,  0.7449,  0.1067,  0.1370,  0.3637,
         0.7548,  0.7163,  0.6455,  0.6291,  0.8499,  0.8543,  0.1913,
         0.8130,  0.2997,  0.4824,  0.3071,  0.1739,  0.3827,  0.7641,
         0.8399,  0.4020,  0.4676,  0.5917,  0.7561,  0.3259,  0.4115,
         0.8642,  0.4706,  0.4999,  0.0570,  0.8034,  0.6222,  0.1382,
         0.4133,  0.1267,  0.5649,  0.3556,  0.7901,  0.2597,  0.2450,
         0.2301,  0.6786,  0.6083,  0.8505,  0.6181,  0.3094,  0.4203,
         0.6006,  0.5479,  0.9740,  0.5977,  0.2211,  0.2723,  0.2786,
         0.8094,  0.4273,  0.2768,  0.5818,  0.7451,  0.9293,  0.7119,
         0.6933,  0.3942,  0.2398,  0.6795,  0.6179,  0.8791,  0.9234,
         0.7332,  0.1716,  0.7107,  0.9648,  0.6843,  0.7872,  0.5258,
         0.2342,  0.3947,  0.6244,  0.1681,  0.6983,  0.7539,  0.3618,
         0.2363,  0.2387,  0.2214,  0.8336,  0.3836,  0.1943,  0.8307,
         0.6160,  0.8326,  0.3790,  0.3062,  0.5818,  0.7497,  0.8947,
         0.7270,  0.3772,  0.2962,  0.2741,  0.5944,  0.6990,  0.8419,
         0.1947,  0.6830,  0.3335,  0.6073,  0.2833,  0.1726,  0.6498,
         0.7613,  0.1812,  0.6544,  0.2519,  0.2329,  0.7661,  0.5298,
         0.3255,  0.4533,  0.5883,  0.1997,  0.8428,  0.7778,  0.3599,
         0.3162,  0.7085,  0.8000,  0.7149,  0.1781,  0.1879,  0.7057,
         0.7350,  0.8153,  0.8111,  0.7815,  0.3568,  0.7349,  0.5183,
         0.5320,  0.6752,  0.8311,  0.7862,  0.6953,  0.1849,  0.2194,
         0.7596,  0.2695,  0.3544,  0.8045,  0.7897,  0.7873,  0.5336,
         0.4584,  0.7747,  0.4822,  0.5241,  0.9489,  0.6675,  0.2058,
         0.4034,  0.1805,  0.7823,  0.1624,  0.8548,  0.3175,  0.8038,
         0.7880,  0.7309,  0.6539,  0.1561,  0.2017,  0.5018,  0.5897,
         0.3426,  0.1688,  0.5160,  0.4742,  0.7557,  0.7514,  0.2630,
         0.3067,  0.7905,  0.6498,  0.6672,  0.7786,  0.5619,  0.8858,
         0.1945,  0.7183,  0.7166,  0.7856,  0.1979,  0.3436,  0.8368,
         0.1225,  0.1139,  0.4830,  0.7660,  0.3982,  0.7805,  0.7442,
         0.6297,  0.5935,  0.8339,  0.2765,  0.7442,  0.1342,  0.1123,
         0.1532,  0.6232,  0.6843,  0.6425,  0.6774,  0.8811,  0.6825,
         0.2448,  0.6424,  0.6048,  0.3220,  0.2013,  0.6932,  0.6246,
         0.2405,  0.4157,  0.3849,  0.4271,  0.1275,  0.7699,  0.3397,
         0.5732,  0.8545,  0.8374,  0.6182,  0.7260,  0.4886,  0.4868,
         0.4920,  0.7144,  0.7685,  0.8301,  0.8894,  0.4899,  0.7520,
         0.8522,  0.2392,  0.5131,  0.3400,  0.7362,  0.8030,  0.6351,
         0.2101,  0.7497,  0.4654,  0.5362,  0.7150,  0.5619,  0.3665,
         0.7916,  0.7792,  0.1218,  0.3221,  0.7123,  0.6044,  0.8150,
         0.6569,  0.8199,  0.6283,  0.2630,  0.1276,  0.2123,  0.7235,
         0.6583,  0.4340,  0.1847,  0.3168,  0.9796,  0.8511,  0.3821,
         0.3730,  0.6526,  0.8291,  0.1338,  0.7548,  0.7684,  0.2941,
         0.6290,  0.5946,  0.2363,  0.5857,  0.5736,  0.2397,  0.3781,
         0.5485,  0.4192,  0.6821,  0.7221,  0.7757,  0.1509,  0.8102,
         0.3092,  0.5506,  0.2657,  0.7681,  0.5565,  0.4467,  0.4450,
         0.8052,  0.6237,  0.2857,  0.6644,  0.5400,  0.7661,  0.8180,
         0.0842,  0.7813,  0.4037,  0.3737,  0.3171,  0.4503,  0.3582,
         0.3385,  0.7017,  0.7284,  0.4551,  0.2604,  0.5509,  0.7110,
         0.8635,  0.8366,  0.4867,  0.1431,  0.8581,  0.3480,  0.6653,
         0.7027,  0.2458,  0.5862,  0.7356,  0.3014,  0.8641,  0.5928,
         0.0947,  0.7881,  0.7288,  0.2480,  0.7435,  0.7774,  0.6358,
         0.8116,  0.4478,  0.7819,  0.5110,  0.8302,  0.7603,  0.4865,
         0.2355,  0.6748,  0.1737,  0.1421,  0.2770,  0.7949,  0.5600,
         0.6674,  0.7623,  0.5325,  0.0781,  0.8514,  0.2802,  0.8087,
         0.3079,  0.6596,  0.6940,  0.1875,  0.3597,  0.4318,  0.7704,
         0.5493,  0.3506,  0.3595,  0.6970,  0.6201,  0.5758,  0.4381,
         0.6339,  0.6609,  0.8884,  0.2196,  0.8043,  0.7329,  0.2490,
         0.3002,  0.7828,  0.8107,  0.4991,  0.7832,  0.1488,  0.7839,
         0.8039,  0.5999,  0.8292,  0.7210,  0.6921,  0.4517,  0.8058,
         0.3699,  0.2988,  0.5687,  0.8032,  0.6584,  0.6833,  0.1148,
         0.7696,  0.2633,  0.3235,  0.6678,  0.8220,  0.1066,  0.3481,
         0.8253,  0.6385,  0.3972,  0.7489,  0.7806,  0.3743,  0.0605,
         0.8778,  0.7976,  0.6009,  0.1576,  0.1648,  0.0993,  0.7566,
         0.5701,  0.6069,  0.9080,  0.5388,  0.5891,  0.7189,  0.4312,
         0.1020,  0.4054,  0.4143,  0.2578,  0.6192,  0.2734,  0.0539,
         0.7488,  0.6974,  0.1734,  0.7659,  0.0832,  0.3356,  0.2068,
         0.4121,  0.7161,  0.2046,  0.1587,  0.7901,  0.1526,  0.3201,
         0.4583,  0.1643,  0.6001,  0.0851,  0.2521,  0.4699,  0.3570,
         0.1960,  0.3481,  0.4785,  0.8001,  0.8920,  0.8879,  0.2416,
         0.6240,  0.7284,  0.7145,  0.2189,  0.4254,  0.8152,  0.8492,
         0.7715,  0.7899,  0.5071,  0.5797,  0.8033,  0.7506,  0.6524,
         0.1569,  0.5555,  0.8164,  0.1863,  0.6739,  0.5097,  0.8011,
         0.8676,  0.8765,  0.2839,  0.8443,  0.2228,  0.1457,  0.7253,
         0.6079,  0.8196,  0.3790,  0.0884,  0.7948,  0.7945,  0.2004,
         0.8711], device='cuda:0')
tensor(0.5409, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7359,  0.7825,  0.7164,  0.1488,  0.1091,  0.8031,  0.6539,
         0.1355,  0.2523,  0.7893,  0.4801,  0.5928,  0.8278,  0.8117,
         0.8576,  0.7453,  0.6000,  0.1902,  0.3537,  0.6608,  0.0294,
         0.1882,  0.6876,  0.7512,  0.7396,  0.5151,  0.6054,  0.5032,
         0.1918,  0.1423,  0.6563,  0.6057,  0.1330,  0.5916,  0.0825,
         0.0930,  0.7285,  0.5850,  0.5990,  0.6989,  0.5007,  0.2897,
         0.8294,  0.6509,  0.7812,  0.1372,  0.8064,  0.2285,  0.8120,
         0.5862,  0.2789,  0.8553,  0.4995,  0.2965,  0.3838,  0.8395,
         0.1355,  0.1970,  0.3242,  0.3894,  0.6805,  0.7148,  0.1006,
         0.7595,  0.7362,  0.7387,  0.6427,  0.2760,  0.1267,  0.7267,
         0.7666,  0.7914,  0.8816,  0.7925,  0.7503,  0.5873,  0.6251,
         0.7940,  0.5288,  0.6339,  0.1189,  0.6625,  0.1708,  0.9175,
         0.0332,  0.6453,  0.8658,  0.3920,  0.5357,  0.0767,  0.8336,
         0.4360,  0.0653,  0.3210,  0.3022,  0.3068,  0.2338,  0.1004,
         0.7805,  0.6230,  0.5013,  0.8134,  0.7242,  0.6473,  0.6799,
         0.6724,  0.7302,  0.8575,  0.8654,  0.4458,  0.5150,  0.1686,
         0.8072,  0.7690,  0.4091,  0.6638,  0.6923,  0.1412,  0.0871,
         0.8804,  0.0707,  0.6968,  0.1043,  0.1368,  0.2543,  0.0906,
         0.1310,  0.7712,  0.8383,  0.1480,  0.7747,  0.1604,  0.8816,
         0.7504,  0.2073,  0.3768,  0.5084,  0.1770,  0.5588,  0.8089,
         0.5865,  0.3975,  0.7865,  0.2139,  0.8874,  0.3967,  0.7883,
         0.7361,  0.2865,  0.1825,  0.7546,  0.4976,  0.4765,  0.6606,
         0.8402,  0.8980,  0.1675,  0.8426,  0.6765,  0.7342,  0.6824,
         0.2514,  0.2071,  0.7413,  0.9487,  0.1932,  0.6008,  0.6570,
         0.9361,  0.0693,  0.6774,  0.3799,  0.5762,  0.2796,  0.0711,
         0.9314,  0.2061,  0.7047,  0.5903,  0.1322,  0.1203,  0.7486,
         0.1389,  0.7628,  0.6756,  0.8081,  0.5576,  0.1303,  0.7049,
         0.7106,  0.7016,  0.5233,  0.3043,  0.5585,  0.2457,  0.1078,
         0.0775,  0.7532,  0.5070,  0.9139,  0.3876,  0.5577,  0.6305,
         0.8548,  0.1708,  0.4692,  0.1729,  0.6351,  0.8470,  0.3122,
         0.7779,  0.6110,  0.5185,  0.1871,  0.4069,  0.1883,  0.7786,
         0.5853,  0.4705,  0.3132,  0.2347,  0.1972,  0.5291,  0.7607,
         0.7909,  0.1957,  0.7462,  0.8982,  0.4313,  0.7201,  0.4799,
         0.6237,  0.7377,  0.7629,  0.7472,  0.1088,  0.7443,  0.9682,
         0.9111,  0.5581,  0.1730,  0.6848,  0.2530,  0.8248,  0.8468,
         0.1464,  0.5601,  0.3048,  0.1769,  0.1927,  0.7521,  0.4925,
         0.2077,  0.8424,  0.7220,  0.2353,  0.5055,  0.5758,  0.7583,
         0.6610,  0.6190,  0.6097,  0.6180,  0.9798,  0.5521,  0.8588,
         0.8730,  0.7384,  0.3065,  0.8766,  0.3695,  0.6258,  0.6046,
         0.7790,  0.1973,  0.6502,  0.8587,  0.0566,  0.7898,  0.1613,
         0.8273,  0.6876,  0.1758,  0.7853,  0.7694,  0.2062,  0.7078,
         0.3145,  0.3319,  0.3326,  0.2545,  0.3474,  0.2906,  0.1584,
         0.6128,  0.4708,  0.4070,  0.4907,  0.5452,  0.9871,  0.6026,
         0.8928,  0.3665,  0.1457,  0.8180,  0.2112,  0.4604,  0.7913,
         0.1266,  0.8874,  0.8120,  0.1996,  0.7881,  0.3052,  0.8314,
         0.7478,  0.7369,  0.5514,  0.6255,  0.6898,  0.9279,  0.8931,
         0.1474,  0.1519,  0.6857,  0.6796,  0.9030,  0.7577,  0.2357,
         0.6151,  0.6157,  0.2596,  0.3583,  0.8569,  0.4385,  0.6707,
         0.6258,  0.1280,  0.8525,  0.8060,  0.1725,  0.2252,  0.9572,
         0.8034,  0.1497,  0.6190,  0.3572,  0.3357,  0.5793,  0.8048,
         0.1071,  0.1961,  0.0919,  0.6795,  0.7137,  0.7610,  0.6967,
         0.6856,  0.7479,  0.6120,  0.4378,  0.8416,  0.1367,  0.5879,
         0.4774,  0.2753,  0.4307,  0.1816,  0.9475,  0.1967,  0.9288,
         0.9193,  0.1954,  0.8282,  0.2166,  0.2993,  0.8975,  0.3371,
         0.5831,  0.5527,  0.1749,  0.8102,  0.7510,  0.9756,  0.3440,
         0.1728,  0.9088,  0.1205,  0.2534,  0.3467,  0.0537,  0.8737,
         0.0680,  0.7698,  0.1506,  0.5258,  0.8248,  0.0821,  0.8772,
         0.9051,  0.2873,  0.2683,  0.2616,  0.9548,  0.2732,  0.7243,
         0.1240,  0.0475,  0.8433,  0.3775,  0.1030,  0.1577,  0.7171,
         0.5160,  0.8974,  0.2133,  0.7360,  0.7393,  0.6990,  0.8086,
         0.5427,  0.2321,  0.7962,  0.3264,  0.3233,  0.3802,  0.6034,
         0.2394,  0.6356,  0.8242,  0.0973,  0.4761,  0.5382,  0.6569,
         0.2020,  0.3298,  0.5065,  0.8392,  0.1633,  0.2495,  0.7658,
         0.8612,  0.7811,  0.8949,  0.0908,  0.5543,  0.7671,  0.2706,
         0.9463,  0.5594,  0.1083,  0.3867,  0.4048,  0.4980,  0.3464,
         0.1648,  0.4276,  0.6393,  0.6491,  0.0578,  0.4577,  0.9683,
         0.6364,  0.5291,  0.5437,  0.8522,  0.5221,  0.4310,  0.6295,
         0.7260,  0.0684,  0.4970,  0.3230,  0.3673,  0.3185,  0.2677,
         0.6611,  0.3249,  0.0998,  0.8398,  0.8195,  0.8675,  0.3163,
         0.6781,  0.6889,  0.4996,  0.1059,  0.1044,  0.1995,  0.4578,
         0.3836,  0.6728,  0.8117,  0.8718,  0.7497,  0.7766,  0.8084,
         0.2642,  0.6906,  0.7487,  0.8749,  0.1956,  0.7313,  0.0447,
         0.8226,  0.7160,  0.1292,  0.6238,  0.2714,  0.9712,  0.7185,
         0.1039], device='cuda:0')
tensor(0.5043, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6713,  0.5906,  0.9699,  0.9658,  0.5870,  0.9224,  0.2361,
         0.8823,  0.7507,  0.4382,  0.2666,  0.6219,  0.4932,  0.8327,
         0.5321,  0.7765,  0.8231,  0.5161,  0.7870,  0.6694,  0.8256,
         0.6328,  0.0349,  0.0960,  0.1620,  0.9464,  0.7331,  0.7677,
         0.4554,  0.4834,  0.5212,  0.4044,  0.6505,  0.6880,  0.9049,
         0.7729,  0.7800,  0.6186,  0.1559,  0.5635,  0.9613,  0.7561,
         0.7161,  0.1946,  0.8522,  0.0942,  0.8726,  0.7589,  0.5254,
         0.0878,  0.1394,  0.7164,  0.1783,  0.8654,  0.7887,  0.3935,
         0.5922,  0.1595,  0.7356,  0.7655,  0.5579,  0.1817,  0.5747,
         0.7527,  0.2247,  0.5636,  0.0654,  0.1039,  0.6123,  0.7471,
         0.0759,  0.1581,  0.0648,  0.7397,  0.6613,  0.3493,  0.3095,
         0.8234,  0.8021,  0.1557,  0.0593,  0.6979,  0.5138,  0.8600,
         0.1508,  0.1992,  0.8890,  0.6034,  0.6229,  0.7905,  0.3925,
         0.7990,  0.7511,  0.9169,  0.0624,  0.4832,  0.3285,  0.6504,
         0.5754,  0.7356,  0.1541,  0.5299,  0.8549,  0.4882,  0.7262,
         0.2694,  0.0957,  0.6877,  0.5844,  0.5166,  0.3326,  0.5031,
         0.6376,  0.4527,  0.1009,  0.4615,  0.7218,  0.2638,  0.6737,
         0.8821,  0.7521,  0.8129,  0.6005,  0.8788,  0.6471,  0.1058,
         0.5781,  0.3513,  0.8392,  0.3086,  0.1518,  0.8075,  0.6764,
         0.2803,  0.7311,  0.6537,  0.2618,  0.7767,  0.8647,  0.5973,
         0.5510,  0.4365,  0.1317,  0.6834,  0.3299,  0.7754,  0.1246,
         0.7272,  0.6211,  0.1304,  0.3361,  0.7851,  0.8131,  0.8652,
         0.2294,  0.6222,  0.3763,  0.7862,  0.8721,  0.5872,  0.0686,
         0.7670,  0.4626,  0.1933,  0.1622,  0.9463,  0.5799,  0.7126,
         0.5643,  0.8397,  0.1775,  0.8389,  0.6344,  0.6786,  0.6637,
         0.8380,  0.3028,  0.2305,  0.7947,  0.7145,  0.1542,  0.7687,
         0.2795,  0.1572,  0.9871,  0.9499,  0.1456,  0.7495,  0.9344,
         0.0897,  0.4568,  0.1613,  0.5682,  0.7499,  0.7977,  0.7475,
         0.8332,  0.2123,  0.8983,  0.8763,  0.0556,  0.7025,  0.9764,
         0.6819,  0.4613,  0.7617,  0.1934,  0.0550,  0.7969,  0.8622,
         0.7607,  0.6529,  0.7377,  0.1790,  0.2412,  0.2171,  0.1130,
         0.1418,  0.6138,  0.6948,  0.8146,  0.0375,  0.0481,  0.2703,
         0.5938,  0.4613,  0.4083,  0.4790,  0.2373,  0.5792,  0.2319,
         0.7045,  0.1649,  0.8558,  0.2143,  0.7551,  0.7574,  0.9319,
         0.4666,  0.0755,  0.3810,  0.3878,  0.9755,  0.1619,  0.6687,
         0.6797,  0.2350,  0.1749,  0.8239,  0.4740,  0.5726,  0.8092,
         0.2092,  0.1300,  0.2153,  0.3840,  0.2709,  0.1272,  0.2175,
         0.2930,  0.9212,  0.2774,  0.2396,  0.6978,  0.6700,  0.4462,
         0.2929,  0.1631,  0.6351,  0.1877,  0.3314,  0.5941,  0.6237,
         0.1725,  0.6784,  0.2814,  0.8768,  0.8176,  0.0807,  0.2756,
         0.6995,  0.8036,  0.9555,  0.1545,  0.3867,  0.1037,  0.6664,
         0.5373,  0.4375,  0.0775,  0.7023,  0.6882,  0.2081,  0.1005,
         0.9051,  0.3007,  0.7293,  0.8255,  0.3802,  0.8183,  0.7297,
         0.7791,  0.5694,  0.4263,  0.6582,  0.1213,  0.4663,  0.8892,
         0.2326,  0.6955,  0.0565,  0.8583,  0.5393,  0.7323,  0.4988,
         0.8459,  0.8348,  0.4951,  0.6706,  0.7837,  0.2359,  0.5313,
         0.3442,  0.7567,  0.7930,  0.1298,  0.6777,  0.5188,  0.4443,
         0.6770,  0.3093,  0.2495,  0.8847,  0.2812,  0.7231,  0.1061,
         0.8281,  0.6640,  0.4864,  0.2291,  0.5438,  0.8335,  0.3917,
         0.7376,  0.6553,  0.2015,  0.5874,  0.6689,  0.3626,  0.2299,
         0.3838,  0.3320,  0.5387,  0.1445,  0.2872,  0.6277,  0.4923,
         0.3660,  0.1082,  0.8872,  0.0984,  0.0895,  0.2189,  0.7809,
         0.8895,  0.7791,  0.2344,  0.6820,  0.8079,  0.7319,  0.1372,
         0.0992,  0.1279,  0.7318,  0.7577,  0.1373,  0.1675,  0.4698,
         0.2543,  0.6145,  0.8220,  0.5200,  0.3999,  0.3488,  0.5818,
         0.1691,  0.7520,  0.6340,  0.1014,  0.9082,  0.7763,  0.1974,
         0.1373,  0.0638,  0.8534,  0.7366,  0.7361,  0.0927,  0.7933,
         0.4161,  0.5116,  0.1007,  0.1214,  0.7968,  0.3196,  0.1587,
         0.9720,  0.7703,  0.6166,  0.0621,  0.2303,  0.7652,  0.6455,
         0.3824,  0.6022,  0.5064,  0.8524,  0.0617,  0.7116,  0.8294,
         0.0855,  0.7542,  0.5196,  0.6189,  0.1304,  0.3719,  0.4557,
         0.7848,  0.7441,  0.8493,  0.5038,  0.7661,  0.7586,  0.6670,
         0.9884,  0.9482,  0.4399,  0.0986,  0.6052,  0.8716,  0.1886,
         0.1305,  0.4030,  0.7882,  0.1690,  0.4075,  0.7390,  0.4318,
         0.7072,  0.7618,  0.1444,  0.1638,  0.2345,  0.7280,  0.1343,
         0.8865,  0.8061,  0.7490,  0.3889,  0.8202,  0.8583,  0.8209,
         0.7403,  0.9307,  0.0840,  0.1547,  0.7662,  0.1611,  0.4161,
         0.9779,  0.2535,  0.3296,  0.1816,  0.7678,  0.7675,  0.8001,
         0.0981,  0.0784,  0.8363,  0.6236,  0.9335,  0.6968,  0.8002,
         0.6146,  0.1510,  0.1195,  0.2402,  0.0979,  0.2476,  0.4709,
         0.1505,  0.6596,  0.7734,  0.1237,  0.2247,  0.1805,  0.6664,
         0.6987,  0.9568,  0.6802,  0.5371,  0.2036,  0.3698,  0.3498,
         0.7377,  0.8753,  0.5923,  0.0816,  0.9235,  0.8554,  0.9034,
         0.7892], device='cuda:0')
tensor(0.4816, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7269,  0.1222,  0.6244,  0.9201,  0.8559,  0.5817,  0.1056,
         0.7217,  0.8118,  0.8526,  0.6254,  0.5351,  0.2197,  0.7976,
         0.1720,  0.3189,  0.3160,  0.7967,  0.1298,  0.6379,  0.7677,
         0.3643,  0.8350,  0.8578,  0.3543,  0.6054,  0.7440,  0.5378,
         0.6177,  0.1164,  0.7930,  0.7766,  0.3187,  0.5365,  0.8034,
         0.7948,  0.2503,  0.4886,  0.7786,  0.3538,  0.3023,  0.1216,
         0.8996,  0.4897,  0.1674,  0.7046,  0.4675,  0.7963,  0.6880,
         0.7698,  0.9767,  0.7233,  0.1935,  0.8248,  0.1259,  0.7689,
         0.1045,  0.2395,  0.1352,  0.1078,  0.7477,  0.0970,  0.6176,
         0.8440,  0.7200,  0.1133,  0.6691,  0.7026,  0.5574,  0.2240,
         0.7845,  0.7885,  0.1726,  0.0983,  0.1517,  0.6088,  0.2125,
         0.6781,  0.1357,  0.8212,  0.1919,  0.7236,  0.9744,  0.1076,
         0.8388,  0.9181,  0.7108,  0.1244,  0.7743,  0.0848,  0.1267,
         0.2110,  0.2616,  0.3373,  0.9168,  0.0960,  0.8343,  0.4495,
         0.1835,  0.3079,  0.1446,  0.8593,  0.2806,  0.9509,  0.5653,
         0.8077,  0.2108,  0.7399,  0.3936,  0.7355,  0.2804,  0.3807,
         0.1122,  0.2667,  0.1071,  0.9757,  0.0949,  0.6042,  0.3211,
         0.6650,  0.6573,  0.7242,  0.5370,  0.6052,  0.1593,  0.6037,
         0.5270,  0.7715,  0.1312,  0.2158,  0.7487,  0.3802,  0.7530,
         0.1295,  0.8806,  0.2647,  0.7434,  0.1797,  0.6888,  0.8520,
         0.9032,  0.6946,  0.8663,  0.9397,  0.7233,  0.2265,  0.3619,
         0.7781,  0.5768,  0.7940,  0.0880,  0.9154,  0.4596,  0.2086,
         0.2877,  0.9077,  0.8374,  0.3126,  0.1211,  0.6905,  0.8296,
         0.2057,  0.5640,  0.8757,  0.2004,  0.0679,  0.1233,  0.4758,
         0.5222,  0.7746,  0.7536,  0.1539,  0.1607,  0.4078,  0.7870,
         0.6827,  0.2173,  0.1755,  0.6920,  0.8720,  0.8782,  0.6622,
         0.1727,  0.9186,  0.3767,  0.3199,  0.5100,  0.2995,  0.4695,
         0.2579,  0.9291,  0.1366,  0.2250,  0.2037,  0.2332,  0.1674,
         0.7791,  0.8656,  0.8984,  0.8276,  0.0612,  0.8867,  0.8350,
         0.8276,  0.4775,  0.3334,  0.6085,  0.2962,  0.4770,  0.7061,
         0.5896,  0.6211,  0.8280,  0.3807,  0.6486,  0.6533,  0.5333,
         0.7599,  0.7583,  0.8038,  0.3092,  0.5662,  0.6920,  0.4608,
         0.2944,  0.8099,  0.6882,  0.6405,  0.6915,  0.7885,  0.1229,
         0.3634,  0.8143,  0.7745,  0.3555,  0.6004,  0.8840,  0.2725,
         0.7608,  0.4936,  0.8044,  0.1875,  0.7289,  0.6732,  0.5854,
         0.8523,  0.8615,  0.8537,  0.7818,  0.1078,  0.6216,  0.1784,
         0.6276,  0.4325,  0.8687,  0.9063,  0.9227,  0.5185,  0.8200,
         0.2088,  0.6096,  0.1964,  0.7848,  0.9889,  0.1672,  0.8400,
         0.8377,  0.9098,  0.8622,  0.1613,  0.5074,  0.6157,  0.4870,
         0.1777,  0.0598,  0.6980,  0.8882,  0.9076,  0.6115,  0.7736,
         0.3165,  0.6398,  0.7074,  0.1263,  0.6787,  0.4265,  0.5252,
         0.2014,  0.6677,  0.7254,  0.1205,  0.2701,  0.2673,  0.8220,
         0.2594,  0.6569,  0.7178,  0.6936,  0.5866,  0.9051,  0.2001,
         0.0614,  0.8307,  0.9454,  0.5807,  0.6314,  0.8147,  0.7987,
         0.2730,  0.6934,  0.3782,  0.7688,  0.7112,  0.7120,  0.0982,
         0.1966,  0.3106,  0.2676,  0.8214,  0.9758,  0.7189,  0.7281,
         0.7975,  0.6287,  0.7375,  0.3819,  0.8457,  0.1670,  0.7639,
         0.7953,  0.7916,  0.1265,  0.1188,  0.8002,  0.5581,  0.6906,
         0.8797,  0.9038,  0.7037,  0.0929,  0.7481,  0.1346,  0.7030,
         0.8572,  0.8939,  0.2402,  0.5716,  0.8628,  0.2154,  0.2170,
         0.8511,  0.3599,  0.1964,  0.7994,  0.0760,  0.7392,  0.7481,
         0.4278,  0.3803,  0.6499,  0.6777,  0.0986,  0.7814,  0.1752,
         0.4547,  0.8153,  0.9563,  0.6810,  0.8577,  0.7794,  0.7644,
         0.7002,  0.6297,  0.6252,  0.8001,  0.2863,  0.8528,  0.5121,
         0.9022,  0.2609,  0.0683,  0.2506,  0.0841,  0.4496,  0.6396,
         0.0808,  0.4728,  0.7674,  0.6641,  0.8983,  0.4382,  0.4365,
         0.6055,  0.8410,  0.1661,  0.2587,  0.5395,  0.7296,  0.5726,
         0.2209,  0.8334,  0.0460,  0.8610,  0.1380,  0.7030,  0.2474,
         0.1225,  0.9238,  0.8353,  0.1809,  0.8040,  0.7376,  0.7238,
         0.7070,  0.4361,  0.8794,  0.6601,  0.7203,  0.0801,  0.9233,
         0.8788,  0.2755,  0.0959,  0.1695,  0.7089,  0.7913,  0.1600,
         0.7439,  0.5141,  0.8551,  0.1024,  0.1898,  0.7396,  0.5092,
         0.3795,  0.0744,  0.5380,  0.8568,  0.5562,  0.2587,  0.2623,
         0.6352,  0.6752,  0.3783,  0.1041,  0.1205,  0.0855,  0.8716,
         0.1244,  0.8336,  0.2190,  0.1602,  0.6069,  0.2161,  0.2919,
         0.8767,  0.0441,  0.6853,  0.3142,  0.7977,  0.9163,  0.8769,
         0.7797,  0.2195,  0.4798,  0.8598,  0.7241,  0.3259,  0.1451,
         0.8304,  0.5100,  0.6786,  0.8902,  0.1638,  0.8555,  0.9049,
         0.0459,  0.1768,  0.8184,  0.3207,  0.7385,  0.4491,  0.6977,
         0.9428,  0.6934,  0.6027,  0.5986,  0.4659,  0.1042,  0.8221,
         0.4959,  0.1638,  0.3377,  0.8813,  0.1184,  0.9722,  0.1470,
         0.7781,  0.0812,  0.1451,  0.5445,  0.1045,  0.8025,  0.1858,
         0.7438,  0.9699,  0.8616,  0.7704,  0.2933,  0.8316,  0.6668,
         0.4444], device='cuda:0')
tensor(0.5297, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4327,  0.0797,  0.8286,  0.8277,  0.3412,  0.1848,  0.5424,
         0.3634,  0.3987,  0.8541,  0.0828,  0.7823,  0.0904,  0.1763,
         0.8385,  0.0559,  0.3908,  0.3664,  0.8780,  0.0656,  0.9177,
         0.1077,  0.9231,  0.7055,  0.1247,  0.7943,  0.8321,  0.2345,
         0.9933,  0.8874,  0.0836,  0.2629,  0.2412,  0.2377,  0.8636,
         0.9165,  0.8316,  0.0567,  0.4246,  0.8273,  0.6805,  0.2113,
         0.4747,  0.8472,  0.8086,  0.7358,  0.7246,  0.7192,  0.2363,
         0.9323,  0.9061,  0.1516,  0.4602,  0.8736,  0.1272,  0.8143,
         0.6336,  0.5808,  0.0646,  0.7529,  0.0996,  0.7736,  0.0672,
         0.2200,  0.2426,  0.0869,  0.5931,  0.9803,  0.4970,  0.8205,
         0.9898,  0.8269,  0.6178,  0.0540,  0.9160,  0.2032,  0.4967,
         0.2529,  0.2064,  0.6494,  0.7416,  0.2147,  0.8744,  0.0261,
         0.8349,  0.9963,  0.2008,  0.9603,  0.2477,  0.1051,  0.2541,
         0.7279,  0.5257,  0.1388,  0.8867,  0.7483,  0.7984,  0.6827,
         0.8942,  0.8744,  0.8103,  0.1806,  0.6908,  0.0942,  0.1023,
         0.7630,  0.8295,  0.6492,  0.1008,  0.2951,  0.7113,  0.5971,
         0.8253,  0.6761,  0.0727,  0.8700,  0.3255,  0.3012,  0.8789,
         0.2254,  0.9822,  0.1512,  0.9024,  0.8627,  0.3252,  0.6396,
         0.2524,  0.1489,  0.4207,  0.2601,  0.7813,  0.7933,  0.1430,
         0.4719,  0.7341,  0.8710,  0.9077,  0.7417,  0.1107,  0.8354,
         0.9706,  0.8150,  0.2563,  0.2316,  0.6879,  0.0776,  0.7295,
         0.4686,  0.1045,  0.8183,  0.0447,  0.6508,  0.8987,  0.8255,
         0.3552,  0.1339,  0.0890,  0.6075,  0.6808,  0.3466,  0.0946,
         0.1248,  0.6174,  0.4513,  0.8274,  0.3604,  0.8788,  0.1445,
         0.8205,  0.3544,  0.3266,  0.0539,  0.7684,  0.6156,  0.3854,
         0.2077,  0.8558,  0.8492,  0.7368,  0.1552,  0.5816,  0.6631,
         0.8128,  0.1088,  0.0761,  0.6935,  0.1272,  0.1273,  0.3431,
         0.1673,  0.3695,  0.2269,  0.2800,  0.1291,  0.8442,  0.0953,
         0.8076,  0.5848,  0.1114,  0.1764,  0.1704,  0.1316,  0.3374,
         0.2897,  0.5180,  0.9532,  0.7613,  0.8925,  0.9319,  0.6636,
         0.0977,  0.8433,  0.2754,  0.1768,  0.2575,  0.0671,  0.2529,
         0.6632,  0.1020,  0.9099,  0.4904,  0.8253,  0.8213,  0.1100,
         0.0431,  0.7744,  0.3543,  0.8488,  0.3098,  0.8769,  0.7801,
         0.2717,  0.7703,  0.8799,  0.8240,  0.7681,  0.4439,  0.7600,
         0.3325,  0.2775,  0.9782,  0.5039,  0.8284,  0.7599,  0.1291,
         0.7539,  0.0954,  0.7817,  0.1394,  0.6945,  0.5979,  0.1797,
         0.2011,  0.7621,  0.2110,  0.7865,  0.7742,  0.1399,  0.8253,
         0.2484,  0.7646,  0.6693,  0.1440,  0.1942,  0.8659,  0.9211,
         0.4010,  0.6635,  0.9369,  0.1361,  0.5776,  0.0717,  0.0117,
         0.9301,  0.5217,  0.8341,  0.2351,  0.2770,  0.2127,  0.1075,
         0.0579,  0.3143,  0.0422,  0.2770,  0.1343,  0.5985,  0.1217,
         0.1768,  0.6391,  0.6843,  0.8536,  0.0641,  0.3279,  0.0804,
         0.6938,  0.2297,  0.7565,  0.7696,  0.7213,  0.6442,  0.8821,
         0.7231,  0.3068,  0.6825,  0.7733,  0.0250,  0.0792,  0.7650,
         0.0861,  0.1555,  0.7878,  0.1831,  0.8586,  0.7481,  0.8002,
         0.9545,  0.2065,  0.5458,  0.7034,  0.7017,  0.0551,  0.8380,
         0.7020,  0.9221,  0.6769,  0.8890,  0.6830,  0.6444,  0.9793,
         0.9311,  0.7889,  0.7744,  0.8617,  0.8460,  0.2135,  0.1846,
         0.1535,  0.1148,  0.8966,  0.1067,  0.0961,  0.6964,  0.8045,
         0.1532,  0.2088,  0.0700,  0.4069,  0.8743,  0.8690,  0.1595,
         0.2076,  0.8107,  0.8071,  0.2073,  0.2660,  0.1262,  0.7758,
         0.1129,  0.6320,  0.2877,  0.1989,  0.1703,  0.8169,  0.3449,
         0.8466,  0.1975,  0.7290,  0.7134,  0.8872,  0.2354,  0.0334,
         0.1146,  0.7986,  0.0531,  0.4458,  0.3052,  0.6477,  0.8877,
         0.7465,  0.2094,  0.8715,  0.4615,  0.8583,  0.1717,  0.7354,
         0.3736,  0.3926,  0.7548,  0.4981,  0.6756,  0.2915,  0.0504,
         0.3357,  0.5965,  0.7252,  0.7885,  0.1197,  0.5607,  0.8122,
         0.8829,  0.7342,  0.6691,  0.7904,  0.7715,  0.2405,  0.9883,
         0.7796,  0.1178,  0.6809,  0.1950,  0.7242,  0.8852,  0.3118,
         0.7638,  0.6253,  0.8549,  0.4635,  0.1613,  0.0991,  0.1809,
         0.7695,  0.7648,  0.5923,  0.9340,  0.4476,  0.0274,  0.6398,
         0.1413,  0.4829,  0.7380,  0.5167,  0.7121,  0.3472,  0.8776,
         0.9853,  0.1214,  0.7965,  0.2305,  0.0901,  0.2378,  0.1130,
         0.1749,  0.1526,  0.1370,  0.8501,  0.8384,  0.6145,  0.0607,
         0.1670,  0.7893,  0.7440,  0.6427,  0.0800,  0.1591,  0.7755,
         0.1511,  0.5166,  0.6220,  0.2117,  0.1988,  0.4058,  0.6990,
         0.7469,  0.0761,  0.1891,  0.1209,  0.7078,  0.1865,  0.1163,
         0.7890,  0.9678,  0.7281,  0.6430,  0.2925,  0.0435,  0.1118,
         0.7047,  0.8915,  0.1297,  0.3106,  0.0479,  0.5820,  0.1157,
         0.2729,  0.0736,  0.2879,  0.7762,  0.1291,  0.2502,  0.1953,
         0.1198,  0.9835,  0.2208,  0.5424,  0.0839,  0.7268,  0.1340,
         0.5871,  0.9188,  0.7692,  0.8343,  0.2765,  0.1159,  0.5303,
         0.8292,  0.1091,  0.1887,  0.7020,  0.2427,  0.7842,  0.6181,
         0.0761], device='cuda:0')
tensor(0.4669, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8689,  0.7289,  0.8752,  0.7310,  0.1326,  0.6337,  0.9265,
         0.2070,  0.9577,  0.0821,  0.2612,  0.0948,  0.2043,  0.7336,
         0.1433,  0.8354,  0.3661,  0.1431,  0.1079,  0.6280,  0.7899,
         0.5609,  0.6160,  0.1369,  0.2113,  0.1167,  0.1161,  0.8156,
         0.4639,  0.3550,  0.4328,  0.7822,  0.1528,  0.9210,  0.9173,
         0.2770,  0.1201,  0.9812,  0.0708,  0.0738,  0.0566,  0.1581,
         0.8112,  0.1328,  0.0209,  0.9743,  0.7862,  0.1913,  0.7940,
         0.3952,  0.3918,  0.2278,  0.2662,  0.1792,  0.1587,  0.7999,
         0.6061,  0.2866,  0.1388,  0.5654,  0.8082,  0.2677,  0.3292,
         0.7329,  0.1145,  0.1102,  0.9081,  0.0563,  0.2093,  0.8402,
         0.4431,  0.2427,  0.8145,  0.8870,  0.5828,  0.3745,  0.1109,
         0.0401,  0.7913,  0.0617,  0.5456,  0.1016,  0.7562,  0.1683,
         0.1529,  0.1270,  0.0313,  0.4520,  0.1417,  0.7018,  0.1413,
         0.4751,  0.5416,  0.4528,  0.7919,  0.2681,  0.5798,  0.7852,
         0.1165,  0.7818,  0.1154,  0.2213,  0.8019,  0.0656,  0.8937,
         0.2152,  0.4041,  0.2300,  0.2972,  0.7345,  0.3552,  0.1814,
         0.3124,  0.0291,  0.1511,  0.7023,  0.4701,  0.3592,  0.6430,
         0.5436,  0.1159,  0.9495,  0.6444,  0.2181,  0.2852,  0.3518,
         0.1243,  0.0846,  0.0944,  0.1613,  0.2452,  0.9471,  0.0765,
         0.1018,  0.7153,  0.6471,  0.2465,  0.0947,  0.7632,  0.6020,
         0.8857,  0.4656,  0.6915,  0.0977,  0.6119,  0.5483,  0.8100,
         0.8837,  0.8086,  0.9007,  0.1752,  0.5922,  0.7787,  0.4231,
         0.1031,  0.1813,  0.7173,  0.1586,  0.1432,  0.4878,  0.6687,
         0.2838,  0.8755,  0.5410,  0.0714,  0.8904,  0.5481,  0.2597,
         0.7760,  0.6532,  0.1368,  0.1028,  0.2954,  0.7171,  0.2283,
         0.7208,  0.6023,  0.0959,  0.0741,  0.5668,  0.4101,  0.1646,
         0.0174,  0.7193,  0.6758,  0.6417,  0.7280,  0.0712,  0.3991,
         0.8361,  0.2706,  0.4537,  0.1290,  0.4765,  0.0983,  0.2045,
         0.1814,  0.6440,  0.2461,  0.1895,  0.1216,  0.9293,  0.1452,
         0.5094,  0.3772,  0.1097,  0.3766,  0.1429,  0.6177,  0.1979,
         0.0775,  0.4969,  0.0793,  0.9073,  0.8025,  0.7509,  0.1113,
         0.6351,  0.4143,  0.7060,  0.1932,  0.0368,  0.2983,  0.1622,
         0.0852,  0.2402,  0.8078,  0.3348,  0.5012,  0.0690,  0.4094,
         0.3534,  0.7748,  0.6627,  0.0918,  0.3231,  0.6706,  0.9184,
         0.8983,  0.8375,  0.1726,  0.2294,  0.3531,  0.8734,  0.5705,
         0.7664,  0.0807,  0.0662,  0.9721,  0.1165,  0.1587,  0.7644,
         0.1465,  0.4456,  0.1367,  0.4937,  0.7501,  0.7296,  0.0955,
         0.1867,  0.7828,  0.1482,  0.6434,  0.5731,  0.3487,  0.8912,
         0.5175,  0.4685,  0.3272,  0.0558,  0.7556,  0.7955,  0.3963,
         0.1952,  0.1450,  0.8909,  0.1012,  0.8119,  0.1767,  0.1090,
         0.1414,  0.8840,  0.8086,  0.7534,  0.6180,  0.2392,  0.5044,
         0.7896,  0.1688,  0.7821,  0.1072,  0.6225,  0.1183,  0.0701,
         0.8666,  0.0475,  0.1157,  0.1788,  0.7977,  0.1160,  0.8244,
         0.1776,  0.1586,  0.3976,  0.1339,  0.6139,  0.3676,  0.8287,
         0.1384,  0.2972,  0.4379,  0.7923,  0.8287,  0.6782,  0.3031,
         0.2022,  0.1472,  0.7149,  0.7817,  0.4636,  0.6197,  0.1422,
         0.1064,  0.8635,  0.2980,  0.1006,  0.8206,  0.6807,  0.2105,
         0.8479,  0.0517,  0.9179,  0.0813,  0.3049,  0.8158,  0.2763,
         0.1382,  0.6057,  0.7358,  0.6810,  0.7607,  0.0800,  0.8294,
         0.7343,  0.1092,  0.9011,  0.1103,  0.8429,  0.0797,  0.1245,
         0.0793,  0.2456,  0.8545,  0.3304,  0.4072,  0.1428,  0.6644,
         0.7567,  0.8929,  0.4977,  0.3911,  0.0604,  0.2193,  0.1132,
         0.6449,  0.0216,  0.0861,  0.6527,  0.0900,  0.6342,  0.8458,
         0.2778,  0.6798,  0.7542,  0.9546,  0.0722,  0.4536,  0.8449,
         0.1713,  0.1654,  0.1260,  0.6297,  0.6103,  0.0397,  0.0953,
         0.7819,  0.4257,  0.1357,  0.3820,  0.3205,  0.3875,  0.1611,
         0.9355,  0.0987,  0.5642,  0.1696,  0.8874,  0.7366,  0.1654,
         0.1555,  0.7847,  0.0790,  0.5220,  0.1546,  0.8015,  0.9059,
         0.7547,  0.8349,  0.2318,  0.8865,  0.1251,  0.1169,  0.1997,
         0.0808,  0.4579,  0.6534,  0.8649,  0.0560,  0.6992,  0.1242,
         0.9571,  0.7828,  0.0453,  0.1018,  0.9407,  0.0668,  0.8963,
         0.0921,  0.5250,  0.8275,  0.6522,  0.7349,  0.8790,  0.1633,
         0.7601,  0.4692,  0.2478,  0.7602,  0.8019,  0.2538,  0.6552,
         0.1543,  0.6630,  0.1058,  0.1085,  0.1569,  0.8053,  0.8881,
         0.8765,  0.3998,  0.5292,  0.5669,  0.7734,  0.7653,  0.7045,
         0.7171,  0.4304,  0.5447,  0.1163,  0.1585,  0.8759,  0.7912,
         0.7690,  0.1904,  0.8139,  0.6848,  0.8809,  0.1867,  0.8937,
         0.5820,  0.5576,  0.4406,  0.1136,  0.1994,  0.2469,  0.1126,
         0.3547,  0.9776,  0.0886,  0.8740,  0.3466,  0.4500,  0.6997,
         0.8761,  0.0990,  0.0777,  0.1670,  0.6714,  0.1401,  0.2145,
         0.9925,  0.1014,  0.8522,  0.0832,  0.0998,  0.7995,  0.3123,
         0.1331,  0.8008,  0.1284,  0.8672,  0.3596,  0.1049,  0.8547,
         0.8287,  0.7556,  0.0895,  0.8126,  0.1677,  0.6480,  0.5467,
         0.7278], device='cuda:0')
tensor(0.4990, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3517,  0.8397,  0.7700,  0.2105,  0.1620,  0.4890,  0.1527,
         0.9482,  0.1667,  0.1069,  0.8875,  0.8596,  0.9123,  0.8481,
         0.0880,  0.9790,  0.4266,  0.2023,  0.6023,  0.3640,  0.5770,
         0.6437,  0.4531,  0.1491,  0.5557,  0.8827,  0.2895,  0.6820,
         0.7139,  0.2528,  0.5992,  0.2520,  0.9750,  0.0476,  0.7021,
         0.9108,  0.0427,  0.7461,  0.0923,  0.4498,  0.5695,  0.2267,
         0.5060,  0.8287,  0.2193,  0.3140,  0.1163,  0.1107,  0.1393,
         0.1440,  0.0239,  0.4241,  0.1956,  0.5678,  0.5458,  0.5743,
         0.6651,  0.7504,  0.7227,  0.2826,  0.7268,  0.4480,  0.7252,
         0.5474,  0.2109,  0.6983,  0.1051,  0.4187,  0.1423,  0.9538,
         0.2431,  0.1672,  0.5354,  0.0914,  0.1525,  0.0981,  0.8608,
         0.1002,  0.1691,  0.8150,  0.6819,  0.4591,  0.5195,  0.5638,
         0.6927,  0.4023,  0.1342,  0.5924,  0.2362,  0.7918,  0.1065,
         0.8603,  0.2635,  0.0796,  0.3293,  0.0341,  0.5942,  0.2088,
         0.6030,  0.8817,  0.8536,  0.1975,  0.0876,  0.2226,  0.6780,
         0.9453,  0.0526,  0.8090,  0.6900,  0.0976,  0.7922,  0.6494,
         0.5977,  0.7644,  0.1064,  0.7838,  0.5536,  0.1575,  0.8328,
         0.4068,  0.3694,  0.3907,  0.1079,  0.8586,  0.7619,  0.1044,
         0.6429,  0.8689,  0.8326,  0.2185,  0.2276,  0.2227,  0.1356,
         0.2668,  0.4568,  0.1943,  0.8538,  0.1365,  0.6072,  0.4406,
         0.1329,  0.6032,  0.7695,  0.0207,  0.9235,  0.1033,  0.7056,
         0.1243,  0.1104,  0.4115,  0.2302,  0.0289,  0.3030,  0.1944,
         0.4670,  0.7952,  0.5853,  0.2232,  0.8294,  0.8349,  0.4106,
         0.3236,  0.7573,  0.4016,  0.5406,  0.6093,  0.0919,  0.1423,
         0.2313,  0.0608,  0.8969,  0.0489,  0.7714,  0.7743,  0.3297,
         0.4485,  0.3237,  0.5427,  0.8266,  0.0358,  0.1856,  0.6235,
         0.0336,  0.0612,  0.1434,  0.0799,  0.0614,  0.1045,  0.7083,
         0.0722,  0.0803,  0.6885,  0.0825,  0.8109,  0.8639,  0.8248,
         0.1309,  0.0645,  0.2305,  0.1522,  0.0765,  0.7022,  0.9001,
         0.1409,  0.1164,  0.7626,  0.0892,  0.2042,  0.6782,  0.0578,
         0.5083,  0.1491,  0.5310,  0.3516,  0.2885,  0.0626,  0.5645,
         0.6334,  0.8260,  0.1732,  0.1146,  0.1559,  0.3113,  0.3892,
         0.3019,  0.9059,  0.8345,  0.8238,  0.1198,  0.1224,  0.1980,
         0.6815,  0.0769,  0.9515,  0.0915,  0.2310,  0.2644,  0.0933,
         0.1063,  0.2204,  0.4064,  0.2325,  0.2494,  0.5381,  0.7764,
         0.0919,  0.1076,  0.6021,  0.0655,  0.2098,  0.8015,  0.7817,
         0.8359,  0.7069,  0.8441,  0.6068,  0.3513,  0.1106,  0.2435,
         0.1719,  0.3918,  0.7006,  0.7243,  0.1285,  0.8746,  0.6330,
         0.4742,  0.4236,  0.1573,  0.0794,  0.1104,  0.8397,  0.0895,
         0.1469,  0.2633,  0.2032,  0.0639,  0.7067,  0.5367,  0.3805,
         0.4989,  0.3174,  0.6475,  0.1342,  0.5624,  0.1203,  0.3547,
         0.8139,  0.2633,  0.7827,  0.1108,  0.4980,  0.5656,  0.7951,
         0.6763,  0.1624,  0.4427,  0.6444,  0.4799,  0.0877,  0.8788,
         0.1699,  0.1547,  0.4271,  0.6573,  0.1465,  0.1071,  0.0523,
         0.2638,  0.1309,  0.1984,  0.8219,  0.1033,  0.1352,  0.2555,
         0.0764,  0.0338,  0.3304,  0.3220,  0.2123,  0.5671,  0.3012,
         0.2102,  0.5400,  0.3889,  0.8100,  0.4874,  0.8463,  0.0676,
         0.1629,  0.1315,  0.0804,  0.4567,  0.8899,  0.2662,  0.7284,
         0.0851,  0.1172,  0.6940,  0.1057,  0.3356,  0.3503,  0.2370,
         0.2637,  0.1661,  0.7428,  0.1843,  0.7691,  0.1597,  0.0510,
         0.6906,  0.5022,  0.7557,  0.6843,  0.8665,  0.4925,  0.7521,
         0.2758,  0.7754,  0.9807,  0.1603,  0.4918,  0.0236,  0.0685,
         0.2764,  0.0263,  0.1055,  0.8407,  0.6579,  0.2749,  0.8685,
         0.5098,  0.1699,  0.0711,  0.5235,  0.8188,  0.2621,  0.8346,
         0.0442,  0.4283,  0.8276,  0.8006,  0.7438,  0.6620,  0.0228,
         0.0652,  0.3123,  0.7195,  0.1678,  0.7607,  0.0819,  0.2135,
         0.0801,  0.1141,  0.1542,  0.8340,  0.6578,  0.5478,  0.8075,
         0.1635,  0.7927,  0.0916,  0.2924,  0.5006,  0.3370,  0.6331,
         0.5122,  0.3104,  0.2542,  0.8078,  0.4577,  0.8794,  0.8421,
         0.6831,  0.8016,  0.2951,  0.6081,  0.8994,  0.1336,  0.9738,
         0.0946,  0.2924,  0.6831,  0.8576,  0.0986,  0.7780,  0.8036,
         0.0962,  0.0655,  0.6554,  0.2951,  0.1589,  0.0626,  0.4212,
         0.0733,  0.1878,  0.0753,  0.3121,  0.0751,  0.6663,  0.0331,
         0.4114,  0.1706,  0.0733,  0.4117,  0.1547,  0.5245,  0.6903,
         0.8391,  0.1895,  0.7205,  0.4215,  0.2863,  0.0673,  0.5791,
         0.0970,  0.2294,  0.4913,  0.2110,  0.6572,  0.4812,  0.1021,
         0.1958,  0.7292,  0.1287,  0.1308,  0.8899,  0.4686,  0.2864,
         0.1902,  0.0832,  0.6032,  0.0709,  0.1989,  0.2519,  0.0734,
         0.6510,  0.7252,  0.0656,  0.4096,  0.0751,  0.0523,  0.1642,
         0.1412,  0.2388,  0.5960,  0.6720,  0.1254,  0.6642,  0.0672,
         0.1352,  0.0989,  0.7726,  0.8718,  0.8377,  0.1977,  0.7787,
         0.8922,  0.8107,  0.1480,  0.9877,  0.1583,  0.5690,  0.7066,
         0.2771,  0.6502,  0.0511,  0.4219,  0.5729,  0.1629,  0.2833,
         0.1891], device='cuda:0')
tensor(0.5361, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6167,  0.4675,  0.1215,  0.7004,  0.0281,  0.5777,  0.8506,
         0.4154,  0.2850,  0.1979,  0.4265,  0.2211,  0.6998,  0.0956,
         0.5239,  0.6909,  0.1669,  0.1732,  0.7210,  0.4096,  0.8239,
         0.2067,  0.2769,  0.7617,  0.0586,  0.7024,  0.1312,  0.1817,
         0.6506,  0.6766,  0.2989,  0.0799,  0.3425,  0.3768,  0.6479,
         0.7514,  0.1202,  0.5730,  0.2744,  0.4471,  0.7188,  0.4151,
         0.4887,  0.9005,  0.1114,  0.2422,  0.6376,  0.1990,  0.1073,
         0.1950,  0.1899,  0.2262,  0.7844,  0.1997,  0.5207,  0.5135,
         0.8543,  0.2440,  0.2465,  0.7923,  0.0597,  0.8148,  0.1279,
         0.9000,  0.1891,  0.6147,  0.1251,  0.8481,  0.1838,  0.8046,
         0.4984,  0.7304,  0.2452,  0.0864,  0.4932,  0.1924,  0.0672,
         0.8027,  0.2914,  0.2600,  0.5192,  0.8799,  0.5177,  0.2585,
         0.6446,  0.6903,  0.3798,  0.7335,  0.0317,  0.5649,  0.8921,
         0.8541,  0.7268,  0.1487,  0.7090,  0.4472,  0.8310,  0.3081,
         0.9361,  0.6525,  0.0807,  0.5472,  0.7062,  0.1002,  0.1482,
         0.1303,  0.8463,  0.1247,  0.3487,  0.2043,  0.0734,  0.8107,
         0.2862,  0.2478,  0.1432,  0.8125,  0.9100,  0.1269,  0.8024,
         0.2600,  0.6340,  0.5881,  0.8033,  0.1240,  0.0885,  0.8893,
         0.0620,  0.2206,  0.7113,  0.2159,  0.1625,  0.3392,  0.6989,
         0.5151,  0.4696,  0.2940,  0.2074,  0.0758,  0.1181,  0.7795,
         0.8604,  0.2048,  0.2231,  0.2470,  0.1298,  0.1402,  0.1707,
         0.1056,  0.1661,  0.0731,  0.8943,  0.2129,  0.0427,  0.6243,
         0.9495,  0.1476,  0.2578,  0.3292,  0.3236,  0.3688,  0.3141,
         0.2085,  0.0528,  0.3014,  0.7914,  0.2870,  0.1888,  0.8525,
         0.1932,  0.3848,  0.8425,  0.1005,  0.0668,  0.0546,  0.1656,
         0.0845,  0.0530,  0.4452,  0.6762,  0.8556,  0.3729,  0.6971,
         0.8231,  0.2764,  0.1709,  0.5506,  0.7183,  0.2000,  0.1765,
         0.3659,  0.7180,  0.9245,  0.1752,  0.3187,  0.2647,  0.0987,
         0.7205,  0.7395,  0.5642,  0.1722,  0.1222,  0.8935,  0.9446,
         0.2193,  0.3499,  0.1622,  0.8461,  0.1676,  0.7636,  0.9244,
         0.1419,  0.6856,  0.3007,  0.7883,  0.5115,  0.6963,  0.4124,
         0.0730,  0.2832,  0.2844,  0.2151,  0.8356,  0.1167,  0.1099,
         0.3627,  0.6774,  0.1002,  0.3893,  0.0811,  0.9926,  0.0660,
         0.2805,  0.7079,  0.9915,  0.2234,  0.4012,  0.2552,  0.2117,
         0.7492,  0.6136,  0.1368,  0.9023,  0.0727,  0.1486,  0.4875,
         0.3842,  0.6314,  0.3046,  0.5157,  0.6360,  0.7800,  0.1537,
         0.3676,  0.5263,  0.9651,  0.8432,  0.1307,  0.8517,  0.2121,
         0.1575,  0.8480,  0.9619,  0.3580,  0.5763,  0.7712,  0.0694,
         0.7622,  0.1864,  0.1104,  0.2006,  0.3780,  0.7491,  0.8742,
         0.0690,  0.7815,  0.4011,  0.3806,  0.3588,  0.0972,  0.7753,
         0.6465,  0.1157,  0.8465,  0.2944,  0.6852,  0.7603,  0.6092,
         0.2551,  0.2613,  0.8001,  0.1758,  0.6098,  0.1772,  0.1532,
         0.7925,  0.2375,  0.2838,  0.3224,  0.8477,  0.2312,  0.8439,
         0.5507,  0.0752,  0.7871,  0.1616,  0.4680,  0.2803,  0.4549,
         0.6912,  0.1494,  0.3169,  0.0960,  0.1745,  0.8554,  0.7662,
         0.7752,  0.5316,  0.9893,  0.8160,  0.6402,  0.1127,  0.1760,
         0.3832,  0.8766,  0.0631,  0.7406,  0.4848,  0.4312,  0.8197,
         0.1373,  0.8353,  0.1224,  0.1061,  0.6949,  0.3237,  0.0560,
         0.6240,  0.7545,  0.0303,  0.3524,  0.0375,  0.5991,  0.4143,
         0.1450,  0.7817,  0.8778,  0.9792,  0.0999,  0.8901,  0.1756,
         0.7212,  0.1442,  0.4152,  0.2138,  0.2267,  0.1143,  0.1831,
         0.8441,  0.8468,  0.2948,  0.3238,  0.1010,  0.1222,  0.1487,
         0.0779,  0.6517,  0.8615,  0.1567,  0.9538,  0.1909,  0.6006,
         0.4183,  0.2648,  0.5658,  0.0815,  0.1731,  0.1305,  0.1100,
         0.6656,  0.0357,  0.8134,  0.9415,  0.7889,  0.1721,  0.9456,
         0.8167,  0.2481,  0.0834,  0.1079,  0.5803,  0.7706,  0.2903,
         0.0747,  0.0590,  0.1542,  0.4682,  0.9323,  0.7654,  0.1151,
         0.5167,  0.3991,  0.3776,  0.5950,  0.6005,  0.9077,  0.7789,
         0.8000,  0.8296,  0.4925,  0.6575,  0.6445,  0.4838,  0.8234,
         0.9173,  0.8195,  0.0774,  0.9542,  0.5536,  0.8876,  0.2003,
         0.6263,  0.3054,  0.3573,  0.4946,  0.5692,  0.6131,  0.3352,
         0.8130,  0.0971,  0.1772,  0.0584,  0.6038,  0.2398,  0.0880,
         0.5367,  0.8163,  0.0759,  0.6808,  0.7763,  0.4751,  0.6915,
         0.3218,  0.3968,  0.7331,  0.7363,  0.0671,  0.2173,  0.6077,
         0.1904,  0.1161,  0.3464,  0.7621,  0.0673,  0.1741,  0.3106,
         0.7576,  0.7761,  0.2018,  0.0860,  0.0977,  0.1231,  0.7587,
         0.8294,  0.8941,  0.2495,  0.7921,  0.0950,  0.0579,  0.7672,
         0.8810,  0.5715,  0.6143,  0.0837,  0.1416,  0.0723,  0.6896,
         0.3956,  0.1304,  0.4396,  0.5443,  0.0773,  0.2639,  0.4873,
         0.7057,  0.7418,  0.2021,  0.3271,  0.8231,  0.4939,  0.1995,
         0.5434,  0.5905,  0.1314,  0.9714,  0.5285,  0.8366,  0.3169,
         0.1978,  0.2100,  0.1703,  0.2222,  0.1259,  0.1493,  0.7207,
         0.7982,  0.2016,  0.0815,  0.2200,  0.8670,  0.6596,  0.1635,
         0.4678], device='cuda:0')
tensor(0.4782, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5151,  0.1498,  0.9712,  0.4029,  0.3064,  0.8104,  0.8602,
         0.0553,  0.7293,  0.3410,  0.4033,  0.1776,  0.9580,  0.5811,
         0.8352,  0.2911,  0.2001,  0.1363,  0.6385,  0.1703,  0.7934,
         0.6366,  0.8751,  0.1763,  0.5501,  0.0807,  0.4878,  0.1033,
         0.3226,  0.5026,  0.1544,  0.2546,  0.2304,  0.8807,  0.0548,
         0.2284,  0.0457,  0.3638,  0.3756,  0.7783,  0.2172,  0.2051,
         0.0783,  0.7311,  0.4982,  0.1416,  0.0745,  0.2410,  0.2095,
         0.6417,  0.1223,  0.3789,  0.5510,  0.1407,  0.3518,  0.5472,
         0.1723,  0.5789,  0.1208,  0.5085,  0.2213,  0.6953,  0.9177,
         0.7968,  0.1453,  0.6994,  0.2462,  0.7299,  0.5875,  0.4952,
         0.1136,  0.4357,  0.8824,  0.1090,  0.6731,  0.7774,  0.4205,
         0.4500,  0.6539,  0.2942,  0.3854,  0.2670,  0.5857,  0.2419,
         0.5598,  0.1690,  0.0971,  0.7075,  0.4088,  0.8513,  0.8332,
         0.5261,  0.6386,  0.9919,  0.9709,  0.5257,  0.6160,  0.5105,
         0.2342,  0.7604,  0.0817,  0.0886,  0.8220,  0.2813,  0.3012,
         0.7477,  0.1042,  0.8166,  0.0935,  0.1860,  0.1981,  0.7263,
         0.1831,  0.8559,  0.6402,  0.2536,  0.1761,  0.5041,  0.6767,
         0.5939,  0.1846,  0.2196,  0.8995,  0.4731,  0.8402,  0.1142,
         0.1758,  0.0490,  0.5760,  0.2767,  0.7360,  0.1280,  0.3570,
         0.8465,  0.4091,  0.1522,  0.8622,  0.4982,  0.7954,  0.1193,
         0.2860,  0.0614,  0.6106,  0.7341,  0.1235,  0.4146,  0.4129,
         0.2476,  0.3895,  0.8574,  0.1839,  0.7525,  0.6517,  0.1743,
         0.1543,  0.4387,  0.9102,  0.8619,  0.2543,  0.4547,  0.7994,
         0.2330,  0.5747,  0.7794,  0.8096,  0.1143,  0.9401,  0.3231,
         0.6718,  0.2344,  0.6152,  0.5941,  0.2719,  0.4360,  0.4827,
         0.5745,  0.6825,  0.8720,  0.5273,  0.1752,  0.1513,  0.3387,
         0.4553,  0.3977,  0.7816,  0.5489,  0.6502,  0.8218,  0.7805,
         0.6631,  0.1597,  0.6791,  0.2139,  0.4699,  0.2578,  0.1756,
         0.1593,  0.4066,  0.1175,  0.3910,  0.8842,  0.3212,  0.4126,
         0.8969,  0.2619,  0.3741,  0.5784,  0.7724,  0.3850,  0.2233,
         0.7301,  0.7648,  0.6964,  0.1521,  0.1566,  0.8944,  0.5829,
         0.6402,  0.4456,  0.5456,  0.1222,  0.4695,  0.2787,  0.5820,
         0.7486,  0.7141,  0.2924,  0.7576,  0.9824,  0.8653,  0.8096,
         0.1225,  0.5231,  0.7697,  0.4383,  0.8182,  0.3133,  0.4245,
         0.2103,  0.8071,  0.3191,  0.8024,  0.7159,  0.4043,  0.3756,
         0.5711,  0.8594,  0.5870,  0.7808,  0.6476,  0.9328,  0.3285,
         0.0597,  0.5803,  0.2663,  0.6280,  0.4470,  0.5869,  0.0791,
         0.8758,  0.1577,  0.4002,  0.6699,  0.4246,  0.2242,  0.1935,
         0.8635,  0.1078,  0.7318,  0.4835,  0.1275,  0.7006,  0.1339,
         0.2740,  0.7811,  0.3460,  0.5447,  0.2918,  0.3045,  0.2501,
         0.6782,  0.9699,  0.5269,  0.3601,  0.6554,  0.8177,  0.0964,
         0.1541,  0.2788,  0.3422,  0.0925,  0.1601,  0.5166,  0.7009,
         0.4967,  0.4884,  0.8343,  0.2587,  0.9247,  0.4882,  0.8002,
         0.1688,  0.2794,  0.4790,  0.1650,  0.0466,  0.8508,  0.1160,
         0.9926,  0.2120,  0.4110,  0.9403,  0.3110,  0.3649,  0.3584,
         0.2949,  0.4569,  0.1927,  0.8987,  0.6836,  0.6633,  0.8159,
         0.2376,  0.8819,  0.5289,  0.2893,  0.1873,  0.3782,  0.2783,
         0.9448,  0.0692,  0.2316,  0.2643,  0.6267,  0.0977,  0.2692,
         0.0857,  0.0988,  0.6236,  0.5357,  0.7753,  0.2868,  0.9906,
         0.2015,  0.9807,  0.7777,  0.2596,  0.0637,  0.1249,  0.1895,
         0.1729,  0.6977,  0.1902,  0.1526,  0.4262,  0.4812,  0.7261,
         0.7205,  0.3945,  0.4955,  0.3917,  0.6743,  0.1355,  0.1005,
         0.5883,  0.2192,  0.6256,  0.7512,  0.1401,  0.5294,  0.1111,
         0.6575,  0.0957,  0.2157,  0.8536,  0.2633,  0.8712,  0.6689,
         0.9042,  0.5659,  0.1446,  0.2283,  0.4944,  0.6664,  0.1205,
         0.5894,  0.4714,  0.1539,  0.2330,  0.2719,  0.2665,  0.6449,
         0.7185,  0.6373,  0.7459,  0.0514,  0.2770,  0.1997,  0.9105,
         0.2187,  0.8477,  0.6848,  0.7003,  0.3337,  0.1199,  0.7124,
         0.1442,  0.5637,  0.1247,  0.6820,  0.6811,  0.8411,  0.9432,
         0.7186,  0.1389,  0.5233,  0.3804,  0.7774,  0.1211,  0.1188,
         0.7166,  0.3810,  0.0373,  0.8462,  0.6509,  0.1017,  0.9440,
         0.5958,  0.0395,  0.8335,  0.8348,  0.1507,  0.1364,  0.6961,
         0.6966,  0.2715,  0.7359,  0.1906,  0.4332,  0.4106,  0.3057,
         0.8196,  0.5123,  0.7433,  0.3812,  0.1355,  0.3184,  0.0759,
         0.2125,  0.5954,  0.1706,  0.7694,  0.2784,  0.7733,  0.2432,
         0.6041,  0.6592,  0.7424,  0.9450,  0.3715,  0.0395,  0.7940,
         0.0983,  0.4554,  0.5168,  0.6701,  0.2103,  0.5575,  0.8017,
         0.4301,  0.1174,  0.9155,  0.0706,  0.2335,  0.5503,  0.2847,
         0.1497,  0.7333,  0.3205,  0.6465,  0.9363,  0.1879,  0.6676,
         0.7392,  0.4899,  0.3420,  0.7318,  0.0268,  0.1739,  0.9235,
         0.8194,  0.9484,  0.5122,  0.0758,  0.4914,  0.4952,  0.8305,
         0.4175,  0.1376,  0.2324,  0.5308,  0.2944,  0.4645,  0.7455,
         0.9479,  0.4623,  0.6355,  0.8593,  0.3288,  0.2487,  0.8720,
         0.4745], device='cuda:0')
tensor(0.4847, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7847,  0.7424,  0.7250,  0.8502,  0.5555,  0.7246,  0.8920,
         0.1782,  0.7342,  0.9203,  0.8685,  0.6403,  0.2317,  0.5171,
         0.4464,  0.4378,  0.4862,  0.9940,  0.2950,  0.2271,  0.0600,
         0.7795,  0.1826,  0.5419,  0.5008,  0.3721,  0.2970,  0.8724,
         0.8809,  0.6268,  0.3985,  0.1706,  0.7979,  0.2668,  0.7997,
         0.8228,  0.1974,  0.2624,  0.1398,  0.4796,  0.8454,  0.1947,
         0.6360,  0.4031,  0.4330,  0.2805,  0.7200,  0.4718,  0.9636,
         0.1869,  0.8421,  0.8594,  0.1378,  0.2463,  0.2977,  0.8167,
         0.8165,  0.8849,  0.3161,  0.4539,  0.2778,  0.7380,  0.1606,
         0.8292,  0.5517,  0.3996,  0.1216,  0.6286,  0.4989,  0.8046,
         0.8457,  0.9783,  0.8277,  0.2399,  0.6420,  0.4333,  0.3344,
         0.6503,  0.8662,  0.5714,  0.7087,  0.2309,  0.5912,  0.8680,
         0.6272,  0.1960,  0.8210,  0.1726,  0.3356,  0.4940,  0.1762,
         0.1288,  0.9109,  0.1928,  0.9516,  0.5208,  0.8620,  0.4862,
         0.5775,  0.5101,  0.6995,  0.1891,  0.6861,  0.2535,  0.7673,
         0.2409,  0.3704,  0.5075,  0.4848,  0.6665,  0.3119,  0.8639,
         0.1900,  0.2683,  0.2225,  0.7780,  0.4365,  0.7209,  0.7356,
         0.1079,  0.6878,  0.4789,  0.8016,  0.2369,  0.5964,  0.6137,
         0.7485,  0.7550,  0.3427,  0.2444,  0.9385,  0.1141,  0.5103,
         0.5555,  0.5917,  0.4235,  0.5716,  0.8802,  0.8517,  0.8554,
         0.7164,  0.6895,  0.3822,  0.2454,  0.1507,  0.2275,  0.8686,
         0.7414,  0.5173,  0.3621,  0.9675,  0.9540,  0.9617,  0.7237,
         0.2479,  0.7566,  0.7990,  0.4850,  0.5136,  0.3777,  0.8260,
         0.4097,  0.2013,  0.7227,  0.1612,  0.3130,  0.2629,  0.0687,
         0.5917,  0.7843,  0.5039,  0.7785,  0.4873,  0.5263,  0.7479,
         0.2519,  0.2481,  0.8480,  0.4599,  0.8168,  0.8506,  0.2556,
         0.4346,  0.8249,  0.3216,  0.4363,  0.3045,  0.5384,  0.8594,
         0.4120,  0.3261,  0.6807,  0.5084,  0.4558,  0.5967,  0.8106,
         0.1999,  0.8055,  0.4993,  0.1302,  0.6985,  0.2971,  0.6568,
         0.4840,  0.5602,  0.9765,  0.3568,  0.5458,  0.8203,  0.2715,
         0.1770,  0.9699,  0.3318,  0.7902,  0.6904,  0.0591,  0.1779,
         0.2957,  0.9404,  0.2510,  0.3098,  0.1580,  0.6081,  0.1105,
         0.9466,  0.8210,  0.9252,  0.7089,  0.1664,  0.6834,  0.2320,
         0.9317,  0.7177,  0.7732,  0.2471,  0.8441,  0.4083,  0.2460,
         0.1289,  0.8365,  0.1638,  0.5927,  0.2133,  0.5072,  0.7073,
         0.7398,  0.0878,  0.2736,  0.8992,  0.8369,  0.3226,  0.3786,
         0.7234,  0.9768,  0.4628,  0.2217,  0.7043,  0.0926,  0.5061,
         0.3143,  0.5661,  0.1496,  0.3015,  0.7865,  0.2469,  0.8721,
         0.0557,  0.8420,  0.7966,  0.2396,  0.2327,  0.2494,  0.4226,
         0.7340,  0.4889,  0.7920,  0.7340,  0.7829,  0.7529,  0.1621,
         0.2953,  0.0432,  0.7832,  0.1873,  0.6031,  0.8632,  0.9321,
         0.2434,  0.8459,  0.2059,  0.6049,  0.0673,  0.7463,  0.4693,
         0.7059,  0.3698,  0.6444,  0.8067,  0.6552,  0.3156,  0.3952,
         0.5744,  0.5191,  0.6990,  0.4664,  0.9380,  0.0694,  0.1874,
         0.1875,  0.7888,  0.6817,  0.6675,  0.5117,  0.2453,  0.6999,
         0.2897,  0.7463,  0.6605,  0.3485,  0.3327,  0.7176,  0.2582,
         0.8613,  0.1399,  0.4638,  0.8288,  0.7847,  0.5484,  0.6217,
         0.8348,  0.6676,  0.3602,  0.2448,  0.8776,  0.1618,  0.3294,
         0.6840,  0.2918,  0.3985,  0.8229,  0.5942,  0.6857,  0.2545,
         0.1229,  0.3776,  0.5982,  0.8977,  0.2060,  0.6032,  0.5288,
         0.3941,  0.3140,  0.7137,  0.7432,  0.0892,  0.8826,  0.7392,
         0.2129,  0.9056,  0.4835,  0.6291,  0.9717,  0.2989,  0.6798,
         0.4550,  0.6461,  0.6165,  0.3876,  0.7431,  0.2299,  0.8362,
         0.3379,  0.2612,  0.3122,  0.2107,  0.5488,  0.3025,  0.5425,
         0.8348,  0.6160,  0.5991,  0.2890,  0.6257,  0.5504,  0.5309,
         0.6475,  0.8697,  0.8373,  0.0766,  0.2994,  0.9317,  0.0817,
         0.7936,  0.8361,  0.6559,  0.7793,  0.1730,  0.2907,  0.5392,
         0.2118,  0.6200,  0.1654,  0.1487,  0.4578,  0.2887,  0.7904,
         0.5851,  0.7970,  0.1321,  0.6272,  0.3464,  0.3955,  0.2862,
         0.6389,  0.3970,  0.4509,  0.2421,  0.4677,  0.1279,  0.8545,
         0.3636,  0.2284,  0.1910,  0.6549,  0.6162,  0.2596,  0.0694,
         0.2980,  0.6693,  0.4148,  0.6724,  0.3111,  0.2830,  0.4808,
         0.8074,  0.9328,  0.5780,  0.0568,  0.1375,  0.7090,  0.3480,
         0.2249,  0.8891,  0.3856,  0.4769,  0.4048,  0.4259,  0.3358,
         0.6210,  0.6425,  0.2186,  0.1178,  0.0504,  0.3803,  0.4280,
         0.7748,  0.2116,  0.3253,  0.7339,  0.1621,  0.8840,  0.1455,
         0.0251,  0.7307,  0.4426,  0.8804,  0.5390,  0.2843,  0.5671,
         0.6038,  0.7582,  0.5230,  0.2991,  0.4473,  0.8218,  0.4929,
         0.1446,  0.8105,  0.4556,  0.7646,  0.7657,  0.7638,  0.8726,
         0.8733,  0.7435,  0.4283,  0.8876,  0.6560,  0.3811,  0.5938,
         0.6312,  0.6288,  0.5678,  0.4928,  0.2784,  0.4000,  0.4302,
         0.9157,  0.6965,  0.3834,  0.7423,  0.3698,  0.4430,  0.7234,
         0.7859,  0.5832,  0.8287,  0.3275,  0.4303,  0.5016,  0.8317,
         0.3197], device='cuda:0')
tensor(0.4988, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8241,  0.4182,  0.5645,  0.8285,  0.7793,  0.3121,  0.2788,
         0.2055,  0.6712,  0.7121,  0.4834,  0.3929,  0.2907,  0.6776,
         0.8152,  0.8834,  0.8451,  0.3963,  0.2317,  0.7997,  0.7047,
         0.2389,  0.3720,  0.5598,  0.1366,  0.5108,  0.5966,  0.5917,
         0.8690,  0.6779,  0.6504,  0.5491,  0.7825,  0.7529,  0.2959,
         0.6199,  0.7422,  0.7473,  0.6135,  0.7784,  0.8826,  0.3183,
         0.7250,  0.4843,  0.4288,  0.3841,  0.3326,  0.7245,  0.4418,
         0.2922,  0.6401,  0.6189,  0.2651,  0.5742,  0.0927,  0.3422,
         0.8788,  0.7071,  0.3980,  0.1451,  0.8708,  0.7926,  0.6787,
         0.3848,  0.6319,  0.7866,  0.5892,  0.2995,  0.7403,  0.5487,
         0.4501,  0.7992,  0.6401,  0.5508,  0.8848,  0.4908,  0.5202,
         0.8260,  0.1344,  0.4068,  0.7010,  0.3010,  0.3887,  0.3169,
         0.1150,  0.7440,  0.7633,  0.5364,  0.3553,  0.8116,  0.7912,
         0.6090,  0.9053,  0.7484,  0.8237,  0.2230,  0.7175,  0.1535,
         0.8065,  0.2274,  0.2514,  0.2878,  0.5474,  0.4599,  0.5160,
         0.5979,  0.7005,  0.2888,  0.4361,  0.2019,  0.3837,  0.9318,
         0.4243,  0.7160,  0.7290,  0.9036,  0.5922,  0.1994,  0.4177,
         0.6990,  0.5093,  0.8808,  0.8224,  0.3308,  0.1994,  0.9928,
         0.3266,  0.5095,  0.7750,  0.0582,  0.9338,  0.5767,  0.7002,
         0.4105,  0.5777,  0.8493,  0.7214,  0.4777,  0.2864,  0.6381,
         0.8230,  0.8344,  0.3910,  0.4112,  0.8142,  0.7829,  0.7145,
         0.8053,  0.4988,  0.6006,  0.1968,  0.4402,  0.3343,  0.8857,
         0.7460,  0.7874,  0.1253,  0.8359,  0.8442,  0.4279,  0.3992,
         0.8630,  0.1638,  0.7702,  0.8999,  0.7893,  0.9061,  0.8536,
         0.2338,  0.7842,  0.4597,  0.3810,  0.8944,  0.9395,  0.4650,
         0.3665,  0.5333,  0.2082,  0.7648,  0.8633,  0.7148,  0.8603,
         0.6123,  0.6661,  0.4672,  0.6805,  0.7574,  0.4980,  0.2386,
         0.6919,  0.3807,  0.5356,  0.7736,  0.1810,  0.8146,  0.7124,
         0.1569,  0.4097,  0.5714,  0.6822,  0.4905,  0.7325,  0.8281,
         0.6816,  0.9714,  0.6611,  0.7642,  0.2589,  0.7641,  0.4251,
         0.8361,  0.7873,  0.7920,  0.6061,  0.8663,  0.6476,  0.5511,
         0.7958,  0.3209,  0.8522,  0.5159,  0.1598,  0.7811,  0.1814,
         0.4397,  0.1936,  0.5055,  0.2697,  0.7859,  0.5479,  0.8087,
         0.2286,  0.7468,  0.9826,  0.4188,  0.8815,  0.6041,  0.0803,
         0.8124,  0.5021,  0.8225,  0.7747,  0.8707,  0.9407,  0.6303,
         0.4272,  0.6501,  0.3273,  0.7645,  0.9898,  0.7538,  0.7018,
         0.2601,  0.7956,  0.4901,  0.4251,  0.1339,  0.5501,  0.7831,
         0.7124,  0.3229,  0.5110,  0.2200,  0.8319,  0.5416,  0.1433,
         0.6984,  0.2907,  0.2163,  0.6848,  0.2679,  0.1581,  0.2306,
         0.8047,  0.7017,  0.7827,  0.5345,  0.6492,  0.9071,  0.4983,
         0.3154,  0.3467,  0.1018,  0.5350,  0.8879,  0.8469,  0.4119,
         0.3863,  0.8047,  0.3351,  0.5755,  0.8250,  0.3691,  0.4235,
         0.4980,  0.2691,  0.2639,  0.4231,  0.6049,  0.2344,  0.2052,
         0.6528,  0.5933,  0.3923,  0.3499,  0.8340,  0.6051,  0.8356,
         0.6039,  0.7794,  0.8862,  0.8473,  0.5403,  0.2263,  0.6536,
         0.0745,  0.4820,  0.6029,  0.2599,  0.8233,  0.8344,  0.2755,
         0.2956,  0.0893,  0.7965,  0.4196,  0.4309,  0.7548,  0.4435,
         0.5711,  0.9418,  0.4057,  0.1305,  0.5396,  0.7008,  0.8313,
         0.0329,  0.3176,  0.7295,  0.5104,  0.9408,  0.7272,  0.3959,
         0.8088,  0.8302,  0.6520,  0.3871,  0.1621,  0.6417,  0.7995,
         0.9028,  0.8311,  0.8768,  0.7462,  0.3848,  0.3521,  0.3427,
         0.6978,  0.8962,  0.6373,  0.1870,  0.3032,  0.8601,  0.0278,
         0.3407,  0.7114,  0.4553,  0.2207,  0.7727,  0.7831,  0.6065,
         0.8122,  0.6435,  0.3501,  0.8813,  0.3216,  0.7120,  0.3804,
         0.6458,  0.7433,  0.3455,  0.0858,  0.6362,  0.5259,  0.3492,
         0.8326,  0.9840,  0.1820,  0.3727,  0.4254,  0.1719,  0.1469,
         0.1401,  0.2852,  0.3779,  0.8137,  0.2008,  0.2909,  0.4694,
         0.6828,  0.8803,  0.3292,  0.8070,  0.5020,  0.5874,  0.2917,
         0.6839,  0.6475,  0.5493,  0.3697,  0.9489,  0.1731,  0.2696,
         0.2625,  0.7459,  0.7302,  0.4530,  0.2832,  0.1732,  0.0772,
         0.6988,  0.2845,  0.5676,  0.4567,  0.7450,  0.5118,  0.5954,
         0.1298,  0.5100,  0.4371,  0.1727,  0.2995,  0.4326,  0.7289,
         0.4731,  0.5716,  0.7252,  0.2818,  0.9612,  0.5880,  0.8327,
         0.1123,  0.2093,  0.8945,  0.6372,  0.8290,  0.3748,  0.2828,
         0.8531,  0.4574,  0.8409,  0.1966,  0.1813,  0.8365,  0.7741,
         0.9518,  0.1483,  0.2193,  0.3792,  0.6367,  0.4166,  0.5901,
         0.1192,  0.1487,  0.3077,  0.6634,  0.7083,  0.7013,  0.8636,
         0.6268,  0.1781,  0.3764,  0.7456,  0.6898,  0.1541,  0.7624,
         0.8260,  0.9723,  0.8514,  0.3299,  0.2083,  0.2221,  0.4079,
         0.7545,  0.7332,  0.4008,  0.5426,  0.8617,  0.2079,  0.9234,
         0.8971,  0.8245,  0.1003,  0.8336,  0.2824,  0.3892,  0.5745,
         0.8203,  0.8613,  0.2752,  0.9041,  0.3753,  0.9069,  0.8362,
         0.6072,  0.4872,  0.3161,  0.4091,  0.7272,  0.0869,  0.2275,
         0.7860], device='cuda:0')
tensor(0.5041, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1193,  0.2726,  0.2475,  0.3181,  0.5077,  0.8458,  0.7255,
         0.8519,  0.9028,  0.1002,  0.1558,  0.6035,  0.4943,  0.0843,
         0.7562,  0.9125,  0.2062,  0.8498,  0.6719,  0.7349,  0.2429,
         0.2452,  0.8108,  0.2435,  0.9793,  0.7354,  0.3761,  0.7183,
         0.7585,  0.8060,  0.5764,  0.3747,  0.4569,  0.2490,  0.8235,
         0.9550,  0.8063,  0.3377,  0.1524,  0.6827,  0.8155,  0.1898,
         0.8223,  0.6084,  0.7570,  0.6285,  0.6318,  0.9637,  0.7548,
         0.1728,  0.0866,  0.1268,  0.3043,  0.7185,  0.7366,  0.1723,
         0.6660,  0.6590,  0.0850,  0.5023,  0.1051,  0.7526,  0.3465,
         0.3013,  0.1320,  0.2245,  0.7931,  0.2912,  0.7600,  0.2865,
         0.3281,  0.0855,  0.4403,  0.9383,  0.9231,  0.1164,  0.7592,
         0.6454,  0.7491,  0.7555,  0.8102,  0.7404,  0.6142,  0.7386,
         0.8381,  0.9285,  0.1595,  0.3693,  0.5735,  0.1019,  0.2733,
         0.5915,  0.8450,  0.5365,  0.6715,  0.3054,  0.6203,  0.7425,
         0.8720,  0.5419,  0.0290,  0.1921,  0.2799,  0.2505,  0.2084,
         0.6862,  0.8147,  0.6847,  0.6988,  0.6212,  0.8045,  0.3374,
         0.6739,  0.2654,  0.5938,  0.4991,  0.5625,  0.7830,  0.3682,
         0.3772,  0.8712,  0.2877,  0.8278,  0.6136,  0.2810,  0.7966,
         0.6784,  0.6246,  0.0765,  0.5353,  0.5703,  0.9167,  0.3889,
         0.3809,  0.8867,  0.9428,  0.2259,  0.7365,  0.7773,  0.5838,
         0.2966,  0.7104,  0.6821,  0.6515,  0.8386,  0.2004,  0.1649,
         0.4517,  0.7039,  0.2835,  0.6666,  0.2771,  0.2926,  0.8448,
         0.1309,  0.8999,  0.2890,  0.3317,  0.9605,  0.7916,  0.5831,
         0.5423,  0.3698,  0.9273,  0.7095,  0.5531,  0.2319,  0.1234,
         0.6514,  0.9105,  0.4978,  0.7877,  0.6610,  0.3399,  0.4174,
         0.8142,  0.8632,  0.2403,  0.7301,  0.3722,  0.7505,  0.8837,
         0.6394,  0.6311,  0.4468,  0.5889,  0.5457,  0.8387,  0.8374,
         0.6433,  0.5671,  0.6761,  0.7674,  0.6053,  0.8391,  0.8016,
         0.6939,  0.4289,  0.6903,  0.9659,  0.2773,  0.9174,  0.1457,
         0.4499,  0.7050,  0.7362,  0.8704,  0.4162,  0.2621,  0.2424,
         0.8580,  0.8629,  0.8700,  0.8814,  0.5882,  0.8428,  0.7135,
         0.8051,  0.5690,  0.3235,  0.4862,  0.5921,  0.7574,  0.1626,
         0.8036,  0.8351,  0.8907,  0.6206,  0.6858,  0.9837,  0.9207,
         0.7084,  0.2738,  0.9063,  0.7853,  0.6959,  0.4997,  0.1521,
         0.7694,  0.2766,  0.9702,  0.6533,  0.3318,  0.4236,  0.6021,
         0.7630,  0.4509,  0.6208,  0.3329,  0.1358,  0.6815,  0.1813,
         0.2248,  0.8159,  0.2243,  0.4840,  0.8130,  0.8139,  0.5126,
         0.6850,  0.1342,  0.7778,  0.6953,  0.5569,  0.8518,  0.7360,
         0.6527,  0.7426,  0.5390,  0.3048,  0.7317,  0.8119,  0.5262,
         0.4205,  0.4180,  0.2616,  0.1339,  0.4624,  0.1405,  0.5343,
         0.2877,  0.6174,  0.6345,  0.1393,  0.2959,  0.7963,  0.1965,
         0.0405,  0.3111,  0.7395,  0.8930,  0.1348,  0.7372,  0.8795,
         0.5472,  0.6233,  0.7769,  0.8082,  0.2164,  0.1270,  0.8292,
         0.3797,  0.3870,  0.7709,  0.5559,  0.8807,  0.3774,  0.3190,
         0.8710,  0.3504,  0.8160,  0.7059,  0.7913,  0.2867,  0.6136,
         0.8713,  0.6845,  0.2640,  0.5111,  0.7602,  0.1037,  0.8868,
         0.9762,  0.4138,  0.8292,  0.7907,  0.8601,  0.8226,  0.9419,
         0.1223,  0.3772,  0.9284,  0.6817,  0.7796,  0.9029,  0.2996,
         0.8026,  0.7714,  0.3414,  0.3998,  0.2434,  0.4996,  0.2578,
         0.6199,  0.3963,  0.4274,  0.3204,  0.7299,  0.8857,  0.5305,
         0.7723,  0.8654,  0.1896,  0.5911,  0.7200,  0.3637,  0.6297,
         0.5192,  0.2117,  0.2591,  0.7341,  0.5295,  0.8707,  0.3418,
         0.3313,  0.1494,  0.8487,  0.7168,  0.6898,  0.6170,  0.8163,
         0.7988,  0.1206,  0.4620,  0.2101,  0.3642,  0.4665,  0.7323,
         0.0774,  0.7279,  0.0721,  0.3326,  0.7152,  0.3107,  0.5299,
         0.9357,  0.2553,  0.9286,  0.3807,  0.0680,  0.7384,  0.4487,
         0.5714,  0.1630,  0.3109,  0.3400,  0.1292,  0.9121,  0.5701,
         0.1370,  0.6631,  0.2759,  0.1947,  0.2474,  0.2117,  0.2041,
         0.2009,  0.6036,  0.1686,  0.7627,  0.8943,  0.7159,  0.8764,
         0.1206,  0.8812,  0.3983,  0.5460,  0.8661,  0.5269,  0.1373,
         0.1822,  0.3246,  0.5317,  0.9232,  0.4882,  0.8553,  0.1494,
         0.7557,  0.8832,  0.8540,  0.7249,  0.8439,  0.7686,  0.1679,
         0.8052,  0.5902,  0.6902,  0.6562,  0.7830,  0.6111,  0.4315,
         0.2023,  0.5328,  0.4882,  0.7224,  0.8437,  0.3427,  0.7813,
         0.8686,  0.7314,  0.4412,  0.1581,  0.6678,  0.7408,  0.9246,
         0.7243,  0.6727,  0.3880,  0.6913,  0.7014,  0.3403,  0.9064,
         0.5442,  0.4390,  0.7766,  0.6439,  0.2903,  0.3568,  0.9875,
         0.2739,  0.5261,  0.0835,  0.5853,  0.7988,  0.5524,  0.4913,
         0.8401,  0.2445,  0.5760,  0.4583,  0.7855,  0.6529,  0.3616,
         0.8890,  0.0627,  0.5328,  0.8336,  0.3428,  0.6400,  0.3119,
         0.7638,  0.4656,  0.7500,  0.8510,  0.4292,  0.4613,  0.5973,
         0.4583,  0.7155,  0.2120,  0.4332,  0.7886,  0.2884,  0.4313,
         0.6413,  0.6994,  0.6234,  0.7071,  0.7313,  0.8937,  0.1904,
         0.4157], device='cuda:0')
tensor(0.5105, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1475,  0.7783,  0.7406,  0.7781,  0.3644,  0.0611,  0.1567,
         0.7683,  0.7666,  0.4972,  0.4148,  0.4167,  0.6593,  0.3323,
         0.6461,  0.4782,  0.1967,  0.1419,  0.1746,  0.4357,  0.7489,
         0.2863,  0.9823,  0.8509,  0.1135,  0.2308,  0.1356,  0.3288,
         0.9260,  0.4455,  0.3035,  0.0628,  0.2696,  0.0256,  0.4865,
         0.8022,  0.4364,  0.7723,  0.8673,  0.8761,  0.4865,  0.2519,
         0.7510,  0.3644,  0.8243,  0.3705,  0.2633,  0.2520,  0.8198,
         0.4294,  0.8562,  0.5098,  0.3915,  0.7277,  0.4515,  0.8434,
         0.6916,  0.7306,  0.8511,  0.2265,  0.6056,  0.6552,  0.3632,
         0.8806,  0.7675,  0.8291,  0.9119,  0.7539,  0.1620,  0.8647,
         0.4815,  0.1540,  0.8479,  0.2040,  0.2157,  0.6620,  0.8512,
         0.6200,  0.8343,  0.0801,  0.0979,  0.8102,  0.8691,  0.8038,
         0.7498,  0.4639,  0.6634,  0.7448,  0.6124,  0.8652,  0.2439,
         0.8423,  0.7425,  0.1804,  0.7767,  0.3173,  0.3071,  0.9309,
         0.4103,  0.8143,  0.6712,  0.2960,  0.8555,  0.7168,  0.1894,
         0.8617,  0.8915,  0.7301,  0.1214,  0.8259,  0.0980,  0.6344,
         0.4808,  0.7960,  0.2069,  0.8115,  0.9112,  0.7450,  0.1096,
         0.6572,  0.2098,  0.7783,  0.2499,  0.9863,  0.8373,  0.8096,
         0.8332,  0.0771,  0.1789,  0.8322,  0.9716,  0.9294,  0.5322,
         0.3182,  0.4518,  0.2279,  0.8540,  0.3653,  0.2797,  0.7292,
         0.2543,  0.7806,  0.4518,  0.4687,  0.8437,  0.7160,  0.7329,
         0.4434,  0.5776,  0.0632,  0.1384,  0.9014,  0.8383,  0.1492,
         0.8239,  0.8580,  0.1956,  0.4203,  0.2347,  0.6982,  0.1738,
         0.2754,  0.7419,  0.4265,  0.0690,  0.8879,  0.2472,  0.4845,
         0.0829,  0.3439,  0.2391,  0.7182,  0.4895,  0.6075,  0.5296,
         0.5377,  0.6285,  0.4783,  0.8804,  0.8533,  0.3475,  0.2190,
         0.7597,  0.3040,  0.5719,  0.9330,  0.5865,  0.6756,  0.8201,
         0.8955,  0.6453,  0.1181,  0.6137,  0.5442,  0.7179,  0.2751,
         0.6010,  0.6146,  0.6210,  0.3048,  0.9424,  0.3720,  0.6269,
         0.9030,  0.6926,  0.6155,  0.9868,  0.4959,  0.7134,  0.6482,
         0.7553,  0.5388,  0.5445,  0.9203,  0.2914,  0.8585,  0.2433,
         0.3242,  0.1412,  0.9584,  0.9338,  0.2341,  0.9472,  0.4123,
         0.8713,  0.5501,  0.6784,  0.8174,  0.8651,  0.2046,  0.7070,
         0.0861,  0.5527,  0.7855,  0.4331,  0.5351,  0.0990,  0.7018,
         0.9908,  0.8751,  0.5681,  0.7817,  0.7691,  0.3057,  0.3653,
         0.4340,  0.8364,  0.6545,  0.7864,  0.3554,  0.5224,  0.2792,
         0.6248,  0.3907,  0.2021,  0.5591,  0.6252,  0.8682,  0.6620,
         0.6492,  0.2417,  0.8507,  0.9608,  0.9119,  0.2300,  0.8968,
         0.8765,  0.9356,  0.0946,  0.6822,  0.4562,  0.8035,  0.9710,
         0.6949,  0.9521,  0.4820,  0.5210,  0.7152,  0.3623,  0.1725,
         0.2983,  0.1542,  0.2621,  0.7567,  0.3476,  0.8842,  0.1698,
         0.5065,  0.8714,  0.5954,  0.6963,  0.7499,  0.4014,  0.6833,
         0.7951,  0.0874,  0.1916,  0.2295,  0.1299,  0.3654,  0.1467,
         0.1035,  0.1660,  0.5953,  0.8530,  0.7435,  0.4701,  0.4092,
         0.5942,  0.4703,  0.9424,  0.4857,  0.2800,  0.8699,  0.7594,
         0.2066,  0.0676,  0.4288,  0.7210,  0.1680,  0.7726,  0.7547,
         0.7076,  0.5977,  0.4135,  0.7365,  0.7404,  0.0502,  0.2092,
         0.8416,  0.9914,  0.7903,  0.6781,  0.7591,  0.7331,  0.7430,
         0.5980,  0.8836,  0.5805,  0.3666,  0.3972,  0.0387,  0.5864,
         0.7727,  0.2171,  0.0996,  0.8539,  0.8904,  0.6923,  0.3261,
         0.7721,  0.3081,  0.3471,  0.9036,  0.7568,  0.4369,  0.6641,
         0.7018,  0.8653,  0.8752,  0.2066,  0.3239,  0.7157,  0.6528,
         0.2286,  0.7533,  0.7912,  0.7508,  0.5490,  0.4012,  0.8001,
         0.6056,  0.1897,  0.6481,  0.5124,  0.9171,  0.4351,  0.6602,
         0.3957,  0.8215,  0.9673,  0.7074,  0.7953,  0.2675,  0.8757,
         0.8651,  0.6330,  0.6018,  0.1758,  0.2770,  0.7801,  0.5269,
         0.9416,  0.2185,  0.1171,  0.6645,  0.7370,  0.2245,  0.6880,
         0.3190,  0.1660,  0.3027,  0.9155,  0.3119,  0.2364,  0.1005,
         0.8772,  0.7892,  0.1493,  0.9579,  0.2515,  0.8062,  0.2626,
         0.4404,  0.1662,  0.1814,  0.2663,  0.0685,  0.3114,  0.6002,
         0.3630,  0.2312,  0.7368,  0.8927], device='cuda:0')
tensor(0.4969, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 3, BCELoss: 0.5329099273195073
tensor([ 0.4830,  0.9156,  0.2691,  0.8609,  0.7891,  0.2604,  0.0928,
         0.9828,  0.3975,  0.8239,  0.1449,  0.3604,  0.2883,  0.4925,
         0.1091,  0.6487,  0.3401,  0.2816,  0.4351,  0.1284,  0.4563,
         0.9248,  0.3807,  0.7930,  0.2947,  0.4957,  0.7817,  0.9706,
         0.7180,  0.4239,  0.9249,  0.9408,  0.6384,  0.6084,  0.2098,
         0.1601,  0.8543,  0.8016,  0.1388,  0.1720,  0.6433,  0.7774,
         0.0370,  0.1063,  0.8141,  0.4627,  0.5718,  0.7111,  0.8592,
         0.1582,  0.1728,  0.2191,  0.7009,  0.4207,  0.2578,  0.2435,
         0.7700,  0.6881,  0.7686,  0.9472,  0.2456,  0.7084,  0.7866,
         0.2161,  0.8542,  0.3397,  0.9275,  0.5240,  0.8579,  0.4294,
         0.1901,  0.8208,  0.2118,  0.1422,  0.9915,  0.9782,  0.1203,
         0.2904,  0.2646,  0.3831,  0.2072,  0.9165,  0.6871,  0.1048,
         0.7162,  0.7555,  0.0974,  0.7297,  0.7821,  0.4371,  0.2317,
         0.3719,  0.4535,  0.5732,  0.4196,  0.4920,  0.8715,  0.9346,
         0.2346,  0.3501,  0.7150,  0.2576,  0.5311,  0.8596,  0.6004,
         0.8654,  0.4320,  0.1731,  0.3168,  0.4226,  0.7817,  0.7655,
         0.6284,  0.5972,  0.7537,  0.2003,  0.2208,  0.9415,  0.7767,
         0.7734,  0.4970,  0.9641,  0.7350,  0.0944,  0.0455,  0.2733,
         0.8601,  0.4718,  0.6376,  0.2994,  0.8011,  0.4896,  0.5364,
         0.2450,  0.0673,  0.9481,  0.3241,  0.6029,  0.7916,  0.5306,
         0.2551,  0.3496,  0.8613,  0.7057,  0.2830,  0.3451,  0.2014,
         0.2736,  0.2016,  0.1081,  0.8085,  0.3829,  0.8694,  0.2611,
         0.3900,  0.3384,  0.9230,  0.6010,  0.2645,  0.4896,  0.8791,
         0.9085,  0.6482,  0.7227,  0.7257,  0.6500,  0.6131,  0.8119,
         0.8190,  0.1905,  0.6617,  0.8315,  0.7148,  0.8549,  0.1064,
         0.8753,  0.3445,  0.8664,  0.3473,  0.2140,  0.6803,  0.6956,
         0.9763,  0.9549,  0.8278,  0.1349,  0.8624,  0.9333,  0.5731,
         0.2043,  0.3476,  0.1942,  0.9118,  0.9087,  0.1793,  0.7339,
         0.9131,  0.7293,  0.2932,  0.3944,  0.5746,  0.3922,  0.8488,
         0.8343,  0.2518,  0.7847,  0.3670,  0.3097,  0.7675,  0.8444,
         0.3374,  0.6961,  0.0768,  0.4659,  0.2420,  0.5760,  0.9676,
         0.1576,  0.7136,  0.7804,  0.3639,  0.8798,  0.9485,  0.3084,
         0.0988,  0.8694,  0.3686,  0.8639,  0.5700,  0.8447,  0.9754,
         0.7688,  0.6468,  0.8114,  0.1223,  0.2454,  0.8598,  0.4599,
         0.7003,  0.1225,  0.3098,  0.8029,  0.4459,  0.6711,  0.7399,
         0.8496,  0.1268,  0.1074,  0.5523,  0.9257,  0.4054,  0.9322,
         0.2412,  0.1766,  0.8644,  0.1320,  0.6740,  0.7181,  0.7475,
         0.8172,  0.1500,  0.9189,  0.8515,  0.6735,  0.6898,  0.2782,
         0.9355,  0.1512,  0.8162,  0.2599,  0.2450,  0.1382,  0.1753,
         0.3836,  0.8656,  0.8403,  0.3856,  0.3309,  0.2684,  0.7671,
         0.7358,  0.1413,  0.8624,  0.7576,  0.3033,  0.1284,  0.6195,
         0.3731,  0.3830,  0.7954,  0.4552,  0.3925,  0.7697,  0.4503,
         0.8515,  0.1689,  0.9864,  0.5638,  0.6454,  0.2482,  0.7786,
         0.3111,  0.5805,  0.8982,  0.7830,  0.9444,  0.1340,  0.2137,
         0.5061,  0.7046,  0.6157,  0.5108,  0.9106,  0.7995,  0.4340,
         0.0871,  0.8815,  0.5268,  0.1237,  0.9712,  0.0810,  0.8179,
         0.7864,  0.5313,  0.1659,  0.8019,  0.7820,  0.2434,  0.1339,
         0.8808,  0.3352,  0.1485,  0.1014,  0.3042,  0.1017,  0.6413,
         0.0800,  0.1086,  0.3843,  0.6689,  0.6743,  0.5921,  0.3793,
         0.0805,  0.7500,  0.7650,  0.8822,  0.1075,  0.8681,  0.6307,
         0.3936,  0.7953,  0.8673,  0.7050,  0.2344,  0.2281,  0.7940,
         0.8200,  0.3633,  0.8734,  0.6096,  0.6037,  0.0480,  0.1021,
         0.0380,  0.1439,  0.9788,  0.2252,  0.3375,  0.2774,  0.1083,
         0.4337,  0.6134,  0.6120,  0.2995,  0.4659,  0.4524,  0.6769,
         0.5874,  0.8350,  0.7107,  0.4879,  0.7110,  0.6618,  0.9521,
         0.2289,  0.3596,  0.9890,  0.3151,  0.8340,  0.6345,  0.6139,
         0.1161,  0.1339,  0.7542,  0.7848,  0.6341,  0.2811,  0.7245,
         0.3254,  0.8123,  0.0901,  0.9035,  0.1888,  0.0705,  0.9662,
         0.3675,  0.2739,  0.3318,  0.8206,  0.1415,  0.8596,  0.1162,
         0.7540,  0.3355,  0.2979,  0.9025,  0.0702,  0.2114,  0.3810,
         0.9333,  0.8318,  0.6468,  0.6517,  0.9575,  0.1808,  0.5310,
         0.1459,  0.8175,  0.4082,  0.7418,  0.1918,  0.3095,  0.0618,
         0.3640,  0.7214,  0.8428,  0.7172,  0.2191,  0.7763,  0.8846,
         0.2913,  0.9333,  0.8845,  0.7836,  0.3919,  0.7588,  0.1224,
         0.1579,  0.7514,  0.7877,  0.7040,  0.4210,  0.4668,  0.1903,
         0.6034,  0.6286,  0.9808,  0.8605,  0.5130,  0.6281,  0.6680,
         0.8330,  0.6298,  0.1478,  0.1922,  0.5162,  0.7385,  0.3934,
         0.4890,  0.5468,  0.5320,  0.1967,  0.1459,  0.3779,  0.4100,
         0.4614,  0.3687,  0.7806,  0.9654,  0.6072,  0.6149,  0.1694,
         0.3143,  0.8818,  0.1588,  0.9040,  0.7595,  0.1909,  0.3682,
         0.7568,  0.8129,  0.2766,  0.8098,  0.5368,  0.4447,  0.1308,
         0.1242,  0.4534,  0.4784,  0.4296,  0.3112,  0.7952,  0.1170,
         0.7076,  0.6215,  0.8910,  0.3017,  0.8408,  0.7935,  0.8053,
         0.1578], device='cuda:0')
tensor(0.4858, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0726,  0.1237,  0.0929,  0.3327,  0.0953,  0.5630,  0.9320,
         0.8702,  0.9292,  0.1105,  0.5847,  0.1846,  0.8280,  0.7957,
         0.7648,  0.1377,  0.3036,  0.2262,  0.3411,  0.1618,  0.2905,
         0.8483,  0.8211,  0.8514,  0.1646,  0.3771,  0.7218,  0.7467,
         0.8180,  0.1848,  0.7984,  0.1333,  0.7929,  0.6450,  0.4468,
         0.3593,  0.9435,  0.0464,  0.8283,  0.6866,  0.7682,  0.1421,
         0.2659,  0.4280,  0.2399,  0.1950,  0.7387,  0.2223,  0.8068,
         0.1322,  0.1941,  0.2642,  0.7021,  0.7992,  0.9293,  0.6732,
         0.4296,  0.2465,  0.7004,  0.9388,  0.3125,  0.7679,  0.8911,
         0.7208,  0.1467,  0.7782,  0.1421,  0.9366,  0.3223,  0.0854,
         0.1008,  0.7311,  0.1361,  0.8495,  0.4960,  0.0408,  0.7015,
         0.0846,  0.1291,  0.9136,  0.8074,  0.2269,  0.2403,  0.1525,
         0.6960,  0.1279,  0.3619,  0.3434,  0.8942,  0.6111,  0.2913,
         0.5407,  0.3282,  0.6430,  0.1448,  0.8850,  0.7552,  0.2740,
         0.7292,  0.2425,  0.8901,  0.3444,  0.1820,  0.9270,  0.1341,
         0.0764,  0.1064,  0.6919,  0.3661,  0.6367,  0.0636,  0.2783,
         0.6763,  0.9506,  0.3336,  0.8545,  0.8540,  0.7077,  0.5126,
         0.1890,  0.8753,  0.0587,  0.6566,  0.3309,  0.5398,  0.2205,
         0.7182,  0.4146,  0.3841,  0.1927,  0.1156,  0.8560,  0.2818,
         0.9564,  0.7915,  0.4575,  0.0521,  0.1305,  0.2769,  0.8986,
         0.1057,  0.1238,  0.2256,  0.2694,  0.5186,  0.1142,  0.2035,
         0.7879,  0.0496,  0.3462,  0.8200,  0.2253,  0.3261,  0.1415,
         0.2691,  0.7990,  0.3447,  0.2105,  0.6956,  0.7401,  0.2861,
         0.8774,  0.1108,  0.7425,  0.8172,  0.8205,  0.6293,  0.1234,
         0.7819,  0.8539,  0.8326,  0.8341,  0.1179,  0.0866,  0.2897,
         0.2623,  0.0765,  0.1300,  0.7193,  0.4851,  0.2028,  0.0880,
         0.3517,  0.7036,  0.0637,  0.5537,  0.7418,  0.8263,  0.4230,
         0.2922,  0.0216,  0.8147,  0.7195,  0.0488,  0.2736,  0.3869,
         0.7023,  0.9336,  0.0544,  0.7611,  0.0930,  0.2651,  0.2616,
         0.6031,  0.1049,  0.6188,  0.6558,  0.8320,  0.0551,  0.8344,
         0.8372,  0.5796,  0.8291,  0.1238,  0.3352,  0.4707,  0.0732,
         0.1372,  0.4192,  0.0968,  0.1090,  0.2117,  0.0992,  0.4114,
         0.2029,  0.9067,  0.6659,  0.5755,  0.4119,  0.4568,  0.3973,
         0.7449,  0.5174,  0.3227,  0.8473,  0.7651,  0.9545,  0.3877,
         0.8376,  0.0495,  0.2944,  0.8723,  0.0728,  0.3186,  0.2922,
         0.3632,  0.4152,  0.1465,  0.7407,  0.7011,  0.8559,  0.2771,
         0.6305,  0.2781,  0.2416,  0.8581,  0.9128,  0.9432,  0.2490,
         0.8021,  0.7935,  0.2919,  0.8437,  0.2205,  0.9400,  0.5174,
         0.2209,  0.6660,  0.5087,  0.6786,  0.5361,  0.6208,  0.2351,
         0.2917,  0.8239,  0.8891,  0.2810,  0.1360,  0.8127,  0.9108,
         0.7993,  0.1051,  0.1153,  0.8555,  0.5046,  0.3015,  0.0928,
         0.7936,  0.0357,  0.8075,  0.7684,  0.1802,  0.8318,  0.3087,
         0.1946,  0.1117,  0.6177,  0.7704,  0.6207,  0.7315,  0.2222,
         0.6701,  0.1484,  0.9334,  0.1207,  0.1578,  0.7851,  0.9039,
         0.1244,  0.0816,  0.7927,  0.6842,  0.3057,  0.0354,  0.7667,
         0.8824,  0.0636,  0.7787,  0.3856,  0.5129,  0.1377,  0.4072,
         0.3672,  0.2670,  0.1809,  0.4337,  0.7823,  0.4395,  0.8413,
         0.9212,  0.2539,  0.8008,  0.1069,  0.0756,  0.8454,  0.1469,
         0.7822,  0.4713,  0.9758,  0.3499,  0.8029,  0.1740,  0.8647,
         0.7681,  0.4491,  0.1643,  0.1724,  0.9019,  0.1652,  0.6767,
         0.6330,  0.9909,  0.6291,  0.1366,  0.1304,  0.0918,  0.6476,
         0.2594,  0.9031,  0.5016,  0.1806,  0.0311,  0.8257,  0.2638,
         0.1292,  0.3391,  0.2236,  0.6914,  0.4734,  0.5280,  0.8552,
         0.9568,  0.1796,  0.4555,  0.4498,  0.2596,  0.1931,  0.2025,
         0.6425,  0.8831,  0.1386,  0.8107,  0.9060,  0.7900,  0.0175,
         0.6043,  0.3198,  0.7352,  0.8406,  0.5943,  0.1789,  0.9863,
         0.3475,  0.1150,  0.6065,  0.4342,  0.7080,  0.5865,  0.1159,
         0.2214,  0.5385,  0.3003,  0.2660,  0.6771,  0.3010,  0.7988,
         0.4089,  0.4751,  0.1135,  0.7971,  0.1151,  0.8841,  0.1058,
         0.1256,  0.8777,  0.8440,  0.7164,  0.2114,  0.9314,  0.4756,
         0.9266,  0.3612,  0.2161,  0.6255,  0.3530,  0.8844,  0.9457,
         0.6285,  0.8204,  0.9685,  0.4222,  0.6850,  0.8132,  0.1031,
         0.5293,  0.3192,  0.1296,  0.3175,  0.5765,  0.4123,  0.8686,
         0.2324,  0.9170,  0.5870,  0.8738,  0.3083,  0.2322,  0.1459,
         0.0997,  0.5394,  0.9349,  0.8339,  0.9186,  0.6995,  0.7638,
         0.8138,  0.8331,  0.6487,  0.2353,  0.9075,  0.1484,  0.7614,
         0.9103,  0.3897,  0.3985,  0.1333,  0.4087,  0.6948,  0.5562,
         0.2441,  0.3772,  0.7784,  0.7540,  0.1716,  0.9491,  0.1543,
         0.6486,  0.4600,  0.8775,  0.1975,  0.2107,  0.6167,  0.7795,
         0.0774,  0.1643,  0.0199,  0.9047,  0.3605,  0.2692,  0.3173,
         0.2441,  0.4066,  0.5868,  0.1978,  0.8914,  0.1216,  0.7278,
         0.4861,  0.1653,  0.8172,  0.7737,  0.7366,  0.7228,  0.9520,
         0.4809,  0.7858,  0.1158,  0.8142,  0.6441,  0.2369,  0.7234,
         0.0728], device='cuda:0')
tensor(0.4761, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8764,  0.2223,  0.1612,  0.5915,  0.8925,  0.2376,  0.2321,
         0.4424,  0.0654,  0.5372,  0.9386,  0.9442,  0.7909,  0.9489,
         0.1127,  0.9062,  0.1287,  0.8499,  0.8589,  0.1644,  0.0547,
         0.4492,  0.8151,  0.9667,  0.1725,  0.6379,  0.1218,  0.7924,
         0.0440,  0.2094,  0.1204,  0.7414,  0.0377,  0.1039,  0.9802,
         0.7485,  0.4033,  0.4565,  0.1356,  0.9173,  0.1602,  0.5445,
         0.1240,  0.1652,  0.7640,  0.7041,  0.5922,  0.2360,  0.5750,
         0.8245,  0.8693,  0.2845,  0.1265,  0.2523,  0.1073,  0.8130,
         0.6626,  0.1578,  0.0874,  0.6802,  0.3126,  0.8717,  0.2949,
         0.2191,  0.5009,  0.8998,  0.7709,  0.0201,  0.8081,  0.2241,
         0.3158,  0.9211,  0.3152,  0.2285,  0.9038,  0.7349,  0.1086,
         0.1813,  0.0904,  0.0920,  0.8911,  0.1071,  0.8578,  0.8609,
         0.9247,  0.2332,  0.1215,  0.2564,  0.1614,  0.9533,  0.7256,
         0.9185,  0.0888,  0.3031,  0.5898,  0.5718,  0.1148,  0.6088,
         0.8958,  0.8332,  0.7585,  0.9480,  0.0662,  0.1882,  0.1342,
         0.8530,  0.9527,  0.6162,  0.8274,  0.2138,  0.1454,  0.8507,
         0.2865,  0.8180,  0.0771,  0.8888,  0.8357,  0.1834,  0.1476,
         0.1638,  0.3519,  0.4079,  0.7795,  0.8921,  0.7297,  0.8288,
         0.8950,  0.3405,  0.3655,  0.1176,  0.8378,  0.1383,  0.6971,
         0.8097,  0.7744,  0.6791,  0.1282,  0.1047,  0.6020,  0.8404,
         0.6869,  0.7205,  0.8882,  0.8361,  0.2022,  0.2139,  0.5548,
         0.6190,  0.0652,  0.1213,  0.7697,  0.1326,  0.1171,  0.2277,
         0.1054,  0.1960,  0.1764,  0.3647,  0.1728,  0.1567,  0.8674,
         0.1397,  0.1513,  0.8176,  0.1712,  0.8220,  0.6733,  0.4298,
         0.9317,  0.0513,  0.8911,  0.1072,  0.8178,  0.6857,  0.1759,
         0.2988,  0.0410,  0.8252,  0.3382,  0.9327,  0.8321,  0.7941,
         0.8345,  0.7746,  0.9867,  0.2155,  0.3925,  0.2913,  0.2780,
         0.8825,  0.8264,  0.3902,  0.6406,  0.0369,  0.8683,  0.9178,
         0.2033,  0.7653,  0.2383,  0.0564,  0.8794,  0.2129,  0.0851,
         0.0943,  0.4098,  0.1400,  0.7348,  0.1106,  0.2078,  0.1135,
         0.1242,  0.2019,  0.2622,  0.8403,  0.1877,  0.1486,  0.7987,
         0.4559,  0.3236,  0.4710,  0.4500,  0.9253,  0.0132,  0.7319,
         0.6254,  0.5904,  0.7973,  0.7731,  0.2525,  0.1717,  0.9873,
         0.8764,  0.8979,  0.3149,  0.0380,  0.6142,  0.4871,  0.0757,
         0.2752,  0.0928,  0.7357,  0.0811,  0.1962,  0.4733,  0.0832,
         0.8314,  0.6413,  0.6472,  0.8567,  0.5908,  0.8313,  0.1618,
         0.6584,  0.1165,  0.1642,  0.1342,  0.9296,  0.5599,  0.0972,
         0.7126,  0.0603,  0.7157,  0.8030,  0.8607,  0.9131,  0.4680,
         0.1682,  0.2103,  0.0686,  0.7883,  0.8705,  0.1157,  0.9384,
         0.8004,  0.3094,  0.0647,  0.8891,  0.3157,  0.2025,  0.2773,
         0.1627,  0.1070,  0.0535,  0.1501,  0.9117,  0.9146,  0.1183,
         0.8013,  0.0842,  0.0326,  0.1714,  0.9651,  0.7539,  0.2237,
         0.9095,  0.0943,  0.4951,  0.6941,  0.7293,  0.8858,  0.3437,
         0.1866,  0.2860,  0.8108,  0.8267,  0.7495,  0.3499,  0.8387,
         0.4349,  0.3080,  0.6750,  0.0778,  0.1558,  0.1262,  0.1500,
         0.8540,  0.7281,  0.1502,  0.1542,  0.0893,  0.1894,  0.7984,
         0.3711,  0.4540,  0.7672,  0.8972,  0.1831,  0.1540,  0.9472,
         0.1359,  0.4867,  0.3907,  0.3681,  0.2444,  0.8604,  0.7695,
         0.1471,  0.1828,  0.0912,  0.2468,  0.9056,  0.2228,  0.1164,
         0.3792,  0.9363,  0.2467,  0.1373,  0.0316,  0.1424,  0.2145,
         0.0771,  0.7100,  0.9011,  0.1296,  0.1665,  0.4194,  0.1727,
         0.0961,  0.2887,  0.3404,  0.9292,  0.3312,  0.0990,  0.8278,
         0.8804,  0.9824,  0.8247,  0.7095,  0.3078,  0.6578,  0.3819,
         0.7682,  0.8516,  0.0581,  0.4931,  0.5024,  0.1188,  0.8851,
         0.1359,  0.0887,  0.1990,  0.3524,  0.1329,  0.1653,  0.8946,
         0.9057,  0.9367,  0.1150,  0.7506,  0.3422,  0.4222,  0.9632,
         0.5831,  0.2192,  0.9561,  0.1349,  0.1992,  0.9131,  0.1277,
         0.9193,  0.0388,  0.1423,  0.7664,  0.0470,  0.8013,  0.3397,
         0.0825,  0.8387,  0.5277,  0.0872,  0.0870,  0.8245,  0.9392,
         0.4034,  0.0766,  0.8666,  0.9446,  0.1609,  0.3358,  0.1277,
         0.0474,  0.2193,  0.1457,  0.2251,  0.9180,  0.3206,  0.8979,
         0.8686,  0.2274,  0.2568,  0.1351,  0.8690,  0.9081,  0.2348,
         0.8887,  0.1691,  0.2246,  0.2485,  0.3398,  0.1500,  0.7226,
         0.6855,  0.1706,  0.5383,  0.6187,  0.1458,  0.7473,  0.0779,
         0.3924,  0.1882,  0.6546,  0.2527,  0.1738,  0.2272,  0.0947,
         0.5258,  0.5669,  0.2053,  0.1119,  0.2585,  0.2860,  0.0838,
         0.9555,  0.1773,  0.3146,  0.8270,  0.7493,  0.0695,  0.3644,
         0.0409,  0.7433,  0.1004,  0.2685,  0.8914,  0.5902,  0.0441,
         0.4953,  0.5684,  0.9033,  0.2547,  0.9128,  0.8547,  0.2525,
         0.5949,  0.2254,  0.3319,  0.0866,  0.1061,  0.9384,  0.7726,
         0.7903,  0.7256,  0.7534,  0.6721,  0.1426,  0.7831,  0.5408,
         0.0139,  0.1176,  0.6972,  0.8214,  0.0347,  0.1250,  0.6432,
         0.1655,  0.2317,  0.7601,  0.0337,  0.1163,  0.5525,  0.9249,
         0.1490], device='cuda:0')
tensor(0.4397, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0843,  0.6629,  0.1441,  0.9198,  0.0933,  0.0884,  0.9250,
         0.0813,  0.2332,  0.1496,  0.0628,  0.1367,  0.2299,  0.7912,
         0.1485,  0.1147,  0.9008,  0.0726,  0.1210,  0.3858,  0.6754,
         0.0816,  0.0721,  0.6889,  0.8138,  0.9271,  0.8445,  0.8262,
         0.4510,  0.0703,  0.8658,  0.0575,  0.8179,  0.0384,  0.8380,
         0.1557,  0.9004,  0.7270,  0.2139,  0.9053,  0.1395,  0.2097,
         0.5060,  0.1010,  0.3734,  0.0942,  0.3887,  0.2247,  0.0923,
         0.7819,  0.1727,  0.8818,  0.8767,  0.7591,  0.2682,  0.3222,
         0.6609,  0.1512,  0.3769,  0.0932,  0.1167,  0.8558,  0.5599,
         0.8418,  0.0757,  0.8950,  0.3355,  0.8713,  0.0257,  0.8150,
         0.4143,  0.1366,  0.8949,  0.5971,  0.0536,  0.5380,  0.1060,
         0.8162,  0.2177,  0.1211,  0.1665,  0.3480,  0.0608,  0.1603,
         0.0497,  0.2042,  0.6560,  0.9006,  0.0860,  0.2294,  0.7801,
         0.2711,  0.1116,  0.8175,  0.7642,  0.8741,  0.2837,  0.4556,
         0.1531,  0.8631,  0.8612,  0.5505,  0.2214,  0.7179,  0.1459,
         0.0679,  0.1349,  0.3932,  0.8359,  0.1587,  0.1404,  0.1614,
         0.1254,  0.3138,  0.1118,  0.9352,  0.0328,  0.7985,  0.0590,
         0.1913,  0.9907,  0.3740,  0.1345,  0.1183,  0.0999,  0.0646,
         0.0751,  0.8577,  0.7200,  0.0898,  0.2319,  0.4360,  0.3277,
         0.9241,  0.0935,  0.0262,  0.6590,  0.9572,  0.1112,  0.5802,
         0.3073,  0.0958,  0.1140,  0.0707,  0.8121,  0.1654,  0.2222,
         0.6439,  0.6375,  0.0932,  0.0301,  0.2123,  0.1311,  0.0491,
         0.3937,  0.6871,  0.2782,  0.1799,  0.8006,  0.1021,  0.2399,
         0.2886,  0.9588,  0.8877,  0.0464,  0.2379,  0.0294,  0.7809,
         0.1907,  0.9054,  0.7964,  0.8378,  0.2349,  0.4765,  0.1109,
         0.8377,  0.1408,  0.3228,  0.0146,  0.5951,  0.5405,  0.0764,
         0.6269,  0.7110,  0.8603,  0.3259,  0.2107,  0.1520,  0.3248,
         0.3822,  0.7317,  0.2289,  0.8561,  0.1995,  0.0393,  0.2361,
         0.3065,  0.9875,  0.7130,  0.2348,  0.3330,  0.9188,  0.8509,
         0.9351,  0.9035,  0.7091,  0.8267,  0.9284,  0.8517,  0.8938,
         0.8529,  0.7512,  0.1096,  0.9243,  0.6068,  0.9758,  0.8939,
         0.1302,  0.0890,  0.1255,  0.5038,  0.0559,  0.1719,  0.1817,
         0.7887,  0.3589,  0.3384,  0.8882,  0.1115,  0.2011,  0.0757,
         0.9350,  0.0406,  0.1141,  0.9424,  0.1165,  0.0532,  0.5353,
         0.1127,  0.1055,  0.1200,  0.7467,  0.9350,  0.5081,  0.1863,
         0.8165,  0.1698,  0.3657,  0.0345,  0.8174,  0.1951,  0.2117,
         0.8502,  0.7107,  0.9166,  0.0322,  0.3993,  0.9109,  0.1918,
         0.5046,  0.4942,  0.0788,  0.2835,  0.0701,  0.8372,  0.6563,
         0.5704,  0.1718,  0.2951,  0.0761,  0.1872,  0.9074,  0.1698,
         0.5561,  0.4827,  0.9367,  0.7018,  0.8853,  0.9203,  0.0894,
         0.1408,  0.9331,  0.1360,  0.8148,  0.7622,  0.8126,  0.4413,
         0.1083,  0.1057,  0.9600,  0.3098,  0.9164,  0.4767,  0.0915,
         0.3561,  0.9579,  0.4050,  0.8126,  0.1649,  0.8308,  0.2152,
         0.6644,  0.4053,  0.9361,  0.9884,  0.0966,  0.8930,  0.3991,
         0.1679,  0.8428,  0.8840,  0.8943,  0.1350,  0.9197,  0.6135,
         0.2039,  0.1000,  0.9249,  0.1041,  0.8920,  0.9827,  0.8275,
         0.4944,  0.1320,  0.4391,  0.0665,  0.8029,  0.1210,  0.2454,
         0.5104,  0.2548,  0.7424,  0.8766,  0.8456,  0.0865,  0.1141,
         0.0342,  0.9182,  0.1031,  0.2595,  0.1505,  0.0783,  0.2372,
         0.0407,  0.8257,  0.1475,  0.9952,  0.1938,  0.1596,  0.7542,
         0.7413,  0.8343,  0.7541,  0.6991,  0.3707,  0.8020,  0.6945,
         0.2995,  0.0932,  0.6726,  0.1358,  0.2001,  0.9173,  0.8229,
         0.6168,  0.1671,  0.0979,  0.2804,  0.1823,  0.1117,  0.8252,
         0.2920,  0.6759,  0.1605,  0.9711,  0.7714,  0.0321,  0.1052,
         0.8566,  0.4167,  0.0292,  0.9910,  0.5937,  0.4719,  0.3943,
         0.3404,  0.5676,  0.4280,  0.8798,  0.8447,  0.5272,  0.2866,
         0.4294,  0.5051,  0.7397,  0.3026,  0.2065,  0.1697,  0.6972,
         0.3514,  0.8979,  0.9665,  0.7020,  0.2433,  0.8549,  0.0766,
         0.7522,  0.7146,  0.3314,  0.8525,  0.1153,  0.5987,  0.0256,
         0.3914,  0.1617,  0.7791,  0.9407,  0.9033,  0.8294,  0.5177,
         0.0775,  0.1694,  0.7958,  0.5795,  0.2219,  0.0896,  0.3022,
         0.1265,  0.8637,  0.9293,  0.1611,  0.2674,  0.0936,  0.0684,
         0.8044,  0.0637,  0.8688,  0.0786,  0.3328,  0.1217,  0.1978,
         0.5824,  0.2333,  0.9035,  0.9449,  0.2580,  0.2123,  0.0480,
         0.9596,  0.7391,  0.7316,  0.1974,  0.1785,  0.9125,  0.1943,
         0.1976,  0.4946,  0.0835,  0.1141,  0.1569,  0.5202,  0.0484,
         0.7720,  0.7125,  0.3383,  0.1976,  0.1674,  0.7490,  0.8781,
         0.8343,  0.1405,  0.1837,  0.8828,  0.0537,  0.1693,  0.0263,
         0.0880,  0.2778,  0.1299,  0.0971,  0.1280,  0.8601,  0.8795,
         0.2196,  0.3392,  0.0842,  0.1116,  0.1988,  0.7870,  0.1221,
         0.7357,  0.7281,  0.9199,  0.1421,  0.3430,  0.9213,  0.7560,
         0.8940,  0.3720,  0.6808,  0.1905,  0.8382,  0.1039,  0.9003,
         0.0842,  0.4423,  0.1218,  0.1194,  0.0872,  0.3164,  0.9357,
         0.8804], device='cuda:0')
tensor(0.4896, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8990,  0.7808,  0.2097,  0.7196,  0.2046,  0.1606,  0.3478,
         0.1696,  0.0707,  0.3423,  0.8815,  0.8998,  0.7582,  0.1647,
         0.0725,  0.1868,  0.2922,  0.8534,  0.2635,  0.7056,  0.8456,
         0.0844,  0.0990,  0.6595,  0.2441,  0.8657,  0.6201,  0.6654,
         0.1094,  0.2036,  0.2503,  0.8993,  0.9015,  0.9444,  0.4759,
         0.5151,  0.5949,  0.8872,  0.7050,  0.4318,  0.9038,  0.6182,
         0.2311,  0.3187,  0.8442,  0.8774,  0.2079,  0.1456,  0.2478,
         0.7936,  0.6482,  0.0994,  0.0737,  0.5144,  0.1563,  0.1085,
         0.5065,  0.7969,  0.1066,  0.1968,  0.8929,  0.4123,  0.6681,
         0.5314,  0.0938,  0.5226,  0.2113,  0.6742,  0.1274,  0.6482,
         0.0469,  0.6286,  0.1048,  0.3458,  0.9178,  0.1923,  0.9627,
         0.8686,  0.4331,  0.0845,  0.9419,  0.9142,  0.7525,  0.0850,
         0.9018,  0.8552,  0.0625,  0.5692,  0.6104,  0.7531,  0.0975,
         0.6743,  0.5372,  0.0832,  0.1254,  0.2685,  0.5393,  0.3929,
         0.9249,  0.6034,  0.1410,  0.0887,  0.7710,  0.4632,  0.0759,
         0.9136,  0.1436,  0.1346,  0.7740,  0.8095,  0.6528,  0.9484,
         0.9372,  0.5937,  0.2075,  0.2077,  0.4382,  0.0628,  0.8339,
         0.1623,  0.7705,  0.0867,  0.9347,  0.7532,  0.3759,  0.8906,
         0.5381,  0.2651,  0.0774,  0.1238,  0.1626,  0.0567,  0.0496,
         0.2457,  0.3284,  0.2669,  0.1171,  0.2500,  0.4101,  0.1381,
         0.0656,  0.2082,  0.1028,  0.8901,  0.0405,  0.0386,  0.8780,
         0.8349,  0.3079,  0.2657,  0.1271,  0.7792,  0.4287,  0.2369,
         0.5817,  0.1717,  0.7857,  0.1860,  0.1322,  0.8957,  0.7711,
         0.6734,  0.9392,  0.1070,  0.0837,  0.0839,  0.6996,  0.8502,
         0.0245,  0.8428,  0.8955,  0.0625,  0.0632,  0.4806,  0.0368,
         0.2547,  0.7309,  0.8804,  0.1417,  0.0887,  0.9070,  0.2357,
         0.6623,  0.8729,  0.2125,  0.4489,  0.0999,  0.8604,  0.4872,
         0.1120,  0.6047,  0.0780,  0.7011,  0.3419,  0.2531,  0.8699,
         0.2235,  0.2089,  0.9624,  0.8706,  0.0983,  0.1936,  0.9415,
         0.4682,  0.4037,  0.1208,  0.8481,  0.1371,  0.8169,  0.0852,
         0.1486,  0.1025,  0.1473,  0.8866,  0.8484,  0.1673,  0.2493,
         0.1118,  0.1982,  0.2170,  0.1935,  0.1299,  0.1603,  0.2183,
         0.8115,  0.4826,  0.8528,  0.4789,  0.7633,  0.7012,  0.1633,
         0.8797,  0.2534,  0.1972,  0.5353,  0.1632,  0.2377,  0.1025,
         0.8276,  0.1310,  0.1066,  0.5736,  0.2682,  0.8754,  0.1775,
         0.1516,  0.7630,  0.1581,  0.3055,  0.6387,  0.2953,  0.6428,
         0.5115,  0.0577,  0.5223,  0.1676,  0.1633,  0.3141,  0.8339,
         0.3341,  0.1323,  0.2999,  0.6633,  0.8167,  0.7231,  0.9892,
         0.4646,  0.0381,  0.9179,  0.0889,  0.1826,  0.8937,  0.0248,
         0.1877,  0.4025,  0.3721,  0.0587,  0.9594,  0.3671,  0.7155,
         0.1814,  0.8224,  0.8915,  0.0862,  0.8264,  0.1505,  0.1327,
         0.1238,  0.1853,  0.4713,  0.7564,  0.7137,  0.1297,  0.1005,
         0.2183,  0.7127,  0.1457,  0.1043,  0.1893,  0.7248,  0.7328,
         0.1409,  0.8850,  0.9628,  0.4874,  0.1738,  0.4537,  0.8043,
         0.4763,  0.4812,  0.0971,  0.8326,  0.1549,  0.0870,  0.1605,
         0.5457,  0.0666,  0.3327,  0.4527,  0.1092,  0.7990,  0.9759,
         0.8750,  0.0717,  0.8722,  0.0913,  0.1898,  0.3275,  0.1708,
         0.9557,  0.7136,  0.5741,  0.6575,  0.5801,  0.3099,  0.8031,
         0.6816,  0.7258,  0.0655,  0.1389,  0.8735,  0.9784,  0.3429,
         0.9942,  0.0965,  0.2770,  0.7740,  0.8850,  0.1955,  0.9047,
         0.9891,  0.2585,  0.4055,  0.6957,  0.8180,  0.4456,  0.9191,
         0.7923,  0.8191,  0.1028,  0.0918,  0.9014,  0.6005,  0.0862,
         0.9621,  0.3834,  0.6507,  0.7492,  0.1499,  0.9155,  0.2208,
         0.1364,  0.0301,  0.9317,  0.3394,  0.1420,  0.5603,  0.1383,
         0.0974,  0.1417,  0.1533,  0.7718,  0.4577,  0.1535,  0.2921,
         0.6552,  0.7863,  0.6759,  0.0863,  0.1872,  0.7134,  0.3547,
         0.8975,  0.6637,  0.8365,  0.7242,  0.2586,  0.8324,  0.2005,
         0.8858,  0.0728,  0.0678,  0.7397,  0.0577,  0.8697,  0.1201,
         0.0911,  0.9159,  0.2067,  0.1977,  0.0426,  0.6751,  0.3217,
         0.1293,  0.8597,  0.9084,  0.1539,  0.3668,  0.1050,  0.2381,
         0.1441,  0.2195,  0.1465,  0.0529,  0.1526,  0.0303,  0.8313,
         0.1911,  0.1327,  0.1113,  0.8428,  0.1868,  0.6383,  0.0486,
         0.1104,  0.1608,  0.6867,  0.0709,  0.4874,  0.5880,  0.9789,
         0.2246,  0.1491,  0.4499,  0.1757,  0.7860,  0.8392,  0.9838,
         0.8352,  0.8813,  0.8870,  0.2262,  0.7199,  0.5272,  0.8889,
         0.2557,  0.1616,  0.1397,  0.8724,  0.1684,  0.2275,  0.7895,
         0.0806,  0.1391,  0.2199,  0.8107,  0.8821,  0.2658,  0.6846,
         0.2619,  0.4856,  0.2203,  0.1852,  0.1598,  0.7959,  0.1914,
         0.8726,  0.1645,  0.1504,  0.1990,  0.4640,  0.8397,  0.0343,
         0.7729,  0.0845,  0.3422,  0.6551,  0.6163,  0.7468,  0.8170,
         0.4935,  0.9251,  0.1804,  0.2322,  0.8259,  0.1819,  0.4781,
         0.1964,  0.8121,  0.1305,  0.2321,  0.7663,  0.4339,  0.9925,
         0.6745,  0.1382,  0.2107,  0.1304,  0.7659,  0.0656,  0.9104,
         0.2627], device='cuda:0')
tensor(0.4892, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3857,  0.5554,  0.0867,  0.8170,  0.9905,  0.9597,  0.7316,
         0.7186,  0.8644,  0.4598,  0.2613,  0.3459,  0.7695,  0.6426,
         0.8224,  0.8952,  0.7411,  0.9010,  0.8669,  0.9279,  0.2097,
         0.0331,  0.1910,  0.6467,  0.0352,  0.8026,  0.5188,  0.7897,
         0.8872,  0.8399,  0.8184,  0.8464,  0.5407,  0.1274,  0.2513,
         0.6662,  0.1021,  0.8868,  0.6718,  0.1418,  0.3621,  0.1916,
         0.4205,  0.9140,  0.2166,  0.8199,  0.8614,  0.9256,  0.5246,
         0.3719,  0.1138,  0.1494,  0.0601,  0.4593,  0.1470,  0.2367,
         0.3336,  0.6065,  0.7282,  0.9709,  0.8545,  0.8516,  0.5787,
         0.8775,  0.5307,  0.9138,  0.6844,  0.1238,  0.2395,  0.2681,
         0.7516,  0.6313,  0.8140,  0.8483,  0.3547,  0.5285,  0.9450,
         0.0790,  0.9334,  0.3898,  0.0744,  0.0901,  0.8925,  0.9136,
         0.7709,  0.1205,  0.3590,  0.9032,  0.8807,  0.0967,  0.4953,
         0.9705,  0.3047,  0.1172,  0.2208,  0.4477,  0.1229,  0.9346,
         0.2844,  0.8330,  0.0788,  0.0988,  0.5392,  0.9790,  0.8806,
         0.9324,  0.8596,  0.4304,  0.9116,  0.0813,  0.6780,  0.3512,
         0.0700,  0.8878,  0.0401,  0.8237,  0.2861,  0.1444,  0.1841,
         0.0783,  0.9645,  0.1988,  0.7754,  0.4183,  0.6342,  0.9946,
         0.4250,  0.8762,  0.1780,  0.8782,  0.9753,  0.1746,  0.9129,
         0.3923,  0.2027,  0.5205,  0.8846,  0.0750,  0.8824,  0.2231,
         0.1262,  0.8961,  0.2231,  0.8652,  0.4678,  0.8226,  0.1770,
         0.7862,  0.1002,  0.0792,  0.2343,  0.6450,  0.4577,  0.2367,
         0.3586,  0.7773,  0.1343,  0.3425,  0.9081,  0.9935,  0.7867,
         0.8913,  0.5464,  0.2046,  0.3633,  0.2063,  0.2452,  0.8832,
         0.1724,  0.1148,  0.4831,  0.8738,  0.9011,  0.7062,  0.5750,
         0.9039,  0.4122,  0.3355,  0.1820,  0.3561,  0.6062,  0.1088,
         0.3450,  0.7378,  0.6930,  0.2626,  0.9565,  0.7814,  0.7094,
         0.2012,  0.9734,  0.8989,  0.5318,  0.1494,  0.1217,  0.9569,
         0.9126,  0.4202,  0.2717,  0.9925,  0.1005,  0.3460,  0.6621,
         0.9537,  0.7358,  0.3153,  0.4979,  0.4497,  0.0867,  0.2639,
         0.8185,  0.0850,  0.1688,  0.0802,  0.7226,  0.6114,  0.9077,
         0.8522,  0.3265,  0.2759,  0.9492,  0.0449,  0.9029,  0.1642,
         0.0769,  0.0620,  0.1403,  0.7645,  0.2975,  0.8845,  0.1530,
         0.1055,  0.9085,  0.9129,  0.8196,  0.8132,  0.1432,  0.1219,
         0.9059,  0.1926,  0.2782,  0.1804,  0.9204,  0.8377,  0.2647,
         0.5943,  0.3540,  0.4667,  0.9516,  0.3153,  0.2345,  0.7307,
         0.1098,  0.8893,  0.9466,  0.8064,  0.8907,  0.0911,  0.2042,
         0.2371,  0.5014,  0.9106,  0.8574,  0.9487,  0.5838,  0.0161,
         0.7865,  0.5907,  0.9258,  0.1826,  0.1314,  0.0660,  0.7607,
         0.2796,  0.8695,  0.8545,  0.1819,  0.3043,  0.2050,  0.3611,
         0.2068,  0.0133,  0.5713,  0.1423,  0.9733,  0.7575,  0.9118,
         0.0953,  0.3809,  0.3931,  0.6904,  0.5819,  0.9691,  0.8340,
         0.1171,  0.6634,  0.8141,  0.5189,  0.9670,  0.1489,  0.1853,
         0.9498,  0.1293,  0.3492,  0.1447,  0.6564,  0.8468,  0.9493,
         0.3917,  0.8364,  0.9117,  0.1368,  0.1240,  0.8757,  0.6164,
         0.2657,  0.2962,  0.1822,  0.7334,  0.8876,  0.9459,  0.0955,
         0.1507,  0.9282,  0.2144,  0.8217,  0.9636,  0.6410,  0.2235,
         0.2793,  0.2620,  0.7179,  0.1578,  0.9150,  0.7968,  0.0296,
         0.8317,  0.8132,  0.1854,  0.9216,  0.9826,  0.8959,  0.1721,
         0.1908,  0.7455,  0.1007,  0.4513,  0.3813,  0.7969,  0.5787,
         0.8245,  0.8122,  0.9533,  0.9340,  0.8230,  0.7434,  0.6033,
         0.6333,  0.2027,  0.2969,  0.0204,  0.9527,  0.1587,  0.9008,
         0.6327,  0.2494,  0.2576,  0.1300,  0.9195,  0.8373,  0.7891,
         0.7217,  0.4350,  0.5088,  0.4095,  0.2154,  0.1040,  0.2156,
         0.2728,  0.7313,  0.9043,  0.4503,  0.0770,  0.1078,  0.9698,
         0.7491,  0.1776,  0.4902,  0.9458,  0.8222,  0.9332,  0.1849,
         0.0739,  0.1933,  0.8006,  0.4921,  0.2999,  0.1023,  0.1550,
         0.9786,  0.8345,  0.0895,  0.5763,  0.1440,  0.3958,  0.8604,
         0.1187,  0.8558,  0.2340,  0.8380,  0.4063,  0.5677,  0.1042,
         0.3352,  0.0549,  0.8537,  0.6919,  0.1793,  0.5020,  0.1232,
         0.2585,  0.2387,  0.1662,  0.3121,  0.8320,  0.0235,  0.5019,
         0.5569,  0.4383,  0.6905,  0.9198,  0.0913,  0.4605,  0.1651,
         0.6261,  0.1024,  0.4649,  0.9192,  0.9599,  0.4329,  0.3157,
         0.2911,  0.9538,  0.3005,  0.1818,  0.1725,  0.1016,  0.7648,
         0.8769,  0.7876,  0.1526,  0.2880,  0.5039,  0.8918,  0.2768,
         0.8926,  0.0967,  0.6074,  0.2360,  0.8837,  0.6947,  0.9928,
         0.2527,  0.5583,  0.8452,  0.7058,  0.8465,  0.7243,  0.3123,
         0.9540,  0.2320,  0.8928,  0.1509,  0.3444,  0.1656,  0.1599,
         0.9164,  0.9724,  0.8817,  0.1573,  0.9089,  0.8702,  0.5668,
         0.1397,  0.0767,  0.4841,  0.6619,  0.2326,  0.9363,  0.7671,
         0.1424,  0.8743,  0.1609,  0.1155,  0.1377,  0.7945,  0.2257,
         0.8962,  0.5170,  0.1002,  0.2276,  0.3754,  0.1065,  0.8656,
         0.9459,  0.6610,  0.1270,  0.1704,  0.7345,  0.0477,  0.8624,
         0.0578], device='cuda:0')
tensor(0.4988, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9079,  0.2493,  0.1662,  0.1570,  0.2490,  0.2853,  0.4040,
         0.9042,  0.8833,  0.1601,  0.7220,  0.9067,  0.4604,  0.4027,
         0.8552,  0.8738,  0.3639,  0.6384,  0.1082,  0.9925,  0.3385,
         0.7448,  0.9177,  0.2615,  0.6966,  0.2140,  0.9674,  0.9044,
         0.7790,  0.5914,  0.2500,  0.2308,  0.1221,  0.9175,  0.2501,
         0.5729,  0.5193,  0.3523,  0.3634,  0.5911,  0.1555,  0.0970,
         0.1450,  0.8184,  0.9264,  0.3990,  0.2407,  0.7954,  0.8272,
         0.4329,  0.3915,  0.3676,  0.2479,  0.7210,  0.1585,  0.4313,
         0.8429,  0.5271,  0.1181,  0.1549,  0.8422,  0.2187,  0.8079,
         0.1747,  0.8354,  0.8297,  0.9234,  0.2000,  0.8538,  0.4913,
         0.8069,  0.0234,  0.2113,  0.3800,  0.8428,  0.7354,  0.2606,
         0.8182,  0.9163,  0.1715,  0.7538,  0.9536,  0.8148,  0.9100,
         0.0295,  0.9621,  0.8906,  0.4818,  0.0608,  0.1744,  0.8053,
         0.9288,  0.5195,  0.8597,  0.2711,  0.8249,  0.7479,  0.3229,
         0.2239,  0.7561,  0.9666,  0.0849,  0.7770,  0.6907,  0.4663,
         0.8220,  0.7740,  0.8583,  0.9978,  0.3065,  0.9403,  0.8937,
         0.1978,  0.2421,  0.2566,  0.2689,  0.3666,  0.5741,  0.9577,
         0.9193,  0.6723,  0.8935,  0.1472,  0.9306,  0.7582,  0.9662,
         0.2885,  0.5794,  0.4968,  0.5526,  0.4136,  0.3874,  0.1072,
         0.2985,  0.7067,  0.0576,  0.7003,  0.4329,  0.5054,  0.4995,
         0.1368,  0.9745,  0.3082,  0.1462,  0.7663,  0.8231,  0.3806,
         0.5679,  0.0348,  0.5801,  0.3370,  0.6107,  0.2522,  0.8434,
         0.9238,  0.4957,  0.7512,  0.9148,  0.7757,  0.7095,  0.9138,
         0.8437,  0.9297,  0.3392,  0.3338,  0.0541,  0.4373,  0.6880,
         0.6808,  0.1766,  0.2093,  0.3235,  0.8325,  0.1745,  0.2901,
         0.3023,  0.2034,  0.7725,  0.2857,  0.7368,  0.9361,  0.3638,
         0.1394,  0.6543,  0.2079,  0.2939,  0.2150,  0.5767,  0.8618,
         0.1664,  0.1681,  0.8222,  0.6064,  0.2846,  0.6830,  0.7516,
         0.8078,  0.5581,  0.1425,  0.5296,  0.6318,  0.8662,  0.9228,
         0.2554,  0.2552,  0.8711,  0.9316,  0.3227,  0.5170,  0.7031,
         0.1509,  0.1801,  0.2337,  0.1016,  0.8165,  0.7442,  0.2081,
         0.1236,  0.4114,  0.9030,  0.3446,  0.8556,  0.9102,  0.8159,
         0.4002,  0.6439,  0.7577,  0.2855,  0.7396,  0.1425,  0.2093,
         0.1682,  0.1790,  0.9147,  0.8511,  0.2980,  0.2576,  0.7731,
         0.7540,  0.7155,  0.9713,  0.9658,  0.5770,  0.3041,  0.1694,
         0.2018,  0.0980,  0.8159,  0.5799,  0.8883,  0.0697,  0.9070,
         0.8592,  0.2962,  0.8320,  0.8742,  0.5313,  0.2532,  0.8760,
         0.5153,  0.9385,  0.7018,  0.3186,  0.6447,  0.4619,  0.8469,
         0.8177,  0.9282,  0.3928,  0.8513,  0.4445,  0.7446,  0.3794,
         0.7046,  0.2821,  0.8876,  0.7774,  0.6348,  0.3649,  0.8770,
         0.8249,  0.8942,  0.1274,  0.9313,  0.5713,  0.1216,  0.8838,
         0.0743,  0.8045,  0.1886,  0.4052,  0.8862,  0.6260,  0.8397,
         0.8582,  0.9030,  0.7450,  0.2061,  0.9858,  0.1225,  0.6161,
         0.7750,  0.9196,  0.7873,  0.8455,  0.0949,  0.1679,  0.1546,
         0.8672,  0.8086,  0.9589,  0.1898,  0.9821,  0.3369,  0.9367,
         0.1538,  0.1569,  0.8982,  0.3672,  0.5134,  0.1261,  0.1855,
         0.8330,  0.3734,  0.2046,  0.6513,  0.8727,  0.9210,  0.4633,
         0.3701,  0.8231,  0.9198,  0.3930,  0.0508,  0.7042,  0.7514,
         0.9492,  0.5685,  0.2690,  0.8118,  0.8387,  0.3406,  0.9082,
         0.2212,  0.2458,  0.5645,  0.6934,  0.2859,  0.1925,  0.7685,
         0.6907,  0.8825,  0.8559,  0.4249,  0.8070,  0.6422,  0.9336,
         0.2082,  0.8012,  0.8208,  0.9374,  0.7236,  0.8982,  0.5387,
         0.9134,  0.6638,  0.8688,  0.6636,  0.8880,  0.8186,  0.5088,
         0.7542,  0.0438,  0.9213,  0.1072,  0.8709,  0.1437,  0.8668,
         0.1129,  0.9807,  0.5238,  0.9556,  0.1576,  0.9150,  0.9704,
         0.7799,  0.8898,  0.5428,  0.6209,  0.7108,  0.7622,  0.1050,
         0.6324,  0.4968,  0.8587,  0.9004,  0.9540,  0.3775,  0.1092,
         0.4481,  0.8421,  0.4780,  0.8435,  0.8804,  0.8745,  0.8862,
         0.8816,  0.7600,  0.9159,  0.8386,  0.8615,  0.3526,  0.7968,
         0.9696,  0.8850,  0.8100,  0.9007,  0.1525,  0.7443,  0.9503,
         0.8927,  0.8662,  0.3863,  0.8922,  0.8273,  0.0968,  0.4148,
         0.7544,  0.6424,  0.7437,  0.3369,  0.8782,  0.8964,  0.5857,
         0.3577,  0.8318,  0.7073,  0.8884,  0.4881,  0.3081,  0.1363,
         0.7326,  0.2048,  0.6225,  0.3016,  0.9603,  0.7942,  0.8235,
         0.9794,  0.1532,  0.1534,  0.1476,  0.5317,  0.9318,  0.6543,
         0.6249,  0.8641,  0.8765,  0.3025,  0.8948,  0.6722,  0.8611,
         0.3234,  0.8460,  0.8856,  0.2363,  0.9373,  0.1686,  0.0976,
         0.9115,  0.9680,  0.9848,  0.4145,  0.1523,  0.2156,  0.3534,
         0.6435,  0.4954,  0.3494,  0.9400,  0.2826,  0.2888,  0.1695,
         0.3216,  0.7394,  0.7445,  0.4572,  0.6567,  0.8381,  0.8729,
         0.8638,  0.0708,  0.5029,  0.7308,  0.9102,  0.5182,  0.8493,
         0.9481,  0.2186,  0.7348,  0.1643,  0.6332,  0.7596,  0.2435,
         0.0828,  0.3418,  0.0760,  0.8983,  0.7990,  0.9793,  0.3282,
         0.9177], device='cuda:0')
tensor(0.4966, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8351,  0.8928,  0.6155,  0.5373,  0.7515,  0.7294,  0.9045,
         0.6207,  0.2027,  0.3010,  0.6906,  0.6751,  0.3190,  0.5794,
         0.5588,  0.6511,  0.8576,  0.5042,  0.8860,  0.3598,  0.8442,
         0.0755,  0.4547,  0.1937,  0.9668,  0.9307,  0.7893,  0.6217,
         0.6282,  0.2718,  0.1500,  0.8893,  0.1678,  0.9554,  0.3669,
         0.9214,  0.1188,  0.4286,  0.8853,  0.8454,  0.2841,  0.8423,
         0.8178,  0.8287,  0.6955,  0.7337,  0.7693,  0.9186,  0.2873,
         0.9020,  0.3610,  0.5793,  0.2019,  0.3154,  0.4817,  0.8505,
         0.9019,  0.1742,  0.7638,  0.8980,  0.9274,  0.7426,  0.0919,
         0.5836,  0.7112,  0.4541,  0.2376,  0.3304,  0.4357,  0.4513,
         0.1559,  0.6818,  0.5545,  0.3479,  0.1811,  0.4533,  0.7932,
         0.6974,  0.1554,  0.4993,  0.8216,  0.5665,  0.6419,  0.0602,
         0.6697,  0.0522,  0.5120,  0.1436,  0.5452,  0.9227,  0.3696,
         0.7315,  0.7222,  0.5549,  0.7795,  0.1790,  0.5822,  0.7753,
         0.4180,  0.6363,  0.6765,  0.1570,  0.1305,  0.4509,  0.2247,
         0.2798,  0.9149,  0.8957,  0.1340,  0.2906,  0.6131,  0.8981,
         0.1995,  0.0450,  0.2443,  0.6054,  0.6861,  0.3994,  0.7901,
         0.9958,  0.6409,  0.8822,  0.2016,  0.7257,  0.7343,  0.1750,
         0.1679,  0.6746,  0.1353,  0.1411,  0.8276,  0.7422,  0.0763,
         0.8615,  0.2719,  0.9041,  0.4603,  0.7816,  0.2214,  0.5221,
         0.7879,  0.4970,  0.2005,  0.9287,  0.3167,  0.2306,  0.7603,
         0.1975,  0.3827,  0.8668,  0.1823,  0.8623,  0.7688,  0.2865,
         0.8241,  0.8462,  0.1202,  0.3562,  0.8091,  0.9213,  0.6392,
         0.4498,  0.0347,  0.0452,  0.2810,  0.9842,  0.9569,  0.7265,
         0.2073,  0.9255,  0.7999,  0.7164,  0.3316,  0.1706,  0.7552,
         0.8949,  0.1822,  0.1519,  0.1660,  0.1411,  0.6947,  0.0610,
         0.2186,  0.5133,  0.6745,  0.6137,  0.6564,  0.6084,  0.0308,
         0.0721,  0.5829,  0.8754,  0.8698,  0.6241,  0.7666,  0.1032,
         0.6814,  0.3684,  0.6507,  0.6469,  0.1876,  0.7201,  0.7109,
         0.4046,  0.9147,  0.8253,  0.7162,  0.9342,  0.6677,  0.3637,
         0.8709,  0.8622,  0.8936,  0.8231,  0.8606,  0.1435,  0.4546,
         0.3648,  0.1602,  0.8646,  0.8263,  0.2728,  0.7145,  0.7212,
         0.6092,  0.8127,  0.3480,  0.7697,  0.5346,  0.2917,  0.8474,
         0.8778,  0.9558,  0.4198,  0.1086,  0.5642,  0.7355,  0.3101,
         0.0935,  0.5015,  0.9064,  0.5968,  0.1886,  0.7973,  0.7979,
         0.7036,  0.7574,  0.6536,  0.6102,  0.3425,  0.8252,  0.2376,
         0.5977,  0.4712,  0.7173,  0.6041,  0.4151,  0.5994,  0.0923,
         0.5678,  0.8727,  0.8636,  0.3527,  0.1912,  0.2877,  0.2734,
         0.1232,  0.6987,  0.7926,  0.1548,  0.1041,  0.8364,  0.1160,
         0.2230,  0.1821,  0.9456,  0.6752,  0.1214,  0.3296,  0.2093,
         0.1172,  0.4447,  0.3769,  0.8946,  0.9211,  0.7196,  0.7611,
         0.5413,  0.8618,  0.5620,  0.6207,  0.1312,  0.8250,  0.7988,
         0.9314,  0.2788,  0.5398,  0.7676,  0.1707,  0.9129,  0.2146,
         0.1782,  0.8120,  0.0950,  0.5746,  0.2859,  0.8873,  0.0499,
         0.4338,  0.8227,  0.3149,  0.2046,  0.2564,  0.1631,  0.6822,
         0.3631,  0.2015,  0.2317,  0.0692,  0.1753,  0.3018,  0.8259,
         0.4209,  0.1253,  0.7752,  0.4145,  0.7401,  0.6601,  0.7070,
         0.7681,  0.3545,  0.9723,  0.9154,  0.3695,  0.1381,  0.4445,
         0.4985,  0.1725,  0.7749,  0.8758,  0.2245,  0.6822,  0.9243,
         0.8007,  0.9028,  0.7026,  0.9530,  0.6337,  0.8535,  0.6938,
         0.2841,  0.2862,  0.9686,  0.2694,  0.1920,  0.8344,  0.2973,
         0.2462,  0.8915,  0.2927,  0.2877,  0.2883,  0.1547,  0.9354,
         0.1299,  0.3456,  0.9210,  0.8684,  0.4753,  0.8397,  0.2258,
         0.0481,  0.1674,  0.7964,  0.0614,  0.1539,  0.9048,  0.6753,
         0.3770,  0.4661,  0.7698,  0.6238,  0.7677,  0.8697,  0.3088,
         0.3152,  0.1867,  0.9537,  0.4014,  0.8727,  0.8201,  0.3643,
         0.9307,  0.8395,  0.0918,  0.5916,  0.6944,  0.9291,  0.8248,
         0.4053,  0.4782,  0.2250,  0.8133,  0.2963,  0.3143,  0.1795,
         0.4877,  0.0682,  0.6864,  0.1102,  0.5261,  0.6532,  0.4134,
         0.9214,  0.1457,  0.4850,  0.9733,  0.0785,  0.2699,  0.6502,
         0.1305,  0.6852,  0.6199,  0.4406,  0.7132,  0.3341,  0.2388,
         0.7891,  0.0903,  0.2663,  0.6229,  0.4774,  0.8968,  0.1257,
         0.9015,  0.1434,  0.5047,  0.8646,  0.7923,  0.8841,  0.1273,
         0.3249,  0.6021,  0.3835,  0.7414,  0.3559,  0.5698,  0.9186,
         0.2714,  0.8071,  0.7250,  0.4534,  0.8637,  0.3966,  0.7071,
         0.8637,  0.8501,  0.5317,  0.2969,  0.4768,  0.8807,  0.8331,
         0.2133,  0.4178,  0.1958,  0.3071,  0.6100,  0.2432,  0.7347,
         0.1605,  0.7390,  0.8402,  0.1520,  0.2522,  0.9448,  0.5202,
         0.7715,  0.0751,  0.7242,  0.4016,  0.6235,  0.5706,  0.8330,
         0.6327,  0.8078,  0.1709,  0.8951,  0.2926,  0.6625,  0.7857,
         0.4092,  0.8501,  0.9082,  0.4394,  0.7625,  0.8007,  0.3272,
         0.4711,  0.2075,  0.8788,  0.6763,  0.8670,  0.5397,  0.3796,
         0.6241,  0.9055,  0.5580,  0.6306,  0.9288,  0.9005,  0.6020,
         0.1177], device='cuda:0')
tensor(0.4601, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7724,  0.2525,  0.7012,  0.8662,  0.7868,  0.7222,  0.6507,
         0.6390,  0.3104,  0.4659,  0.6073,  0.8390,  0.8126,  0.4739,
         0.8083,  0.0603,  0.2936,  0.4715,  0.6170,  0.7036,  0.2005,
         0.8252,  0.3492,  0.4014,  0.4239,  0.4628,  0.7805,  0.2648,
         0.2846,  0.9276,  0.2793,  0.6377,  0.4052,  0.3466,  0.2132,
         0.0896,  0.1008,  0.1044,  0.4446,  0.9737,  0.0919,  0.1235,
         0.5956,  0.7986,  0.4252,  0.9058,  0.8053,  0.6470,  0.2267,
         0.3076,  0.5994,  0.1048,  0.5357,  0.2333,  0.9070,  0.5947,
         0.2672,  0.4466,  0.5211,  0.8507,  0.6896,  0.6798,  0.4124,
         0.7068,  0.8291,  0.8547,  0.1457,  0.8196,  0.7629,  0.7043,
         0.4115,  0.7589,  0.3198,  0.5483,  0.9307,  0.8808,  0.6392,
         0.4330,  0.3583,  0.3180,  0.8215,  0.6263,  0.5062,  0.2499,
         0.2465,  0.9097,  0.1073,  0.7488,  0.5928,  0.2822,  0.1397,
         0.1408,  0.6082,  0.5281,  0.2552,  0.8243,  0.3695,  0.3238,
         0.4454,  0.7460,  0.4789,  0.8922,  0.1036,  0.1964,  0.4464,
         0.9542,  0.3285,  0.5942,  0.5571,  0.6056,  0.4028,  0.5659,
         0.6662,  0.8520,  0.5809,  0.6500,  0.2945,  0.4999,  0.6878,
         0.4358,  0.7854,  0.7388,  0.3501,  0.8350,  0.5877,  0.2841,
         0.9419,  0.6092,  0.9441,  0.6126,  0.4752,  0.7994,  0.5732,
         0.4560,  0.2237,  0.8901,  0.8138,  0.8087,  0.6731,  0.4892,
         0.5456,  0.2550,  0.3619,  0.4014,  0.6656,  0.0888,  0.7482,
         0.7231,  0.7443,  0.7213,  0.9758,  0.8588,  0.7728,  0.7337,
         0.5296,  0.7130,  0.2184,  0.3142,  0.2343,  0.6028,  0.0754,
         0.3285,  0.4772,  0.5309,  0.0717,  0.8129,  0.7946,  0.4493,
         0.8574,  0.1761,  0.7856,  0.6099,  0.7382,  0.3628,  0.6693,
         0.6501,  0.7509,  0.5026,  0.8880,  0.7400,  0.3013,  0.2246,
         0.2326,  0.2293,  0.3590,  0.5772,  0.8839,  0.7377,  0.6793,
         0.7931,  0.5144,  0.7519,  0.2209,  0.7898,  0.4167,  0.7329,
         0.1410,  0.7554,  0.6655,  0.2382,  0.3361,  0.0571,  0.1969,
         0.2169,  0.5353,  0.4615,  0.1470,  0.4505,  0.6730,  0.7774,
         0.5243,  0.6756,  0.1376,  0.5684,  0.1592,  0.2356,  0.1852,
         0.9373,  0.5181,  0.5339,  0.4908,  0.2842,  0.7361,  0.2714,
         0.8399,  0.5332,  0.3922,  0.1204,  0.5353,  0.2096,  0.3511,
         0.8613,  0.7164,  0.7857,  0.1376,  0.2665,  0.5206,  0.4028,
         0.7493,  0.5679,  0.7676,  0.8694,  0.5936,  0.7526,  0.4584,
         0.7062,  0.2621,  0.1111,  0.0747,  0.9116,  0.5805,  0.7686,
         0.7286,  0.6723,  0.1206,  0.6681,  0.1331,  0.7428,  0.8706,
         0.6527,  0.3166,  0.2364,  0.5891,  0.2825,  0.7400,  0.2213,
         0.7300,  0.2260,  0.3280,  0.0996,  0.2158,  0.0466,  0.7904,
         0.3535,  0.6134,  0.3501,  0.1877,  0.1993,  0.4147,  0.0911,
         0.2720,  0.5464,  0.8727,  0.6274,  0.1762,  0.2386,  0.3744,
         0.7731,  0.7904,  0.3545,  0.2260,  0.3754,  0.6836,  0.2296,
         0.8214,  0.8327,  0.2810,  0.5889,  0.2741,  0.1152,  0.1815,
         0.5019,  0.1933,  0.8548,  0.9541,  0.1977,  0.2204,  0.1503,
         0.5962,  0.7178,  0.3641,  0.6422,  0.4033,  0.1712,  0.1410,
         0.6585,  0.4114,  0.0948,  0.8262,  0.7059,  0.4297,  0.6262,
         0.2813,  0.2154,  0.7526,  0.7302,  0.1110,  0.4726,  0.3308,
         0.2087,  0.2157,  0.1989,  0.5653,  0.2469,  0.8224,  0.5093,
         0.1460,  0.7576,  0.4525,  0.2914,  0.8900,  0.6462,  0.2166,
         0.7046,  0.5770,  0.4561,  0.8497,  0.7542,  0.3756,  0.3796,
         0.8539,  0.1670,  0.6397,  0.3638,  0.5389,  0.7671,  0.5932,
         0.8244,  0.8928,  0.9725,  0.6544,  0.5989,  0.6590,  0.6080,
         0.7683,  0.4777,  0.8585,  0.8134,  0.7378,  0.6689,  0.2974,
         0.2104,  0.6511,  0.4233,  0.5380,  0.8889,  0.6755,  0.3424,
         0.1691,  0.3381,  0.2539,  0.9660,  0.8131,  0.5191,  0.6642,
         0.9355,  0.7142,  0.7119,  0.4118,  0.8528,  0.2456,  0.6195,
         0.2743,  0.9087,  0.6931,  0.4751,  0.8887,  0.0545,  0.1576,
         0.2623,  0.4665,  0.3368,  0.6638,  0.6642,  0.7266,  0.2324,
         0.1228,  0.7589,  0.5502,  0.2647,  0.7706,  0.0576,  0.7719,
         0.1117,  0.6847,  0.7035,  0.6015,  0.3229,  0.2421,  0.5742,
         0.1751,  0.4299,  0.5296,  0.5824,  0.7995,  0.2019,  0.6721,
         0.1167,  0.6109,  0.3236,  0.3796,  0.5724,  0.7954,  0.8202,
         0.6945,  0.3904,  0.5272,  0.8900,  0.5824,  0.8540,  0.3588,
         0.6526,  0.1236,  0.2337,  0.7679,  0.2805,  0.6382,  0.7609,
         0.7541,  0.3748,  0.2934,  0.2411,  0.8319,  0.1577,  0.6324,
         0.2973,  0.3188,  0.7854,  0.7351,  0.6132,  0.9333,  0.8616,
         0.6631,  0.1924,  0.7090,  0.3108,  0.6853,  0.8322,  0.8513,
         0.5055,  0.5480,  0.1094,  0.6734,  0.6156,  0.4997,  0.4653,
         0.0596,  0.5933,  0.6329,  0.5363,  0.4391,  0.6351,  0.5983,
         0.9682,  0.5752,  0.5256,  0.3308,  0.2831,  0.2650,  0.8635,
         0.9162,  0.4289,  0.7349,  0.4327,  0.5967,  0.3624,  0.9327,
         0.1608,  0.6160,  0.1336,  0.4596,  0.2620,  0.2026,  0.3658,
         0.4424,  0.6287,  0.3354,  0.6967,  0.5327,  0.4622,  0.7407,
         0.4956], device='cuda:0')
tensor(0.4907, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5812,  0.2194,  0.8590,  0.8161,  0.7681,  0.6406,  0.4141,
         0.3396,  0.8433,  0.9275,  0.9875,  0.1932,  0.6469,  0.9382,
         0.6801,  0.2771,  0.0835,  0.7801,  0.0591,  0.3675,  0.4027,
         0.1472,  0.3986,  0.3158,  0.3056,  0.5201,  0.2927,  0.6279,
         0.8666,  0.2348,  0.3791,  0.3322,  0.1102,  0.4791,  0.2723,
         0.2606,  0.7613,  0.3998,  0.2536,  0.5145,  0.1190,  0.9471,
         0.2396,  0.1703,  0.8010,  0.8175,  0.6955,  0.7023,  0.7817,
         0.6204,  0.3305,  0.6555,  0.3415,  0.3606,  0.4307,  0.7857,
         0.3127,  0.0492,  0.4055,  0.3936,  0.3568,  0.8186,  0.2014,
         0.4219,  0.1953,  0.6508,  0.5098,  0.4660,  0.4268,  0.7555,
         0.6854,  0.4383,  0.1818,  0.6460,  0.7468,  0.2269,  0.6627,
         0.2357,  0.0838,  0.5783,  0.8041,  0.5901,  0.4689,  0.5606,
         0.3922,  0.3039,  0.3559,  0.2665,  0.7591,  0.8819,  0.6999,
         0.3578,  0.3509,  0.4494,  0.2676,  0.8342,  0.8031,  0.1409,
         0.9129,  0.8356,  0.1088,  0.3862,  0.5585,  0.7278,  0.8626,
         0.9196,  0.5476,  0.2954,  0.5717,  0.1881,  0.6359,  0.6961,
         0.7471,  0.8159,  0.5192,  0.7245,  0.5071,  0.9902,  0.3512,
         0.3391,  0.3021,  0.1943,  0.6548,  0.9798,  0.2317,  0.4025,
         0.4806,  0.7031,  0.2760,  0.3861,  0.6127,  0.6924,  0.5534,
         0.9343,  0.3771,  0.6170,  0.3130,  0.9756,  0.1470,  0.9315,
         0.6344,  0.8013,  0.5385,  0.5292,  0.2755,  0.7339,  0.6662,
         0.7138,  0.2757,  0.7952,  0.2897,  0.4492,  0.3604,  0.9206,
         0.3900,  0.3849,  0.4938,  0.1875,  0.7469,  0.9888,  0.7756,
         0.9051,  0.0678,  0.3350,  0.1236,  0.2867,  0.2939,  0.1743,
         0.9270,  0.9870,  0.3916,  0.3370,  0.5308,  0.9213,  0.1369,
         0.4561,  0.8556,  0.3718,  0.5000,  0.2775,  0.7045,  0.5262,
         0.9705,  0.0873,  0.2818,  0.8425,  0.0976,  0.7109,  0.8005,
         0.8882,  0.2492,  0.6294,  0.6115,  0.3431,  0.0357,  0.5650,
         0.9414,  0.2774,  0.7683,  0.0624,  0.1751,  0.6404,  0.1435,
         0.3009,  0.9137,  0.2761,  0.8819,  0.0828,  0.4996,  0.8717,
         0.9563,  0.6095,  0.2494,  0.1603,  0.7723,  0.4026,  0.4882,
         0.3452,  0.2718,  0.9411,  0.7115,  0.6346,  0.3436,  0.2256,
         0.0903,  0.3228,  0.0565,  0.4266,  0.4131,  0.5453,  0.4444,
         0.6278,  0.8947,  0.6942,  0.7024,  0.2680,  0.5906,  0.3541,
         0.7288,  0.6809,  0.5005,  0.3427,  0.5384,  0.1829,  0.6575,
         0.6340,  0.9823,  0.7189,  0.7009,  0.6530,  0.1993,  0.5653,
         0.4377,  0.2426,  0.3887,  0.8884,  0.5189,  0.7771,  0.5501,
         0.8624,  0.1549,  0.4805,  0.4476,  0.7206,  0.9423,  0.3898,
         0.9632,  0.5136,  0.2044,  0.1173,  0.3676,  0.6960,  0.3078,
         0.2028,  0.6955,  0.9462,  0.1259,  0.8281,  0.4649,  0.7339,
         0.9692,  0.1995,  0.9416,  0.9857,  0.9496,  0.7213,  0.1867,
         0.7155,  0.3167,  0.9372,  0.6612,  0.7714,  0.2334,  0.2961,
         0.6612,  0.3050,  0.3359,  0.2115,  0.6955,  0.5442,  0.1619,
         0.1499,  0.1907,  0.9804,  0.5726,  0.5465,  0.1599,  0.7575,
         0.8398,  0.3326,  0.7000,  0.5557,  0.2797,  0.1441,  0.8394,
         0.6068,  0.8251,  0.7550,  0.3194,  0.6803,  0.2018,  0.1432,
         0.3418,  0.7583,  0.3891,  0.3123,  0.2441,  0.4124,  0.8753,
         0.5020,  0.4468,  0.1625,  0.4699,  0.2629,  0.4126,  0.6342,
         0.8341,  0.5735,  0.3530,  0.4815,  0.9513,  0.5601,  0.0883,
         0.1196,  0.1266,  0.2342,  0.2797,  0.6739,  0.1579,  0.7535,
         0.5492,  0.3826,  0.8206,  0.8434,  0.9322,  0.5107,  0.6399,
         0.1286,  0.6333,  0.7978,  0.7117,  0.3731,  0.3530,  0.0746,
         0.2860,  0.4460,  0.5594,  0.6556,  0.7716,  0.0867,  0.0706,
         0.1613,  0.6377,  0.2674,  0.2951,  0.1691,  0.2269,  0.8032,
         0.7307,  0.2884,  0.6707,  0.7653,  0.6409,  0.5702,  0.6009,
         0.1895,  0.0559,  0.8655,  0.2790,  0.3672,  0.3898,  0.1611,
         0.5109,  0.2980,  0.7393,  0.6816,  0.3123,  0.8629,  0.6570,
         0.9400,  0.5415,  0.8240,  0.8879,  0.8444,  0.5252,  0.3578,
         0.2296,  0.7078,  0.0452,  0.5301,  0.6595,  0.3898,  0.5350,
         0.2136,  0.9230,  0.5184,  0.0558,  0.2029,  0.5817,  0.3027,
         0.6881,  0.5917,  0.2687,  0.2376,  0.7040,  0.1367,  0.4753,
         0.0976,  0.9582,  0.7790,  0.7922,  0.1963,  0.1735,  0.7037,
         0.3629,  0.7706,  0.3921,  0.8978,  0.6096,  0.7645,  0.1094,
         0.0944,  0.7508,  0.2135,  0.8637,  0.8513,  0.6250,  0.5440,
         0.6264,  0.4853,  0.1788,  0.6072,  0.6310,  0.1649,  0.3809,
         0.8599,  0.2051,  0.1580,  0.6860,  0.2344,  0.4794,  0.2200,
         0.1778,  0.8650,  0.6782,  0.3731,  0.6515,  0.7288,  0.6623,
         0.5808,  0.1464,  0.4163,  0.7162,  0.7152,  0.8997,  0.6930,
         0.2982,  0.3383,  0.3302,  0.8708,  0.8427,  0.3509,  0.3320,
         0.7720,  0.8377,  0.5191,  0.8951,  0.8280,  0.1646,  0.8704,
         0.8951,  0.6013,  0.6856,  0.8372,  0.6311,  0.9458,  0.3407,
         0.0484,  0.4270,  0.5525,  0.2099,  0.7707,  0.2399,  0.2305,
         0.9806,  0.1799,  0.2249,  0.6210,  0.8252,  0.4472,  0.8145,
         0.6051], device='cuda:0')
tensor(0.4901, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6496,  0.6695,  0.5921,  0.5147,  0.2373,  0.6368,  0.6341,
         0.6376,  0.1131,  0.6267,  0.1676,  0.4369,  0.4432,  0.4196,
         0.2049,  0.3566,  0.9382,  0.8438,  0.9437,  0.3737,  0.7609,
         0.6774,  0.4690,  0.3965,  0.1200,  0.7819,  0.2356,  0.3380,
         0.1995,  0.1550,  0.1119,  0.7777,  0.1459,  0.2940,  0.7784,
         0.0101,  0.7259,  0.7072,  0.2684,  0.7007,  0.7516,  0.7964,
         0.5952,  0.4441,  0.6984,  0.6296,  0.2185,  0.5716,  0.0675,
         0.4128,  0.6195,  0.7390,  0.3683,  0.5752,  0.4118,  0.7566,
         0.2408,  0.5343,  0.3243,  0.5305,  0.3364,  0.8527,  0.3143,
         0.1004,  0.7650,  0.2671,  0.8609,  0.4729,  0.8809,  0.0930,
         0.9149,  0.7458,  0.2048,  0.4490,  0.1120,  0.6695,  0.8411,
         0.7965,  0.3952,  0.7953,  0.4380,  0.3404,  0.1637,  0.3841,
         0.7917,  0.1237,  0.5476,  0.2532,  0.3145,  0.9195,  0.7579,
         0.7468,  0.8687,  0.7317,  0.2125,  0.3953,  0.6572,  0.4397,
         0.2124,  0.6971,  0.8850,  0.5742,  0.1250,  0.4933,  0.2687,
         0.8917,  0.3404,  0.5789,  0.2642,  0.2656,  0.3614,  0.6993,
         0.3674,  0.0508,  0.8491,  0.5946,  0.2127,  0.6394,  0.5747,
         0.3940,  0.9762,  0.4862,  0.8504,  0.7831,  0.2252,  0.1075,
         0.6864,  0.1695,  0.1362,  0.8975,  0.2205,  0.8254,  0.6719,
         0.3835,  0.5087,  0.9692,  0.6028,  0.6503,  0.5948,  0.6787,
         0.6095,  0.9215,  0.0941,  0.3169,  0.6390,  0.7475,  0.7715,
         0.8578,  0.4801,  0.7587,  0.2062,  0.7064,  0.6328,  0.0942,
         0.4333,  0.1152,  0.3581,  0.1506,  0.8541,  0.3262,  0.8438,
         0.6887,  0.5552,  0.9922,  0.1983,  0.5862,  0.1716,  0.4880,
         0.2658,  0.6971,  0.3561,  0.3930,  0.5328,  0.5408,  0.8617,
         0.4084,  0.5408,  0.8434,  0.3314,  0.4450,  0.0834,  0.7920,
         0.2565,  0.4891,  0.0798,  0.6405,  0.3367,  0.7417,  0.7604,
         0.4426,  0.3954,  0.7539,  0.7223,  0.4176,  0.4976,  0.7526,
         0.1500,  0.9855,  0.4147,  0.3191,  0.3172,  0.4155,  0.8015,
         0.7701,  0.6974,  0.2067,  0.2807,  0.8775,  0.3845,  0.6878,
         0.3311,  0.3795,  0.2721,  0.3603,  0.3908,  0.4919,  0.1807,
         0.2077,  0.2208,  0.6075,  0.1340,  0.8409,  0.6032,  0.6441,
         0.4465,  0.8192,  0.2552,  0.6944,  0.1889,  0.4462,  0.1720,
         0.2248,  0.7685,  0.7329,  0.3121,  0.5025,  0.8938,  0.0237,
         0.4829,  0.6190,  0.4045,  0.3301,  0.1233,  0.6535,  0.1929,
         0.2035,  0.5533,  0.1597,  0.0687,  0.2202,  0.7477,  0.6356,
         0.5539,  0.3706,  0.6218,  0.0733,  0.7555,  0.9292,  0.1853,
         0.1175,  0.2243,  0.7693,  0.4976,  0.3671,  0.7643,  0.2440,
         0.3270,  0.4161,  0.8216,  0.2590,  0.3008,  0.9171,  0.3571,
         0.7720,  0.7766,  0.6802,  0.0874,  0.1868,  0.3525,  0.1630,
         0.3329,  0.2948,  0.2137,  0.5541,  0.7523,  0.9080,  0.7763,
         0.3199,  0.3169,  0.3279,  0.7835,  0.7030,  0.6189,  0.5866,
         0.2083,  0.6940,  0.3097,  0.6131,  0.4569,  0.6448,  0.5945,
         0.6132,  0.2301,  0.3066,  0.7610,  0.9100,  0.6100,  0.3894,
         0.2714,  0.6012,  0.2605,  0.6015,  0.2497,  0.3894,  0.3449,
         0.9107,  0.8839,  0.9098,  0.4706,  0.8987,  0.0166,  0.4171,
         0.7522,  0.2513,  0.0424,  0.6245,  0.3146,  0.5730,  0.4001,
         0.6648,  0.2035,  0.3145,  0.1808,  0.6327,  0.9007,  0.1735,
         0.2547,  0.2384,  0.9373,  0.2607,  0.1634,  0.1010,  0.7717,
         0.2697,  0.2689,  0.8158,  0.4697,  0.8235,  0.1060,  0.7938,
         0.1779,  0.3810,  0.0678,  0.4748,  0.2590,  0.8763,  0.2346,
         0.6111,  0.3710,  0.2496,  0.7285,  0.3767,  0.2472,  0.4511,
         0.2396,  0.5832,  0.8977,  0.2273,  0.4027,  0.8862,  0.6891,
         0.2841,  0.2531,  0.5217,  0.4126,  0.6360,  0.1513,  0.5001,
         0.2205,  0.7810,  0.3359,  0.4801,  0.1194,  0.8433,  0.7524,
         0.0623,  0.7868,  0.1612,  0.2066,  0.0940,  0.7209,  0.7299,
         0.4248,  0.3527,  0.0637,  0.2666,  0.9929,  0.8700,  0.9268,
         0.7019,  0.8236,  0.4006,  0.0787,  0.0676,  0.6019,  0.5190,
         0.6571,  0.2606,  0.5150,  0.7068,  0.4002,  0.1358,  0.2049,
         0.4331,  0.1423,  0.1878,  0.0288,  0.2268,  0.1251,  0.8766,
         0.9510,  0.7163,  0.1459,  0.2806,  0.8618,  0.5628,  0.6369,
         0.9505,  0.6270,  0.4363,  0.7612,  0.1327,  0.4475,  0.1727,
         0.2531,  0.3383,  0.3291,  0.5923,  0.0610,  0.2126,  0.2556,
         0.5089,  0.0642,  0.1522,  0.2017,  0.2157,  0.3211,  0.3726,
         0.7845,  0.7957,  0.1992,  0.4287,  0.7544,  0.1920,  0.2951,
         0.7796,  0.2247,  0.3304,  0.7786,  0.7184,  0.0612,  0.7324,
         0.5548,  0.2110,  0.8148,  0.3984,  0.6842,  0.0894,  0.1937,
         0.2811,  0.7149,  0.9934,  0.5159,  0.6915,  0.0753,  0.2755,
         0.3359,  0.2059,  0.7834,  0.8197,  0.5073,  0.5881,  0.2053,
         0.4339,  0.2222,  0.4640,  0.8188,  0.0856,  0.7166,  0.4101,
         0.3120,  0.8179,  0.2244,  0.4552,  0.2192,  0.3650,  0.6917,
         0.2158,  0.4913,  0.8203,  0.3637,  0.7593,  0.8784,  0.5004,
         0.7392,  0.3357,  0.6740,  0.9699,  0.2555,  0.1574,  0.6918,
         0.6687], device='cuda:0')
tensor(0.4931, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4776,  0.4962,  0.1841,  0.2704,  0.8351,  0.8964,  0.1402,
         0.8098,  0.6833,  0.9296,  0.1630,  0.5027,  0.5384,  0.3008,
         0.4922,  0.6356,  0.2568,  0.1361,  0.1052,  0.2866,  0.7860,
         0.3802,  0.8137,  0.5668,  0.1646,  0.9415,  0.4390,  0.3087,
         0.2093,  0.7169,  0.2166,  0.9645,  0.2759,  0.2786,  0.8498,
         0.6584,  0.2573,  0.5947,  0.9247,  0.2926,  0.9799,  0.0803,
         0.1554,  0.5908,  0.9877,  0.1810,  0.4867,  0.2106,  0.3915,
         0.5323,  0.9506,  0.9240,  0.6515,  0.4304,  0.1727,  0.7802,
         0.5950,  0.3337,  0.8427,  0.3527,  0.3776,  0.4389,  0.4124,
         0.4178,  0.5329,  0.1017,  0.1857,  0.7898,  0.9522,  0.2083,
         0.8444,  0.9398,  0.4191,  0.9086,  0.0814,  0.7949,  0.6854,
         0.7515,  0.2185,  0.9491,  0.2167,  0.0859,  0.1955,  0.2231,
         0.3863,  0.6733,  0.2344,  0.0579,  0.8747,  0.4020,  0.8326,
         0.7955,  0.3232,  0.6490,  0.1538,  0.9496,  0.7137,  0.9238,
         0.4842,  0.1662,  0.9870,  0.6554,  0.6247,  0.0562,  0.7535,
         0.1176,  0.0379,  0.3158,  0.6923,  0.5519,  0.1385,  0.0678,
         0.8919,  0.4338,  0.3142,  0.2449,  0.7185,  0.7257,  0.3761,
         0.4995,  0.1810,  0.4469,  0.6413,  0.6745,  0.8183,  0.8037,
         0.9193,  0.4996,  0.7293,  0.2006,  0.6988,  0.4168,  0.3261,
         0.5745,  0.2995,  0.2530,  0.3880,  0.2988,  0.2701,  0.3168,
         0.5744,  0.8901,  0.4245,  0.1376,  0.6362,  0.9482,  0.1846,
         0.8997,  0.5468,  0.2899,  0.1286,  0.2989,  0.4100,  0.1941,
         0.8632,  0.7936,  0.8284,  0.1053,  0.7852,  0.0768,  0.5633,
         0.4406,  0.6870,  0.0636,  0.7324,  0.6465,  0.1106,  0.1278,
         0.0363,  0.8652,  0.7679,  0.7654,  0.3879,  0.6042,  0.8332,
         0.4553,  0.9743,  0.3591,  0.9836,  0.5808,  0.8236,  0.7249,
         0.9429,  0.1617,  0.8741,  0.0450,  0.9714,  0.8563,  0.7000,
         0.5137,  0.2461,  0.3542,  0.1477,  0.3039,  0.4536,  0.2548,
         0.8044,  0.2423,  0.7349,  0.6374,  0.1329,  0.2247,  0.4779,
         0.7727,  0.2372,  0.6793,  0.1766,  0.4202,  0.2942,  0.2442,
         0.9533,  0.3685,  0.2483,  0.7438,  0.0920,  0.2135,  0.1390,
         0.9110,  0.1179,  0.0568,  0.1498,  0.6685,  0.8640,  0.8446,
         0.7045,  0.4050,  0.2409,  0.7791,  0.8430,  0.2498,  0.2623,
         0.9869,  0.8488,  0.8189,  0.8758,  0.1555,  0.9021,  0.4423,
         0.9351,  0.3201,  0.3625,  0.1312,  0.2156,  0.9064,  0.4051,
         0.1133,  0.2404,  0.7437,  0.6891,  0.1794,  0.9030,  0.2792,
         0.8502,  0.6293,  0.7763,  0.0445,  0.0780,  0.6196,  0.1864,
         0.3700,  0.2366,  0.8892,  0.2409,  0.7103,  0.6153,  0.6623,
         0.8751,  0.4551,  0.4990,  0.2546,  0.3471,  0.1350,  0.1217,
         0.1385,  0.8859,  0.4250,  0.4630,  0.4941,  0.8444,  0.6209,
         0.4111,  0.0605,  0.1211,  0.6883,  0.3129,  0.8648,  0.2813,
         0.3759,  0.7790,  0.1853,  0.3671,  0.7318,  0.8442,  0.2126,
         0.5824,  0.2205,  0.9359,  0.4255,  0.4926,  0.6940,  0.2901,
         0.2740,  0.2246,  0.4491,  0.7299,  0.4494,  0.4064,  0.1100,
         0.1323,  0.3874,  0.8147,  0.5082,  0.1808,  0.4729,  0.8704,
         0.1690,  0.9724,  0.8629,  0.6661,  0.7979,  0.7104,  0.3614,
         0.2813,  0.1863,  0.7143,  0.8012,  0.1201,  0.1928,  0.0546,
         0.4235,  0.6477,  0.4769,  0.3938,  0.6433,  0.4583,  0.1073,
         0.4258,  0.7444,  0.6733,  0.6609,  0.8077,  0.8059,  0.3769,
         0.7083,  0.7173,  0.0467,  0.3355,  0.8772,  0.1371,  0.0657,
         0.2965,  0.7350,  0.3350,  0.9513,  0.3809,  0.3838,  0.7660,
         0.2198,  0.4589,  0.3239,  0.7059,  0.8948,  0.2704,  0.3017,
         0.2701,  0.3286,  0.4600,  0.4888,  0.4673,  0.3633,  0.3451,
         0.4760,  0.1330,  0.0593,  0.3429,  0.7248,  0.1349,  0.7236,
         0.7349,  0.1972,  0.7850,  0.8959,  0.4423,  0.2538,  0.4064,
         0.0920,  0.3853,  0.6681,  0.4298,  0.7310,  0.8476,  0.8006,
         0.6986,  0.8366,  0.7997,  0.3107,  0.2849,  0.5655,  0.3522,
         0.4932,  0.3316,  0.0666,  0.2825,  0.7988,  0.4086,  0.6287,
         0.8861,  0.6603,  0.5601,  0.5281,  0.9617,  0.6829,  0.2932,
         0.0716,  0.2993,  0.2055,  0.8476,  0.1397,  0.3398,  0.2205,
         0.5778,  0.3100,  0.4105,  0.0786,  0.9857,  0.9445,  0.8704,
         0.3623,  0.9186,  0.9159,  0.8575,  0.6824,  0.3061,  0.8403,
         0.3075,  0.3272,  0.9447,  0.5357,  0.8575,  0.7470,  0.1332,
         0.3789,  0.7607,  0.0677,  0.7182,  0.8094,  0.8735,  0.1272,
         0.7740,  0.5329,  0.4994,  0.8227,  0.0267,  0.7239,  0.0519,
         0.9158,  0.1128,  0.6043,  0.4614,  0.0601,  0.4618,  0.6793,
         0.0901,  0.4049,  0.3940,  0.6270,  0.2371,  0.2941,  0.2246,
         0.5743,  0.7401,  0.5924,  0.1717,  0.1866,  0.1497,  0.8402,
         0.1284,  0.5850,  0.8568,  0.1491,  0.6710,  0.7376,  0.6636,
         0.2882,  0.3728,  0.1340,  0.4046,  0.7472,  0.6055,  0.6639,
         0.6916,  0.1655,  0.8724,  0.1769,  0.4909,  0.3488,  0.8046,
         0.6436,  0.4672,  0.7300,  0.3378,  0.9143,  0.3028,  0.6306,
         0.1427,  0.1006,  0.2138,  0.6051,  0.1068,  0.6670,  0.5833,
         0.2438], device='cuda:0')
tensor(0.4703, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8820,  0.1451,  0.8005,  0.8418,  0.7490,  0.5132,  0.1784,
         0.3879,  0.4255,  0.1377,  0.2005,  0.8458,  0.8508,  0.2527,
         0.4663,  0.0812,  0.3091,  0.0811,  0.8260,  0.9603,  0.7913,
         0.9603,  0.0515,  0.0866,  0.3363,  0.9410,  0.4562,  0.8047,
         0.7822,  0.1462,  0.6858,  0.2838,  0.1456,  0.2805,  0.6160,
         0.3823,  0.9721,  0.4256,  0.1165,  0.7218,  0.5837,  0.7043,
         0.9256,  0.0890,  0.6219,  0.7911,  0.2817,  0.5615,  0.3383,
         0.4649,  0.0960,  0.7021,  0.7369,  0.5526,  0.2849,  0.8232,
         0.2715,  0.0844,  0.6459,  0.0662,  0.9016,  0.6211,  0.7469,
         0.3824,  0.6005,  0.2166,  0.9203,  0.1382,  0.2181,  0.7522,
         0.3323,  0.4109,  0.0776,  0.1620,  0.5613,  0.6571,  0.1671,
         0.6149,  0.3803,  0.3415,  0.3110,  0.1761,  0.4710,  0.8462,
         0.1419,  0.7228,  0.1609,  0.8756,  0.4593,  0.6177,  0.0337,
         0.1355,  0.4333,  0.0828,  0.2494,  0.8455,  0.1884,  0.8279,
         0.3187,  0.1863,  0.1743,  0.4616,  0.6658,  0.0785,  0.9073,
         0.8126,  0.1148,  0.2948,  0.4402,  0.1357,  0.5170,  0.8630,
         0.6800,  0.7689,  0.6041,  0.7027,  0.4161,  0.4468,  0.3937,
         0.3770,  0.9439,  0.4316,  0.7636,  0.9668,  0.4305,  0.2928,
         0.1751,  0.2666,  0.7946,  0.1873,  0.4725,  0.2476,  0.7658,
         0.2163,  0.6573,  0.9203,  0.8535,  0.0938,  0.0784,  0.7010,
         0.3678,  0.5214,  0.1269,  0.1357,  0.5852,  0.7491,  0.0961,
         0.1684,  0.1585,  0.4131,  0.3277,  0.3188,  0.9633,  0.2362,
         0.0821,  0.3090,  0.5481,  0.2142,  0.6719,  0.9479,  0.0763,
         0.2191,  0.2382,  0.1582,  0.3165,  0.6696,  0.0838,  0.8122,
         0.3192,  0.4427,  0.1948,  0.9353,  0.2345,  0.4204,  0.2559,
         0.3129,  0.4593,  0.7297,  0.9878,  0.7098,  0.6211,  0.0814,
         0.8385,  0.0965,  0.9226,  0.6783,  0.8955,  0.8247,  0.7361,
         0.0991,  0.8110,  0.3611,  0.7007,  0.6159,  0.6715,  0.4552,
         0.1558,  0.6894,  0.2596,  0.6337,  0.9461,  0.2772,  0.3921,
         0.5656,  0.4458,  0.5737,  0.2149,  0.0693,  0.8551,  0.9348,
         0.8149,  0.9739,  0.7363,  0.2020,  0.7364,  0.3780,  0.6363,
         0.2698,  0.0611,  0.0650,  0.6239,  0.9371,  0.2629,  0.6697,
         0.9020,  0.1325,  0.3952,  0.1324,  0.7285,  0.9842,  0.5421,
         0.3651,  0.2781,  0.0761,  0.7297,  0.6517,  0.6377,  0.9005,
         0.6909,  0.3240,  0.8441,  0.4019,  0.2940,  0.7631,  0.4126,
         0.3017,  0.0799,  0.9024,  0.7226,  0.6150,  0.6118,  0.3149,
         0.1040,  0.1844,  0.2467,  0.7588,  0.5991,  0.0528,  0.7179,
         0.5758,  0.5231,  0.7132,  0.4353,  0.7574,  0.0929,  0.7375,
         0.6233,  0.3539,  0.1944,  0.8002,  0.2933,  0.8784,  0.9308,
         0.2049,  0.6983,  0.8814,  0.6020,  0.3511,  0.0340,  0.9486,
         0.7900,  0.1818,  0.5443,  0.8448,  0.0760,  0.6023,  0.8316,
         0.1006,  0.7453,  0.1436,  0.5233,  0.7809,  0.3698,  0.8794,
         0.3127,  0.1410,  0.4390,  0.5648,  0.9780,  0.0437,  0.6395,
         0.1329,  0.1458,  0.1715,  0.2020,  0.3155,  0.5890,  0.4698,
         0.1050,  0.5030,  0.2465,  0.3981,  0.4390,  0.4827,  0.2243,
         0.7068,  0.6161,  0.3509,  0.1675,  0.5736,  0.7105,  0.6766,
         0.3000,  0.8009,  0.1736,  0.7407,  0.2586,  0.2259,  0.1272,
         0.1694,  0.6231,  0.1994,  0.8922,  0.2458,  0.7011,  0.9286,
         0.0774,  0.1189,  0.6952,  0.7079,  0.2112,  0.2130,  0.7607,
         0.7427,  0.6835,  0.3586,  0.1120,  0.6244,  0.0740,  0.0915,
         0.2066,  0.7427,  0.7700,  0.1315,  0.1610,  0.9480,  0.3784,
         0.9811,  0.5506,  0.6222,  0.5519,  0.1457,  0.8396,  0.1559,
         0.5383,  0.4433,  0.4563,  0.6749,  0.0801,  0.8304,  0.9030,
         0.7625,  0.1934,  0.3601,  0.0872,  0.7509,  0.3141,  0.9739,
         0.8235,  0.2881,  0.2541,  0.1044,  0.4294,  0.0706,  0.3888,
         0.8783,  0.6767,  0.0904,  0.3209,  0.3184,  0.3041,  0.9358,
         0.3100,  0.7105,  0.6221,  0.4363,  0.1089,  0.0968,  0.3463,
         0.0446,  0.4365,  0.8669,  0.8685,  0.9654,  0.2247,  0.1901,
         0.2466,  0.4090,  0.1701,  0.2075,  0.4527,  0.9132,  0.2146,
         0.8337,  0.7046,  0.5962,  0.2914,  0.6626,  0.8857,  0.1122,
         0.0487,  0.6496,  0.1123,  0.7371,  0.2397,  0.7640,  0.2679,
         0.7185,  0.9223,  0.7252,  0.1996,  0.5783,  0.3187,  0.3653,
         0.1519,  0.3405,  0.3142,  0.7222,  0.2389,  0.2794,  0.4307,
         0.6763,  0.3116,  0.6690,  0.7741,  0.9280,  0.0609,  0.4969,
         0.2457,  0.9931,  0.1638,  0.2393,  0.5388,  0.2857,  0.2288,
         0.3184,  0.7187,  0.8024,  0.4439,  0.2498,  0.0381,  0.5384,
         0.8746,  0.2625,  0.9045,  0.9212,  0.7275,  0.9580,  0.3687,
         0.7695,  0.1909,  0.8445,  0.8109,  0.2655,  0.1037,  0.5806,
         0.8384,  0.9289,  0.3230,  0.1310,  0.8992,  0.9414,  0.8223,
         0.1839,  0.7606,  0.1968,  0.7856,  0.7575,  0.4557,  0.9773,
         0.0532,  0.9165,  0.0297,  0.0756,  0.1632,  0.6863,  0.8032,
         0.6052,  0.1985,  0.8702,  0.4259,  0.3395,  0.6280,  0.2122,
         0.2890,  0.8544,  0.8602,  0.9639,  0.1185,  0.3325,  0.2593,
         0.5306], device='cuda:0')
tensor(0.5172, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1593,  0.2497,  0.1622,  0.7022,  0.5062,  0.2044,  0.7654,
         0.0252,  0.8119,  0.9197,  0.8193,  0.4169,  0.1615,  0.4283,
         0.6067,  0.1916,  0.4711,  0.2830,  0.8988,  0.7290,  0.6757,
         0.0799,  0.2293,  0.0571,  0.0144,  0.6600,  0.2800,  0.6636,
         0.0382,  0.0954,  0.1143,  0.2718,  0.9311,  0.5522,  0.7593,
         0.0782,  0.4057,  0.5809,  0.7601,  0.3033,  0.7065,  0.9961,
         0.8779,  0.6821,  0.1694,  0.7332,  0.6991,  0.7710,  0.1284,
         0.1789,  0.1597,  0.1157,  0.1562,  0.1055,  0.2061,  0.1350,
         0.8744,  0.1647,  0.7764,  0.9294,  0.3219,  0.2910,  0.2476,
         0.9224,  0.8322,  0.3265,  0.8991,  0.7019,  0.9732,  0.9174,
         0.0603,  0.1204,  0.0782,  0.4994,  0.1010,  0.6588,  0.5246,
         0.0843,  0.4305,  0.1114,  0.0352,  0.2613,  0.9008,  0.0330,
         0.9052,  0.8081,  0.3063,  0.7471,  0.9311,  0.7593,  0.8927,
         0.3598,  0.1932,  0.3349,  0.1202,  0.5201,  0.2534,  0.9165,
         0.8697,  0.1245,  0.5298,  0.2323,  0.9255,  0.0396,  0.5410,
         0.9024,  0.2807,  0.0808,  0.7643,  0.0638,  0.9549,  0.4568,
         0.2955,  0.0967,  0.7637,  0.1274,  0.4314,  0.1827,  0.2009,
         0.2886,  0.9137,  0.0150,  0.7557,  0.1679,  0.1391,  0.3759,
         0.9115,  0.6047,  0.8995,  0.2321,  0.4430,  0.8364,  0.5676,
         0.1390,  0.6828,  0.2009,  0.7476,  0.8665,  0.0574,  0.8881,
         0.1260,  0.1786,  0.7134,  0.8120,  0.0604,  0.4931,  0.7834,
         0.1041,  0.6046,  0.6185,  0.4742,  0.7516,  0.0911,  0.9792,
         0.1638,  0.5620,  0.9548,  0.8565,  0.1956,  0.1237,  0.1627,
         0.8441,  0.2152,  0.6134,  0.5142,  0.1177,  0.6434,  0.4778,
         0.9191,  0.3682,  0.5322,  0.6846,  0.7695,  0.0964,  0.1758,
         0.3172,  0.4423,  0.1329,  0.1597,  0.8764,  0.2987,  0.2473,
         0.3903,  0.1685,  0.8631,  0.8034,  0.8136,  0.5156,  0.5259,
         0.9246,  0.0259,  0.4469,  0.6793,  0.1153,  0.7205,  0.9466,
         0.7133,  0.1421,  0.2963,  0.2393,  0.6681,  0.8409,  0.1795,
         0.0558,  0.0763,  0.6837,  0.1559,  0.2095,  0.7284,  0.9328,
         0.9513,  0.3910,  0.2919,  0.8378,  0.7667,  0.8273,  0.2601,
         0.9040,  0.7398,  0.1773,  0.2789,  0.0412,  0.5994,  0.1756,
         0.1880,  0.8053,  0.2507,  0.8927,  0.2987,  0.8931,  0.9042,
         0.7437,  0.1308,  0.5794,  0.0684,  0.8971,  0.3523,  0.8488,
         0.8060,  0.3485,  0.7651,  0.1107,  0.0411,  0.8611,  0.3208,
         0.8671,  0.3117,  0.8429,  0.8043,  0.7055,  0.1541,  0.4513,
         0.1285,  0.7276,  0.8961,  0.7849,  0.3200,  0.8508,  0.9287,
         0.3353,  0.3205,  0.8520,  0.1236,  0.0153,  0.5156,  0.8642,
         0.7291,  0.5975,  0.8579,  0.1476,  0.8883,  0.3244,  0.1865,
         0.1805,  0.6291,  0.3267,  0.8299,  0.1038,  0.4619,  0.9163,
         0.3934,  0.7878,  0.3541,  0.8957,  0.0250,  0.2814,  0.6901,
         0.8055,  0.9634,  0.6342,  0.3940,  0.2618,  0.8561,  0.1017,
         0.8447,  0.3059,  0.9440,  0.0666,  0.3053,  0.7122,  0.7453,
         0.9375,  0.8269,  0.9117,  0.8991,  0.1754,  0.1923,  0.3444,
         0.8059,  0.2633,  0.2133,  0.3967,  0.3283,  0.8358,  0.0455,
         0.9350,  0.2122,  0.9068,  0.3288,  0.3190,  0.0686,  0.6324,
         0.6781,  0.1979,  0.7928,  0.7070,  0.1706,  0.0572,  0.3844,
         0.3621,  0.9624,  0.1868,  0.9739,  0.9859,  0.6912,  0.9925,
         0.8972,  0.8707,  0.2235,  0.8682,  0.9735,  0.8522,  0.7987,
         0.8350,  0.7848,  0.0400,  0.8964,  0.3088,  0.2504,  0.8644,
         0.3334,  0.1620,  0.5880,  0.9533,  0.8387,  0.6810,  0.4313,
         0.5226,  0.0982,  0.9529,  0.2673,  0.1707,  0.1897,  0.7689,
         0.6745,  0.0402,  0.3233,  0.5881,  0.9666,  0.8304,  0.7266,
         0.8717,  0.7896,  0.7187,  0.2742,  0.2468,  0.3011,  0.6414,
         0.4703,  0.0423,  0.2346,  0.8095,  0.7659,  0.0647,  0.9107,
         0.0537,  0.6273,  0.9139,  0.5949,  0.7168,  0.1056,  0.7840,
         0.0933,  0.4840,  0.2547,  0.3851,  0.2519,  0.0680,  0.9209,
         0.7496,  0.5495,  0.8999,  0.2003,  0.3357,  0.6429,  0.8980,
         0.1322,  0.4709,  0.8703,  0.1371,  0.0358,  0.1272,  0.8297,
         0.7227,  0.6516,  0.2218,  0.2383,  0.9254,  0.5369,  0.1303,
         0.1971,  0.0868,  0.8520,  0.8014,  0.9093,  0.8500,  0.0727,
         0.1489,  0.4962,  0.1328,  0.3162,  0.0972,  0.0275,  0.1173,
         0.7709,  0.3725,  0.3129,  0.8059,  0.4821,  0.0943,  0.2060,
         0.0434,  0.6257,  0.0959,  0.2148,  0.8153,  0.7849,  0.5748,
         0.8042,  0.8740,  0.0391,  0.0876,  0.7862,  0.1470,  0.3945,
         0.2905,  0.3280,  0.8901,  0.9089,  0.0448,  0.8678,  0.6262,
         0.0940,  0.5558,  0.8935,  0.4083,  0.8611,  0.8269,  0.8670,
         0.0316,  0.9036,  0.6006,  0.8761,  0.8545,  0.8937,  0.8841,
         0.0775,  0.9838,  0.0751,  0.7305,  0.6770,  0.5078,  0.2289,
         0.5813,  0.9190,  0.4607,  0.8876,  0.9569,  0.2353,  0.3627,
         0.0305,  0.7580,  0.4471,  0.1936,  0.8668,  0.1844,  0.2138,
         0.1239,  0.9384,  0.3319,  0.8671,  0.3075,  0.0622,  0.1961,
         0.1466,  0.4311,  0.0918,  0.1153,  0.8721,  0.5175,  0.5857,
         0.9397], device='cuda:0')
tensor(0.4191, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0754,  0.9378,  0.6865,  0.0807,  0.1748,  0.0720,  0.1772,
         0.0927,  0.9815,  0.1670,  0.7072,  0.1697,  0.6566,  0.8217,
         0.8954,  0.0880,  0.8529,  0.9175,  0.3295,  0.1671,  0.7789,
         0.1937,  0.2238,  0.7546,  0.4721,  0.0718,  0.7947,  0.4137,
         0.4963,  0.8598,  0.3243,  0.3615,  0.9386,  0.6371,  0.0805,
         0.9024,  0.1523,  0.1122,  0.1877,  0.8498,  0.1013,  0.0615,
         0.7123,  0.0514,  0.9223,  0.0932,  0.7609,  0.1443,  0.9163,
         0.2295,  0.9589,  0.6607,  0.7749,  0.1959,  0.1195,  0.0242,
         0.9227,  0.0810,  0.8793,  0.8051,  0.8799,  0.8650,  0.4848,
         0.6070,  0.9182,  0.9370,  0.8052,  0.7696,  0.7642,  0.4604,
         0.0358,  0.8048,  0.3286,  0.4164,  0.8925,  0.1659,  0.0469,
         0.5335,  0.0843,  0.8569,  0.2686,  0.2133,  0.9149,  0.1198,
         0.1632,  0.8670,  0.6453,  0.1077,  0.9217,  0.9139,  0.0754,
         0.7174,  0.1689,  0.7851,  0.1260,  0.7999,  0.1639,  0.7896,
         0.1756,  0.8519,  0.9145,  0.9456,  0.9230,  0.8722,  0.9056,
         0.7167,  0.8564,  0.2487,  0.9148,  0.0530,  0.8798,  0.0787,
         0.1483,  0.8763,  0.3731,  0.1452,  0.8674,  0.5989,  0.1488,
         0.6073,  0.9514,  0.9255,  0.9213,  0.7488,  0.9322,  0.3834,
         0.8267,  0.0630,  0.8559,  0.0992,  0.6113,  0.1061,  0.2190,
         0.0889,  0.9438,  0.8947,  0.8004,  0.9074,  0.0507,  0.7839,
         0.3200,  0.3352,  0.2513,  0.1215,  0.7736,  0.3128,  0.8576,
         0.9180,  0.1111,  0.7853,  0.5946,  0.8646,  0.0914,  0.7308,
         0.8233,  0.1476,  0.2728,  0.0684,  0.9336,  0.8136,  0.0263,
         0.0606,  0.1561,  0.7935,  0.0794,  0.0650,  0.8561,  0.2154,
         0.9847,  0.8748,  0.2223,  0.0893,  0.8651,  0.1001,  0.8196,
         0.9898,  0.8103,  0.9293,  0.6724,  0.1923,  0.8147,  0.8840,
         0.8987,  0.8487,  0.8355,  0.4968,  0.0645,  0.2083,  0.1471,
         0.4849,  0.8748,  0.0565,  0.5508,  0.9519,  0.0483,  0.8291,
         0.0770,  0.1501,  0.0745,  0.7570,  0.2414,  0.8745,  0.1251,
         0.9661,  0.8225,  0.0295,  0.9465,  0.2575,  0.9312,  0.0944,
         0.4719,  0.6005,  0.1976,  0.5596,  0.0540,  0.6634,  0.8762,
         0.2085,  0.7313,  0.6175,  0.5746,  0.9126,  0.7654,  0.7901,
         0.1597,  0.9087,  0.9107,  0.1473,  0.1460,  0.8718,  0.9874,
         0.9246,  0.0977,  0.9029,  0.8988,  0.8288,  0.7415,  0.3507,
         0.8764,  0.9173,  0.9437,  0.8732,  0.8997,  0.9940,  0.1364,
         0.0777,  0.1567,  0.9885,  0.9133,  0.9927,  0.3170,  0.4237,
         0.0510,  0.7921,  0.8680,  0.9456,  0.5511,  0.6141,  0.9108,
         0.9387,  0.9466,  0.6965,  0.6656,  0.6288,  0.9452,  0.1548,
         0.0956,  0.6646,  0.8918,  0.9366,  0.2283,  0.8781,  0.2846,
         0.8160,  0.8367,  0.9186,  0.8850,  0.6908,  0.8939,  0.3502,
         0.1442,  0.6581,  0.9848,  0.8562,  0.4302,  0.3941,  0.9603,
         0.9519,  0.8649,  0.9117,  0.1564,  0.0815,  0.1590,  0.1140,
         0.7100,  0.9210,  0.1526,  0.3672,  0.8941,  0.2118,  0.1586,
         0.1915,  0.9212,  0.0592,  0.0426,  0.8938,  0.2931,  0.9719,
         0.1089,  0.8620,  0.3668,  0.4026,  0.0943,  0.1530,  0.2405,
         0.0533,  0.2643,  0.7842,  0.8065,  0.8495,  0.3343,  0.7780,
         0.2686,  0.7705,  0.1019,  0.2235,  0.1045,  0.0270,  0.5937,
         0.2143,  0.4193,  0.8759,  0.1164,  0.1968,  0.8861,  0.6804,
         0.2151,  0.1893,  0.0576,  0.0443,  0.8771,  0.0814,  0.4607,
         0.1092,  0.8045,  0.9566,  0.1013,  0.3736,  0.6756,  0.9155,
         0.1887,  0.0441,  0.0988,  0.1497,  0.2093,  0.5492,  0.1701,
         0.9539,  0.2246,  0.1846,  0.7753,  0.8594,  0.8316,  0.7193,
         0.8610,  0.5363,  0.0958,  0.2580,  0.1894,  0.8074,  0.5334,
         0.0356,  0.5702,  0.2350,  0.8345,  0.9029,  0.0510,  0.9164,
         0.7586,  0.3089,  0.2281,  0.0155,  0.0816,  0.1284,  0.1424,
         0.1137,  0.8624,  0.3230,  0.1038,  0.0916,  0.2233,  0.8840,
         0.1697,  0.1797,  0.9169,  0.1910,  0.2478,  0.0946,  0.0727,
         0.8841,  0.8472,  0.1732,  0.9610,  0.1384,  0.0569,  0.8092,
         0.8884,  0.2410,  0.8512,  0.0941,  0.0948,  0.3713,  0.8699,
         0.1850,  0.1844,  0.4052,  0.1705,  0.9569,  0.1711,  0.9485,
         0.9292,  0.9360,  0.1248,  0.9505,  0.3997,  0.4097,  0.9569,
         0.8173,  0.0526,  0.1188,  0.1734,  0.1553,  0.1013,  0.9210,
         0.7939,  0.7479,  0.2742,  0.8753,  0.4468,  0.9305,  0.2456,
         0.4631,  0.6688,  0.8924,  0.8411,  0.9614,  0.0757,  0.9309,
         0.5248,  0.2349,  0.7928,  0.7893,  0.9455,  0.0743,  0.1031,
         0.1785,  0.8502,  0.8296,  0.0570,  0.9412,  0.0461,  0.3730,
         0.1857,  0.0188,  0.9004,  0.0494,  0.9268,  0.7148,  0.8286,
         0.1466,  0.3088,  0.2984,  0.4562,  0.8237,  0.9304,  0.1577,
         0.7993,  0.1347,  0.2435,  0.9784,  0.0493,  0.1513,  0.8884,
         0.6115,  0.1381,  0.7975,  0.6416,  0.0371,  0.0196,  0.9871,
         0.0896,  0.0164,  0.7680,  0.3101,  0.9576,  0.9137,  0.7379,
         0.1163,  0.7165,  0.1676,  0.8716,  0.9347,  0.8278,  0.8172,
         0.7990,  0.8324,  0.7300,  0.2306,  0.9886,  0.0739,  0.4068,
         0.9858], device='cuda:0')
tensor(0.4638, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1226,  0.2847,  0.9151,  0.1687,  0.1053,  0.8735,  0.9721,
         0.2401,  0.9485,  0.7226,  0.3017,  0.0827,  0.2754,  0.8921,
         0.0811,  0.0643,  0.9234,  0.9705,  0.2114,  0.2072,  0.3056,
         0.9877,  0.9917,  0.1979,  0.0724,  0.4378,  0.8382,  0.7916,
         0.8435,  0.9199,  0.0621,  0.1624,  0.1282,  0.9212,  0.7386,
         0.0497,  0.1925,  0.1890,  0.2893,  0.9030,  0.1448,  0.7961,
         0.3074,  0.7398,  0.1621,  0.3433,  0.8282,  0.9880,  0.9000,
         0.0542,  0.2891,  0.1768,  0.8308,  0.0438,  0.1057,  0.1200,
         0.7432,  0.1836,  0.8962,  0.6533,  0.0903,  0.2363,  0.0546,
         0.8881,  0.9657,  0.9321,  0.8339,  0.0892,  0.0656,  0.0255,
         0.7476,  0.9086,  0.1296,  0.0950,  0.7240,  0.0801,  0.6003,
         0.2433,  0.1370,  0.8708,  0.8484,  0.2794,  0.8772,  0.3745,
         0.0310,  0.9340,  0.0331,  0.8885,  0.1050,  0.8538,  0.9099,
         0.9887,  0.6845,  0.2038,  0.3077,  0.6272,  0.7239,  0.8596,
         0.7816,  0.1616,  0.0178,  0.8820,  0.4897,  0.7031,  0.1034,
         0.0940,  0.2047,  0.0668,  0.3781,  0.0914,  0.9022,  0.1267,
         0.6758,  0.2845,  0.1592,  0.0870,  0.7883,  0.0453,  0.5494,
         0.6175,  0.7145,  0.1858,  0.9522,  0.8597,  0.5831,  0.1175,
         0.8401,  0.0616,  0.8540,  0.5477,  0.3592,  0.1870,  0.5246,
         0.0467,  0.7322,  0.1269,  0.7298,  0.8876,  0.3909,  0.0736,
         0.4334,  0.8740,  0.4974,  0.7174,  0.7900,  0.1744,  0.4557,
         0.2974,  0.1428,  0.8139,  0.9318,  0.3378,  0.3426,  0.8449,
         0.0599,  0.6345,  0.0208,  0.8515,  0.6829,  0.8821,  0.0626,
         0.8961,  0.1473,  0.9628,  0.0810,  0.0331,  0.1826,  0.7871,
         0.8218,  0.9673,  0.8096,  0.7969,  0.8451,  0.1058,  0.7087,
         0.0384,  0.2646,  0.6897,  0.0564,  0.3661,  0.0453,  0.3144,
         0.9897,  0.2351,  0.6701,  0.6681,  0.7928,  0.1477,  0.1879,
         0.7535,  0.7836,  0.2675,  0.7703,  0.8851,  0.1593,  0.9868,
         0.0983,  0.0732,  0.5384,  0.8175,  0.9557,  0.2985,  0.9620,
         0.1365,  0.1150,  0.8941,  0.0509,  0.1701,  0.1940,  0.0920,
         0.2382,  0.8495,  0.0481,  0.8914,  0.8957,  0.1455,  0.8165,
         0.8296,  0.0825,  0.6370,  0.6638,  0.8416,  0.8364,  0.9044,
         0.9595,  0.0492,  0.7226,  0.8796,  0.9284,  0.8856,  0.8401,
         0.0569,  0.0949,  0.0353,  0.0562,  0.8384,  0.0425,  0.0387,
         0.9454,  0.0928,  0.1829,  0.1088,  0.9050,  0.0943,  0.3072,
         0.1403,  0.9600,  0.0997,  0.3053,  0.4012,  0.1777,  0.8191,
         0.2254,  0.8690,  0.9625,  0.7262,  0.2543,  0.1009,  0.5142,
         0.9016,  0.7826,  0.1075,  0.2015,  0.1903,  0.2302,  0.1131,
         0.8144,  0.9365,  0.9375,  0.7885,  0.7409,  0.6547,  0.1505,
         0.9439,  0.5486,  0.2208,  0.0885,  0.1517,  0.1643,  0.6551,
         0.0154,  0.6551,  0.7953,  0.8890,  0.9286,  0.1714,  0.2378,
         0.0323,  0.8721,  0.0985,  0.1807,  0.0770,  0.0518,  0.1642,
         0.0817,  0.8848,  0.9697,  0.9246,  0.9146,  0.9369,  0.2335,
         0.2375,  0.2380,  0.7154,  0.9182,  0.9271,  0.9293,  0.3309,
         0.9088,  0.0300,  0.2337,  0.8374,  0.9485,  0.0559,  0.8965,
         0.2582,  0.7877,  0.2594,  0.5387,  0.8197,  0.9109,  0.0605,
         0.7867,  0.1312,  0.2260,  0.0287,  0.1591,  0.1276,  0.3051,
         0.8918,  0.7520,  0.7907,  0.9372,  0.6686,  0.1829,  0.0435,
         0.2718,  0.0248,  0.8918,  0.8311,  0.9548,  0.1223,  0.8367,
         0.9383,  0.5644,  0.8852,  0.8293,  0.2737,  0.8826,  0.1983,
         0.8734,  0.7278,  0.8698,  0.9296,  0.0360,  0.8734,  0.8655,
         0.9347,  0.8178,  0.0855,  0.7090,  0.0996,  0.8694,  0.0532,
         0.0848,  0.7433,  0.3635,  0.7379,  0.8314,  0.4682,  0.8730,
         0.1632,  0.1035,  0.1246,  0.5201,  0.9419,  0.8713,  0.0363,
         0.2598,  0.9947,  0.1577,  0.0877,  0.6541,  0.3310,  0.9644,
         0.7799,  0.9133,  0.1831,  0.3307,  0.0980,  0.8907,  0.3351,
         0.2233,  0.8127,  0.2108,  0.9687,  0.8377,  0.5755,  0.4325,
         0.9485,  0.3421,  0.3538,  0.0996,  0.0994,  0.8650,  0.0304,
         0.9061,  0.5152,  0.4608,  0.2770,  0.6282,  0.3579,  0.4485,
         0.0584,  0.7860,  0.4995,  0.6712,  0.8107,  0.9206,  0.0478,
         0.3337,  0.2092,  0.9677,  0.0782,  0.6348,  0.0872,  0.1894,
         0.0541,  0.8357,  0.1668,  0.8289,  0.2576,  0.1574,  0.1272,
         0.1985,  0.6472,  0.6740,  0.5060,  0.1233,  0.2089,  0.8722,
         0.9380,  0.0324,  0.8831,  0.1022,  0.9620,  0.8825,  0.2257,
         0.0857,  0.3727,  0.5920,  0.1485,  0.5300,  0.9097,  0.8556,
         0.1634,  0.1427,  0.4462,  0.0762,  0.0633,  0.5008,  0.7537,
         0.7602,  0.1211,  0.1426,  0.1142,  0.0794,  0.6922,  0.7775,
         0.0328,  0.1005,  0.8041,  0.9054,  0.9208,  0.0676,  0.2501,
         0.0408,  0.9292,  0.3017,  0.7772,  0.3957,  0.0359,  0.0928,
         0.0877,  0.1266,  0.1043,  0.1011,  0.1330,  0.1312,  0.1847,
         0.9630,  0.9892,  0.0811,  0.1544,  0.2487,  0.0450,  0.0158,
         0.0257,  0.1400,  0.2262,  0.1854,  0.8005,  0.2048,  0.0205,
         0.1066,  0.8593,  0.4064,  0.5546,  0.3851,  0.6852,  0.4403,
         0.3804], device='cuda:0')
tensor(0.5213, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3545,  0.5061,  0.5578,  0.7163,  0.6218,  0.5881,  0.0260,
         0.1489,  0.1083,  0.9792,  0.5825,  0.5716,  0.7632,  0.0764,
         0.6290,  0.7471,  0.6769,  0.8892,  0.9147,  0.1494,  0.9146,
         0.1167,  0.8734,  0.0385,  0.8201,  0.7663,  0.2383,  0.4463,
         0.1611,  0.7811,  0.9738,  0.7439,  0.2660,  0.3972,  0.8533,
         0.2048,  0.1573,  0.2064,  0.7896,  0.3667,  0.4736,  0.1041,
         0.0194,  0.7924,  0.0696,  0.3303,  0.3273,  0.8161,  0.9300,
         0.0300,  0.4585,  0.2485,  0.3801,  0.9374,  0.0776,  0.0849,
         0.2446,  0.7329,  0.4173,  0.0848,  0.0876,  0.8134,  0.1885,
         0.6548,  0.1377,  0.9638,  0.9798,  0.8193,  0.0870,  0.7186,
         0.2029,  0.0192,  0.8579,  0.8313,  0.8358,  0.8647,  0.4309,
         0.1146,  0.0965,  0.0725,  0.9300,  0.8991,  0.1879,  0.1223,
         0.1674,  0.2596,  0.0425,  0.8942,  0.4610,  0.8917,  0.8068,
         0.6370,  0.8002,  0.6530,  0.2178,  0.0970,  0.1251,  0.8648,
         0.5857,  0.5903,  0.8850,  0.0682,  0.2829,  0.7522,  0.3173,
         0.9368,  0.6614,  0.1203,  0.7084,  0.2137,  0.8247,  0.0964,
         0.1444,  0.1873,  0.6756,  0.1001,  0.5566,  0.4792,  0.8965,
         0.2104,  0.4512,  0.9238,  0.0319,  0.2222,  0.0516,  0.6182,
         0.8158,  0.1557,  0.7310,  0.6638,  0.7816,  0.8376,  0.2511,
         0.6392,  0.8104,  0.8594,  0.1973,  0.0902,  0.9260,  0.3322,
         0.7373,  0.0378,  0.0309,  0.8123,  0.6070,  0.7323,  0.1856,
         0.7436,  0.3076,  0.0974,  0.1917,  0.2917,  0.8769,  0.0794,
         0.0879,  0.7657,  0.2368,  0.3002,  0.6921,  0.4349,  0.2109,
         0.8016,  0.9805,  0.9235,  0.0492,  0.1773,  0.2319,  0.0095,
         0.2222,  0.8722,  0.5307,  0.8129,  0.1125,  0.1985,  0.2052,
         0.0142,  0.4114,  0.1493,  0.2420,  0.1074,  0.8363,  0.0341,
         0.0437,  0.1645,  0.2629,  0.8330,  0.8199,  0.1960,  0.8833,
         0.3397,  0.8826,  0.6849,  0.8903,  0.9296,  0.1370,  0.4555,
         0.1353,  0.2104,  0.0662,  0.4541,  0.0571,  0.7069,  0.9173,
         0.0667,  0.3894,  0.9114,  0.9037,  0.3938,  0.0270,  0.8796,
         0.7957,  0.7919,  0.3348,  0.8883,  0.6174,  0.8317,  0.6609,
         0.0971,  0.4434,  0.1461,  0.0575,  0.9117,  0.4423,  0.8192,
         0.1409,  0.2774,  0.9398,  0.1692,  0.0163,  0.4730,  0.1110,
         0.1652,  0.2990,  0.5167,  0.4386,  0.4311,  0.2255,  0.9557,
         0.1648,  0.8676,  0.6837,  0.8862,  0.8831,  0.6278,  0.8428,
         0.6897,  0.8389,  0.3533,  0.5757,  0.8954,  0.7833,  0.1468,
         0.7606,  0.9423,  0.3707,  0.4185,  0.0557,  0.7748,  0.4275,
         0.7588,  0.7977,  0.2790,  0.3239,  0.5587,  0.0441,  0.2739,
         0.0379,  0.5922,  0.8189,  0.8651,  0.9644,  0.7383,  0.7832,
         0.8872,  0.1626,  0.1300,  0.8326,  0.6788,  0.6379,  0.9498,
         0.2763,  0.8683,  0.1065,  0.7863,  0.7862,  0.2869,  0.3801,
         0.1626,  0.9850,  0.8221,  0.4119,  0.1429,  0.7329,  0.0973,
         0.8072,  0.7124,  0.9802,  0.2752,  0.0163,  0.1250,  0.4589,
         0.8177,  0.8888,  0.0599,  0.0439,  0.3281,  0.9587,  0.9234,
         0.5146,  0.6238,  0.8019,  0.8541,  0.7623,  0.2445,  0.9543,
         0.2863,  0.4568,  0.3082,  0.0882,  0.8854,  0.2002,  0.8816,
         0.4743,  0.6118,  0.1296,  0.6373,  0.1176,  0.8526,  0.9252,
         0.8849,  0.7854,  0.1585,  0.3400,  0.0864,  0.1039,  0.2454,
         0.0718,  0.1677,  0.0810,  0.1879,  0.4899,  0.7575,  0.1344,
         0.6382,  0.9166,  0.0895,  0.0932,  0.1732,  0.1509,  0.9730,
         0.2454,  0.6968,  0.4044,  0.9801,  0.6916,  0.1297,  0.8596,
         0.0947,  0.3482,  0.1769,  0.1528,  0.4635,  0.2024,  0.4441,
         0.0302,  0.5562,  0.2320,  0.9301,  0.5616,  0.3068,  0.1545,
         0.2397,  0.0888,  0.3480,  0.4707,  0.8506,  0.8043,  0.1905,
         0.2324,  0.2972,  0.8394,  0.3017,  0.0428,  0.9361,  0.1703,
         0.9012,  0.7568,  0.0557,  0.7457,  0.1797,  0.1279,  0.4535,
         0.8385,  0.4900,  0.8371,  0.5514,  0.0405,  0.4943,  0.8179,
         0.1312,  0.2084,  0.6406,  0.3521,  0.8884,  0.1141,  0.3345,
         0.9084,  0.0702,  0.0598,  0.7200,  0.2926,  0.6547,  0.6352,
         0.9910,  0.8154,  0.6103,  0.1975,  0.6856,  0.0748,  0.0659,
         0.8819,  0.6003,  0.0689,  0.4775,  0.5610,  0.9246,  0.1573,
         0.5180,  0.1756,  0.2602,  0.7011,  0.4978,  0.4700,  0.1727,
         0.0858,  0.8805,  0.9871,  0.0447,  0.9157,  0.2233,  0.7906,
         0.9137,  0.0436,  0.8645,  0.3963,  0.0830,  0.2903,  0.9344,
         0.6514,  0.1221,  0.6901,  0.4438,  0.2323,  0.3776,  0.6500,
         0.8199,  0.3510,  0.9354,  0.7544,  0.2771,  0.0469,  0.7925,
         0.3236,  0.6050,  0.1463,  0.6334,  0.8932,  0.7898,  0.0608,
         0.7947,  0.1896,  0.6645,  0.8018,  0.3064,  0.1939,  0.7635,
         0.9358,  0.0679,  0.2923,  0.7219,  0.4891,  0.4468,  0.9119,
         0.8978,  0.9209,  0.6231,  0.1750,  0.5158,  0.7130,  0.2214,
         0.6090,  0.1103,  0.7870,  0.2692,  0.1688,  0.9954,  0.7880,
         0.8356,  0.2676,  0.0446,  0.3063,  0.3220,  0.8568,  0.2388,
         0.2727,  0.5964,  0.3090,  0.7269,  0.5552,  0.8545,  0.2632,
         0.8408], device='cuda:0')
tensor(0.5143, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1222,  0.9174,  0.2988,  0.5145,  0.4072,  0.1813,  0.8804,
         0.0666,  0.8548,  0.1531,  0.2876,  0.8509,  0.0657,  0.2288,
         0.7866,  0.6694,  0.5435,  0.8881,  0.8176,  0.8154,  0.3482,
         0.1828,  0.1400,  0.8959,  0.4618,  0.8616,  0.7710,  0.4372,
         0.0653,  0.2069,  0.1940,  0.3301,  0.1034,  0.2040,  0.4560,
         0.0323,  0.1229,  0.2567,  0.3014,  0.0311,  0.9379,  0.0578,
         0.2129,  0.1732,  0.7904,  0.7769,  0.3034,  0.8465,  0.2977,
         0.2808,  0.1719,  0.7281,  0.2614,  0.5763,  0.1195,  0.1200,
         0.3161,  0.7623,  0.5214,  0.9331,  0.2343,  0.1148,  0.5052,
         0.2962,  0.3221,  0.1901,  0.8733,  0.8346,  0.9076,  0.1358,
         0.9203,  0.0943,  0.3503,  0.1233,  0.4768,  0.4245,  0.7651,
         0.0722,  0.4534,  0.1276,  0.2642,  0.8516,  0.0320,  0.8901,
         0.7565,  0.2512,  0.9024,  0.5592,  0.9331,  0.8544,  0.1065,
         0.8083,  0.0298,  0.0389,  0.8825,  0.1971,  0.7530,  0.1492,
         0.8148,  0.7743,  0.0258,  0.2158,  0.2013,  0.7242,  0.1227,
         0.5209,  0.1226,  0.2011,  0.1844,  0.3240,  0.8753,  0.5281,
         0.4793,  0.3477,  0.5561,  0.8753,  0.1074,  0.7023,  0.3697,
         0.5193,  0.2564,  0.0809,  0.5662,  0.1392,  0.6535,  0.1060,
         0.1634,  0.4423,  0.1945,  0.7891,  0.2375,  0.2781,  0.7785,
         0.7946,  0.2296,  0.8111,  0.2666,  0.1106,  0.8079,  0.0358,
         0.3745,  0.2591,  0.4893,  0.5226,  0.9073,  0.2722,  0.0489,
         0.2817,  0.2537,  0.9289,  0.3062,  0.9339,  0.5678,  0.1904,
         0.4758,  0.2377,  0.5849,  0.1888,  0.3189,  0.1104,  0.6938,
         0.3176,  0.7168,  0.5973,  0.2015,  0.6386,  0.5350,  0.5247,
         0.3352,  0.8750,  0.1956,  0.4017,  0.5426,  0.1779,  0.0772,
         0.9205,  0.5835,  0.2050,  0.7641,  0.2270,  0.6896,  0.6873,
         0.0938,  0.3097,  0.7733,  0.2560,  0.0487,  0.6803,  0.6950,
         0.9643,  0.9433,  0.2139,  0.0106,  0.4183,  0.1085,  0.3970,
         0.7978,  0.0863,  0.3462,  0.7660,  0.1990,  0.2298,  0.5986,
         0.4938,  0.9782,  0.6029,  0.9098,  0.1074,  0.0916,  0.6880,
         0.7621,  0.0412,  0.7765,  0.7348,  0.7736,  0.5952,  0.0239,
         0.9732,  0.7595,  0.2355,  0.0968,  0.1456,  0.1081,  0.2402,
         0.2821,  0.9483,  0.6625,  0.6278,  0.8649,  0.9959,  0.0740,
         0.0494,  0.4101,  0.0886,  0.3429,  0.8497,  0.8576,  0.0593,
         0.4209,  0.8087,  0.3013,  0.2897,  0.4679,  0.7143,  0.1384,
         0.0814,  0.5525,  0.6410,  0.1931,  0.1483,  0.4970,  0.7051,
         0.1131,  0.1464,  0.8909,  0.1170,  0.7248,  0.0291,  0.8739,
         0.8884,  0.8063,  0.3187,  0.4528,  0.8157,  0.6075,  0.3765,
         0.0998,  0.2999,  0.4443,  0.1270,  0.8175,  0.3142,  0.0813,
         0.7773,  0.2867,  0.1614,  0.3866,  0.0903,  0.2488,  0.7857,
         0.5771,  0.1706,  0.8750,  0.5025,  0.6174,  0.5067,  0.3884,
         0.9033,  0.1190,  0.4303,  0.4264,  0.8373,  0.3758,  0.3989,
         0.1167,  0.1480,  0.3787,  0.9182,  0.3306,  0.2849,  0.6431,
         0.1810,  0.7929,  0.2221,  0.2999,  0.1515,  0.2653,  0.2776,
         0.0911,  0.8547,  0.2200,  0.6668,  0.8226,  0.1383,  0.3380,
         0.2032,  0.6914,  0.7809,  0.0974,  0.1861,  0.8224,  0.2154,
         0.7966,  0.8084,  0.3208,  0.8345,  0.8533,  0.9006,  0.4216,
         0.3456,  0.9886,  0.7812,  0.6941,  0.9789,  0.5282,  0.8176,
         0.7547,  0.5664,  0.2574,  0.7766,  0.0751,  0.9662,  0.7126,
         0.5268,  0.1552,  0.4958,  0.9833,  0.7328,  0.8215,  0.0789,
         0.3007,  0.0354,  0.2990,  0.8491,  0.8295,  0.7211,  0.1298,
         0.1895,  0.4153,  0.1087,  0.8534,  0.7537,  0.2054,  0.0496,
         0.1714,  0.6253,  0.4116,  0.7727,  0.3636,  0.5641,  0.3082,
         0.6900,  0.8015,  0.1706,  0.0180,  0.1946,  0.3048,  0.8497,
         0.7573,  0.5232,  0.7748,  0.0729,  0.2876,  0.4190,  0.1796,
         0.9035,  0.2236,  0.3061,  0.6598,  0.1729,  0.1971,  0.3060,
         0.8297,  0.9000,  0.2473,  0.8129,  0.5097,  0.9761,  0.1279,
         0.2601,  0.8113,  0.8811,  0.7988,  0.8092,  0.1600,  0.0809,
         0.7351,  0.1617,  0.4454,  0.2816,  0.7438,  0.1330,  0.2977,
         0.9278,  0.7502,  0.3615,  0.1283,  0.1788,  0.5925,  0.5523,
         0.4378,  0.4045,  0.0380,  0.7402,  0.9695,  0.4829,  0.8440,
         0.8530,  0.8716,  0.0451,  0.9885,  0.8115,  0.7743,  0.2251,
         0.0863,  0.1306,  0.7162,  0.2271,  0.8299,  0.3776,  0.1972,
         0.5913,  0.8474,  0.4870,  0.0939,  0.1726,  0.2160,  0.8420,
         0.1781,  0.5036,  0.0625,  0.0703,  0.1521,  0.7508,  0.4741,
         0.4099,  0.9260,  0.8655,  0.8758,  0.3381,  0.8415,  0.2538,
         0.7828,  0.3740,  0.9342,  0.2383,  0.1111,  0.7945,  0.4419,
         0.3668,  0.3213,  0.2849,  0.6277,  0.5123,  0.1681,  0.7119,
         0.8283,  0.8266,  0.7837,  0.1397,  0.4211,  0.7544,  0.7925,
         0.2791,  0.7827,  0.8035,  0.8855,  0.1961,  0.1465,  0.7301,
         0.7414,  0.3533,  0.2672,  0.2568,  0.9254,  0.0537,  0.5504,
         0.7027,  0.9099,  0.7574,  0.2717,  0.5443,  0.0641,  0.1088,
         0.1102,  0.9021,  0.8026,  0.1137,  0.9260,  0.3970,  0.4938,
         0.6320], device='cuda:0')
tensor(0.4377, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1811,  0.3720,  0.6687,  0.4741,  0.4904,  0.9076,  0.6407,
         0.6109,  0.6468,  0.4093,  0.8022,  0.6912,  0.7346,  0.8556,
         0.5588,  0.7973,  0.8474,  0.0435,  0.1617,  0.2274,  0.0780,
         0.8366,  0.7384,  0.4546,  0.0980,  0.3271,  0.1411,  0.5891,
         0.6670,  0.6887,  0.1442,  0.8834,  0.8921,  0.2247,  0.5904,
         0.8338,  0.6876,  0.2288,  0.1156,  0.1758,  0.0864,  0.7396,
         0.6880,  0.0909,  0.8205,  0.7469,  0.7107,  0.7542,  0.9783,
         0.3823,  0.7180,  0.4497,  0.7710,  0.7801,  0.1982,  0.7737,
         0.5363,  0.5869,  0.7858,  0.1647,  0.8731,  0.1667,  0.1285,
         0.1172,  0.3530,  0.5731,  0.1982,  0.6241,  0.5140,  0.1391,
         0.5974,  0.2495,  0.1004,  0.0661,  0.2254,  0.4082,  0.1424,
         0.4354,  0.7710,  0.1795,  0.4668,  0.5333,  0.8573,  0.1556,
         0.9292,  0.7657,  0.4890,  0.2107,  0.3505,  0.7779,  0.0900,
         0.0343,  0.2621,  0.7900,  0.2444,  0.1084,  0.5632,  0.5455,
         0.6447,  0.1569,  0.3072,  0.8906,  0.8596,  0.2603,  0.7122,
         0.1016,  0.7592,  0.7474,  0.1162,  0.8707,  0.9171,  0.7926,
         0.3573,  0.1146,  0.1936,  0.6348,  0.6604,  0.9116,  0.7765,
         0.0461,  0.3204,  0.5536,  0.7764,  0.3568,  0.8303,  0.1083,
         0.4905,  0.8429,  0.8910,  0.4730,  0.9800,  0.8668,  0.5984,
         0.9043,  0.6670,  0.0408,  0.3938,  0.2151,  0.9027,  0.2961,
         0.1931,  0.2418,  0.6849,  0.3113,  0.8061,  0.1059,  0.2144,
         0.6790,  0.3365,  0.2847,  0.7383,  0.9004,  0.8491,  0.5136,
         0.5629,  0.4711,  0.2849,  0.7585,  0.7342,  0.5927,  0.9911,
         0.8499,  0.1169,  0.1670,  0.4068,  0.3547,  0.8122,  0.5921,
         0.1649,  0.0922,  0.6674,  0.3532,  0.5526,  0.2363,  0.1880,
         0.3309,  0.1674,  0.0180,  0.8723,  0.7764,  0.0799,  0.3912,
         0.6683,  0.3401,  0.6919,  0.9021,  0.6307,  0.8189,  0.2165,
         0.0453,  0.5211,  0.3007,  0.7266,  0.7723,  0.3420,  0.4621,
         0.1110,  0.3898,  0.3613,  0.5627,  0.2330,  0.2399,  0.5053,
         0.0916,  0.5535,  0.6875,  0.3077,  0.7299,  0.3258,  0.4301,
         0.7639,  0.1472,  0.3865,  0.3434,  0.8878,  0.4487,  0.1830,
         0.1512,  0.1109,  0.1800,  0.4961,  0.2035,  0.1208,  0.3448,
         0.3195,  0.2688,  0.4572,  0.1277,  0.6114,  0.7863,  0.7206,
         0.1319,  0.1403,  0.3120,  0.9221,  0.2229,  0.3500,  0.9174,
         0.7600,  0.3495,  0.6963,  0.0999,  0.7302,  0.6146,  0.7421,
         0.1464,  0.2721,  0.1350,  0.3667,  0.3981,  0.3102,  0.9244,
         0.6309,  0.6067,  0.4185,  0.1081,  0.5139,  0.3821,  0.4335,
         0.5738,  0.3277,  0.6490,  0.7217,  0.2992,  0.5741,  0.4509,
         0.2328,  0.8865,  0.3874,  0.3268,  0.2206,  0.3363,  0.0742,
         0.0829,  0.2290,  0.3802,  0.1042,  0.2675,  0.2872,  0.0647,
         0.5610,  0.8666,  0.0619,  0.6155,  0.4335,  0.1963,  0.4974,
         0.8685,  0.3130,  0.3511,  0.3526,  0.9654,  0.2496,  0.7247,
         0.6719,  0.5095,  0.6115,  0.2616,  0.8437,  0.1258,  0.2732,
         0.3338,  0.8436,  0.0448,  0.1855,  0.1960,  0.4070,  0.4941,
         0.4205,  0.5416,  0.5304,  0.4930,  0.4752,  0.2153,  0.5485,
         0.8471,  0.3604,  0.6705,  0.3207,  0.9442,  0.8395,  0.7300,
         0.7031,  0.2608,  0.8158,  0.2781,  0.7616,  0.2905,  0.1756,
         0.8701,  0.4042,  0.6622,  0.8165,  0.1113,  0.3211,  0.1764,
         0.3107,  0.4721,  0.0746,  0.8972,  0.4779,  0.4707,  0.6544,
         0.4379,  0.2430,  0.8750,  0.2759,  0.6109,  0.3186,  0.6501,
         0.6652,  0.3905,  0.3642,  0.9693,  0.4909,  0.4406,  0.4449,
         0.8200,  0.4684,  0.1771,  0.8903,  0.6242,  0.5597,  0.3041,
         0.6361,  0.7017,  0.7440,  0.5018,  0.0419,  0.0726,  0.3834,
         0.2539,  0.7627,  0.6747,  0.7601,  0.7641,  0.6676,  0.6476,
         0.6126,  0.7988,  0.5181,  0.3743,  0.2236,  0.1941,  0.2814,
         0.0377,  0.6361,  0.6370,  0.1252,  0.1356,  0.4956,  0.7472,
         0.2761,  0.5949,  0.7853,  0.8265,  0.8952,  0.5483,  0.5750,
         0.1039,  0.6492,  0.4562,  0.5033,  0.1553,  0.6748,  0.1304,
         0.8200,  0.1383,  0.3055,  0.9096,  0.3935,  0.1603,  0.1599,
         0.7749,  0.1841,  0.2579,  0.1939,  0.1351,  0.9089,  0.2756,
         0.2129,  0.8378,  0.6966,  0.1493,  0.5275,  0.1540,  0.7860,
         0.2870,  0.8393,  0.1430,  0.2585,  0.1462,  0.7582,  0.1435,
         0.7903,  0.7161,  0.1084,  0.2440,  0.4238,  0.3948,  0.5131,
         0.3186,  0.1480,  0.8777,  0.9862,  0.4142,  0.6337,  0.3308,
         0.8051,  0.2296,  0.8712,  0.2027,  0.7802,  0.8136,  0.7972,
         0.8658,  0.8567,  0.5020,  0.7021,  0.9122,  0.1075,  0.7445,
         0.5714,  0.2303,  0.2355,  0.8809,  0.8309,  0.0917,  0.8052,
         0.2337,  0.2523,  0.7195,  0.9204,  0.2919,  0.0842,  0.2250,
         0.2697,  0.9802,  0.6577,  0.2262,  0.7999,  0.5900,  0.8636,
         0.3304,  0.8734,  0.6197,  0.6428,  0.7877,  0.9871,  0.5049,
         0.2631,  0.9223,  0.8956,  0.1521,  0.2527,  0.4314,  0.6179,
         0.0468,  0.3273,  0.2000,  0.2981,  0.4562,  0.2879,  0.7728,
         0.8478,  0.5615,  0.3839,  0.1681,  0.5511,  0.6981,  0.1995,
         0.1007], device='cuda:0')
tensor(0.4664, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2537,  0.5873,  0.2445,  0.6423,  0.3279,  0.0804,  0.1072,
         0.2427,  0.1184,  0.1306,  0.7069,  0.5778,  0.4030,  0.1645,
         0.9380,  0.7065,  0.8146,  0.1174,  0.8756,  0.4997,  0.7728,
         0.2115,  0.7904,  0.6701,  0.5329,  0.3030,  0.9801,  0.4147,
         0.3095,  0.7722,  0.3715,  0.7606,  0.7846,  0.8251,  0.8128,
         0.4471,  0.5221,  0.8342,  0.1793,  0.1240,  0.4000,  0.1542,
         0.7374,  0.6840,  0.6441,  0.3583,  0.5438,  0.2407,  0.7135,
         0.2480,  0.8234,  0.7142,  0.8549,  0.5831,  0.9458,  0.2053,
         0.6670,  0.4615,  0.9841,  0.3411,  0.8813,  0.2850,  0.6461,
         0.2617,  0.8062,  0.9053,  0.4880,  0.8673,  0.3914,  0.1855,
         0.2797,  0.6278,  0.5847,  0.6366,  0.5317,  0.3420,  0.7960,
         0.6430,  0.7144,  0.3125,  0.0396,  0.1852,  0.2513,  0.3931,
         0.2734,  0.5924,  0.8363,  0.2209,  0.5769,  0.4480,  0.3490,
         0.5715,  0.3696,  0.2498,  0.6273,  0.6338,  0.6991,  0.4708,
         0.6211,  0.6163,  0.5780,  0.7651,  0.3035,  0.9805,  0.5323,
         0.3826,  0.5876,  0.6077,  0.6439,  0.1443,  0.4461,  0.5761,
         0.4562,  0.7121,  0.5913,  0.6381,  0.3685,  0.4696,  0.3554,
         0.1312,  0.1995,  0.8497,  0.3000,  0.5769,  0.7817,  0.5689,
         0.9717,  0.2245,  0.5687,  0.7089,  0.9274,  0.5391,  0.4152,
         0.1881,  0.6160,  0.7331,  0.4945,  0.2035,  0.3811,  0.1659,
         0.5467,  0.8676,  0.2042,  0.2595,  0.8266,  0.2731,  0.1048,
         0.0956,  0.8293,  0.1332,  0.3305,  0.5860,  0.6426,  0.5261,
         0.6333,  0.8475,  0.7390,  0.6961,  0.6589,  0.1150,  0.2397,
         0.2410,  0.4206,  0.2217,  0.4892,  0.6781,  0.2791,  0.7127,
         0.7590,  0.6131,  0.7323,  0.3525,  0.3005,  0.4206,  0.5940,
         0.8068,  0.8050,  0.8323,  0.5175,  0.4940,  0.7703,  0.7203,
         0.3010,  0.2366,  0.6901,  0.3574,  0.3573,  0.7935,  0.4353,
         0.4867,  0.5162,  0.2796,  0.6135,  0.1473,  0.6568,  0.8369,
         0.3474,  0.1420,  0.6846,  0.6898,  0.5614,  0.7046,  0.7634,
         0.5140,  0.3801,  0.7621,  0.1568,  0.7191,  0.7912,  0.7746,
         0.6243,  0.1311,  0.4560,  0.6416,  0.3753,  0.4131,  0.4759,
         0.6596,  0.6614,  0.6815,  0.6474,  0.3131,  0.5302,  0.6661,
         0.5054,  0.2086,  0.0667,  0.2325,  0.3575,  0.0877,  0.8235,
         0.2963,  0.0437,  0.5819,  0.4842,  0.7690,  0.6524,  0.2111,
         0.8153,  0.2710,  0.4894,  0.7016,  0.5662,  0.8439,  0.6919,
         0.7480,  0.7611,  0.6821,  0.5331,  0.6789,  0.9689,  0.2107,
         0.7862,  0.9061,  0.6304,  0.1037,  0.9704,  0.3921,  0.1141,
         0.6877,  0.0758,  0.5789,  0.9745,  0.1859,  0.8511,  0.5710,
         0.8375,  0.8416,  0.7606,  0.7695,  0.3969,  0.3086,  0.8725,
         0.9432,  0.5381,  0.3245,  0.8850,  0.8180,  0.2841,  0.8054,
         0.6074,  0.4170,  0.6469,  0.7331,  0.8859,  0.5479,  0.9202,
         0.9290,  0.2021,  0.4355,  0.7602,  0.8189,  0.7143,  0.6324,
         0.9177,  0.6838,  0.9496,  0.7607,  0.3353,  0.5252,  0.7762,
         0.8844,  0.7157,  0.5753,  0.2427,  0.6761,  0.8536,  0.5384,
         0.2342,  0.3635,  0.6703,  0.1313,  0.3216,  0.8576,  0.8154,
         0.6438,  0.5588,  0.7566,  0.4128,  0.5328,  0.5861,  0.5459,
         0.5649,  0.7567,  0.8233,  0.3268,  0.4610,  0.7181,  0.5007,
         0.7842,  0.7448,  0.2902,  0.2270,  0.7584,  0.8407,  0.7491,
         0.2685,  0.2919,  0.9652,  0.5847,  0.5050,  0.5281,  0.4152,
         0.2205,  0.8848,  0.8459,  0.1090,  0.3087,  0.3091,  0.5578,
         0.7089,  0.5908,  0.8158,  0.6846,  0.3267,  0.3847,  0.8421,
         0.4245,  0.0462,  0.2229,  0.2506,  0.6110,  0.6102,  0.4870,
         0.1924,  0.0182,  0.2834,  0.3839,  0.3253,  0.8667,  0.5398,
         0.4406,  0.8051,  0.3662,  0.8107,  0.4554,  0.9800,  0.4651,
         0.0709,  0.1939,  0.6951,  0.4121,  0.6965,  0.3109,  0.6366,
         0.8125,  0.5866,  0.1685,  0.8503,  0.6057,  0.0312,  0.2005,
         0.8483,  0.7377,  0.6952,  0.8389,  0.8746,  0.5878,  0.7178,
         0.6952,  0.9029,  0.9561,  0.6176,  0.5434,  0.8938,  0.2774,
         0.7372,  0.8785,  0.5268,  0.4557,  0.4438,  0.4480,  0.9769,
         0.5150,  0.3086,  0.2810,  0.7142,  0.4244,  0.8704,  0.6656,
         0.0920,  0.7614,  0.5952,  0.6033,  0.3324,  0.2089,  0.6885,
         0.2134,  0.4254,  0.5482,  0.0487,  0.7458,  0.2306,  0.9662,
         0.3786,  0.6444,  0.5709,  0.8641,  0.7505,  0.7801,  0.3017,
         0.8446,  0.4824,  0.1860,  0.6141,  0.1649,  0.7310,  0.5226,
         0.3821,  0.8742,  0.3518,  0.3903,  0.6885,  0.3899,  0.2501,
         0.7757,  0.5910,  0.8543,  0.3299,  0.1319,  0.8039,  0.2751,
         0.1075,  0.1186,  0.3360,  0.1851,  0.9133,  0.5093,  0.1547,
         0.5878,  0.4634,  0.3339,  0.7744,  0.8396,  0.3806,  0.8444,
         0.8964,  0.3801,  0.0736,  0.2632,  0.7182,  0.3930,  0.2002,
         0.9146,  0.8786,  0.5664,  0.5696,  0.9021,  0.1565,  0.1571,
         0.4401,  0.5320,  0.5375,  0.2557,  0.7164,  0.9257,  0.1757,
         0.6573,  0.2461,  0.0970,  0.4644,  0.3228,  0.6125,  0.8461,
         0.8353,  0.7882,  0.5845,  0.8497,  0.5494,  0.2920,  0.1219,
         0.7956], device='cuda:0')
tensor(0.4958, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5660,  0.1669,  0.3194,  0.0893,  0.2661,  0.2354,  0.0290,
         0.2110,  0.6002,  0.5400,  0.6518,  0.9389,  0.1441,  0.7778,
         0.2944,  0.4162,  0.7488,  0.1418,  0.9584,  0.3124,  0.2581,
         0.8218,  0.5893,  0.1460,  0.0690,  0.4612,  0.1691,  0.5376,
         0.2607,  0.8300,  0.4498,  0.5518,  0.7232,  0.7586,  0.1902,
         0.2703,  0.4179,  0.2808,  0.5601,  0.7892,  0.8030,  0.8539,
         0.7915,  0.0629,  0.1278,  0.6631,  0.8235,  0.8022,  0.7226,
         0.7725,  0.3418,  0.9682,  0.7226,  0.3728,  0.7916,  0.6038,
         0.8758,  0.6738,  0.7188,  0.9192,  0.1526,  0.4251,  0.7717,
         0.3313,  0.6636,  0.8196,  0.0682,  0.5519,  0.9290,  0.2640,
         0.5249,  0.8800,  0.7673,  0.7888,  0.7086,  0.6068,  0.6368,
         0.3673,  0.6462,  0.9374,  0.9308,  0.2206,  0.2487,  0.7935,
         0.3664,  0.1638,  0.0467,  0.1945,  0.5552,  0.1852,  0.7569,
         0.1569,  0.9427,  0.2873,  0.3753,  0.5181,  0.7379,  0.2693,
         0.4117,  0.2459,  0.5909,  0.8823,  0.3499,  0.4890,  0.1203,
         0.7178,  0.1126,  0.3770,  0.6398,  0.7972,  0.7951,  0.8174,
         0.7985,  0.1923,  0.8075,  0.7228,  0.8274,  0.3198,  0.2321,
         0.5979,  0.3436,  0.3215,  0.7125,  0.9418,  0.5239,  0.8327,
         0.8843,  0.5398,  0.6402,  0.3123,  0.6466,  0.9306,  0.9347,
         0.3648,  0.6456,  0.4540,  0.2638,  0.1360,  0.7700,  0.5778,
         0.8562,  0.6922,  0.1688,  0.7831,  0.8296,  0.6843,  0.2412,
         0.3903,  0.2548,  0.7510,  0.4331,  0.7122,  0.1030,  0.8730,
         0.4581,  0.9881,  0.0425,  0.2094,  0.1923,  0.7274,  0.8584,
         0.4537,  0.8039,  0.8454,  0.3625,  0.3486,  0.2032,  0.7410,
         0.1991,  0.2539,  0.6403,  0.8398,  0.3508,  0.2496,  0.4992,
         0.5149,  0.1950,  0.7226,  0.4596,  0.0658,  0.6907,  0.6304,
         0.2498,  0.2541,  0.5725,  0.6212,  0.3195,  0.6567,  0.7304,
         0.1136,  0.8842,  0.4699,  0.3581,  0.0613,  0.4442,  0.1011,
         0.8404,  0.4533,  0.1918,  0.1234,  0.7852,  0.7803,  0.2330,
         0.5335,  0.8312,  0.0919,  0.1450,  0.7450,  0.7822,  0.7933,
         0.4914,  0.2005,  0.5984,  0.5749,  0.4068,  0.3047,  0.4898,
         0.3147,  0.6661,  0.5270,  0.8027,  0.1245,  0.2028,  0.4902,
         0.8178,  0.7493,  0.4674,  0.7587,  0.8451,  0.3900,  0.4025,
         0.5985,  0.7431,  0.7727,  0.3092,  0.3114,  0.7375,  0.3088,
         0.1325,  0.4162,  0.6849,  0.1620,  0.2839,  0.7429,  0.5356,
         0.8110,  0.9783,  0.7028,  0.2182,  0.4024,  0.0697,  0.8269,
         0.2343,  0.3057,  0.5596,  0.7100,  0.6706,  0.7563,  0.6995,
         0.1841,  0.2254,  0.2908,  0.5114,  0.4197,  0.4758,  0.7262,
         0.6594,  0.3032,  0.5891,  0.5584,  0.1938,  0.3226,  0.6580,
         0.5761,  0.2562,  0.9008,  0.7424,  0.5254,  0.2933,  0.1675,
         0.4034,  0.5814,  0.8396,  0.8186,  0.6404,  0.0560,  0.6642,
         0.3493,  0.4835,  0.6456,  0.7174,  0.7165,  0.4210,  0.6908,
         0.9238,  0.5207,  0.7126,  0.3044,  0.4384,  0.7159,  0.6075,
         0.7059,  0.8607,  0.7110,  0.9398,  0.3558,  0.4756,  0.9022,
         0.0610,  0.2527,  0.6005,  0.7576,  0.0512,  0.7364,  0.0413,
         0.6627,  0.6693,  0.2893,  0.7019,  0.3175,  0.3604,  0.6331,
         0.6169,  0.6806,  0.3095,  0.0381,  0.1286,  0.3069,  0.2238,
         0.3890,  0.3229,  0.1674,  0.8714,  0.9165,  0.4533,  0.6669,
         0.1372,  0.5152,  0.0894,  0.2504,  0.6421,  0.3805,  0.2100,
         0.7458,  0.7813,  0.4084,  0.7406,  0.6878,  0.3829,  0.7794,
         0.3378,  0.8187,  0.9003,  0.8103,  0.7802,  0.4820,  0.3504,
         0.6391,  0.4272,  0.2889,  0.8684,  0.7125,  0.9071,  0.0230,
         0.8276,  0.6402,  0.1755,  0.8634,  0.5788,  0.5158,  0.7506,
         0.7169,  0.8709,  0.8149,  0.6969,  0.7823,  0.6684,  0.6542,
         0.7161,  0.8244,  0.1024,  0.4205,  0.9489,  0.9705,  0.1642,
         0.6149,  0.8055,  0.8336,  0.4498,  0.7132,  0.6150,  0.9098,
         0.8177,  0.2435,  0.6387,  0.5291,  0.2400,  0.3664,  0.7769,
         0.8479,  0.3453,  0.2098,  0.7610,  0.2288,  0.3959,  0.6772,
         0.2147,  0.1853,  0.9146,  0.4556,  0.8461,  0.8851,  0.6589,
         0.4428,  0.2446,  0.9859,  0.6557,  0.7955,  0.8176,  0.2283,
         0.9237,  0.0995,  0.1137,  0.8270,  0.0618,  0.8719,  0.8625,
         0.4109,  0.3916,  0.8685,  0.5421,  0.5508,  0.5480,  0.3770,
         0.2067,  0.1884,  0.2876,  0.4285,  0.6576,  0.1972,  0.3920,
         0.1168,  0.8127,  0.1786,  0.9152,  0.6407,  0.6614,  0.3437,
         0.4642,  0.3749,  0.2915,  0.9298,  0.8813,  0.5433,  0.7354,
         0.7020,  0.3381,  0.6371,  0.4219,  0.3517,  0.8283,  0.0715,
         0.3529,  0.9802,  0.4835,  0.7764,  0.2919,  0.0479,  0.6913,
         0.8612,  0.6359,  0.7652,  0.7564,  0.7191,  0.9747,  0.2490,
         0.1414,  0.4381,  0.1545,  0.8053,  0.0176,  0.5575,  0.4796,
         0.5974,  0.5584,  0.7165,  0.8819,  0.5359,  0.7787,  0.1665,
         0.2417,  0.1302,  0.5170,  0.4866,  0.3131,  0.7735,  0.8969,
         0.0836,  0.8151,  0.8771,  0.1949,  0.6213,  0.8650,  0.2272,
         0.1944,  0.6440,  0.7614,  0.8317,  0.8273,  0.4484,  0.4816,
         0.3937], device='cuda:0')
tensor(0.4647, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7682,  0.2624,  0.3121,  0.1029,  0.0449,  0.8233,  0.1397,
         0.8196,  0.1017,  0.5924,  0.1873,  0.6962,  0.7892,  0.8553,
         0.2343,  0.3760,  0.3287,  0.3712,  0.6021,  0.8796,  0.8842,
         0.8636,  0.7146,  0.8504,  0.0504,  0.5798,  0.1792,  0.3691,
         0.7609,  0.6754,  0.6564,  0.5218,  0.1689,  0.4219,  0.2114,
         0.8106,  0.7367,  0.3878,  0.9455,  0.4485,  0.3220,  0.6853,
         0.1640,  0.0659,  0.7651,  0.1601,  0.4887,  0.6591,  0.7788,
         0.2238,  0.8740,  0.4127,  0.1523,  0.3810,  0.9816,  0.8249,
         0.2151,  0.2418,  0.7338,  0.2713,  0.7599,  0.3249,  0.6667,
         0.6744,  0.7451,  0.1375,  0.2636,  0.3256,  0.7387,  0.0827,
         0.7170,  0.0649,  0.2535,  0.2279,  0.7506,  0.2120,  0.1282,
         0.5568,  0.1671,  0.5268,  0.1351,  0.9069,  0.7001,  0.1311,
         0.3474,  0.4971,  0.4202,  0.1990,  0.5888,  0.2657,  0.2089,
         0.8509,  0.1635,  0.1516,  0.3530,  0.0410,  0.5588,  0.1159,
         0.7021,  0.1913,  0.7015,  0.2856,  0.2795,  0.8787,  0.8738,
         0.0862,  0.1419,  0.6325,  0.5840,  0.6530,  0.8025,  0.9725,
         0.9418,  0.3156,  0.1783,  0.4221,  0.8401,  0.6145,  0.1108,
         0.7795,  0.5400,  0.5379,  0.3757,  0.8133,  0.0652,  0.4002,
         0.2639,  0.8473,  0.6769,  0.6605,  0.6799,  0.6316,  0.1564,
         0.4977,  0.8211,  0.8891,  0.8363,  0.4736,  0.2431,  0.1953,
         0.4166,  0.5923,  0.0268,  0.3457,  0.1635,  0.9046,  0.8213,
         0.0968,  0.9019,  0.2177,  0.9142,  0.6665,  0.6454,  0.2739,
         0.8629,  0.9739,  0.7559,  0.0937,  0.9307,  0.2984,  0.7800,
         0.2620,  0.2860,  0.5799,  0.7199,  0.1580,  0.3738,  0.2724,
         0.8051,  0.8995,  0.2212,  0.7527,  0.5579,  0.2466,  0.8033,
         0.4253,  0.3649,  0.1899,  0.6826,  0.0991,  0.7508,  0.7075,
         0.8186,  0.6513,  0.8202,  0.3382,  0.9451,  0.8525,  0.3640,
         0.4676,  0.0678,  0.8900,  0.8430,  0.2083,  0.9748,  0.5809,
         0.2653,  0.8578,  0.3263,  0.7490,  0.9267,  0.7559,  0.3990,
         0.2041,  0.0437,  0.7833,  0.4175,  0.1099,  0.9153,  0.7400,
         0.0615,  0.6152,  0.0791,  0.1052,  0.2850,  0.5943,  0.6829,
         0.4578,  0.4334,  0.2047,  0.2705,  0.6809,  0.7196,  0.1497,
         0.1615,  0.0805,  0.9879,  0.7066,  0.2724,  0.8241,  0.9098,
         0.2152,  0.4321,  0.8186,  0.8412,  0.5504,  0.8432,  0.4555,
         0.7317,  0.7221,  0.0248,  0.5481,  0.3775,  0.9276,  0.5955,
         0.3765,  0.1398,  0.9440,  0.2541,  0.8503,  0.0881,  0.9644,
         0.2484,  0.2038,  0.8186,  0.8241,  0.8648,  0.2051,  0.4575,
         0.7321,  0.8420,  0.9780,  0.1289,  0.3497,  0.0897,  0.2592,
         0.9530,  0.4241,  0.1099,  0.5957,  0.8153,  0.5247,  0.8954,
         0.7783,  0.5286,  0.2950,  0.3865,  0.8465,  0.8427,  0.7334,
         0.9235,  0.1903,  0.7022,  0.9559,  0.8549,  0.2890,  0.4793,
         0.7377,  0.6613,  0.3241,  0.8413,  0.5640,  0.2036,  0.1983,
         0.0909,  0.4726,  0.5014,  0.7111,  0.3675,  0.8578,  0.4588,
         0.7347,  0.7408,  0.5880,  0.3284,  0.3612,  0.5305,  0.8907,
         0.8231,  0.8090,  0.5761,  0.0669,  0.2248,  0.8425,  0.4141,
         0.5371,  0.7085,  0.9224,  0.2657,  0.3160,  0.7569,  0.1949,
         0.1021,  0.5187,  0.6318,  0.3809,  0.8152,  0.9126,  0.9037,
         0.8935,  0.8187,  0.8419,  0.0987,  0.8389,  0.7439,  0.3968,
         0.3039,  0.5660,  0.4274,  0.9665,  0.2420,  0.1875,  0.2052,
         0.4177,  0.9356,  0.2066,  0.6438,  0.7296,  0.4576,  0.4115,
         0.7184,  0.7333,  0.7752,  0.0602,  0.1042,  0.2565,  0.7261,
         0.4613,  0.6298,  0.4065,  0.4521,  0.8663,  0.4538,  0.5656,
         0.3948,  0.2823,  0.3722,  0.4255,  0.7400,  0.8931,  0.1299,
         0.5230,  0.1444,  0.4716,  0.9806,  0.6085,  0.8416,  0.6304,
         0.8803,  0.3648,  0.0801,  0.2398,  0.6208,  0.0443,  0.7016,
         0.9327,  0.8545,  0.8501,  0.8900,  0.1961,  0.5139,  0.0684,
         0.4252,  0.3734,  0.3688,  0.8197,  0.8833,  0.7722,  0.1682,
         0.7482,  0.8627,  0.8250,  0.8858,  0.7905,  0.2623,  0.6414,
         0.1483,  0.1163,  0.8663,  0.8192,  0.9091,  0.9292,  0.6976,
         0.1005,  0.9580,  0.2905,  0.5620,  0.6560,  0.9117,  0.6830,
         0.0877,  0.8526,  0.3194,  0.3525,  0.9537,  0.1131,  0.2257,
         0.3840,  0.1626,  0.2290,  0.4488,  0.1747,  0.9562,  0.1623,
         0.1773,  0.7278,  0.5360,  0.1605,  0.7551,  0.8074,  0.1049,
         0.0825,  0.9417,  0.3958,  0.6917,  0.7826,  0.8356,  0.7003,
         0.3432,  0.8693,  0.6998,  0.2382,  0.6780,  0.6337,  0.0724,
         0.1462,  0.3540,  0.8278,  0.1936,  0.8544,  0.6471,  0.0504,
         0.8579,  0.1848,  0.9028,  0.2087,  0.1951,  0.6636,  0.6568,
         0.7829,  0.4172,  0.1879,  0.8621,  0.6575,  0.1909,  0.1880,
         0.2817,  0.7819,  0.7064,  0.8316,  0.3017,  0.6578,  0.6680,
         0.9879,  0.7038,  0.9651,  0.7251,  0.1171,  0.1316,  0.5090,
         0.6723,  0.8884,  0.7707,  0.8302,  0.3962,  0.8539,  0.0809,
         0.4257,  0.1448,  0.7755,  0.2853,  0.0568,  0.6907,  0.4808,
         0.4771,  0.8942,  0.3275,  0.6955,  0.4899,  0.2789,  0.0990,
         0.6984], device='cuda:0')
tensor(0.4494, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3981,  0.4807,  0.4696,  0.9794,  0.1907,  0.0393,  0.1486,
         0.4779,  0.9685,  0.1551,  0.7656,  0.6243,  0.0430,  0.8519,
         0.8382,  0.6377,  0.3545,  0.9955,  0.2248,  0.1803,  0.8431,
         0.5147,  0.0889,  0.8263,  0.7779,  0.0549,  0.6033,  0.3847,
         0.1847,  0.7259,  0.1891,  0.7818,  0.2121,  0.6951,  0.1606,
         0.9521,  0.6878,  0.5761,  0.4981,  0.0378,  0.7214,  0.8223,
         0.4933,  0.8408,  0.0460,  0.8992,  0.9567,  0.1975,  0.9016,
         0.5353,  0.6830,  0.5311,  0.1554,  0.1373,  0.0807,  0.2386,
         0.9573,  0.2907,  0.8380,  0.1665,  0.2434,  0.8703,  0.5886,
         0.6458,  0.8410,  0.6318,  0.8074,  0.2229,  0.2794,  0.3929,
         0.4871,  0.9119,  0.5897,  0.2207,  0.6589,  0.2692,  0.3886,
         0.0728,  0.5279,  0.7087,  0.3304,  0.6729,  0.2103,  0.1712,
         0.0799,  0.2470,  0.7908,  0.2336,  0.5545,  0.0691,  0.9294,
         0.3361,  0.8838,  0.0638,  0.1133,  0.7118,  0.1640,  0.8642,
         0.6740,  0.9298,  0.3196,  0.7922,  0.8696,  0.1049,  0.1781,
         0.0459,  0.0686,  0.8778,  0.0293,  0.0934,  0.7275,  0.1978,
         0.3082,  0.1695,  0.9169,  0.7779,  0.8409,  0.5794,  0.7696,
         0.8587,  0.3336,  0.2850,  0.8222,  0.2146,  0.8219,  0.2428,
         0.6366,  0.0747,  0.7659,  0.8269,  0.8622,  0.1820,  0.2217,
         0.1027,  0.1308,  0.7266,  0.8507,  0.1565,  0.9528,  0.1415,
         0.1085,  0.1152,  0.6855,  0.9081,  0.8700,  0.5589,  0.8436,
         0.8676,  0.7484,  0.0579,  0.9576,  0.8500,  0.2171,  0.3109,
         0.8128,  0.0982,  0.0734,  0.2463,  0.7349,  0.0569,  0.6679,
         0.6826,  0.0908,  0.4122,  0.2659,  0.8210,  0.1978,  0.9110,
         0.8118,  0.9394,  0.5962,  0.9330,  0.3144,  0.1130,  0.8277,
         0.8567,  0.9818,  0.8143,  0.2787,  0.0990,  0.8055,  0.2602,
         0.7275,  0.7367,  0.1474,  0.7815,  0.3677,  0.0575,  0.8515,
         0.1020,  0.9341,  0.3436,  0.1919,  0.9431,  0.0553,  0.2843,
         0.8997,  0.8705,  0.6233,  0.7841,  0.6224,  0.4588,  0.0894,
         0.1060,  0.2893,  0.0882,  0.2429,  0.8754,  0.6209,  0.3691,
         0.8484,  0.2122,  0.6961,  0.5969,  0.4753,  0.0653,  0.7717,
         0.1860,  0.7846,  0.8389,  0.9140,  0.1155,  0.0923,  0.5910,
         0.2837,  0.8304,  0.8547,  0.9901,  0.2934,  0.2232,  0.9037,
         0.1568,  0.4764,  0.0396,  0.2758,  0.7916,  0.1251,  0.5945,
         0.0582,  0.2858,  0.4183,  0.3320,  0.7548,  0.2241,  0.7890,
         0.6578,  0.8196,  0.3742,  0.5187,  0.8628,  0.8769,  0.0822,
         0.0927,  0.7274,  0.0843,  0.4078,  0.2880,  0.7986,  0.0443,
         0.4587,  0.1725,  0.8407,  0.4613,  0.7225,  0.2453,  0.1038,
         0.0877,  0.1258,  0.1536,  0.4934,  0.8599,  0.4577,  0.1473,
         0.8390,  0.6346,  0.7722,  0.7554,  0.5857,  0.7832,  0.0095,
         0.9308,  0.8689,  0.7582,  0.7986,  0.6909,  0.1860,  0.0919,
         0.8463,  0.0654,  0.4999,  0.9526,  0.9010,  0.3119,  0.4045,
         0.1772,  0.8112,  0.1282,  0.4527,  0.3545,  0.9275,  0.9386,
         0.8024,  0.7403,  0.5917,  0.5402,  0.0636,  0.5110,  0.3315,
         0.7973,  0.3117,  0.3883,  0.8568,  0.1371,  0.7562,  0.6408,
         0.7626,  0.4893,  0.0408,  0.9873,  0.5842,  0.7516,  0.2092,
         0.9021,  0.0446,  0.9052,  0.2435,  0.0328,  0.1998,  0.4631,
         0.5887,  0.8188,  0.7398,  0.6096,  0.8702,  0.4990,  0.4005,
         0.3880,  0.2619,  0.3365,  0.7065,  0.8070,  0.5738,  0.4024,
         0.7307,  0.4080,  0.1836,  0.2114,  0.6388,  0.4763,  0.2909,
         0.1149,  0.5727,  0.8713,  0.6232,  0.7628,  0.7346,  0.9665,
         0.5275,  0.1495,  0.6940,  0.7001,  0.0454,  0.1407,  0.8452,
         0.2622,  0.9559,  0.8531,  0.8255,  0.0517,  0.7280,  0.3527,
         0.8539,  0.7273,  0.2087,  0.1523,  0.8337,  0.1582,  0.8254,
         0.1910,  0.0477,  0.2782,  0.3181,  0.2889,  0.7588,  0.9303,
         0.9035,  0.9839,  0.0699,  0.5132,  0.7747,  0.0557,  0.0785,
         0.6836,  0.2256,  0.3328,  0.5133,  0.9077,  0.8788,  0.7961,
         0.5140,  0.6540,  0.0670,  0.9410,  0.2346,  0.9565,  0.4283,
         0.7226,  0.6340,  0.7852,  0.7278,  0.7132,  0.5346,  0.4124,
         0.5461,  0.7938,  0.5581,  0.2679,  0.3615,  0.0637,  0.2814,
         0.8032,  0.0900,  0.1430,  0.7762,  0.4569,  0.0990,  0.4323,
         0.4715,  0.9715,  0.4777,  0.3639,  0.2147,  0.4501,  0.6315,
         0.1340,  0.3887,  0.7703,  0.1541,  0.7776,  0.0395,  0.9094,
         0.9009,  0.1854,  0.7142,  0.8690,  0.3218,  0.8137,  0.8445,
         0.8660,  0.8704,  0.9103,  0.1229,  0.2091,  0.0581,  0.7760,
         0.9398,  0.1542,  0.6293,  0.5934,  0.7960,  0.9142,  0.4273,
         0.3296,  0.6940,  0.8082,  0.8232,  0.9936,  0.7901,  0.8377,
         0.0926,  0.8378,  0.4937,  0.6865,  0.1680,  0.2322,  0.2163,
         0.9374,  0.2953,  0.1842,  0.2694,  0.1281,  0.1654,  0.7185,
         0.2750,  0.1643,  0.0768,  0.9503,  0.0241,  0.0847,  0.6921,
         0.8040,  0.1202,  0.8382,  0.9467,  0.3436,  0.1620,  0.7502,
         0.7793,  0.9165,  0.1046,  0.2715,  0.1422,  0.8735,  0.2689,
         0.4446,  0.9527,  0.5586,  0.8949,  0.3201,  0.9329,  0.7820,
         0.8077], device='cuda:0')
tensor(0.4575, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4618,  0.4179,  0.3750,  0.6159,  0.2401,  0.1953,  0.8733,
         0.2951,  0.9613,  0.7382,  0.4833,  0.9126,  0.0471,  0.8935,
         0.7623,  0.9126,  0.7098,  0.1623,  0.5132,  0.4878,  0.0708,
         0.5156,  0.8865,  0.0552,  0.1117,  0.1615,  0.0328,  0.8581,
         0.0827,  0.0362,  0.1793,  0.8659,  0.2414,  0.9122,  0.2134,
         0.9694,  0.9625,  0.7998,  0.9540,  0.8369,  0.3482,  0.0477,
         0.9118,  0.7954,  0.8761,  0.7151,  0.1891,  0.0348,  0.2287,
         0.1553,  0.2259,  0.6153,  0.1758,  0.8947,  0.2060,  0.4521,
         0.9313,  0.1666,  0.3849,  0.6923,  0.1814,  0.0750,  0.6427,
         0.7920,  0.0221,  0.1551,  0.9708,  0.0525,  0.0616,  0.8479,
         0.8838,  0.8259,  0.0886,  0.7659,  0.2790,  0.8527,  0.8840,
         0.5542,  0.9137,  0.2109,  0.1560,  0.8207,  0.3681,  0.0981,
         0.1756,  0.2680,  0.8317,  0.0440,  0.2222,  0.8462,  0.9011,
         0.4217,  0.8667,  0.7428,  0.8809,  0.8267,  0.6242,  0.1190,
         0.8224,  0.2605,  0.0993,  0.1647,  0.8866,  0.0342,  0.0911,
         0.2156,  0.0079,  0.1084,  0.8446,  0.0733,  0.6008,  0.8603,
         0.1025,  0.8512,  0.7817,  0.5896,  0.8860,  0.0966,  0.2774,
         0.3819,  0.1139,  0.8954,  0.8207,  0.7358,  0.7823,  0.3049,
         0.7502,  0.8164,  0.0654,  0.8939,  0.3514,  0.9456,  0.8672,
         0.5369,  0.5504,  0.8033,  0.2424,  0.7447,  0.9276,  0.1126,
         0.1089,  0.0307,  0.9782,  0.3373,  0.2674,  0.8263,  0.0766,
         0.3950,  0.4729,  0.3188,  0.1386,  0.0541,  0.4605,  0.9836,
         0.6043,  0.2689,  0.2236,  0.6144,  0.0779,  0.9704,  0.8733,
         0.3959,  0.4850,  0.3769,  0.9834,  0.0495,  0.8518,  0.2661,
         0.7325,  0.9368,  0.3984,  0.9495,  0.3520,  0.4650,  0.8848,
         0.9290,  0.3280,  0.8789,  0.4851,  0.5809,  0.8270,  0.9074,
         0.2843,  0.0277,  0.8098,  0.0596,  0.1665,  0.9143,  0.8590,
         0.4832,  0.2433,  0.6882,  0.8231,  0.1464,  0.4534,  0.2362,
         0.8661,  0.8639,  0.5209,  0.2728,  0.9081,  0.8235,  0.2347,
         0.1907,  0.1080,  0.8487,  0.1331,  0.8708,  0.3686,  0.0959,
         0.1358,  0.0690,  0.9417,  0.0299,  0.8141,  0.7403,  0.1558,
         0.8342,  0.8972,  0.1843,  0.8198,  0.0339,  0.7940,  0.8619,
         0.7576,  0.1754,  0.1532,  0.0915,  0.6828,  0.8969,  0.1321,
         0.6212,  0.5045,  0.6692,  0.1658,  0.1121,  0.0633,  0.6652,
         0.8065,  0.9560,  0.8321,  0.3023,  0.9474,  0.8475,  0.1236,
         0.8823,  0.0191,  0.4743,  0.9224,  0.2042,  0.0742,  0.1648,
         0.8821,  0.1080,  0.1541,  0.8341,  0.2740,  0.1691,  0.8298,
         0.7856,  0.2731,  0.1370,  0.8922,  0.8221,  0.9422,  0.3239,
         0.1788,  0.1604,  0.5955,  0.8724,  0.7842,  0.9158,  0.9121,
         0.0311,  0.2772,  0.1722,  0.2427,  0.0308,  0.0933,  0.7236,
         0.6448,  0.8790,  0.8347,  0.1197,  0.8907,  0.1802,  0.9086,
         0.1638,  0.7909,  0.0268,  0.8216,  0.7047,  0.6285,  0.0704,
         0.4326,  0.8579,  0.7715,  0.1137,  0.9864,  0.1193,  0.8057,
         0.6558,  0.8761,  0.9415,  0.0439,  0.4624,  0.8412,  0.9341,
         0.7857,  0.8780,  0.8093,  0.9404,  0.1609,  0.1774,  0.1041,
         0.8052,  0.9152,  0.1532,  0.0351,  0.8862,  0.8621,  0.0489,
         0.0533,  0.5570,  0.2743,  0.4274,  0.3367,  0.8970,  0.0286,
         0.1386,  0.8161,  0.2296,  0.1111,  0.8109,  0.0975,  0.4605,
         0.2546,  0.0347,  0.0659,  0.1687,  0.1469,  0.8195,  0.1095,
         0.2042,  0.7342,  0.1349,  0.7476,  0.8318,  0.7019,  0.4634,
         0.4788,  0.8426,  0.9420,  0.8904,  0.0433,  0.7455,  0.8452,
         0.2576,  0.8939,  0.7642,  0.0875,  0.9313,  0.2091,  0.8716,
         0.8583,  0.5437,  0.7017,  0.3229,  0.8759,  0.1606,  0.0992,
         0.0822,  0.0776,  0.7803,  0.9018,  0.1059,  0.0280,  0.9521,
         0.0881,  0.0985,  0.7624,  0.8443,  0.8776,  0.8112,  0.0851,
         0.5823,  0.2913,  0.1475,  0.8843,  0.2617,  0.7757,  0.9154,
         0.6816,  0.0178,  0.8633,  0.9917,  0.1859,  0.4855,  0.4187,
         0.8899,  0.3980,  0.8901,  0.0112,  0.7816,  0.2083,  0.8132,
         0.2292,  0.0505,  0.1203,  0.8267,  0.1265,  0.8382,  0.8158,
         0.1950,  0.7512,  0.2538,  0.8431,  0.2502,  0.8982,  0.0200,
         0.2448,  0.2155,  0.0527,  0.6480,  0.1712,  0.1412,  0.1077,
         0.6667,  0.0786,  0.7324,  0.2044,  0.0531,  0.8118,  0.5131,
         0.8779,  0.6296,  0.7339,  0.8602,  0.8415,  0.0771,  0.5574,
         0.2366,  0.7405,  0.1314,  0.9242,  0.9109,  0.5163,  0.7081,
         0.6252,  0.8613,  0.8301,  0.3455,  0.0325,  0.1292,  0.5552,
         0.3963,  0.6527,  0.3885,  0.7281,  0.7361,  0.4825,  0.2222,
         0.8338,  0.8902,  0.9301,  0.7165,  0.1332,  0.8047,  0.1163,
         0.7409,  0.9002,  0.7898,  0.1967,  0.5840,  0.9377,  0.2536,
         0.1662,  0.1001,  0.7059,  0.0564,  0.7108,  0.0708,  0.4692,
         0.1715,  0.8175,  0.0511,  0.8753,  0.8236,  0.7942,  0.6621,
         0.3074,  0.8917,  0.7006,  0.8594,  0.3521,  0.7852,  0.0773,
         0.9287,  0.3959,  0.0472,  0.9616,  0.8406,  0.1583,  0.0677,
         0.0618,  0.7494,  0.1740,  0.0982,  0.0744,  0.8596,  0.0962,
         0.9199], device='cuda:0')
tensor(0.4149, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8040,  0.2069,  0.5071,  0.1210,  0.8128,  0.0761,  0.0896,
         0.8674,  0.0313,  0.0273,  0.4845,  0.2881,  0.3204,  0.1613,
         0.0343,  0.3555,  0.3395,  0.2240,  0.1010,  0.3092,  0.1362,
         0.0129,  0.1821,  0.1626,  0.7910,  0.8965,  0.1481,  0.8847,
         0.1794,  0.7516,  0.1466,  0.8311,  0.1621,  0.0544,  0.8423,
         0.8577,  0.0701,  0.3615,  0.4634,  0.0891,  0.1141,  0.1389,
         0.8466,  0.1374,  0.2508,  0.0117,  0.5508,  0.0902,  0.8459,
         0.0869,  0.0102,  0.8705,  0.2058,  0.7352,  0.0659,  0.8432,
         0.8199,  0.8341,  0.6606,  0.1218,  0.1097,  0.8689,  0.7692,
         0.7863,  0.1528,  0.5026,  0.0856,  0.7599,  0.2638,  0.7379,
         0.7712,  0.8276,  0.5675,  0.0605,  0.0553,  0.5994,  0.1567,
         0.0494,  0.2818,  0.0635,  0.8695,  0.9340,  0.1249,  0.1920,
         0.0253,  0.1277,  0.1250,  0.0498,  0.1252,  0.7164,  0.7460,
         0.3042,  0.7889,  0.1351,  0.4410,  0.0337,  0.7178,  0.0134,
         0.1541,  0.0542,  0.6752,  0.7308,  0.0459,  0.8542,  0.3500,
         0.8259,  0.8750,  0.9708,  0.5684,  0.0475,  0.1867,  0.6176,
         0.0480,  0.8006,  0.9023,  0.2283,  0.0890,  0.0938,  0.6623,
         0.8581,  0.9022,  0.1077,  0.8253,  0.0486,  0.0996,  0.0608,
         0.4113,  0.9042,  0.5494,  0.0441,  0.8132,  0.1116,  0.0714,
         0.0123,  0.9041,  0.2427,  0.3714,  0.0048,  0.6449,  0.4825,
         0.7738,  0.0709,  0.4800,  0.7995,  0.0155,  0.1460,  0.7919,
         0.9363,  0.1305,  0.3905,  0.7363,  0.0152,  0.3958,  0.3973,
         0.7481,  0.0820,  0.5118,  0.0531,  0.2819,  0.7810,  0.1537,
         0.0778,  0.2549,  0.0285,  0.6279,  0.6959,  0.8387,  0.1554,
         0.0203,  0.0452,  0.0102,  0.1376,  0.8996,  0.8148,  0.0233,
         0.0557,  0.0229,  0.7525,  0.2166,  0.3093,  0.0755,  0.0607,
         0.0641,  0.7970,  0.8934,  0.6972,  0.1408,  0.8299,  0.9849,
         0.7938,  0.6411,  0.7456,  0.0383,  0.0614,  0.0199,  0.8956,
         0.3558,  0.3789,  0.7932,  0.3002,  0.1084,  0.6985,  0.6000,
         0.7946,  0.0844,  0.0777,  0.6441,  0.9319,  0.9635,  0.0864,
         0.0214,  0.0357,  0.4715,  0.5771,  0.1286,  0.0239,  0.1846,
         0.7525,  0.9369,  0.0098,  0.9444,  0.8339,  0.8613,  0.0880,
         0.0675,  0.4093,  0.1606,  0.5410,  0.2125,  0.8894,  0.5984,
         0.8771,  0.2735,  0.5176,  0.0865,  0.6674,  0.0870,  0.9143,
         0.6448,  0.9376,  0.7182,  0.0870,  0.3249,  0.8937,  0.1228,
         0.9788,  0.0755,  0.0790,  0.1392,  0.0089,  0.0759,  0.8022,
         0.0509,  0.0678,  0.8073,  0.0713,  0.7596,  0.1701,  0.5331,
         0.9205,  0.1074,  0.8739,  0.4302,  0.2756,  0.1948,  0.8097,
         0.0405,  0.7979,  0.9862,  0.1826,  0.6758,  0.1388,  0.6347,
         0.1375,  0.4703,  0.7806,  0.8590,  0.1177,  0.0922,  0.3486,
         0.0469,  0.1514,  0.3743,  0.0765,  0.7489,  0.1255,  0.0721,
         0.3359,  0.0721,  0.2203,  0.0827,  0.2570,  0.7362,  0.5981,
         0.2453,  0.2410,  0.0285,  0.1167,  0.0961,  0.0488,  0.3948,
         0.0908,  0.8712,  0.0851,  0.0276,  0.0359,  0.6784,  0.0264,
         0.0697,  0.8087,  0.6897,  0.1830,  0.7539,  0.0537,  0.3248,
         0.8984,  0.2624,  0.2139,  0.0146,  0.3096,  0.7835,  0.8388,
         0.6297,  0.3179,  0.0635,  0.4294,  0.0802,  0.0566,  0.0278,
         0.7877,  0.1082,  0.7781,  0.9224,  0.9359,  0.3373,  0.0202,
         0.9038,  0.1696,  0.1186,  0.6897,  0.6660,  0.2799,  0.0927,
         0.0903,  0.9181,  0.1460,  0.8868,  0.0493,  0.7533,  0.1276,
         0.0853,  0.0451,  0.8605,  0.1196,  0.8795,  0.0905,  0.7717,
         0.8774,  0.1128,  0.3116,  0.0302,  0.3962,  0.6529,  0.1379,
         0.6204,  0.1949,  0.8733,  0.1567,  0.9688,  0.0795,  0.9852,
         0.0765,  0.9121,  0.0483,  0.8857,  0.0578,  0.0713,  0.6188,
         0.0955,  0.8259,  0.8329,  0.2579,  0.6889,  0.1175,  0.0326,
         0.0660,  0.1335,  0.9087,  0.6097,  0.9517,  0.0964,  0.0524,
         0.1340,  0.5036,  0.2012,  0.8966,  0.8497,  0.7372,  0.0255,
         0.8016,  0.0742,  0.8478,  0.1943,  0.9244,  0.5245,  0.1052,
         0.5932,  0.4097,  0.0825,  0.2252,  0.1831,  0.0687,  0.0898,
         0.1063,  0.9534,  0.8832,  0.4224,  0.0958,  0.9165,  0.2316,
         0.1029,  0.6744,  0.0336,  0.0375,  0.0632,  0.3084,  0.7207,
         0.8783,  0.8016,  0.7401,  0.0310,  0.0395,  0.0101,  0.3205,
         0.0537,  0.8520,  0.7804,  0.0610,  0.7362,  0.7325,  0.1439,
         0.7299,  0.8418,  0.1458,  0.0560,  0.0723,  0.8174,  0.1019,
         0.9779,  0.1782,  0.1936,  0.1408,  0.0224,  0.6442,  0.2030,
         0.0480,  0.8762,  0.2557,  0.4488,  0.9086,  0.0623,  0.8291,
         0.1608,  0.2293,  0.0237,  0.5555,  0.9125,  0.1292,  0.7909,
         0.8707,  0.1338,  0.9823,  0.2903,  0.0785,  0.0666,  0.1552,
         0.0886,  0.4192,  0.0621,  0.6767,  0.0420,  0.1047,  0.2707,
         0.0820,  0.5887,  0.0931,  0.7937,  0.8104,  0.0203,  0.0478,
         0.0972,  0.2904,  0.3141,  0.1199,  0.0689,  0.3799,  0.8843,
         0.0564,  0.1647,  0.0512,  0.8823,  0.0686,  0.0891,  0.9134,
         0.4439,  0.8463,  0.1955,  0.1646,  0.0514,  0.9467,  0.3478,
         0.2060], device='cuda:0')
tensor(0.5068, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2647,  0.3771,  0.2324,  0.9049,  0.1154,  0.8704,  0.8321,
         0.8434,  0.3222,  0.1111,  0.0672,  0.0485,  0.9051,  0.4161,
         0.1595,  0.5544,  0.0963,  0.0187,  0.7482,  0.3963,  0.1135,
         0.3929,  0.0250,  0.0961,  0.2943,  0.6207,  0.8532,  0.6646,
         0.0549,  0.5464,  0.4130,  0.5896,  0.2665,  0.2160,  0.0387,
         0.6997,  0.1181,  0.7716,  0.6292,  0.1073,  0.3438,  0.2148,
         0.8457,  0.1431,  0.6876,  0.7724,  0.1482,  0.0297,  0.2215,
         0.3436,  0.8133,  0.6178,  0.0212,  0.0352,  0.9012,  0.3571,
         0.7540,  0.8916,  0.0542,  0.8780,  0.9081,  0.1236,  0.6550,
         0.1747,  0.1311,  0.6086,  0.0107,  0.2428,  0.0274,  0.2731,
         0.4522,  0.2634,  0.9852,  0.3400,  0.7445,  0.0399,  0.8461,
         0.4203,  0.9824,  0.7160,  0.7294,  0.0677,  0.2707,  0.3006,
         0.8030,  0.1764,  0.2817,  0.9365,  0.7541,  0.1127,  0.3002,
         0.1239,  0.3210,  0.1767,  0.5014,  0.0573,  0.2681,  0.5677,
         0.8151,  0.2036,  0.6329,  0.5971,  0.5890,  0.4839,  0.5064,
         0.1382,  0.7439,  0.2152,  0.1920,  0.7941,  0.1305,  0.0547,
         0.1060,  0.1101,  0.2505,  0.6997,  0.4102,  0.8221,  0.1068,
         0.8102,  0.7985,  0.1877,  0.3637,  0.8878,  0.8070,  0.7089,
         0.0987,  0.3758,  0.1496,  0.6902,  0.3317,  0.9312,  0.8987,
         0.3289,  0.0220,  0.1784,  0.3878,  0.9309,  0.9132,  0.3934,
         0.8785,  0.5261,  0.9704,  0.6371,  0.3513,  0.7602,  0.3533,
         0.0578,  0.6490,  0.1676,  0.1492,  0.2309,  0.3116,  0.7136,
         0.4033,  0.1567,  0.0777,  0.6743,  0.6463,  0.1660,  0.7341,
         0.5983,  0.9239,  0.2621,  0.8333,  0.0461,  0.9700,  0.0886,
         0.8310,  0.1229,  0.2018,  0.0314,  0.7504,  0.9175,  0.1387,
         0.1260,  0.8990,  0.9592,  0.7702,  0.7326,  0.8238,  0.8235,
         0.9688,  0.2408,  0.2081,  0.7119,  0.5214,  0.8866,  0.3010,
         0.6858,  0.7269,  0.3322,  0.8354,  0.5930,  0.7487,  0.8344,
         0.3062,  0.2592,  0.2135,  0.0676,  0.2161,  0.0679,  0.4963,
         0.0845,  0.9759,  0.1617,  0.7407,  0.6796,  0.3192,  0.0719,
         0.4895,  0.5546,  0.8459,  0.7240,  0.9324,  0.4515,  0.8414,
         0.8953,  0.0820,  0.0687,  0.5755,  0.8358,  0.2197,  0.8352,
         0.5137,  0.8421,  0.3904,  0.1220,  0.0314,  0.7927,  0.1192,
         0.3116,  0.0904,  0.3609,  0.7137,  0.0590,  0.0949,  0.2868,
         0.6547,  0.6094,  0.8257,  0.3109,  0.7150,  0.1355,  0.8204,
         0.7335,  0.0225,  0.0587,  0.5846,  0.1081,  0.8856,  0.5497,
         0.1733,  0.4286,  0.7787,  0.1726,  0.2981,  0.8065,  0.0592,
         0.1782,  0.3262,  0.8003,  0.0670,  0.2277,  0.2018,  0.0379,
         0.0475,  0.5179,  0.2000,  0.1905,  0.9062,  0.2761,  0.9424,
         0.2137,  0.6344,  0.8294,  0.5906,  0.3396,  0.3242,  0.2619,
         0.8989,  0.8545,  0.8574,  0.5846,  0.4727,  0.3368,  0.8446,
         0.3603,  0.1300,  0.8147,  0.0858,  0.9814,  0.6569,  0.9151,
         0.8933,  0.6909,  0.9064,  0.9162,  0.0547,  0.8030,  0.7705,
         0.6911,  0.9154,  0.1599,  0.0906,  0.0545,  0.1702,  0.3050,
         0.8305,  0.1287,  0.1752,  0.1852,  0.1424,  0.7833,  0.8535,
         0.8050,  0.2055,  0.9770,  0.4073,  0.2395,  0.9667,  0.1221,
         0.3558,  0.8240,  0.1323,  0.6632,  0.3096,  0.9250,  0.5421,
         0.0801,  0.3023,  0.0834,  0.0613,  0.3632,  0.6505,  0.7087,
         0.5627,  0.2466,  0.0332,  0.7946,  0.7455,  0.3385,  0.1526,
         0.5647,  0.0755,  0.6650,  0.6403,  0.8507,  0.0719,  0.0710,
         0.8541,  0.0441,  0.7651,  0.0989,  0.8620,  0.7084,  0.0952,
         0.3424,  0.8826,  0.1771,  0.8326,  0.6017,  0.0789,  0.2061,
         0.9021,  0.9263,  0.6225,  0.1789,  0.5680,  0.0423,  0.2992,
         0.8425,  0.0688,  0.7210,  0.1209,  0.7594,  0.6479,  0.1391,
         0.0890,  0.0304,  0.1086,  0.4974,  0.3184,  0.0369,  0.7071,
         0.6741,  0.1695,  0.7331,  0.2322,  0.8610,  0.0441,  0.6090,
         0.8351,  0.7719,  0.0405,  0.3400,  0.8390,  0.1399,  0.8910,
         0.1361,  0.2188,  0.8622,  0.8683,  0.2314,  0.2107,  0.1081,
         0.8931,  0.7960,  0.6045,  0.2721,  0.8450,  0.8220,  0.8935,
         0.4952,  0.9185,  0.1433,  0.4573,  0.2173,  0.1026,  0.0567,
         0.0753,  0.3046,  0.4427,  0.8510,  0.1973,  0.7462,  0.5842,
         0.9458,  0.0676,  0.3128,  0.0409,  0.0459,  0.9068,  0.0808,
         0.1967,  0.9668,  0.4712,  0.5972,  0.1279,  0.3045,  0.9108,
         0.0649,  0.0488,  0.3540,  0.0665,  0.2550,  0.8790,  0.0780,
         0.3455,  0.0664,  0.2093,  0.2925,  0.4761,  0.1086,  0.1216,
         0.6041,  0.3861,  0.0887,  0.1092,  0.2079,  0.9565,  0.4616,
         0.7206,  0.1311,  0.2497,  0.8428,  0.7068,  0.9177,  0.3859,
         0.1653,  0.6447,  0.1319,  0.0682,  0.0797,  0.0694,  0.7563,
         0.6787,  0.8129,  0.9785,  0.1379,  0.0652,  0.9206,  0.9612,
         0.9853,  0.0978,  0.1812,  0.1488,  0.4025,  0.8803,  0.8741,
         0.7507,  0.9531,  0.1336,  0.5816,  0.0824,  0.4571,  0.2346,
         0.4707,  0.8634,  0.9473,  0.6751,  0.0687,  0.9788,  0.1179,
         0.2409,  0.2235,  0.7385,  0.8661,  0.0746,  0.8905,  0.5507,
         0.3643], device='cuda:0')
tensor(0.4366, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1476,  0.3492,  0.3598,  0.0483,  0.9310,  0.0878,  0.6544,
         0.4543,  0.8295,  0.5561,  0.6994,  0.1795,  0.5248,  0.8172,
         0.4079,  0.2650,  0.1790,  0.3606,  0.9104,  0.9088,  0.7463,
         0.3495,  0.2102,  0.7426,  0.6019,  0.3901,  0.3536,  0.2170,
         0.7005,  0.8896,  0.5994,  0.0925,  0.8374,  0.8581,  0.0251,
         0.3081,  0.7041,  0.0830,  0.8979,  0.9500,  0.1216,  0.0509,
         0.9633,  0.4698,  0.9513,  0.6511,  0.9045,  0.6215,  0.5308,
         0.9915,  0.9581,  0.9121,  0.7475,  0.1775,  0.0275,  0.8587,
         0.6614,  0.9488,  0.2869,  0.7150,  0.3662,  0.9193,  0.0542,
         0.1858,  0.1878,  0.4052,  0.4041,  0.3394,  0.7390,  0.0696,
         0.2952,  0.6505,  0.1345,  0.1400,  0.1270,  0.5187,  0.5948,
         0.9300,  0.8194,  0.1691,  0.7367,  0.8321,  0.2366,  0.1051,
         0.3374,  0.0379,  0.8717,  0.0854,  0.8137,  0.4067,  0.5495,
         0.6979,  0.5837,  0.7375,  0.1637,  0.4634,  0.7851,  0.8794,
         0.8681,  0.2138,  0.0908,  0.5929,  0.2656,  0.8292,  0.7121,
         0.9384,  0.2022,  0.3962,  0.6553,  0.0414,  0.9853,  0.9074,
         0.4141,  0.6927,  0.5899,  0.2777,  0.5618,  0.8692,  0.5657,
         0.2610,  0.9400,  0.7817,  0.3202,  0.4314,  0.7895,  0.8032,
         0.1831,  0.0535,  0.8463,  0.1700,  0.8556,  0.8756,  0.7224,
         0.8551,  0.5484,  0.6133,  0.9938,  0.8952,  0.7347,  0.5786,
         0.8671,  0.7603,  0.3649,  0.7881,  0.8783,  0.4946,  0.4230,
         0.6715,  0.6841,  0.8023,  0.3408,  0.8208,  0.2454,  0.8334,
         0.9203,  0.8219,  0.9499,  0.2809,  0.9157,  0.0310,  0.8333,
         0.2149,  0.9666,  0.2899,  0.4867,  0.2408,  0.0240,  0.0744,
         0.3734,  0.1821,  0.8531,  0.6974,  0.1792,  0.4524,  0.2911,
         0.6791,  0.8044,  0.8274,  0.9188,  0.7929,  0.0390,  0.8695,
         0.8277,  0.0375,  0.9252,  0.1113,  0.8334,  0.0751,  0.8250,
         0.2536,  0.1306,  0.7023,  0.4691,  0.7616,  0.3840,  0.1463,
         0.7050,  0.8320,  0.6436,  0.7874,  0.7311,  0.9160,  0.7491,
         0.4022,  0.8855,  0.9898,  0.3397,  0.7268,  0.6577,  0.7997,
         0.0953,  0.8677,  0.1826,  0.8748,  0.7480,  0.7141,  0.8214,
         0.5450,  0.6727,  0.7915,  0.3740,  0.2319,  0.4583,  0.7411,
         0.8324,  0.5184,  0.8306,  0.7629,  0.1673,  0.2736,  0.1357,
         0.2119,  0.8992,  0.1063,  0.7414,  0.3686,  0.8286,  0.1714,
         0.1528,  0.8183,  0.6132,  0.9416,  0.7403,  0.1337,  0.4475,
         0.1020,  0.3619,  0.0814,  0.6479,  0.1898,  0.8208,  0.4483,
         0.0420,  0.3490,  0.9028,  0.6544,  0.0197,  0.5551,  0.5076,
         0.2089,  0.9419,  0.8470,  0.9111,  0.3568,  0.7945,  0.3732,
         0.5121,  0.9115,  0.8927,  0.9134,  0.7328,  0.5520,  0.6822,
         0.5794,  0.2370,  0.3640,  0.7048,  0.1639,  0.1530,  0.8394,
         0.1011,  0.1542,  0.1828,  0.9717,  0.8363,  0.8854,  0.8283,
         0.6838,  0.8565,  0.0932,  0.0733,  0.1887,  0.8677,  0.7724,
         0.7204,  0.7909,  0.7611,  0.2206,  0.2314,  0.8351,  0.2742,
         0.3569,  0.7556,  0.6578,  0.0462,  0.2586,  0.2203,  0.7940,
         0.2517,  0.7593,  0.3744,  0.1360,  0.9449,  0.2719,  0.3115,
         0.4468,  0.6636,  0.1877,  0.3211,  0.8280,  0.1580,  0.7938,
         0.6819,  0.6048,  0.6786,  0.7537,  0.2671,  0.7716,  0.1627,
         0.7466,  0.1680,  0.8280,  0.8869,  0.2252,  0.1009,  0.8470,
         0.9290,  0.6010,  0.9941,  0.8152,  0.3551,  0.1582,  0.9465,
         0.5429,  0.3320,  0.8240,  0.8072,  0.6983,  0.0777,  0.6588,
         0.8039,  0.7910,  0.1664,  0.3473,  0.0511,  0.0974,  0.3158,
         0.0970,  0.6956,  0.9197,  0.4749,  0.5429,  0.8990,  0.6392,
         0.0387,  0.7839,  0.8946,  0.2325,  0.8050,  0.4811,  0.2735,
         0.1958,  0.6479,  0.0939,  0.8552,  0.1318,  0.9131,  0.8168,
         0.6637,  0.9739,  0.2080,  0.2204,  0.2860,  0.1371,  0.0971,
         0.0370,  0.6157,  0.4984,  0.9189,  0.9547,  0.9032,  0.1352,
         0.2212,  0.7684,  0.4231,  0.1890,  0.5756,  0.7263,  0.8580,
         0.2015,  0.6930,  0.0834,  0.6288,  0.9090,  0.9135,  0.0879,
         0.8125,  0.2594,  0.5651,  0.2047,  0.0756,  0.5088,  0.5249,
         0.6735,  0.8648,  0.8871,  0.8614,  0.9128,  0.2744,  0.9515,
         0.1311,  0.7154,  0.2724,  0.8546,  0.3581,  0.2276,  0.9360,
         0.5235,  0.2145,  0.4627,  0.8610,  0.0406,  0.7763,  0.7524,
         0.7009,  0.9750,  0.8470,  0.8541,  0.3732,  0.6586,  0.9320,
         0.5977,  0.2789,  0.8007,  0.1678,  0.1496,  0.0943,  0.6369,
         0.5893,  0.8558,  0.6971,  0.4197,  0.2638,  0.9454,  0.8420,
         0.8154,  0.4093,  0.1896,  0.2041,  0.7510,  0.5799,  0.9379,
         0.5347,  0.9258,  0.8801,  0.5623,  0.3029,  0.9277,  0.7945,
         0.6884,  0.3335,  0.4011,  0.9556,  0.8028,  0.8592,  0.3208,
         0.7080,  0.3926,  0.9872,  0.9170,  0.1818,  0.7928,  0.2051,
         0.2620,  0.1469,  0.9832,  0.9032,  0.0894,  0.7546,  0.8425,
         0.2718,  0.6134,  0.1841,  0.2963,  0.3779,  0.3803,  0.5273,
         0.7906,  0.5014,  0.1489,  0.6149,  0.2606,  0.1886,  0.2051,
         0.0816,  0.9504,  0.7952,  0.8851,  0.8345,  0.5319,  0.5083,
         0.8144], device='cuda:0')
tensor(0.4417, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7492,  0.9450,  0.1192,  0.6760,  0.9191,  0.8278,  0.8639,
         0.0209,  0.8173,  0.4838,  0.9124,  0.1515,  0.8594,  0.7300,
         0.8660,  0.2915,  0.9153,  0.9117,  0.4276,  0.1575,  0.8456,
         0.9022,  0.7602,  0.3038,  0.4112,  0.2186,  0.6781,  0.9793,
         0.9112,  0.6466,  0.8658,  0.0727,  0.7850,  0.4620,  0.1464,
         0.8193,  0.5166,  0.5746,  0.7943,  0.6962,  0.9108,  0.1867,
         0.2661,  0.2567,  0.7217,  0.0725,  0.4165,  0.2696,  0.6323,
         0.2855,  0.0693,  0.1559,  0.6122,  0.8712,  0.8455,  0.8954,
         0.4412,  0.2628,  0.4305,  0.0516,  0.7640,  0.8883,  0.6879,
         0.2347,  0.5245,  0.9350,  0.8276,  0.6341,  0.1169,  0.2505,
         0.2929,  0.3397,  0.1475,  0.8157,  0.5796,  0.8067,  0.7126,
         0.5145,  0.8539,  0.2304,  0.8176,  0.1461,  0.3265,  0.3978,
         0.3574,  0.1408,  0.9544,  0.7092,  0.1783,  0.2280,  0.8649,
         0.9869,  0.2455,  0.8452,  0.3289,  0.3051,  0.9161,  0.0254,
         0.9504,  0.8229,  0.1245,  0.8223,  0.1282,  0.2155,  0.9277,
         0.9334,  0.4365,  0.7570,  0.8796,  0.6360,  0.9111,  0.3198,
         0.9779,  0.9195,  0.1491,  0.0713,  0.9186,  0.8363,  0.2044,
         0.2720,  0.2164,  0.9833,  0.8515,  0.7831,  0.7835,  0.6166,
         0.3679,  0.3464,  0.9109,  0.1354,  0.8112,  0.7587,  0.9332,
         0.8576,  0.2135,  0.5173,  0.3977,  0.3921,  0.7381,  0.9019,
         0.7663,  0.2200,  0.7862,  0.6814,  0.8605,  0.7478,  0.4983,
         0.9844,  0.2011,  0.0767,  0.2130,  0.7031,  0.6476,  0.4709,
         0.6492,  0.3293,  0.9101,  0.9679,  0.4190,  0.9177,  0.7356,
         0.9600,  0.6071,  0.8768,  0.8236,  0.3340,  0.7370,  0.9032,
         0.4060,  0.7955,  0.9205,  0.8149,  0.0407,  0.9927,  0.1043,
         0.1366,  0.8442,  0.9020,  0.7413,  0.2850,  0.5729,  0.3940,
         0.9904,  0.4970,  0.1814,  0.8705,  0.8234,  0.9606,  0.6620,
         0.8704,  0.8324,  0.7281,  0.6174,  0.9753,  0.6612,  0.8938,
         0.9255,  0.3021,  0.5662,  0.6245,  0.1391,  0.2520,  0.0645,
         0.4328,  0.8551,  0.7981,  0.2029,  0.7803,  0.9071,  0.9628,
         0.3274,  0.6027,  0.8753,  0.2698,  0.8642,  0.5131,  0.1071,
         0.8501,  0.9347,  0.9273,  0.3085,  0.3447,  0.1432,  0.3109,
         0.1319,  0.8940,  0.8780,  0.2381,  0.1377,  0.5475,  0.9418,
         0.9285,  0.8189,  0.8911,  0.5171,  0.4378,  0.5918,  0.9863,
         0.8547,  0.9261,  0.0600,  0.0706,  0.8728,  0.8578,  0.5833,
         0.2037,  0.8456,  0.5364,  0.7848,  0.4944,  0.2725,  0.9837,
         0.3358,  0.9935,  0.9636,  0.8519,  0.2307,  0.5843,  0.5521,
         0.5457,  0.4550,  0.8540,  0.5381,  0.4853,  0.8689,  0.6981,
         0.7384,  0.2777,  0.8782,  0.9590,  0.9061,  0.9616,  0.3588,
         0.9039,  0.8601,  0.6059,  0.6979,  0.1604,  0.9034,  0.7688,
         0.6372,  0.3506,  0.3166,  0.5915,  0.6641,  0.8130,  0.7214,
         0.2821,  0.8062,  0.4157,  0.8729,  0.2697,  0.8096,  0.5509,
         0.8966,  0.8739,  0.8803,  0.5583,  0.8558,  0.2882,  0.2638,
         0.8513,  0.2391,  0.8690,  0.4388,  0.1189,  0.8337,  0.6903,
         0.4058,  0.8694,  0.2172,  0.7631,  0.6370,  0.6194,  0.5282,
         0.2998,  0.8862,  0.1741,  0.2222,  0.1259,  0.9192,  0.8044,
         0.8331,  0.3308,  0.1952,  0.8494,  0.7716,  0.8901,  0.8951,
         0.5242,  0.6582,  0.6497,  0.7673,  0.8201,  0.8561,  0.4633,
         0.8169,  0.1339,  0.7486,  0.8201,  0.8610,  0.3965,  0.8199,
         0.1724,  0.8043,  0.8078,  0.5058,  0.2583,  0.8300,  0.9011,
         0.7899,  0.7378,  0.5810,  0.3080,  0.5184,  0.3049,  0.6623,
         0.3228,  0.8838,  0.1534,  0.9690,  0.7559,  0.8679,  0.8900,
         0.9232,  0.2050,  0.8127,  0.1649,  0.0731,  0.3412,  0.8737,
         0.9303,  0.8271,  0.5196,  0.8710,  0.8109,  0.8547,  0.0961,
         0.2686,  0.9638,  0.0372,  0.3983,  0.8598,  0.8905,  0.7849,
         0.9542,  0.8437,  0.8602,  0.3800,  0.8735,  0.6953,  0.8234,
         0.6731,  0.1954,  0.7338,  0.8717,  0.6845,  0.3683,  0.8293,
         0.9232,  0.7642,  0.6803,  0.6728,  0.2101,  0.9193,  0.0324,
         0.7850,  0.9401,  0.5640,  0.1781,  0.1038,  0.4880,  0.1017,
         0.8061,  0.9360,  0.1940,  0.1678,  0.8725,  0.9966,  0.5924,
         0.5782,  0.3992,  0.9588,  0.7824,  0.2713,  0.9277,  0.8990,
         0.9395,  0.8860,  0.1434,  0.8346,  0.2336,  0.8972,  0.7013,
         0.9073,  0.8902,  0.1736,  0.7354,  0.3804,  0.8270,  0.9198,
         0.9219,  0.7858,  0.2337,  0.1398,  0.8643,  0.8255,  0.2733,
         0.7530,  0.7541,  0.9654,  0.9374,  0.9903,  0.1812,  0.3851,
         0.0679,  0.8671,  0.1233,  0.2660,  0.3696,  0.6667,  0.6255,
         0.5792,  0.5667,  0.9224,  0.1135,  0.1609,  0.9412,  0.8350,
         0.8772,  0.8356,  0.9713,  0.0900,  0.5941,  0.8322,  0.8744,
         0.6612,  0.8763,  0.9360,  0.0946,  0.8552,  0.1863,  0.9191,
         0.1804,  0.2726,  0.1909,  0.7033,  0.5051,  0.1317,  0.8725,
         0.6783,  0.5911,  0.7308,  0.4502,  0.0516,  0.1170,  0.5602,
         0.6872,  0.0262,  0.5847,  0.4430,  0.1131,  0.9494,  0.9630,
         0.8818,  0.1089,  0.2956,  0.6720,  0.8766,  0.1769,  0.8315,
         0.6901], device='cuda:0')
tensor(0.5013, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5437,  0.4801,  0.8994,  0.2152,  0.8839,  0.1803,  0.3461,
         0.3092,  0.1281,  0.5528,  0.6488,  0.3685,  0.6384,  0.7079,
         0.4184,  0.6267,  0.1808,  0.5001,  0.5270,  0.8673,  0.8112,
         0.9694,  0.7812,  0.3684,  0.3707,  0.8398,  0.5899,  0.5715,
         0.3293,  0.8999,  0.6859,  0.7736,  0.4609,  0.5142,  0.4184,
         0.2769,  0.7672,  0.5937,  0.7747,  0.5931,  0.9838,  0.6376,
         0.4918,  0.5570,  0.2707,  0.2755,  0.7115,  0.1994,  0.5161,
         0.2417,  0.3179,  0.1496,  0.1632,  0.1429,  0.1578,  0.4922,
         0.1542,  0.9396,  0.8623,  0.3085,  0.8878,  0.6789,  0.7011,
         0.9837,  0.9541,  0.5242,  0.8962,  0.4917,  0.5403,  0.8544,
         0.5834,  0.9888,  0.2500,  0.8950,  0.6319,  0.5292,  0.3238,
         0.5217,  0.6587,  0.6335,  0.8008,  0.0835,  0.1423,  0.6083,
         0.0711,  0.8413,  0.7614,  0.6087,  0.8612,  0.4427,  0.4915,
         0.2303,  0.8158,  0.7473,  0.2992,  0.8074,  0.8110,  0.9141,
         0.6750,  0.3716,  0.5403,  0.8377,  0.1771,  0.9932,  0.2108,
         0.8668,  0.5730,  0.2548,  0.0928,  0.8300,  0.3838,  0.6924,
         0.2507,  0.1009,  0.9960,  0.7885,  0.8551,  0.4081,  0.2728,
         0.1994,  0.2957,  0.2603,  0.9819,  0.6394,  0.8449,  0.8239,
         0.1626,  0.8155,  0.3643,  0.8172,  0.6729,  0.1163,  0.7313,
         0.2050,  0.2214,  0.1319,  0.2773,  0.4683,  0.4332,  0.4800,
         0.2991,  0.2587,  0.1716,  0.9755,  0.4231,  0.5587,  0.5841,
         0.7577,  0.5169,  0.5692,  0.4842,  0.9084,  0.4171,  0.2558,
         0.2674,  0.4941,  0.7639,  0.0436,  0.8829,  0.7381,  0.3653,
         0.6516,  0.4319,  0.4516,  0.6807,  0.2637,  0.6868,  0.2233,
         0.3173,  0.5182,  0.5622,  0.8678,  0.4927,  0.1080,  0.3038,
         0.8298,  0.6647,  0.0485,  0.1971,  0.2192,  0.2562,  0.3098,
         0.4811,  0.1729,  0.9596,  0.9016,  0.9589,  0.8078,  0.4960,
         0.8541,  0.9394,  0.5049,  0.1932,  0.7861,  0.3814,  0.4587,
         0.9576,  0.2201,  0.8401,  0.7920,  0.6068,  0.6136,  0.7565,
         0.9181,  0.6730,  0.9529,  0.3615,  0.5506,  0.1571,  0.8445,
         0.1118,  0.3009,  0.7480,  0.4572,  0.1632,  0.1842,  0.1601,
         0.4925,  0.7893,  0.2224,  0.2693,  0.4015,  0.9170,  0.3075,
         0.0464,  0.9278,  0.2156,  0.4752,  0.2238,  0.1801,  0.3409,
         0.3611,  0.5181,  0.1277,  0.7067,  0.8117,  0.5378,  0.7050,
         0.7697,  0.7707,  0.7002,  0.3712,  0.6195,  0.8963,  0.9305,
         0.4896,  0.1090,  0.3690,  0.6501,  0.5139,  0.9396,  0.7156,
         0.7374,  0.5129,  0.9482,  0.7983,  0.1621,  0.3578,  0.7899,
         0.8688,  0.4010,  0.3398,  0.9411,  0.8497,  0.2674,  0.2824,
         0.8013,  0.4412,  0.1819,  0.8210,  0.2541,  0.2887,  0.5251,
         0.7947,  0.5232,  0.6978,  0.4041,  0.7187,  0.8329,  0.3816,
         0.2490,  0.9599,  0.6455,  0.1564,  0.5262,  0.3953,  0.0831,
         0.1535,  0.6820,  0.4126,  0.7600,  0.7785,  0.6909,  0.4846,
         0.8074,  0.2422,  0.7745,  0.7963,  0.8834,  0.4177,  0.7214,
         0.2813,  0.7637,  0.4411,  0.9002,  0.7665,  0.2043,  0.7444,
         0.6876,  0.5350,  0.5421,  0.2669,  0.9921,  0.5429,  0.3244,
         0.8761,  0.8034,  0.9931,  0.6910,  0.0356,  0.2310,  0.2606,
         0.8507,  0.0955,  0.8068,  0.5725,  0.4154,  0.7611,  0.0838,
         0.7375,  0.6749,  0.3895,  0.6317,  0.9494,  0.4418,  0.5887,
         0.4152,  0.1202,  0.1819,  0.1183,  0.3961,  0.3484,  0.8734,
         0.4644,  0.4143,  0.3644,  0.4462,  0.6880,  0.8754,  0.4307,
         0.9359,  0.8209,  0.8059,  0.7897,  0.5340,  0.8484,  0.7291,
         0.5870,  0.1232,  0.2203,  0.9131,  0.2846,  0.3993,  0.3137,
         0.2178,  0.4726,  0.6905,  0.8281,  0.7735,  0.9304,  0.7699,
         0.8845,  0.0587,  0.8801,  0.8994,  0.6832,  0.5635,  0.3249,
         0.6032,  0.8900,  0.7723,  0.7510,  0.9086,  0.2535,  0.9203,
         0.8890,  0.3190,  0.5109,  0.4839,  0.7323,  0.9317,  0.2208,
         0.9211,  0.7464,  0.3778,  0.2655,  0.3105,  0.6906,  0.3433,
         0.8615,  0.7237,  0.5398,  0.0694,  0.2915,  0.8823,  0.1951,
         0.2365,  0.2560,  0.9408,  0.6022,  0.5519,  0.4949,  0.7269,
         0.9098,  0.6106,  0.0197,  0.7990,  0.8497,  0.2822,  0.8688,
         0.9572,  0.9232,  0.2518,  0.7318,  0.8073,  0.9307,  0.8272,
         0.1510,  0.7798,  0.8215,  0.8868,  0.8200,  0.8845,  0.7611,
         0.5714,  0.3333,  0.4802,  0.9126,  0.5627,  0.7001,  0.8796,
         0.3357,  0.9813,  0.7760,  0.5125,  0.8922,  0.1608,  0.4952,
         0.6778,  0.6599,  0.9551,  0.1582,  0.8694,  0.1421,  0.9725,
         0.3129,  0.9166,  0.2158,  0.8557,  0.6753,  0.3871,  0.7372,
         0.2724,  0.4863,  0.7589,  0.6802,  0.6728,  0.9788,  0.9167,
         0.3624,  0.7032,  0.3413,  0.5102,  0.6657,  0.9865,  0.6421,
         0.3558,  0.7189,  0.8538,  0.7639,  0.6303,  0.2761,  0.8617,
         0.8956,  0.6168,  0.7778,  0.7884,  0.0392,  0.1547,  0.5726,
         0.0578,  0.6534,  0.6642,  0.6557,  0.7614,  0.7574,  0.8420,
         0.3335,  0.5512,  0.3039,  0.6013,  0.6085,  0.7254,  0.7847,
         0.2839,  0.9202,  0.7042,  0.1723,  0.5970,  0.4838,  0.7988,
         0.2729], device='cuda:0')
tensor(0.4576, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5782,  0.4583,  0.8590,  0.7862,  0.9366,  0.9015,  0.7869,
         0.4482,  0.4059,  0.2839,  0.3702,  0.3561,  0.8225,  0.8881,
         0.9626,  0.2223,  0.8736,  0.0578,  0.4649,  0.8539,  0.6747,
         0.2910,  0.4068,  0.7265,  0.5022,  0.4345,  0.1457,  0.8135,
         0.9022,  0.6668,  0.5579,  0.9606,  0.4640,  0.8177,  0.1140,
         0.2916,  0.3500,  0.3441,  0.3136,  0.9577,  0.8446,  0.3771,
         0.9926,  0.1487,  0.5587,  0.8125,  0.6617,  0.3099,  0.5660,
         0.2351,  0.4008,  0.2106,  0.0644,  0.8401,  0.1860,  0.4829,
         0.6851,  0.8878,  0.1307,  0.3054,  0.2599,  0.2747,  0.8356,
         0.2789,  0.4806,  0.4965,  0.3780,  0.0941,  0.4684,  0.1847,
         0.8911,  0.3517,  0.1747,  0.9762,  0.8336,  0.3932,  0.9196,
         0.4712,  0.5857,  0.3795,  0.6707,  0.9029,  0.9247,  0.1202,
         0.9841,  0.8006,  0.4570,  0.0439,  0.4675,  0.6500,  0.8783,
         0.6149,  0.7217,  0.3553,  0.9499,  0.5888,  0.4290,  0.6476,
         0.0597,  0.8411,  0.5253,  0.9634,  0.3630,  0.9154,  0.6373,
         0.3623,  0.9057,  0.9373,  0.8569,  0.3751,  0.2008,  0.6028,
         0.4911,  0.2423,  0.8237,  0.0867,  0.5506,  0.8517,  0.9603,
         0.8291,  0.8057,  0.2012,  0.8372,  0.9521,  0.4869,  0.9777,
         0.8042,  0.7709,  0.1834,  0.2396,  0.3922,  0.7215,  0.9343,
         0.8204,  0.5004,  0.8804,  0.1650,  0.8247,  0.8906,  0.4302,
         0.9470,  0.2192,  0.3911,  0.1768,  0.6729,  0.8708,  0.4160,
         0.3977,  0.1796,  0.6956,  0.3835,  0.4902,  0.8887,  0.7890,
         0.1575,  0.1527,  0.2798,  0.8745,  0.3519,  0.2370,  0.1516,
         0.8892,  0.5882,  0.6468,  0.5026,  0.6312,  0.2520,  0.9678,
         0.8439,  0.6880,  0.1835,  0.1210,  0.1429,  0.5437,  0.0306,
         0.3585,  0.4253,  0.9162,  0.6796,  0.6305,  0.8351,  0.4459,
         0.7952,  0.8411,  0.2529,  0.3549,  0.4988,  0.8128,  0.4121,
         0.8329,  0.9021,  0.8536,  0.8933,  0.7654,  0.7888,  0.1243,
         0.1603,  0.6352,  0.7268,  0.9253,  0.5949,  0.2621,  0.7133,
         0.8112,  0.5546,  0.5668,  0.7770,  0.8640,  0.6428,  0.5740,
         0.8390,  0.4354,  0.6843,  0.1221,  0.7785,  0.7434,  0.7961,
         0.8167,  0.2056,  0.9009,  0.1497,  0.0932,  0.2234,  0.2178,
         0.7820,  0.5151,  0.2128,  0.8596,  0.1810,  0.9337,  0.4728,
         0.5988,  0.5511,  0.5413,  0.8398,  0.8833,  0.6913,  0.0856,
         0.2049,  0.6484,  0.5923,  0.5812,  0.5756,  0.7925,  0.2276,
         0.3931,  0.3500,  0.7820,  0.4929,  0.8707,  0.9006,  0.3376,
         0.6885,  0.8952,  0.8851,  0.8262,  0.8941,  0.6105,  0.9595,
         0.1660,  0.6336,  0.0898,  0.8960,  0.2700,  0.8896,  0.7892,
         0.8708,  0.5087,  0.8648,  0.3980,  0.0448,  0.1969,  0.7343,
         0.6483,  0.4488,  0.8418,  0.9311,  0.8538,  0.4133,  0.1607,
         0.5988,  0.8947,  0.6605,  0.6187,  0.3765,  0.7380,  0.8981,
         0.1239,  0.7223,  0.9554,  0.6214,  0.9610,  0.0910,  0.0994,
         0.1069,  0.3522,  0.5959,  0.0721,  0.8258,  0.3488,  0.7184,
         0.5778,  0.2290,  0.1386,  0.8745,  0.8579,  0.1926,  0.5226,
         0.9259,  0.7759,  0.1152,  0.8644,  0.6147,  0.6790,  0.9352,
         0.3784,  0.3959,  0.1427,  0.9157,  0.4492,  0.2235,  0.8191,
         0.7248,  0.4696,  0.1029,  0.9175,  0.7589,  0.1926,  0.7606,
         0.4901,  0.4269,  0.6531,  0.6270,  0.7524,  0.6464,  0.1891,
         0.3237,  0.5329,  0.1786,  0.2285,  0.3766,  0.2103,  0.3906,
         0.6371,  0.1649,  0.5366,  0.3108,  0.1439,  0.9140,  0.5218,
         0.1371,  0.1272,  0.8220,  0.3092,  0.3986,  0.2576,  0.7140,
         0.2681,  0.4695,  0.6984,  0.9180,  0.7080,  0.3492,  0.5538,
         0.2507,  0.8013,  0.8501,  0.3314,  0.7126,  0.4540,  0.0809,
         0.5498,  0.8147,  0.3836,  0.7215,  0.7975,  0.4807,  0.7440,
         0.6789,  0.3879,  0.7652,  0.3433,  0.0875,  0.1580,  0.9335,
         0.5399,  0.8750,  0.8030,  0.7920,  0.3935,  0.9004,  0.3251,
         0.2252,  0.8054,  0.6514,  0.1844,  0.6367,  0.5872,  0.6384,
         0.5941,  0.4080,  0.6393,  0.9512,  0.6506,  0.2653,  0.4461,
         0.8455,  0.1965,  0.3754,  0.9005,  0.3841,  0.2787,  0.3762,
         0.8130,  0.7239,  0.7868,  0.9569,  0.6961,  0.8118,  0.4664,
         0.3582,  0.8607,  0.8743,  0.7295,  0.7681,  0.9102,  0.2079,
         0.2591,  0.6584,  0.4442,  0.8325,  0.3586,  0.4157,  0.6573,
         0.9529,  0.1666,  0.8812,  0.5132,  0.8509,  0.3857,  0.5357,
         0.2038,  0.7377,  0.4785,  0.2638,  0.5762,  0.1438,  0.6708,
         0.4394,  0.2288,  0.1016,  0.3867,  0.0417,  0.7944,  0.1331,
         0.8119,  0.2590,  0.8349,  0.6858,  0.3955,  0.2413,  0.4017,
         0.3339,  0.8908,  0.9340,  0.1842,  0.3217,  0.2312,  0.2984,
         0.3783,  0.3208,  0.2225,  0.2667,  0.9944,  0.2946,  0.4114,
         0.8980,  0.9205,  0.8273,  0.8764,  0.8888,  0.2001,  0.7330,
         0.6831,  0.1779,  0.8623,  0.7067,  0.2667,  0.9375,  0.7566,
         0.3229,  0.4805,  0.3480,  0.2810,  0.8503,  0.0899,  0.4355,
         0.7442,  0.8636,  0.8903,  0.9216,  0.3991,  0.1766,  0.0656,
         0.8853,  0.3122,  0.2302,  0.8748,  0.1543,  0.7780,  0.7640,
         0.5860], device='cuda:0')
tensor(0.4184, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4050,  0.4351,  0.2070,  0.9010,  0.8576,  0.8862,  0.8166,
         0.4821,  0.9554,  0.1674,  0.3716,  0.5130,  0.5650,  0.2480,
         0.7535,  0.3406,  0.9490,  0.9317,  0.3145,  0.9039,  0.0869,
         0.0646,  0.2124,  0.1258,  0.4892,  0.6201,  0.8304,  0.5809,
         0.7279,  0.8786,  0.7319,  0.5371,  0.0336,  0.2806,  0.8032,
         0.2693,  0.5605,  0.5732,  0.6746,  0.3152,  0.4452,  0.4431,
         0.1842,  0.7030,  0.9373,  0.1502,  0.7794,  0.7314,  0.4347,
         0.3713,  0.5171,  0.6310,  0.5860,  0.2967,  0.4482,  0.2412,
         0.4716,  0.4875,  0.7929,  0.8215,  0.7144,  0.9188,  0.2937,
         0.2795,  0.6650,  0.6595,  0.6100,  0.7802,  0.5472,  0.4934,
         0.8373,  0.8150,  0.2073,  0.4040,  0.3204,  0.4452,  0.8993,
         0.6942,  0.7946,  0.8452,  0.0428,  0.8183,  0.4476,  0.2510,
         0.7438,  0.2534,  0.5854,  0.3047,  0.3097,  0.9068,  0.3792,
         0.1399,  0.1840,  0.9452,  0.7607,  0.2240,  0.5408,  0.3033,
         0.1376,  0.4054,  0.4286,  0.5396,  0.8818,  0.4676,  0.6463,
         0.5393,  0.1043,  0.6264,  0.3426,  0.2400,  0.7716,  0.8660,
         0.4241,  0.4289,  0.7240,  0.2679,  0.6294,  0.0834,  0.4434,
         0.3652,  0.7291,  0.7822,  0.3934,  0.8582,  0.4759,  0.1998,
         0.1531,  0.7332,  0.1666,  0.2087,  0.5675,  0.4159,  0.2593,
         0.6178,  0.8420,  0.2535,  0.7669,  0.1932,  0.3973,  0.2856,
         0.3569,  0.2917,  0.5311,  0.2371,  0.1863,  0.2510,  0.6422,
         0.6695,  0.1903,  0.1436,  0.2921,  0.6883,  0.7100,  0.0651,
         0.1249,  0.8262,  0.2046,  0.2844,  0.1851,  0.9361,  0.5524,
         0.5699,  0.2789,  0.8793,  0.6012,  0.9564,  0.0702,  0.9477,
         0.5828,  0.9216,  0.5514,  0.1354,  0.8729,  0.5795,  0.7668,
         0.8704,  0.7973,  0.5542,  0.0433,  0.2073,  0.4403,  0.5056,
         0.5862,  0.2942,  0.6010,  0.5303,  0.9566,  0.8706,  0.4100,
         0.7631,  0.2213,  0.2746,  0.2993,  0.5979,  0.8752,  0.7285,
         0.2042,  0.7083,  0.9142,  0.1276,  0.2016,  0.5234,  0.2882,
         0.3129,  0.9081,  0.5793,  0.7608,  0.8422,  0.3520,  0.2622,
         0.3286,  0.9886,  0.1759,  0.2962,  0.7781,  0.6080,  0.5893,
         0.7736,  0.1378,  0.3892,  0.8649,  0.1582,  0.6033,  0.6901,
         0.4406,  0.1752,  0.2897,  0.2504,  0.7563,  0.2788,  0.2637,
         0.3187,  0.5147,  0.6198,  0.1725,  0.4219,  0.4259,  0.4601,
         0.5976,  0.2667,  0.8785,  0.3563,  0.4381,  0.3723,  0.6691,
         0.5072,  0.4589,  0.4457,  0.6016,  0.7208,  0.6179,  0.5141,
         0.3078,  0.4900,  0.2439,  0.9229,  0.9250,  0.5622,  0.1891,
         0.2411,  0.2528,  0.7265,  0.5244,  0.6090,  0.1945,  0.3223,
         0.7100,  0.5058,  0.2281,  0.3595,  0.4065,  0.1842,  0.2568,
         0.5356,  0.2714,  0.4498,  0.8568,  0.1724,  0.9645,  0.1974,
         0.5286,  0.8293,  0.7182,  0.7146,  0.2502,  0.1768,  0.5082,
         0.1595,  0.2006,  0.8382,  0.6602,  0.5590,  0.5101,  0.0293,
         0.2075,  0.5826,  0.9284,  0.4290,  0.1149,  0.8061,  0.8626,
         0.7788,  0.3651,  0.5690,  0.2358,  0.3400,  0.1379,  0.8730,
         0.3744,  0.4356,  0.7896,  0.1141,  0.3166,  0.7222,  0.1098,
         0.2223,  0.8225,  0.2283,  0.0611,  0.3563,  0.9706,  0.2891,
         0.8465,  0.6133,  0.3042,  0.0974,  0.7670,  0.1574,  0.0842,
         0.2304,  0.6317,  0.8965,  0.6688,  0.3946,  0.4775,  0.2702,
         0.1815,  0.4693,  0.6346,  0.4794,  0.9795,  0.4862,  0.8428,
         0.1170,  0.2922,  0.4010,  0.2677,  0.8220,  0.1943,  0.3900,
         0.1385,  0.4063,  0.8712,  0.8053,  0.8460,  0.3499,  0.6012,
         0.6522,  0.2792,  0.4679,  0.0970,  0.5876,  0.8040,  0.4125,
         0.9927,  0.9824,  0.0963,  0.7104,  0.1341,  0.1319,  0.7991,
         0.6383,  0.4065,  0.6184,  0.5124,  0.8330,  0.1613,  0.6013,
         0.1884,  0.1136,  0.5125,  0.3656,  0.9425,  0.2429,  0.2154,
         0.4040,  0.7454,  0.1906,  0.4070,  0.6233,  0.3656,  0.3181,
         0.8475,  0.2422,  0.1722,  0.4281,  0.7006,  0.8212,  0.7522,
         0.7896,  0.8158,  0.1882,  0.1998,  0.0410,  0.8908,  0.4656,
         0.4991,  0.1927,  0.3111,  0.1801,  0.1453,  0.6248,  0.5473,
         0.6656,  0.2148,  0.9389,  0.3261,  0.5960,  0.4409,  0.3603,
         0.6150,  0.3879,  0.2675,  0.6878,  0.3974,  0.6481,  0.7202,
         0.3339,  0.9627,  0.6973,  0.8891,  0.5782,  0.0935,  0.4809,
         0.7437,  0.6614,  0.7342,  0.3787,  0.5530,  0.3470,  0.4326,
         0.8633,  0.1866,  0.8264,  0.7099,  0.2271,  0.6128,  0.4541,
         0.3718,  0.9347,  0.2637,  0.3598,  0.2719,  0.1053,  0.2247,
         0.6514,  0.7400,  0.0334,  0.8329,  0.8517,  0.1773,  0.3200,
         0.9166,  0.1998,  0.7946,  0.3449,  0.7364,  0.8373,  0.3261,
         0.9214,  0.2442,  0.7707,  0.7939,  0.7986,  0.2694,  0.2831,
         0.8636,  0.2152,  0.1895,  0.8985,  0.1309,  0.2179,  0.3787,
         0.9009,  0.3033,  0.9864,  0.8958,  0.5680,  0.4093,  0.6160,
         0.1674,  0.9717,  0.4677,  0.1807,  0.2248,  0.8183,  0.4214,
         0.5058,  0.5264,  0.2201,  0.7559,  0.1862,  0.5990,  0.2370,
         0.8078,  0.3596,  0.0922,  0.4130,  0.5334,  0.7935,  0.2073,
         0.4777], device='cuda:0')
tensor(0.4637, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7667,  0.3667,  0.5227,  0.2088,  0.0967,  0.8396,  0.2306,
         0.2185,  0.1198,  0.5421,  0.2115,  0.6525,  0.9521,  0.8919,
         0.4588,  0.3339,  0.4789,  0.5373,  0.9017,  0.2135,  0.7380,
         0.3653,  0.1431,  0.1995,  0.6223,  0.5433,  0.9186,  0.7457,
         0.8510,  0.4773,  0.2131,  0.8167,  0.8819,  0.2996,  0.3677,
         0.8553,  0.8414,  0.3936,  0.3833,  0.3382,  0.9166,  0.1085,
         0.0907,  0.9377,  0.7137,  0.1727,  0.2446,  0.4205,  0.3786,
         0.6707,  0.9068,  0.8311,  0.1735,  0.3937,  0.5191,  0.5190,
         0.1998,  0.7850,  0.9345,  0.8274,  0.1276,  0.3014,  0.3731,
         0.2117,  0.4074,  0.2274,  0.3227,  0.5506,  0.8449,  0.3092,
         0.8032,  0.5760,  0.7630,  0.2231,  0.4455,  0.3338,  0.6823,
         0.3028,  0.0593,  0.7423,  0.3500,  0.0385,  0.9558,  0.8230,
         0.0668,  0.3950,  0.2365,  0.8468,  0.5957,  0.7761,  0.2897,
         0.4418,  0.2886,  0.9417,  0.8964,  0.2329,  0.7577,  0.7646,
         0.9595,  0.9950,  0.3768,  0.1267,  0.2398,  0.5689,  0.0819,
         0.8312,  0.8493,  0.2099,  0.9102,  0.7347,  0.1570,  0.2798,
         0.2971,  0.3275,  0.7063,  0.7221,  0.8780,  0.6558,  0.4162,
         0.3190,  0.5003,  0.2395,  0.9509,  0.7831,  0.3332,  0.8073,
         0.7706,  0.4258,  0.8657,  0.6279,  0.0262,  0.3744,  0.2104,
         0.5544,  0.9090,  0.3078,  0.8186,  0.9006,  0.5414,  0.3024,
         0.3683,  0.4991,  0.5752,  0.3721,  0.3427,  0.2712,  0.8033,
         0.2033,  0.7621,  0.3159,  0.2618,  0.8580,  0.8957,  0.2238,
         0.5216,  0.1981,  0.3930,  0.8044,  0.3786,  0.7068,  0.4021,
         0.3905,  0.1358,  0.8959,  0.4849,  0.4220,  0.4332,  0.8903,
         0.2788,  0.2729,  0.8529,  0.1116,  0.6484,  0.8148,  0.3416,
         0.2001,  0.2032,  0.4488,  0.4095,  0.1777,  0.3986,  0.1442,
         0.4598,  0.2449,  0.8224,  0.9650,  0.1091,  0.2319,  0.2433,
         0.5298,  0.1243,  0.5070,  0.4708,  0.3579,  0.7480,  0.7676,
         0.4848,  0.5812,  0.6543,  0.0922,  0.6744,  0.9055,  0.7638,
         0.9401,  0.4354,  0.6882,  0.1926,  0.1054,  0.6794,  0.3281,
         0.0835,  0.3314,  0.7213,  0.4550,  0.6635,  0.0844,  0.7740,
         0.5980,  0.8221,  0.1336,  0.6896,  0.2570,  0.2670,  0.7283,
         0.9302,  0.1345,  0.2314,  0.2588,  0.0391,  0.1773,  0.8174,
         0.8679,  0.9008,  0.4677,  0.1438,  0.2680,  0.4987,  0.1489,
         0.0567,  0.1658,  0.2948,  0.2787,  0.8249,  0.2899,  0.3931,
         0.6614,  0.5088,  0.7897,  0.7042,  0.3090,  0.4106,  0.7683,
         0.2668,  0.5694,  0.3058,  0.2441,  0.1186,  0.6369,  0.4251,
         0.2963,  0.3468,  0.6787,  0.5475,  0.3631,  0.3357,  0.4202,
         0.7864,  0.3117,  0.6277,  0.1690,  0.9319,  0.8380,  0.2533,
         0.5434,  0.4634,  0.3389,  0.7544,  0.0867,  0.7528,  0.1024,
         0.1160,  0.8948,  0.7524,  0.3047,  0.1550,  0.0519,  0.6306,
         0.7958,  0.8962,  0.0385,  0.6292,  0.5439,  0.7512,  0.7013,
         0.5578,  0.0581,  0.4736,  0.4247,  0.8091,  0.1518,  0.1914,
         0.4679,  0.1354,  0.7577,  0.8181,  0.1996,  0.4636,  0.5281,
         0.1541,  0.1680,  0.2848,  0.9420,  0.3583,  0.7212,  0.2701,
         0.8234,  0.6271,  0.8081,  0.9588,  0.3352,  0.4932,  0.1091,
         0.3323,  0.2519,  0.1900,  0.8342,  0.4077,  0.6743,  0.5044,
         0.2536,  0.3973,  0.9369,  0.0722,  0.1445,  0.3231,  0.1610,
         0.4662,  0.1497,  0.2921,  0.2786,  0.8561,  0.4152,  0.7074,
         0.7972,  0.6187,  0.3363,  0.4311,  0.8836,  0.3316,  0.2493,
         0.3950,  0.2910,  0.2044,  0.2928,  0.6973,  0.7904,  0.2158,
         0.5935,  0.8302,  0.6303,  0.9359,  0.4111,  0.5798,  0.2496,
         0.1853,  0.4209,  0.4359,  0.3544,  0.3521,  0.6739,  0.9662,
         0.2256,  0.3027,  0.1543,  0.2355,  0.5487,  0.5994,  0.7221,
         0.9879,  0.2822,  0.5696,  0.8341,  0.5237,  0.1938,  0.2678,
         0.2373,  0.4992,  0.2103,  0.4658,  0.3512,  0.3885,  0.5016,
         0.6175,  0.3643,  0.2911,  0.2169,  0.3539,  0.3652,  0.2900,
         0.7078,  0.8275,  0.4798,  0.8588,  0.1672,  0.8642,  0.7572,
         0.2192,  0.8935,  0.9415,  0.4727,  0.8613,  0.0925,  0.2433,
         0.2988,  0.6904,  0.3959,  0.2064,  0.9818,  0.7255,  0.3484,
         0.3940,  0.7180,  0.1396,  0.4679,  0.2535,  0.2725,  0.6280,
         0.4123,  0.2163,  0.1851,  0.6870,  0.2321,  0.0919,  0.9085,
         0.7867,  0.2391,  0.8351,  0.0472,  0.2044,  0.6270,  0.0249,
         0.3055,  0.1616,  0.2648,  0.5889,  0.6450,  0.7197,  0.7593,
         0.9240,  0.0976,  0.8465,  0.2298,  0.2593,  0.2960,  0.9184,
         0.9151,  0.0700,  0.6200,  0.5165,  0.7859,  0.6377,  0.8524,
         0.2769,  0.8642,  0.4111,  0.6671,  0.2943,  0.6344,  0.2565,
         0.8230,  0.5149,  0.2969,  0.5676,  0.2014,  0.8659,  0.6144,
         0.5213,  0.8218,  0.7123,  0.1526,  0.0552,  0.9358,  0.0521,
         0.3827,  0.5847,  0.9585,  0.8258,  0.3814,  0.1989,  0.2733,
         0.5020,  0.1390,  0.8481,  0.3742,  0.4785,  0.2501,  0.1930,
         0.3971,  0.7261,  0.5851,  0.8054,  0.1600,  0.1962,  0.7277,
         0.0571,  0.4547,  0.3079,  0.9831,  0.1521,  0.3618,  0.1521,
         0.1746], device='cuda:0')
tensor(0.4603, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9288,  0.6431,  0.5986,  0.6618,  0.2859,  0.9545,  0.8341,
         0.9951,  0.6141,  0.4347,  0.7023,  0.4360,  0.2059,  0.0981,
         0.7111,  0.5121,  0.2893,  0.1413,  0.5617,  0.8207,  0.2089,
         0.1169,  0.3406,  0.8799,  0.1254,  0.4897,  0.9969,  0.3409,
         0.1746,  0.2427,  0.1876,  0.1100,  0.0156,  0.9064,  0.1765,
         0.2947,  0.7180,  0.1886,  0.5686,  0.2194,  0.5479,  0.2645,
         0.4588,  0.3218,  0.9080,  0.3434,  0.6785,  0.8241,  0.5775,
         0.8869,  0.6518,  0.9717,  0.9579,  0.9073,  0.3687,  0.6811,
         0.3086,  0.7177,  0.3195,  0.9477,  0.8813,  0.2552,  0.2370,
         0.9643,  0.8585,  0.8050,  0.7134,  0.4422,  0.8427,  0.6025,
         0.9121,  0.5218,  0.2451,  0.1631,  0.2924,  0.4902,  0.8504,
         0.2083,  0.9777,  0.9455,  0.7712,  0.0595,  0.2414,  0.6087,
         0.0677,  0.1046,  0.4545,  0.7718,  0.8392,  0.2204,  0.8967,
         0.1711,  0.3640,  0.1209,  0.4967,  0.5732,  0.1356,  0.2675,
         0.5184,  0.2632,  0.3406,  0.1707,  0.4079,  0.7179,  0.3184,
         0.8018,  0.3461,  0.8842,  0.1556,  0.2943,  0.6507,  0.7529,
         0.8853,  0.2636,  0.8855,  0.1977,  0.6204,  0.2456,  0.1582,
         0.4203,  0.2349,  0.9139,  0.9007,  0.8815,  0.9683,  0.9850,
         0.2475,  0.2886,  0.0276,  0.9477,  0.1556,  0.1847,  0.9815,
         0.4148,  0.2365,  0.4045,  0.0451,  0.1825,  0.9643,  0.8454,
         0.7736,  0.2541,  0.3513,  0.0232,  0.9692,  0.0854,  0.8777,
         0.8508,  0.2462,  0.8958,  0.7691,  0.9766,  0.6660,  0.9199,
         0.1363,  0.2307,  0.5697,  0.7804,  0.8884,  0.9957,  0.1543,
         0.9262,  0.4699,  0.1571,  0.7723,  0.2323,  0.4468,  0.8456,
         0.0529,  0.1952,  0.8704,  0.4447,  0.7281,  0.5110,  0.1841,
         0.1265,  0.9365,  0.1801,  0.9522,  0.9746,  0.4182,  0.3452,
         0.6290,  0.2195,  0.8248,  0.5932,  0.9334,  0.2523,  0.2092,
         0.8322,  0.3282,  0.4353,  0.8619,  0.1544,  0.4924,  0.1927,
         0.1578,  0.2669,  0.8892,  0.3713,  0.1074,  0.2145,  0.2458,
         0.0672,  0.1405,  0.6267,  0.9656,  0.4695,  0.4263,  0.9342,
         0.9377,  0.7835,  0.2830,  0.2669,  0.0937,  0.8593,  0.8815,
         0.4493,  0.9069,  0.9556,  0.8609,  0.9608,  0.3240,  0.9244,
         0.4441,  0.4762,  0.9500,  0.9631,  0.3003,  0.4134,  0.3181,
         0.4562,  0.6150,  0.2682,  0.5416,  0.7209,  0.1510,  0.1835,
         0.7195,  0.2142,  0.7316,  0.1698,  0.3073,  0.4163,  0.2078,
         0.2458,  0.6290,  0.0558,  0.1387,  0.1046,  0.0215,  0.7335,
         0.1740,  0.2440,  0.7263,  0.4720,  0.8724,  0.8887,  0.2668,
         0.4949,  0.8087,  0.7479,  0.4789,  0.1248,  0.0980,  0.8007,
         0.0388,  0.3255,  0.4151,  0.3946,  0.4218,  0.1377,  0.2144,
         0.9094,  0.3346,  0.1001,  0.9400,  0.4203,  0.2099,  0.4880,
         0.5206,  0.9835,  0.6745,  0.1035,  0.0847,  0.7950,  0.7620,
         0.3629,  0.7105,  0.2979,  0.5434,  0.9257,  0.8508,  0.9653,
         0.5928,  0.1130,  0.3989,  0.5682,  0.1092,  0.3483,  0.8259,
         0.9397,  0.1972,  0.9089,  0.7806,  0.8879,  0.7693,  0.1103,
         0.9527,  0.1349,  0.7858,  0.4108,  0.1214,  0.2619,  0.2026,
         0.5795,  0.6434,  0.0371,  0.0731,  0.7649,  0.3616,  0.4715,
         0.2696,  0.9588,  0.1678,  0.8756,  0.9686,  0.8236,  0.2015,
         0.8988,  0.4370,  0.3530,  0.9306,  0.1758,  0.1650,  0.0559,
         0.6248,  0.5868,  0.1101,  0.2709,  0.3650,  0.3767,  0.2656,
         0.2442,  0.2900,  0.0808,  0.9599,  0.8504,  0.8998,  0.0545,
         0.9718,  0.9682,  0.2975,  0.0576,  0.1823,  0.6247,  0.0206,
         0.2713,  0.8440,  0.8246,  0.9404,  0.1167,  0.8842,  0.7771,
         0.6035,  0.4788,  0.9629,  0.4193,  0.4170,  0.8031,  0.9755,
         0.3977,  0.1652,  0.4329,  0.2731,  0.2892,  0.9285,  0.2428,
         0.3142,  0.9040,  0.8724,  0.3756,  0.9225,  0.0935,  0.9832,
         0.9166,  0.4008,  0.2692,  0.3327,  0.5273,  0.0181,  0.7667,
         0.7564,  0.2397,  0.0461,  0.0812,  0.2426,  0.4060,  0.1526,
         0.9469,  0.1949,  0.9106,  0.9155,  0.8679,  0.4282,  0.1510,
         0.7073,  0.9704,  0.1397,  0.2363,  0.3505,  0.9424,  0.7838,
         0.2400,  0.8814,  0.6419,  0.8385,  0.4267,  0.8265,  0.3933,
         0.4656,  0.0750,  0.6424,  0.2176,  0.4231,  0.6464,  0.4883,
         0.3385,  0.1399,  0.1558,  0.0298,  0.6389,  0.8418,  0.0760,
         0.3816,  0.2399,  0.1136,  0.3675,  0.4707,  0.0301,  0.5859,
         0.8366,  0.9320,  0.6852,  0.0891,  0.9563,  0.0734,  0.9473,
         0.5920,  0.9500,  0.2351,  0.4277,  0.2608,  0.6935,  0.7320,
         0.1292,  0.1242,  0.1447,  0.0337,  0.8452,  0.7503,  0.3675,
         0.3562,  0.5643,  0.9833,  0.1928,  0.2799,  0.2065,  0.1328,
         0.3171,  0.4689,  0.8940,  0.8790,  0.9282,  0.8428,  0.4423,
         0.9291,  0.6690,  0.8953,  0.9131,  0.9106,  0.9697,  0.3028,
         0.8655,  0.1167,  0.1575,  0.8758,  0.4826,  0.8712,  0.0991,
         0.1891,  0.1947,  0.7966,  0.6367,  0.8025,  0.7417,  0.5431,
         0.3495,  0.9572,  0.6763,  0.7340,  0.5273,  0.5981,  0.0650,
         0.9075,  0.1248,  0.9441,  0.9306,  0.1077,  0.1376,  0.7290,
         0.3824], device='cuda:0')
tensor(0.4632, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1585,  0.2575,  0.2234,  0.2820,  0.2149,  0.5985,  0.4160,
         0.4619,  0.9745,  0.8098,  0.0786,  0.0242,  0.0983,  0.3298,
         0.0725,  0.9545,  0.9879,  0.4805,  0.1792,  0.1445,  0.1646,
         0.9089,  0.5396,  0.2797,  0.9546,  0.1295,  0.8875,  0.1699,
         0.2988,  0.7470,  0.5000,  0.9700,  0.9602,  0.2524,  0.3694,
         0.1729,  0.4847,  0.1245,  0.2543,  0.7337,  0.4273,  0.1897,
         0.9237,  0.8966,  0.0988,  0.9218,  0.9478,  0.0310,  0.1110,
         0.9427,  0.1547,  0.8801,  0.1282,  0.4795,  0.4372,  0.4160,
         0.6201,  0.9875,  0.3289,  0.1995,  0.7199,  0.6343,  0.9461,
         0.5033,  0.4016,  0.1065,  0.2621,  0.2139,  0.1399,  0.1648,
         0.9400,  0.2082,  0.1832,  0.2586,  0.3406,  0.4614,  0.7511,
         0.0881,  0.5072,  0.3925,  0.8504,  0.5421,  0.9246,  0.0543,
         0.1627,  0.2206,  0.3020,  0.7677,  0.3127,  0.9002,  0.4556,
         0.7926,  0.9034,  0.9523,  0.3381,  0.9451,  0.2611,  0.1395,
         0.6845,  0.9583,  0.1334,  0.8756,  0.1809,  0.0766,  0.2023,
         0.9216,  0.4767,  0.2859,  0.1805,  0.9458,  0.7816,  0.4492,
         0.1391,  0.3105,  0.9013,  0.6382,  0.2249,  0.2298,  0.5082,
         0.4251,  0.9282,  0.6995,  0.4196,  0.9033,  0.2861,  0.4111,
         0.2475,  0.8180,  0.3006,  0.1925,  0.8855,  0.6897,  0.0861,
         0.9473,  0.9552,  0.2657,  0.4630,  0.1258,  0.9820,  0.6007,
         0.3013,  0.2062,  0.8556,  0.8302,  0.9605,  0.9297,  0.2341,
         0.8122,  0.4261,  0.9373,  0.7340,  0.1715,  0.0892,  0.9620,
         0.9768,  0.9590,  0.2836,  0.2379,  0.2965,  0.9325,  0.9832,
         0.3602,  0.7228,  0.4832,  0.0665,  0.8954,  0.7766,  0.9078,
         0.3762,  0.9634,  0.2122,  0.1426,  0.2746,  0.1404,  0.9427,
         0.2419,  0.2727,  0.9446,  0.9625,  0.1334,  0.9514,  0.3222,
         0.9411,  0.9783,  0.9072,  0.8828,  0.4799,  0.4213,  0.8660,
         0.9371,  0.9677,  0.3139,  0.5039,  0.1353,  0.2176,  0.4281,
         0.3126,  0.9876,  0.1731,  0.5507,  0.1436,  0.7657,  0.3859,
         0.9299,  0.9831,  0.1711,  0.0893,  0.9186,  0.2105,  0.9749,
         0.8493,  0.6803,  0.2632,  0.4299,  0.9127,  0.9929,  0.8901,
         0.8934,  0.9780,  0.3960,  0.3988,  0.1657,  0.4355,  0.1527,
         0.1048,  0.9326,  0.9183,  0.5956,  0.8682,  0.7994,  0.9020,
         0.1456,  0.9316,  0.9595,  0.2664,  0.1965,  0.9539,  0.0499,
         0.3424,  0.0383,  0.7644,  0.8464,  0.9545,  0.8873,  0.9384,
         0.1669,  0.5592,  0.9496,  0.0865,  0.2448,  0.8981,  0.1461,
         0.8663,  0.9726,  0.9641,  0.8258,  0.3402,  0.4981,  0.6720,
         0.1030,  0.0889,  0.9604,  0.2142,  0.5860,  0.8771,  0.9442,
         0.1849,  0.5627,  0.3505,  0.8552,  0.0977,  0.0847,  0.4434,
         0.9900,  0.3306,  0.8160,  0.2487,  0.3811,  0.9513,  0.4160,
         0.1156,  0.2047,  0.8791,  0.2180,  0.9742,  0.5246,  0.0296,
         0.0361,  0.2619,  0.9978,  0.0623,  0.1993,  0.1826,  0.8287,
         0.2982,  0.8934,  0.0916,  0.1126,  0.7321,  0.2332,  0.2555,
         0.0739,  0.6530,  0.2752,  0.9026,  0.9288,  0.9360,  0.1771,
         0.9560,  0.9005,  0.9463,  0.8792,  0.0542,  0.1338,  0.2116,
         0.5476,  0.8275,  0.9736,  0.9546,  0.1245,  0.9426,  0.1148,
         0.7882,  0.1206,  0.9920,  0.2939,  0.4738,  0.0860,  0.9357,
         0.7369,  0.5602,  0.1459,  0.8384,  0.1980,  0.1212,  0.2130,
         0.1224,  0.1511,  0.5750,  0.1419,  0.4651,  0.3319,  0.8642,
         0.9644,  0.0927,  0.2579,  0.9435,  0.3517,  0.7295,  0.8606,
         0.1534,  0.7973,  0.4893,  0.3096,  0.8778,  0.6369,  0.9362,
         0.5176,  0.8886,  0.3146,  0.8617,  0.1038,  0.9459,  0.9512,
         0.3367,  0.1682,  0.8875,  0.9422,  0.9029,  0.0379,  0.9903,
         0.9487,  0.1976,  0.9707,  0.2246,  0.1923,  0.9008,  0.9586,
         0.1331,  0.8242,  0.2347,  0.8266,  0.8288,  0.9625,  0.5917,
         0.3207,  0.3463,  0.9499,  0.9644,  0.3196,  0.3207,  0.1964,
         0.3170,  0.8679,  0.1905,  0.7957,  0.1493,  0.9244,  0.1456,
         0.9621,  0.8729,  0.0783,  0.9397,  0.1906,  0.1719,  0.9043,
         0.0862,  0.9170,  0.1085,  0.0367,  0.5307,  0.7044,  0.1853,
         0.2643,  0.6708,  0.7762,  0.1007,  0.0319,  0.0854,  0.8845,
         0.1167,  0.9119,  0.1332,  0.2457,  0.4130,  0.1492,  0.0944,
         0.9582,  0.9077,  0.7902,  0.3833,  0.8751,  0.9289,  0.6823,
         0.3721,  0.1382,  0.1496,  0.9549,  0.7877,  0.0411,  0.9650,
         0.0801,  0.1652,  0.2588,  0.9749,  0.9331,  0.2473,  0.9514,
         0.5365,  0.2327,  0.0439,  0.7886,  0.9928,  0.7338,  0.2309,
         0.2149,  0.0312,  0.9834,  0.1631,  0.2891,  0.8694,  0.6220,
         0.2393,  0.2259,  0.0359,  0.8601,  0.4029,  0.9622,  0.9146,
         0.9407,  0.8062,  0.2530,  0.7536,  0.2210,  0.1771,  0.2896,
         0.9289,  0.9319,  0.3625,  0.1305,  0.2690,  0.2926,  0.1593,
         0.6713,  0.7877,  0.9607,  0.2448,  0.8668,  0.7884,  0.2275,
         0.1923,  0.9283,  0.9784,  0.2065,  0.4406,  0.8792,  0.9072,
         0.3062,  0.1838,  0.8958,  0.6687,  0.9695,  0.9194,  0.3823,
         0.9558,  0.9854,  0.5133,  0.1738,  0.3095,  0.8885,  0.8786,
         0.3215], device='cuda:0')
tensor(0.4918, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0512,  0.9342,  0.0812,  0.2655,  0.4747,  0.5891,  0.0567,
         0.5078,  0.5351,  0.8795,  0.8099,  0.1156,  0.1434,  0.7934,
         0.0940,  0.7413,  0.3570,  0.9239,  0.0614,  0.4488,  0.9757,
         0.3517,  0.2270,  0.4215,  0.9769,  0.9914,  0.7158,  0.3067,
         0.9495,  0.0214,  0.1176,  0.5833,  0.8130,  0.4808,  0.3632,
         0.8482,  0.3234,  0.8976,  0.1493,  0.1778,  0.4960,  0.9120,
         0.2878,  0.2646,  0.1207,  0.2129,  0.3096,  0.1106,  0.4774,
         0.2622,  0.9525,  0.1213,  0.2729,  0.0973,  0.1740,  0.3794,
         0.2281,  0.1622,  0.9906,  0.2532,  0.8653,  0.9843,  0.9621,
         0.9083,  0.1201,  0.1109,  0.2581,  0.4908,  0.0467,  0.2972,
         0.3561,  0.1197,  0.6330,  0.6672,  0.9191,  0.7571,  0.3452,
         0.0913,  0.4463,  0.9512,  0.5021,  0.2925,  0.8918,  0.4869,
         0.1173,  0.2525,  0.3562,  0.7854,  0.1942,  0.9267,  0.1899,
         0.6611,  0.0890,  0.3343,  0.1910,  0.3210,  0.3087,  0.9032,
         0.1472,  0.3279,  0.2143,  0.1621,  0.1146,  0.3030,  0.2419,
         0.9646,  0.9480,  0.1548,  0.9762,  0.5718,  0.9098,  0.8268,
         0.7298,  0.1306,  0.8991,  0.1861,  0.8278,  0.9301,  0.9655,
         0.4805,  0.1512,  0.7652,  0.1174,  0.7152,  0.1702,  0.1042,
         0.9279,  0.8704,  0.4594,  0.2740,  0.1296,  0.9960,  0.1437,
         0.6368,  0.9365,  0.0748,  0.9539,  0.3357,  0.8619,  0.9760,
         0.0983,  0.7380,  0.8261,  0.2231,  0.6879,  0.1983,  0.2598,
         0.3335,  0.9027,  0.1493,  0.7078,  0.4670,  0.8259,  0.9634,
         0.2606,  0.4829,  0.9100,  0.0222,  0.8194,  0.8188,  0.7749,
         0.1720,  0.2843,  0.2366,  0.0695,  0.5851,  0.1147,  0.1361,
         0.2053,  0.9339,  0.3624,  0.2231,  0.2170,  0.3983,  0.2534,
         0.8169,  0.1713,  0.4571,  0.1508,  0.4312,  0.0849,  0.7924,
         0.9917,  0.9540,  0.3568,  0.4962,  0.1626,  0.8595,  0.7388,
         0.7784,  0.3232,  0.3416,  0.1092,  0.3633,  0.0811,  0.2099,
         0.4707,  0.2706,  0.1944,  0.1945,  0.5180,  0.8636,  0.5403,
         0.9906,  0.0655,  0.2196,  0.9418,  0.9016,  0.9033,  0.3191,
         0.8646,  0.9269,  0.8271,  0.3496,  0.2567,  0.9581,  0.2556,
         0.0610,  0.0342,  0.1864,  0.1969,  0.9598,  0.0677,  0.2510,
         0.2794,  0.1303,  0.9777,  0.4613,  0.6154,  0.8802,  0.0699,
         0.7671,  0.0138,  0.2960,  0.9317,  0.3774,  0.8918,  0.5414,
         0.7947,  0.1340,  0.8616,  0.0163,  0.2267,  0.1820,  0.2986,
         0.3504,  0.9808,  0.1917,  0.8375,  0.0780,  0.4165,  0.1292,
         0.6014,  0.3529,  0.1340,  0.7034,  0.6252,  0.9311,  0.9418,
         0.2929,  0.1395,  0.4472,  0.1759,  0.4458,  0.0974,  0.3588,
         0.0519,  0.0646,  0.2262,  0.9342,  0.0728,  0.1184,  0.8803,
         0.1052,  0.7816,  0.2461,  0.3797,  0.1276,  0.9880,  0.0524,
         0.0819,  0.1726,  0.7553,  0.9218,  0.0663,  0.1703,  0.6085,
         0.8376,  0.8637,  0.2147,  0.9057,  0.1103,  0.1198,  0.5672,
         0.4851,  0.1280,  0.1576,  0.0432,  0.8924,  0.9128,  0.1134,
         0.7737,  0.9651,  0.8950,  0.9338,  0.3094,  0.7335,  0.4852,
         0.2589,  0.1561,  0.0512,  0.8431,  0.8389,  0.6427,  0.8410,
         0.1815,  0.8413,  0.9771,  0.9719,  0.5763,  0.1912,  0.4874,
         0.4232,  0.8074,  0.0542,  0.2468,  0.0789,  0.1694,  0.2748,
         0.1556,  0.3069,  0.9483,  0.0308,  0.6629,  0.9311,  0.9843,
         0.9366,  0.2246,  0.1589,  0.4214,  0.9844,  0.2874,  0.1287,
         0.7964,  0.9650,  0.1829,  0.1187,  0.9950,  0.5480,  0.2088,
         0.0614,  0.1629,  0.5223,  0.4597,  0.8711,  0.1738,  0.2760,
         0.1748,  0.8931,  0.9328,  0.1024,  0.9121,  0.8333,  0.9516,
         0.0381,  0.9580,  0.9602,  0.4585,  0.9370,  0.1757,  0.1803,
         0.3883,  0.7958,  0.9076,  0.4557,  0.4375,  0.9678,  0.5209,
         0.1077,  0.5311,  0.2365,  0.4561,  0.3570,  0.5675,  0.1108,
         0.3330,  0.4775,  0.7356,  0.6551,  0.0908,  0.6959,  0.6959,
         0.2996,  0.3677,  0.9656,  0.2765,  0.7199,  0.8930,  0.6107,
         0.2323,  0.9189,  0.3925,  0.2700,  0.9670,  0.5048,  0.7190,
         0.1551,  0.7917,  0.0608,  0.0696,  0.1672,  0.1108,  0.2563,
         0.4040,  0.1330,  0.9081,  0.3143,  0.9321,  0.4425,  0.1550,
         0.2011,  0.5685,  0.9726,  0.2915,  0.8523,  0.8006,  0.8783,
         0.2541,  0.9532,  0.2301,  0.3732,  0.8922,  0.4009,  0.0620,
         0.3292,  0.9035,  0.6119,  0.2158,  0.1169,  0.9682,  0.1678,
         0.2180,  0.3915,  0.9466,  0.9950,  0.3608,  0.9411,  0.4329,
         0.1874,  0.4376,  0.0383,  0.1496,  0.7303,  0.9101,  0.0999,
         0.5610,  0.1612,  0.8750,  0.2233,  0.3633,  0.2475,  0.1901,
         0.9753,  0.2716,  0.8118,  0.2355,  0.2149,  0.1890,  0.4110,
         0.1141,  0.1725,  0.7342,  0.6457,  0.9431,  0.8515,  0.8980,
         0.2953,  0.4204,  0.2130,  0.3427,  0.2496,  0.2873,  0.0734,
         0.9537,  0.2381,  0.1960,  0.0490,  0.4327,  0.3031,  0.1550,
         0.1790,  0.9369,  0.5675,  0.9494,  0.2437,  0.0566,  0.1796,
         0.1901,  0.4737,  0.8431,  0.2388,  0.6573,  0.4291,  0.8255,
         0.2146,  0.1904,  0.2683,  0.1671,  0.7884,  0.9427,  0.6025,
         0.8591], device='cuda:0')
tensor(0.4047, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5811,  0.1656,  0.5096,  0.2184,  0.9718,  0.4041,  0.8040,
         0.8127,  0.9806,  0.5354,  0.1893,  0.9906,  0.9453,  0.2137,
         0.1505,  0.0262,  0.2483,  0.0532,  0.8285,  0.2788,  0.9236,
         0.1348,  0.3809,  0.5135,  0.9468,  0.8754,  0.3237,  0.0678,
         0.9885,  0.4891,  0.8120,  0.4822,  0.5549,  0.8666,  0.3077,
         0.2175,  0.4898,  0.8434,  0.7507,  0.7275,  0.9269,  0.3584,
         0.4466,  0.2122,  0.3628,  0.1334,  0.0830,  0.0672,  0.0415,
         0.0576,  0.1855,  0.8980,  0.1790,  0.5137,  0.0962,  0.1467,
         0.7750,  0.5166,  0.7133,  0.3503,  0.1985,  0.8713,  0.1584,
         0.2295,  0.7798,  0.3352,  0.1742,  0.1314,  0.1381,  0.0264,
         0.2047,  0.0955,  0.2680,  0.1660,  0.2724,  0.3202,  0.4092,
         0.6210,  0.2087,  0.3360,  0.2519,  0.2360,  0.1767,  0.7152,
         0.9773,  0.1364,  0.1632,  0.2493,  0.7264,  0.3205,  0.4542,
         0.3937,  0.4019,  0.2240,  0.8317,  0.8393,  0.0781,  0.0305,
         0.1370,  0.1064,  0.8294,  0.3107,  0.2066,  0.5422,  0.7011,
         0.3683,  0.4187,  0.9000,  0.8710,  0.4027,  0.3450,  0.9451,
         0.0139,  0.9320,  0.3658,  0.4746,  0.3036,  0.4437,  0.4463,
         0.3974,  0.1794,  0.7894,  0.6252,  0.2341,  0.8638,  0.8792,
         0.4934,  0.8980,  0.0402,  0.7163,  0.5233,  0.8337,  0.5765,
         0.3395,  0.7706,  0.8987,  0.5885,  0.3433,  0.2295,  0.9303,
         0.7556,  0.6771,  0.7975,  0.7614,  0.8723,  0.4209,  0.9639,
         0.5577,  0.6513,  0.7978,  0.4350,  0.0471,  0.8810,  0.1936,
         0.9011,  0.7908,  0.4203,  0.8834,  0.6575,  0.3760,  0.2670,
         0.4286,  0.1466,  0.8864,  0.2059,  0.6193,  0.9791,  0.3083,
         0.2669,  0.1672,  0.1491,  0.2184,  0.3909,  0.1488,  0.0750,
         0.6622,  0.5835,  0.7516,  0.7246,  0.9600,  0.0839,  0.5517,
         0.7793,  0.1607,  0.1352,  0.7807,  0.6933,  0.1982,  0.6011,
         0.8156,  0.0267,  0.9670,  0.0633,  0.7188,  0.0101,  0.4446,
         0.2404,  0.5937,  0.1807,  0.1893,  0.3699,  0.2494,  0.1221,
         0.9653,  0.3321,  0.3474,  0.8350,  0.0938,  0.0778,  0.3485,
         0.1452,  0.8308,  0.2635,  0.4105,  0.3615,  0.5640,  0.4252,
         0.8277,  0.4051,  0.8051,  0.5723,  0.7322,  0.8959,  0.1126,
         0.5263,  0.7138,  0.3726,  0.6120,  0.9854,  0.0124,  0.2818,
         0.8750,  0.8014,  0.1948,  0.4814,  0.8627,  0.0708,  0.5774,
         0.2197,  0.6696,  0.7523,  0.1958,  0.8497,  0.1417,  0.9679,
         0.9333,  0.0895,  0.4487,  0.3723,  0.3312,  0.2883,  0.8696,
         0.6483,  0.9241,  0.0941,  0.9628,  0.1860,  0.5030,  0.8337,
         0.9846,  0.7162,  0.5735,  0.1584,  0.1979,  0.8084,  0.2785,
         0.6501,  0.7287,  0.3469,  0.8507,  0.7132,  0.2215,  0.1517,
         0.9354,  0.6766,  0.1682,  0.9375,  0.8656,  0.2041,  0.8545,
         0.3073,  0.1110,  0.1659,  0.2777,  0.2257,  0.8223,  0.9233,
         0.3132,  0.3818,  0.6219,  0.0959,  0.5282,  0.3800,  0.1804,
         0.6046,  0.2150,  0.7968,  0.3967,  0.7588,  0.1973,  0.1017,
         0.1345,  0.4408,  0.1216,  0.4503,  0.7084,  0.1462,  0.4426,
         0.1373,  0.9265,  0.7262,  0.8678,  0.2253,  0.2747,  0.1740,
         0.7126,  0.8311,  0.0803,  0.2469,  0.9599,  0.5793,  0.3475,
         0.9129,  0.4195,  0.4600,  0.6326,  0.5061,  0.5133,  0.9904,
         0.1805,  0.7718,  0.7389,  0.1564,  0.0742,  0.8684,  0.1602,
         0.6760,  0.5401,  0.4484,  0.7635,  0.8938,  0.1966,  0.7827,
         0.2807,  0.7651,  0.4301,  0.8051,  0.6885,  0.6143,  0.0223,
         0.2068,  0.1222,  0.2999,  0.8070,  0.2082,  0.6643,  0.1973,
         0.4783,  0.6252,  0.8772,  0.9014,  0.2297,  0.4814,  0.3387,
         0.4819,  0.7899,  0.2511,  0.9603,  0.9081,  0.1648,  0.9237,
         0.6858,  0.8611,  0.2753,  0.1576,  0.4112,  0.9099,  0.9829,
         0.1420,  0.4042,  0.2335,  0.2885,  0.2312,  0.6605,  0.9777,
         0.2676,  0.6336,  0.2964,  0.1379,  0.4603,  0.4848,  0.8984,
         0.0945,  0.2864,  0.2517,  0.6625,  0.4358,  0.2249,  0.9263,
         0.0313,  0.3831,  0.1860,  0.5365,  0.2194,  0.2953,  0.7327,
         0.0294,  0.4576,  0.0334,  0.4579,  0.9034,  0.9315,  0.8149,
         0.0926,  0.2023,  0.4699,  0.9122,  0.8323,  0.8423,  0.2808,
         0.1362,  0.6994,  0.3519,  0.2479,  0.6480,  0.9698,  0.1845,
         0.4540,  0.7542,  0.5933,  0.1551,  0.4888,  0.7814,  0.3941,
         0.7182,  0.5684,  0.2438,  0.7152,  0.0315,  0.3448,  0.9289,
         0.3444,  0.3518,  0.1652,  0.7369,  0.8736,  0.3013,  0.2951,
         0.2672,  0.9577,  0.9936,  0.1314,  0.8649,  0.2335,  0.5492,
         0.2956,  0.1768,  0.0840,  0.8811,  0.1042,  0.6175,  0.4029,
         0.1776,  0.7665,  0.2050,  0.1808,  0.0527,  0.6948,  0.6444,
         0.8538,  0.0432,  0.3520,  0.1769,  0.1415,  0.2046,  0.4497,
         0.1589,  0.4850,  0.5758,  0.4069,  0.6197,  0.1388,  0.5507,
         0.2014,  0.1573,  0.6878,  0.1298,  0.5309,  0.0702,  0.4996,
         0.9521,  0.4634,  0.3081,  0.2166,  0.5408,  0.0336,  0.1154,
         0.1551,  0.5650,  0.3323,  0.2360,  0.8529,  0.1871,  0.2027,
         0.1966,  0.8722,  0.8906,  0.7308,  0.5226,  0.7777,  0.1196,
         0.1859], device='cuda:0')
tensor(0.4538, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3179,  0.7751,  0.9477,  0.8109,  0.0635,  0.0792,  0.1367,
         0.7824,  0.6580,  0.5740,  0.6909,  0.7901,  0.9029,  0.1759,
         0.5582,  0.1978,  0.4604,  0.2582,  0.1038,  0.2622,  0.8339,
         0.9004,  0.3392,  0.4327,  0.7202,  0.8561,  0.2627,  0.3139,
         0.9029,  0.5132,  0.4653,  0.0313,  0.8499,  0.6942,  0.0941,
         0.3861,  0.0941,  0.4341,  0.2496,  0.7833,  0.1197,  0.1659,
         0.2442,  0.7141,  0.5554,  0.9326,  0.3191,  0.2710,  0.2591,
         0.6317,  0.3400,  0.9880,  0.3753,  0.1663,  0.2673,  0.2650,
         0.8940,  0.2163,  0.2318,  0.2237,  0.5932,  0.8062,  0.4041,
         0.4598,  0.3379,  0.2132,  0.2198,  0.4759,  0.8993,  0.9801,
         0.4269,  0.0685,  0.3488,  0.9736,  0.7569,  0.7795,  0.3914,
         0.1567,  0.4043,  0.2396,  0.1166,  0.7673,  0.7433,  0.2272,
         0.2142,  0.1833,  0.0800,  0.8776,  0.1009,  0.1391,  0.9143,
         0.6030,  0.9245,  0.2267,  0.2077,  0.4355,  0.5882,  0.6810,
         0.7014,  0.2747,  0.3055,  0.1766,  0.6966,  0.6237,  0.9290,
         0.1985,  0.7060,  0.2530,  0.5067,  0.2249,  0.1468,  0.4007,
         0.8221,  0.1404,  0.5624,  0.2417,  0.2489,  0.7166,  0.5890,
         0.1974,  0.3446,  0.6648,  0.1438,  0.7726,  0.7338,  0.3455,
         0.2474,  0.3883,  0.8363,  0.5097,  0.1683,  0.1864,  0.7486,
         0.8034,  0.8952,  0.4924,  0.7988,  0.2818,  0.6467,  0.2366,
         0.5287,  0.8364,  0.9104,  0.7046,  0.7762,  0.1286,  0.1778,
         0.7621,  0.1922,  0.2625,  0.8806,  0.9190,  0.8315,  0.1170,
         0.5284,  0.8844,  0.2723,  0.6018,  0.8791,  0.7908,  0.1575,
         0.1443,  0.1250,  0.8234,  0.0695,  0.7682,  0.3128,  0.7448,
         0.3879,  0.7920,  0.5347,  0.1036,  0.1232,  0.2130,  0.2975,
         0.1966,  0.1370,  0.5346,  0.4326,  0.5935,  0.7979,  0.2369,
         0.3193,  0.8672,  0.5533,  0.5717,  0.4908,  0.3969,  0.9094,
         0.1531,  0.7482,  0.4815,  0.7904,  0.0961,  0.3825,  0.8509,
         0.0725,  0.0753,  0.4269,  0.7851,  0.2855,  0.8494,  0.8299,
         0.6687,  0.5248,  0.8824,  0.2471,  0.3623,  0.0797,  0.1109,
         0.1318,  0.4626,  0.7794,  0.2369,  0.4586,  0.9400,  0.7344,
         0.2211,  0.7618,  0.6076,  0.3212,  0.1668,  0.7311,  0.6848,
         0.3795,  0.2380,  0.2661,  0.3004,  0.1065,  0.7613,  0.2063,
         0.7435,  0.8685,  0.5401,  0.3740,  0.5826,  0.5215,  0.4593,
         0.4289,  0.4591,  0.7615,  0.7428,  0.9350,  0.4569,  0.6460,
         0.8145,  0.2003,  0.5246,  0.2913,  0.8164,  0.7975,  0.4891,
         0.1972,  0.5675,  0.3609,  0.4422,  0.6854,  0.1926,  0.2775,
         0.6981,  0.8798,  0.0918,  0.2232,  0.5966,  0.7613,  0.8918,
         0.6802,  0.8723,  0.7523,  0.1544,  0.0944,  0.1609,  0.6012,
         0.7931,  0.5151,  0.1550,  0.3059,  0.9914,  0.8447,  0.2605,
         0.2616,  0.2521,  0.8441,  0.0701,  0.8354,  0.8627,  0.1075,
         0.3325,  0.6450,  0.1141,  0.7926,  0.6149,  0.1731,  0.2131,
         0.1977,  0.4064,  0.5227,  0.5848,  0.8625,  0.1000,  0.7335,
         0.2907,  0.4870,  0.2914,  0.6867,  0.4120,  0.4627,  0.3440,
         0.8668,  0.5805,  0.2813,  0.4612,  0.4896,  0.8428,  0.7754,
         0.0456,  0.8363,  0.2625,  0.3270,  0.3604,  0.4510,  0.2692,
         0.4426,  0.8003,  0.4207,  0.2110,  0.1525,  0.3423,  0.7343,
         0.9518,  0.9034,  0.3420,  0.1025,  0.9224,  0.1048,  0.6309,
         0.5103,  0.2446,  0.2361,  0.6758,  0.2929,  0.9432,  0.4251,
         0.0558,  0.5795,  0.8037,  0.1642,  0.7567,  0.5103,  0.4706,
         0.8690,  0.4433,  0.7896,  0.4624,  0.8679,  0.8359,  0.2242,
         0.2900,  0.5681,  0.2029,  0.0992,  0.2077,  0.6397,  0.4375,
         0.6854,  0.7959,  0.5454,  0.0570,  0.9106,  0.2414,  0.9023,
         0.3152,  0.4000,  0.8069,  0.1214,  0.1539,  0.2656,  0.7245,
         0.0903,  0.3818,  0.3672,  0.7852,  0.7006,  0.5659,  0.2226,
         0.5720,  0.6006,  0.9372,  0.0581,  0.6116,  0.8236,  0.1433,
         0.2709,  0.7898,  0.7210,  0.3918,  0.6347,  0.1197,  0.4931,
         0.6917,  0.4642,  0.8461,  0.7955,  0.5486,  0.5074,  0.6921,
         0.2151,  0.2511,  0.2574,  0.8645,  0.6980,  0.7650,  0.0717,
         0.7530,  0.2154,  0.2501,  0.6494,  0.8403,  0.0734,  0.2677,
         0.8866,  0.3981,  0.3172,  0.8193,  0.6622,  0.4029,  0.0429,
         0.7910,  0.8856,  0.2830,  0.1325,  0.1052,  0.0627,  0.8610,
         0.7212,  0.7489,  0.9629,  0.4034,  0.4938,  0.7629,  0.2311,
         0.0328,  0.3764,  0.2294,  0.1991,  0.7514,  0.1580,  0.0323,
         0.8590,  0.3515,  0.1025,  0.6606,  0.0623,  0.1379,  0.1221,
         0.2029,  0.5997,  0.2091,  0.1083,  0.8575,  0.1320,  0.4054,
         0.3813,  0.1162,  0.4511,  0.0421,  0.3084,  0.4113,  0.2328,
         0.2108,  0.2752,  0.3653,  0.8628,  0.8853,  0.6929,  0.1270,
         0.5537,  0.8434,  0.5876,  0.1581,  0.2364,  0.6129,  0.8675,
         0.7991,  0.7589,  0.2685,  0.2276,  0.8768,  0.5398,  0.5602,
         0.1603,  0.4731,  0.8934,  0.1026,  0.4485,  0.2095,  0.7744,
         0.9124,  0.7660,  0.1654,  0.8798,  0.1586,  0.2326,  0.7908,
         0.5329,  0.6915,  0.1617,  0.0626,  0.8274,  0.7909,  0.1513,
         0.9106], device='cuda:0')
tensor(0.4870, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7745,  0.5138,  0.7424,  0.1130,  0.0889,  0.7662,  0.6956,
         0.1084,  0.3607,  0.7051,  0.3101,  0.3062,  0.7692,  0.8814,
         0.8765,  0.7729,  0.4285,  0.1650,  0.2902,  0.7331,  0.0134,
         0.1853,  0.6813,  0.8330,  0.7810,  0.6591,  0.2899,  0.3858,
         0.1649,  0.1022,  0.4344,  0.5242,  0.1139,  0.6453,  0.0714,
         0.0760,  0.6976,  0.4594,  0.4234,  0.7144,  0.4714,  0.3331,
         0.5328,  0.7118,  0.8830,  0.1195,  0.7126,  0.1140,  0.7647,
         0.3414,  0.3142,  0.9002,  0.4002,  0.1945,  0.4458,  0.6743,
         0.1587,  0.1493,  0.3638,  0.4525,  0.7286,  0.7614,  0.0795,
         0.8499,  0.9320,  0.7381,  0.6877,  0.1650,  0.0987,  0.5656,
         0.5921,  0.8215,  0.9313,  0.7457,  0.5651,  0.3733,  0.6650,
         0.8626,  0.4818,  0.4546,  0.0930,  0.7190,  0.1228,  0.9372,
         0.0165,  0.4046,  0.7865,  0.3957,  0.4624,  0.0672,  0.8591,
         0.5125,  0.0554,  0.3556,  0.2840,  0.3547,  0.2240,  0.1052,
         0.8662,  0.4024,  0.3493,  0.8019,  0.7107,  0.8602,  0.6915,
         0.4379,  0.8222,  0.9239,  0.9248,  0.1965,  0.3331,  0.1419,
         0.7085,  0.7844,  0.3461,  0.6495,  0.6382,  0.1639,  0.0686,
         0.7894,  0.0391,  0.7381,  0.0779,  0.1301,  0.2667,  0.0546,
         0.0962,  0.8228,  0.8718,  0.1539,  0.7019,  0.1320,  0.9100,
         0.5838,  0.0704,  0.3823,  0.4933,  0.1353,  0.6119,  0.8451,
         0.4258,  0.3384,  0.8826,  0.1840,  0.9329,  0.4115,  0.8468,
         0.7785,  0.3337,  0.1756,  0.7251,  0.2603,  0.6137,  0.6842,
         0.8523,  0.9241,  0.1778,  0.8914,  0.5782,  0.8119,  0.5636,
         0.1098,  0.1714,  0.6571,  0.9618,  0.1314,  0.3546,  0.4857,
         0.9690,  0.0364,  0.7278,  0.3298,  0.5915,  0.3040,  0.0554,
         0.9140,  0.1012,  0.7312,  0.5872,  0.0629,  0.1350,  0.6863,
         0.1176,  0.8011,  0.6171,  0.8668,  0.5932,  0.1036,  0.6597,
         0.7528,  0.7531,  0.6336,  0.2325,  0.3781,  0.2775,  0.0945,
         0.0801,  0.5385,  0.6152,  0.9531,  0.6230,  0.3944,  0.5051,
         0.9221,  0.1480,  0.4598,  0.1814,  0.4953,  0.9311,  0.1738,
         0.8550,  0.4521,  0.2979,  0.1722,  0.1357,  0.1145,  0.8202,
         0.6848,  0.4772,  0.3031,  0.3043,  0.2735,  0.4521,  0.7854,
         0.8235,  0.1787,  0.7969,  0.7919,  0.2639,  0.8399,  0.1197,
         0.6336,  0.7782,  0.5835,  0.6527,  0.0901,  0.7737,  0.9848,
         0.9050,  0.2905,  0.1374,  0.6193,  0.2601,  0.8727,  0.8847,
         0.0860,  0.3691,  0.3549,  0.0872,  0.1557,  0.7719,  0.2464,
         0.2992,  0.6718,  0.7251,  0.2443,  0.5095,  0.5543,  0.7484,
         0.6264,  0.4979,  0.4610,  0.5722,  0.9902,  0.5088,  0.7760,
         0.9249,  0.8193,  0.2510,  0.9283,  0.3480,  0.3800,  0.4123,
         0.7862,  0.1869,  0.7587,  0.8973,  0.0389,  0.8756,  0.1743,
         0.8596,  0.4004,  0.1517,  0.7754,  0.7209,  0.1596,  0.6195,
         0.3446,  0.4437,  0.1002,  0.2163,  0.1986,  0.1915,  0.0949,
         0.6725,  0.4148,  0.4322,  0.2907,  0.4782,  0.9930,  0.7293,
         0.8965,  0.4809,  0.1510,  0.9040,  0.1994,  0.3140,  0.8275,
         0.0959,  0.8121,  0.8627,  0.2314,  0.8464,  0.3372,  0.5943,
         0.7692,  0.6373,  0.6632,  0.4751,  0.5218,  0.7928,  0.9339,
         0.0999,  0.1639,  0.7092,  0.4077,  0.9512,  0.8114,  0.2245,
         0.7883,  0.5410,  0.1744,  0.3195,  0.6618,  0.3085,  0.5891,
         0.6525,  0.1192,  0.9234,  0.8786,  0.1090,  0.2031,  0.9875,
         0.8782,  0.1254,  0.6357,  0.2788,  0.2680,  0.3194,  0.8528,
         0.1034,  0.1979,  0.1019,  0.7484,  0.6122,  0.8380,  0.6339,
         0.6902,  0.5447,  0.5053,  0.4293,  0.8951,  0.1337,  0.3831,
         0.4213,  0.1710,  0.2337,  0.3223,  0.9622,  0.1131,  0.8915,
         0.9386,  0.1731,  0.7957,  0.2384,  0.3553,  0.8735,  0.3988,
         0.5475,  0.3220,  0.2093,  0.7973,  0.8909,  0.9877,  0.4126,
         0.1840,  0.9146,  0.1204,  0.3300,  0.3577,  0.0394,  0.9049,
         0.0569,  0.8401,  0.0646,  0.4988,  0.6970,  0.0646,  0.9204,
         0.9430,  0.2612,  0.3771,  0.2751,  0.9526,  0.2691,  0.7735,
         0.1242,  0.0242,  0.8018,  0.2543,  0.0761,  0.1394,  0.6795,
         0.4116,  0.9290,  0.2334,  0.8393,  0.8335,  0.7648,  0.8273,
         0.3911,  0.2914,  0.8241,  0.2946,  0.4227,  0.5036,  0.4948,
         0.2969,  0.6595,  0.6706,  0.0431,  0.1889,  0.4393,  0.5828,
         0.1979,  0.3660,  0.5132,  0.9123,  0.1560,  0.2480,  0.8577,
         0.5157,  0.8345,  0.9262,  0.0942,  0.3715,  0.6504,  0.2913,
         0.9629,  0.0970,  0.0920,  0.2825,  0.4740,  0.2641,  0.4117,
         0.1061,  0.4714,  0.5872,  0.7761,  0.0323,  0.2145,  0.9852,
         0.2862,  0.3281,  0.2959,  0.8648,  0.4946,  0.3714,  0.6100,
         0.6869,  0.0502,  0.4993,  0.1909,  0.3244,  0.2957,  0.3187,
         0.7202,  0.3318,  0.0846,  0.8781,  0.9135,  0.8640,  0.3137,
         0.4121,  0.8384,  0.4254,  0.1122,  0.0552,  0.1160,  0.5253,
         0.1485,  0.6311,  0.8825,  0.8148,  0.5237,  0.7904,  0.9054,
         0.2313,  0.5792,  0.8889,  0.9356,  0.2006,  0.8642,  0.0278,
         0.6624,  0.7996,  0.1050,  0.4002,  0.5386,  0.9753,  0.5894,
         0.0574], device='cuda:0')
tensor(0.4553, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7285,  0.5674,  0.9720,  0.9806,  0.6106,  0.9602,  0.2370,
         0.9426,  0.8742,  0.6973,  0.3604,  0.4430,  0.4842,  0.7925,
         0.5988,  0.7672,  0.9048,  0.4435,  0.7660,  0.7836,  0.8617,
         0.5290,  0.0236,  0.0925,  0.2832,  0.9502,  0.8206,  0.8608,
         0.5747,  0.5654,  0.6773,  0.5215,  0.7268,  0.6901,  0.9407,
         0.8846,  0.8574,  0.7320,  0.1740,  0.3933,  0.9809,  0.7573,
         0.7429,  0.2488,  0.9230,  0.2271,  0.9447,  0.8262,  0.7894,
         0.0587,  0.1985,  0.8199,  0.3035,  0.9079,  0.8211,  0.5333,
         0.7106,  0.1590,  0.8385,  0.8338,  0.7111,  0.1728,  0.6935,
         0.7668,  0.1280,  0.6808,  0.0447,  0.1133,  0.6886,  0.7744,
         0.0584,  0.1801,  0.0215,  0.6988,  0.4769,  0.5611,  0.3684,
         0.8587,  0.8169,  0.2382,  0.0524,  0.8218,  0.5302,  0.9236,
         0.2075,  0.2439,  0.9266,  0.8464,  0.6846,  0.6854,  0.3485,
         0.8425,  0.8326,  0.8148,  0.0331,  0.5525,  0.2745,  0.9140,
         0.5763,  0.9421,  0.1436,  0.6651,  0.8782,  0.3170,  0.5434,
         0.3761,  0.2053,  0.8640,  0.6148,  0.5413,  0.6555,  0.3484,
         0.4827,  0.6124,  0.1083,  0.6371,  0.8042,  0.4617,  0.7771,
         0.9383,  0.7685,  0.8605,  0.2621,  0.8814,  0.7035,  0.1005,
         0.5642,  0.5471,  0.9314,  0.3495,  0.1494,  0.9165,  0.4056,
         0.2714,  0.7925,  0.7143,  0.3801,  0.8605,  0.9153,  0.7738,
         0.6363,  0.3849,  0.1917,  0.7710,  0.5182,  0.8256,  0.1175,
         0.7954,  0.6253,  0.1329,  0.5194,  0.8661,  0.9246,  0.9131,
         0.2642,  0.5679,  0.7416,  0.8378,  0.8731,  0.6164,  0.0700,
         0.8430,  0.2104,  0.2156,  0.3008,  0.9750,  0.6048,  0.8124,
         0.4297,  0.7956,  0.4518,  0.7871,  0.5837,  0.5081,  0.7455,
         0.8817,  0.3251,  0.2622,  0.8394,  0.7397,  0.1409,  0.8329,
         0.3795,  0.1939,  0.9948,  0.9755,  0.1892,  0.8263,  0.9564,
         0.0501,  0.5070,  0.2016,  0.6233,  0.7826,  0.8713,  0.8441,
         0.8976,  0.3416,  0.9431,  0.9306,  0.0327,  0.6570,  0.9839,
         0.5321,  0.2950,  0.7471,  0.3120,  0.0443,  0.8566,  0.8726,
         0.8289,  0.9736,  0.9210,  0.2190,  0.3462,  0.1657,  0.0940,
         0.2507,  0.7206,  0.7916,  0.8336,  0.0361,  0.0392,  0.1856,
         0.6981,  0.5831,  0.4155,  0.1949,  0.2882,  0.6834,  0.2196,
         0.8288,  0.1664,  0.9157,  0.2284,  0.8061,  0.8480,  0.9607,
         0.3399,  0.0574,  0.1103,  0.5335,  0.9902,  0.1855,  0.7675,
         0.6942,  0.2591,  0.1566,  0.7799,  0.4851,  0.6529,  0.8958,
         0.3535,  0.1420,  0.1653,  0.3320,  0.3043,  0.1199,  0.4040,
         0.2782,  0.9599,  0.2900,  0.3392,  0.7740,  0.5984,  0.1985,
         0.4308,  0.2157,  0.6530,  0.2614,  0.3714,  0.6961,  0.5786,
         0.1703,  0.7801,  0.3807,  0.9320,  0.8885,  0.0862,  0.2925,
         0.6452,  0.8498,  0.9736,  0.1617,  0.4295,  0.1052,  0.6853,
         0.8013,  0.3152,  0.0709,  0.6564,  0.5506,  0.5644,  0.0674,
         0.9392,  0.4321,  0.6114,  0.7715,  0.4626,  0.8181,  0.8547,
         0.6060,  0.4632,  0.2694,  0.7968,  0.1734,  0.4883,  0.9342,
         0.2719,  0.6947,  0.0550,  0.8956,  0.5273,  0.9333,  0.3885,
         0.5737,  0.9007,  0.7707,  0.7258,  0.8575,  0.2245,  0.2158,
         0.3383,  0.8017,  0.5830,  0.1303,  0.6420,  0.4192,  0.3093,
         0.6506,  0.3349,  0.3134,  0.9141,  0.2205,  0.7973,  0.1694,
         0.8944,  0.4744,  0.6657,  0.2435,  0.3812,  0.8829,  0.5803,
         0.8259,  0.7986,  0.2554,  0.7063,  0.6878,  0.5159,  0.4605,
         0.6588,  0.5609,  0.5648,  0.2573,  0.3034,  0.7155,  0.5506,
         0.3444,  0.0974,  0.9490,  0.0617,  0.0752,  0.5345,  0.8345,
         0.8941,  0.8645,  0.2013,  0.7256,  0.8542,  0.7560,  0.1294,
         0.1402,  0.1385,  0.5508,  0.8280,  0.1502,  0.1746,  0.4202,
         0.2439,  0.6161,  0.8343,  0.5901,  0.4365,  0.5237,  0.5011,
         0.1805,  0.7474,  0.6553,  0.0724,  0.9278,  0.7814,  0.1933,
         0.1732,  0.0635,  0.8841,  0.8588,  0.3418,  0.0934,  0.8430,
         0.2806,  0.6416,  0.0862,  0.1886,  0.8110,  0.4263,  0.1202,
         0.9893,  0.8769,  0.6529,  0.0654,  0.0534,  0.7467,  0.7386,
         0.3969,  0.6675,  0.2403,  0.9102,  0.0815,  0.7704,  0.8512,
         0.0792,  0.8393,  0.5043,  0.3503,  0.0986,  0.4818,  0.5230,
         0.8557,  0.6959,  0.8793,  0.6149,  0.7948,  0.7278,  0.6843,
         0.9954,  0.9610,  0.4192,  0.1297,  0.7898,  0.9214,  0.2914,
         0.1194,  0.5416,  0.9708,  0.2041,  0.5358,  0.8470,  0.1651,
         0.7822,  0.8402,  0.1343,  0.2260,  0.3292,  0.8212,  0.1730,
         0.7996,  0.7428,  0.7727,  0.2628,  0.8903,  0.9144,  0.8743,
         0.7362,  0.9602,  0.0763,  0.1628,  0.8373,  0.1792,  0.5328,
         0.9926,  0.4434,  0.3544,  0.2067,  0.8418,  0.8062,  0.8128,
         0.0897,  0.0675,  0.8763,  0.6138,  0.9434,  0.7163,  0.8675,
         0.7301,  0.2279,  0.1845,  0.3460,  0.0822,  0.3524,  0.6621,
         0.2347,  0.6239,  0.8869,  0.1349,  0.3018,  0.2233,  0.4784,
         0.7379,  0.9759,  0.7098,  0.5132,  0.2672,  0.4848,  0.3840,
         0.8402,  0.9248,  0.6717,  0.0706,  0.9541,  0.9056,  0.9258,
         0.7605], device='cuda:0')
tensor(0.4266, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7559,  0.1257,  0.6646,  0.9667,  0.9127,  0.7786,  0.1017,
         0.6679,  0.8651,  0.8359,  0.6584,  0.6562,  0.3901,  0.8176,
         0.2750,  0.5965,  0.4076,  0.7969,  0.1198,  0.6794,  0.7174,
         0.3607,  0.9074,  0.8956,  0.3204,  0.7146,  0.8727,  0.8223,
         0.7100,  0.4253,  0.9036,  0.9114,  0.2220,  0.8131,  0.8819,
         0.8249,  0.7100,  0.8680,  0.8750,  0.4229,  0.2574,  0.1973,
         0.9449,  0.5817,  0.2182,  0.8657,  0.7981,  0.8580,  0.8486,
         0.8633,  0.9899,  0.7265,  0.2452,  0.9192,  0.1134,  0.8450,
         0.2534,  0.4016,  0.2446,  0.1251,  0.8327,  0.1294,  0.7429,
         0.8225,  0.8003,  0.1460,  0.7347,  0.8535,  0.5589,  0.3299,
         0.8747,  0.8670,  0.2220,  0.1452,  0.2412,  0.6744,  0.2991,
         0.7804,  0.3745,  0.9081,  0.5929,  0.5821,  0.9882,  0.1382,
         0.8674,  0.9715,  0.7629,  0.2090,  0.8845,  0.1612,  0.1673,
         0.1959,  0.4115,  0.2194,  0.9620,  0.1010,  0.8572,  0.9081,
         0.2082,  0.5700,  0.1990,  0.8894,  0.1615,  0.9843,  0.6207,
         0.9365,  0.2273,  0.8236,  0.4372,  0.6526,  0.2510,  0.6720,
         0.1619,  0.8355,  0.1252,  0.9797,  0.1184,  0.6943,  0.1168,
         0.7714,  0.7964,  0.8243,  0.2594,  0.8158,  0.2704,  0.6770,
         0.3457,  0.7503,  0.1434,  0.2064,  0.8648,  0.4042,  0.7646,
         0.1574,  0.9412,  0.3329,  0.8533,  0.2994,  0.8261,  0.9017,
         0.9221,  0.7960,  0.9217,  0.9797,  0.8494,  0.3179,  0.5275,
         0.6227,  0.6435,  0.8350,  0.1292,  0.9484,  0.8149,  0.2821,
         0.5418,  0.9561,  0.8872,  0.3082,  0.0998,  0.8272,  0.8973,
         0.8411,  0.7716,  0.9302,  0.3834,  0.0431,  0.1252,  0.4092,
         0.6156,  0.8946,  0.8834,  0.4181,  0.2443,  0.6849,  0.8451,
         0.7877,  0.2268,  0.2245,  0.7658,  0.8731,  0.9425,  0.7993,
         0.1734,  0.9349,  0.4852,  0.4155,  0.8436,  0.2584,  0.3707,
         0.2863,  0.9605,  0.3337,  0.3947,  0.2724,  0.3162,  0.1280,
         0.7971,  0.8773,  0.9579,  0.8488,  0.0442,  0.9342,  0.9136,
         0.5095,  0.4217,  0.8124,  0.5737,  0.2524,  0.2918,  0.8431,
         0.5908,  0.7257,  0.8950,  0.8247,  0.6522,  0.7527,  0.4297,
         0.7832,  0.8401,  0.8029,  0.3871,  0.7407,  0.8190,  0.4653,
         0.5138,  0.9048,  0.8045,  0.7727,  0.8286,  0.7530,  0.1636,
         0.5690,  0.9126,  0.8610,  0.7819,  0.5876,  0.9166,  0.6671,
         0.8703,  0.7490,  0.8886,  0.2107,  0.8490,  0.7702,  0.6649,
         0.9118,  0.9296,  0.9216,  0.8572,  0.0825,  0.8745,  0.3362,
         0.7709,  0.6674,  0.9209,  0.9548,  0.9632,  0.3525,  0.8998,
         0.2221,  0.9661,  0.2898,  0.8498,  0.9961,  0.3225,  0.9308,
         0.8567,  0.9515,  0.9363,  0.2705,  0.4887,  0.6646,  0.7011,
         0.1492,  0.0568,  0.8633,  0.9016,  0.9524,  0.8973,  0.8467,
         0.3661,  0.7194,  0.7210,  0.2174,  0.8087,  0.5460,  0.4389,
         0.2696,  0.7298,  0.7721,  0.0953,  0.4532,  0.4588,  0.8903,
         0.3486,  0.7827,  0.7820,  0.7730,  0.7846,  0.9369,  0.2672,
         0.0477,  0.9096,  0.9778,  0.4353,  0.5027,  0.9037,  0.7739,
         0.6170,  0.7296,  0.6056,  0.8764,  0.8212,  0.8224,  0.1067,
         0.2484,  0.3681,  0.4153,  0.8837,  0.9864,  0.8680,  0.7485,
         0.8756,  0.7543,  0.8625,  0.6280,  0.7071,  0.1758,  0.8634,
         0.8741,  0.8545,  0.0953,  0.1279,  0.8524,  0.6524,  0.6560,
         0.9520,  0.9199,  0.8115,  0.0986,  0.3889,  0.0878,  0.7589,
         0.8995,  0.9522,  0.3722,  0.6788,  0.7830,  0.3303,  0.3541,
         0.9231,  0.4748,  0.3148,  0.9066,  0.0630,  0.8270,  0.9356,
         0.2938,  0.6684,  0.3703,  0.8322,  0.1075,  0.8390,  0.2208,
         0.8316,  0.8607,  0.9820,  0.4596,  0.9290,  0.8678,  0.8878,
         0.7494,  0.5278,  0.5465,  0.5571,  0.3074,  0.8950,  0.8023,
         0.9646,  0.3566,  0.0763,  0.3724,  0.1212,  0.9603,  0.6304,
         0.0815,  0.8503,  0.8349,  0.7778,  0.9245,  0.9471,  0.5278,
         0.7491,  0.8991,  0.2546,  0.3718,  0.2334,  0.8205,  0.6092,
         0.3218,  0.8765,  0.0377,  0.8967,  0.2340,  0.7669,  0.3168,
         0.1157,  0.9565,  0.9811,  0.3059,  0.8795,  0.8445,  0.8397,
         0.8632,  0.6952,  0.9396,  0.7107,  0.8215,  0.1052,  0.9638,
         0.8523,  0.6062,  0.1839,  0.5654,  0.5851,  0.9045,  0.2588,
         0.8777,  0.3566,  0.9356,  0.0909,  0.5560,  0.8518,  0.4677,
         0.7508,  0.0944,  0.8565,  0.9281,  0.5186,  0.2598,  0.4100,
         0.7890,  0.8157,  0.4759,  0.0967,  0.1741,  0.1511,  0.9308,
         0.2288,  0.7659,  0.1260,  0.2210,  0.6647,  0.4177,  0.4885,
         0.9368,  0.0353,  0.8151,  0.4126,  0.8662,  0.9392,  0.9540,
         0.8379,  0.4893,  0.1675,  0.8794,  0.5062,  0.4408,  0.1623,
         0.5315,  0.5866,  0.3642,  0.9505,  0.2128,  0.9236,  0.9364,
         0.0301,  0.2607,  0.8593,  0.9123,  0.8569,  0.7897,  0.8650,
         0.9726,  0.6828,  0.7577,  0.7535,  0.6564,  0.1140,  0.9192,
         0.4453,  0.1834,  0.8492,  0.9129,  0.1377,  0.9863,  0.3249,
         0.8929,  0.0753,  0.2029,  0.6507,  0.1038,  0.8883,  0.2417,
         0.8815,  0.9874,  0.9232,  0.7649,  0.6416,  0.8802,  0.8352,
         0.5658], device='cuda:0')
tensor(0.5149, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6323,  0.2432,  0.8591,  0.8767,  0.4434,  0.5197,  0.5717,
         0.5665,  0.4823,  0.8981,  0.1307,  0.8539,  0.1732,  0.2009,
         0.8874,  0.0720,  0.4431,  0.6705,  0.9196,  0.0772,  0.9469,
         0.2329,  0.9210,  0.6111,  0.1276,  0.7993,  0.9107,  0.2734,
         0.9971,  0.9158,  0.0862,  0.7089,  0.2147,  0.4528,  0.9147,
         0.9476,  0.9164,  0.0487,  0.5048,  0.9141,  0.7718,  0.3120,
         0.4588,  0.8714,  0.8878,  0.8116,  0.8018,  0.7909,  0.3105,
         0.9587,  0.9157,  0.1484,  0.6406,  0.9155,  0.2523,  0.8209,
         0.7420,  0.6263,  0.0779,  0.6227,  0.1054,  0.8108,  0.1095,
         0.3228,  0.3085,  0.0641,  0.4149,  0.9907,  0.4641,  0.8710,
         0.9959,  0.6476,  0.5954,  0.0462,  0.9472,  0.2307,  0.8412,
         0.1382,  0.4197,  0.7418,  0.7303,  0.1442,  0.9182,  0.0166,
         0.6707,  0.9983,  0.3198,  0.9866,  0.5577,  0.0621,  0.4861,
         0.5377,  0.5590,  0.1310,  0.9087,  0.5652,  0.8729,  0.6603,
         0.9210,  0.9431,  0.8202,  0.2058,  0.6910,  0.0923,  0.1307,
         0.8343,  0.8762,  0.7225,  0.1095,  0.3410,  0.7312,  0.5181,
         0.8867,  0.7112,  0.0601,  0.8916,  0.7456,  0.5758,  0.8592,
         0.2448,  0.9900,  0.2406,  0.9480,  0.8845,  0.3471,  0.5057,
         0.2728,  0.2333,  0.4672,  0.2301,  0.8779,  0.8482,  0.1616,
         0.2929,  0.7430,  0.8286,  0.9366,  0.7716,  0.1574,  0.8983,
         0.9870,  0.8072,  0.3382,  0.5095,  0.7244,  0.2745,  0.5755,
         0.8076,  0.1228,  0.8535,  0.0355,  0.6936,  0.9247,  0.7351,
         0.4036,  0.1002,  0.0944,  0.5719,  0.6607,  0.7448,  0.2688,
         0.2842,  0.9036,  0.3891,  0.8746,  0.4461,  0.9079,  0.1912,
         0.7383,  0.7118,  0.3004,  0.0886,  0.8343,  0.8360,  0.4350,
         0.6337,  0.9201,  0.8953,  0.6920,  0.2320,  0.8179,  0.7755,
         0.6131,  0.1397,  0.2017,  0.7184,  0.1742,  0.1594,  0.2424,
         0.1000,  0.7216,  0.3705,  0.3953,  0.1227,  0.8954,  0.0956,
         0.8506,  0.8131,  0.1602,  0.1328,  0.2432,  0.1516,  0.2963,
         0.3895,  0.5935,  0.9897,  0.8331,  0.9096,  0.9451,  0.6954,
         0.1183,  0.8803,  0.2180,  0.2127,  0.3368,  0.0260,  0.5552,
         0.4675,  0.1683,  0.9531,  0.4857,  0.7307,  0.8619,  0.1462,
         0.0399,  0.8399,  0.2525,  0.9043,  0.4071,  0.9276,  0.8644,
         0.2298,  0.8307,  0.8788,  0.8339,  0.8260,  0.4639,  0.8130,
         0.4857,  0.5162,  0.9842,  0.4622,  0.8754,  0.7973,  0.4176,
         0.8151,  0.0530,  0.8272,  0.0952,  0.6891,  0.7576,  0.3819,
         0.5691,  0.7530,  0.3529,  0.8334,  0.7612,  0.2148,  0.6050,
         0.3538,  0.6949,  0.6812,  0.2833,  0.1978,  0.9195,  0.9520,
         0.4792,  0.6735,  0.9433,  0.1406,  0.6712,  0.0683,  0.0067,
         0.9604,  0.9274,  0.9062,  0.4255,  0.2822,  0.3704,  0.1169,
         0.0532,  0.6205,  0.0815,  0.5452,  0.1799,  0.5623,  0.1869,
         0.1113,  0.6600,  0.7442,  0.9038,  0.0665,  0.4480,  0.0654,
         0.7818,  0.2546,  0.7766,  0.7942,  0.8144,  0.6742,  0.8932,
         0.7334,  0.2755,  0.6321,  0.8395,  0.0222,  0.0626,  0.8141,
         0.0998,  0.1599,  0.7216,  0.3622,  0.8951,  0.7202,  0.8779,
         0.9605,  0.6673,  0.4812,  0.8013,  0.7471,  0.0720,  0.9686,
         0.7399,  0.9407,  0.6582,  0.9248,  0.6971,  0.7162,  0.9911,
         0.9594,  0.2344,  0.8479,  0.8604,  0.9036,  0.8020,  0.2924,
         0.1970,  0.3936,  0.9044,  0.0943,  0.0969,  0.6878,  0.8813,
         0.1981,  0.2086,  0.0674,  0.3590,  0.8812,  0.9055,  0.2197,
         0.3507,  0.8752,  0.6797,  0.2700,  0.4404,  0.0973,  0.7867,
         0.2067,  0.4924,  0.4086,  0.2099,  0.1432,  0.8733,  0.6786,
         0.7845,  0.3549,  0.7392,  0.7585,  0.9106,  0.1594,  0.0225,
         0.1289,  0.8841,  0.0627,  0.5006,  0.2532,  0.5040,  0.9159,
         0.6693,  0.1298,  0.9232,  0.3590,  0.8259,  0.2405,  0.8116,
         0.2210,  0.4306,  0.8331,  0.3516,  0.8297,  0.2804,  0.0610,
         0.5604,  0.8577,  0.6887,  0.8738,  0.2463,  0.6387,  0.8805,
         0.8977,  0.7671,  0.2397,  0.7740,  0.7895,  0.1898,  0.9872,
         0.7774,  0.1350,  0.8132,  0.1940,  0.7700,  0.9366,  0.7081,
         0.2670,  0.9466,  0.9092,  0.5787,  0.1992,  0.2516,  0.6858,
         0.7655,  0.7310,  0.6575,  0.9469,  0.3640,  0.0113,  0.8041,
         0.1651,  0.5507,  0.7472,  0.5486,  0.6871,  0.5697,  0.8970,
         0.9928,  0.3194,  0.8457,  0.3892,  0.0735,  0.3993,  0.1271,
         0.2208,  0.1610,  0.2641,  0.9187,  0.8935,  0.4151,  0.0740,
         0.1855,  0.8208,  0.8475,  0.5686,  0.0888,  0.1646,  0.8522,
         0.1670,  0.6623,  0.7628,  0.3394,  0.4113,  0.2770,  0.6438,
         0.8419,  0.0653,  0.5709,  0.1266,  0.6590,  0.2767,  0.1533,
         0.8462,  0.9664,  0.7331,  0.5560,  0.2071,  0.0322,  0.1091,
         0.7833,  0.9342,  0.1877,  0.7211,  0.0619,  0.5608,  0.1415,
         0.2610,  0.0882,  0.5193,  0.8572,  0.1980,  0.4343,  0.2301,
         0.1658,  0.9939,  0.2689,  0.6772,  0.0687,  0.8325,  0.2517,
         0.6386,  0.9345,  0.8298,  0.8823,  0.1451,  0.0668,  0.6937,
         0.8586,  0.1125,  0.3165,  0.7919,  0.5572,  0.8268,  0.6204,
         0.1175], device='cuda:0')
tensor(0.4380, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8830,  0.5909,  0.9354,  0.7711,  0.0850,  0.6618,  0.9243,
         0.4201,  0.9743,  0.1446,  0.6144,  0.0758,  0.3457,  0.7868,
         0.1560,  0.8129,  0.8344,  0.3318,  0.1539,  0.6471,  0.4830,
         0.8238,  0.6008,  0.1899,  0.4136,  0.2610,  0.1440,  0.8807,
         0.2835,  0.4272,  0.4720,  0.8502,  0.1599,  0.9285,  0.9401,
         0.3527,  0.1334,  0.9907,  0.1135,  0.0660,  0.0539,  0.2456,
         0.8485,  0.1729,  0.0099,  0.9844,  0.7984,  0.6166,  0.8596,
         0.7458,  0.4478,  0.2927,  0.3120,  0.2782,  0.2614,  0.3839,
         0.7054,  0.3723,  0.1617,  0.2483,  0.8245,  0.2433,  0.4292,
         0.7037,  0.1416,  0.1010,  0.9257,  0.0586,  0.1891,  0.8808,
         0.6320,  0.7123,  0.8536,  0.8852,  0.5072,  0.1456,  0.0751,
         0.0530,  0.6668,  0.0551,  0.8988,  0.1570,  0.7201,  0.2645,
         0.1520,  0.2348,  0.0390,  0.5415,  0.1395,  0.8165,  0.2011,
         0.2876,  0.4503,  0.6536,  0.7413,  0.3662,  0.3168,  0.6791,
         0.1777,  0.8538,  0.1333,  0.4093,  0.7675,  0.0659,  0.9169,
         0.3809,  0.5272,  0.1276,  0.3630,  0.7960,  0.5280,  0.2249,
         0.1784,  0.0243,  0.3343,  0.6256,  0.6975,  0.3377,  0.7470,
         0.5005,  0.1504,  0.9549,  0.9589,  0.2172,  0.2775,  0.4229,
         0.5101,  0.0661,  0.1861,  0.1762,  0.4325,  0.8543,  0.0644,
         0.1449,  0.6797,  0.6307,  0.6863,  0.0988,  0.8309,  0.6048,
         0.8698,  0.6199,  0.6379,  0.1319,  0.6674,  0.3911,  0.8426,
         0.9280,  0.8552,  0.9069,  0.2509,  0.5992,  0.6290,  0.7844,
         0.1087,  0.1972,  0.6026,  0.4573,  0.1808,  0.7258,  0.5337,
         0.6249,  0.9019,  0.1534,  0.1059,  0.9006,  0.6608,  0.2114,
         0.8452,  0.3060,  0.1607,  0.1849,  0.3934,  0.7331,  0.6373,
         0.8141,  0.7608,  0.0785,  0.1160,  0.5168,  0.2542,  0.2928,
         0.0087,  0.7792,  0.6688,  0.5666,  0.7414,  0.0468,  0.4199,
         0.8729,  0.2342,  0.2169,  0.1552,  0.4575,  0.0827,  0.2985,
         0.2247,  0.7242,  0.1082,  0.2800,  0.1634,  0.9685,  0.1320,
         0.4045,  0.8018,  0.1359,  0.5556,  0.3196,  0.4758,  0.4986,
         0.3391,  0.5443,  0.0817,  0.9395,  0.6904,  0.6464,  0.1252,
         0.6677,  0.7598,  0.6290,  0.2046,  0.0259,  0.8224,  0.2003,
         0.1342,  0.3287,  0.7688,  0.2838,  0.5269,  0.0930,  0.5421,
         0.6456,  0.8223,  0.7358,  0.1065,  0.2029,  0.5717,  0.9278,
         0.9328,  0.8067,  0.1362,  0.4369,  0.5085,  0.8141,  0.3214,
         0.3385,  0.0858,  0.0776,  0.9885,  0.1495,  0.1479,  0.8066,
         0.5543,  0.6041,  0.1244,  0.4239,  0.6396,  0.7514,  0.1197,
         0.2450,  0.8469,  0.2204,  0.6443,  0.8219,  0.0770,  0.8990,
         0.3435,  0.5188,  0.5638,  0.0518,  0.8427,  0.8524,  0.6640,
         0.3516,  0.2145,  0.9324,  0.1631,  0.6771,  0.2356,  0.0681,
         0.1781,  0.9215,  0.8651,  0.6841,  0.3715,  0.4892,  0.6900,
         0.8430,  0.2823,  0.8167,  0.1172,  0.4043,  0.1520,  0.1121,
         0.8915,  0.0543,  0.1215,  0.2417,  0.5877,  0.1320,  0.8396,
         0.2291,  0.2925,  0.4222,  0.1568,  0.7688,  0.1810,  0.8311,
         0.1427,  0.3231,  0.4635,  0.6342,  0.8451,  0.4241,  0.4802,
         0.4189,  0.2148,  0.4847,  0.8471,  0.4216,  0.6812,  0.1532,
         0.1054,  0.8855,  0.1888,  0.1364,  0.8229,  0.7594,  0.1134,
         0.8669,  0.0275,  0.9372,  0.1159,  0.2873,  0.4170,  0.5487,
         0.2937,  0.8160,  0.7346,  0.3972,  0.7498,  0.2646,  0.8302,
         0.7888,  0.1123,  0.9312,  0.6862,  0.8301,  0.2848,  0.1502,
         0.0997,  0.3221,  0.8701,  0.3035,  0.4949,  0.2485,  0.4811,
         0.6811,  0.9276,  0.4677,  0.6610,  0.0466,  0.3629,  0.1623,
         0.6345,  0.0139,  0.0755,  0.7998,  0.0806,  0.5943,  0.8595,
         0.3204,  0.7155,  0.7348,  0.9710,  0.0635,  0.5072,  0.8607,
         0.3698,  0.1935,  0.1052,  0.7815,  0.7344,  0.0279,  0.0733,
         0.8260,  0.3375,  0.1608,  0.3373,  0.2415,  0.6803,  0.4636,
         0.9278,  0.0845,  0.7692,  0.3788,  0.8921,  0.6787,  0.1742,
         0.1279,  0.7759,  0.0659,  0.5593,  0.2734,  0.8628,  0.9340,
         0.7038,  0.8974,  0.4401,  0.9069,  0.1541,  0.1120,  0.3456,
         0.0940,  0.7936,  0.7268,  0.7828,  0.0360,  0.6220,  0.1416,
         0.9650,  0.7892,  0.0416,  0.0557,  0.9490,  0.0495,  0.9285,
         0.1165,  0.1861,  0.8179,  0.7379,  0.8264,  0.9249,  0.2453,
         0.9268,  0.6057,  0.3386,  0.9641,  0.7592,  0.4421,  0.7503,
         0.1926,  0.3637,  0.0947,  0.1273,  0.3060,  0.8328,  0.8747,
         0.8704,  0.3262,  0.6153,  0.7269,  0.7916,  0.7629,  0.7265,
         0.6643,  0.6131,  0.3856,  0.1400,  0.1464,  0.9097,  0.8431,
         0.7227,  0.3216,  0.8264,  0.2704,  0.9577,  0.2589,  0.8843,
         0.3507,  0.5799,  0.4746,  0.1089,  0.2975,  0.1973,  0.1216,
         0.6384,  0.9869,  0.0650,  0.9280,  0.2691,  0.8239,  0.6275,
         0.9190,  0.1061,  0.1226,  0.1862,  0.5980,  0.1545,  0.2826,
         0.9961,  0.1470,  0.8964,  0.0753,  0.1471,  0.7353,  0.4806,
         0.1733,  0.8254,  0.1893,  0.8763,  0.7652,  0.0938,  0.8815,
         0.8285,  0.8070,  0.0881,  0.8402,  0.3567,  0.7563,  0.7812,
         0.6231], device='cuda:0')
tensor(0.4184, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4399,  0.8418,  0.7856,  0.1576,  0.1236,  0.1877,  0.1001,
         0.9505,  0.1668,  0.1062,  0.9082,  0.8878,  0.9418,  0.8743,
         0.0655,  0.9770,  0.5295,  0.1765,  0.5727,  0.4059,  0.5014,
         0.4506,  0.1531,  0.1783,  0.2196,  0.9277,  0.2599,  0.5003,
         0.7367,  0.3103,  0.4916,  0.3797,  0.9823,  0.0217,  0.6117,
         0.9464,  0.0191,  0.7586,  0.0667,  0.4347,  0.3325,  0.2259,
         0.1532,  0.7695,  0.2105,  0.1733,  0.0623,  0.0780,  0.1245,
         0.1314,  0.0114,  0.1081,  0.1187,  0.3022,  0.6463,  0.5424,
         0.6407,  0.6228,  0.8339,  0.3492,  0.8142,  0.2566,  0.7173,
         0.6338,  0.1991,  0.6546,  0.0628,  0.4526,  0.1959,  0.9575,
         0.2347,  0.1340,  0.3564,  0.0565,  0.1079,  0.0882,  0.7537,
         0.0635,  0.1340,  0.8600,  0.5330,  0.4005,  0.7926,  0.3091,
         0.3791,  0.7673,  0.0865,  0.4202,  0.1338,  0.8898,  0.0566,
         0.8423,  0.3291,  0.0460,  0.2204,  0.0205,  0.3018,  0.1852,
         0.4194,  0.8718,  0.8636,  0.1281,  0.0569,  0.2867,  0.2483,
         0.8150,  0.0452,  0.8560,  0.4065,  0.0837,  0.7482,  0.4243,
         0.2691,  0.7888,  0.0658,  0.7301,  0.1583,  0.1893,  0.8472,
         0.7070,  0.4016,  0.4268,  0.0746,  0.7954,  0.7947,  0.0727,
         0.6388,  0.8629,  0.8918,  0.2844,  0.3170,  0.0903,  0.1273,
         0.8396,  0.5003,  0.3049,  0.8851,  0.1279,  0.3647,  0.3636,
         0.0825,  0.2524,  0.4744,  0.0082,  0.9431,  0.0725,  0.6273,
         0.1726,  0.1515,  0.0745,  0.1450,  0.0137,  0.1260,  0.1407,
         0.5507,  0.8374,  0.6295,  0.1634,  0.7376,  0.8263,  0.1126,
         0.3637,  0.7253,  0.3475,  0.4655,  0.6624,  0.1042,  0.1387,
         0.1875,  0.0361,  0.7315,  0.0196,  0.7716,  0.7970,  0.2061,
         0.3347,  0.3737,  0.5042,  0.6685,  0.0149,  0.1590,  0.4419,
         0.0127,  0.0261,  0.0840,  0.0549,  0.0660,  0.0986,  0.6599,
         0.0484,  0.1424,  0.6625,  0.0746,  0.8147,  0.8551,  0.7993,
         0.0981,  0.0342,  0.1917,  0.1476,  0.0633,  0.6761,  0.9154,
         0.1303,  0.0966,  0.8242,  0.0630,  0.2587,  0.1106,  0.0245,
         0.2005,  0.1426,  0.2378,  0.1250,  0.2501,  0.0547,  0.3696,
         0.6640,  0.7758,  0.1343,  0.0960,  0.1332,  0.3713,  0.5849,
         0.1726,  0.9211,  0.5055,  0.8293,  0.1286,  0.4039,  0.2462,
         0.7052,  0.0479,  0.9586,  0.1170,  0.2564,  0.1055,  0.0724,
         0.0782,  0.2229,  0.2371,  0.2537,  0.1313,  0.4626,  0.7275,
         0.0596,  0.0803,  0.5613,  0.0319,  0.1640,  0.7359,  0.7736,
         0.8312,  0.7610,  0.8664,  0.2298,  0.6789,  0.0754,  0.2935,
         0.1372,  0.1150,  0.7019,  0.3010,  0.1021,  0.8421,  0.2355,
         0.0667,  0.3929,  0.1246,  0.0406,  0.1149,  0.7472,  0.0565,
         0.0992,  0.4834,  0.1660,  0.0327,  0.5793,  0.2814,  0.4021,
         0.6131,  0.2746,  0.6695,  0.1042,  0.7869,  0.1073,  0.2500,
         0.6166,  0.3485,  0.7880,  0.0859,  0.3148,  0.6275,  0.8485,
         0.7101,  0.1047,  0.4302,  0.4708,  0.5959,  0.0633,  0.3005,
         0.1063,  0.1343,  0.1847,  0.5656,  0.1162,  0.0975,  0.0311,
         0.5548,  0.1445,  0.1984,  0.6817,  0.0709,  0.1186,  0.1439,
         0.0519,  0.0183,  0.2395,  0.2911,  0.1386,  0.7541,  0.2480,
         0.2216,  0.4890,  0.2377,  0.5801,  0.2267,  0.7995,  0.0378,
         0.1414,  0.0900,  0.0462,  0.5480,  0.9364,  0.3225,  0.7974,
         0.0546,  0.0952,  0.6358,  0.0821,  0.3958,  0.4484,  0.2297,
         0.1570,  0.1540,  0.3376,  0.0969,  0.7586,  0.1432,  0.0312,
         0.5849,  0.5485,  0.6682,  0.8709,  0.8909,  0.3088,  0.6889,
         0.1238,  0.8077,  0.9834,  0.2116,  0.4427,  0.0084,  0.0632,
         0.2056,  0.0109,  0.0412,  0.8297,  0.8211,  0.2885,  0.8779,
         0.5500,  0.1887,  0.0444,  0.3091,  0.7985,  0.2512,  0.9185,
         0.0260,  0.1646,  0.8275,  0.8278,  0.6786,  0.7403,  0.0141,
         0.0380,  0.1255,  0.7416,  0.1576,  0.7611,  0.0618,  0.3467,
         0.0786,  0.0877,  0.1149,  0.8627,  0.6776,  0.3280,  0.8355,
         0.1204,  0.7358,  0.0309,  0.2136,  0.6146,  0.3612,  0.4820,
         0.2356,  0.4384,  0.2528,  0.8392,  0.2219,  0.8689,  0.8612,
         0.7090,  0.8308,  0.4001,  0.5212,  0.9096,  0.0893,  0.9692,
         0.0725,  0.2493,  0.6471,  0.8185,  0.0710,  0.8295,  0.4042,
         0.0419,  0.0680,  0.6607,  0.1584,  0.1029,  0.0459,  0.2874,
         0.0588,  0.1687,  0.0584,  0.3756,  0.0511,  0.6879,  0.0152,
         0.5086,  0.2208,  0.0517,  0.3780,  0.3053,  0.4547,  0.6328,
         0.8554,  0.1664,  0.6789,  0.3778,  0.1851,  0.0444,  0.3264,
         0.0455,  0.1357,  0.3170,  0.2149,  0.3408,  0.6481,  0.0742,
         0.2440,  0.7441,  0.1062,  0.1259,  0.8862,  0.2352,  0.0778,
         0.1631,  0.0822,  0.6999,  0.0473,  0.1688,  0.2669,  0.0349,
         0.6394,  0.3405,  0.0395,  0.5091,  0.0442,  0.0297,  0.1508,
         0.1181,  0.0849,  0.2844,  0.4746,  0.1172,  0.3966,  0.0376,
         0.1032,  0.1144,  0.7851,  0.8589,  0.8638,  0.2733,  0.7642,
         0.9018,  0.8603,  0.1159,  0.9953,  0.1512,  0.2472,  0.8430,
         0.2744,  0.5531,  0.0258,  0.4940,  0.6013,  0.2217,  0.4739,
         0.1368], device='cuda:0')
tensor(0.4855, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6827,  0.3645,  0.0718,  0.7655,  0.0075,  0.6161,  0.8543,
         0.2412,  0.2139,  0.0834,  0.2067,  0.0606,  0.3815,  0.0535,
         0.3568,  0.7384,  0.0765,  0.1159,  0.7955,  0.2878,  0.7983,
         0.1279,  0.1389,  0.7847,  0.0287,  0.6171,  0.0701,  0.0670,
         0.7128,  0.5841,  0.1858,  0.0338,  0.3846,  0.3073,  0.7019,
         0.6892,  0.0844,  0.2044,  0.1422,  0.2023,  0.6054,  0.3905,
         0.4407,  0.8898,  0.0577,  0.1507,  0.6395,  0.0898,  0.0413,
         0.1107,  0.0456,  0.2988,  0.2413,  0.1307,  0.4810,  0.2710,
         0.9062,  0.2908,  0.1258,  0.3742,  0.0280,  0.8626,  0.0796,
         0.9187,  0.0930,  0.5237,  0.0593,  0.8758,  0.1566,  0.7885,
         0.2692,  0.7379,  0.0793,  0.0326,  0.6043,  0.0797,  0.0291,
         0.7158,  0.1280,  0.2500,  0.2885,  0.8748,  0.6804,  0.1312,
         0.3982,  0.8234,  0.3733,  0.5770,  0.0055,  0.1610,  0.9122,
         0.8978,  0.6685,  0.0858,  0.4379,  0.4363,  0.7486,  0.2143,
         0.9183,  0.6772,  0.0473,  0.4663,  0.4646,  0.0526,  0.1069,
         0.0647,  0.7335,  0.0462,  0.1882,  0.1474,  0.0281,  0.8342,
         0.2548,  0.1371,  0.0313,  0.5115,  0.5790,  0.0743,  0.7876,
         0.1533,  0.7064,  0.5910,  0.8496,  0.0662,  0.0450,  0.8537,
         0.0257,  0.1255,  0.7761,  0.2856,  0.0550,  0.2454,  0.6334,
         0.1971,  0.1926,  0.2607,  0.1125,  0.0330,  0.0478,  0.6768,
         0.8068,  0.1021,  0.0281,  0.2712,  0.0605,  0.0615,  0.0985,
         0.0610,  0.1060,  0.0289,  0.9183,  0.0923,  0.0138,  0.6143,
         0.9768,  0.0754,  0.1004,  0.1344,  0.1290,  0.1978,  0.1893,
         0.1289,  0.0199,  0.3318,  0.7221,  0.4039,  0.1280,  0.8132,
         0.1305,  0.2133,  0.9121,  0.0487,  0.0235,  0.0252,  0.1354,
         0.0383,  0.0184,  0.1960,  0.7764,  0.8762,  0.2442,  0.7067,
         0.8396,  0.1894,  0.1113,  0.5778,  0.5120,  0.1168,  0.1047,
         0.3963,  0.6439,  0.9270,  0.1185,  0.1680,  0.2472,  0.0385,
         0.5587,  0.7972,  0.4737,  0.1093,  0.0648,  0.8361,  0.9567,
         0.1162,  0.4872,  0.1063,  0.8072,  0.1033,  0.7657,  0.8486,
         0.0690,  0.6421,  0.2061,  0.8527,  0.3428,  0.7592,  0.3181,
         0.0357,  0.1827,  0.1916,  0.1602,  0.8129,  0.0478,  0.0593,
         0.2935,  0.7525,  0.0605,  0.3625,  0.0572,  0.9966,  0.0255,
         0.1253,  0.6114,  0.9961,  0.1436,  0.2316,  0.1370,  0.1193,
         0.6618,  0.1543,  0.0799,  0.9709,  0.0235,  0.0708,  0.4911,
         0.2873,  0.5521,  0.2140,  0.5548,  0.6256,  0.4369,  0.0879,
         0.4080,  0.2582,  0.9634,  0.8791,  0.0674,  0.8321,  0.1514,
         0.0856,  0.8209,  0.9718,  0.0314,  0.6279,  0.7333,  0.0170,
         0.6703,  0.1169,  0.0470,  0.1124,  0.2649,  0.6595,  0.8854,
         0.0290,  0.8083,  0.2186,  0.2408,  0.3135,  0.0652,  0.7668,
         0.4844,  0.0575,  0.8359,  0.1853,  0.7007,  0.7026,  0.3060,
         0.2040,  0.1087,  0.7868,  0.0949,  0.4215,  0.1069,  0.0793,
         0.8340,  0.0919,  0.1729,  0.1917,  0.8832,  0.1459,  0.9204,
         0.1113,  0.0454,  0.7786,  0.0887,  0.3571,  0.1706,  0.2777,
         0.7298,  0.0515,  0.2262,  0.0419,  0.0671,  0.7657,  0.7824,
         0.8025,  0.2145,  0.9941,  0.7551,  0.6778,  0.0566,  0.1318,
         0.3471,  0.8980,  0.0224,  0.5972,  0.4201,  0.4186,  0.8165,
         0.0533,  0.8992,  0.0573,  0.0842,  0.2189,  0.2316,  0.0256,
         0.6343,  0.7682,  0.0159,  0.5593,  0.0118,  0.6421,  0.4410,
         0.0722,  0.4502,  0.9099,  0.9792,  0.0445,  0.9211,  0.0979,
         0.4834,  0.0902,  0.3020,  0.1432,  0.1243,  0.0468,  0.1016,
         0.8087,  0.8563,  0.1292,  0.2225,  0.0427,  0.0354,  0.0748,
         0.0224,  0.6363,  0.8845,  0.0790,  0.9560,  0.1152,  0.3984,
         0.2055,  0.1358,  0.4691,  0.0237,  0.0906,  0.0685,  0.0606,
         0.4261,  0.0102,  0.8013,  0.9593,  0.7362,  0.0906,  0.9471,
         0.8169,  0.2513,  0.0302,  0.0693,  0.5401,  0.7580,  0.1918,
         0.0431,  0.0198,  0.2294,  0.6173,  0.9458,  0.7898,  0.0382,
         0.5216,  0.2764,  0.4011,  0.3459,  0.6991,  0.8739,  0.4648,
         0.7887,  0.7044,  0.4077,  0.2861,  0.2801,  0.4125,  0.3283,
         0.9196,  0.8536,  0.0477,  0.9746,  0.5180,  0.9278,  0.1314,
         0.4323,  0.3851,  0.2894,  0.6061,  0.6664,  0.6188,  0.3908,
         0.8495,  0.0554,  0.0501,  0.0230,  0.3207,  0.1682,  0.0194,
         0.6194,  0.8366,  0.0323,  0.7499,  0.8202,  0.3949,  0.5547,
         0.2315,  0.3342,  0.7431,  0.7887,  0.0288,  0.1854,  0.7058,
         0.1391,  0.0461,  0.3593,  0.7090,  0.0192,  0.1067,  0.0893,
         0.8293,  0.8037,  0.1248,  0.0171,  0.0624,  0.0531,  0.7654,
         0.8143,  0.9041,  0.1495,  0.7155,  0.0488,  0.0280,  0.8148,
         0.8608,  0.6264,  0.5303,  0.0347,  0.0576,  0.0330,  0.6287,
         0.1661,  0.0705,  0.2733,  0.1994,  0.0325,  0.1863,  0.4300,
         0.5223,  0.7302,  0.1663,  0.2224,  0.8255,  0.0944,  0.0994,
         0.3455,  0.5721,  0.0656,  0.9760,  0.4746,  0.8788,  0.3199,
         0.1098,  0.1389,  0.0745,  0.0913,  0.0759,  0.0863,  0.5821,
         0.8582,  0.1100,  0.0206,  0.0776,  0.8731,  0.2644,  0.0905,
         0.1837], device='cuda:0')
tensor(0.4644, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2422,  0.0986,  0.9779,  0.2906,  0.1745,  0.9106,  0.9040,
         0.0155,  0.7227,  0.1674,  0.3392,  0.0496,  0.9386,  0.3674,
         0.8636,  0.1368,  0.1228,  0.1403,  0.6399,  0.1206,  0.8099,
         0.6893,  0.9067,  0.0806,  0.5580,  0.0335,  0.4967,  0.0533,
         0.2786,  0.5121,  0.0997,  0.1637,  0.1552,  0.9082,  0.0136,
         0.0649,  0.0204,  0.3192,  0.5161,  0.7327,  0.2420,  0.1473,
         0.0545,  0.5217,  0.5599,  0.0827,  0.0340,  0.1357,  0.1256,
         0.6894,  0.0609,  0.2845,  0.6230,  0.0690,  0.1958,  0.5672,
         0.1156,  0.4146,  0.0806,  0.6139,  0.1364,  0.7725,  0.9351,
         0.8098,  0.0818,  0.6779,  0.1672,  0.2043,  0.5433,  0.4475,
         0.0593,  0.2751,  0.9177,  0.0448,  0.6774,  0.8064,  0.2668,
         0.2728,  0.4452,  0.2090,  0.4699,  0.1237,  0.6539,  0.1157,
         0.4930,  0.1107,  0.0434,  0.6980,  0.5763,  0.8444,  0.8360,
         0.5266,  0.6837,  0.9950,  0.9830,  0.4055,  0.4222,  0.2352,
         0.1370,  0.8375,  0.0345,  0.0233,  0.8502,  0.1089,  0.1587,
         0.6337,  0.0354,  0.8344,  0.0414,  0.1675,  0.0800,  0.7957,
         0.0650,  0.8660,  0.5735,  0.1563,  0.1104,  0.3709,  0.5570,
         0.6801,  0.1054,  0.2027,  0.9228,  0.6039,  0.6260,  0.0504,
         0.1287,  0.0132,  0.5746,  0.2279,  0.7851,  0.0599,  0.2139,
         0.7356,  0.3354,  0.0670,  0.9062,  0.3316,  0.7354,  0.0510,
         0.1753,  0.0283,  0.6604,  0.7434,  0.0894,  0.3526,  0.3114,
         0.0891,  0.2797,  0.9161,  0.0798,  0.7363,  0.5989,  0.0830,
         0.0668,  0.3099,  0.9432,  0.9096,  0.1203,  0.1616,  0.8041,
         0.1167,  0.3522,  0.8164,  0.8366,  0.0757,  0.9597,  0.1575,
         0.7000,  0.1876,  0.6286,  0.6808,  0.2112,  0.3399,  0.3615,
         0.7010,  0.5292,  0.8986,  0.4089,  0.0874,  0.0527,  0.1864,
         0.2873,  0.3681,  0.8517,  0.6020,  0.6838,  0.8604,  0.7084,
         0.6603,  0.0892,  0.6126,  0.1245,  0.4865,  0.2613,  0.0605,
         0.0547,  0.4273,  0.0585,  0.2055,  0.8809,  0.2569,  0.3524,
         0.9395,  0.1419,  0.1686,  0.4497,  0.7191,  0.2244,  0.1233,
         0.5653,  0.4936,  0.6351,  0.0274,  0.0742,  0.9237,  0.7029,
         0.7255,  0.4513,  0.3926,  0.0487,  0.3126,  0.1264,  0.5119,
         0.6928,  0.7113,  0.1569,  0.7851,  0.9911,  0.8900,  0.8483,
         0.0693,  0.2785,  0.5482,  0.2282,  0.8492,  0.1594,  0.3572,
         0.1431,  0.8797,  0.2215,  0.7580,  0.7759,  0.3144,  0.3138,
         0.5803,  0.9123,  0.6239,  0.7677,  0.6526,  0.9555,  0.1603,
         0.0192,  0.5063,  0.1319,  0.5364,  0.2196,  0.6151,  0.0349,
         0.8902,  0.1338,  0.2620,  0.7662,  0.3762,  0.2224,  0.1087,
         0.8787,  0.0509,  0.8375,  0.3830,  0.0723,  0.5427,  0.0535,
         0.1432,  0.8765,  0.3734,  0.7299,  0.1456,  0.1976,  0.1461,
         0.6877,  0.9827,  0.5324,  0.4187,  0.6360,  0.7775,  0.0490,
         0.1164,  0.1351,  0.1695,  0.0286,  0.0899,  0.2374,  0.6013,
         0.6066,  0.3661,  0.8487,  0.1860,  0.8922,  0.3326,  0.9114,
         0.0492,  0.1776,  0.2731,  0.0914,  0.0209,  0.8396,  0.0438,
         0.9962,  0.3388,  0.3537,  0.9749,  0.3837,  0.2385,  0.2559,
         0.3603,  0.3749,  0.1705,  0.9377,  0.6811,  0.3618,  0.8308,
         0.1393,  0.9082,  0.5946,  0.1780,  0.1293,  0.2235,  0.1680,
         0.9499,  0.0249,  0.1245,  0.1332,  0.4084,  0.0522,  0.2399,
         0.0295,  0.0456,  0.6288,  0.2054,  0.6635,  0.1675,  0.9959,
         0.0803,  0.9899,  0.8007,  0.2224,  0.0285,  0.0864,  0.1198,
         0.0916,  0.6622,  0.0950,  0.0651,  0.4261,  0.2090,  0.8004,
         0.7217,  0.2129,  0.3737,  0.2349,  0.6263,  0.0685,  0.0865,
         0.6497,  0.0976,  0.5548,  0.8037,  0.0338,  0.3066,  0.0604,
         0.5871,  0.0340,  0.0960,  0.8853,  0.1573,  0.8496,  0.3224,
         0.9392,  0.6399,  0.0647,  0.1284,  0.5200,  0.4966,  0.0410,
         0.6234,  0.1651,  0.0593,  0.2220,  0.1840,  0.1576,  0.7087,
         0.7479,  0.6669,  0.7812,  0.0143,  0.1795,  0.1312,  0.9128,
         0.1198,  0.8674,  0.5369,  0.4183,  0.1280,  0.0521,  0.8101,
         0.0697,  0.4296,  0.0708,  0.2670,  0.6473,  0.8647,  0.9709,
         0.6828,  0.1076,  0.6303,  0.2727,  0.8462,  0.0434,  0.0526,
         0.7942,  0.3416,  0.0132,  0.9009,  0.6123,  0.0466,  0.9612,
         0.3712,  0.0228,  0.8631,  0.8821,  0.0884,  0.0645,  0.7769,
         0.6851,  0.2018,  0.8163,  0.1229,  0.3795,  0.3784,  0.2342,
         0.8178,  0.4569,  0.4302,  0.3750,  0.0598,  0.2649,  0.0328,
         0.1062,  0.4393,  0.1024,  0.8242,  0.1479,  0.8391,  0.1505,
         0.6429,  0.7010,  0.7774,  0.9628,  0.2179,  0.0119,  0.8628,
         0.0525,  0.2911,  0.4268,  0.6491,  0.0957,  0.4134,  0.8398,
         0.3803,  0.0273,  0.9155,  0.0266,  0.1287,  0.5054,  0.1639,
         0.0578,  0.8197,  0.3048,  0.5045,  0.9388,  0.1856,  0.3839,
         0.7957,  0.1601,  0.2717,  0.7712,  0.0069,  0.0969,  0.9078,
         0.8840,  0.9675,  0.5046,  0.0439,  0.6075,  0.6222,  0.8776,
         0.3621,  0.0892,  0.1408,  0.3964,  0.1920,  0.6130,  0.6375,
         0.9507,  0.5272,  0.7186,  0.8778,  0.5487,  0.1506,  0.8965,
         0.5291], device='cuda:0')
tensor(0.4332, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7989,  0.5740,  0.7852,  0.9251,  0.6347,  0.8305,  0.9627,
         0.1731,  0.8596,  0.9492,  0.8839,  0.7256,  0.2294,  0.7401,
         0.3820,  0.3663,  0.6243,  0.9978,  0.2037,  0.1390,  0.0166,
         0.5570,  0.0956,  0.4630,  0.4414,  0.2311,  0.2918,  0.8623,
         0.9151,  0.6723,  0.2961,  0.1343,  0.8386,  0.4518,  0.8666,
         0.8830,  0.2572,  0.1723,  0.0912,  0.4304,  0.8918,  0.1102,
         0.7861,  0.4538,  0.3355,  0.1848,  0.7409,  0.5588,  0.9858,
         0.1127,  0.8571,  0.9035,  0.0782,  0.1895,  0.2128,  0.8548,
         0.8804,  0.9106,  0.2377,  0.5384,  0.1415,  0.8382,  0.0687,
         0.9343,  0.4189,  0.4910,  0.0568,  0.7904,  0.6789,  0.8030,
         0.8647,  0.9919,  0.8864,  0.1720,  0.7651,  0.6606,  0.2527,
         0.4551,  0.8650,  0.6037,  0.7934,  0.2333,  0.7806,  0.9358,
         0.7593,  0.0951,  0.8715,  0.0829,  0.2929,  0.2634,  0.1340,
         0.0610,  0.9418,  0.1775,  0.9563,  0.4445,  0.8938,  0.6483,
         0.7281,  0.4626,  0.7653,  0.1448,  0.7691,  0.1459,  0.7814,
         0.7026,  0.5531,  0.6090,  0.5302,  0.7677,  0.3543,  0.8896,
         0.1803,  0.2239,  0.3231,  0.8198,  0.3938,  0.5095,  0.8235,
         0.0622,  0.7728,  0.4434,  0.8725,  0.1877,  0.2602,  0.7370,
         0.7864,  0.8372,  0.2740,  0.3457,  0.9591,  0.0781,  0.4039,
         0.3657,  0.7776,  0.3280,  0.6922,  0.9164,  0.8735,  0.8908,
         0.7712,  0.7803,  0.2423,  0.1802,  0.0778,  0.1561,  0.8573,
         0.7980,  0.6867,  0.3615,  0.9809,  0.9755,  0.9861,  0.7271,
         0.1493,  0.8374,  0.8692,  0.4694,  0.5792,  0.6264,  0.8951,
         0.3843,  0.1492,  0.7187,  0.0780,  0.3507,  0.2547,  0.0293,
         0.6193,  0.7218,  0.6922,  0.8298,  0.2967,  0.6564,  0.2943,
         0.1423,  0.1794,  0.9040,  0.4346,  0.8392,  0.8920,  0.1707,
         0.3875,  0.9072,  0.4218,  0.6576,  0.2002,  0.4291,  0.8903,
         0.4400,  0.1917,  0.8221,  0.3245,  0.5783,  0.7485,  0.8923,
         0.1203,  0.8648,  0.4733,  0.0670,  0.5974,  0.1878,  0.6152,
         0.6652,  0.7463,  0.9843,  0.4057,  0.4926,  0.8303,  0.2163,
         0.1064,  0.9830,  0.2338,  0.8615,  0.7484,  0.0215,  0.1550,
         0.4028,  0.9672,  0.4511,  0.2465,  0.1173,  0.8076,  0.0787,
         0.9699,  0.8436,  0.9453,  0.7326,  0.0742,  0.8124,  0.1494,
         0.9743,  0.7759,  0.8824,  0.3222,  0.8852,  0.3316,  0.1409,
         0.1366,  0.8727,  0.1074,  0.4905,  0.1120,  0.3794,  0.6596,
         0.7978,  0.0480,  0.1880,  0.9329,  0.9075,  0.2467,  0.2723,
         0.7394,  0.9865,  0.3541,  0.1491,  0.7123,  0.0456,  0.4126,
         0.3902,  0.5274,  0.0571,  0.3108,  0.8083,  0.1930,  0.9541,
         0.0243,  0.9036,  0.8883,  0.1743,  0.1624,  0.4107,  0.5359,
         0.8615,  0.3634,  0.8569,  0.7739,  0.7961,  0.8494,  0.0994,
         0.3393,  0.0182,  0.8412,  0.1199,  0.7195,  0.9082,  0.9596,
         0.1539,  0.8891,  0.1552,  0.6314,  0.0448,  0.8032,  0.4286,
         0.8415,  0.2774,  0.7842,  0.8555,  0.6447,  0.3640,  0.4973,
         0.5778,  0.4471,  0.7479,  0.3151,  0.9683,  0.0300,  0.2011,
         0.0866,  0.8412,  0.7757,  0.6084,  0.4092,  0.2962,  0.7557,
         0.2008,  0.8332,  0.6879,  0.3162,  0.3311,  0.6308,  0.2437,
         0.8946,  0.0934,  0.5371,  0.8449,  0.9027,  0.4488,  0.7187,
         0.8850,  0.6988,  0.2994,  0.1732,  0.9096,  0.0879,  0.2239,
         0.7187,  0.1989,  0.6451,  0.8971,  0.6681,  0.7150,  0.1908,
         0.1188,  0.4519,  0.6546,  0.9173,  0.1368,  0.8046,  0.6101,
         0.4594,  0.2938,  0.7695,  0.8064,  0.0357,  0.9211,  0.7528,
         0.1333,  0.9338,  0.2861,  0.4887,  0.9846,  0.2523,  0.7667,
         0.3059,  0.8329,  0.6479,  0.4512,  0.8404,  0.0978,  0.8928,
         0.3971,  0.1448,  0.4047,  0.1288,  0.7315,  0.2166,  0.7207,
         0.8830,  0.6429,  0.5393,  0.1775,  0.7008,  0.3839,  0.4878,
         0.6187,  0.8326,  0.8838,  0.0334,  0.4031,  0.9333,  0.0366,
         0.8274,  0.8795,  0.7240,  0.8207,  0.1403,  0.2344,  0.5480,
         0.1117,  0.7153,  0.2555,  0.0667,  0.4315,  0.2452,  0.8562,
         0.9250,  0.8610,  0.0799,  0.7531,  0.5352,  0.2985,  0.0917,
         0.8199,  0.6604,  0.5323,  0.2025,  0.5898,  0.1031,  0.9015,
         0.3680,  0.1625,  0.1386,  0.7274,  0.6677,  0.1691,  0.0293,
         0.2769,  0.7537,  0.4538,  0.7714,  0.1942,  0.1672,  0.4659,
         0.8564,  0.9606,  0.6984,  0.0242,  0.0598,  0.7059,  0.3396,
         0.1662,  0.9376,  0.2656,  0.5828,  0.3810,  0.3029,  0.2582,
         0.7930,  0.7034,  0.1671,  0.0641,  0.0149,  0.3550,  0.6967,
         0.7792,  0.1621,  0.8738,  0.8153,  0.0704,  0.9086,  0.0536,
         0.0068,  0.8589,  0.6171,  0.9304,  0.7007,  0.1853,  0.4628,
         0.4586,  0.7742,  0.6352,  0.3034,  0.5278,  0.8909,  0.5238,
         0.1709,  0.8603,  0.6154,  0.7239,  0.8232,  0.8717,  0.9273,
         0.9130,  0.8088,  0.2334,  0.9364,  0.3267,  0.2873,  0.6540,
         0.6778,  0.6744,  0.5941,  0.6508,  0.1570,  0.2709,  0.5443,
         0.9787,  0.7524,  0.4479,  0.8334,  0.2305,  0.4183,  0.7782,
         0.8330,  0.5033,  0.9261,  0.3497,  0.2837,  0.5536,  0.8927,
         0.2411], device='cuda:0')
tensor(0.4298, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8838,  0.7099,  0.3817,  0.8888,  0.8500,  0.2733,  0.3687,
         0.1207,  0.5817,  0.7773,  0.5842,  0.3653,  0.2070,  0.7992,
         0.8949,  0.9277,  0.9067,  0.3456,  0.3944,  0.8518,  0.7267,
         0.3957,  0.5152,  0.7821,  0.1430,  0.5069,  0.8013,  0.4580,
         0.9391,  0.7494,  0.7019,  0.5954,  0.8624,  0.8408,  0.4262,
         0.5939,  0.8285,  0.8357,  0.6111,  0.8849,  0.9306,  0.3866,
         0.8316,  0.5045,  0.6559,  0.2898,  0.2529,  0.8289,  0.5213,
         0.2165,  0.7583,  0.8271,  0.2054,  0.7486,  0.0186,  0.1960,
         0.9184,  0.8015,  0.4335,  0.0723,  0.9016,  0.8773,  0.6864,
         0.3126,  0.6108,  0.8671,  0.7794,  0.1977,  0.8311,  0.4181,
         0.6927,  0.8380,  0.7041,  0.7400,  0.9231,  0.4890,  0.7241,
         0.8865,  0.0819,  0.5627,  0.8129,  0.2148,  0.7369,  0.3958,
         0.0642,  0.7884,  0.8771,  0.5842,  0.5499,  0.8754,  0.8873,
         0.8227,  0.9566,  0.8129,  0.8848,  0.1471,  0.8643,  0.1324,
         0.8456,  0.2305,  0.1725,  0.2282,  0.6445,  0.6752,  0.5954,
         0.8858,  0.8332,  0.3682,  0.3292,  0.1116,  0.3868,  0.9548,
         0.5720,  0.8284,  0.8667,  0.9315,  0.6779,  0.1494,  0.5200,
         0.8095,  0.5281,  0.9267,  0.8654,  0.2823,  0.2876,  0.9973,
         0.4667,  0.6839,  0.8913,  0.0251,  0.9669,  0.7893,  0.7574,
         0.4451,  0.7493,  0.8935,  0.8067,  0.6065,  0.2603,  0.6894,
         0.9061,  0.8972,  0.6604,  0.4667,  0.8644,  0.9023,  0.7346,
         0.9065,  0.4405,  0.7597,  0.1330,  0.5608,  0.3676,  0.9322,
         0.8318,  0.8555,  0.0811,  0.9091,  0.8945,  0.4995,  0.5776,
         0.9310,  0.0986,  0.8645,  0.9472,  0.8975,  0.9534,  0.8826,
         0.2613,  0.8644,  0.6620,  0.4719,  0.9480,  0.9705,  0.6733,
         0.4391,  0.5013,  0.1667,  0.7769,  0.9256,  0.8486,  0.8807,
         0.7758,  0.7067,  0.5421,  0.7160,  0.7984,  0.6725,  0.1731,
         0.8191,  0.5615,  0.6586,  0.8151,  0.1017,  0.8764,  0.8473,
         0.0921,  0.5650,  0.5476,  0.7900,  0.7149,  0.8248,  0.8255,
         0.8353,  0.9826,  0.8428,  0.8402,  0.2607,  0.8616,  0.4359,
         0.9000,  0.8882,  0.8144,  0.4675,  0.9334,  0.7711,  0.5256,
         0.6736,  0.6266,  0.8603,  0.8161,  0.1874,  0.8580,  0.1300,
         0.7005,  0.1798,  0.5772,  0.3658,  0.8261,  0.5847,  0.8612,
         0.1508,  0.8297,  0.9946,  0.4883,  0.9471,  0.4743,  0.0371,
         0.8815,  0.5747,  0.9191,  0.8907,  0.9769,  0.9767,  0.7206,
         0.4596,  0.7745,  0.4139,  0.8477,  0.9965,  0.6787,  0.8470,
         0.2370,  0.8714,  0.5511,  0.5754,  0.0659,  0.6493,  0.8750,
         0.8486,  0.4152,  0.7350,  0.1327,  0.8897,  0.4493,  0.0825,
         0.8418,  0.2070,  0.1434,  0.5831,  0.3759,  0.3213,  0.1898,
         0.8831,  0.8008,  0.8914,  0.5977,  0.7890,  0.9285,  0.7162,
         0.4209,  0.5489,  0.0493,  0.7310,  0.9256,  0.9170,  0.6046,
         0.5230,  0.8906,  0.5656,  0.6312,  0.8652,  0.2689,  0.4718,
         0.6761,  0.2070,  0.3455,  0.5956,  0.7085,  0.1883,  0.1680,
         0.8187,  0.7530,  0.5332,  0.4102,  0.9005,  0.8323,  0.9055,
         0.8771,  0.8446,  0.9365,  0.9194,  0.6492,  0.1505,  0.7641,
         0.0459,  0.7703,  0.7496,  0.2392,  0.8769,  0.9060,  0.5404,
         0.2254,  0.0471,  0.8819,  0.5798,  0.2902,  0.8274,  0.3839,
         0.8358,  0.9668,  0.6102,  0.0518,  0.7243,  0.8281,  0.7900,
         0.0084,  0.4451,  0.8389,  0.6454,  0.9636,  0.8612,  0.5688,
         0.8386,  0.8954,  0.7400,  0.2927,  0.1155,  0.8188,  0.8041,
         0.9411,  0.8916,  0.9199,  0.8700,  0.4894,  0.3231,  0.4739,
         0.8808,  0.9390,  0.7703,  0.0548,  0.5107,  0.9363,  0.0085,
         0.3067,  0.8262,  0.8018,  0.1204,  0.8199,  0.8728,  0.7139,
         0.8862,  0.7885,  0.3030,  0.9602,  0.2311,  0.8090,  0.2715,
         0.6513,  0.8153,  0.4411,  0.0442,  0.7635,  0.6806,  0.4689,
         0.8852,  0.9933,  0.0675,  0.3296,  0.3409,  0.1949,  0.1322,
         0.0718,  0.2569,  0.6944,  0.8993,  0.2620,  0.2523,  0.5478,
         0.7802,  0.9474,  0.3083,  0.8899,  0.6708,  0.5951,  0.2462,
         0.7222,  0.7654,  0.7420,  0.6242,  0.9780,  0.1626,  0.2610,
         0.3750,  0.8098,  0.8490,  0.4532,  0.2537,  0.2997,  0.0281,
         0.7537,  0.2558,  0.4742,  0.6355,  0.8605,  0.6514,  0.6288,
         0.0786,  0.5139,  0.5218,  0.2505,  0.4541,  0.4608,  0.8117,
         0.4863,  0.6303,  0.8587,  0.3271,  0.9837,  0.7683,  0.9395,
         0.0919,  0.1281,  0.9135,  0.7700,  0.8690,  0.7144,  0.1841,
         0.9187,  0.6650,  0.9256,  0.1684,  0.1885,  0.9497,  0.8482,
         0.9824,  0.0865,  0.1125,  0.5623,  0.8190,  0.5054,  0.8087,
         0.0665,  0.1802,  0.2387,  0.7486,  0.8215,  0.7629,  0.8976,
         0.7764,  0.1266,  0.2799,  0.8131,  0.8510,  0.0995,  0.8352,
         0.8047,  0.9886,  0.8987,  0.5110,  0.2238,  0.4089,  0.6611,
         0.8468,  0.7902,  0.6516,  0.6732,  0.8826,  0.2435,  0.9595,
         0.9465,  0.8779,  0.0361,  0.9043,  0.4389,  0.6409,  0.7849,
         0.9003,  0.9530,  0.5200,  0.9495,  0.4055,  0.9539,  0.9019,
         0.6358,  0.5561,  0.1940,  0.4121,  0.8570,  0.0417,  0.0907,
         0.8669], device='cuda:0')
tensor(0.4711, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0558,  0.2901,  0.1948,  0.2618,  0.7261,  0.9252,  0.7760,
         0.9174,  0.9365,  0.1744,  0.1407,  0.7321,  0.6468,  0.0338,
         0.8354,  0.9371,  0.1791,  0.9078,  0.7655,  0.7821,  0.1813,
         0.2179,  0.8807,  0.1879,  0.9852,  0.8910,  0.3570,  0.8106,
         0.6576,  0.8690,  0.7090,  0.2987,  0.5019,  0.1928,  0.8952,
         0.9765,  0.8796,  0.4867,  0.0942,  0.8081,  0.8819,  0.1272,
         0.8901,  0.7246,  0.7845,  0.6970,  0.8224,  0.9771,  0.8056,
         0.1210,  0.0607,  0.0791,  0.4169,  0.7548,  0.8310,  0.1165,
         0.7270,  0.8067,  0.0333,  0.6789,  0.0727,  0.8332,  0.7981,
         0.2179,  0.1773,  0.5350,  0.8598,  0.3107,  0.8328,  0.1661,
         0.5308,  0.0394,  0.7608,  0.9641,  0.9481,  0.1474,  0.8294,
         0.7625,  0.8433,  0.7723,  0.9075,  0.7851,  0.8763,  0.8005,
         0.8690,  0.9576,  0.1197,  0.4257,  0.8170,  0.0774,  0.1729,
         0.7282,  0.8999,  0.6754,  0.7322,  0.3455,  0.7956,  0.8368,
         0.9271,  0.4666,  0.0170,  0.1241,  0.3699,  0.2409,  0.2480,
         0.8102,  0.8771,  0.7366,  0.8331,  0.7570,  0.8655,  0.4917,
         0.7226,  0.2830,  0.8785,  0.4963,  0.7685,  0.8758,  0.5372,
         0.4456,  0.8838,  0.5200,  0.8792,  0.7787,  0.2149,  0.8571,
         0.7946,  0.8331,  0.0223,  0.5708,  0.6509,  0.9482,  0.6809,
         0.3928,  0.9138,  0.9668,  0.2909,  0.7340,  0.8785,  0.7761,
         0.2916,  0.8163,  0.7863,  0.6804,  0.8718,  0.2574,  0.0995,
         0.4525,  0.8039,  0.5136,  0.7427,  0.2390,  0.5908,  0.9039,
         0.0929,  0.9439,  0.3095,  0.2933,  0.9830,  0.8510,  0.6713,
         0.5677,  0.6702,  0.9460,  0.7937,  0.7034,  0.1334,  0.0641,
         0.7936,  0.9231,  0.6631,  0.8335,  0.8052,  0.4102,  0.3621,
         0.8395,  0.9298,  0.2577,  0.8615,  0.5513,  0.8163,  0.9294,
         0.8578,  0.7794,  0.3395,  0.5442,  0.6672,  0.9157,  0.8899,
         0.7142,  0.4489,  0.7583,  0.8073,  0.6304,  0.9008,  0.8254,
         0.6737,  0.6839,  0.7993,  0.9834,  0.2734,  0.9565,  0.0844,
         0.5994,  0.7828,  0.8159,  0.9282,  0.3752,  0.2242,  0.1650,
         0.8917,  0.9055,  0.9097,  0.9078,  0.7633,  0.9052,  0.8242,
         0.8687,  0.6553,  0.1964,  0.8036,  0.7343,  0.8677,  0.1660,
         0.9037,  0.8691,  0.9434,  0.8041,  0.7270,  0.9922,  0.9710,
         0.8295,  0.1531,  0.9475,  0.7631,  0.8339,  0.8868,  0.0576,
         0.8387,  0.2382,  0.9809,  0.6987,  0.5838,  0.4730,  0.7715,
         0.8782,  0.4415,  0.7923,  0.4511,  0.0837,  0.7854,  0.2601,
         0.3112,  0.8837,  0.3975,  0.6223,  0.8702,  0.8347,  0.5434,
         0.9009,  0.1676,  0.8278,  0.8408,  0.7814,  0.8945,  0.8201,
         0.8355,  0.8711,  0.8368,  0.3252,  0.8242,  0.8931,  0.7280,
         0.5301,  0.3688,  0.4962,  0.1113,  0.4535,  0.0972,  0.6855,
         0.3572,  0.8119,  0.8106,  0.1278,  0.2856,  0.8621,  0.2053,
         0.0202,  0.2246,  0.7667,  0.9550,  0.0859,  0.7977,  0.9337,
         0.7638,  0.7258,  0.8811,  0.9044,  0.2198,  0.0763,  0.8852,
         0.2432,  0.5730,  0.8208,  0.7188,  0.9509,  0.4203,  0.1551,
         0.8927,  0.2097,  0.8963,  0.8353,  0.8412,  0.2984,  0.8329,
         0.9307,  0.8001,  0.1900,  0.6000,  0.7977,  0.0379,  0.9211,
         0.9886,  0.5651,  0.8698,  0.8108,  0.9145,  0.8904,  0.9558,
         0.1609,  0.3245,  0.9599,  0.7974,  0.8912,  0.9313,  0.2949,
         0.9467,  0.8630,  0.2966,  0.2522,  0.2766,  0.7276,  0.4933,
         0.7747,  0.6131,  0.4608,  0.5305,  0.8698,  0.9368,  0.6945,
         0.8550,  0.9026,  0.1286,  0.7680,  0.8260,  0.6743,  0.6840,
         0.7064,  0.2879,  0.3092,  0.8211,  0.7923,  0.9289,  0.6937,
         0.5584,  0.4384,  0.8979,  0.7746,  0.7870,  0.8325,  0.8945,
         0.8996,  0.1072,  0.7413,  0.2346,  0.3721,  0.6148,  0.7786,
         0.1074,  0.8275,  0.0372,  0.5368,  0.9342,  0.3213,  0.5803,
         0.9478,  0.2362,  0.9757,  0.3610,  0.0296,  0.8647,  0.6306,
         0.5457,  0.1327,  0.4682,  0.3983,  0.0739,  0.9573,  0.6448,
         0.0809,  0.7920,  0.2471,  0.1797,  0.2121,  0.2458,  0.2950,
         0.1119,  0.8046,  0.2045,  0.8208,  0.9193,  0.8009,  0.9360,
         0.1186,  0.9302,  0.6846,  0.5425,  0.9143,  0.5392,  0.0723,
         0.1329,  0.4346,  0.7069,  0.9568,  0.5724,  0.8951,  0.0732,
         0.8692,  0.8895,  0.8769,  0.7267,  0.8698,  0.8831,  0.0923,
         0.8750,  0.7663,  0.7985,  0.7549,  0.8994,  0.7491,  0.7223,
         0.1636,  0.6509,  0.4928,  0.7891,  0.9032,  0.5372,  0.8519,
         0.9212,  0.8282,  0.5436,  0.1158,  0.6824,  0.7815,  0.9681,
         0.8155,  0.8276,  0.6056,  0.6485,  0.7528,  0.5440,  0.9603,
         0.7368,  0.6407,  0.8435,  0.8342,  0.4176,  0.5286,  0.9925,
         0.2371,  0.6609,  0.0389,  0.7396,  0.8992,  0.6254,  0.6774,
         0.9022,  0.3730,  0.5734,  0.5147,  0.8476,  0.7831,  0.3292,
         0.9492,  0.0422,  0.6947,  0.8236,  0.3356,  0.7279,  0.4628,
         0.8886,  0.2486,  0.8399,  0.8254,  0.3207,  0.7471,  0.4023,
         0.3430,  0.8179,  0.1637,  0.4357,  0.8385,  0.2806,  0.4269,
         0.8136,  0.7648,  0.7711,  0.7268,  0.8307,  0.9486,  0.1107,
         0.6048], device='cuda:0')
tensor(0.4894, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0797,  0.8673,  0.8008,  0.7916,  0.2945,  0.0436,  0.1341,
         0.8282,  0.8213,  0.3171,  0.4983,  0.5362,  0.6572,  0.6182,
         0.6876,  0.5894,  0.1651,  0.1075,  0.2135,  0.4201,  0.7706,
         0.2953,  0.9882,  0.8999,  0.0739,  0.3042,  0.1467,  0.3462,
         0.9443,  0.3949,  0.3155,  0.0330,  0.4050,  0.0088,  0.7510,
         0.8520,  0.3228,  0.8341,  0.8727,  0.9144,  0.5891,  0.2021,
         0.7314,  0.4405,  0.8566,  0.5701,  0.3523,  0.5276,  0.8773,
         0.6111,  0.8809,  0.4518,  0.4649,  0.8085,  0.5659,  0.8996,
         0.7304,  0.7958,  0.9033,  0.2838,  0.5502,  0.6573,  0.3512,
         0.8508,  0.8062,  0.8616,  0.9583,  0.6293,  0.1085,  0.8954,
         0.2815,  0.1252,  0.8258,  0.1240,  0.2688,  0.6801,  0.8769,
         0.5982,  0.8663,  0.0356,  0.0875,  0.8341,  0.8810,  0.8233,
         0.9242,  0.6757,  0.8404,  0.7917,  0.5329,  0.8899,  0.2647,
         0.8738,  0.7911,  0.2189,  0.7696,  0.3095,  0.5081,  0.9389,
         0.6087,  0.8637,  0.7217,  0.3751,  0.8736,  0.7736,  0.1750,
         0.8904,  0.9284,  0.8981,  0.1079,  0.8578,  0.0884,  0.6913,
         0.5550,  0.8565,  0.1509,  0.8424,  0.9438,  0.6935,  0.1003,
         0.8373,  0.1359,  0.7980,  0.6043,  0.9935,  0.9451,  0.8669,
         0.8634,  0.0512,  0.1413,  0.8987,  0.9830,  0.9412,  0.6233,
         0.4986,  0.3880,  0.1970,  0.8811,  0.3393,  0.2141,  0.7473,
         0.1922,  0.8148,  0.5416,  0.5230,  0.8771,  0.7144,  0.7551,
         0.4308,  0.6913,  0.0342,  0.0757,  0.9262,  0.8421,  0.1031,
         0.8556,  0.9102,  0.1959,  0.4222,  0.1473,  0.5411,  0.1492,
         0.2718,  0.7942,  0.4180,  0.0343,  0.9209,  0.2166,  0.4342,
         0.0514,  0.2345,  0.1898,  0.8031,  0.5439,  0.6992,  0.5761,
         0.6267,  0.7708,  0.5848,  0.8890,  0.8784,  0.2632,  0.1221,
         0.7557,  0.1199,  0.6451,  0.9505,  0.5766,  0.6628,  0.8251,
         0.9149,  0.6002,  0.0652,  0.7481,  0.7209,  0.4954,  0.2524,
         0.7557,  0.7836,  0.6184,  0.6669,  0.9589,  0.5275,  0.6990,
         0.9104,  0.7782,  0.7488,  0.9936,  0.7195,  0.8315,  0.7195,
         0.8489,  0.7075,  0.4621,  0.9357,  0.3241,  0.8832,  0.3033,
         0.3231,  0.1601,  0.9746,  0.9839,  0.2530,  0.9536,  0.3180,
         0.9033,  0.6848,  0.7848,  0.8417,  0.8846,  0.1546,  0.8066,
         0.0536,  0.5168,  0.8453,  0.4947,  0.5518,  0.0441,  0.7100,
         0.9952,  0.8635,  0.6459,  0.8531,  0.8098,  0.4381,  0.5212,
         0.6271,  0.8762,  0.7441,  0.8137,  0.2931,  0.6020,  0.2726,
         0.6564,  0.3489,  0.1791,  0.7703,  0.6098,  0.8740,  0.7697,
         0.7071,  0.2813,  0.8205,  0.9727,  0.9250,  0.2444,  0.9169,
         0.9193,  0.9491,  0.0721,  0.7394,  0.3605,  0.8431,  0.9832,
         0.7822,  0.9603,  0.6240,  0.7348,  0.7857,  0.3085,  0.1279,
         0.4951,  0.1134,  0.1257,  0.7896,  0.4990,  0.9088,  0.1530,
         0.5534,  0.9033,  0.7079,  0.7673,  0.7656,  0.3630,  0.7439,
         0.8745,  0.0418,  0.3061,  0.1948,  0.0854,  0.3976,  0.0858,
         0.0620,  0.1063,  0.6877,  0.8791,  0.7872,  0.5648,  0.7133,
         0.6443,  0.5881,  0.9668,  0.5601,  0.5490,  0.8768,  0.8455,
         0.1796,  0.0254,  0.5455,  0.7452,  0.1485,  0.8569,  0.8197,
         0.8034,  0.6950,  0.7295,  0.7850,  0.8010,  0.0194,  0.3922,
         0.8621,  0.9954,  0.8597,  0.7098,  0.8525,  0.7824,  0.7676,
         0.7289,  0.9222,  0.6641,  0.2993,  0.4320,  0.0158,  0.3217,
         0.8288,  0.2499,  0.0469,  0.8997,  0.9323,  0.6057,  0.3199,
         0.7174,  0.2534,  0.3431,  0.9378,  0.8303,  0.6937,  0.7419,
         0.7702,  0.8969,  0.9125,  0.3134,  0.5624,  0.6817,  0.6975,
         0.1753,  0.7214,  0.8383,  0.7751,  0.6737,  0.5788,  0.9280,
         0.6866,  0.1663,  0.7033,  0.4836,  0.9442,  0.4810,  0.6941,
         0.2826,  0.8780,  0.9752,  0.7696,  0.8052,  0.3447,  0.9037,
         0.9033,  0.7590,  0.6442,  0.1045,  0.2158,  0.8439,  0.5413,
         0.9582,  0.1978,  0.1235,  0.7439,  0.7679,  0.2678,  0.7551,
         0.4012,  0.0927,  0.3024,  0.9218,  0.2970,  0.2095,  0.0867,
         0.8924,  0.8427,  0.0932,  0.9678,  0.2207,  0.8518,  0.2087,
         0.5347,  0.2057,  0.1243,  0.2370,  0.0379,  0.3237,  0.7955,
         0.3203,  0.2065,  0.7769,  0.9750], device='cuda:0')
tensor(0.4663, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 4, BCELoss: 0.46697952613538624
tensor([ 0.5820,  0.9363,  0.2436,  0.8683,  0.7735,  0.2373,  0.0583,
         0.9878,  0.4722,  0.8463,  0.1009,  0.6181,  0.3946,  0.5365,
         0.0736,  0.6725,  0.3493,  0.3999,  0.2945,  0.0778,  0.4448,
         0.8981,  0.3632,  0.8373,  0.2317,  0.5336,  0.7265,  0.9677,
         0.7067,  0.5992,  0.9220,  0.9425,  0.7138,  0.5927,  0.2073,
         0.1226,  0.8479,  0.8143,  0.0987,  0.1145,  0.5935,  0.7427,
         0.0132,  0.0427,  0.7771,  0.4301,  0.5773,  0.6387,  0.8424,
         0.1126,  0.1693,  0.2033,  0.7013,  0.6114,  0.3975,  0.1793,
         0.9566,  0.7204,  0.9154,  0.9444,  0.2564,  0.6837,  0.8044,
         0.1283,  0.8004,  0.4570,  0.9346,  0.5018,  0.8800,  0.4277,
         0.1802,  0.8113,  0.1222,  0.0622,  0.9938,  0.9854,  0.0945,
         0.2554,  0.1743,  0.2529,  0.2591,  0.9282,  0.6721,  0.0870,
         0.6233,  0.7539,  0.0619,  0.8118,  0.8216,  0.4115,  0.2371,
         0.3268,  0.3352,  0.5596,  0.6358,  0.5460,  0.8672,  0.9396,
         0.1867,  0.1418,  0.6501,  0.1944,  0.3734,  0.9051,  0.5230,
         0.8665,  0.4291,  0.1613,  0.2171,  0.4030,  0.8106,  0.7546,
         0.6470,  0.5594,  0.7534,  0.1680,  0.2719,  0.9754,  0.7961,
         0.7699,  0.4681,  0.9665,  0.7718,  0.0820,  0.0193,  0.3103,
         0.8176,  0.3761,  0.5695,  0.3288,  0.8007,  0.5160,  0.5129,
         0.2121,  0.0300,  0.9536,  0.2690,  0.5390,  0.7514,  0.4260,
         0.1892,  0.3662,  0.8770,  0.6150,  0.4212,  0.2582,  0.1853,
         0.4708,  0.1042,  0.0683,  0.8081,  0.4889,  0.7563,  0.2594,
         0.3285,  0.2767,  0.9299,  0.6261,  0.3055,  0.6321,  0.9261,
         0.9208,  0.5913,  0.8195,  0.7106,  0.5405,  0.5876,  0.7880,
         0.8322,  0.1564,  0.6480,  0.8659,  0.7159,  0.8303,  0.0538,
         0.8682,  0.2890,  0.8576,  0.5201,  0.1801,  0.4241,  0.5717,
         0.9755,  0.9501,  0.8726,  0.0946,  0.8743,  0.9533,  0.4454,
         0.1656,  0.4482,  0.2331,  0.8540,  0.8960,  0.1460,  0.6891,
         0.8670,  0.7909,  0.1856,  0.4555,  0.6335,  0.3622,  0.8095,
         0.8108,  0.2278,  0.7760,  0.4124,  0.2585,  0.7883,  0.8271,
         0.5165,  0.6901,  0.0376,  0.3329,  0.2849,  0.5798,  0.9906,
         0.1467,  0.6512,  0.7865,  0.3032,  0.8895,  0.9562,  0.3001,
         0.0457,  0.8913,  0.2556,  0.8120,  0.5834,  0.8368,  0.9769,
         0.7748,  0.6110,  0.8082,  0.0682,  0.3114,  0.8731,  0.4448,
         0.7111,  0.0925,  0.4485,  0.7992,  0.6114,  0.3381,  0.7396,
         0.8522,  0.0852,  0.0592,  0.6874,  0.9469,  0.3448,  0.9458,
         0.1746,  0.1433,  0.8156,  0.0977,  0.6782,  0.7002,  0.7220,
         0.8094,  0.0755,  0.9121,  0.8551,  0.8427,  0.5488,  0.3011,
         0.9572,  0.1330,  0.7825,  0.2205,  0.2022,  0.1572,  0.1181,
         0.4582,  0.8711,  0.8487,  0.4800,  0.4700,  0.2022,  0.7708,
         0.7045,  0.1017,  0.8926,  0.7276,  0.3448,  0.0852,  0.6845,
         0.4011,  0.4323,  0.8385,  0.5404,  0.3935,  0.7402,  0.4104,
         0.8506,  0.1222,  0.9888,  0.6064,  0.6893,  0.2568,  0.7554,
         0.4051,  0.6173,  0.9002,  0.7694,  0.9495,  0.0910,  0.1981,
         0.4803,  0.8471,  0.5512,  0.5543,  0.9316,  0.8072,  0.4474,
         0.0413,  0.9133,  0.6885,  0.0843,  0.9817,  0.0500,  0.8194,
         0.8081,  0.5513,  0.2366,  0.7974,  0.7668,  0.2512,  0.0984,
         0.8886,  0.3555,  0.1101,  0.0639,  0.3615,  0.0928,  0.5909,
         0.0978,  0.0653,  0.4278,  0.6466,  0.6782,  0.5382,  0.3344,
         0.0473,  0.7938,  0.7699,  0.8744,  0.0682,  0.8562,  0.5507,
         0.4472,  0.8117,  0.8678,  0.6844,  0.1615,  0.2956,  0.7452,
         0.8368,  0.3958,  0.8907,  0.5695,  0.6591,  0.0360,  0.0861,
         0.0105,  0.1202,  0.9840,  0.4683,  0.3139,  0.2131,  0.0711,
         0.4300,  0.4799,  0.5400,  0.2882,  0.4404,  0.4246,  0.7590,
         0.5929,  0.8608,  0.6647,  0.4588,  0.6711,  0.7140,  0.9780,
         0.2080,  0.4143,  0.9920,  0.3346,  0.8545,  0.7175,  0.5832,
         0.1131,  0.1552,  0.7634,  0.6842,  0.5929,  0.2157,  0.7529,
         0.3836,  0.8168,  0.0686,  0.8986,  0.1668,  0.0401,  0.9734,
         0.4845,  0.1971,  0.3418,  0.8342,  0.1264,  0.8780,  0.0839,
         0.6706,  0.5912,  0.3623,  0.9162,  0.0471,  0.1901,  0.5585,
         0.8944,  0.8294,  0.7873,  0.5642,  0.9558,  0.2079,  0.4377,
         0.1083,  0.8131,  0.6797,  0.7450,  0.1710,  0.2551,  0.0354,
         0.4524,  0.7220,  0.8065,  0.6901,  0.2134,  0.7825,  0.8687,
         0.2816,  0.9750,  0.8697,  0.7824,  0.4029,  0.8142,  0.2923,
         0.1136,  0.7199,  0.7874,  0.6656,  0.4965,  0.5289,  0.2172,
         0.6549,  0.7516,  0.9860,  0.8617,  0.4148,  0.5979,  0.6926,
         0.8118,  0.5471,  0.1789,  0.1503,  0.4646,  0.6796,  0.3543,
         0.5466,  0.4906,  0.4246,  0.2152,  0.1056,  0.4546,  0.4466,
         0.4962,  0.3107,  0.8704,  0.9695,  0.5079,  0.6108,  0.1395,
         0.3117,  0.8630,  0.1704,  0.9146,  0.5904,  0.1844,  0.4070,
         0.7155,  0.7802,  0.5022,  0.7948,  0.7298,  0.4981,  0.0924,
         0.1008,  0.5078,  0.3678,  0.3861,  0.3080,  0.6452,  0.1196,
         0.7056,  0.5685,  0.8652,  0.5054,  0.8227,  0.8976,  0.8033,
         0.0815], device='cuda:0')
tensor(0.4457, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0468,  0.0962,  0.0797,  0.3950,  0.0721,  0.6046,  0.9225,
         0.7806,  0.9284,  0.0571,  0.6147,  0.3809,  0.7713,  0.7112,
         0.6640,  0.1122,  0.3833,  0.2888,  0.3317,  0.1239,  0.3586,
         0.8160,  0.6731,  0.7405,  0.1165,  0.5770,  0.6905,  0.6689,
         0.7088,  0.2134,  0.7025,  0.1052,  0.7711,  0.5968,  0.3609,
         0.3365,  0.9359,  0.0180,  0.7085,  0.5734,  0.7358,  0.1182,
         0.2189,  0.2997,  0.1799,  0.1374,  0.5482,  0.1577,  0.7784,
         0.0932,  0.1401,  0.4934,  0.6306,  0.8564,  0.9084,  0.3811,
         0.3856,  0.1967,  0.6809,  0.9388,  0.2594,  0.8329,  0.8910,
         0.6961,  0.0980,  0.7091,  0.1135,  0.9793,  0.3619,  0.0535,
         0.0699,  0.5943,  0.1044,  0.8542,  0.4992,  0.0158,  0.5351,
         0.0595,  0.0982,  0.9142,  0.7972,  0.1544,  0.1997,  0.1153,
         0.7591,  0.0718,  0.3793,  0.4009,  0.8629,  0.6925,  0.1874,
         0.4611,  0.2777,  0.4072,  0.1688,  0.8661,  0.2291,  0.2663,
         0.6659,  0.2108,  0.8700,  0.2891,  0.1717,  0.9633,  0.0831,
         0.0542,  0.0744,  0.5622,  0.2317,  0.8085,  0.0510,  0.2122,
         0.6029,  0.9462,  0.5140,  0.8350,  0.7914,  0.6389,  0.3849,
         0.2427,  0.8000,  0.0317,  0.6225,  0.3254,  0.4428,  0.1863,
         0.7937,  0.3833,  0.5536,  0.1546,  0.0774,  0.7701,  0.5119,
         0.9635,  0.7391,  0.6600,  0.0351,  0.1193,  0.2688,  0.8899,
         0.0958,  0.0855,  0.2345,  0.2082,  0.4178,  0.0937,  0.1678,
         0.8420,  0.0249,  0.4158,  0.7815,  0.1374,  0.1629,  0.1389,
         0.2690,  0.7839,  0.2080,  0.2817,  0.6131,  0.7123,  0.2327,
         0.8484,  0.0804,  0.7201,  0.7823,  0.8469,  0.5776,  0.0888,
         0.7310,  0.7983,  0.7525,  0.6896,  0.0720,  0.0530,  0.3879,
         0.3013,  0.0318,  0.0650,  0.6809,  0.6914,  0.2381,  0.0671,
         0.3846,  0.6731,  0.0555,  0.4067,  0.5536,  0.8238,  0.4614,
         0.3211,  0.0106,  0.7841,  0.7046,  0.0158,  0.2408,  0.3730,
         0.6685,  0.9074,  0.0199,  0.4093,  0.0553,  0.3229,  0.3598,
         0.5729,  0.0656,  0.6700,  0.6381,  0.8691,  0.0265,  0.4641,
         0.8006,  0.6751,  0.8284,  0.0710,  0.3602,  0.6599,  0.0442,
         0.0829,  0.5286,  0.0648,  0.0592,  0.1544,  0.0757,  0.4162,
         0.1673,  0.8744,  0.4599,  0.3631,  0.3536,  0.2379,  0.2211,
         0.4787,  0.6512,  0.2673,  0.8658,  0.7485,  0.9822,  0.5588,
         0.8071,  0.0413,  0.1058,  0.8543,  0.0640,  0.3476,  0.2669,
         0.4584,  0.8063,  0.0926,  0.7297,  0.8868,  0.7348,  0.3215,
         0.4528,  0.1268,  0.3482,  0.8863,  0.8964,  0.9453,  0.2236,
         0.7286,  0.6176,  0.1883,  0.8168,  0.2086,  0.9420,  0.5564,
         0.3346,  0.7094,  0.5838,  0.7627,  0.3849,  0.7646,  0.3892,
         0.3092,  0.7789,  0.8617,  0.2574,  0.0959,  0.7954,  0.9008,
         0.9683,  0.0585,  0.0656,  0.7564,  0.5099,  0.1382,  0.0538,
         0.8030,  0.0171,  0.7351,  0.7674,  0.1457,  0.7496,  0.2084,
         0.1420,  0.0477,  0.3529,  0.7276,  0.4854,  0.6485,  0.1350,
         0.5468,  0.1097,  0.9652,  0.0719,  0.1784,  0.7479,  0.9058,
         0.1106,  0.0548,  0.8429,  0.5858,  0.3370,  0.0143,  0.7133,
         0.7447,  0.0377,  0.6247,  0.6205,  0.3834,  0.1223,  0.6401,
         0.3794,  0.2928,  0.1954,  0.5328,  0.7443,  0.4403,  0.7753,
         0.9006,  0.2752,  0.9667,  0.0533,  0.0301,  0.8119,  0.2435,
         0.7593,  0.4994,  0.9898,  0.3803,  0.7599,  0.1487,  0.8958,
         0.6698,  0.4517,  0.1476,  0.1247,  0.8973,  0.1188,  0.6543,
         0.4400,  0.9918,  0.7088,  0.0886,  0.1030,  0.0620,  0.7964,
         0.2403,  0.8381,  0.3306,  0.1128,  0.0080,  0.8309,  0.2815,
         0.1477,  0.3715,  0.1838,  0.4620,  0.4584,  0.7033,  0.8368,
         0.9487,  0.1620,  0.4723,  0.6481,  0.2823,  0.1538,  0.1413,
         0.6180,  0.9871,  0.1067,  0.7943,  0.9652,  0.8781,  0.0049,
         0.5501,  0.2781,  0.7782,  0.8539,  0.1987,  0.1835,  0.9881,
         0.7043,  0.0777,  0.5285,  0.6321,  0.6938,  0.5073,  0.1916,
         0.2329,  0.5031,  0.1659,  0.1788,  0.6416,  0.3238,  0.7318,
         0.3420,  0.5844,  0.0724,  0.7578,  0.0675,  0.8633,  0.0795,
         0.0794,  0.8800,  0.7738,  0.5133,  0.1449,  0.9255,  0.5594,
         0.9168,  0.2362,  0.2078,  0.5258,  0.2660,  0.8768,  0.9534,
         0.4537,  0.7499,  0.9696,  0.6057,  0.6585,  0.7736,  0.0630,
         0.4374,  0.3394,  0.1355,  0.2684,  0.6695,  0.3725,  0.8529,
         0.1758,  0.8835,  0.6992,  0.7779,  0.3048,  0.2173,  0.1151,
         0.0763,  0.6894,  0.9314,  0.8049,  0.9067,  0.6106,  0.7819,
         0.7957,  0.7640,  0.6122,  0.3013,  0.8796,  0.0920,  0.6920,
         0.9294,  0.4072,  0.3315,  0.1044,  0.3602,  0.6250,  0.5740,
         0.2618,  0.3759,  0.6347,  0.7265,  0.1398,  0.9533,  0.0644,
         0.4554,  0.6570,  0.8321,  0.0821,  0.2568,  0.9215,  0.5303,
         0.0374,  0.1464,  0.0062,  0.8500,  0.4060,  0.4536,  0.2080,
         0.2583,  0.3648,  0.3693,  0.2300,  0.8366,  0.0686,  0.7799,
         0.8503,  0.1175,  0.7333,  0.7529,  0.7206,  0.7746,  0.9466,
         0.3971,  0.7540,  0.0791,  0.6915,  0.6343,  0.3085,  0.8468,
         0.0309], device='cuda:0')
tensor(0.4243, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8194,  0.1523,  0.1018,  0.4822,  0.6494,  0.2464,  0.1603,
         0.5020,  0.0289,  0.2645,  0.9311,  0.9267,  0.7277,  0.9365,
         0.0545,  0.8854,  0.1014,  0.6765,  0.8165,  0.1199,  0.0391,
         0.4910,  0.7781,  0.9433,  0.1569,  0.1546,  0.0677,  0.6789,
         0.0128,  0.1561,  0.0590,  0.6584,  0.0215,  0.0592,  0.9855,
         0.5952,  0.2263,  0.4760,  0.1671,  0.8244,  0.0927,  0.4671,
         0.0877,  0.1523,  0.6539,  0.8758,  0.6866,  0.3088,  0.6127,
         0.8019,  0.7976,  0.2473,  0.0785,  0.1685,  0.0544,  0.7806,
         0.5342,  0.1407,  0.0405,  0.6393,  0.2728,  0.7718,  0.2362,
         0.1634,  0.3492,  0.8157,  0.6893,  0.0067,  0.7714,  0.0887,
         0.7498,  0.8198,  0.2686,  0.1575,  0.8976,  0.9418,  0.0865,
         0.1132,  0.1678,  0.0396,  0.8602,  0.0532,  0.7896,  0.8227,
         0.9160,  0.1756,  0.0691,  0.1764,  0.1079,  0.9413,  0.6289,
         0.8923,  0.0559,  0.2334,  0.4839,  0.3160,  0.0773,  0.6554,
         0.8725,  0.5787,  0.6555,  0.9394,  0.0277,  0.0636,  0.0650,
         0.8226,  0.9413,  0.6317,  0.8422,  0.2478,  0.0847,  0.4944,
         0.4290,  0.7937,  0.0372,  0.8752,  0.7533,  0.1697,  0.1070,
         0.1123,  0.4912,  0.3848,  0.5311,  0.8757,  0.6239,  0.7919,
         0.8768,  0.2610,  0.1492,  0.0849,  0.7977,  0.0726,  0.5545,
         0.3922,  0.6959,  0.6110,  0.0811,  0.0489,  0.7704,  0.5399,
         0.6219,  0.6329,  0.8410,  0.7842,  0.2543,  0.1643,  0.3499,
         0.6616,  0.0260,  0.0157,  0.5647,  0.0723,  0.0600,  0.2875,
         0.0581,  0.1891,  0.0693,  0.3520,  0.1291,  0.0701,  0.6831,
         0.0751,  0.0992,  0.7483,  0.1227,  0.4753,  0.6255,  0.6182,
         0.8316,  0.0162,  0.8489,  0.1083,  0.5359,  0.6397,  0.1282,
         0.1910,  0.0351,  0.7529,  0.3090,  0.9057,  0.7381,  0.7821,
         0.7309,  0.6471,  0.9891,  0.1332,  0.4303,  0.1606,  0.2510,
         0.7345,  0.7595,  0.1869,  0.5582,  0.0153,  0.8360,  0.8244,
         0.1138,  0.7467,  0.1119,  0.0234,  0.8735,  0.2061,  0.0402,
         0.0332,  0.6246,  0.0900,  0.7097,  0.0642,  0.6509,  0.0543,
         0.0718,  0.1315,  0.0656,  0.7016,  0.3278,  0.0879,  0.7825,
         0.3209,  0.3054,  0.3579,  0.3392,  0.9060,  0.0039,  0.5882,
         0.5197,  0.6319,  0.8381,  0.7922,  0.2620,  0.1111,  0.9887,
         0.7873,  0.8942,  0.2883,  0.0164,  0.7079,  0.3869,  0.0311,
         0.2078,  0.0454,  0.6302,  0.0288,  0.2258,  0.5974,  0.0511,
         0.7164,  0.6083,  0.0840,  0.7550,  0.6834,  0.8012,  0.1048,
         0.5960,  0.0647,  0.1072,  0.1154,  0.8271,  0.1699,  0.0560,
         0.2544,  0.0243,  0.7175,  0.7208,  0.8310,  0.8981,  0.5512,
         0.1081,  0.1814,  0.0442,  0.5215,  0.8499,  0.0701,  0.9241,
         0.7388,  0.3121,  0.0268,  0.7121,  0.3264,  0.1778,  0.2289,
         0.1141,  0.0390,  0.0196,  0.2389,  0.9203,  0.8850,  0.0727,
         0.7114,  0.0528,  0.0214,  0.1602,  0.7076,  0.5154,  0.1224,
         0.8785,  0.0593,  0.5751,  0.5762,  0.5946,  0.8758,  0.2596,
         0.1126,  0.3523,  0.7943,  0.7894,  0.7529,  0.3987,  0.7646,
         0.5586,  0.4449,  0.5988,  0.0576,  0.1407,  0.0695,  0.0886,
         0.6210,  0.8889,  0.1087,  0.1180,  0.0794,  0.2208,  0.5808,
         0.3009,  0.3652,  0.5360,  0.8685,  0.0599,  0.0665,  0.9313,
         0.0984,  0.7148,  0.3608,  0.5794,  0.1637,  0.8443,  0.6195,
         0.1500,  0.1783,  0.0494,  0.1405,  0.8148,  0.1569,  0.0825,
         0.3279,  0.8976,  0.1493,  0.0895,  0.0206,  0.0885,  0.1534,
         0.1038,  0.6354,  0.8196,  0.0792,  0.3038,  0.7113,  0.1615,
         0.0784,  0.2061,  0.0963,  0.9312,  0.2313,  0.0897,  0.8354,
         0.8040,  0.9821,  0.5424,  0.2374,  0.2939,  0.5921,  0.2585,
         0.4244,  0.8383,  0.0209,  0.6176,  0.3089,  0.0737,  0.8265,
         0.1002,  0.0496,  0.1225,  0.4777,  0.0750,  0.1358,  0.8704,
         0.7449,  0.9286,  0.0680,  0.5847,  0.3414,  0.1129,  0.9444,
         0.5889,  0.2098,  0.9269,  0.0803,  0.1405,  0.7912,  0.0886,
         0.9108,  0.0127,  0.0890,  0.7835,  0.0199,  0.7503,  0.3951,
         0.0475,  0.8207,  0.4889,  0.0395,  0.0398,  0.7478,  0.9193,
         0.4242,  0.0654,  0.8213,  0.9644,  0.1258,  0.5040,  0.0585,
         0.0201,  0.1421,  0.1042,  0.2067,  0.8817,  0.3133,  0.8895,
         0.8054,  0.1226,  0.2191,  0.0771,  0.8538,  0.8896,  0.3993,
         0.8517,  0.1660,  0.1401,  0.2430,  0.3865,  0.1201,  0.5741,
         0.6005,  0.0959,  0.1537,  0.4697,  0.1103,  0.6456,  0.0484,
         0.3719,  0.0480,  0.6960,  0.2174,  0.1154,  0.2853,  0.0432,
         0.6258,  0.2888,  0.1371,  0.0385,  0.2827,  0.2029,  0.0344,
         0.9360,  0.1350,  0.4625,  0.6545,  0.4269,  0.0484,  0.3732,
         0.0199,  0.6280,  0.0564,  0.2094,  0.8846,  0.3316,  0.0184,
         0.1681,  0.7529,  0.8738,  0.1818,  0.8580,  0.8171,  0.2976,
         0.5324,  0.1663,  0.2934,  0.0448,  0.0606,  0.9282,  0.7438,
         0.7457,  0.8357,  0.8584,  0.2393,  0.1164,  0.8010,  0.1420,
         0.0048,  0.0439,  0.6414,  0.7343,  0.0141,  0.0986,  0.5653,
         0.1531,  0.1516,  0.7728,  0.0193,  0.2174,  0.7891,  0.9115,
         0.1091], device='cuda:0')
tensor(0.4073, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0377,  0.3960,  0.0949,  0.9022,  0.0401,  0.0395,  0.9040,
         0.0286,  0.1373,  0.0919,  0.0211,  0.0890,  0.2085,  0.6174,
         0.0648,  0.0534,  0.8517,  0.0332,  0.0950,  0.0438,  0.6293,
         0.0274,  0.0314,  0.5491,  0.8175,  0.9115,  0.8965,  0.7291,
         0.4489,  0.0612,  0.8449,  0.0215,  0.5238,  0.0083,  0.8710,
         0.0750,  0.8687,  0.4124,  0.1390,  0.8689,  0.0596,  0.1618,
         0.8036,  0.0501,  0.1852,  0.0612,  0.3600,  0.3514,  0.0448,
         0.7273,  0.0973,  0.8138,  0.8688,  0.4885,  0.4908,  0.2254,
         0.4251,  0.1087,  0.3576,  0.0560,  0.0524,  0.8436,  0.5717,
         0.8233,  0.0422,  0.8620,  0.4789,  0.8629,  0.0058,  0.7213,
         0.4397,  0.0721,  0.8901,  0.7948,  0.0144,  0.4287,  0.0559,
         0.1846,  0.1273,  0.0960,  0.0881,  0.3897,  0.0223,  0.0815,
         0.0177,  0.2457,  0.7050,  0.8718,  0.0273,  0.2102,  0.6268,
         0.1820,  0.0864,  0.8689,  0.6797,  0.4541,  0.2095,  0.1264,
         0.0841,  0.3050,  0.7865,  0.8615,  0.1872,  0.7306,  0.0799,
         0.0215,  0.0899,  0.6072,  0.7991,  0.0947,  0.0755,  0.1092,
         0.0819,  0.2017,  0.0653,  0.6907,  0.0098,  0.7898,  0.0095,
         0.2012,  0.9907,  0.2651,  0.0606,  0.0435,  0.0913,  0.0250,
         0.0260,  0.8088,  0.6907,  0.0940,  0.1626,  0.5412,  0.4845,
         0.7524,  0.0567,  0.0051,  0.3639,  0.9505,  0.0511,  0.2614,
         0.2887,  0.0545,  0.0515,  0.0284,  0.7584,  0.1299,  0.1462,
         0.8826,  0.6051,  0.0743,  0.0176,  0.3435,  0.0693,  0.0199,
         0.3962,  0.3279,  0.3089,  0.1136,  0.6334,  0.0392,  0.1801,
         0.3119,  0.9667,  0.8362,  0.0212,  0.2393,  0.0108,  0.6027,
         0.0882,  0.8975,  0.7758,  0.6860,  0.3916,  0.4886,  0.0416,
         0.7905,  0.0748,  0.3714,  0.0038,  0.6010,  0.5450,  0.0270,
         0.5588,  0.7163,  0.8336,  0.8227,  0.1345,  0.0892,  0.2305,
         0.3590,  0.7659,  0.1650,  0.8327,  0.0179,  0.0121,  0.1289,
         0.5570,  0.9886,  0.7956,  0.2589,  0.2591,  0.9036,  0.7857,
         0.9284,  0.8586,  0.5268,  0.5644,  0.9497,  0.8481,  0.8493,
         0.7867,  0.8279,  0.0622,  0.9035,  0.5411,  0.8113,  0.8878,
         0.1027,  0.0362,  0.0661,  0.4912,  0.0201,  0.0965,  0.0894,
         0.6320,  0.2537,  0.1734,  0.8424,  0.0338,  0.1174,  0.0564,
         0.9120,  0.0126,  0.0575,  0.9403,  0.0576,  0.0143,  0.5534,
         0.0541,  0.0663,  0.0493,  0.3553,  0.9372,  0.6844,  0.0980,
         0.7274,  0.0928,  0.2472,  0.0101,  0.7604,  0.2271,  0.1685,
         0.8157,  0.5602,  0.8682,  0.0083,  0.3133,  0.9073,  0.1388,
         0.8324,  0.4146,  0.0210,  0.4309,  0.0205,  0.6186,  0.7725,
         0.0620,  0.0816,  0.1007,  0.0257,  0.2253,  0.9035,  0.1782,
         0.4501,  0.0789,  0.9298,  0.6208,  0.8579,  0.9133,  0.0516,
         0.0921,  0.9131,  0.0593,  0.7086,  0.5513,  0.8008,  0.4267,
         0.0576,  0.0535,  0.9535,  0.1413,  0.9069,  0.1356,  0.0388,
         0.3417,  0.9498,  0.2656,  0.7172,  0.0863,  0.8172,  0.0966,
         0.3206,  0.3883,  0.9207,  0.9758,  0.0462,  0.8920,  0.6185,
         0.0958,  0.8988,  0.9262,  0.8285,  0.0835,  0.9131,  0.6676,
         0.3271,  0.0409,  0.9097,  0.0379,  0.8713,  0.5969,  0.7746,
         0.4450,  0.0799,  0.3977,  0.0220,  0.6477,  0.1403,  0.1869,
         0.2132,  0.2054,  0.7262,  0.8278,  0.6521,  0.0261,  0.0626,
         0.0082,  0.8759,  0.0484,  0.1394,  0.0781,  0.0334,  0.4413,
         0.0173,  0.8844,  0.0884,  0.9963,  0.4584,  0.1045,  0.5245,
         0.5291,  0.4447,  0.6903,  0.6153,  0.1491,  0.7292,  0.7076,
         0.4888,  0.0682,  0.6414,  0.0796,  0.2239,  0.9044,  0.7462,
         0.7174,  0.0918,  0.0469,  0.1416,  0.1317,  0.0589,  0.7537,
         0.2259,  0.4837,  0.1121,  0.9724,  0.5419,  0.0100,  0.0605,
         0.7540,  0.3045,  0.0094,  0.9935,  0.2673,  0.3317,  0.3305,
         0.1821,  0.6719,  0.4900,  0.7521,  0.6726,  0.4174,  0.2599,
         0.3732,  0.3864,  0.5930,  0.2564,  0.2800,  0.1144,  0.4176,
         0.2048,  0.8509,  0.9555,  0.4738,  0.2536,  0.5021,  0.0344,
         0.0865,  0.5828,  0.2511,  0.7825,  0.0792,  0.4346,  0.0057,
         0.2112,  0.1701,  0.8913,  0.9155,  0.8566,  0.8690,  0.0552,
         0.0569,  0.1350,  0.7429,  0.6657,  0.1091,  0.0371,  0.2194,
         0.0824,  0.7383,  0.8695,  0.2825,  0.1914,  0.0345,  0.0206,
         0.7876,  0.0229,  0.8691,  0.0125,  0.2556,  0.5552,  0.4955,
         0.4092,  0.1484,  0.8417,  0.9501,  0.2430,  0.1265,  0.0188,
         0.9655,  0.7281,  0.6651,  0.0983,  0.1143,  0.8823,  0.7593,
         0.1251,  0.4861,  0.0525,  0.0637,  0.0927,  0.5739,  0.0212,
         0.2456,  0.6221,  0.2542,  0.1820,  0.0648,  0.4747,  0.7652,
         0.8088,  0.0634,  0.1353,  0.6000,  0.0235,  0.0920,  0.0117,
         0.0539,  0.5983,  0.0629,  0.0591,  0.0691,  0.8282,  0.8567,
         0.1826,  0.2534,  0.0502,  0.5155,  0.1330,  0.7462,  0.0362,
         0.6341,  0.7064,  0.8870,  0.0762,  0.2491,  0.9002,  0.7007,
         0.8703,  0.2166,  0.1957,  0.2390,  0.9300,  0.0643,  0.8686,
         0.0372,  0.3984,  0.1222,  0.0788,  0.0240,  0.0581,  0.8656,
         0.8516], device='cuda:0')
tensor(0.4611, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9054,  0.7260,  0.1288,  0.5875,  0.1245,  0.1682,  0.2272,
         0.1243,  0.0293,  0.2588,  0.8785,  0.8741,  0.7177,  0.0848,
         0.0297,  0.1064,  0.1407,  0.8491,  0.1427,  0.7951,  0.8343,
         0.0443,  0.0484,  0.8252,  0.1727,  0.8368,  0.6287,  0.6891,
         0.0533,  0.1754,  0.2475,  0.8893,  0.9176,  0.9355,  0.4944,
         0.5823,  0.6243,  0.8651,  0.5894,  0.6008,  0.8633,  0.5146,
         0.1386,  0.1016,  0.8143,  0.9425,  0.1478,  0.0821,  0.4779,
         0.8092,  0.8313,  0.0467,  0.0254,  0.6476,  0.1067,  0.0469,
         0.2352,  0.8695,  0.0867,  0.1179,  0.9195,  0.4335,  0.7366,
         0.6171,  0.0284,  0.4209,  0.2324,  0.6673,  0.0733,  0.4859,
         0.0242,  0.7884,  0.1026,  0.4400,  0.9489,  0.1554,  0.9843,
         0.8630,  0.3763,  0.0371,  0.9551,  0.9161,  0.6544,  0.0406,
         0.9163,  0.7956,  0.0393,  0.5341,  0.7746,  0.7393,  0.0499,
         0.5676,  0.7327,  0.0338,  0.0882,  0.2838,  0.4482,  0.2830,
         0.9154,  0.6787,  0.1002,  0.0487,  0.8396,  0.3922,  0.0351,
         0.9032,  0.0753,  0.0960,  0.7596,  0.7508,  0.7419,  0.9395,
         0.9187,  0.7924,  0.1561,  0.3192,  0.3613,  0.0256,  0.8566,
         0.0820,  0.7537,  0.0448,  0.9276,  0.7653,  0.3926,  0.7201,
         0.6718,  0.1461,  0.0403,  0.0472,  0.1073,  0.0336,  0.0179,
         0.1188,  0.2182,  0.1670,  0.0571,  0.1363,  0.6232,  0.0768,
         0.0287,  0.1297,  0.0816,  0.8887,  0.0148,  0.0157,  0.7976,
         0.8108,  0.2658,  0.2647,  0.0733,  0.7630,  0.7305,  0.5592,
         0.6748,  0.1116,  0.8687,  0.5264,  0.0893,  0.8547,  0.5504,
         0.6460,  0.9366,  0.0493,  0.0464,  0.0574,  0.7376,  0.6076,
         0.0092,  0.7947,  0.9047,  0.0266,  0.0230,  0.3426,  0.0209,
         0.2639,  0.7569,  0.8682,  0.0676,  0.0417,  0.9173,  0.1723,
         0.8828,  0.8535,  0.1366,  0.4572,  0.0433,  0.8434,  0.7888,
         0.0504,  0.8060,  0.0300,  0.6564,  0.3237,  0.3197,  0.3795,
         0.1154,  0.2028,  0.9645,  0.8569,  0.1293,  0.1841,  0.9011,
         0.4673,  0.3470,  0.0622,  0.8864,  0.0672,  0.7528,  0.0338,
         0.1239,  0.0401,  0.4538,  0.8649,  0.8585,  0.0913,  0.1432,
         0.0662,  0.4510,  0.1349,  0.1863,  0.0673,  0.0890,  0.2341,
         0.7579,  0.3807,  0.8544,  0.4065,  0.7618,  0.6082,  0.0859,
         0.8727,  0.2064,  0.4957,  0.8075,  0.1329,  0.1353,  0.0488,
         0.8262,  0.0789,  0.0700,  0.8642,  0.5388,  0.8826,  0.1058,
         0.0726,  0.6968,  0.1124,  0.2006,  0.6821,  0.5339,  0.7769,
         0.5004,  0.0177,  0.3882,  0.1023,  0.0853,  0.3732,  0.8369,
         0.3868,  0.0795,  0.3109,  0.7018,  0.8268,  0.6074,  0.9923,
         0.3199,  0.0144,  0.8856,  0.0386,  0.1068,  0.8911,  0.0087,
         0.0988,  0.3109,  0.2576,  0.0208,  0.7608,  0.2845,  0.7736,
         0.1087,  0.8823,  0.8856,  0.0396,  0.4713,  0.0941,  0.0701,
         0.0696,  0.1018,  0.6683,  0.7034,  0.7609,  0.0654,  0.0771,
         0.2092,  0.8096,  0.0744,  0.0876,  0.1015,  0.3654,  0.6412,
         0.0793,  0.8515,  0.9611,  0.6404,  0.0985,  0.7627,  0.6642,
         0.5731,  0.6332,  0.0440,  0.8046,  0.1197,  0.0630,  0.1495,
         0.3953,  0.0382,  0.5237,  0.3713,  0.0774,  0.6438,  0.9831,
         0.8353,  0.0300,  0.8365,  0.0233,  0.1146,  0.1760,  0.4873,
         0.9605,  0.6567,  0.5203,  0.5302,  0.4528,  0.3864,  0.6835,
         0.7326,  0.6219,  0.0425,  0.0556,  0.6660,  0.9850,  0.2226,
         0.9959,  0.0431,  0.3453,  0.2447,  0.8884,  0.1256,  0.9034,
         0.9930,  0.1581,  0.2822,  0.7015,  0.7719,  0.4103,  0.9104,
         0.7465,  0.8139,  0.0609,  0.0457,  0.9049,  0.6740,  0.0466,
         0.9675,  0.3705,  0.6665,  0.8045,  0.0703,  0.9223,  0.1403,
         0.1064,  0.0106,  0.9510,  0.2164,  0.0887,  0.5101,  0.0990,
         0.0348,  0.0838,  0.1026,  0.4322,  0.2863,  0.1066,  0.2680,
         0.7315,  0.9089,  0.8194,  0.0360,  0.1545,  0.8638,  0.2099,
         0.8868,  0.5322,  0.8323,  0.4906,  0.1510,  0.7620,  0.1158,
         0.8798,  0.0218,  0.0448,  0.8667,  0.0155,  0.8507,  0.0658,
         0.0398,  0.9112,  0.1420,  0.1271,  0.0383,  0.6736,  0.3074,
         0.0525,  0.8930,  0.8909,  0.0818,  0.2550,  0.0941,  0.3879,
         0.0946,  0.1473,  0.1144,  0.0582,  0.0755,  0.0108,  0.7500,
         0.1140,  0.0862,  0.0580,  0.7928,  0.1167,  0.7994,  0.0282,
         0.0607,  0.1196,  0.4696,  0.0478,  0.0814,  0.3623,  0.9787,
         0.1673,  0.0866,  0.2584,  0.1055,  0.8613,  0.8063,  0.9865,
         0.7657,  0.8738,  0.8437,  0.1508,  0.6811,  0.6441,  0.8787,
         0.3027,  0.2317,  0.0587,  0.9013,  0.1178,  0.1483,  0.7333,
         0.0422,  0.0953,  0.1619,  0.8198,  0.8838,  0.1737,  0.6999,
         0.1573,  0.6401,  0.2964,  0.1530,  0.1111,  0.7844,  0.2125,
         0.8696,  0.1057,  0.0630,  0.1340,  0.3889,  0.8359,  0.0132,
         0.6274,  0.0486,  0.2968,  0.7908,  0.5885,  0.7306,  0.7653,
         0.7441,  0.9432,  0.1086,  0.1906,  0.7864,  0.0888,  0.2968,
         0.2196,  0.7998,  0.0592,  0.1591,  0.7825,  0.1965,  0.9950,
         0.4002,  0.0441,  0.1120,  0.1276,  0.8549,  0.0267,  0.9216,
         0.1932], device='cuda:0')
tensor(0.4455, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2092,  0.6941,  0.0552,  0.8205,  0.9935,  0.9861,  0.6578,
         0.7129,  0.8508,  0.6668,  0.2648,  0.3596,  0.7394,  0.7148,
         0.8551,  0.8987,  0.7571,  0.9098,  0.8638,  0.9215,  0.2255,
         0.0390,  0.2512,  0.4628,  0.0095,  0.7497,  0.5035,  0.8687,
         0.9283,  0.8812,  0.8127,  0.8371,  0.4625,  0.0859,  0.2837,
         0.8061,  0.0512,  0.8961,  0.6220,  0.0985,  0.6919,  0.1507,
         0.5222,  0.9018,  0.1697,  0.8237,  0.8204,  0.9191,  0.5223,
         0.6618,  0.1801,  0.2021,  0.0357,  0.3890,  0.1386,  0.2154,
         0.2033,  0.7778,  0.7002,  0.9807,  0.8828,  0.9273,  0.7516,
         0.8864,  0.6809,  0.8935,  0.6681,  0.0643,  0.2202,  0.2988,
         0.7591,  0.7734,  0.7761,  0.8343,  0.2998,  0.7874,  0.9342,
         0.0586,  0.9235,  0.6224,  0.0539,  0.0512,  0.8638,  0.9146,
         0.4741,  0.0648,  0.3963,  0.9055,  0.8875,  0.0595,  0.7470,
         0.9819,  0.2493,  0.1149,  0.1755,  0.4952,  0.0535,  0.9536,
         0.3648,  0.8082,  0.0468,  0.0830,  0.5056,  0.9840,  0.8085,
         0.9439,  0.8713,  0.4877,  0.8949,  0.0414,  0.8168,  0.6548,
         0.0882,  0.8854,  0.0193,  0.8531,  0.3487,  0.2084,  0.3415,
         0.0488,  0.9815,  0.2454,  0.7530,  0.7070,  0.7788,  0.9979,
         0.5633,  0.8784,  0.1831,  0.8624,  0.9750,  0.1794,  0.9188,
         0.9342,  0.0924,  0.5596,  0.8581,  0.0526,  0.8610,  0.1932,
         0.1579,  0.9125,  0.1256,  0.8375,  0.1518,  0.8816,  0.2406,
         0.8452,  0.0785,  0.0457,  0.1198,  0.6561,  0.4099,  0.2202,
         0.3584,  0.8134,  0.0935,  0.4705,  0.9135,  0.9969,  0.8170,
         0.8968,  0.5036,  0.2565,  0.3007,  0.1443,  0.1976,  0.8821,
         0.1172,  0.0687,  0.5487,  0.8904,  0.9853,  0.7500,  0.4900,
         0.8892,  0.5791,  0.8414,  0.1170,  0.4027,  0.7108,  0.0696,
         0.6830,  0.8764,  0.6742,  0.7987,  0.9750,  0.8153,  0.7551,
         0.4803,  0.9830,  0.9205,  0.4019,  0.1036,  0.0701,  0.9632,
         0.9349,  0.8457,  0.2018,  0.9959,  0.0505,  0.5596,  0.8267,
         0.9606,  0.5991,  0.3267,  0.3603,  0.3344,  0.0654,  0.1766,
         0.8436,  0.0367,  0.1163,  0.0472,  0.6593,  0.4774,  0.9675,
         0.8767,  0.3938,  0.2751,  0.9601,  0.0197,  0.9218,  0.1088,
         0.0326,  0.0223,  0.1172,  0.7119,  0.2585,  0.8518,  0.0960,
         0.0525,  0.9245,  0.9064,  0.8446,  0.7755,  0.1101,  0.1463,
         0.8903,  0.1149,  0.1987,  0.1166,  0.9337,  0.7650,  0.2744,
         0.7966,  0.3614,  0.6042,  0.9738,  0.4143,  0.4827,  0.6094,
         0.1062,  0.8664,  0.9463,  0.7826,  0.9108,  0.0746,  0.1826,
         0.2100,  0.7517,  0.9306,  0.8699,  0.9435,  0.5572,  0.0058,
         0.8195,  0.6178,  0.8413,  0.6596,  0.0863,  0.0409,  0.4531,
         0.8226,  0.8627,  0.8668,  0.6313,  0.5306,  0.1675,  0.6216,
         0.2033,  0.0185,  0.9328,  0.1176,  0.9606,  0.7747,  0.9104,
         0.0667,  0.5018,  0.3300,  0.8017,  0.6682,  0.9634,  0.8529,
         0.1029,  0.9193,  0.8204,  0.5440,  0.9831,  0.0769,  0.1712,
         0.9561,  0.1231,  0.7451,  0.1151,  0.6146,  0.8225,  0.9621,
         0.3462,  0.8290,  0.9063,  0.1336,  0.0920,  0.9440,  0.5836,
         0.5380,  0.6029,  0.1944,  0.7569,  0.9095,  0.9572,  0.0569,
         0.3477,  0.8654,  0.1896,  0.9166,  0.9549,  0.7127,  0.3630,
         0.3208,  0.2980,  0.6972,  0.1316,  0.9037,  0.8524,  0.0085,
         0.9144,  0.9019,  0.1244,  0.9538,  0.9898,  0.9077,  0.1457,
         0.1573,  0.7377,  0.0827,  0.7706,  0.5424,  0.8553,  0.3719,
         0.7345,  0.7824,  0.9665,  0.9314,  0.8527,  0.7600,  0.5689,
         0.6587,  0.2366,  0.2599,  0.0084,  0.9624,  0.1814,  0.9115,
         0.8949,  0.3214,  0.1781,  0.1043,  0.9467,  0.8545,  0.8237,
         0.7030,  0.8887,  0.7161,  0.7234,  0.1534,  0.0505,  0.1821,
         0.7108,  0.7620,  0.9451,  0.5950,  0.0365,  0.0746,  0.9786,
         0.7566,  0.1279,  0.6141,  0.9556,  0.7222,  0.9503,  0.6228,
         0.0390,  0.1571,  0.9143,  0.5787,  0.3434,  0.0481,  0.2510,
         0.9777,  0.8211,  0.0512,  0.6193,  0.0895,  0.4505,  0.8748,
         0.0877,  0.8603,  0.4305,  0.8507,  0.6631,  0.8700,  0.0993,
         0.8679,  0.0294,  0.8729,  0.7712,  0.1675,  0.7181,  0.0858,
         0.2938,  0.1252,  0.0760,  0.2728,  0.8574,  0.0077,  0.8996,
         0.5733,  0.4146,  0.7901,  0.9444,  0.0554,  0.5744,  0.6213,
         0.8852,  0.0699,  0.5322,  0.9264,  0.9658,  0.6048,  0.1934,
         0.3369,  0.9648,  0.4682,  0.1685,  0.1294,  0.0714,  0.7792,
         0.9146,  0.7257,  0.0979,  0.1820,  0.5586,  0.8601,  0.3774,
         0.9045,  0.0912,  0.8911,  0.2888,  0.9106,  0.7577,  0.9969,
         0.2302,  0.6358,  0.8772,  0.7992,  0.8844,  0.7591,  0.6616,
         0.9658,  0.1710,  0.9238,  0.1255,  0.3555,  0.3930,  0.1003,
         0.9076,  0.9789,  0.9514,  0.1184,  0.9224,  0.8713,  0.5151,
         0.2404,  0.0353,  0.7076,  0.7175,  0.4008,  0.9425,  0.7534,
         0.0816,  0.8740,  0.5107,  0.0878,  0.2290,  0.7702,  0.2429,
         0.9064,  0.7498,  0.0523,  0.5019,  0.4584,  0.0572,  0.8604,
         0.9488,  0.6652,  0.0951,  0.1325,  0.8614,  0.0410,  0.8356,
         0.0382], device='cuda:0')
tensor(0.4361, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9600,  0.2052,  0.1513,  0.0948,  0.2517,  0.3940,  0.4019,
         0.9194,  0.8711,  0.2013,  0.7089,  0.9150,  0.5406,  0.4969,
         0.8879,  0.8733,  0.2757,  0.8645,  0.0908,  0.9965,  0.3386,
         0.8150,  0.9930,  0.2211,  0.8039,  0.1292,  0.9824,  0.9237,
         0.8430,  0.6409,  0.2199,  0.4097,  0.1039,  0.9314,  0.2233,
         0.8048,  0.5639,  0.2793,  0.7889,  0.7352,  0.1001,  0.0683,
         0.1104,  0.8347,  0.9741,  0.4927,  0.7799,  0.9296,  0.8439,
         0.5314,  0.5589,  0.7083,  0.2561,  0.7715,  0.1227,  0.5387,
         0.8950,  0.7284,  0.1404,  0.0968,  0.8504,  0.1807,  0.9043,
         0.1175,  0.8607,  0.8588,  0.9179,  0.1742,  0.9399,  0.7380,
         0.8668,  0.0138,  0.2039,  0.4757,  0.9425,  0.6867,  0.4615,
         0.8176,  0.9445,  0.0950,  0.7965,  0.9874,  0.8104,  0.9245,
         0.0137,  0.9866,  0.9026,  0.6080,  0.0309,  0.1160,  0.8689,
         0.9509,  0.6451,  0.8936,  0.4182,  0.8760,  0.9030,  0.2934,
         0.8048,  0.7663,  0.9810,  0.0830,  0.6816,  0.7781,  0.4128,
         0.8510,  0.8195,  0.9102,  0.9990,  0.3952,  0.9608,  0.9278,
         0.2033,  0.1961,  0.3618,  0.2848,  0.4311,  0.6922,  0.9726,
         0.9347,  0.9222,  0.9175,  0.1246,  0.9427,  0.8110,  0.9783,
         0.4536,  0.6085,  0.6068,  0.8178,  0.6572,  0.4749,  0.0900,
         0.8757,  0.7179,  0.0416,  0.7901,  0.7144,  0.5418,  0.5517,
         0.2081,  0.9849,  0.2920,  0.1047,  0.8205,  0.8025,  0.3572,
         0.6345,  0.0188,  0.7453,  0.4261,  0.6289,  0.2922,  0.8904,
         0.9393,  0.4637,  0.6460,  0.9360,  0.9342,  0.8179,  0.9234,
         0.8496,  0.9492,  0.4788,  0.3504,  0.0604,  0.4215,  0.8085,
         0.7768,  0.2224,  0.1706,  0.2905,  0.8634,  0.1584,  0.4353,
         0.3540,  0.3060,  0.7760,  0.2481,  0.7102,  0.9375,  0.2691,
         0.0605,  0.7787,  0.1969,  0.2866,  0.3267,  0.6197,  0.9494,
         0.0985,  0.1852,  0.8301,  0.6156,  0.3084,  0.9170,  0.8774,
         0.8283,  0.8075,  0.2796,  0.8078,  0.8071,  0.9189,  0.9470,
         0.1841,  0.2072,  0.8758,  0.9554,  0.3229,  0.5821,  0.8399,
         0.1181,  0.1011,  0.1733,  0.0796,  0.8489,  0.7601,  0.2509,
         0.0494,  0.5680,  0.9045,  0.3758,  0.8451,  0.9269,  0.8353,
         0.5009,  0.6993,  0.8392,  0.4483,  0.8769,  0.1109,  0.1804,
         0.1223,  0.2461,  0.9319,  0.8835,  0.5201,  0.3056,  0.7913,
         0.7675,  0.7329,  0.9816,  0.9787,  0.5476,  0.3158,  0.1410,
         0.1402,  0.0706,  0.8158,  0.7362,  0.9071,  0.0421,  0.9400,
         0.9247,  0.2498,  0.8717,  0.8925,  0.7494,  0.3988,  0.8870,
         0.8627,  0.9496,  0.6835,  0.4269,  0.8519,  0.7918,  0.9168,
         0.8817,  0.9499,  0.4434,  0.8785,  0.4717,  0.8002,  0.5504,
         0.7082,  0.4096,  0.9094,  0.8168,  0.7312,  0.3174,  0.9378,
         0.8154,  0.9254,  0.0774,  0.9497,  0.6980,  0.0767,  0.9159,
         0.0609,  0.8513,  0.1157,  0.4790,  0.9015,  0.8019,  0.8539,
         0.8621,  0.9041,  0.7227,  0.1234,  0.9921,  0.0924,  0.7311,
         0.8084,  0.9227,  0.8192,  0.8485,  0.0985,  0.1526,  0.4259,
         0.9032,  0.8407,  0.9623,  0.1572,  0.9896,  0.3151,  0.9459,
         0.1348,  0.1202,  0.9024,  0.4555,  0.5772,  0.1085,  0.1781,
         0.8586,  0.4019,  0.2009,  0.6301,  0.8932,  0.9239,  0.4862,
         0.2990,  0.8327,  0.9268,  0.4036,  0.0221,  0.8419,  0.7684,
         0.9596,  0.7220,  0.2537,  0.8240,  0.8139,  0.5327,  0.9612,
         0.3330,  0.4072,  0.6294,  0.5554,  0.2402,  0.2425,  0.8623,
         0.6899,  0.9048,  0.9130,  0.8469,  0.8778,  0.7199,  0.9665,
         0.1637,  0.7859,  0.8495,  0.9471,  0.8242,  0.8962,  0.8973,
         0.9427,  0.8387,  0.9102,  0.8034,  0.9042,  0.8116,  0.6495,
         0.8346,  0.0243,  0.9296,  0.0788,  0.9470,  0.1141,  0.8978,
         0.1083,  0.9959,  0.6541,  0.9615,  0.1006,  0.9589,  0.9890,
         0.8250,  0.9135,  0.6709,  0.6728,  0.5704,  0.7153,  0.1508,
         0.7173,  0.6585,  0.8690,  0.9109,  0.9660,  0.4276,  0.0726,
         0.6802,  0.8612,  0.4777,  0.8742,  0.9074,  0.8807,  0.8921,
         0.9256,  0.8259,  0.9150,  0.8479,  0.8757,  0.4807,  0.8316,
         0.9801,  0.9196,  0.8615,  0.9234,  0.3045,  0.9159,  0.9620,
         0.9205,  0.8698,  0.6520,  0.9191,  0.8982,  0.0584,  0.3587,
         0.8664,  0.8269,  0.6693,  0.6511,  0.9362,  0.9121,  0.8053,
         0.7028,  0.8135,  0.7088,  0.8980,  0.5968,  0.3357,  0.1170,
         0.8595,  0.2426,  0.7506,  0.4104,  0.9824,  0.8065,  0.8104,
         0.9872,  0.1394,  0.1408,  0.1192,  0.5693,  0.9527,  0.7369,
         0.8849,  0.8906,  0.9474,  0.2640,  0.9318,  0.8683,  0.8845,
         0.3805,  0.8509,  0.9189,  0.2738,  0.9403,  0.1257,  0.0777,
         0.9225,  0.9776,  0.9916,  0.5489,  0.2049,  0.1709,  0.3832,
         0.9434,  0.5654,  0.5224,  0.9583,  0.3110,  0.6863,  0.0977,
         0.6092,  0.7105,  0.8310,  0.5369,  0.6591,  0.8739,  0.8925,
         0.8720,  0.0508,  0.8826,  0.7372,  0.9314,  0.6437,  0.8705,
         0.9542,  0.1514,  0.8866,  0.3850,  0.7247,  0.8092,  0.2569,
         0.0412,  0.2395,  0.0338,  0.9180,  0.8304,  0.9858,  0.3820,
         0.9351], device='cuda:0')
tensor(0.4784, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8851,  0.9308,  0.7922,  0.7622,  0.7893,  0.7894,  0.9448,
         0.6931,  0.2103,  0.3623,  0.9141,  0.7890,  0.3292,  0.7471,
         0.5901,  0.7469,  0.9323,  0.6827,  0.9330,  0.4605,  0.9081,
         0.0487,  0.5930,  0.1327,  0.9760,  0.9670,  0.8618,  0.7956,
         0.7805,  0.5186,  0.1790,  0.9128,  0.0860,  0.9738,  0.4282,
         0.9133,  0.0762,  0.6704,  0.9028,  0.9075,  0.2232,  0.9106,
         0.8870,  0.9032,  0.7983,  0.7668,  0.8122,  0.9560,  0.4931,
         0.9404,  0.3616,  0.6140,  0.2329,  0.3093,  0.3745,  0.9121,
         0.9317,  0.1409,  0.8479,  0.9147,  0.9478,  0.7751,  0.0541,
         0.8672,  0.8131,  0.7462,  0.3030,  0.4622,  0.3490,  0.4046,
         0.1059,  0.8470,  0.5817,  0.2919,  0.1566,  0.5674,  0.8604,
         0.7551,  0.0870,  0.4930,  0.9150,  0.5612,  0.9155,  0.0441,
         0.7500,  0.0288,  0.8195,  0.1018,  0.5637,  0.9507,  0.3917,
         0.7815,  0.8402,  0.4964,  0.8784,  0.3648,  0.6567,  0.9175,
         0.4657,  0.7694,  0.8889,  0.1264,  0.0641,  0.8078,  0.2001,
         0.2878,  0.9481,  0.9308,  0.1152,  0.3165,  0.7049,  0.9573,
         0.3118,  0.0200,  0.1889,  0.6316,  0.8561,  0.6492,  0.8589,
         0.9983,  0.5409,  0.9139,  0.1441,  0.8823,  0.8270,  0.1426,
         0.1666,  0.8364,  0.1146,  0.0908,  0.8900,  0.8265,  0.0404,
         0.9426,  0.2423,  0.9252,  0.5609,  0.8270,  0.1777,  0.7736,
         0.8374,  0.6219,  0.1398,  0.9726,  0.2886,  0.2980,  0.8736,
         0.1872,  0.3554,  0.9113,  0.1534,  0.9040,  0.8659,  0.2704,
         0.8880,  0.8852,  0.0713,  0.4392,  0.8323,  0.9475,  0.8794,
         0.5541,  0.0237,  0.0166,  0.3996,  0.9964,  0.9819,  0.8887,
         0.2209,  0.9437,  0.8566,  0.8233,  0.3442,  0.1520,  0.9035,
         0.9200,  0.1215,  0.1439,  0.2212,  0.2586,  0.6953,  0.0288,
         0.1808,  0.5697,  0.8184,  0.6997,  0.7308,  0.8341,  0.0152,
         0.0185,  0.8233,  0.9406,  0.8887,  0.8733,  0.8346,  0.0697,
         0.7947,  0.5290,  0.7337,  0.7784,  0.1343,  0.7681,  0.8318,
         0.3306,  0.9878,  0.8745,  0.7805,  0.9592,  0.7150,  0.3531,
         0.9121,  0.8922,  0.9454,  0.9071,  0.9255,  0.1272,  0.5962,
         0.3665,  0.0945,  0.9468,  0.8669,  0.2694,  0.8986,  0.7713,
         0.6481,  0.8498,  0.2775,  0.8569,  0.7412,  0.3895,  0.8746,
         0.9272,  0.9694,  0.5264,  0.0636,  0.8244,  0.8590,  0.2633,
         0.0296,  0.7238,  0.9283,  0.8341,  0.1921,  0.8632,  0.8537,
         0.8789,  0.8631,  0.8968,  0.7404,  0.4074,  0.8938,  0.1695,
         0.7076,  0.6942,  0.8444,  0.9105,  0.5426,  0.5878,  0.0463,
         0.5133,  0.8737,  0.9240,  0.3358,  0.1701,  0.2977,  0.2165,
         0.0840,  0.7624,  0.8594,  0.1925,  0.1034,  0.8905,  0.0828,
         0.2418,  0.1091,  0.9536,  0.7462,  0.1043,  0.7487,  0.1726,
         0.1009,  0.6665,  0.5952,  0.9239,  0.9500,  0.7086,  0.8135,
         0.7445,  0.8975,  0.7202,  0.5256,  0.1381,  0.8857,  0.8612,
         0.9388,  0.2202,  0.7840,  0.8179,  0.0904,  0.9345,  0.1994,
         0.2451,  0.8798,  0.0538,  0.7059,  0.4852,  0.9301,  0.0196,
         0.5802,  0.9155,  0.2532,  0.3932,  0.2914,  0.1162,  0.7710,
         0.5251,  0.1652,  0.1645,  0.0322,  0.1544,  0.2681,  0.8597,
         0.6798,  0.0879,  0.8214,  0.4472,  0.9083,  0.7107,  0.8381,
         0.8626,  0.4211,  0.9883,  0.9351,  0.3184,  0.2566,  0.8397,
         0.7443,  0.1465,  0.8979,  0.9304,  0.2016,  0.6286,  0.9529,
         0.8280,  0.9278,  0.9422,  0.9774,  0.7689,  0.8670,  0.7650,
         0.3015,  0.2603,  0.9826,  0.2005,  0.1261,  0.8395,  0.1645,
         0.2115,  0.9363,  0.5283,  0.2805,  0.5467,  0.0950,  0.9623,
         0.0780,  0.3697,  0.9440,  0.8993,  0.5104,  0.8939,  0.2980,
         0.0202,  0.2066,  0.8988,  0.0300,  0.1380,  0.9210,  0.8136,
         0.3958,  0.7161,  0.8793,  0.6951,  0.8194,  0.9262,  0.3064,
         0.3085,  0.3102,  0.9700,  0.5551,  0.9274,  0.8020,  0.4217,
         0.9627,  0.8708,  0.0353,  0.6142,  0.5545,  0.9437,  0.8999,
         0.4614,  0.6648,  0.3233,  0.8775,  0.3179,  0.2676,  0.0994,
         0.5995,  0.0358,  0.8736,  0.0778,  0.3957,  0.8162,  0.5527,
         0.9445,  0.1592,  0.4955,  0.9886,  0.0397,  0.2259,  0.7231,
         0.0899,  0.8393,  0.7737,  0.4738,  0.7184,  0.5236,  0.2091,
         0.8922,  0.0537,  0.2474,  0.7053,  0.6029,  0.9219,  0.0708,
         0.9197,  0.1025,  0.7170,  0.9123,  0.8690,  0.9383,  0.0840,
         0.3792,  0.7944,  0.3599,  0.7914,  0.5146,  0.6786,  0.9669,
         0.2822,  0.8936,  0.7485,  0.5355,  0.9192,  0.4805,  0.7684,
         0.9022,  0.9058,  0.5341,  0.2288,  0.5587,  0.8887,  0.8342,
         0.2048,  0.4740,  0.1925,  0.2625,  0.7261,  0.6068,  0.7699,
         0.1121,  0.8109,  0.8628,  0.0880,  0.2048,  0.9563,  0.3745,
         0.9119,  0.0513,  0.7343,  0.4725,  0.8522,  0.5191,  0.8553,
         0.6970,  0.8660,  0.1632,  0.9238,  0.2212,  0.7531,  0.8076,
         0.6434,  0.8837,  0.9506,  0.4398,  0.8636,  0.9094,  0.3034,
         0.5980,  0.1691,  0.9240,  0.7430,  0.9315,  0.7120,  0.4168,
         0.7578,  0.9454,  0.7107,  0.8400,  0.9568,  0.9505,  0.7297,
         0.0790], device='cuda:0')
tensor(0.4341, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8818,  0.1653,  0.7501,  0.8862,  0.8253,  0.8385,  0.7245,
         0.6671,  0.2111,  0.6697,  0.6351,  0.9242,  0.9106,  0.5879,
         0.9061,  0.0491,  0.3018,  0.5363,  0.7018,  0.7186,  0.1764,
         0.9478,  0.3384,  0.5220,  0.5920,  0.4844,  0.7788,  0.2619,
         0.3452,  0.9416,  0.1976,  0.8056,  0.5979,  0.3192,  0.1766,
         0.0513,  0.0688,  0.0656,  0.4194,  0.9723,  0.0550,  0.0920,
         0.6041,  0.8689,  0.5562,  0.9503,  0.8898,  0.7029,  0.2706,
         0.2105,  0.7969,  0.0592,  0.5022,  0.2414,  0.9497,  0.6283,
         0.1838,  0.4511,  0.6520,  0.9272,  0.7362,  0.7446,  0.6071,
         0.5984,  0.8703,  0.8980,  0.0648,  0.8856,  0.7751,  0.7024,
         0.4452,  0.8431,  0.1681,  0.7732,  0.9660,  0.9234,  0.5602,
         0.5520,  0.4526,  0.2995,  0.8568,  0.6942,  0.6637,  0.2237,
         0.2034,  0.9427,  0.0586,  0.7640,  0.6615,  0.2505,  0.0908,
         0.1583,  0.7368,  0.5822,  0.2359,  0.8690,  0.3497,  0.3878,
         0.4941,  0.8280,  0.4151,  0.9198,  0.0415,  0.1472,  0.4188,
         0.9671,  0.2894,  0.5733,  0.6188,  0.6280,  0.4581,  0.6990,
         0.8006,  0.8741,  0.6473,  0.7758,  0.2394,  0.7155,  0.8031,
         0.5484,  0.8535,  0.7921,  0.2847,  0.8632,  0.7532,  0.3057,
         0.9552,  0.6557,  0.9779,  0.7644,  0.5324,  0.8571,  0.7499,
         0.4562,  0.1863,  0.9520,  0.8398,  0.8744,  0.7044,  0.4002,
         0.6345,  0.2039,  0.3604,  0.3841,  0.7282,  0.0534,  0.8492,
         0.7948,  0.8060,  0.7690,  0.9890,  0.9428,  0.8659,  0.7111,
         0.5869,  0.8421,  0.1554,  0.2846,  0.1200,  0.7271,  0.0317,
         0.3715,  0.6354,  0.4606,  0.0467,  0.8828,  0.8482,  0.4873,
         0.8955,  0.1149,  0.8025,  0.7056,  0.8638,  0.3110,  0.7176,
         0.7169,  0.8054,  0.5834,  0.9128,  0.8149,  0.2296,  0.1834,
         0.3113,  0.1816,  0.3724,  0.7011,  0.9067,  0.7536,  0.6921,
         0.8690,  0.6269,  0.8522,  0.1621,  0.8867,  0.3341,  0.8233,
         0.0886,  0.8173,  0.7854,  0.2102,  0.5365,  0.0281,  0.0817,
         0.1632,  0.5870,  0.5473,  0.1973,  0.5786,  0.8031,  0.8336,
         0.7110,  0.7685,  0.0652,  0.7559,  0.1816,  0.1985,  0.1624,
         0.9830,  0.6248,  0.6278,  0.6944,  0.4098,  0.8689,  0.4588,
         0.9206,  0.6433,  0.5382,  0.0748,  0.8714,  0.3366,  0.2186,
         0.9194,  0.7776,  0.9105,  0.0824,  0.3236,  0.6511,  0.5951,
         0.8012,  0.6310,  0.8030,  0.9147,  0.6739,  0.9142,  0.5000,
         0.9031,  0.1695,  0.0889,  0.0538,  0.9475,  0.7007,  0.7339,
         0.7898,  0.7644,  0.0742,  0.8215,  0.0899,  0.7382,  0.9272,
         0.7612,  0.2756,  0.2956,  0.6868,  0.2782,  0.8221,  0.2033,
         0.7944,  0.1497,  0.3371,  0.0597,  0.2149,  0.0227,  0.8735,
         0.5042,  0.7921,  0.3029,  0.1260,  0.1528,  0.3980,  0.0615,
         0.2652,  0.5035,  0.9200,  0.6758,  0.0939,  0.1422,  0.5922,
         0.7909,  0.8336,  0.3964,  0.1533,  0.4928,  0.8094,  0.1757,
         0.8881,  0.8642,  0.1930,  0.7619,  0.2287,  0.0543,  0.1449,
         0.4239,  0.1782,  0.9194,  0.9903,  0.1055,  0.2826,  0.0987,
         0.6208,  0.8073,  0.2589,  0.6679,  0.4249,  0.1076,  0.1668,
         0.8066,  0.4573,  0.1463,  0.8393,  0.7432,  0.4475,  0.6923,
         0.2036,  0.1770,  0.8202,  0.8095,  0.0557,  0.6306,  0.1995,
         0.2026,  0.1845,  0.1999,  0.7264,  0.2092,  0.8891,  0.5297,
         0.1562,  0.8333,  0.3823,  0.2824,  0.9337,  0.7094,  0.1777,
         0.7769,  0.7239,  0.6261,  0.8670,  0.8972,  0.3168,  0.5628,
         0.8799,  0.1621,  0.7122,  0.3777,  0.7496,  0.8827,  0.5226,
         0.8685,  0.9022,  0.9857,  0.8010,  0.7938,  0.8232,  0.7832,
         0.8092,  0.6751,  0.8739,  0.8635,  0.7897,  0.7161,  0.3423,
         0.2580,  0.6896,  0.5808,  0.4394,  0.9174,  0.7210,  0.3629,
         0.1042,  0.4827,  0.1717,  0.9736,  0.9107,  0.7477,  0.7698,
         0.9628,  0.7828,  0.7783,  0.4031,  0.8940,  0.1861,  0.8088,
         0.2171,  0.9611,  0.8100,  0.6752,  0.9130,  0.0323,  0.1612,
         0.4565,  0.7452,  0.3977,  0.7919,  0.7189,  0.7914,  0.3388,
         0.0857,  0.8142,  0.7390,  0.2512,  0.8252,  0.0265,  0.8389,
         0.0903,  0.7442,  0.7735,  0.6781,  0.2751,  0.2113,  0.6351,
         0.2337,  0.4704,  0.6505,  0.7920,  0.8999,  0.1366,  0.7216,
         0.0788,  0.6887,  0.2968,  0.4123,  0.6118,  0.8201,  0.8611,
         0.7837,  0.4029,  0.8062,  0.9152,  0.5130,  0.8893,  0.5214,
         0.7147,  0.0641,  0.2001,  0.8215,  0.2396,  0.7251,  0.8410,
         0.8516,  0.4847,  0.4022,  0.2041,  0.8172,  0.1022,  0.6083,
         0.3319,  0.4536,  0.9469,  0.8085,  0.6189,  0.9593,  0.9026,
         0.7257,  0.3391,  0.7445,  0.4119,  0.7780,  0.9097,  0.8750,
         0.5958,  0.4213,  0.1666,  0.7236,  0.6631,  0.6023,  0.5045,
         0.0282,  0.6823,  0.7917,  0.5137,  0.3746,  0.6453,  0.7791,
         0.9863,  0.6821,  0.6056,  0.2336,  0.2456,  0.2609,  0.9150,
         0.9590,  0.4925,  0.8207,  0.5306,  0.5953,  0.4312,  0.9722,
         0.1410,  0.6402,  0.0879,  0.6276,  0.2053,  0.1221,  0.3710,
         0.6380,  0.6557,  0.2619,  0.6834,  0.6383,  0.7649,  0.8546,
         0.7734], device='cuda:0')
tensor(0.4513, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6515,  0.1940,  0.8886,  0.8616,  0.7254,  0.6634,  0.4327,
         0.3478,  0.8473,  0.9639,  0.9933,  0.1465,  0.7401,  0.9434,
         0.7555,  0.2458,  0.0483,  0.8574,  0.0195,  0.3689,  0.3719,
         0.0866,  0.4191,  0.2571,  0.3071,  0.6989,  0.3733,  0.7502,
         0.8800,  0.1607,  0.3904,  0.3204,  0.0607,  0.4691,  0.2950,
         0.1691,  0.8265,  0.3528,  0.1583,  0.5051,  0.0661,  0.9713,
         0.1714,  0.0827,  0.8044,  0.8545,  0.7452,  0.8065,  0.8395,
         0.6701,  0.3407,  0.6288,  0.3911,  0.3016,  0.5400,  0.8229,
         0.3628,  0.0227,  0.4470,  0.5392,  0.2296,  0.8852,  0.1317,
         0.5734,  0.1671,  0.7952,  0.4112,  0.6318,  0.4635,  0.7370,
         0.7106,  0.4962,  0.1311,  0.7840,  0.8407,  0.1519,  0.7440,
         0.2362,  0.0469,  0.6834,  0.8234,  0.5108,  0.5047,  0.6819,
         0.5380,  0.4125,  0.3524,  0.2686,  0.8227,  0.9070,  0.7254,
         0.3957,  0.3928,  0.4365,  0.1745,  0.8871,  0.7931,  0.0736,
         0.9223,  0.8427,  0.0640,  0.4239,  0.6351,  0.7383,  0.8856,
         0.9400,  0.4921,  0.4214,  0.7527,  0.1278,  0.6790,  0.7873,
         0.7597,  0.8455,  0.5342,  0.7753,  0.6038,  0.9946,  0.3673,
         0.2745,  0.2487,  0.2388,  0.7124,  0.9898,  0.1539,  0.3204,
         0.5988,  0.7602,  0.2189,  0.2408,  0.6336,  0.6249,  0.6856,
         0.9562,  0.3536,  0.7749,  0.2492,  0.9888,  0.0907,  0.9704,
         0.7595,  0.8445,  0.6600,  0.5273,  0.2167,  0.7920,  0.6710,
         0.7589,  0.1701,  0.8357,  0.2479,  0.3850,  0.2229,  0.9589,
         0.3377,  0.2788,  0.5530,  0.0995,  0.7780,  0.9950,  0.7698,
         0.9166,  0.0397,  0.2970,  0.1187,  0.2379,  0.2832,  0.0905,
         0.9517,  0.9940,  0.5127,  0.2653,  0.6114,  0.9422,  0.0854,
         0.4578,  0.8424,  0.3184,  0.6259,  0.2025,  0.7820,  0.5292,
         0.9855,  0.0450,  0.2223,  0.8693,  0.0482,  0.7705,  0.8570,
         0.9164,  0.1773,  0.6881,  0.6372,  0.2639,  0.0183,  0.6073,
         0.9590,  0.2259,  0.7907,  0.0334,  0.1334,  0.7401,  0.0928,
         0.2299,  0.9346,  0.2498,  0.8976,  0.0524,  0.5329,  0.9121,
         0.9725,  0.6241,  0.2755,  0.0995,  0.8109,  0.4464,  0.4332,
         0.3074,  0.2765,  0.9420,  0.8038,  0.7348,  0.2247,  0.1489,
         0.0576,  0.2469,  0.0234,  0.4384,  0.3947,  0.5348,  0.3971,
         0.6936,  0.9003,  0.7524,  0.7288,  0.2532,  0.6636,  0.3289,
         0.8289,  0.7620,  0.5773,  0.3496,  0.6381,  0.1237,  0.6912,
         0.7378,  0.9903,  0.7543,  0.7106,  0.7460,  0.2232,  0.6797,
         0.4031,  0.1718,  0.3850,  0.9365,  0.3846,  0.8342,  0.5982,
         0.9313,  0.0985,  0.4895,  0.5471,  0.8032,  0.9728,  0.3735,
         0.9790,  0.5900,  0.1662,  0.0628,  0.4683,  0.7286,  0.2919,
         0.3254,  0.7381,  0.9448,  0.0973,  0.8781,  0.3057,  0.7866,
         0.9725,  0.1527,  0.9640,  0.9923,  0.9718,  0.7622,  0.1454,
         0.7670,  0.2237,  0.9501,  0.8037,  0.7968,  0.1944,  0.2314,
         0.7520,  0.2494,  0.2479,  0.1797,  0.7131,  0.6218,  0.1461,
         0.0819,  0.1249,  0.9904,  0.5896,  0.5946,  0.0902,  0.7552,
         0.8906,  0.3645,  0.7834,  0.6806,  0.3195,  0.1195,  0.8240,
         0.5805,  0.8375,  0.8210,  0.3584,  0.6741,  0.2230,  0.0931,
         0.3035,  0.6292,  0.4172,  0.2826,  0.1744,  0.4560,  0.8945,
         0.5478,  0.4592,  0.0853,  0.5250,  0.3198,  0.3849,  0.6941,
         0.8663,  0.6161,  0.3461,  0.5043,  0.9669,  0.5291,  0.0464,
         0.0688,  0.0786,  0.1423,  0.3109,  0.7473,  0.0607,  0.7787,
         0.6157,  0.4415,  0.8450,  0.8824,  0.9444,  0.6145,  0.7675,
         0.0697,  0.7238,  0.8431,  0.7913,  0.4145,  0.5026,  0.0462,
         0.2223,  0.5065,  0.5644,  0.6116,  0.7709,  0.0468,  0.0334,
         0.1085,  0.6763,  0.2470,  0.3081,  0.1152,  0.3138,  0.8136,
         0.8273,  0.2071,  0.6168,  0.7763,  0.7526,  0.6852,  0.7053,
         0.1601,  0.0333,  0.8906,  0.2965,  0.3868,  0.3744,  0.1144,
         0.6954,  0.2726,  0.8014,  0.7660,  0.2362,  0.9135,  0.6993,
         0.9519,  0.5927,  0.8826,  0.9454,  0.8925,  0.5225,  0.5777,
         0.1620,  0.7619,  0.0224,  0.4947,  0.7456,  0.3269,  0.6178,
         0.1638,  0.9485,  0.4932,  0.0304,  0.1470,  0.5802,  0.4205,
         0.7638,  0.5783,  0.2648,  0.2195,  0.7006,  0.1009,  0.5643,
         0.0461,  0.9726,  0.7589,  0.8470,  0.1254,  0.0993,  0.7792,
         0.4023,  0.8380,  0.4939,  0.9373,  0.6754,  0.8606,  0.0571,
         0.0477,  0.8048,  0.1722,  0.8540,  0.9470,  0.6266,  0.5981,
         0.5996,  0.5631,  0.1528,  0.6790,  0.8079,  0.1940,  0.5854,
         0.8821,  0.1281,  0.1437,  0.6812,  0.1965,  0.4956,  0.1511,
         0.1230,  0.8930,  0.7222,  0.2949,  0.8094,  0.7549,  0.6970,
         0.6959,  0.0970,  0.5825,  0.7878,  0.7128,  0.9133,  0.6810,
         0.4097,  0.3415,  0.3043,  0.8847,  0.8750,  0.4475,  0.3412,
         0.8117,  0.8602,  0.5346,  0.9326,  0.9058,  0.1348,  0.8937,
         0.9294,  0.7194,  0.7454,  0.9057,  0.7323,  0.9583,  0.2804,
         0.0178,  0.4435,  0.6968,  0.1502,  0.8638,  0.1902,  0.1851,
         0.9886,  0.0898,  0.2410,  0.6569,  0.8327,  0.4395,  0.8963,
         0.6250], device='cuda:0')
tensor(0.4439, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6449,  0.6809,  0.5461,  0.5920,  0.2215,  0.6267,  0.5388,
         0.5006,  0.0789,  0.7310,  0.1523,  0.3710,  0.4867,  0.3359,
         0.1539,  0.2628,  0.9498,  0.8502,  0.9438,  0.3390,  0.8015,
         0.7020,  0.4893,  0.4311,  0.0830,  0.7256,  0.1754,  0.3389,
         0.1446,  0.1511,  0.0610,  0.8144,  0.1602,  0.2769,  0.8242,
         0.0033,  0.7366,  0.7134,  0.2494,  0.6568,  0.7388,  0.7811,
         0.6529,  0.3725,  0.6668,  0.6382,  0.1613,  0.6098,  0.0230,
         0.2398,  0.4853,  0.7398,  0.2756,  0.5439,  0.3326,  0.6870,
         0.1721,  0.4244,  0.2860,  0.5448,  0.3805,  0.8399,  0.2441,
         0.0596,  0.8610,  0.2435,  0.8689,  0.5133,  0.9012,  0.0601,
         0.9422,  0.7964,  0.1719,  0.3362,  0.0527,  0.5874,  0.8764,
         0.8218,  0.3107,  0.8550,  0.3041,  0.3324,  0.1066,  0.3253,
         0.7933,  0.0712,  0.5744,  0.1673,  0.1797,  0.9515,  0.7003,
         0.7156,  0.8730,  0.6937,  0.1390,  0.2931,  0.7507,  0.3363,
         0.1529,  0.6068,  0.9038,  0.5497,  0.0703,  0.3719,  0.2163,
         0.9085,  0.2548,  0.4681,  0.2940,  0.2023,  0.2364,  0.6853,
         0.4188,  0.0181,  0.8624,  0.4944,  0.1130,  0.5277,  0.6101,
         0.3914,  0.9844,  0.4245,  0.8918,  0.7371,  0.1329,  0.0759,
         0.6923,  0.0892,  0.0791,  0.9032,  0.1594,  0.8087,  0.7460,
         0.3630,  0.6142,  0.9787,  0.4967,  0.6497,  0.6949,  0.7134,
         0.6227,  0.9311,  0.0315,  0.2668,  0.6123,  0.6753,  0.7848,
         0.8419,  0.4714,  0.6952,  0.1041,  0.7006,  0.6697,  0.0486,
         0.3985,  0.0875,  0.3056,  0.1056,  0.7995,  0.3581,  0.8577,
         0.6475,  0.6049,  0.9957,  0.1148,  0.6250,  0.1346,  0.4878,
         0.2043,  0.7315,  0.3662,  0.2857,  0.5653,  0.4958,  0.8825,
         0.4711,  0.3716,  0.8961,  0.3827,  0.3452,  0.0338,  0.8019,
         0.1488,  0.4509,  0.0328,  0.5891,  0.3345,  0.7542,  0.6953,
         0.4237,  0.3310,  0.7767,  0.8877,  0.5231,  0.2958,  0.7610,
         0.0878,  0.9865,  0.3942,  0.2585,  0.2575,  0.3440,  0.8254,
         0.8167,  0.7494,  0.1732,  0.1709,  0.9032,  0.4017,  0.6862,
         0.3358,  0.4936,  0.2111,  0.3660,  0.2622,  0.2207,  0.0874,
         0.1529,  0.1714,  0.5993,  0.0853,  0.7906,  0.6704,  0.5449,
         0.5004,  0.8038,  0.2509,  0.6055,  0.1172,  0.4015,  0.0968,
         0.1461,  0.7365,  0.7347,  0.2333,  0.2461,  0.9310,  0.0129,
         0.2602,  0.5424,  0.3211,  0.3460,  0.0762,  0.5897,  0.1627,
         0.1393,  0.5202,  0.1480,  0.0334,  0.1996,  0.7765,  0.6645,
         0.5872,  0.2876,  0.7038,  0.0496,  0.7349,  0.9472,  0.1542,
         0.0476,  0.1344,  0.7422,  0.3625,  0.2835,  0.7457,  0.1786,
         0.2784,  0.3589,  0.8563,  0.1738,  0.1561,  0.9301,  0.3054,
         0.6973,  0.7820,  0.7274,  0.0413,  0.1370,  0.3078,  0.0860,
         0.2791,  0.1145,  0.1245,  0.5779,  0.7636,  0.9052,  0.8021,
         0.2729,  0.2569,  0.2457,  0.7043,  0.7711,  0.6423,  0.6571,
         0.1744,  0.8034,  0.2624,  0.4833,  0.4799,  0.5183,  0.5781,
         0.6139,  0.1500,  0.2925,  0.8308,  0.9099,  0.6501,  0.3478,
         0.2401,  0.6336,  0.2241,  0.5596,  0.1796,  0.2832,  0.2734,
         0.9245,  0.9357,  0.9339,  0.5333,  0.9016,  0.0074,  0.2026,
         0.8067,  0.1581,  0.0155,  0.4144,  0.2859,  0.5883,  0.2950,
         0.6593,  0.1649,  0.2234,  0.0670,  0.6267,  0.9063,  0.0971,
         0.3459,  0.1434,  0.9709,  0.1455,  0.1010,  0.0335,  0.7811,
         0.1826,  0.1840,  0.8025,  0.5238,  0.8379,  0.0662,  0.8032,
         0.1227,  0.2727,  0.0492,  0.3948,  0.2364,  0.8986,  0.1500,
         0.5664,  0.3608,  0.1592,  0.7107,  0.2881,  0.1686,  0.3874,
         0.1876,  0.5867,  0.9214,  0.1342,  0.2579,  0.8938,  0.6458,
         0.2118,  0.3048,  0.6053,  0.5298,  0.6450,  0.0844,  0.4255,
         0.1599,  0.7860,  0.3931,  0.4122,  0.0799,  0.8663,  0.7577,
         0.0279,  0.7380,  0.1066,  0.1415,  0.0504,  0.6658,  0.8278,
         0.4276,  0.3771,  0.0329,  0.2454,  0.9958,  0.8748,  0.9335,
         0.7239,  0.8376,  0.3763,  0.0497,  0.0422,  0.6142,  0.5076,
         0.6935,  0.2614,  0.7241,  0.7380,  0.2859,  0.0969,  0.1306,
         0.4073,  0.0936,  0.0969,  0.0122,  0.1976,  0.0638,  0.9161,
         0.9675,  0.7302,  0.0935,  0.2358,  0.8814,  0.6014,  0.6239,
         0.9616,  0.6783,  0.3763,  0.7497,  0.0622,  0.4274,  0.1449,
         0.1451,  0.2288,  0.2714,  0.5295,  0.0350,  0.1563,  0.2483,
         0.6033,  0.0261,  0.1094,  0.1338,  0.2238,  0.2423,  0.4521,
         0.7786,  0.8157,  0.1504,  0.4128,  0.8402,  0.1375,  0.1940,
         0.7663,  0.1726,  0.3011,  0.7376,  0.6386,  0.0313,  0.8110,
         0.5839,  0.1100,  0.8344,  0.2880,  0.7210,  0.0403,  0.1054,
         0.2397,  0.7513,  0.9967,  0.3196,  0.7564,  0.0301,  0.1740,
         0.2554,  0.1115,  0.8024,  0.8337,  0.4244,  0.6448,  0.1490,
         0.3059,  0.1435,  0.4526,  0.8520,  0.0543,  0.7379,  0.3630,
         0.2395,  0.7895,  0.1048,  0.3761,  0.1668,  0.3551,  0.7434,
         0.1746,  0.3862,  0.8489,  0.2748,  0.7397,  0.8704,  0.4616,
         0.8184,  0.2514,  0.5816,  0.9783,  0.1517,  0.0786,  0.7024,
         0.6664], device='cuda:0')
tensor(0.4439, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4131,  0.3567,  0.1090,  0.2182,  0.8389,  0.8916,  0.1360,
         0.8481,  0.7259,  0.9406,  0.1121,  0.4286,  0.5597,  0.1720,
         0.4953,  0.6269,  0.1733,  0.0880,  0.0475,  0.2682,  0.8007,
         0.2701,  0.8230,  0.4625,  0.1079,  0.9375,  0.4115,  0.2000,
         0.1794,  0.6650,  0.1675,  0.9722,  0.1610,  0.1906,  0.8275,
         0.5508,  0.0903,  0.6141,  0.8810,  0.1421,  0.9762,  0.0544,
         0.0995,  0.2944,  0.9907,  0.1505,  0.5589,  0.1105,  0.2697,
         0.6421,  0.9448,  0.8270,  0.6088,  0.3520,  0.1168,  0.7847,
         0.6060,  0.1738,  0.7999,  0.2204,  0.2623,  0.3529,  0.2720,
         0.2567,  0.5437,  0.0598,  0.1433,  0.7792,  0.9455,  0.1062,
         0.8269,  0.9262,  0.2881,  0.9015,  0.0458,  0.7415,  0.6186,
         0.6867,  0.1235,  0.9557,  0.1496,  0.0495,  0.1517,  0.1321,
         0.2189,  0.5106,  0.1427,  0.0223,  0.7863,  0.3778,  0.8712,
         0.8222,  0.3297,  0.6478,  0.0828,  0.9506,  0.6471,  0.9134,
         0.4432,  0.1112,  0.9889,  0.5504,  0.4913,  0.0247,  0.7357,
         0.0419,  0.0140,  0.1782,  0.7025,  0.5022,  0.0644,  0.0328,
         0.8911,  0.2680,  0.1891,  0.1469,  0.7302,  0.7719,  0.2492,
         0.2446,  0.1296,  0.3863,  0.4815,  0.5785,  0.8352,  0.7813,
         0.9312,  0.2945,  0.7273,  0.0850,  0.6482,  0.2983,  0.2391,
         0.6193,  0.2533,  0.2049,  0.2575,  0.1905,  0.2050,  0.2531,
         0.6254,  0.9137,  0.3425,  0.1001,  0.4293,  0.9389,  0.1749,
         0.9015,  0.3320,  0.1863,  0.0719,  0.2718,  0.2040,  0.1288,
         0.8267,  0.7847,  0.7780,  0.0386,  0.8026,  0.0317,  0.3958,
         0.2830,  0.6470,  0.0255,  0.7512,  0.6527,  0.0624,  0.0906,
         0.0136,  0.8408,  0.7475,  0.7380,  0.3041,  0.4658,  0.8503,
         0.3380,  0.9744,  0.2010,  0.9909,  0.5737,  0.8269,  0.7549,
         0.9520,  0.0983,  0.8714,  0.0146,  0.9747,  0.8634,  0.7004,
         0.4589,  0.1405,  0.3150,  0.1185,  0.2562,  0.3867,  0.1671,
         0.7337,  0.2260,  0.7189,  0.6445,  0.0686,  0.2036,  0.3028,
         0.6995,  0.1669,  0.5288,  0.1035,  0.1831,  0.2301,  0.2375,
         0.9375,  0.3091,  0.1430,  0.6758,  0.0460,  0.1440,  0.0690,
         0.8719,  0.0783,  0.0322,  0.1086,  0.6112,  0.8179,  0.8060,
         0.6195,  0.3527,  0.1466,  0.8248,  0.8257,  0.2157,  0.1761,
         0.9895,  0.8150,  0.8096,  0.8739,  0.1244,  0.8822,  0.2952,
         0.9530,  0.1804,  0.2320,  0.0675,  0.1411,  0.8951,  0.4397,
         0.0492,  0.1611,  0.5783,  0.7081,  0.1254,  0.8466,  0.2016,
         0.8257,  0.5811,  0.7472,  0.0274,  0.0449,  0.6499,  0.1090,
         0.3349,  0.1054,  0.9297,  0.1265,  0.7044,  0.5119,  0.6004,
         0.8345,  0.4386,  0.4348,  0.1353,  0.3188,  0.0599,  0.0481,
         0.0676,  0.8859,  0.3444,  0.4348,  0.3066,  0.7739,  0.5485,
         0.2591,  0.0181,  0.0451,  0.7249,  0.2041,  0.8955,  0.3107,
         0.2896,  0.6972,  0.1358,  0.1794,  0.6318,  0.8517,  0.1405,
         0.5555,  0.1386,  0.9507,  0.3805,  0.4285,  0.6138,  0.1773,
         0.1763,  0.1519,  0.3766,  0.7263,  0.3920,  0.3076,  0.0537,
         0.0819,  0.2410,  0.8265,  0.4795,  0.1111,  0.2777,  0.8824,
         0.0996,  0.9722,  0.8203,  0.5125,  0.7892,  0.6326,  0.2624,
         0.1038,  0.0959,  0.6524,  0.7740,  0.0739,  0.0921,  0.0239,
         0.3245,  0.4706,  0.3095,  0.2532,  0.5548,  0.4606,  0.0677,
         0.2846,  0.6551,  0.6602,  0.5382,  0.8082,  0.7540,  0.2315,
         0.6832,  0.6655,  0.0174,  0.1744,  0.8684,  0.0857,  0.0224,
         0.2384,  0.7315,  0.3107,  0.9194,  0.3424,  0.3662,  0.7372,
         0.1662,  0.3623,  0.2899,  0.6103,  0.9076,  0.1708,  0.1264,
         0.1686,  0.1773,  0.3941,  0.5120,  0.4973,  0.2247,  0.1888,
         0.4271,  0.0749,  0.0208,  0.2692,  0.5768,  0.0629,  0.5706,
         0.6582,  0.1119,  0.7516,  0.8970,  0.2352,  0.1941,  0.2808,
         0.0498,  0.3692,  0.4947,  0.2492,  0.7282,  0.8143,  0.7901,
         0.7094,  0.8415,  0.7973,  0.2808,  0.2081,  0.5659,  0.2358,
         0.3582,  0.1732,  0.0390,  0.2081,  0.7292,  0.3185,  0.6184,
         0.8487,  0.5217,  0.4605,  0.2491,  0.9648,  0.5713,  0.2441,
         0.0260,  0.2762,  0.1656,  0.8495,  0.0725,  0.2317,  0.0814,
         0.5017,  0.2245,  0.3655,  0.0377,  0.9885,  0.9567,  0.8812,
         0.3274,  0.9264,  0.9041,  0.8745,  0.6541,  0.1903,  0.8785,
         0.2380,  0.2547,  0.9558,  0.4664,  0.8561,  0.7067,  0.0488,
         0.3829,  0.6977,  0.0259,  0.6835,  0.8233,  0.8880,  0.0624,
         0.7556,  0.4170,  0.4597,  0.7364,  0.0114,  0.7894,  0.0173,
         0.8805,  0.0643,  0.4785,  0.4152,  0.0293,  0.4362,  0.6714,
         0.0590,  0.2707,  0.3450,  0.5898,  0.1822,  0.1726,  0.1557,
         0.4180,  0.8229,  0.4379,  0.1146,  0.1026,  0.1022,  0.7938,
         0.0873,  0.5472,  0.8548,  0.0815,  0.6548,  0.6400,  0.6525,
         0.2056,  0.4507,  0.1060,  0.3214,  0.7380,  0.5315,  0.4713,
         0.7071,  0.0858,  0.8723,  0.1348,  0.4594,  0.2862,  0.7665,
         0.6494,  0.3876,  0.7044,  0.2711,  0.9141,  0.3217,  0.4788,
         0.0778,  0.0497,  0.1297,  0.5636,  0.0711,  0.6582,  0.3465,
         0.1377], device='cuda:0')
tensor(0.4387, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7413,  0.0797,  0.7843,  0.8341,  0.6158,  0.4266,  0.1051,
         0.1047,  0.2676,  0.0866,  0.1415,  0.6676,  0.8276,  0.1865,
         0.3974,  0.0433,  0.1562,  0.0498,  0.7551,  0.9437,  0.7308,
         0.9462,  0.0309,  0.0387,  0.2740,  0.8876,  0.2684,  0.7434,
         0.6164,  0.1463,  0.4059,  0.1601,  0.0760,  0.1345,  0.5895,
         0.3275,  0.9717,  0.1815,  0.0700,  0.6801,  0.3840,  0.6588,
         0.9283,  0.0627,  0.3718,  0.7699,  0.1432,  0.5628,  0.2091,
         0.3959,  0.0399,  0.6293,  0.6665,  0.5720,  0.1591,  0.7482,
         0.0934,  0.0598,  0.4401,  0.0376,  0.6666,  0.6021,  0.6285,
         0.1589,  0.5169,  0.1402,  0.8760,  0.1292,  0.1748,  0.7052,
         0.2131,  0.2731,  0.0551,  0.0899,  0.4710,  0.4370,  0.0864,
         0.5043,  0.3085,  0.2774,  0.1427,  0.1240,  0.4034,  0.8047,
         0.1113,  0.6667,  0.1178,  0.8478,  0.3524,  0.4758,  0.0150,
         0.1265,  0.3114,  0.0517,  0.1890,  0.7808,  0.1254,  0.6660,
         0.2708,  0.1144,  0.1213,  0.2442,  0.6868,  0.0515,  0.8485,
         0.7976,  0.1040,  0.2771,  0.3021,  0.0914,  0.3681,  0.8127,
         0.2983,  0.5879,  0.4187,  0.4154,  0.3665,  0.2778,  0.3445,
         0.1734,  0.9349,  0.3520,  0.5546,  0.9672,  0.3111,  0.2372,
         0.1088,  0.2533,  0.6087,  0.1385,  0.3981,  0.2209,  0.7029,
         0.1422,  0.5564,  0.9554,  0.8267,  0.0528,  0.0568,  0.6153,
         0.2832,  0.3560,  0.0646,  0.0797,  0.5616,  0.6445,  0.0616,
         0.1138,  0.1090,  0.4990,  0.2503,  0.2098,  0.9582,  0.1682,
         0.0450,  0.2047,  0.4530,  0.1492,  0.7502,  0.9555,  0.0403,
         0.1573,  0.2084,  0.0677,  0.1534,  0.6895,  0.0397,  0.7840,
         0.2032,  0.5568,  0.1433,  0.9242,  0.2560,  0.2707,  0.1933,
         0.1838,  0.4890,  0.6058,  0.9884,  0.5589,  0.3283,  0.0371,
         0.8234,  0.0363,  0.9338,  0.4168,  0.8979,  0.7710,  0.7127,
         0.0493,  0.8144,  0.1975,  0.5650,  0.5284,  0.5655,  0.1130,
         0.0899,  0.4472,  0.1018,  0.4526,  0.9509,  0.2141,  0.3285,
         0.5806,  0.2078,  0.5708,  0.1727,  0.0405,  0.8238,  0.8917,
         0.7867,  0.9550,  0.6568,  0.1562,  0.6083,  0.2083,  0.6731,
         0.2719,  0.0197,  0.0475,  0.3315,  0.8165,  0.2499,  0.3946,
         0.8462,  0.0970,  0.3066,  0.0940,  0.7039,  0.9840,  0.4306,
         0.2187,  0.1277,  0.0464,  0.5828,  0.4582,  0.3159,  0.9122,
         0.5354,  0.1628,  0.8654,  0.3782,  0.2877,  0.7428,  0.4561,
         0.2017,  0.0248,  0.8580,  0.6759,  0.5576,  0.2415,  0.2798,
         0.0532,  0.0904,  0.1514,  0.7296,  0.5101,  0.0253,  0.7604,
         0.3793,  0.3241,  0.6626,  0.4728,  0.5890,  0.0630,  0.6659,
         0.5404,  0.1113,  0.1044,  0.7465,  0.2995,  0.8105,  0.9349,
         0.1222,  0.6900,  0.8234,  0.4368,  0.3162,  0.0171,  0.9398,
         0.6838,  0.1073,  0.4787,  0.5944,  0.0560,  0.4877,  0.8041,
         0.0645,  0.5789,  0.1104,  0.5328,  0.6997,  0.2372,  0.8497,
         0.2778,  0.0497,  0.1797,  0.3946,  0.9719,  0.0286,  0.6334,
         0.0929,  0.0879,  0.1545,  0.1401,  0.2383,  0.3351,  0.2290,
         0.0687,  0.5573,  0.1343,  0.3794,  0.4416,  0.4508,  0.1485,
         0.6177,  0.4738,  0.2219,  0.1352,  0.4582,  0.6288,  0.4190,
         0.1441,  0.7243,  0.0980,  0.4576,  0.1799,  0.1412,  0.0794,
         0.0733,  0.6565,  0.0981,  0.7954,  0.2129,  0.5889,  0.9221,
         0.0404,  0.0769,  0.5660,  0.6088,  0.1448,  0.1241,  0.5886,
         0.7047,  0.5562,  0.0756,  0.0695,  0.5034,  0.0338,  0.0483,
         0.1587,  0.6727,  0.4359,  0.0992,  0.0955,  0.9475,  0.3102,
         0.9828,  0.4292,  0.4089,  0.2542,  0.0675,  0.8171,  0.0939,
         0.5112,  0.3600,  0.3671,  0.5810,  0.0244,  0.8943,  0.8694,
         0.6611,  0.0816,  0.2922,  0.0538,  0.7223,  0.1470,  0.9742,
         0.7535,  0.2041,  0.1728,  0.0764,  0.3061,  0.0356,  0.4147,
         0.8760,  0.1840,  0.0495,  0.1751,  0.2571,  0.2045,  0.9322,
         0.2914,  0.6643,  0.5467,  0.3750,  0.0675,  0.0486,  0.2549,
         0.0187,  0.2263,  0.8870,  0.8464,  0.9683,  0.1359,  0.1596,
         0.2666,  0.1288,  0.1747,  0.1442,  0.3310,  0.8681,  0.1320,
         0.7903,  0.6261,  0.5464,  0.1939,  0.4952,  0.8783,  0.0998,
         0.0244,  0.4267,  0.0799,  0.6842,  0.1701,  0.6708,  0.2250,
         0.7635,  0.9073,  0.6341,  0.1536,  0.4813,  0.1989,  0.3383,
         0.1259,  0.2568,  0.0475,  0.5279,  0.2112,  0.2145,  0.3445,
         0.5595,  0.2136,  0.5356,  0.5848,  0.9185,  0.0338,  0.2731,
         0.2295,  0.9934,  0.1267,  0.2282,  0.3174,  0.1724,  0.1756,
         0.2129,  0.7749,  0.7114,  0.1583,  0.1296,  0.0184,  0.3524,
         0.7967,  0.1902,  0.8857,  0.9414,  0.6854,  0.9496,  0.2790,
         0.6380,  0.1254,  0.2660,  0.6203,  0.2993,  0.0824,  0.4298,
         0.5568,  0.9183,  0.2989,  0.0547,  0.9022,  0.9523,  0.7976,
         0.1270,  0.6629,  0.1380,  0.6074,  0.5289,  0.4306,  0.9776,
         0.0194,  0.9025,  0.0115,  0.0408,  0.1070,  0.6904,  0.6977,
         0.2923,  0.1739,  0.8386,  0.4164,  0.1698,  0.5555,  0.1040,
         0.3067,  0.6710,  0.8083,  0.9667,  0.0674,  0.3053,  0.2382,
         0.2724], device='cuda:0')
tensor(0.5318, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1384,  0.1068,  0.0939,  0.5790,  0.3217,  0.1971,  0.6829,
         0.0147,  0.7085,  0.8898,  0.7316,  0.1664,  0.1396,  0.5196,
         0.1575,  0.0773,  0.2963,  0.1472,  0.9014,  0.5167,  0.6411,
         0.0540,  0.2288,  0.0348,  0.0059,  0.5474,  0.2609,  0.5825,
         0.0254,  0.0601,  0.0725,  0.3361,  0.8684,  0.6429,  0.4559,
         0.0496,  0.4738,  0.5655,  0.2708,  0.2860,  0.6778,  0.9960,
         0.7114,  0.6254,  0.1574,  0.5445,  0.5383,  0.4277,  0.1127,
         0.2034,  0.1585,  0.0685,  0.1191,  0.0744,  0.1794,  0.1556,
         0.8122,  0.1429,  0.4502,  0.9171,  0.2221,  0.2206,  0.1282,
         0.7637,  0.7713,  0.5279,  0.8585,  0.4047,  0.9750,  0.8295,
         0.0506,  0.1023,  0.0463,  0.2266,  0.0813,  0.2330,  0.4020,
         0.0334,  0.3333,  0.0700,  0.0177,  0.0744,  0.8433,  0.0183,
         0.7636,  0.7319,  0.2210,  0.4676,  0.8403,  0.6019,  0.8528,
         0.2416,  0.1544,  0.2582,  0.0822,  0.5002,  0.2296,  0.9009,
         0.8003,  0.1202,  0.1518,  0.2063,  0.8918,  0.0184,  0.4333,
         0.8120,  0.2092,  0.0578,  0.7071,  0.0505,  0.9417,  0.3628,
         0.2205,  0.0617,  0.6195,  0.1208,  0.3556,  0.0833,  0.1088,
         0.2302,  0.8977,  0.0065,  0.6796,  0.1059,  0.0977,  0.3038,
         0.8228,  0.1023,  0.8491,  0.2392,  0.3806,  0.7857,  0.3654,
         0.1125,  0.4220,  0.1708,  0.2499,  0.8458,  0.0463,  0.8514,
         0.1110,  0.1530,  0.6340,  0.7205,  0.0553,  0.3194,  0.6408,
         0.0875,  0.3125,  0.3549,  0.3381,  0.2169,  0.0798,  0.9756,
         0.0830,  0.3878,  0.9536,  0.3604,  0.1741,  0.0760,  0.0867,
         0.7074,  0.1860,  0.5299,  0.5847,  0.0304,  0.3175,  0.1569,
         0.8071,  0.2854,  0.4952,  0.5678,  0.7042,  0.0654,  0.1344,
         0.2798,  0.3871,  0.0976,  0.1256,  0.6946,  0.2968,  0.2410,
         0.1246,  0.1237,  0.8280,  0.6880,  0.5801,  0.4302,  0.2770,
         0.9124,  0.0117,  0.2816,  0.5381,  0.0744,  0.7629,  0.9254,
         0.4555,  0.0794,  0.3479,  0.1727,  0.6243,  0.8922,  0.1297,
         0.0438,  0.0470,  0.6021,  0.1242,  0.1894,  0.5345,  0.9233,
         0.9518,  0.1506,  0.3209,  0.7478,  0.6670,  0.7730,  0.1615,
         0.8534,  0.5828,  0.1330,  0.1686,  0.0122,  0.4549,  0.1427,
         0.1471,  0.5971,  0.1440,  0.8726,  0.2928,  0.7375,  0.8385,
         0.4093,  0.0335,  0.6205,  0.0527,  0.8637,  0.4128,  0.7337,
         0.8058,  0.2695,  0.5585,  0.1086,  0.0249,  0.7306,  0.1619,
         0.8442,  0.2488,  0.6619,  0.5969,  0.6530,  0.1213,  0.2933,
         0.1101,  0.6006,  0.8691,  0.7087,  0.3053,  0.8343,  0.7979,
         0.0783,  0.3865,  0.7498,  0.0891,  0.0087,  0.5721,  0.3144,
         0.5809,  0.5883,  0.8124,  0.1225,  0.8103,  0.2930,  0.1429,
         0.1444,  0.2327,  0.2625,  0.7612,  0.0769,  0.2158,  0.8994,
         0.4402,  0.6441,  0.3661,  0.8648,  0.0104,  0.2131,  0.4805,
         0.5957,  0.9512,  0.4957,  0.2196,  0.1104,  0.7953,  0.0711,
         0.5551,  0.2610,  0.9250,  0.0471,  0.1936,  0.4841,  0.6142,
         0.9393,  0.7721,  0.8382,  0.8115,  0.1530,  0.1320,  0.2129,
         0.6707,  0.2980,  0.2329,  0.3105,  0.2604,  0.6503,  0.0204,
         0.9280,  0.1268,  0.8812,  0.3387,  0.0976,  0.0422,  0.5610,
         0.3972,  0.1788,  0.2603,  0.6546,  0.1701,  0.0346,  0.3582,
         0.2641,  0.9496,  0.0777,  0.9826,  0.9781,  0.5421,  0.9892,
         0.8597,  0.7148,  0.1585,  0.8447,  0.9695,  0.7870,  0.5074,
         0.6147,  0.5775,  0.0200,  0.8101,  0.2569,  0.2147,  0.8373,
         0.2400,  0.1470,  0.6767,  0.9339,  0.5128,  0.5444,  0.3901,
         0.2340,  0.0637,  0.9460,  0.2587,  0.1443,  0.0671,  0.6631,
         0.6384,  0.0268,  0.1317,  0.7111,  0.9544,  0.7420,  0.6287,
         0.8412,  0.2776,  0.4800,  0.2267,  0.2279,  0.3244,  0.4430,
         0.1642,  0.0257,  0.1323,  0.6937,  0.5078,  0.0438,  0.8226,
         0.0230,  0.0906,  0.8737,  0.3780,  0.6205,  0.0767,  0.6052,
         0.0725,  0.2097,  0.2197,  0.1600,  0.2300,  0.0345,  0.8449,
         0.5276,  0.4922,  0.8637,  0.1586,  0.0860,  0.5310,  0.8353,
         0.0833,  0.1976,  0.7963,  0.1147,  0.0231,  0.0793,  0.5101,
         0.7879,  0.3611,  0.1581,  0.0667,  0.8609,  0.3539,  0.0879,
         0.1529,  0.0484,  0.6925,  0.6426,  0.8732,  0.7662,  0.0085,
         0.1010,  0.3284,  0.0863,  0.1678,  0.0868,  0.0160,  0.0792,
         0.6250,  0.2761,  0.3562,  0.5447,  0.1092,  0.0622,  0.1677,
         0.0298,  0.4494,  0.0497,  0.1290,  0.7443,  0.8512,  0.2630,
         0.8111,  0.7154,  0.0297,  0.0586,  0.6262,  0.1055,  0.2831,
         0.0978,  0.3581,  0.8576,  0.7626,  0.0308,  0.8469,  0.5911,
         0.0563,  0.1912,  0.9229,  0.2901,  0.9329,  0.7456,  0.8197,
         0.0125,  0.8353,  0.2291,  0.6988,  0.8045,  0.7408,  0.7601,
         0.0177,  0.9766,  0.0388,  0.5593,  0.5664,  0.4498,  0.1890,
         0.4196,  0.8611,  0.2587,  0.8838,  0.9432,  0.2141,  0.3326,
         0.0190,  0.7450,  0.1661,  0.1778,  0.8321,  0.1580,  0.1185,
         0.1894,  0.9043,  0.1714,  0.5820,  0.2113,  0.0413,  0.1344,
         0.1007,  0.3642,  0.0537,  0.0349,  0.7008,  0.2749,  0.1861,
         0.8940], device='cuda:0')
tensor(0.3891, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0854,  0.9152,  0.5284,  0.0753,  0.7373,  0.0634,  0.1633,
         0.0560,  0.9854,  0.1118,  0.5243,  0.1374,  0.3728,  0.8742,
         0.7659,  0.1381,  0.9189,  0.9171,  0.3904,  0.1757,  0.7107,
         0.3229,  0.2535,  0.5016,  0.1401,  0.0562,  0.6462,  0.2750,
         0.3226,  0.8303,  0.3577,  0.6586,  0.9257,  0.6725,  0.0661,
         0.2609,  0.1922,  0.1296,  0.1916,  0.7629,  0.1224,  0.0461,
         0.5768,  0.0506,  0.9318,  0.1207,  0.6456,  0.1531,  0.9103,
         0.5928,  0.9640,  0.5154,  0.6781,  0.1800,  0.1791,  0.0223,
         0.9190,  0.0910,  0.7484,  0.7055,  0.8633,  0.7832,  0.5394,
         0.8638,  0.9262,  0.9057,  0.5812,  0.6728,  0.8285,  0.6038,
         0.0235,  0.9080,  0.4454,  0.4992,  0.8765,  0.2120,  0.0372,
         0.2100,  0.0826,  0.8212,  0.3069,  0.1305,  0.8770,  0.1646,
         0.1600,  0.8264,  0.6664,  0.0976,  0.9300,  0.8852,  0.0662,
         0.4381,  0.1672,  0.6457,  0.1730,  0.7731,  0.1701,  0.3679,
         0.2984,  0.7940,  0.8702,  0.9209,  0.9110,  0.8016,  0.9198,
         0.8051,  0.8496,  0.2908,  0.8908,  0.0424,  0.7972,  0.0611,
         0.1409,  0.8575,  0.5071,  0.1463,  0.8059,  0.3321,  0.1465,
         0.2549,  0.9454,  0.9068,  0.6940,  0.1699,  0.9051,  0.4959,
         0.7974,  0.0508,  0.7703,  0.1065,  0.5731,  0.0977,  0.2012,
         0.0814,  0.9099,  0.8998,  0.2067,  0.8755,  0.0698,  0.7223,
         0.3595,  0.7409,  0.2304,  0.1393,  0.5902,  0.2494,  0.7107,
         0.9196,  0.1078,  0.6074,  0.5550,  0.7762,  0.1068,  0.6495,
         0.7726,  0.1536,  0.2267,  0.0539,  0.9156,  0.7755,  0.0160,
         0.0402,  0.1903,  0.7023,  0.0845,  0.0537,  0.8224,  0.2856,
         0.9871,  0.7326,  0.2437,  0.0965,  0.7929,  0.0831,  0.6418,
         0.9869,  0.7312,  0.9030,  0.5446,  0.2834,  0.2947,  0.8642,
         0.8622,  0.7930,  0.7069,  0.5405,  0.0493,  0.1717,  0.0359,
         0.7935,  0.8371,  0.0379,  0.4845,  0.8559,  0.0416,  0.7395,
         0.0971,  0.1714,  0.0720,  0.7106,  0.2988,  0.8400,  0.1220,
         0.9596,  0.7973,  0.0246,  0.9338,  0.2703,  0.9181,  0.1157,
         0.5092,  0.6063,  0.2325,  0.4210,  0.0682,  0.5482,  0.8458,
         0.2666,  0.5748,  0.6852,  0.4947,  0.8976,  0.7859,  0.7558,
         0.1776,  0.9033,  0.8519,  0.1530,  0.1978,  0.8386,  0.9800,
         0.8901,  0.0736,  0.6563,  0.8436,  0.7655,  0.6061,  0.2232,
         0.7983,  0.8450,  0.9181,  0.8257,  0.8687,  0.9936,  0.1092,
         0.0461,  0.2107,  0.9892,  0.9139,  0.9930,  0.6455,  0.3301,
         0.0539,  0.5602,  0.6336,  0.9258,  0.7546,  0.4496,  0.8840,
         0.8796,  0.9494,  0.4402,  0.5418,  0.5149,  0.9369,  0.1064,
         0.1086,  0.9179,  0.7891,  0.8621,  0.4670,  0.8113,  0.3083,
         0.7820,  0.7788,  0.8948,  0.8755,  0.3429,  0.7917,  0.3044,
         0.1539,  0.3903,  0.9842,  0.8529,  0.2036,  0.5384,  0.9406,
         0.9435,  0.7946,  0.8739,  0.1666,  0.0884,  0.1120,  0.0996,
         0.9171,  0.9156,  0.1337,  0.4655,  0.8168,  0.2375,  0.1598,
         0.0751,  0.8767,  0.0491,  0.0282,  0.7887,  0.3425,  0.9669,
         0.0822,  0.8345,  0.3482,  0.4855,  0.0631,  0.1600,  0.3252,
         0.0560,  0.2895,  0.7424,  0.6198,  0.8107,  0.2352,  0.7066,
         0.6529,  0.5227,  0.1182,  0.2309,  0.0820,  0.0114,  0.5441,
         0.1593,  0.5926,  0.8063,  0.1354,  0.3190,  0.8473,  0.6214,
         0.2657,  0.2380,  0.0397,  0.0345,  0.7191,  0.1396,  0.2070,
         0.1661,  0.7586,  0.9399,  0.0992,  0.1081,  0.3943,  0.8706,
         0.2273,  0.0324,  0.1150,  0.1445,  0.2004,  0.6139,  0.2027,
         0.9413,  0.1232,  0.1656,  0.4421,  0.8585,  0.7400,  0.4213,
         0.7281,  0.1548,  0.0934,  0.2821,  0.2120,  0.6807,  0.2170,
         0.0325,  0.3023,  0.0992,  0.9109,  0.7286,  0.0647,  0.8874,
         0.6822,  0.1295,  0.1016,  0.0096,  0.0497,  0.1521,  0.1145,
         0.1134,  0.8439,  0.1937,  0.1280,  0.0914,  0.4494,  0.4747,
         0.2222,  0.2830,  0.8623,  0.2084,  0.1606,  0.0915,  0.0686,
         0.8949,  0.7460,  0.3002,  0.9715,  0.1551,  0.0470,  0.7658,
         0.7844,  0.4002,  0.7536,  0.1200,  0.1701,  0.4077,  0.8354,
         0.2054,  0.1782,  0.4171,  0.1326,  0.9429,  0.1494,  0.9532,
         0.7869,  0.9258,  0.0994,  0.9384,  0.6516,  0.4550,  0.9389,
         0.7597,  0.0460,  0.1350,  0.2075,  0.1517,  0.0856,  0.8997,
         0.7444,  0.6849,  0.3243,  0.8054,  0.2578,  0.8886,  0.2312,
         0.7640,  0.3361,  0.8503,  0.6846,  0.9008,  0.0541,  0.9227,
         0.5645,  0.1542,  0.6905,  0.5513,  0.9117,  0.0596,  0.0648,
         0.1939,  0.8728,  0.8174,  0.0413,  0.9150,  0.0393,  0.0966,
         0.2984,  0.0109,  0.9114,  0.0376,  0.9153,  0.6280,  0.7962,
         0.1267,  0.4729,  0.3999,  0.4972,  0.7876,  0.9839,  0.1360,
         0.1473,  0.1351,  0.2839,  0.9792,  0.0434,  0.1442,  0.8195,
         0.6748,  0.2075,  0.6491,  0.2693,  0.0268,  0.0126,  0.9851,
         0.0436,  0.0107,  0.6286,  0.3747,  0.9548,  0.8422,  0.6385,
         0.1161,  0.5972,  0.1653,  0.8460,  0.8986,  0.4327,  0.7399,
         0.7489,  0.7714,  0.7434,  0.3596,  0.9881,  0.0624,  0.4949,
         0.9861], device='cuda:0')
tensor(0.4155, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1363,  0.4701,  0.9506,  0.2316,  0.1275,  0.8808,  0.9810,
         0.3437,  0.9569,  0.7858,  0.6127,  0.0867,  0.2048,  0.7632,
         0.0852,  0.0858,  0.9281,  0.9624,  0.2168,  0.3132,  0.2262,
         0.9908,  0.9954,  0.2124,  0.0900,  0.0579,  0.2001,  0.7830,
         0.8180,  0.9196,  0.0860,  0.2855,  0.1284,  0.9364,  0.7026,
         0.0791,  0.1738,  0.2310,  0.5283,  0.8893,  0.2501,  0.2889,
         0.5480,  0.6960,  0.2015,  0.6984,  0.8206,  0.8977,  0.9199,
         0.0490,  0.3694,  0.2884,  0.8176,  0.0429,  0.1298,  0.1139,
         0.7414,  0.4574,  0.6110,  0.4822,  0.0933,  0.2696,  0.0374,
         0.8780,  0.9740,  0.9323,  0.7604,  0.1974,  0.0528,  0.0271,
         0.7233,  0.9089,  0.1022,  0.1144,  0.9201,  0.0518,  0.5843,
         0.2812,  0.1350,  0.8217,  0.8703,  0.3553,  0.8701,  0.4126,
         0.0277,  0.9474,  0.0203,  0.8770,  0.0857,  0.8712,  0.9209,
         0.9926,  0.6256,  0.2080,  0.0519,  0.6372,  0.5433,  0.8021,
         0.8310,  0.1010,  0.0086,  0.8788,  0.8730,  0.6875,  0.1569,
         0.0916,  0.7631,  0.0647,  0.5754,  0.1022,  0.9022,  0.1404,
         0.1208,  0.2741,  0.2134,  0.1020,  0.7824,  0.0588,  0.4695,
         0.7128,  0.5226,  0.1948,  0.9608,  0.8528,  0.4770,  0.1687,
         0.8723,  0.0491,  0.7546,  0.7601,  0.4044,  0.2796,  0.4263,
         0.0438,  0.5814,  0.0830,  0.6306,  0.9083,  0.0974,  0.0685,
         0.4381,  0.8823,  0.4938,  0.4143,  0.6659,  0.2397,  0.8121,
         0.4787,  0.1108,  0.7436,  0.9478,  0.3889,  0.4602,  0.7968,
         0.0533,  0.6851,  0.0143,  0.7700,  0.6790,  0.9110,  0.0652,
         0.8776,  0.2425,  0.9684,  0.0621,  0.0325,  0.2412,  0.5713,
         0.7116,  0.9876,  0.8299,  0.7817,  0.8743,  0.1318,  0.7407,
         0.0206,  0.3479,  0.7017,  0.0748,  0.4530,  0.0322,  0.3935,
         0.9957,  0.3524,  0.6727,  0.8398,  0.7728,  0.1817,  0.4198,
         0.7392,  0.8029,  0.2970,  0.4695,  0.9038,  0.1651,  0.9915,
         0.1135,  0.0757,  0.4591,  0.8390,  0.9568,  0.2584,  0.9683,
         0.0425,  0.1119,  0.9020,  0.0541,  0.2271,  0.2690,  0.0836,
         0.2676,  0.8497,  0.0428,  0.8977,  0.9188,  0.1268,  0.7702,
         0.8048,  0.0923,  0.8206,  0.8763,  0.5147,  0.8238,  0.9159,
         0.9636,  0.0535,  0.8220,  0.8943,  0.9292,  0.8548,  0.8325,
         0.0554,  0.1039,  0.0330,  0.0563,  0.7347,  0.0390,  0.0395,
         0.8775,  0.1593,  0.2191,  0.1384,  0.9168,  0.0223,  0.5368,
         0.1436,  0.9713,  0.1704,  0.3571,  0.9227,  0.2035,  0.9235,
         0.5157,  0.8841,  0.9757,  0.6866,  0.9132,  0.0879,  0.7760,
         0.9075,  0.8005,  0.2092,  0.2496,  0.2339,  0.3251,  0.0791,
         0.7987,  0.9216,  0.9362,  0.8063,  0.8640,  0.0714,  0.1994,
         0.9485,  0.8519,  0.1053,  0.0911,  0.1468,  0.4813,  0.5443,
         0.0140,  0.7331,  0.7708,  0.8292,  0.9394,  0.3818,  0.4203,
         0.0297,  0.7746,  0.1022,  0.1833,  0.1123,  0.0586,  0.8476,
         0.0726,  0.3436,  0.9747,  0.9327,  0.8955,  0.9344,  0.5134,
         0.6792,  0.1863,  0.8070,  0.9258,  0.9164,  0.9533,  0.6773,
         0.8446,  0.0206,  0.2909,  0.3743,  0.9558,  0.1843,  0.9051,
         0.3748,  0.7199,  0.2301,  0.3134,  0.7947,  0.9139,  0.0703,
         0.7972,  0.1405,  0.2697,  0.0272,  0.1941,  0.1553,  0.5501,
         0.9028,  0.4567,  0.7143,  0.9198,  0.3920,  0.1641,  0.0392,
         0.3301,  0.0181,  0.9005,  0.8156,  0.9769,  0.0976,  0.8245,
         0.9507,  0.5812,  0.8957,  0.8374,  0.3802,  0.7260,  0.2468,
         0.8727,  0.6084,  0.8881,  0.9420,  0.0367,  0.8387,  0.8586,
         0.7771,  0.7784,  0.0941,  0.6084,  0.1223,  0.8389,  0.0386,
         0.0905,  0.3594,  0.4369,  0.7465,  0.8049,  0.3805,  0.7841,
         0.2170,  0.1357,  0.3153,  0.8260,  0.9308,  0.8260,  0.0306,
         0.5097,  0.9965,  0.1569,  0.0734,  0.6836,  0.3635,  0.9652,
         0.5068,  0.9143,  0.2666,  0.3214,  0.1212,  0.8815,  0.7563,
         0.2579,  0.8245,  0.2965,  0.7441,  0.1895,  0.1158,  0.8077,
         0.9537,  0.4966,  0.4840,  0.1215,  0.0390,  0.7627,  0.0234,
         0.9209,  0.7262,  0.6839,  0.4412,  0.2665,  0.4950,  0.5293,
         0.0646,  0.7984,  0.9228,  0.4667,  0.8156,  0.9283,  0.0393,
         0.3298,  0.2770,  0.9757,  0.0669,  0.7796,  0.0809,  0.2319,
         0.0549,  0.8248,  0.1467,  0.9135,  0.3134,  0.1356,  0.1028,
         0.2585,  0.5932,  0.6271,  0.9215,  0.6555,  0.1540,  0.8779,
         0.9534,  0.0185,  0.8637,  0.1471,  0.9752,  0.9079,  0.2496,
         0.0763,  0.5284,  0.3124,  0.2146,  0.2991,  0.8987,  0.8850,
         0.8121,  0.8204,  0.6004,  0.0801,  0.0555,  0.8704,  0.3233,
         0.6892,  0.1397,  0.1423,  0.1197,  0.0592,  0.6874,  0.9092,
         0.0398,  0.0972,  0.5034,  0.8964,  0.9513,  0.0635,  0.2721,
         0.0299,  0.9584,  0.2467,  0.7662,  0.2697,  0.0268,  0.0934,
         0.0926,  0.1302,  0.1177,  0.0933,  0.1441,  0.1604,  0.5554,
         0.9684,  0.9906,  0.7988,  0.1424,  0.3538,  0.0395,  0.0095,
         0.0164,  0.1302,  0.8591,  0.1022,  0.7715,  0.2838,  0.0124,
         0.1036,  0.8785,  0.6614,  0.6934,  0.5136,  0.7959,  0.6993,
         0.0860], device='cuda:0')
tensor(0.4154, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5917,  0.9017,  0.7402,  0.8663,  0.6354,  0.7949,  0.0183,
         0.1521,  0.6389,  0.9917,  0.7629,  0.8765,  0.8809,  0.0377,
         0.7401,  0.8895,  0.7904,  0.9356,  0.9460,  0.1468,  0.9321,
         0.1174,  0.9213,  0.0379,  0.8793,  0.8331,  0.9416,  0.4390,
         0.0785,  0.8309,  0.9898,  0.8032,  0.8315,  0.8677,  0.8975,
         0.3407,  0.1583,  0.1583,  0.8216,  0.4428,  0.5311,  0.1066,
         0.0127,  0.8802,  0.0524,  0.4217,  0.6753,  0.9121,  0.9647,
         0.0171,  0.6785,  0.1848,  0.4414,  0.9697,  0.0616,  0.0563,
         0.4354,  0.8694,  0.7647,  0.0933,  0.0837,  0.9197,  0.2371,
         0.7144,  0.6994,  0.9816,  0.9934,  0.9041,  0.0750,  0.7840,
         0.1615,  0.0098,  0.8978,  0.9135,  0.9348,  0.9307,  0.8443,
         0.0884,  0.0969,  0.0528,  0.9615,  0.9415,  0.2990,  0.0789,
         0.1854,  0.7385,  0.0271,  0.9550,  0.8491,  0.9141,  0.9062,
         0.8431,  0.8300,  0.8917,  0.7121,  0.0660,  0.0789,  0.9255,
         0.7631,  0.7097,  0.9507,  0.0355,  0.4014,  0.9477,  0.6114,
         0.9721,  0.8382,  0.0823,  0.8628,  0.7789,  0.9054,  0.0686,
         0.1015,  0.1997,  0.8193,  0.2529,  0.7566,  0.6192,  0.9396,
         0.8036,  0.8254,  0.9557,  0.0410,  0.2923,  0.0335,  0.7513,
         0.8545,  0.6112,  0.8470,  0.8059,  0.8802,  0.9104,  0.2821,
         0.6304,  0.8925,  0.9102,  0.7773,  0.1298,  0.9393,  0.9392,
         0.9040,  0.0275,  0.0330,  0.8873,  0.6947,  0.8298,  0.1660,
         0.8833,  0.4276,  0.5386,  0.2258,  0.2221,  0.9256,  0.0956,
         0.0946,  0.8506,  0.8813,  0.3279,  0.8740,  0.9212,  0.1392,
         0.9033,  0.9944,  0.9623,  0.0453,  0.3937,  0.2216,  0.0054,
         0.2150,  0.9213,  0.8254,  0.8799,  0.4087,  0.1353,  0.2785,
         0.0068,  0.3391,  0.1145,  0.3949,  0.1338,  0.9020,  0.0334,
         0.0407,  0.7551,  0.2355,  0.9282,  0.9007,  0.1530,  0.9138,
         0.8830,  0.9423,  0.8140,  0.9234,  0.9757,  0.1764,  0.8401,
         0.1239,  0.1801,  0.0598,  0.1656,  0.0502,  0.8410,  0.9627,
         0.0498,  0.9005,  0.9330,  0.9388,  0.5466,  0.0133,  0.9190,
         0.8638,  0.8669,  0.2635,  0.9527,  0.6036,  0.8905,  0.6542,
         0.1173,  0.8451,  0.1844,  0.0491,  0.9639,  0.5144,  0.9201,
         0.2360,  0.3582,  0.9714,  0.1670,  0.0127,  0.8538,  0.4936,
         0.1615,  0.3545,  0.6353,  0.6769,  0.4751,  0.3061,  0.9793,
         0.1407,  0.9294,  0.8458,  0.9224,  0.9672,  0.8456,  0.8981,
         0.8235,  0.8975,  0.3301,  0.6173,  0.9600,  0.8603,  0.0941,
         0.8776,  0.9745,  0.4388,  0.6078,  0.0451,  0.8505,  0.5888,
         0.8832,  0.9505,  0.3245,  0.6206,  0.9070,  0.2218,  0.2364,
         0.0265,  0.9397,  0.8857,  0.9288,  0.9846,  0.8064,  0.8232,
         0.9375,  0.1560,  0.0895,  0.8826,  0.7539,  0.8638,  0.9714,
         0.2265,  0.9618,  0.1183,  0.4713,  0.8813,  0.3557,  0.3541,
         0.1408,  0.9963,  0.8983,  0.3124,  0.1160,  0.7899,  0.0761,
         0.8978,  0.6517,  0.9916,  0.2497,  0.0089,  0.2542,  0.6754,
         0.8892,  0.9432,  0.0442,  0.0347,  0.4643,  0.9813,  0.9602,
         0.7173,  0.7571,  0.9191,  0.9018,  0.9191,  0.1886,  0.9743,
         0.8189,  0.7830,  0.5660,  0.7191,  0.9332,  0.4491,  0.9506,
         0.7511,  0.8149,  0.1095,  0.8328,  0.1058,  0.9377,  0.9573,
         0.9346,  0.8773,  0.1240,  0.7544,  0.1162,  0.0745,  0.2670,
         0.0698,  0.1469,  0.0689,  0.1497,  0.4392,  0.8437,  0.1303,
         0.7353,  0.9619,  0.1286,  0.0774,  0.3770,  0.4154,  0.9854,
         0.6393,  0.8278,  0.5343,  0.9913,  0.9303,  0.8186,  0.9289,
         0.0938,  0.2073,  0.1678,  0.1174,  0.7355,  0.1561,  0.5559,
         0.0170,  0.7288,  0.2772,  0.9623,  0.7468,  0.2672,  0.1184,
         0.7557,  0.0947,  0.5205,  0.8611,  0.9146,  0.9174,  0.4149,
         0.1886,  0.6236,  0.9389,  0.3052,  0.0393,  0.9657,  0.2458,
         0.9429,  0.2524,  0.0566,  0.8224,  0.1550,  0.1140,  0.7210,
         0.8478,  0.5750,  0.9089,  0.6122,  0.0319,  0.3260,  0.9101,
         0.1251,  0.2575,  0.8425,  0.3271,  0.9493,  0.0770,  0.2287,
         0.9726,  0.0470,  0.0508,  0.8035,  0.3725,  0.8482,  0.9101,
         0.9970,  0.8836,  0.7574,  0.2079,  0.8696,  0.0589,  0.0703,
         0.9357,  0.6759,  0.0572,  0.9179,  0.7586,  0.9634,  0.1247,
         0.8528,  0.2190,  0.2307,  0.7914,  0.5588,  0.9409,  0.1494,
         0.0735,  0.9181,  0.9954,  0.0338,  0.9642,  0.6517,  0.9038,
         0.9618,  0.0298,  0.9246,  0.8828,  0.1030,  0.9004,  0.9594,
         0.8775,  0.0894,  0.8590,  0.7836,  0.2197,  0.3967,  0.8141,
         0.8854,  0.7470,  0.9636,  0.8554,  0.2368,  0.0359,  0.8824,
         0.2790,  0.7492,  0.0865,  0.7286,  0.9366,  0.8721,  0.0412,
         0.9008,  0.2474,  0.7545,  0.8901,  0.2583,  0.1630,  0.8630,
         0.9771,  0.0512,  0.9154,  0.8990,  0.8711,  0.9365,  0.9594,
         0.9411,  0.9532,  0.8255,  0.5497,  0.6463,  0.7672,  0.1570,
         0.9214,  0.0984,  0.8321,  0.3472,  0.2427,  0.9984,  0.9708,
         0.9187,  0.2542,  0.3192,  0.1493,  0.4814,  0.9217,  0.1810,
         0.8746,  0.8816,  0.8299,  0.9151,  0.7331,  0.8994,  0.7978,
         0.8774], device='cuda:0')
tensor(0.4845, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1114,  0.9625,  0.2694,  0.8826,  0.3685,  0.1240,  0.9548,
         0.0292,  0.9367,  0.0998,  0.8228,  0.9459,  0.0354,  0.1305,
         0.8882,  0.5538,  0.3844,  0.9435,  0.9023,  0.9340,  0.2651,
         0.1019,  0.0795,  0.9505,  0.4626,  0.9461,  0.6033,  0.7329,
         0.1946,  0.0939,  0.0800,  0.1971,  0.0475,  0.2019,  0.8396,
         0.0105,  0.0560,  0.1709,  0.2368,  0.0170,  0.9769,  0.0257,
         0.1433,  0.2003,  0.8887,  0.8786,  0.1933,  0.9449,  0.1895,
         0.1650,  0.0728,  0.8882,  0.2460,  0.4508,  0.0644,  0.0663,
         0.2075,  0.8719,  0.7211,  0.9776,  0.3064,  0.0500,  0.7726,
         0.1864,  0.4573,  0.2988,  0.9328,  0.9236,  0.9247,  0.1112,
         0.9645,  0.0363,  0.7337,  0.0364,  0.3514,  0.3671,  0.9062,
         0.0352,  0.4211,  0.0733,  0.8343,  0.9172,  0.0163,  0.9855,
         0.8727,  0.1205,  0.9513,  0.8999,  0.9803,  0.9473,  0.0665,
         0.8057,  0.0532,  0.0147,  0.9554,  0.6454,  0.9050,  0.0791,
         0.9242,  0.9157,  0.0089,  0.1131,  0.2411,  0.8956,  0.1087,
         0.8349,  0.0447,  0.0941,  0.0898,  0.2976,  0.9384,  0.7273,
         0.3387,  0.8329,  0.8605,  0.9354,  0.0574,  0.8675,  0.2396,
         0.8728,  0.5153,  0.0328,  0.7624,  0.0573,  0.9237,  0.0523,
         0.0723,  0.3720,  0.1981,  0.9344,  0.2663,  0.3784,  0.4480,
         0.9060,  0.1804,  0.8993,  0.6448,  0.0888,  0.9496,  0.0202,
         0.7765,  0.4220,  0.4871,  0.3837,  0.9672,  0.2077,  0.0248,
         0.1801,  0.1732,  0.9621,  0.3887,  0.9679,  0.7566,  0.1060,
         0.8022,  0.1453,  0.7855,  0.1142,  0.3973,  0.0598,  0.9109,
         0.1899,  0.8701,  0.7422,  0.0860,  0.8089,  0.2679,  0.4174,
         0.1660,  0.9418,  0.1326,  0.3019,  0.7262,  0.1163,  0.0369,
         0.9740,  0.8299,  0.3844,  0.9066,  0.4607,  0.8422,  0.8323,
         0.0518,  0.1157,  0.8407,  0.2042,  0.0215,  0.7714,  0.9361,
         0.9913,  0.9861,  0.1313,  0.0035,  0.6254,  0.0627,  0.8478,
         0.9317,  0.0296,  0.2515,  0.4254,  0.0901,  0.2776,  0.6236,
         0.6080,  0.9948,  0.9016,  0.9799,  0.0528,  0.0584,  0.8680,
         0.8300,  0.0167,  0.9829,  0.8892,  0.9106,  0.7739,  0.0100,
         0.9934,  0.8360,  0.8736,  0.0663,  0.1331,  0.0610,  0.6533,
         0.6062,  0.9768,  0.6987,  0.8755,  0.9431,  0.9985,  0.0479,
         0.0284,  0.7966,  0.0508,  0.8924,  0.8822,  0.9453,  0.0210,
         0.5700,  0.9014,  0.5165,  0.2374,  0.5174,  0.7830,  0.1023,
         0.0416,  0.7560,  0.8449,  0.1291,  0.3020,  0.6514,  0.8327,
         0.0707,  0.0985,  0.9478,  0.0476,  0.8399,  0.0710,  0.9599,
         0.9419,  0.9145,  0.2404,  0.4092,  0.9363,  0.8661,  0.7108,
         0.0556,  0.2035,  0.5652,  0.0906,  0.9337,  0.4864,  0.0469,
         0.5367,  0.2050,  0.5111,  0.2957,  0.0450,  0.2884,  0.8888,
         0.8793,  0.0972,  0.8976,  0.8992,  0.7812,  0.7071,  0.7896,
         0.9588,  0.0886,  0.7968,  0.3035,  0.9333,  0.2467,  0.3410,
         0.0928,  0.0778,  0.7866,  0.9788,  0.1629,  0.1829,  0.7486,
         0.1135,  0.9152,  0.1202,  0.4058,  0.1459,  0.1616,  0.2427,
         0.0372,  0.9373,  0.7520,  0.8903,  0.9125,  0.0643,  0.6834,
         0.1109,  0.8393,  0.9107,  0.0516,  0.3087,  0.9030,  0.1155,
         0.9063,  0.9380,  0.2134,  0.9341,  0.9250,  0.9623,  0.1983,
         0.8989,  0.9970,  0.8794,  0.8393,  0.9937,  0.7327,  0.9198,
         0.8536,  0.4368,  0.1556,  0.8864,  0.0275,  0.9869,  0.8378,
         0.2889,  0.1042,  0.8895,  0.9949,  0.8954,  0.9289,  0.0266,
         0.5953,  0.0155,  0.8036,  0.9385,  0.9195,  0.9105,  0.2957,
         0.1550,  0.3653,  0.0570,  0.9096,  0.8749,  0.3875,  0.0197,
         0.0965,  0.8796,  0.7630,  0.8835,  0.1638,  0.7939,  0.1387,
         0.8403,  0.9580,  0.0773,  0.0079,  0.2186,  0.2065,  0.9362,
         0.9089,  0.8852,  0.8760,  0.0546,  0.4683,  0.5561,  0.1057,
         0.9587,  0.0953,  0.7573,  0.8735,  0.1052,  0.1115,  0.6615,
         0.9490,  0.9784,  0.4403,  0.9345,  0.8420,  0.9934,  0.0778,
         0.0809,  0.9072,  0.9370,  0.8987,  0.9046,  0.1120,  0.0272,
         0.8855,  0.2198,  0.8738,  0.1759,  0.8506,  0.0776,  0.1619,
         0.9653,  0.8954,  0.2973,  0.1807,  0.1046,  0.4576,  0.6210,
         0.4539,  0.8263,  0.0151,  0.8788,  0.9959,  0.9026,  0.9157,
         0.9309,  0.9436,  0.2800,  0.9972,  0.9206,  0.9043,  0.5931,
         0.0420,  0.0536,  0.9221,  0.7462,  0.9196,  0.8274,  0.1186,
         0.8681,  0.9393,  0.8477,  0.0568,  0.0741,  0.1078,  0.9500,
         0.6730,  0.8485,  0.0283,  0.0420,  0.0926,  0.8549,  0.7332,
         0.8237,  0.9711,  0.9269,  0.9446,  0.1657,  0.9290,  0.4694,
         0.8987,  0.2178,  0.9940,  0.1394,  0.0471,  0.9146,  0.7998,
         0.2783,  0.6329,  0.5922,  0.7712,  0.7840,  0.0874,  0.8899,
         0.8963,  0.6476,  0.9042,  0.0752,  0.3796,  0.8775,  0.9039,
         0.2693,  0.8967,  0.9545,  0.9226,  0.3544,  0.1689,  0.5938,
         0.6543,  0.2528,  0.2017,  0.1468,  0.9741,  0.1487,  0.8398,
         0.8676,  0.9592,  0.9139,  0.2431,  0.9081,  0.0253,  0.0593,
         0.0804,  0.9839,  0.8991,  0.1129,  0.9743,  0.2335,  0.5477,
         0.8250], device='cuda:0')
tensor(0.4279, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0794,  0.5497,  0.8007,  0.7395,  0.2194,  0.9452,  0.8423,
         0.4234,  0.7846,  0.3719,  0.8937,  0.8099,  0.8200,  0.9538,
         0.7457,  0.9106,  0.9443,  0.0201,  0.5968,  0.2907,  0.0311,
         0.9142,  0.8356,  0.7521,  0.0860,  0.2129,  0.0547,  0.8149,
         0.7195,  0.8539,  0.0708,  0.9367,  0.9320,  0.2360,  0.8471,
         0.9263,  0.9513,  0.1053,  0.0505,  0.0763,  0.0416,  0.6352,
         0.4098,  0.0332,  0.9198,  0.8668,  0.8108,  0.8625,  0.9918,
         0.3641,  0.8581,  0.2703,  0.8624,  0.8645,  0.1168,  0.8515,
         0.7567,  0.7216,  0.9153,  0.0727,  0.9399,  0.1279,  0.0855,
         0.0404,  0.7333,  0.7365,  0.0694,  0.7093,  0.7136,  0.0830,
         0.8182,  0.1124,  0.0372,  0.0424,  0.1660,  0.2236,  0.0664,
         0.4344,  0.8677,  0.0948,  0.7347,  0.7959,  0.9248,  0.0489,
         0.9556,  0.8539,  0.3010,  0.0819,  0.2127,  0.8900,  0.0105,
         0.0091,  0.1544,  0.8927,  0.1547,  0.2277,  0.7398,  0.6846,
         0.7997,  0.0778,  0.1573,  0.9345,  0.9098,  0.2786,  0.8698,
         0.0296,  0.8575,  0.8874,  0.0499,  0.9287,  0.9679,  0.8978,
         0.1584,  0.0480,  0.1039,  0.8036,  0.8050,  0.9876,  0.8757,
         0.0151,  0.7343,  0.7726,  0.8578,  0.1454,  0.8975,  0.0603,
         0.7922,  0.9260,  0.9379,  0.3159,  0.9910,  0.9237,  0.7029,
         0.9465,  0.7195,  0.0118,  0.2043,  0.2111,  0.9476,  0.0985,
         0.1018,  0.2770,  0.4915,  0.1497,  0.8358,  0.0494,  0.1156,
         0.4762,  0.3065,  0.1400,  0.8743,  0.9543,  0.9258,  0.7309,
         0.6094,  0.7206,  0.1184,  0.8627,  0.9043,  0.3167,  0.9971,
         0.9309,  0.0499,  0.0807,  0.6962,  0.4722,  0.8900,  0.7968,
         0.4411,  0.0394,  0.8452,  0.2335,  0.7403,  0.1482,  0.3960,
         0.2590,  0.1028,  0.0050,  0.9446,  0.8719,  0.2178,  0.3597,
         0.8259,  0.2032,  0.7253,  0.9398,  0.5966,  0.9162,  0.0941,
         0.0127,  0.3308,  0.2142,  0.8939,  0.9021,  0.2500,  0.5509,
         0.0522,  0.1516,  0.1679,  0.6397,  0.1436,  0.0835,  0.6878,
         0.0300,  0.7253,  0.7953,  0.1939,  0.7141,  0.1280,  0.2314,
         0.8715,  0.0524,  0.1703,  0.4118,  0.9319,  0.7250,  0.0866,
         0.1473,  0.0516,  0.1156,  0.6877,  0.0932,  0.0647,  0.1073,
         0.5417,  0.0591,  0.7463,  0.0459,  0.4273,  0.8759,  0.8701,
         0.0532,  0.0666,  0.2121,  0.9697,  0.1125,  0.7204,  0.9618,
         0.8620,  0.1305,  0.8264,  0.0445,  0.8658,  0.4942,  0.8634,
         0.2474,  0.1284,  0.1410,  0.1677,  0.5104,  0.1644,  0.9873,
         0.9305,  0.5385,  0.2791,  0.0461,  0.7380,  0.6104,  0.2403,
         0.6231,  0.1697,  0.8833,  0.8740,  0.1370,  0.5760,  0.5377,
         0.3213,  0.9436,  0.7057,  0.1862,  0.0825,  0.1220,  0.0386,
         0.0345,  0.0756,  0.2124,  0.0315,  0.1408,  0.1568,  0.0267,
         0.6635,  0.9343,  0.0326,  0.7669,  0.6526,  0.2848,  0.6599,
         0.9170,  0.1127,  0.1779,  0.2654,  0.9900,  0.3681,  0.8650,
         0.8309,  0.5038,  0.8104,  0.1338,  0.9817,  0.0782,  0.2967,
         0.2473,  0.9064,  0.0230,  0.0658,  0.0501,  0.5472,  0.7434,
         0.3176,  0.1634,  0.3204,  0.7590,  0.6731,  0.1079,  0.5565,
         0.9141,  0.4870,  0.4797,  0.3495,  0.9827,  0.9117,  0.8351,
         0.6846,  0.1127,  0.8720,  0.0739,  0.9046,  0.3150,  0.0920,
         0.9297,  0.5859,  0.8788,  0.9092,  0.0479,  0.5318,  0.0936,
         0.2281,  0.7004,  0.0268,  0.9562,  0.8383,  0.3988,  0.8503,
         0.3511,  0.4037,  0.9413,  0.1871,  0.6959,  0.2029,  0.4472,
         0.8132,  0.2302,  0.1425,  0.9841,  0.5648,  0.2245,  0.2826,
         0.9206,  0.7451,  0.1294,  0.9378,  0.7793,  0.4219,  0.5007,
         0.7992,  0.1805,  0.8425,  0.8776,  0.0137,  0.0250,  0.1995,
         0.0995,  0.8951,  0.8209,  0.8922,  0.8762,  0.8712,  0.8173,
         0.7103,  0.8938,  0.7501,  0.4985,  0.1702,  0.0901,  0.2216,
         0.0138,  0.7977,  0.6074,  0.0474,  0.0377,  0.7470,  0.8541,
         0.1047,  0.6710,  0.8539,  0.9125,  0.9574,  0.6980,  0.6402,
         0.0538,  0.7906,  0.5903,  0.2490,  0.0640,  0.8756,  0.0262,
         0.9152,  0.0636,  0.1515,  0.9568,  0.1468,  0.0669,  0.0696,
         0.8998,  0.0764,  0.4389,  0.0429,  0.0591,  0.9356,  0.3839,
         0.1033,  0.9217,  0.6013,  0.0686,  0.6433,  0.0931,  0.8837,
         0.0993,  0.9260,  0.0587,  0.1339,  0.4436,  0.9137,  0.1490,
         0.8916,  0.8161,  0.0178,  0.0846,  0.5738,  0.1280,  0.3946,
         0.2160,  0.0443,  0.9380,  0.9954,  0.5724,  0.4054,  0.2009,
         0.8953,  0.0717,  0.9443,  0.0964,  0.8510,  0.9034,  0.8920,
         0.9265,  0.9193,  0.1506,  0.8174,  0.9670,  0.0558,  0.8967,
         0.8046,  0.1374,  0.1529,  0.9446,  0.8977,  0.0754,  0.9070,
         0.1302,  0.1136,  0.6950,  0.9642,  0.1709,  0.0827,  0.2463,
         0.1519,  0.9940,  0.8410,  0.1455,  0.7020,  0.3518,  0.9325,
         0.2290,  0.9261,  0.5074,  0.8124,  0.7550,  0.9951,  0.6847,
         0.0781,  0.9548,  0.9703,  0.0901,  0.1204,  0.7666,  0.6926,
         0.0160,  0.2264,  0.1257,  0.1092,  0.6418,  0.1898,  0.8547,
         0.9063,  0.7477,  0.1780,  0.0892,  0.7544,  0.3767,  0.1240,
         0.0489], device='cuda:0')
tensor(0.3851, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1948,  0.2486,  0.1543,  0.6946,  0.4935,  0.0204,  0.0410,
         0.1150,  0.0541,  0.0715,  0.7891,  0.6649,  0.7768,  0.0659,
         0.9652,  0.8391,  0.8769,  0.0328,  0.9224,  0.3028,  0.8568,
         0.1125,  0.8090,  0.6452,  0.5652,  0.2361,  0.9912,  0.2497,
         0.3523,  0.8353,  0.2563,  0.7799,  0.8668,  0.8875,  0.8928,
         0.1311,  0.5964,  0.9238,  0.0667,  0.0438,  0.2944,  0.0824,
         0.8436,  0.7815,  0.7700,  0.1370,  0.5263,  0.1484,  0.8137,
         0.0751,  0.9114,  0.8617,  0.9177,  0.7761,  0.9680,  0.0934,
         0.7586,  0.5112,  0.9929,  0.1340,  0.9043,  0.1229,  0.6932,
         0.1016,  0.8660,  0.9478,  0.3106,  0.8173,  0.4108,  0.0978,
         0.1084,  0.7150,  0.3666,  0.4536,  0.6437,  0.2190,  0.8731,
         0.6169,  0.8347,  0.2079,  0.0147,  0.0665,  0.0748,  0.1915,
         0.1411,  0.6217,  0.8699,  0.1047,  0.4191,  0.6772,  0.1964,
         0.4652,  0.3442,  0.0793,  0.2134,  0.8144,  0.8048,  0.6035,
         0.4942,  0.8005,  0.6995,  0.8167,  0.1512,  0.9917,  0.6791,
         0.3017,  0.6678,  0.3167,  0.8020,  0.0477,  0.1702,  0.3227,
         0.2723,  0.4960,  0.6840,  0.5861,  0.2305,  0.2660,  0.1654,
         0.0683,  0.0974,  0.9000,  0.1451,  0.6153,  0.8345,  0.7640,
         0.9850,  0.0738,  0.6538,  0.8577,  0.9653,  0.3152,  0.2066,
         0.0918,  0.7213,  0.8710,  0.3754,  0.0784,  0.3166,  0.0759,
         0.3171,  0.9111,  0.0792,  0.2768,  0.9006,  0.0987,  0.0386,
         0.0660,  0.8063,  0.0513,  0.1461,  0.7190,  0.7766,  0.6994,
         0.7907,  0.9114,  0.8340,  0.7784,  0.6202,  0.0500,  0.3223,
         0.1127,  0.7061,  0.0674,  0.4943,  0.8222,  0.1022,  0.6498,
         0.8241,  0.7219,  0.8172,  0.1351,  0.1663,  0.5804,  0.7228,
         0.8669,  0.8833,  0.8935,  0.7303,  0.2920,  0.8519,  0.4897,
         0.1255,  0.1089,  0.7625,  0.1537,  0.5437,  0.4574,  0.2391,
         0.4381,  0.6004,  0.0959,  0.7187,  0.0621,  0.7766,  0.9129,
         0.1658,  0.0591,  0.7930,  0.8023,  0.7681,  0.8188,  0.8155,
         0.7126,  0.2419,  0.8548,  0.0655,  0.8329,  0.8145,  0.8574,
         0.3552,  0.0647,  0.4187,  0.7693,  0.4509,  0.2213,  0.4643,
         0.8046,  0.7558,  0.7607,  0.6156,  0.0791,  0.7535,  0.8062,
         0.4339,  0.0820,  0.0240,  0.1221,  0.5252,  0.0313,  0.8721,
         0.1656,  0.0115,  0.6379,  0.5313,  0.8589,  0.7667,  0.1902,
         0.8673,  0.1345,  0.5033,  0.7702,  0.6592,  0.9450,  0.7687,
         0.8110,  0.8480,  0.8526,  0.5194,  0.7240,  0.9865,  0.0864,
         0.8674,  0.9384,  0.7552,  0.0359,  0.9806,  0.1521,  0.0507,
         0.3022,  0.0305,  0.7345,  0.9863,  0.0843,  0.9078,  0.6961,
         0.9080,  0.9084,  0.8218,  0.8588,  0.3032,  0.2158,  0.9091,
         0.9578,  0.4362,  0.1442,  0.8935,  0.8845,  0.1488,  0.8727,
         0.3670,  0.2463,  0.7567,  0.8393,  0.9356,  0.2219,  0.9568,
         0.9649,  0.0516,  0.2266,  0.8192,  0.8847,  0.7483,  0.7670,
         0.9633,  0.8273,  0.9795,  0.8215,  0.1563,  0.5904,  0.8639,
         0.9207,  0.8459,  0.4721,  0.1481,  0.8826,  0.8886,  0.4651,
         0.1084,  0.0822,  0.5230,  0.0784,  0.5931,  0.9233,  0.8770,
         0.6532,  0.7403,  0.8544,  0.5761,  0.3525,  0.6592,  0.2607,
         0.6443,  0.8501,  0.8999,  0.3329,  0.3001,  0.5995,  0.2702,
         0.8579,  0.8163,  0.3098,  0.1075,  0.5134,  0.8610,  0.6809,
         0.1245,  0.1265,  0.9854,  0.6750,  0.6975,  0.7566,  0.3505,
         0.1067,  0.9260,  0.8816,  0.0449,  0.4510,  0.1784,  0.6584,
         0.7892,  0.3173,  0.9069,  0.7272,  0.1478,  0.3044,  0.9053,
         0.3061,  0.0168,  0.0603,  0.2051,  0.7422,  0.6316,  0.0527,
         0.0937,  0.0045,  0.1430,  0.1641,  0.1316,  0.9278,  0.7548,
         0.5069,  0.8983,  0.1755,  0.8749,  0.2174,  0.9919,  0.2217,
         0.0214,  0.0757,  0.5382,  0.4323,  0.7987,  0.1431,  0.7086,
         0.9048,  0.7482,  0.0642,  0.8934,  0.7252,  0.0082,  0.1533,
         0.9168,  0.8787,  0.2875,  0.5960,  0.9351,  0.3803,  0.8161,
         0.8226,  0.9386,  0.9875,  0.4686,  0.6704,  0.9334,  0.1395,
         0.8268,  0.8512,  0.7693,  0.6301,  0.1993,  0.2831,  0.9903,
         0.4151,  0.1529,  0.1737,  0.7625,  0.1938,  0.8975,  0.8649,
         0.0338,  0.8212,  0.2747,  0.8077,  0.1004,  0.2186,  0.7298,
         0.1622,  0.2329,  0.6388,  0.0231,  0.8415,  0.1035,  0.9796,
         0.1648,  0.8081,  0.6034,  0.9111,  0.8143,  0.8581,  0.1281,
         0.9294,  0.2505,  0.1038,  0.7456,  0.0255,  0.4310,  0.6008,
         0.5255,  0.9388,  0.1593,  0.2294,  0.6577,  0.1940,  0.1854,
         0.8100,  0.6983,  0.9257,  0.1745,  0.0339,  0.8491,  0.1608,
         0.0407,  0.0375,  0.1401,  0.0520,  0.9548,  0.6296,  0.0683,
         0.2904,  0.1685,  0.1504,  0.8590,  0.8893,  0.2856,  0.7330,
         0.9407,  0.2600,  0.0464,  0.1268,  0.5198,  0.6316,  0.0766,
         0.9418,  0.9043,  0.7800,  0.7157,  0.9427,  0.0681,  0.0737,
         0.2310,  0.2295,  0.4461,  0.1254,  0.8472,  0.9481,  0.1053,
         0.6919,  0.0851,  0.0316,  0.3712,  0.1145,  0.3588,  0.9048,
         0.8921,  0.8848,  0.5979,  0.8855,  0.4441,  0.1757,  0.0619,
         0.8835], device='cuda:0')
tensor(0.4171, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3809,  0.0755,  0.2052,  0.0432,  0.1442,  0.0848,  0.0077,
         0.1068,  0.6703,  0.3366,  0.5753,  0.9403,  0.0754,  0.8308,
         0.1126,  0.2434,  0.8079,  0.0608,  0.9820,  0.1572,  0.1182,
         0.8771,  0.5083,  0.0453,  0.0276,  0.4410,  0.0649,  0.5982,
         0.2332,  0.8535,  0.4061,  0.3445,  0.7831,  0.8129,  0.0978,
         0.1567,  0.1235,  0.2012,  0.5497,  0.8110,  0.8303,  0.8747,
         0.6304,  0.0190,  0.0545,  0.6961,  0.8989,  0.7189,  0.8135,
         0.7918,  0.3001,  0.9806,  0.7082,  0.1445,  0.8083,  0.6593,
         0.8883,  0.7751,  0.7657,  0.9320,  0.0802,  0.3486,  0.8068,
         0.1878,  0.7633,  0.8383,  0.0235,  0.7097,  0.9547,  0.1988,
         0.5498,  0.9011,  0.7929,  0.8157,  0.7697,  0.6213,  0.6195,
         0.1626,  0.6947,  0.9274,  0.9531,  0.1113,  0.1177,  0.8493,
         0.1763,  0.0845,  0.0178,  0.0912,  0.3202,  0.0971,  0.6929,
         0.0763,  0.9646,  0.1481,  0.2076,  0.4892,  0.7241,  0.1087,
         0.3556,  0.1339,  0.5980,  0.9022,  0.2622,  0.2984,  0.0570,
         0.7398,  0.0403,  0.3158,  0.4680,  0.8161,  0.7667,  0.8738,
         0.8218,  0.0704,  0.8612,  0.7391,  0.8782,  0.1699,  0.1167,
         0.7193,  0.1671,  0.2046,  0.6522,  0.9538,  0.4477,  0.8816,
         0.9160,  0.5573,  0.6352,  0.1992,  0.7212,  0.9447,  0.9526,
         0.2125,  0.6221,  0.3360,  0.1205,  0.0608,  0.8175,  0.5842,
         0.8974,  0.6259,  0.1673,  0.8078,  0.8290,  0.7415,  0.1520,
         0.2269,  0.1236,  0.7638,  0.5162,  0.7318,  0.0549,  0.9118,
         0.3672,  0.9926,  0.0138,  0.1213,  0.1208,  0.8190,  0.8964,
         0.5028,  0.8313,  0.8734,  0.3205,  0.1887,  0.1245,  0.7969,
         0.0766,  0.1085,  0.7158,  0.8867,  0.2061,  0.1740,  0.4152,
         0.1858,  0.0731,  0.7618,  0.2886,  0.0276,  0.7280,  0.7283,
         0.0850,  0.1566,  0.6150,  0.7397,  0.1839,  0.6700,  0.7863,
         0.0553,  0.8948,  0.4845,  0.3839,  0.0295,  0.3477,  0.0399,
         0.8586,  0.4221,  0.0875,  0.0659,  0.8345,  0.8048,  0.0835,
         0.2537,  0.8117,  0.0361,  0.0563,  0.7322,  0.8272,  0.8171,
         0.3441,  0.0615,  0.6637,  0.4677,  0.2427,  0.2932,  0.7226,
         0.0888,  0.7190,  0.3271,  0.8219,  0.0644,  0.0890,  0.5398,
         0.8296,  0.7720,  0.3693,  0.8318,  0.8617,  0.2478,  0.2388,
         0.4428,  0.7707,  0.7610,  0.3088,  0.3012,  0.7966,  0.2165,
         0.0456,  0.2913,  0.7705,  0.0790,  0.1123,  0.8159,  0.4752,
         0.8257,  0.9828,  0.7821,  0.1072,  0.3814,  0.0232,  0.8322,
         0.1091,  0.1451,  0.2617,  0.3774,  0.4468,  0.8282,  0.7953,
         0.0877,  0.1127,  0.2124,  0.2361,  0.3046,  0.4269,  0.7931,
         0.6875,  0.2174,  0.6406,  0.5301,  0.0626,  0.2751,  0.4814,
         0.3499,  0.1393,  0.9411,  0.7923,  0.6787,  0.1580,  0.0902,
         0.4639,  0.6510,  0.8535,  0.8334,  0.4848,  0.0227,  0.5131,
         0.3083,  0.3230,  0.6700,  0.7629,  0.7092,  0.2279,  0.7129,
         0.9451,  0.2285,  0.6676,  0.1368,  0.1131,  0.7886,  0.6904,
         0.7640,  0.8776,  0.2932,  0.9635,  0.3722,  0.1582,  0.9286,
         0.0244,  0.1315,  0.5971,  0.8132,  0.0116,  0.5789,  0.0149,
         0.5986,  0.7434,  0.1234,  0.7600,  0.1471,  0.1891,  0.6485,
         0.6651,  0.7439,  0.1551,  0.0157,  0.0655,  0.3139,  0.0901,
         0.3806,  0.3841,  0.0766,  0.9039,  0.9241,  0.3951,  0.7700,
         0.0824,  0.5339,  0.0291,  0.1486,  0.6164,  0.2340,  0.2058,
         0.7530,  0.7825,  0.2868,  0.8096,  0.7499,  0.1988,  0.8194,
         0.1674,  0.8694,  0.9206,  0.8347,  0.8331,  0.2940,  0.3437,
         0.7275,  0.2572,  0.2326,  0.8982,  0.7619,  0.9311,  0.0086,
         0.8458,  0.4748,  0.0831,  0.9203,  0.4023,  0.4072,  0.7436,
         0.7825,  0.8999,  0.8337,  0.7391,  0.8635,  0.4922,  0.6751,
         0.7962,  0.8386,  0.0389,  0.3072,  0.9703,  0.9776,  0.0984,
         0.3838,  0.8583,  0.8647,  0.4547,  0.8149,  0.7195,  0.9178,
         0.7307,  0.1103,  0.4129,  0.4526,  0.0832,  0.1638,  0.7705,
         0.8611,  0.2022,  0.1121,  0.7953,  0.2704,  0.3803,  0.7231,
         0.1186,  0.0812,  0.9332,  0.2984,  0.8780,  0.8764,  0.6105,
         0.4101,  0.1314,  0.9925,  0.5829,  0.9048,  0.8522,  0.1119,
         0.9578,  0.0373,  0.0596,  0.8896,  0.0215,  0.9073,  0.9018,
         0.2688,  0.1068,  0.9012,  0.6262,  0.3007,  0.4742,  0.3497,
         0.0803,  0.1119,  0.1406,  0.2904,  0.7218,  0.1210,  0.5369,
         0.0429,  0.8357,  0.0856,  0.9346,  0.7342,  0.6233,  0.1588,
         0.1279,  0.2618,  0.2567,  0.9543,  0.8874,  0.3925,  0.7599,
         0.7821,  0.1806,  0.6249,  0.2929,  0.1687,  0.9136,  0.0375,
         0.2188,  0.9793,  0.3364,  0.8299,  0.2331,  0.0165,  0.7368,
         0.8757,  0.6722,  0.8292,  0.7801,  0.7808,  0.9860,  0.0944,
         0.0591,  0.3408,  0.0764,  0.8394,  0.0074,  0.5286,  0.2991,
         0.6441,  0.6348,  0.7417,  0.9214,  0.4842,  0.7613,  0.0829,
         0.1045,  0.0791,  0.3647,  0.2203,  0.1102,  0.8520,  0.9175,
         0.0372,  0.8735,  0.9255,  0.1239,  0.5257,  0.8952,  0.1089,
         0.1052,  0.6393,  0.7786,  0.8796,  0.8993,  0.2359,  0.5656,
         0.2261], device='cuda:0')
tensor(0.3959, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7654,  0.1737,  0.1914,  0.0476,  0.0194,  0.8469,  0.1064,
         0.8556,  0.0577,  0.2684,  0.1085,  0.6896,  0.8199,  0.8518,
         0.1263,  0.2919,  0.2164,  0.2783,  0.2260,  0.8834,  0.8761,
         0.8768,  0.7139,  0.8639,  0.0243,  0.6197,  0.1118,  0.3803,
         0.7515,  0.6634,  0.6233,  0.1747,  0.0986,  0.2887,  0.1165,
         0.8111,  0.7607,  0.2217,  0.9517,  0.4665,  0.1584,  0.7002,
         0.0894,  0.0334,  0.7054,  0.0693,  0.3513,  0.4893,  0.7351,
         0.1544,  0.8929,  0.2358,  0.0904,  0.2190,  0.9833,  0.8321,
         0.1223,  0.1401,  0.6014,  0.1430,  0.6474,  0.2340,  0.5705,
         0.7610,  0.6457,  0.0658,  0.1542,  0.2693,  0.6670,  0.0320,
         0.6823,  0.0371,  0.2616,  0.0799,  0.7930,  0.1055,  0.0691,
         0.4252,  0.0963,  0.4256,  0.0838,  0.8993,  0.6744,  0.0443,
         0.2841,  0.4408,  0.5300,  0.0888,  0.4714,  0.1559,  0.1116,
         0.8690,  0.0505,  0.0983,  0.2248,  0.0191,  0.5630,  0.0731,
         0.6386,  0.1576,  0.7288,  0.1775,  0.1819,  0.9013,  0.8550,
         0.0425,  0.0925,  0.6265,  0.5120,  0.5150,  0.8186,  0.9613,
         0.9192,  0.2159,  0.1220,  0.1256,  0.8530,  0.5581,  0.0365,
         0.7724,  0.5466,  0.3419,  0.2363,  0.8173,  0.0255,  0.1964,
         0.1917,  0.8276,  0.6827,  0.4491,  0.6175,  0.5410,  0.0803,
         0.5186,  0.6941,  0.9099,  0.7886,  0.3425,  0.2074,  0.1232,
         0.1826,  0.4842,  0.0073,  0.3217,  0.0938,  0.8937,  0.8327,
         0.0270,  0.8915,  0.0878,  0.9140,  0.5944,  0.5609,  0.2259,
         0.8919,  0.9833,  0.6131,  0.0370,  0.9236,  0.2637,  0.7860,
         0.1291,  0.2817,  0.3759,  0.6643,  0.1000,  0.2847,  0.2066,
         0.8238,  0.8980,  0.1352,  0.7714,  0.4482,  0.1574,  0.8279,
         0.4204,  0.1804,  0.1123,  0.5472,  0.0570,  0.6814,  0.7570,
         0.7361,  0.6588,  0.8061,  0.2622,  0.9642,  0.8056,  0.1705,
         0.2858,  0.0385,  0.8385,  0.8572,  0.1089,  0.9800,  0.5774,
         0.1425,  0.7607,  0.4644,  0.7246,  0.7931,  0.7895,  0.2677,
         0.1495,  0.0163,  0.6820,  0.3834,  0.0692,  0.9152,  0.7204,
         0.0370,  0.7783,  0.0525,  0.0464,  0.2084,  0.5472,  0.6470,
         0.3309,  0.2620,  0.1092,  0.1272,  0.6565,  0.6707,  0.0916,
         0.0556,  0.0242,  0.9927,  0.2951,  0.1844,  0.8052,  0.9205,
         0.1004,  0.3227,  0.8255,  0.8492,  0.5269,  0.8371,  0.4403,
         0.7510,  0.6950,  0.0087,  0.5452,  0.2026,  0.9352,  0.4973,
         0.2660,  0.0798,  0.9572,  0.1562,  0.8444,  0.0424,  0.9731,
         0.1420,  0.1495,  0.8530,  0.6627,  0.8761,  0.1502,  0.3190,
         0.7241,  0.8574,  0.9835,  0.0785,  0.2540,  0.0318,  0.1671,
         0.9534,  0.3584,  0.0634,  0.3512,  0.8027,  0.4830,  0.9028,
         0.7525,  0.5272,  0.1762,  0.3980,  0.7819,  0.8391,  0.7716,
         0.9350,  0.1208,  0.6634,  0.9544,  0.8534,  0.1976,  0.3486,
         0.7591,  0.6031,  0.3665,  0.8397,  0.4890,  0.1403,  0.1667,
         0.0301,  0.2948,  0.3525,  0.5949,  0.2255,  0.8795,  0.4022,
         0.6699,  0.7275,  0.5784,  0.2145,  0.3075,  0.3088,  0.8960,
         0.8092,  0.7964,  0.5728,  0.0200,  0.1664,  0.8502,  0.2912,
         0.4864,  0.6889,  0.9410,  0.1872,  0.2735,  0.5743,  0.0686,
         0.0395,  0.3486,  0.5066,  0.4236,  0.8446,  0.9099,  0.8962,
         0.9226,  0.8344,  0.8391,  0.0284,  0.8465,  0.5627,  0.4085,
         0.1060,  0.2852,  0.4642,  0.9791,  0.1443,  0.1146,  0.1322,
         0.2662,  0.9179,  0.2049,  0.2734,  0.5061,  0.3296,  0.2329,
         0.7161,  0.8702,  0.7619,  0.0319,  0.0500,  0.1196,  0.6991,
         0.3053,  0.5745,  0.2661,  0.2879,  0.8378,  0.3112,  0.6000,
         0.2690,  0.1323,  0.3251,  0.2175,  0.7151,  0.8685,  0.0756,
         0.6055,  0.0737,  0.4150,  0.9806,  0.4987,  0.8044,  0.5976,
         0.8906,  0.2733,  0.0360,  0.1419,  0.4454,  0.0243,  0.6856,
         0.9498,  0.8602,  0.8593,  0.8994,  0.1131,  0.4545,  0.0324,
         0.3911,  0.2968,  0.2876,  0.7975,  0.8945,  0.7543,  0.0864,
         0.7500,  0.7957,  0.8442,  0.8794,  0.7691,  0.0906,  0.4791,
         0.0640,  0.0789,  0.8804,  0.6169,  0.9412,  0.9246,  0.6156,
         0.0519,  0.9649,  0.1098,  0.5505,  0.6360,  0.9082,  0.6752,
         0.0450,  0.8307,  0.2409,  0.3163,  0.9591,  0.0494,  0.1086,
         0.2908,  0.0284,  0.1358,  0.3095,  0.0772,  0.9699,  0.0910,
         0.1115,  0.7274,  0.1916,  0.0929,  0.7407,  0.7793,  0.0529,
         0.0435,  0.9437,  0.2728,  0.6746,  0.7687,  0.8434,  0.6235,
         0.3117,  0.7967,  0.7082,  0.1336,  0.7487,  0.5275,  0.0178,
         0.0446,  0.1811,  0.8464,  0.1133,  0.8398,  0.4539,  0.0208,
         0.8611,  0.1185,  0.9321,  0.1034,  0.1667,  0.7237,  0.6425,
         0.7976,  0.4193,  0.1274,  0.8208,  0.5947,  0.0762,  0.1139,
         0.1611,  0.6400,  0.7070,  0.8214,  0.3548,  0.6343,  0.6859,
         0.9928,  0.6761,  0.9700,  0.7108,  0.0678,  0.0471,  0.5040,
         0.6910,  0.8877,  0.7600,  0.8329,  0.4366,  0.8640,  0.0339,
         0.3612,  0.0842,  0.8091,  0.1459,  0.0312,  0.6979,  0.2926,
         0.4455,  0.8798,  0.3111,  0.6965,  0.3690,  0.0754,  0.0480,
         0.6424], device='cuda:0')
tensor(0.4090, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1701,  0.5982,  0.3048,  0.9872,  0.1501,  0.0271,  0.1021,
         0.4510,  0.9746,  0.1257,  0.7586,  0.3545,  0.0343,  0.7852,
         0.5690,  0.5182,  0.2687,  0.9972,  0.2928,  0.1295,  0.7917,
         0.2935,  0.0638,  0.8095,  0.7015,  0.0380,  0.2426,  0.3284,
         0.1478,  0.6669,  0.1989,  0.7757,  0.1679,  0.5756,  0.1539,
         0.9487,  0.6137,  0.4292,  0.3329,  0.0274,  0.4896,  0.7692,
         0.5921,  0.8483,  0.0205,  0.8340,  0.9598,  0.1357,  0.9371,
         0.5602,  0.5693,  0.4931,  0.1576,  0.0918,  0.0477,  0.2122,
         0.9608,  0.0582,  0.7953,  0.0657,  0.1483,  0.7174,  0.6159,
         0.4475,  0.5544,  0.6020,  0.8315,  0.1740,  0.2177,  0.3717,
         0.3758,  0.8801,  0.4256,  0.1422,  0.5029,  0.1870,  0.4019,
         0.0482,  0.5016,  0.7459,  0.2619,  0.6274,  0.1598,  0.1292,
         0.0531,  0.2014,  0.7787,  0.2160,  0.4997,  0.0449,  0.9400,
         0.2828,  0.8608,  0.0403,  0.0786,  0.6442,  0.1086,  0.8403,
         0.5519,  0.9317,  0.5998,  0.7136,  0.8657,  0.0800,  0.1214,
         0.0257,  0.0532,  0.8547,  0.0142,  0.0729,  0.6478,  0.1915,
         0.2633,  0.1471,  0.9164,  0.7203,  0.8235,  0.4726,  0.6526,
         0.8187,  0.3044,  0.2124,  0.7146,  0.1918,  0.6603,  0.2139,
         0.6583,  0.0501,  0.7730,  0.7376,  0.8311,  0.1710,  0.1847,
         0.0698,  0.0679,  0.6789,  0.7513,  0.0974,  0.9450,  0.0556,
         0.0609,  0.0829,  0.6662,  0.9124,  0.8814,  0.6237,  0.8559,
         0.8798,  0.7793,  0.0551,  0.9608,  0.5934,  0.1871,  0.4709,
         0.6878,  0.1466,  0.0614,  0.2124,  0.4515,  0.0406,  0.6985,
         0.5894,  0.0630,  0.3999,  0.2682,  0.7883,  0.1919,  0.8922,
         0.5953,  0.9390,  0.6575,  0.9145,  0.3085,  0.0730,  0.8191,
         0.8220,  0.9870,  0.6720,  0.2444,  0.0722,  0.7552,  0.2465,
         0.6643,  0.3245,  0.1041,  0.7912,  0.4852,  0.0364,  0.8606,
         0.0499,  0.9144,  0.2061,  0.0811,  0.9387,  0.0309,  0.2465,
         0.8885,  0.8631,  0.5107,  0.7889,  0.5504,  0.4230,  0.0452,
         0.0609,  0.1929,  0.0738,  0.2007,  0.8929,  0.4442,  0.3359,
         0.8341,  0.2004,  0.7017,  0.5947,  0.4974,  0.0380,  0.7419,
         0.1086,  0.5698,  0.7665,  0.8953,  0.0390,  0.0682,  0.6186,
         0.2079,  0.7368,  0.8050,  0.9933,  0.1875,  0.1622,  0.8835,
         0.1489,  0.5152,  0.0183,  0.2016,  0.6978,  0.0888,  0.5920,
         0.0459,  0.2369,  0.3176,  0.2423,  0.6842,  0.1311,  0.7634,
         0.7259,  0.6615,  0.2929,  0.5923,  0.8347,  0.8817,  0.0611,
         0.0524,  0.5869,  0.0804,  0.1441,  0.2937,  0.7407,  0.0299,
         0.4721,  0.1384,  0.7744,  0.4880,  0.6542,  0.2524,  0.0772,
         0.0588,  0.0889,  0.1243,  0.3860,  0.8328,  0.3610,  0.1521,
         0.4101,  0.6056,  0.6835,  0.6834,  0.6909,  0.6842,  0.0044,
         0.8856,  0.8828,  0.7651,  0.7809,  0.6538,  0.1309,  0.0771,
         0.7817,  0.0349,  0.4542,  0.9518,  0.8709,  0.3027,  0.1791,
         0.1237,  0.7895,  0.0940,  0.1517,  0.3465,  0.9050,  0.9442,
         0.7840,  0.7105,  0.4803,  0.2699,  0.0596,  0.3338,  0.2185,
         0.7440,  0.2316,  0.4817,  0.8290,  0.1009,  0.7182,  0.4154,
         0.7219,  0.4762,  0.0195,  0.9908,  0.2023,  0.6349,  0.1790,
         0.8991,  0.0164,  0.8980,  0.2230,  0.0171,  0.2187,  0.5003,
         0.5397,  0.7710,  0.6573,  0.6044,  0.8667,  0.6018,  0.3392,
         0.2344,  0.2169,  0.1152,  0.7125,  0.7376,  0.6274,  0.3050,
         0.5022,  0.3908,  0.1332,  0.1681,  0.6448,  0.6273,  0.2199,
         0.0756,  0.5889,  0.8403,  0.2234,  0.6961,  0.4672,  0.9845,
         0.5761,  0.1289,  0.6745,  0.6177,  0.0307,  0.1347,  0.8373,
         0.2334,  0.9647,  0.8208,  0.7211,  0.0250,  0.7690,  0.2246,
         0.8175,  0.6658,  0.1816,  0.1074,  0.7954,  0.1254,  0.7236,
         0.1592,  0.0212,  0.1934,  0.2988,  0.2966,  0.6851,  0.9201,
         0.8738,  0.9897,  0.0423,  0.5702,  0.7790,  0.0426,  0.0542,
         0.6384,  0.1102,  0.1817,  0.4613,  0.8762,  0.8862,  0.8937,
         0.2346,  0.6646,  0.0403,  0.9303,  0.2936,  0.9658,  0.1430,
         0.3816,  0.6809,  0.8311,  0.8434,  0.5344,  0.2887,  0.1869,
         0.5374,  0.5752,  0.3417,  0.3266,  0.3147,  0.0304,  0.1980,
         0.7446,  0.0393,  0.1193,  0.7496,  0.4921,  0.0604,  0.4220,
         0.3838,  0.9734,  0.1944,  0.1357,  0.1464,  0.2871,  0.6361,
         0.0675,  0.2436,  0.7290,  0.1035,  0.6946,  0.0183,  0.8754,
         0.8598,  0.2001,  0.5701,  0.8260,  0.2757,  0.8152,  0.8850,
         0.8314,  0.8365,  0.8861,  0.0595,  0.1621,  0.0344,  0.7562,
         0.9413,  0.1106,  0.7620,  0.6406,  0.8418,  0.9075,  0.4938,
         0.1968,  0.5821,  0.6663,  0.8063,  0.9895,  0.7864,  0.8288,
         0.0598,  0.8339,  0.4310,  0.5563,  0.0927,  0.2272,  0.1539,
         0.9425,  0.1988,  0.2643,  0.3534,  0.1091,  0.1211,  0.6645,
         0.0910,  0.1405,  0.0521,  0.9577,  0.0121,  0.0458,  0.4411,
         0.7392,  0.0729,  0.8301,  0.9506,  0.2947,  0.1460,  0.7122,
         0.7290,  0.8986,  0.0693,  0.2427,  0.1340,  0.8711,  0.4832,
         0.6048,  0.9446,  0.5626,  0.8668,  0.2663,  0.9300,  0.7226,
         0.8026], device='cuda:0')
tensor(0.4132, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3863,  0.3560,  0.8504,  0.6111,  0.3289,  0.1370,  0.8223,
         0.4193,  0.9591,  0.6525,  0.2262,  0.8679,  0.0402,  0.9169,
         0.5468,  0.9010,  0.6591,  0.0939,  0.3950,  0.2988,  0.0423,
         0.3333,  0.8841,  0.0469,  0.0939,  0.3824,  0.0360,  0.8063,
         0.0631,  0.0438,  0.1376,  0.7857,  0.2408,  0.8717,  0.1825,
         0.9728,  0.9573,  0.7769,  0.9595,  0.7903,  0.4438,  0.0346,
         0.8773,  0.6790,  0.8157,  0.5985,  0.3489,  0.0254,  0.4693,
         0.1373,  0.2516,  0.5844,  0.2619,  0.8445,  0.3115,  0.5845,
         0.9114,  0.3430,  0.6725,  0.8876,  0.2560,  0.0817,  0.3322,
         0.7258,  0.0138,  0.4181,  0.9687,  0.0423,  0.0517,  0.8029,
         0.8483,  0.7550,  0.2180,  0.6009,  0.2898,  0.8540,  0.8378,
         0.5406,  0.8887,  0.2410,  0.1592,  0.7625,  0.3572,  0.1070,
         0.2164,  0.4320,  0.7569,  0.0278,  0.3649,  0.6190,  0.8747,
         0.4277,  0.8583,  0.6517,  0.8078,  0.7770,  0.4777,  0.1827,
         0.7594,  0.3853,  0.1293,  0.2842,  0.8350,  0.0243,  0.0842,
         0.0763,  0.0059,  0.1475,  0.7538,  0.0642,  0.6757,  0.7399,
         0.1177,  0.7248,  0.7102,  0.6909,  0.8334,  0.1737,  0.4712,
         0.8621,  0.1170,  0.8119,  0.7466,  0.6165,  0.6851,  0.3759,
         0.6602,  0.7543,  0.0700,  0.8523,  0.3965,  0.9422,  0.8626,
         0.4238,  0.4004,  0.6332,  0.4730,  0.6806,  0.9064,  0.1036,
         0.1269,  0.0261,  0.9742,  0.4491,  0.2104,  0.7302,  0.0634,
         0.4149,  0.5753,  0.3019,  0.1290,  0.0440,  0.5731,  0.9850,
         0.2966,  0.2495,  0.2139,  0.7345,  0.0643,  0.9720,  0.8045,
         0.7476,  0.2528,  0.5213,  0.9736,  0.0623,  0.7528,  0.2875,
         0.6229,  0.9402,  0.3926,  0.9502,  0.5218,  0.3836,  0.8807,
         0.9094,  0.3349,  0.8751,  0.4925,  0.2051,  0.7742,  0.8941,
         0.4433,  0.0211,  0.7002,  0.0425,  0.2846,  0.8914,  0.5159,
         0.5174,  0.5620,  0.4852,  0.7359,  0.1180,  0.3337,  0.0989,
         0.7862,  0.8204,  0.3274,  0.2342,  0.8607,  0.6763,  0.2898,
         0.2216,  0.2227,  0.8268,  0.1584,  0.8585,  0.0832,  0.0841,
         0.1520,  0.0567,  0.9453,  0.0219,  0.7547,  0.8646,  0.1551,
         0.7863,  0.8631,  0.1230,  0.8336,  0.0332,  0.7107,  0.8202,
         0.6847,  0.1807,  0.1445,  0.1329,  0.4881,  0.8522,  0.4001,
         0.6120,  0.1716,  0.4923,  0.1648,  0.1591,  0.1177,  0.7299,
         0.7832,  0.9551,  0.7671,  0.2819,  0.9522,  0.7981,  0.1079,
         0.8259,  0.0123,  0.3568,  0.9318,  0.2552,  0.1359,  0.1467,
         0.9063,  0.0869,  0.1584,  0.7512,  0.2614,  0.1526,  0.7661,
         0.7199,  0.3534,  0.1322,  0.8469,  0.7408,  0.9318,  0.4691,
         0.2120,  0.3055,  0.7527,  0.8226,  0.6484,  0.8797,  0.8754,
         0.0423,  0.2600,  0.2602,  0.2731,  0.0382,  0.0967,  0.6453,
         0.2987,  0.8588,  0.7273,  0.1202,  0.8459,  0.1976,  0.8713,
         0.1412,  0.6835,  0.0462,  0.7530,  0.4778,  0.5427,  0.0984,
         0.4179,  0.7634,  0.8066,  0.1263,  0.9877,  0.1315,  0.7451,
         0.7484,  0.8801,  0.9599,  0.0340,  0.4913,  0.8182,  0.9322,
         0.6246,  0.7774,  0.7716,  0.9479,  0.2496,  0.2250,  0.1373,
         0.7029,  0.8880,  0.1399,  0.0373,  0.8324,  0.7913,  0.0440,
         0.0464,  0.5941,  0.2719,  0.6914,  0.4617,  0.8806,  0.0143,
         0.1589,  0.7972,  0.2737,  0.1846,  0.7609,  0.1921,  0.4193,
         0.4812,  0.0466,  0.0722,  0.1812,  0.1752,  0.7855,  0.0856,
         0.1652,  0.4796,  0.2181,  0.6058,  0.7373,  0.7939,  0.2742,
         0.5339,  0.8065,  0.9347,  0.8538,  0.0360,  0.8024,  0.7681,
         0.4864,  0.8735,  0.6168,  0.0980,  0.9118,  0.2298,  0.7631,
         0.7350,  0.6341,  0.4523,  0.3763,  0.8474,  0.1755,  0.1688,
         0.0922,  0.0740,  0.7017,  0.8556,  0.0966,  0.0287,  0.9407,
         0.0461,  0.1507,  0.6527,  0.8177,  0.8337,  0.7156,  0.0999,
         0.6517,  0.4768,  0.0998,  0.8093,  0.2653,  0.7486,  0.9115,
         0.4590,  0.0151,  0.8289,  0.9927,  0.1386,  0.4763,  0.6138,
         0.8295,  0.4680,  0.8597,  0.0060,  0.7042,  0.1696,  0.8084,
         0.3083,  0.0574,  0.1320,  0.9205,  0.1161,  0.8436,  0.6827,
         0.2036,  0.7075,  0.4276,  0.7679,  0.2067,  0.8768,  0.0114,
         0.2674,  0.3408,  0.0593,  0.9185,  0.1668,  0.1666,  0.1397,
         0.6018,  0.0807,  0.6113,  0.1509,  0.0415,  0.8048,  0.0970,
         0.8474,  0.7473,  0.8308,  0.7937,  0.7908,  0.0769,  0.7689,
         0.8356,  0.4330,  0.1661,  0.9186,  0.8985,  0.2484,  0.6577,
         0.4641,  0.8277,  0.7248,  0.2306,  0.0207,  0.0968,  0.7649,
         0.1850,  0.5839,  0.1452,  0.8007,  0.6248,  0.5036,  0.2954,
         0.8087,  0.8618,  0.9101,  0.7117,  0.4798,  0.8653,  0.1841,
         0.4859,  0.8492,  0.7340,  0.1942,  0.2765,  0.9338,  0.5536,
         0.3076,  0.1129,  0.6286,  0.0520,  0.7223,  0.0612,  0.6870,
         0.2991,  0.8018,  0.0609,  0.8449,  0.7592,  0.7246,  0.6379,
         0.1755,  0.8733,  0.5919,  0.8435,  0.3535,  0.5207,  0.0700,
         0.9249,  0.1419,  0.0351,  0.9605,  0.7446,  0.2819,  0.0603,
         0.0599,  0.8392,  0.1850,  0.0944,  0.0640,  0.8018,  0.0813,
         0.9133], device='cuda:0')
tensor(0.3780, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6350,  0.3926,  0.5937,  0.5675,  0.8137,  0.1123,  0.0721,
         0.8212,  0.0353,  0.0317,  0.6066,  0.3683,  0.5637,  0.3622,
         0.1415,  0.4789,  0.8148,  0.1880,  0.4296,  0.4660,  0.6505,
         0.0132,  0.8093,  0.7957,  0.7245,  0.8865,  0.7838,  0.8660,
         0.5201,  0.6022,  0.1775,  0.8322,  0.2285,  0.1998,  0.8187,
         0.8456,  0.1304,  0.7250,  0.3361,  0.1690,  0.2208,  0.1689,
         0.7562,  0.1445,  0.1368,  0.0087,  0.8948,  0.6752,  0.8455,
         0.3223,  0.0067,  0.8308,  0.2817,  0.7641,  0.0789,  0.8274,
         0.7928,  0.8763,  0.8848,  0.1707,  0.1621,  0.7717,  0.7374,
         0.7134,  0.1650,  0.7245,  0.3807,  0.6517,  0.4144,  0.7068,
         0.8484,  0.8745,  0.5906,  0.1991,  0.0616,  0.5352,  0.2161,
         0.4829,  0.7795,  0.1029,  0.8056,  0.9360,  0.1170,  0.4558,
         0.0297,  0.1572,  0.1986,  0.3559,  0.5309,  0.7363,  0.9529,
         0.3831,  0.7076,  0.5050,  0.6313,  0.0431,  0.7925,  0.0142,
         0.1896,  0.0846,  0.6728,  0.7364,  0.0576,  0.8582,  0.3363,
         0.7466,  0.8561,  0.9680,  0.6120,  0.0922,  0.4597,  0.9706,
         0.0361,  0.8313,  0.8402,  0.6021,  0.1291,  0.1435,  0.7458,
         0.8239,  0.9280,  0.0922,  0.8141,  0.0471,  0.0922,  0.0792,
         0.8445,  0.9190,  0.6985,  0.0524,  0.8347,  0.8480,  0.5305,
         0.0117,  0.9803,  0.2869,  0.6710,  0.0054,  0.4267,  0.3901,
         0.6789,  0.0968,  0.6951,  0.7178,  0.0180,  0.1655,  0.5947,
         0.9242,  0.1931,  0.7245,  0.7705,  0.0096,  0.7780,  0.8624,
         0.7047,  0.3429,  0.5037,  0.0692,  0.7170,  0.7763,  0.2838,
         0.5150,  0.6737,  0.0294,  0.7959,  0.5465,  0.8358,  0.3203,
         0.0251,  0.0524,  0.0081,  0.2525,  0.8689,  0.8415,  0.0210,
         0.0484,  0.0253,  0.8117,  0.6510,  0.1995,  0.1202,  0.0439,
         0.1247,  0.7532,  0.8869,  0.6834,  0.5328,  0.7686,  0.9867,
         0.6416,  0.6281,  0.7040,  0.0602,  0.0570,  0.0223,  0.8971,
         0.4061,  0.7968,  0.7812,  0.2948,  0.6699,  0.6585,  0.5773,
         0.7973,  0.0821,  0.1900,  0.7291,  0.9297,  0.9667,  0.0980,
         0.0363,  0.0383,  0.8118,  0.6061,  0.1955,  0.0325,  0.2424,
         0.7342,  0.9357,  0.0076,  0.9357,  0.7858,  0.8460,  0.0851,
         0.0656,  0.9320,  0.5498,  0.2697,  0.8547,  0.8540,  0.4998,
         0.8684,  0.5015,  0.4594,  0.4554,  0.5820,  0.5000,  0.9141,
         0.4275,  0.9153,  0.6189,  0.1418,  0.1245,  0.8689,  0.1743,
         0.9812,  0.0959,  0.1482,  0.1513,  0.0068,  0.2042,  0.8461,
         0.1240,  0.4469,  0.7413,  0.2815,  0.7006,  0.8509,  0.6323,
         0.9060,  0.5411,  0.8698,  0.5668,  0.8072,  0.1114,  0.8199,
         0.0431,  0.6715,  0.9887,  0.7333,  0.6044,  0.2672,  0.9648,
         0.2465,  0.9161,  0.7267,  0.8829,  0.2905,  0.4775,  0.5192,
         0.0278,  0.2573,  0.3551,  0.0928,  0.6647,  0.3356,  0.1160,
         0.4748,  0.0897,  0.6625,  0.0798,  0.5139,  0.8930,  0.4374,
         0.3313,  0.5532,  0.0394,  0.2284,  0.1091,  0.0748,  0.5455,
         0.0912,  0.8248,  0.1942,  0.0368,  0.0907,  0.6106,  0.0179,
         0.0647,  0.8620,  0.7488,  0.6875,  0.8443,  0.0512,  0.2142,
         0.8710,  0.3263,  0.5285,  0.0110,  0.4237,  0.7869,  0.9162,
         0.7889,  0.8347,  0.0935,  0.7854,  0.1613,  0.0539,  0.0259,
         0.8255,  0.3627,  0.8205,  0.9283,  0.9334,  0.7009,  0.0141,
         0.8855,  0.2184,  0.1686,  0.5008,  0.5896,  0.8636,  0.1283,
         0.1373,  0.9103,  0.1974,  0.7986,  0.0459,  0.7323,  0.1541,
         0.3861,  0.0416,  0.8311,  0.2307,  0.8731,  0.1091,  0.7772,
         0.8303,  0.1911,  0.6129,  0.0327,  0.6555,  0.6684,  0.1666,
         0.6382,  0.7487,  0.8437,  0.1611,  0.9704,  0.1533,  0.9902,
         0.1012,  0.9078,  0.0898,  0.9493,  0.0791,  0.0698,  0.6211,
         0.1853,  0.8298,  0.8237,  0.4878,  0.8794,  0.1316,  0.0209,
         0.1027,  0.1264,  0.9016,  0.4379,  0.9589,  0.1448,  0.0719,
         0.3862,  0.4402,  0.2961,  0.9096,  0.9089,  0.9568,  0.0327,
         0.7819,  0.1979,  0.8841,  0.4008,  0.9143,  0.7562,  0.1141,
         0.7926,  0.8923,  0.0659,  0.3355,  0.3104,  0.0820,  0.3423,
         0.1585,  0.9450,  0.8286,  0.5818,  0.2112,  0.8941,  0.7190,
         0.3187,  0.6159,  0.0784,  0.0678,  0.0889,  0.8774,  0.7246,
         0.8741,  0.7633,  0.6091,  0.0253,  0.0421,  0.0079,  0.3785,
         0.0561,  0.8670,  0.6953,  0.0925,  0.6771,  0.7894,  0.1915,
         0.7026,  0.8391,  0.4832,  0.1783,  0.1390,  0.7925,  0.1422,
         0.9808,  0.4907,  0.4604,  0.3983,  0.0222,  0.7979,  0.2912,
         0.1075,  0.8525,  0.3540,  0.8783,  0.9008,  0.0792,  0.9034,
         0.4325,  0.6546,  0.0343,  0.5776,  0.9068,  0.3217,  0.7998,
         0.8492,  0.2133,  0.9846,  0.6851,  0.3737,  0.4825,  0.2722,
         0.3127,  0.1556,  0.0803,  0.6263,  0.0864,  0.1059,  0.7147,
         0.2862,  0.6275,  0.1637,  0.8532,  0.8206,  0.0160,  0.0517,
         0.4632,  0.8908,  0.8965,  0.1566,  0.1100,  0.8175,  0.8379,
         0.1071,  0.7662,  0.1001,  0.8803,  0.1071,  0.1574,  0.8563,
         0.7525,  0.7991,  0.6729,  0.7017,  0.0600,  0.9522,  0.6334,
         0.1562], device='cuda:0')
tensor(0.3916, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1925,  0.4215,  0.1538,  0.9091,  0.0638,  0.8365,  0.8632,
         0.8771,  0.7084,  0.0913,  0.0355,  0.0783,  0.9099,  0.7434,
         0.1026,  0.7934,  0.1055,  0.0078,  0.6740,  0.5276,  0.0727,
         0.3206,  0.0118,  0.0481,  0.2402,  0.7590,  0.8490,  0.6339,
         0.0344,  0.5310,  0.4175,  0.3172,  0.2447,  0.2011,  0.0198,
         0.9787,  0.5444,  0.7036,  0.6438,  0.0849,  0.4598,  0.3278,
         0.8459,  0.1496,  0.8019,  0.7286,  0.0938,  0.0298,  0.1238,
         0.4726,  0.8191,  0.8262,  0.0094,  0.0739,  0.8946,  0.5579,
         0.7307,  0.9054,  0.0296,  0.8651,  0.9377,  0.1758,  0.6942,
         0.1371,  0.1056,  0.6912,  0.0054,  0.7044,  0.0112,  0.3106,
         0.4113,  0.1410,  0.9915,  0.6840,  0.6977,  0.0251,  0.8493,
         0.7774,  0.9872,  0.8363,  0.6658,  0.0334,  0.1898,  0.2845,
         0.8148,  0.3093,  0.1951,  0.9437,  0.7781,  0.1076,  0.2608,
         0.0665,  0.3897,  0.1125,  0.7278,  0.0609,  0.2869,  0.7021,
         0.8243,  0.1657,  0.6147,  0.6199,  0.7043,  0.8610,  0.8973,
         0.4015,  0.7511,  0.2947,  0.0894,  0.7297,  0.1269,  0.0250,
         0.1011,  0.0702,  0.4249,  0.9229,  0.4003,  0.8736,  0.0947,
         0.8314,  0.7753,  0.0923,  0.5084,  0.8918,  0.8072,  0.7392,
         0.2923,  0.5079,  0.1064,  0.6680,  0.2197,  0.9359,  0.8724,
         0.5728,  0.0085,  0.1175,  0.8067,  0.9715,  0.9251,  0.6420,
         0.8820,  0.6407,  0.9718,  0.6926,  0.3800,  0.7937,  0.4733,
         0.0451,  0.7833,  0.5437,  0.2423,  0.2765,  0.7449,  0.6954,
         0.3576,  0.1462,  0.0446,  0.7342,  0.8050,  0.3486,  0.8517,
         0.6665,  0.9242,  0.2120,  0.8665,  0.0284,  0.9854,  0.0360,
         0.7950,  0.0607,  0.1156,  0.0149,  0.8366,  0.9304,  0.1647,
         0.0936,  0.9026,  0.9641,  0.7651,  0.7785,  0.8432,  0.8146,
         0.9683,  0.2558,  0.7142,  0.9216,  0.6147,  0.8765,  0.1860,
         0.6009,  0.7826,  0.2478,  0.8729,  0.5639,  0.7236,  0.8376,
         0.2266,  0.1905,  0.6868,  0.0411,  0.0995,  0.0336,  0.3217,
         0.0439,  0.9867,  0.1183,  0.9095,  0.6950,  0.5847,  0.0358,
         0.4596,  0.7024,  0.8708,  0.7344,  0.9385,  0.7747,  0.8521,
         0.9257,  0.0435,  0.0440,  0.6542,  0.8688,  0.7318,  0.8828,
         0.6510,  0.8782,  0.6163,  0.1163,  0.0194,  0.8006,  0.0900,
         0.2878,  0.0436,  0.2984,  0.7875,  0.1184,  0.1391,  0.4654,
         0.6671,  0.6356,  0.8769,  0.7618,  0.7687,  0.2470,  0.7712,
         0.6451,  0.0112,  0.0304,  0.5531,  0.0720,  0.8547,  0.5949,
         0.1865,  0.5821,  0.7392,  0.2166,  0.2195,  0.7272,  0.0256,
         0.1032,  0.3551,  0.8376,  0.0372,  0.1780,  0.1813,  0.0224,
         0.0186,  0.7627,  0.0952,  0.1393,  0.9093,  0.4725,  0.9583,
         0.1208,  0.3930,  0.8662,  0.4034,  0.2026,  0.4797,  0.7040,
         0.9221,  0.8731,  0.8664,  0.6384,  0.8128,  0.3247,  0.8173,
         0.2985,  0.0859,  0.7895,  0.0570,  0.9921,  0.6777,  0.9267,
         0.9166,  0.7197,  0.9263,  0.9204,  0.0276,  0.7769,  0.7426,
         0.6980,  0.9277,  0.0709,  0.0592,  0.0306,  0.3830,  0.6534,
         0.8415,  0.1040,  0.0916,  0.5096,  0.1009,  0.8125,  0.8692,
         0.9168,  0.1839,  0.9838,  0.4714,  0.7549,  0.9791,  0.0611,
         0.3925,  0.8016,  0.1579,  0.8376,  0.5529,  0.9363,  0.5739,
         0.0537,  0.1398,  0.0910,  0.0337,  0.4796,  0.6239,  0.7166,
         0.4717,  0.2242,  0.0134,  0.8206,  0.7564,  0.4821,  0.7239,
         0.6335,  0.0499,  0.7754,  0.6909,  0.8401,  0.0400,  0.0292,
         0.9451,  0.0236,  0.7355,  0.0464,  0.8563,  0.8041,  0.0581,
         0.2715,  0.8711,  0.2830,  0.8364,  0.6854,  0.0452,  0.4253,
         0.9079,  0.9167,  0.8666,  0.1547,  0.5366,  0.0183,  0.2406,
         0.9193,  0.0576,  0.8099,  0.0926,  0.7833,  0.6517,  0.0762,
         0.0725,  0.0170,  0.0532,  0.5401,  0.1651,  0.0145,  0.7556,
         0.6628,  0.2700,  0.5716,  0.5941,  0.8633,  0.0231,  0.6687,
         0.8883,  0.7707,  0.0144,  0.5243,  0.8005,  0.2624,  0.8924,
         0.1301,  0.6637,  0.8301,  0.8651,  0.7424,  0.1853,  0.0983,
         0.8963,  0.6627,  0.8282,  0.2843,  0.8645,  0.8471,  0.9040,
         0.6944,  0.9168,  0.0791,  0.7376,  0.1100,  0.0536,  0.0333,
         0.0624,  0.2338,  0.4157,  0.8454,  0.2638,  0.7145,  0.6243,
         0.9876,  0.0321,  0.1758,  0.0239,  0.0395,  0.9035,  0.0450,
         0.1527,  0.9745,  0.3552,  0.8034,  0.1171,  0.5982,  0.9083,
         0.0333,  0.0253,  0.5031,  0.0347,  0.2212,  0.8667,  0.0720,
         0.6513,  0.0460,  0.1066,  0.7294,  0.5627,  0.1673,  0.2015,
         0.5597,  0.9195,  0.0572,  0.0910,  0.1825,  0.9642,  0.5490,
         0.6967,  0.0803,  0.1852,  0.9792,  0.8857,  0.9346,  0.3586,
         0.1182,  0.5579,  0.0842,  0.0372,  0.0444,  0.0682,  0.7916,
         0.7834,  0.8157,  0.9860,  0.0800,  0.0295,  0.9172,  0.9663,
         0.9866,  0.0473,  0.1152,  0.1020,  0.3792,  0.8510,  0.8520,
         0.7510,  0.9511,  0.1180,  0.5602,  0.0529,  0.5201,  0.7638,
         0.5214,  0.8489,  0.9453,  0.7406,  0.0429,  0.9887,  0.0963,
         0.2378,  0.2660,  0.7482,  0.8960,  0.0424,  0.9129,  0.7323,
         0.5366], device='cuda:0')
tensor(0.3824, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0370,  0.2117,  0.1555,  0.0130,  0.9353,  0.0427,  0.4343,
         0.4549,  0.8403,  0.7296,  0.6698,  0.0514,  0.4243,  0.8518,
         0.2631,  0.0844,  0.0412,  0.1273,  0.9075,  0.9052,  0.5434,
         0.1128,  0.0348,  0.8080,  0.5357,  0.6326,  0.2764,  0.2291,
         0.6373,  0.8822,  0.3080,  0.0307,  0.8223,  0.8470,  0.0042,
         0.0975,  0.8002,  0.0283,  0.8804,  0.9585,  0.0421,  0.0186,
         0.7935,  0.1895,  0.9533,  0.7138,  0.8929,  0.2744,  0.6466,
         0.9946,  0.9659,  0.9107,  0.7639,  0.0423,  0.0050,  0.8614,
         0.6141,  0.9691,  0.1011,  0.7574,  0.1446,  0.9307,  0.0127,
         0.0545,  0.0645,  0.8014,  0.1016,  0.1215,  0.1997,  0.0207,
         0.0982,  0.5522,  0.0432,  0.2244,  0.0243,  0.4811,  0.2247,
         0.9257,  0.7402,  0.0416,  0.7294,  0.8342,  0.3383,  0.0297,
         0.1403,  0.0074,  0.8748,  0.0281,  0.8124,  0.3450,  0.7815,
         0.6815,  0.1781,  0.7249,  0.0610,  0.3929,  0.7336,  0.8805,
         0.8904,  0.0632,  0.0211,  0.7486,  0.1096,  0.8425,  0.7040,
         0.9403,  0.1667,  0.3300,  0.7149,  0.0186,  0.9927,  0.8447,
         0.2029,  0.6577,  0.2206,  0.0732,  0.3934,  0.8787,  0.4851,
         0.0714,  0.9487,  0.8196,  0.1505,  0.1544,  0.7100,  0.8527,
         0.0754,  0.0151,  0.7207,  0.0483,  0.8203,  0.8696,  0.8176,
         0.7504,  0.7685,  0.6290,  0.9963,  0.8982,  0.7175,  0.6162,
         0.8765,  0.7760,  0.4060,  0.7787,  0.8931,  0.5898,  0.1586,
         0.4681,  0.7026,  0.8253,  0.1348,  0.8128,  0.0879,  0.9095,
         0.9143,  0.8497,  0.9731,  0.0938,  0.9332,  0.0079,  0.7983,
         0.0594,  0.9713,  0.1134,  0.5840,  0.0694,  0.0054,  0.0176,
         0.5147,  0.0557,  0.8524,  0.6479,  0.0521,  0.1196,  0.0716,
         0.3591,  0.5850,  0.8415,  0.9169,  0.3684,  0.0076,  0.8579,
         0.8395,  0.0114,  0.9131,  0.0345,  0.8879,  0.0210,  0.8768,
         0.0994,  0.0357,  0.6995,  0.1387,  0.7779,  0.1835,  0.0448,
         0.7714,  0.8125,  0.7308,  0.8298,  0.7524,  0.9107,  0.7552,
         0.1369,  0.9029,  0.9932,  0.1705,  0.7423,  0.6307,  0.7844,
         0.0279,  0.8230,  0.0613,  0.8685,  0.7224,  0.7393,  0.8148,
         0.2358,  0.1907,  0.6474,  0.1131,  0.0611,  0.2444,  0.7418,
         0.8275,  0.2185,  0.8014,  0.8701,  0.0529,  0.5212,  0.0651,
         0.0814,  0.9088,  0.0156,  0.8465,  0.1930,  0.8313,  0.0528,
         0.0688,  0.7505,  0.4411,  0.9391,  0.6906,  0.0624,  0.3437,
         0.0387,  0.3957,  0.0271,  0.7389,  0.0610,  0.7920,  0.1987,
         0.0107,  0.1113,  0.8995,  0.5359,  0.0043,  0.1164,  0.4604,
         0.0721,  0.9582,  0.8411,  0.9108,  0.0709,  0.8878,  0.2131,
         0.7601,  0.9086,  0.8761,  0.9357,  0.4767,  0.3898,  0.6231,
         0.6786,  0.0888,  0.1273,  0.6432,  0.0444,  0.0527,  0.9376,
         0.0289,  0.0588,  0.0594,  0.9783,  0.8306,  0.9023,  0.7236,
         0.7487,  0.8833,  0.0260,  0.0143,  0.0809,  0.8496,  0.7590,
         0.6562,  0.5930,  0.7383,  0.1742,  0.1000,  0.8096,  0.0619,
         0.2091,  0.7486,  0.7205,  0.0086,  0.1566,  0.0404,  0.7815,
         0.2866,  0.7984,  0.3390,  0.0561,  0.9558,  0.1026,  0.2477,
         0.3744,  0.7162,  0.1685,  0.1316,  0.7812,  0.0650,  0.7731,
         0.4530,  0.5475,  0.6835,  0.7306,  0.0704,  0.5591,  0.0682,
         0.7509,  0.0561,  0.8302,  0.8593,  0.0691,  0.0241,  0.8733,
         0.9233,  0.6452,  0.9967,  0.7994,  0.1223,  0.0401,  0.9730,
         0.4763,  0.0634,  0.8248,  0.8274,  0.7667,  0.0220,  0.2570,
         0.8582,  0.8219,  0.0470,  0.1302,  0.0093,  0.0296,  0.0596,
         0.0192,  0.7121,  0.9045,  0.3559,  0.2327,  0.8824,  0.5194,
         0.0079,  0.7866,  0.6568,  0.0762,  0.8995,  0.6071,  0.1137,
         0.0571,  0.4809,  0.0201,  0.7399,  0.0422,  0.9200,  0.8389,
         0.6312,  0.9871,  0.0497,  0.0807,  0.0811,  0.0408,  0.0257,
         0.0054,  0.6112,  0.4400,  0.8993,  0.9608,  0.9175,  0.0673,
         0.0984,  0.7654,  0.2189,  0.0544,  0.6136,  0.6731,  0.8388,
         0.0608,  0.5991,  0.0354,  0.5058,  0.8922,  0.9666,  0.0273,
         0.8147,  0.0608,  0.2206,  0.0528,  0.0199,  0.1579,  0.2663,
         0.3813,  0.8429,  0.9084,  0.7403,  0.8805,  0.1009,  0.9461,
         0.0511,  0.7095,  0.0972,  0.8412,  0.1795,  0.1877,  0.9409,
         0.5413,  0.0803,  0.2705,  0.8624,  0.0107,  0.8179,  0.6358,
         0.7486,  0.9780,  0.8643,  0.8256,  0.1699,  0.6264,  0.9381,
         0.5073,  0.0982,  0.8360,  0.0367,  0.0373,  0.0221,  0.3280,
         0.4702,  0.8272,  0.7604,  0.1962,  0.1233,  0.9418,  0.8349,
         0.8316,  0.1366,  0.0561,  0.0548,  0.6980,  0.1431,  0.9349,
         0.1355,  0.9208,  0.8543,  0.2702,  0.6761,  0.9337,  0.7774,
         0.6976,  0.1530,  0.2548,  0.9671,  0.8038,  0.9499,  0.2494,
         0.7129,  0.0633,  0.9907,  0.8815,  0.0457,  0.8175,  0.0827,
         0.1311,  0.0390,  0.9887,  0.9426,  0.0282,  0.7911,  0.8896,
         0.1173,  0.5400,  0.0445,  0.2489,  0.1441,  0.1475,  0.6404,
         0.8190,  0.1897,  0.0568,  0.2075,  0.3354,  0.0452,  0.0597,
         0.0251,  0.9552,  0.7917,  0.8799,  0.8208,  0.2369,  0.3360,
         0.8083], device='cuda:0')
tensor(0.3990, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6631,  0.9321,  0.0301,  0.6842,  0.9092,  0.8349,  0.8512,
         0.0048,  0.8737,  0.2265,  0.9175,  0.0508,  0.8723,  0.5468,
         0.8778,  0.2370,  0.9528,  0.9169,  0.5610,  0.0574,  0.8385,
         0.9797,  0.7330,  0.0761,  0.1315,  0.0647,  0.8204,  0.9870,
         0.9043,  0.6367,  0.8833,  0.0169,  0.7745,  0.0551,  0.0391,
         0.9201,  0.6600,  0.4468,  0.7844,  0.5855,  0.8989,  0.0799,
         0.2310,  0.1028,  0.8392,  0.0219,  0.0840,  0.3745,  0.6129,
         0.1296,  0.0183,  0.0454,  0.7112,  0.8537,  0.8529,  0.9136,
         0.1277,  0.2119,  0.3510,  0.0095,  0.7624,  0.9283,  0.3090,
         0.1135,  0.2307,  0.9250,  0.7755,  0.5589,  0.0280,  0.1578,
         0.2454,  0.2606,  0.0367,  0.6151,  0.3663,  0.8298,  0.6547,
         0.5749,  0.8800,  0.0820,  0.6909,  0.0399,  0.4621,  0.4684,
         0.2245,  0.0338,  0.9577,  0.7716,  0.0444,  0.1549,  0.3743,
         0.9895,  0.1376,  0.8208,  0.1108,  0.1084,  0.9123,  0.0065,
         0.9527,  0.8821,  0.0203,  0.7880,  0.0395,  0.0688,  0.9505,
         0.9534,  0.0531,  0.7263,  0.8567,  0.6860,  0.9017,  0.1218,
         0.9791,  0.9040,  0.1029,  0.0138,  0.9206,  0.9065,  0.1797,
         0.0662,  0.1029,  0.9853,  0.4670,  0.8566,  0.8715,  0.2113,
         0.2586,  0.1130,  0.9313,  0.0200,  0.8197,  0.7361,  0.9475,
         0.8512,  0.0538,  0.5016,  0.1299,  0.1063,  0.7330,  0.7739,
         0.6834,  0.0784,  0.7223,  0.5948,  0.8633,  0.7704,  0.1935,
         0.9861,  0.0595,  0.0188,  0.7750,  0.6374,  0.6916,  0.2291,
         0.6300,  0.6903,  0.8972,  0.9689,  0.3601,  0.9054,  0.4789,
         0.9650,  0.2848,  0.9086,  0.8352,  0.0870,  0.7606,  0.9281,
         0.4312,  0.7478,  0.9510,  0.8064,  0.0077,  0.9956,  0.0263,
         0.0692,  0.9179,  0.8820,  0.5982,  0.0632,  0.5706,  0.4449,
         0.9928,  0.6423,  0.0476,  0.8666,  0.8141,  0.9689,  0.8307,
         0.8721,  0.8148,  0.7675,  0.5319,  0.9805,  0.6859,  0.8855,
         0.9367,  0.0795,  0.5205,  0.6772,  0.0534,  0.1191,  0.0125,
         0.1742,  0.8406,  0.8453,  0.0524,  0.7090,  0.9338,  0.9666,
         0.1606,  0.3500,  0.8715,  0.1012,  0.8847,  0.1446,  0.0293,
         0.8119,  0.9223,  0.9254,  0.0929,  0.1042,  0.0731,  0.1924,
         0.2438,  0.8732,  0.8678,  0.0805,  0.0321,  0.4734,  0.9573,
         0.9379,  0.7515,  0.8708,  0.6347,  0.3364,  0.3818,  0.9893,
         0.3062,  0.9070,  0.0123,  0.0206,  0.8561,  0.8213,  0.1965,
         0.0489,  0.8782,  0.2183,  0.9413,  0.4620,  0.0857,  0.9900,
         0.0207,  0.9977,  0.9675,  0.8898,  0.1003,  0.3398,  0.5646,
         0.3995,  0.3588,  0.8493,  0.0930,  0.0963,  0.8620,  0.7435,
         0.6298,  0.1803,  0.8725,  0.9589,  0.9256,  0.9677,  0.5113,
         0.9117,  0.8853,  0.2095,  0.7628,  0.2337,  0.8463,  0.7528,
         0.6744,  0.1244,  0.1111,  0.5801,  0.0988,  0.7590,  0.7266,
         0.0393,  0.8033,  0.1389,  0.8537,  0.2018,  0.8352,  0.2896,
         0.8968,  0.8858,  0.9359,  0.3304,  0.8553,  0.0780,  0.1681,
         0.8478,  0.2103,  0.8504,  0.4213,  0.0452,  0.8135,  0.7262,
         0.5712,  0.8474,  0.0408,  0.7314,  0.2456,  0.5090,  0.4021,
         0.2107,  0.8884,  0.0372,  0.0773,  0.0070,  0.8863,  0.8724,
         0.8194,  0.1072,  0.0509,  0.8375,  0.1666,  0.6952,  0.9065,
         0.4897,  0.5921,  0.6285,  0.6902,  0.7948,  0.8255,  0.6125,
         0.8326,  0.0456,  0.7200,  0.8780,  0.8562,  0.1432,  0.8393,
         0.1207,  0.8214,  0.6912,  0.4754,  0.0669,  0.8294,  0.9083,
         0.7667,  0.7512,  0.5738,  0.1090,  0.4382,  0.0775,  0.7756,
         0.4619,  0.8983,  0.0332,  0.9668,  0.7671,  0.8638,  0.8969,
         0.9281,  0.0654,  0.7278,  0.1159,  0.0345,  0.1298,  0.8853,
         0.9292,  0.8773,  0.1939,  0.8499,  0.8164,  0.7860,  0.0247,
         0.1113,  0.9618,  0.0064,  0.1618,  0.8314,  0.8699,  0.7362,
         0.9595,  0.8220,  0.8452,  0.1616,  0.8534,  0.4346,  0.8457,
         0.6487,  0.0586,  0.8129,  0.8305,  0.6673,  0.0674,  0.8089,
         0.9341,  0.7098,  0.7062,  0.7727,  0.0624,  0.9185,  0.0057,
         0.7706,  0.9691,  0.5329,  0.0912,  0.0221,  0.4638,  0.0182,
         0.8477,  0.9403,  0.0425,  0.0521,  0.8218,  0.9980,  0.5160,
         0.2543,  0.1518,  0.9560,  0.4917,  0.0849,  0.9146,  0.8791,
         0.9413,  0.9045,  0.0749,  0.8555,  0.0875,  0.9170,  0.6353,
         0.9006,  0.8931,  0.0569,  0.7650,  0.2696,  0.8700,  0.9136,
         0.9193,  0.8062,  0.1509,  0.0358,  0.8665,  0.8231,  0.2148,
         0.8136,  0.6851,  0.9712,  0.9534,  0.9942,  0.0569,  0.4008,
         0.0221,  0.8956,  0.0311,  0.0840,  0.1231,  0.6448,  0.5044,
         0.2495,  0.2396,  0.9321,  0.0293,  0.0498,  0.8891,  0.8641,
         0.9155,  0.8330,  0.9748,  0.0279,  0.5001,  0.7909,  0.8770,
         0.7436,  0.8576,  0.9309,  0.0205,  0.8684,  0.0508,  0.9113,
         0.2563,  0.3140,  0.0657,  0.6656,  0.2383,  0.0231,  0.8585,
         0.6755,  0.6375,  0.6009,  0.4672,  0.0098,  0.0329,  0.0977,
         0.5623,  0.0052,  0.3769,  0.0995,  0.0265,  0.9513,  0.9689,
         0.8754,  0.0903,  0.3865,  0.7495,  0.8397,  0.0378,  0.8018,
         0.6878], device='cuda:0')
tensor(0.4413, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6509,  0.3941,  0.8977,  0.1341,  0.8617,  0.0523,  0.2574,
         0.1539,  0.0428,  0.5470,  0.8125,  0.1280,  0.7280,  0.7960,
         0.4065,  0.5585,  0.0692,  0.1788,  0.3410,  0.8541,  0.9124,
         0.9739,  0.8566,  0.1864,  0.5247,  0.8775,  0.6489,  0.7196,
         0.1548,  0.8443,  0.3521,  0.8621,  0.2555,  0.8163,  0.6668,
         0.3624,  0.8242,  0.4727,  0.8806,  0.6865,  0.9944,  0.7214,
         0.7285,  0.5810,  0.0847,  0.2034,  0.5288,  0.1007,  0.5720,
         0.1994,  0.0901,  0.0504,  0.0484,  0.0373,  0.0386,  0.2887,
         0.0509,  0.9867,  0.7811,  0.1082,  0.8926,  0.5493,  0.6973,
         0.9886,  0.9499,  0.6963,  0.9220,  0.4592,  0.6384,  0.8703,
         0.2773,  0.9927,  0.1115,  0.9159,  0.7513,  0.6203,  0.1640,
         0.2782,  0.5561,  0.6469,  0.8006,  0.0256,  0.0316,  0.7193,
         0.0094,  0.8480,  0.5037,  0.6907,  0.8605,  0.2195,  0.5855,
         0.1007,  0.8299,  0.8746,  0.1515,  0.9318,  0.8123,  0.9305,
         0.7733,  0.6812,  0.6621,  0.9210,  0.0986,  0.9957,  0.0780,
         0.9055,  0.8153,  0.1047,  0.0417,  0.8589,  0.2813,  0.7956,
         0.1183,  0.0289,  0.9981,  0.8092,  0.7062,  0.6426,  0.1034,
         0.1185,  0.1084,  0.1110,  0.9886,  0.7359,  0.8542,  0.9198,
         0.0556,  0.8710,  0.4245,  0.8134,  0.5202,  0.0470,  0.4992,
         0.0739,  0.0793,  0.0353,  0.0848,  0.2428,  0.1794,  0.2285,
         0.1859,  0.0867,  0.1639,  0.9902,  0.2106,  0.8062,  0.5666,
         0.8629,  0.3510,  0.5820,  0.2922,  0.9043,  0.2927,  0.1102,
         0.2371,  0.3023,  0.8534,  0.0177,  0.9060,  0.7606,  0.5698,
         0.7810,  0.0863,  0.2790,  0.7251,  0.0649,  0.8020,  0.1467,
         0.0933,  0.5063,  0.5070,  0.8611,  0.6412,  0.0200,  0.1085,
         0.8798,  0.4229,  0.0136,  0.1218,  0.0829,  0.1500,  0.1267,
         0.5048,  0.0365,  0.9664,  0.9127,  0.9612,  0.7948,  0.2766,
         0.8779,  0.9550,  0.6644,  0.0732,  0.8320,  0.1821,  0.2470,
         0.9732,  0.0696,  0.8180,  0.8319,  0.8073,  0.4639,  0.8365,
         0.9121,  0.6356,  0.9580,  0.2445,  0.4926,  0.0465,  0.8400,
         0.0275,  0.1451,  0.7528,  0.6267,  0.0565,  0.0556,  0.1197,
         0.5653,  0.7943,  0.0918,  0.1459,  0.3870,  0.9044,  0.1338,
         0.0103,  0.9534,  0.1172,  0.4499,  0.1761,  0.0630,  0.1451,
         0.1239,  0.4504,  0.0370,  0.8225,  0.8542,  0.6855,  0.7778,
         0.7597,  0.8591,  0.7530,  0.1693,  0.7344,  0.9239,  0.9028,
         0.3553,  0.0254,  0.3483,  0.7483,  0.4932,  0.9440,  0.8521,
         0.8054,  0.6761,  0.9743,  0.8501,  0.0966,  0.1731,  0.7845,
         0.9030,  0.2425,  0.2974,  0.9484,  0.8602,  0.1486,  0.1346,
         0.8730,  0.5485,  0.0404,  0.7520,  0.2837,  0.3533,  0.5383,
         0.7946,  0.3918,  0.7875,  0.1615,  0.6668,  0.8444,  0.2894,
         0.0619,  0.9816,  0.6867,  0.0421,  0.6670,  0.1536,  0.0176,
         0.0475,  0.5234,  0.1725,  0.8342,  0.8256,  0.3433,  0.3821,
         0.8574,  0.0451,  0.7395,  0.8260,  0.9015,  0.3340,  0.8721,
         0.2389,  0.8042,  0.1901,  0.9175,  0.7456,  0.0940,  0.7793,
         0.7120,  0.4843,  0.2949,  0.0860,  0.9961,  0.3954,  0.1629,
         0.9027,  0.7527,  0.9973,  0.6181,  0.0073,  0.0678,  0.1044,
         0.8009,  0.0311,  0.7574,  0.5012,  0.3097,  0.8640,  0.0209,
         0.7443,  0.8457,  0.2861,  0.6367,  0.9663,  0.1975,  0.6986,
         0.1042,  0.0312,  0.0686,  0.0370,  0.8207,  0.4603,  0.8267,
         0.5178,  0.2713,  0.1393,  0.5176,  0.8101,  0.8615,  0.1455,
         0.9460,  0.8257,  0.8293,  0.7889,  0.4211,  0.8621,  0.7207,
         0.6315,  0.0347,  0.1059,  0.9717,  0.1042,  0.2979,  0.3742,
         0.0599,  0.4640,  0.8267,  0.8059,  0.6975,  0.9335,  0.7933,
         0.9021,  0.0122,  0.8707,  0.9214,  0.7431,  0.3264,  0.1211,
         0.4536,  0.9487,  0.7083,  0.7782,  0.9396,  0.1738,  0.9325,
         0.9335,  0.1416,  0.6820,  0.2024,  0.7059,  0.9356,  0.0577,
         0.8940,  0.7567,  0.1079,  0.1062,  0.1471,  0.3273,  0.1816,
         0.8501,  0.6910,  0.4432,  0.0139,  0.3405,  0.8654,  0.0625,
         0.0789,  0.0299,  0.9591,  0.6618,  0.3178,  0.2397,  0.8254,
         0.9168,  0.3693,  0.0032,  0.8362,  0.8723,  0.1215,  0.8891,
         0.9832,  0.9321,  0.1093,  0.8036,  0.8003,  0.9413,  0.8581,
         0.1225,  0.7756,  0.8237,  0.9272,  0.7429,  0.8540,  0.7822,
         0.6271,  0.0677,  0.5652,  0.9188,  0.3357,  0.6233,  0.8610,
         0.0952,  0.9829,  0.7583,  0.3545,  0.9135,  0.0670,  0.5514,
         0.4269,  0.6756,  0.9809,  0.0460,  0.9476,  0.0633,  0.9812,
         0.0893,  0.9202,  0.0681,  0.8562,  0.7157,  0.4767,  0.8041,
         0.1195,  0.1542,  0.8435,  0.7724,  0.7844,  0.9891,  0.9286,
         0.2421,  0.7007,  0.3403,  0.2797,  0.6961,  0.9925,  0.7636,
         0.4539,  0.7049,  0.8529,  0.7893,  0.8035,  0.1840,  0.8654,
         0.8999,  0.6056,  0.7357,  0.7862,  0.0087,  0.0385,  0.3213,
         0.0100,  0.2693,  0.6863,  0.5643,  0.8080,  0.8147,  0.8454,
         0.1090,  0.7066,  0.2500,  0.6086,  0.7339,  0.8142,  0.8055,
         0.0843,  0.9113,  0.4504,  0.1184,  0.7783,  0.1858,  0.6383,
         0.0755], device='cuda:0')
tensor(0.3881, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6909,  0.4058,  0.8964,  0.8744,  0.9625,  0.9200,  0.8068,
         0.5963,  0.1850,  0.1191,  0.2001,  0.1298,  0.8569,  0.9090,
         0.9808,  0.0918,  0.8701,  0.0110,  0.2784,  0.8772,  0.7510,
         0.1410,  0.1646,  0.7605,  0.2567,  0.6869,  0.0746,  0.8313,
         0.9150,  0.6959,  0.3312,  0.9661,  0.5970,  0.8486,  0.0249,
         0.1363,  0.5356,  0.4857,  0.1779,  0.9804,  0.8729,  0.1647,
         0.9967,  0.0220,  0.2107,  0.8532,  0.7634,  0.1198,  0.4358,
         0.1112,  0.3076,  0.0855,  0.0338,  0.8890,  0.0369,  0.6613,
         0.7556,  0.9022,  0.0415,  0.1913,  0.2799,  0.1756,  0.8535,
         0.0805,  0.1679,  0.3600,  0.3699,  0.0172,  0.6406,  0.0685,
         0.9195,  0.5261,  0.1607,  0.9890,  0.9299,  0.5065,  0.9609,
         0.2686,  0.6266,  0.4279,  0.8479,  0.9251,  0.9212,  0.0232,
         0.9899,  0.8388,  0.2133,  0.0161,  0.4549,  0.6858,  0.8996,
         0.7127,  0.7201,  0.2272,  0.9701,  0.6836,  0.3761,  0.7095,
         0.0134,  0.8541,  0.5164,  0.9917,  0.1812,  0.9336,  0.3963,
         0.2162,  0.9109,  0.9434,  0.9082,  0.5739,  0.0829,  0.6098,
         0.5960,  0.0905,  0.8089,  0.0209,  0.5682,  0.8161,  0.9618,
         0.9194,  0.8487,  0.0719,  0.8161,  0.9666,  0.5927,  0.9899,
         0.8316,  0.7463,  0.0712,  0.0925,  0.2286,  0.7009,  0.9528,
         0.8886,  0.4368,  0.8993,  0.0348,  0.8616,  0.9101,  0.4112,
         0.9570,  0.0926,  0.3312,  0.1012,  0.7580,  0.8754,  0.1894,
         0.3709,  0.0475,  0.7392,  0.2994,  0.6013,  0.9153,  0.8153,
         0.0551,  0.0537,  0.1410,  0.9066,  0.1854,  0.0806,  0.0453,
         0.9028,  0.7197,  0.6193,  0.2869,  0.6140,  0.1953,  0.9763,
         0.8795,  0.7726,  0.0334,  0.0403,  0.0720,  0.3082,  0.0117,
         0.6214,  0.6143,  0.9233,  0.7913,  0.7268,  0.9148,  0.5780,
         0.8336,  0.9500,  0.1432,  0.4295,  0.6973,  0.9210,  0.2303,
         0.8468,  0.9250,  0.8969,  0.9287,  0.8276,  0.8619,  0.0510,
         0.1036,  0.6459,  0.7452,  0.9229,  0.4039,  0.0942,  0.8233,
         0.9603,  0.3373,  0.3102,  0.8175,  0.9466,  0.7126,  0.6626,
         0.8723,  0.4441,  0.7221,  0.1004,  0.8926,  0.7270,  0.8453,
         0.8609,  0.3217,  0.9461,  0.0578,  0.0669,  0.0944,  0.0697,
         0.8360,  0.4369,  0.1201,  0.8564,  0.1518,  0.9410,  0.1761,
         0.6793,  0.3467,  0.7045,  0.8013,  0.9158,  0.6979,  0.0211,
         0.0958,  0.4696,  0.6849,  0.6620,  0.7010,  0.8767,  0.0852,
         0.1875,  0.1307,  0.8777,  0.6431,  0.9471,  0.9244,  0.1756,
         0.6857,  0.9101,  0.9452,  0.8673,  0.9358,  0.4561,  0.9738,
         0.0431,  0.5665,  0.0328,  0.9336,  0.4111,  0.8852,  0.8864,
         0.8740,  0.6667,  0.9089,  0.2836,  0.0134,  0.0572,  0.4887,
         0.5442,  0.3531,  0.9178,  0.9490,  0.9104,  0.2901,  0.0759,
         0.3371,  0.9457,  0.7063,  0.7571,  0.2256,  0.8197,  0.9026,
         0.0425,  0.6979,  0.9610,  0.4984,  0.9729,  0.0276,  0.0224,
         0.0268,  0.4475,  0.4841,  0.0585,  0.8469,  0.2047,  0.8304,
         0.5830,  0.1101,  0.0553,  0.8646,  0.9160,  0.0610,  0.7003,
         0.9512,  0.8527,  0.0861,  0.9256,  0.6000,  0.8530,  0.9562,
         0.2210,  0.2315,  0.0623,  0.9461,  0.5357,  0.0914,  0.8118,
         0.8060,  0.3954,  0.0678,  0.9526,  0.8902,  0.0669,  0.7707,
         0.3594,  0.3029,  0.7110,  0.6755,  0.7539,  0.6734,  0.0878,
         0.1824,  0.4051,  0.0624,  0.0919,  0.4192,  0.0836,  0.2587,
         0.7657,  0.0654,  0.2941,  0.2669,  0.0530,  0.9537,  0.5308,
         0.0443,  0.0271,  0.9233,  0.1603,  0.3030,  0.0913,  0.7753,
         0.1048,  0.6809,  0.7524,  0.9302,  0.7951,  0.3488,  0.6837,
         0.1451,  0.8626,  0.8946,  0.3486,  0.7592,  0.2445,  0.0275,
         0.5876,  0.9444,  0.3108,  0.7522,  0.8636,  0.4967,  0.6749,
         0.7970,  0.1822,  0.8662,  0.2209,  0.0247,  0.0672,  0.9626,
         0.5607,  0.8561,  0.8544,  0.9079,  0.2918,  0.9177,  0.5077,
         0.1098,  0.8554,  0.5639,  0.0644,  0.6658,  0.7009,  0.7968,
         0.6856,  0.1823,  0.6924,  0.9653,  0.6999,  0.0729,  0.6040,
         0.8602,  0.0728,  0.1920,  0.9026,  0.6143,  0.0787,  0.3147,
         0.8535,  0.7374,  0.8252,  0.9780,  0.7957,  0.7977,  0.6806,
         0.1927,  0.8709,  0.9076,  0.7899,  0.8291,  0.8832,  0.0714,
         0.0853,  0.6821,  0.3455,  0.8427,  0.2342,  0.2325,  0.7358,
         0.9629,  0.2669,  0.9024,  0.5162,  0.9675,  0.1850,  0.6293,
         0.0541,  0.8354,  0.5379,  0.1626,  0.6819,  0.0779,  0.6726,
         0.1920,  0.1031,  0.0347,  0.3156,  0.0106,  0.8464,  0.0513,
         0.7901,  0.1097,  0.8719,  0.7417,  0.2376,  0.0647,  0.2353,
         0.5136,  0.9217,  0.9278,  0.0367,  0.5572,  0.0976,  0.3756,
         0.5406,  0.3728,  0.2864,  0.1480,  0.9968,  0.2856,  0.3736,
         0.8990,  0.9860,  0.8078,  0.8712,  0.9031,  0.1304,  0.4791,
         0.8266,  0.0569,  0.9254,  0.7388,  0.2365,  0.9574,  0.8022,
         0.2204,  0.2496,  0.1358,  0.1445,  0.8593,  0.0244,  0.4547,
         0.8283,  0.8761,  0.8967,  0.9195,  0.2653,  0.0775,  0.0243,
         0.9215,  0.1453,  0.1238,  0.9281,  0.0440,  0.8199,  0.8845,
         0.7246], device='cuda:0')
tensor(0.3637, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1621,  0.5644,  0.0652,  0.9189,  0.8364,  0.9081,  0.8770,
         0.6172,  0.9763,  0.2160,  0.1492,  0.6637,  0.6793,  0.0821,
         0.7685,  0.1327,  0.9631,  0.9417,  0.1459,  0.9106,  0.0223,
         0.0135,  0.0586,  0.0426,  0.3240,  0.7429,  0.8633,  0.6253,
         0.8225,  0.8871,  0.7905,  0.3204,  0.0089,  0.2853,  0.8664,
         0.2380,  0.3958,  0.5578,  0.7281,  0.4002,  0.3364,  0.2941,
         0.1184,  0.8025,  0.9507,  0.0621,  0.8202,  0.7609,  0.3405,
         0.6152,  0.7812,  0.7662,  0.8543,  0.1122,  0.2550,  0.2758,
         0.1656,  0.2421,  0.7332,  0.8444,  0.8752,  0.9073,  0.1508,
         0.4753,  0.8317,  0.8052,  0.7993,  0.8501,  0.5707,  0.4605,
         0.8813,  0.8627,  0.3115,  0.4592,  0.3233,  0.6766,  0.9411,
         0.5835,  0.8735,  0.8682,  0.0170,  0.8223,  0.3124,  0.0987,
         0.7332,  0.1162,  0.3886,  0.1850,  0.1222,  0.8929,  0.1847,
         0.0395,  0.0659,  0.9566,  0.7565,  0.0756,  0.5515,  0.2531,
         0.0536,  0.1717,  0.5215,  0.3692,  0.9090,  0.5864,  0.7308,
         0.6500,  0.0287,  0.8244,  0.1401,  0.0663,  0.8585,  0.9099,
         0.4312,  0.5166,  0.8786,  0.1464,  0.7992,  0.0317,  0.4247,
         0.1731,  0.8885,  0.8346,  0.2984,  0.8860,  0.6677,  0.0748,
         0.1064,  0.8525,  0.0458,  0.0913,  0.6849,  0.2014,  0.1935,
         0.5563,  0.8397,  0.0872,  0.7999,  0.1295,  0.1968,  0.4405,
         0.5007,  0.2234,  0.3194,  0.1213,  0.1363,  0.0715,  0.7161,
         0.7330,  0.0555,  0.0374,  0.1694,  0.7625,  0.7537,  0.0171,
         0.0292,  0.9148,  0.0804,  0.1367,  0.0781,  0.9450,  0.6734,
         0.6111,  0.1560,  0.8921,  0.4212,  0.9233,  0.0526,  0.9453,
         0.6540,  0.9191,  0.7809,  0.0400,  0.9042,  0.5815,  0.8544,
         0.9094,  0.8879,  0.7846,  0.0057,  0.2106,  0.3026,  0.3068,
         0.4214,  0.4442,  0.5885,  0.5688,  0.9629,  0.8850,  0.2611,
         0.9030,  0.1594,  0.1557,  0.2340,  0.6848,  0.8864,  0.7878,
         0.1301,  0.7169,  0.8125,  0.0391,  0.0540,  0.5578,  0.1779,
         0.4344,  0.9363,  0.6557,  0.8087,  0.8679,  0.1188,  0.1088,
         0.2999,  0.9930,  0.0394,  0.1467,  0.8045,  0.6649,  0.3132,
         0.7827,  0.0618,  0.2462,  0.8980,  0.0752,  0.3371,  0.7637,
         0.4189,  0.0575,  0.4261,  0.0891,  0.6804,  0.1147,  0.3005,
         0.1617,  0.3288,  0.5185,  0.1083,  0.1978,  0.0750,  0.5157,
         0.6685,  0.1168,  0.9098,  0.1478,  0.4147,  0.4015,  0.6253,
         0.4369,  0.7024,  0.2102,  0.7734,  0.6954,  0.3497,  0.3120,
         0.1575,  0.2044,  0.1664,  0.9499,  0.9085,  0.4949,  0.0608,
         0.1580,  0.0971,  0.7381,  0.6337,  0.4801,  0.1088,  0.1481,
         0.7703,  0.3063,  0.0982,  0.1441,  0.5067,  0.1581,  0.0982,
         0.4545,  0.2668,  0.4729,  0.8417,  0.0594,  0.9756,  0.0791,
         0.6389,  0.8463,  0.8029,  0.6497,  0.1922,  0.0664,  0.7204,
         0.0666,  0.0757,  0.9071,  0.6851,  0.4821,  0.4022,  0.0057,
         0.0459,  0.6361,  0.9285,  0.3094,  0.0329,  0.8509,  0.9098,
         0.8565,  0.3359,  0.4049,  0.0831,  0.4156,  0.1332,  0.8913,
         0.3206,  0.6215,  0.7816,  0.0548,  0.1936,  0.7860,  0.0340,
         0.1047,  0.8147,  0.3947,  0.0162,  0.6277,  0.9887,  0.2039,
         0.9209,  0.4239,  0.1230,  0.0184,  0.7798,  0.2001,  0.0310,
         0.1356,  0.8026,  0.8935,  0.6109,  0.2420,  0.6326,  0.1364,
         0.0723,  0.4896,  0.8227,  0.5773,  0.9859,  0.3542,  0.9305,
         0.0310,  0.2579,  0.4785,  0.1720,  0.9217,  0.0676,  0.2784,
         0.0493,  0.5276,  0.8967,  0.8805,  0.8193,  0.1543,  0.6683,
         0.7778,  0.1114,  0.2683,  0.1271,  0.7814,  0.8164,  0.3581,
         0.9955,  0.9914,  0.0234,  0.7398,  0.0490,  0.0453,  0.9476,
         0.7632,  0.4116,  0.8013,  0.6134,  0.8686,  0.1591,  0.6778,
         0.0920,  0.0377,  0.6254,  0.2530,  0.9597,  0.1927,  0.0930,
         0.7164,  0.7910,  0.0851,  0.3660,  0.4426,  0.4822,  0.1715,
         0.8633,  0.1081,  0.1577,  0.1192,  0.6949,  0.8385,  0.6740,
         0.8409,  0.8383,  0.0628,  0.0726,  0.0095,  0.9222,  0.1715,
         0.6165,  0.0528,  0.3838,  0.0727,  0.0422,  0.8651,  0.6489,
         0.7247,  0.0398,  0.9709,  0.2071,  0.3835,  0.5993,  0.3467,
         0.5936,  0.1106,  0.1097,  0.8180,  0.2472,  0.7637,  0.8256,
         0.1072,  0.9896,  0.7445,  0.8982,  0.7258,  0.0237,  0.3693,
         0.8795,  0.6959,  0.8231,  0.1960,  0.3882,  0.5098,  0.4806,
         0.8588,  0.0582,  0.9420,  0.8068,  0.1248,  0.4776,  0.3774,
         0.2556,  0.9434,  0.0757,  0.4274,  0.1048,  0.0312,  0.0731,
         0.6751,  0.8149,  0.0061,  0.8476,  0.9005,  0.2309,  0.3567,
         0.9494,  0.0959,  0.8535,  0.1859,  0.7849,  0.8887,  0.1577,
         0.9503,  0.2686,  0.6748,  0.8143,  0.8223,  0.0787,  0.0997,
         0.8730,  0.4621,  0.2107,  0.9251,  0.1086,  0.1036,  0.3305,
         0.9222,  0.1708,  0.9905,  0.9215,  0.7064,  0.2822,  0.8112,
         0.0703,  0.9877,  0.2639,  0.0657,  0.0591,  0.8608,  0.2648,
         0.4008,  0.6929,  0.2852,  0.8213,  0.0786,  0.4483,  0.1063,
         0.8059,  0.4354,  0.0295,  0.2848,  0.5824,  0.7926,  0.2109,
         0.6998], device='cuda:0')
tensor(0.3798, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7610,  0.1649,  0.7411,  0.1030,  0.0892,  0.8247,  0.1025,
         0.0730,  0.0277,  0.7981,  0.0915,  0.8274,  0.9635,  0.8977,
         0.2895,  0.1676,  0.5100,  0.4018,  0.8890,  0.0845,  0.7861,
         0.1963,  0.0543,  0.0755,  0.6824,  0.3121,  0.9141,  0.8836,
         0.9215,  0.3315,  0.1225,  0.8323,  0.9282,  0.1418,  0.0968,
         0.8493,  0.7598,  0.1916,  0.4143,  0.1537,  0.9002,  0.0250,
         0.0242,  0.9524,  0.7551,  0.0334,  0.1702,  0.2483,  0.1406,
         0.8348,  0.9172,  0.8552,  0.1568,  0.1833,  0.6707,  0.7132,
         0.0704,  0.6549,  0.9422,  0.8531,  0.0416,  0.1028,  0.2789,
         0.0623,  0.2340,  0.1027,  0.4293,  0.5574,  0.9643,  0.2700,
         0.7785,  0.8107,  0.7351,  0.1399,  0.5991,  0.2012,  0.5609,
         0.1357,  0.0195,  0.8500,  0.2981,  0.0085,  0.9770,  0.8197,
         0.0164,  0.5545,  0.1191,  0.7464,  0.8155,  0.5300,  0.1704,
         0.6239,  0.2899,  0.9425,  0.8855,  0.1108,  0.7412,  0.7946,
         0.9724,  0.9979,  0.1911,  0.0438,  0.2257,  0.3156,  0.0313,
         0.8770,  0.8456,  0.0630,  0.9465,  0.7994,  0.0824,  0.1285,
         0.5340,  0.4176,  0.7630,  0.7715,  0.9221,  0.6820,  0.5399,
         0.2962,  0.2492,  0.1719,  0.9814,  0.7733,  0.1546,  0.8233,
         0.7358,  0.2740,  0.8441,  0.4208,  0.0072,  0.2051,  0.0762,
         0.3335,  0.9090,  0.1137,  0.7302,  0.9020,  0.4720,  0.1130,
         0.4114,  0.5592,  0.8444,  0.3998,  0.1768,  0.2232,  0.8268,
         0.0772,  0.8747,  0.1283,  0.1265,  0.8870,  0.9213,  0.0853,
         0.5646,  0.0602,  0.6044,  0.7556,  0.1754,  0.7308,  0.5704,
         0.1983,  0.0629,  0.8790,  0.4359,  0.5852,  0.2902,  0.8816,
         0.1528,  0.1223,  0.8386,  0.1095,  0.7366,  0.8609,  0.1847,
         0.1141,  0.0770,  0.5223,  0.2684,  0.0757,  0.2296,  0.0446,
         0.5877,  0.0586,  0.8582,  0.9682,  0.0324,  0.0636,  0.2171,
         0.3114,  0.0300,  0.5422,  0.2605,  0.2646,  0.7813,  0.7116,
         0.4111,  0.6464,  0.7974,  0.0145,  0.6213,  0.9156,  0.9631,
         0.9453,  0.4033,  0.6098,  0.0600,  0.0265,  0.6873,  0.2887,
         0.0189,  0.1415,  0.8224,  0.2568,  0.6445,  0.0693,  0.8890,
         0.5920,  0.7791,  0.0453,  0.7416,  0.0824,  0.3634,  0.7491,
         0.9227,  0.0793,  0.0939,  0.1246,  0.0084,  0.0748,  0.8493,
         0.9026,  0.8920,  0.3233,  0.0452,  0.1342,  0.4243,  0.0500,
         0.0144,  0.0735,  0.1360,  0.1655,  0.7641,  0.0968,  0.2444,
         0.6703,  0.3521,  0.7824,  0.8613,  0.1481,  0.2255,  0.9286,
         0.1177,  0.7911,  0.2839,  0.1344,  0.0488,  0.6921,  0.5268,
         0.2123,  0.4328,  0.8089,  0.2258,  0.1658,  0.1067,  0.3860,
         0.8260,  0.1506,  0.5446,  0.0478,  0.9367,  0.7870,  0.1028,
         0.5827,  0.4078,  0.3379,  0.6854,  0.0280,  0.8615,  0.0306,
         0.0301,  0.9225,  0.4572,  0.1316,  0.0517,  0.0102,  0.4739,
         0.8702,  0.8609,  0.0107,  0.6436,  0.6866,  0.7732,  0.7663,
         0.7939,  0.0131,  0.4747,  0.4992,  0.7792,  0.0537,  0.0763,
         0.4328,  0.0578,  0.7788,  0.9379,  0.0777,  0.3493,  0.6223,
         0.0783,  0.1013,  0.1913,  0.9365,  0.2177,  0.7406,  0.2219,
         0.8058,  0.5511,  0.8663,  0.9613,  0.2649,  0.5458,  0.0270,
         0.5028,  0.1072,  0.1727,  0.8618,  0.1799,  0.8752,  0.3889,
         0.1004,  0.2103,  0.9269,  0.0166,  0.0529,  0.1730,  0.0728,
         0.3993,  0.0452,  0.1175,  0.1370,  0.8531,  0.5215,  0.8119,
         0.9259,  0.4699,  0.1748,  0.3338,  0.9043,  0.3455,  0.3306,
         0.3450,  0.1639,  0.0708,  0.4309,  0.8875,  0.7157,  0.0876,
         0.6307,  0.8576,  0.7591,  0.9397,  0.4337,  0.6433,  0.1302,
         0.0499,  0.3433,  0.2704,  0.2803,  0.3553,  0.7603,  0.9882,
         0.0846,  0.1290,  0.0665,  0.1276,  0.7424,  0.7385,  0.7649,
         0.9948,  0.2708,  0.7601,  0.7780,  0.6181,  0.0868,  0.0800,
         0.1402,  0.3800,  0.1114,  0.2939,  0.2470,  0.3661,  0.4584,
         0.5123,  0.4480,  0.1317,  0.0865,  0.1641,  0.1948,  0.0932,
         0.6912,  0.8846,  0.7564,  0.8990,  0.0704,  0.8869,  0.8629,
         0.0720,  0.9021,  0.9647,  0.4132,  0.9022,  0.0386,  0.1198,
         0.1379,  0.7402,  0.3218,  0.1153,  0.9842,  0.7885,  0.2279,
         0.2616,  0.7524,  0.0421,  0.2852,  0.2731,  0.1206,  0.7918,
         0.1833,  0.0883,  0.0568,  0.4614,  0.0878,  0.0211,  0.9236,
         0.7913,  0.2086,  0.8883,  0.0156,  0.0678,  0.7730,  0.0058,
         0.2465,  0.0424,  0.5896,  0.4422,  0.6072,  0.7090,  0.6986,
         0.9492,  0.0364,  0.9443,  0.1124,  0.1960,  0.3010,  0.9078,
         0.9047,  0.0160,  0.4324,  0.7100,  0.6865,  0.6990,  0.8294,
         0.1267,  0.8589,  0.2892,  0.6207,  0.1257,  0.4265,  0.1351,
         0.8259,  0.6958,  0.1110,  0.6777,  0.1800,  0.8792,  0.6482,
         0.2904,  0.7993,  0.7239,  0.0475,  0.0115,  0.9488,  0.0100,
         0.1334,  0.6784,  0.9606,  0.9373,  0.1466,  0.1662,  0.2461,
         0.6891,  0.0379,  0.9447,  0.4008,  0.2612,  0.1226,  0.1383,
         0.2588,  0.7515,  0.6894,  0.8690,  0.0802,  0.0673,  0.7848,
         0.0099,  0.3408,  0.1689,  0.9941,  0.0519,  0.1741,  0.0871,
         0.1193], device='cuda:0')
tensor(0.4004, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8463,  0.5731,  0.4496,  0.6401,  0.1981,  0.9653,  0.8266,
         0.9961,  0.7877,  0.2031,  0.5798,  0.3135,  0.0453,  0.0494,
         0.7485,  0.3081,  0.1559,  0.0419,  0.5516,  0.5786,  0.0962,
         0.0546,  0.2138,  0.8108,  0.0519,  0.2370,  0.9981,  0.2533,
         0.0708,  0.1048,  0.0769,  0.0648,  0.0056,  0.9006,  0.1048,
         0.5473,  0.6417,  0.0789,  0.3834,  0.1016,  0.4296,  0.0868,
         0.2415,  0.2063,  0.9397,  0.2002,  0.4856,  0.6828,  0.4504,
         0.8774,  0.6317,  0.9684,  0.9381,  0.8510,  0.2681,  0.5652,
         0.3118,  0.8125,  0.3090,  0.9271,  0.6512,  0.1515,  0.1082,
         0.9057,  0.7654,  0.6384,  0.7848,  0.2929,  0.7003,  0.4096,
         0.9585,  0.6120,  0.1404,  0.0437,  0.5307,  0.4686,  0.7697,
         0.1165,  0.9743,  0.9588,  0.7990,  0.0198,  0.1015,  0.4510,
         0.0176,  0.0735,  0.4031,  0.6975,  0.7392,  0.0642,  0.8270,
         0.0682,  0.4143,  0.0460,  0.4917,  0.7513,  0.0466,  0.1256,
         0.3558,  0.1419,  0.2334,  0.0686,  0.2822,  0.5808,  0.2162,
         0.5636,  0.1660,  0.7577,  0.0639,  0.1977,  0.7228,  0.7708,
         0.8081,  0.3367,  0.9632,  0.1036,  0.5676,  0.1544,  0.0608,
         0.2191,  0.1201,  0.8294,  0.9020,  0.9024,  0.9735,  0.9863,
         0.1505,  0.2267,  0.0059,  0.7627,  0.0352,  0.3187,  0.9795,
         0.2933,  0.1567,  0.5569,  0.0126,  0.1115,  0.9586,  0.7851,
         0.8937,  0.1270,  0.2149,  0.0073,  0.9701,  0.0185,  0.8046,
         0.7728,  0.0734,  0.7536,  0.9406,  0.9786,  0.7498,  0.9128,
         0.0601,  0.0746,  0.5906,  0.7571,  0.8811,  0.9968,  0.0864,
         0.8863,  0.3804,  0.0736,  0.5387,  0.1224,  0.3759,  0.8118,
         0.0095,  0.1169,  0.9496,  0.6449,  0.6050,  0.6800,  0.1333,
         0.0303,  0.8633,  0.0748,  0.9126,  0.9722,  0.3734,  0.2420,
         0.8468,  0.4098,  0.7509,  0.8132,  0.9241,  0.1792,  0.1878,
         0.5870,  0.1761,  0.1955,  0.6910,  0.0575,  0.6572,  0.0961,
         0.0401,  0.1401,  0.7805,  0.3128,  0.0312,  0.1104,  0.1068,
         0.0176,  0.0516,  0.3983,  0.9520,  0.6155,  0.2374,  0.9729,
         0.9322,  0.9308,  0.1449,  0.1225,  0.0660,  0.6690,  0.8846,
         0.2960,  0.8658,  0.9329,  0.7756,  0.9480,  0.1384,  0.8969,
         0.4818,  0.6617,  0.9220,  0.9453,  0.1267,  0.5521,  0.1675,
         0.5738,  0.2750,  0.1838,  0.4655,  0.7368,  0.0441,  0.1006,
         0.4105,  0.1340,  0.7006,  0.0885,  0.1136,  0.2839,  0.1570,
         0.1316,  0.6517,  0.0184,  0.0624,  0.0403,  0.0069,  0.7676,
         0.0697,  0.1447,  0.7409,  0.3055,  0.7676,  0.8341,  0.4182,
         0.6311,  0.8309,  0.8095,  0.3572,  0.0541,  0.0421,  0.8466,
         0.0096,  0.2372,  0.2648,  0.3060,  0.2367,  0.0552,  0.0879,
         0.8939,  0.1687,  0.0620,  0.8997,  0.4603,  0.0727,  0.5505,
         0.4931,  0.9895,  0.6004,  0.0457,  0.0597,  0.7316,  0.7529,
         0.2066,  0.6570,  0.2033,  0.6489,  0.8950,  0.8679,  0.9587,
         0.7045,  0.0420,  0.2853,  0.4202,  0.0482,  0.2086,  0.8244,
         0.9586,  0.0909,  0.9172,  0.8350,  0.7527,  0.5717,  0.0521,
         0.9394,  0.0568,  0.7891,  0.5639,  0.0375,  0.1113,  0.1547,
         0.3988,  0.4507,  0.0067,  0.0176,  0.2106,  0.4026,  0.4262,
         0.1149,  0.9415,  0.0739,  0.8401,  0.9542,  0.8867,  0.0931,
         0.8655,  0.3234,  0.1849,  0.8971,  0.0857,  0.0948,  0.0278,
         0.6469,  0.6941,  0.0356,  0.2163,  0.4982,  0.5138,  0.1304,
         0.2080,  0.1213,  0.0286,  0.9063,  0.6056,  0.8142,  0.0294,
         0.9682,  0.9930,  0.6675,  0.0101,  0.0747,  0.5514,  0.0068,
         0.3284,  0.5849,  0.9031,  0.9092,  0.0324,  0.8315,  0.7766,
         0.7826,  0.6614,  0.9480,  0.3038,  0.2888,  0.7274,  0.9907,
         0.2540,  0.0520,  0.7116,  0.0916,  0.3522,  0.9257,  0.1226,
         0.2128,  0.8641,  0.8251,  0.3939,  0.8895,  0.0531,  0.9819,
         0.8899,  0.1932,  0.1436,  0.2585,  0.5818,  0.0040,  0.7894,
         0.7545,  0.1293,  0.0570,  0.0438,  0.3657,  0.5065,  0.0545,
         0.8925,  0.1451,  0.9897,  0.8938,  0.2813,  0.5681,  0.0671,
         0.3703,  0.9671,  0.0454,  0.1112,  0.2014,  0.9118,  0.5890,
         0.1686,  0.8732,  0.5711,  0.8280,  0.2542,  0.8081,  0.1934,
         0.6721,  0.0143,  0.6345,  0.1152,  0.4665,  0.7619,  0.5905,
         0.3331,  0.0562,  0.0614,  0.0121,  0.4729,  0.8523,  0.0208,
         0.2660,  0.1030,  0.0273,  0.2033,  0.5987,  0.0079,  0.6151,
         0.8960,  0.9028,  0.7741,  0.0367,  0.9566,  0.0566,  0.9384,
         0.3525,  0.9000,  0.1407,  0.4346,  0.1276,  0.7532,  0.9136,
         0.0509,  0.0497,  0.0770,  0.0089,  0.7196,  0.8037,  0.4831,
         0.2793,  0.7050,  0.9864,  0.0915,  0.2809,  0.1290,  0.1853,
         0.2334,  0.4935,  0.8484,  0.4976,  0.8474,  0.7428,  0.5109,
         0.9002,  0.6126,  0.7851,  0.9489,  0.8446,  0.9724,  0.1755,
         0.8978,  0.0334,  0.0490,  0.9252,  0.4297,  0.8461,  0.0321,
         0.0747,  0.2329,  0.8622,  0.4308,  0.8885,  0.8733,  0.5169,
         0.2266,  0.9223,  0.7413,  0.5000,  0.5234,  0.4855,  0.0201,
         0.8279,  0.0304,  0.9099,  0.9076,  0.0519,  0.0484,  0.7861,
         0.2456], device='cuda:0')
tensor(0.4130, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0868,  0.2359,  0.0863,  0.2888,  0.1330,  0.2611,  0.3411,
         0.4454,  0.9649,  0.6507,  0.0374,  0.0153,  0.0595,  0.1434,
         0.0319,  0.9154,  0.9787,  0.5382,  0.1085,  0.0632,  0.1605,
         0.8056,  0.5019,  0.6721,  0.9200,  0.0460,  0.8371,  0.0743,
         0.2370,  0.5422,  0.7164,  0.9676,  0.9509,  0.2647,  0.7966,
         0.1088,  0.8761,  0.0609,  0.1618,  0.8217,  0.4431,  0.1506,
         0.8379,  0.7659,  0.0292,  0.9476,  0.9109,  0.0061,  0.0591,
         0.8563,  0.0609,  0.9061,  0.0586,  0.6657,  0.8241,  0.4442,
         0.6556,  0.9888,  0.3733,  0.1496,  0.7831,  0.1208,  0.8957,
         0.4896,  0.2750,  0.0325,  0.6064,  0.0996,  0.0693,  0.1198,
         0.8971,  0.1168,  0.1724,  0.3811,  0.2789,  0.8560,  0.8613,
         0.0327,  0.4568,  0.3642,  0.6490,  0.2988,  0.8821,  0.0247,
         0.1315,  0.1155,  0.3573,  0.6149,  0.6424,  0.9178,  0.4961,
         0.5528,  0.1768,  0.9304,  0.3463,  0.9266,  0.2763,  0.1034,
         0.1485,  0.9459,  0.0601,  0.7987,  0.1193,  0.0445,  0.1589,
         0.8048,  0.5630,  0.1236,  0.1359,  0.9051,  0.5078,  0.2764,
         0.0465,  0.2045,  0.3676,  0.7330,  0.0916,  0.2255,  0.4776,
         0.4584,  0.7502,  0.7932,  0.3700,  0.8683,  0.1955,  0.3389,
         0.1889,  0.8949,  0.1084,  0.1125,  0.7405,  0.9172,  0.0365,
         0.9448,  0.9175,  0.1253,  0.3340,  0.0646,  0.9788,  0.5875,
         0.2448,  0.1054,  0.7573,  0.7598,  0.9385,  0.8983,  0.6665,
         0.5491,  0.4948,  0.8710,  0.8998,  0.0735,  0.0244,  0.9537,
         0.9779,  0.9489,  0.1890,  0.2511,  0.2164,  0.9055,  0.9799,
         0.6543,  0.6631,  0.3814,  0.0291,  0.4852,  0.7874,  0.7981,
         0.3395,  0.9261,  0.1232,  0.0581,  0.3210,  0.0762,  0.8486,
         0.1779,  0.3408,  0.8915,  0.9485,  0.0611,  0.9346,  0.5242,
         0.9206,  0.9706,  0.7189,  0.7019,  0.3773,  0.3113,  0.4726,
         0.8449,  0.9630,  0.2745,  0.5857,  0.0841,  0.1087,  0.3623,
         0.2009,  0.9870,  0.0620,  0.4811,  0.0544,  0.6181,  0.5467,
         0.8453,  0.9714,  0.0629,  0.0344,  0.6288,  0.1019,  0.9508,
         0.5996,  0.2440,  0.1467,  0.3834,  0.8273,  0.9931,  0.9537,
         0.9046,  0.9686,  0.3860,  0.3071,  0.1358,  0.6365,  0.0772,
         0.0451,  0.8795,  0.8690,  0.4428,  0.7558,  0.7116,  0.9162,
         0.0529,  0.8543,  0.9299,  0.1626,  0.1062,  0.9569,  0.0080,
         0.3915,  0.0154,  0.7894,  0.6751,  0.9938,  0.7982,  0.8762,
         0.0914,  0.4462,  0.4980,  0.1317,  0.6225,  0.8607,  0.0577,
         0.6940,  0.9703,  0.9354,  0.8943,  0.2136,  0.7772,  0.8548,
         0.0415,  0.0857,  0.9733,  0.3341,  0.8269,  0.7117,  0.8224,
         0.0880,  0.4961,  0.9260,  0.4691,  0.0475,  0.0328,  0.5499,
         0.9844,  0.3179,  0.8390,  0.3203,  0.3954,  0.9513,  0.2607,
         0.0534,  0.2615,  0.7107,  0.1215,  0.9782,  0.6575,  0.0135,
         0.0094,  0.2357,  0.9991,  0.0274,  0.1034,  0.1107,  0.9733,
         0.2202,  0.7117,  0.0292,  0.0327,  0.8248,  0.1400,  0.6445,
         0.0282,  0.7836,  0.3201,  0.8191,  0.9572,  0.8896,  0.0713,
         0.9263,  0.7816,  0.7921,  0.7258,  0.0615,  0.0605,  0.5125,
         0.8782,  0.5916,  0.9610,  0.7506,  0.0722,  0.8803,  0.0633,
         0.3103,  0.1008,  0.9670,  0.2693,  0.4633,  0.0436,  0.8793,
         0.1553,  0.5587,  0.2450,  0.9590,  0.2103,  0.0625,  0.0982,
         0.0478,  0.0721,  0.4528,  0.0906,  0.3698,  0.2541,  0.8893,
         0.9467,  0.0359,  0.2580,  0.9222,  0.7604,  0.5786,  0.7080,
         0.0593,  0.0669,  0.4738,  0.2105,  0.8422,  0.7624,  0.6757,
         0.3362,  0.8443,  0.3939,  0.8873,  0.0599,  0.9167,  0.7848,
         0.2887,  0.0832,  0.8173,  0.9006,  0.7818,  0.0116,  0.9916,
         0.9034,  0.2111,  0.9519,  0.1949,  0.1028,  0.7944,  0.8964,
         0.0370,  0.6266,  0.1380,  0.9206,  0.6290,  0.9189,  0.0637,
         0.2589,  0.3261,  0.9146,  0.9456,  0.2716,  0.2414,  0.1481,
         0.3582,  0.9265,  0.1420,  0.7370,  0.0748,  0.8590,  0.1034,
         0.9689,  0.9002,  0.0453,  0.8576,  0.1383,  0.1667,  0.8774,
         0.0569,  0.8151,  0.1062,  0.0112,  0.5963,  0.7816,  0.0916,
         0.4549,  0.7452,  0.6661,  0.0409,  0.0118,  0.0388,  0.6706,
         0.0476,  0.7330,  0.0769,  0.0939,  0.6145,  0.0526,  0.0760,
         0.9637,  0.8268,  0.8020,  0.7262,  0.7095,  0.8419,  0.5262,
         0.3883,  0.1078,  0.0864,  0.9427,  0.6616,  0.0175,  0.9551,
         0.0450,  0.0962,  0.1512,  0.9758,  0.8698,  0.2420,  0.9718,
         0.3283,  0.1600,  0.0191,  0.7388,  0.9945,  0.4507,  0.2732,
         0.2963,  0.0081,  0.9830,  0.2952,  0.2411,  0.5868,  0.6951,
         0.1138,  0.0117,  0.0237,  0.6195,  0.7727,  0.9341,  0.8796,
         0.8875,  0.8549,  0.1332,  0.2876,  0.0632,  0.3024,  0.8245,
         0.5307,  0.9121,  0.2357,  0.0567,  0.3553,  0.3696,  0.0564,
         0.7324,  0.7621,  0.9444,  0.1108,  0.7846,  0.8192,  0.2035,
         0.1439,  0.8475,  0.9647,  0.1529,  0.2720,  0.8771,  0.9010,
         0.5372,  0.1574,  0.8389,  0.8014,  0.9472,  0.5965,  0.3226,
         0.9759,  0.9784,  0.6621,  0.1017,  0.2002,  0.7051,  0.6178,
         0.2521], device='cuda:0')
tensor(0.4006, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0254,  0.9266,  0.0448,  0.2954,  0.4709,  0.7013,  0.0201,
         0.5472,  0.6327,  0.9167,  0.8625,  0.0631,  0.0544,  0.8295,
         0.0392,  0.5863,  0.5963,  0.9266,  0.0215,  0.5737,  0.9726,
         0.3601,  0.3794,  0.2887,  0.9819,  0.9957,  0.9189,  0.4205,
         0.9557,  0.0097,  0.1309,  0.8764,  0.8499,  0.5514,  0.3343,
         0.9040,  0.4356,  0.9274,  0.1097,  0.1254,  0.6872,  0.9108,
         0.2259,  0.2939,  0.0711,  0.0857,  0.2306,  0.0567,  0.7323,
         0.1408,  0.9593,  0.0781,  0.1759,  0.0464,  0.0613,  0.2542,
         0.3124,  0.0910,  0.9963,  0.2012,  0.7969,  0.9934,  0.9676,
         0.8924,  0.2433,  0.0734,  0.2008,  0.6531,  0.0173,  0.6595,
         0.3860,  0.0506,  0.5494,  0.7560,  0.9087,  0.9306,  0.7006,
         0.0569,  0.6003,  0.9550,  0.6052,  0.6557,  0.9320,  0.5114,
         0.1711,  0.1688,  0.3926,  0.7808,  0.5003,  0.9284,  0.1065,
         0.8861,  0.0434,  0.4969,  0.1372,  0.2391,  0.6914,  0.9517,
         0.3171,  0.3825,  0.2116,  0.0792,  0.0583,  0.2449,  0.1301,
         0.9776,  0.9407,  0.0809,  0.9787,  0.7514,  0.8729,  0.7609,
         0.8816,  0.0616,  0.8637,  0.1336,  0.9312,  0.9298,  0.9781,
         0.4345,  0.1587,  0.7078,  0.0454,  0.7599,  0.1144,  0.0770,
         0.9144,  0.8993,  0.3935,  0.1574,  0.0629,  0.9980,  0.1330,
         0.7290,  0.9570,  0.0700,  0.9586,  0.4650,  0.9127,  0.9735,
         0.0837,  0.8132,  0.8785,  0.4302,  0.8050,  0.1249,  0.3387,
         0.3275,  0.8983,  0.1302,  0.7991,  0.4444,  0.7933,  0.9787,
         0.3128,  0.8955,  0.8633,  0.0065,  0.9778,  0.7841,  0.8145,
         0.1663,  0.4707,  0.1859,  0.0273,  0.6397,  0.1033,  0.0722,
         0.3041,  0.9432,  0.2772,  0.1255,  0.1754,  0.5344,  0.4243,
         0.7418,  0.2300,  0.6510,  0.0736,  0.3261,  0.0423,  0.7387,
         0.9955,  0.9495,  0.2333,  0.7175,  0.1459,  0.9497,  0.8896,
         0.7837,  0.2225,  0.4279,  0.0482,  0.5113,  0.0709,  0.1182,
         0.3491,  0.1792,  0.1724,  0.0855,  0.4552,  0.9324,  0.7062,
         0.9955,  0.0656,  0.2369,  0.9356,  0.9042,  0.8874,  0.2065,
         0.9682,  0.8757,  0.8867,  0.3676,  0.1417,  0.9534,  0.6539,
         0.0239,  0.0162,  0.1804,  0.1314,  0.9527,  0.0255,  0.1249,
         0.1538,  0.2692,  0.9829,  0.8133,  0.7632,  0.8893,  0.0369,
         0.7289,  0.0026,  0.1824,  0.9527,  0.4363,  0.9500,  0.7601,
         0.7805,  0.0742,  0.8499,  0.0068,  0.1874,  0.1231,  0.1378,
         0.5381,  0.9846,  0.3764,  0.8537,  0.0294,  0.4805,  0.0795,
         0.6723,  0.3462,  0.0505,  0.9269,  0.5006,  0.9663,  0.9450,
         0.8773,  0.0692,  0.6306,  0.1277,  0.3660,  0.0363,  0.9272,
         0.0199,  0.0599,  0.5840,  0.9452,  0.1570,  0.1158,  0.9421,
         0.0456,  0.9781,  0.2766,  0.4566,  0.0451,  0.9933,  0.0187,
         0.0361,  0.1077,  0.7515,  0.9185,  0.0227,  0.1223,  0.9252,
         0.8576,  0.9087,  0.1215,  0.8898,  0.0439,  0.1573,  0.8066,
         0.3013,  0.0679,  0.1436,  0.0138,  0.8789,  0.9837,  0.0473,
         0.6675,  0.9786,  0.8977,  0.9484,  0.2831,  0.7549,  0.5692,
         0.1616,  0.0823,  0.0234,  0.7854,  0.8079,  0.8851,  0.9072,
         0.4727,  0.8529,  0.9757,  0.9797,  0.7700,  0.1001,  0.9511,
         0.2985,  0.8524,  0.0610,  0.2197,  0.0457,  0.1030,  0.2973,
         0.1661,  0.2802,  0.9687,  0.0074,  0.7649,  0.9016,  0.9975,
         0.9203,  0.1430,  0.1546,  0.2470,  0.9921,  0.2793,  0.1000,
         0.7236,  0.9695,  0.1484,  0.0700,  0.9974,  0.7329,  0.1329,
         0.0239,  0.0986,  0.5556,  0.7247,  0.8150,  0.2112,  0.2781,
         0.1675,  0.8666,  0.8903,  0.0462,  0.9130,  0.6667,  0.9407,
         0.0131,  0.9563,  0.9652,  0.5838,  0.9219,  0.1182,  0.1273,
         0.3911,  0.8759,  0.8817,  0.7145,  0.6462,  0.9686,  0.7163,
         0.0646,  0.6647,  0.2450,  0.2685,  0.3493,  0.8774,  0.0786,
         0.5028,  0.6005,  0.7895,  0.7705,  0.0391,  0.9491,  0.5930,
         0.8284,  0.2409,  0.9728,  0.2448,  0.4998,  0.8556,  0.9563,
         0.2058,  0.9301,  0.2958,  0.2785,  0.9823,  0.9223,  0.8106,
         0.1935,  0.9678,  0.0146,  0.0906,  0.1454,  0.2995,  0.2780,
         0.8260,  0.0648,  0.8754,  0.1488,  0.9232,  0.4288,  0.1165,
         0.2662,  0.7851,  0.9805,  0.8137,  0.8518,  0.8714,  0.9207,
         0.2286,  0.9446,  0.1578,  0.6940,  0.8380,  0.3872,  0.0294,
         0.2477,  0.8796,  0.9155,  0.2981,  0.0929,  0.9656,  0.0832,
         0.1665,  0.4875,  0.9660,  0.9982,  0.4263,  0.9419,  0.5395,
         0.1273,  0.8082,  0.0113,  0.0798,  0.9478,  0.8401,  0.0587,
         0.5861,  0.0883,  0.8424,  0.2245,  0.4209,  0.6031,  0.1502,
         0.9818,  0.1768,  0.8278,  0.1522,  0.1414,  0.3770,  0.6916,
         0.0767,  0.2961,  0.7665,  0.5762,  0.9496,  0.8464,  0.8766,
         0.3173,  0.4635,  0.1475,  0.3022,  0.2059,  0.2742,  0.0483,
         0.9564,  0.1931,  0.1424,  0.0206,  0.5943,  0.3077,  0.0776,
         0.1024,  0.9349,  0.8749,  0.9615,  0.1372,  0.0294,  0.0829,
         0.1278,  0.4847,  0.8005,  0.1856,  0.7581,  0.7314,  0.6530,
         0.3322,  0.1004,  0.2402,  0.1066,  0.4010,  0.9261,  0.9179,
         0.8374], device='cuda:0')
tensor(0.3419, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8021,  0.0912,  0.4775,  0.1815,  0.9876,  0.2867,  0.9098,
         0.9178,  0.9941,  0.6901,  0.2097,  0.9977,  0.9835,  0.1098,
         0.0926,  0.0114,  0.8798,  0.0220,  0.9102,  0.2083,  0.9901,
         0.1074,  0.6406,  0.5864,  0.9922,  0.8645,  0.1878,  0.0280,
         0.9975,  0.5512,  0.8835,  0.4105,  0.6640,  0.9118,  0.5158,
         0.1436,  0.7568,  0.9654,  0.9323,  0.8574,  0.9625,  0.2852,
         0.4929,  0.3481,  0.4429,  0.0679,  0.0307,  0.0481,  0.0175,
         0.0182,  0.3047,  0.9685,  0.2414,  0.7653,  0.0436,  0.4490,
         0.9924,  0.8478,  0.8793,  0.2757,  0.1380,  0.9147,  0.0833,
         0.2529,  0.8701,  0.8486,  0.0952,  0.0544,  0.0396,  0.0124,
         0.1516,  0.0731,  0.8381,  0.1574,  0.1615,  0.3172,  0.4771,
         0.8213,  0.2497,  0.2919,  0.8721,  0.4466,  0.0886,  0.9760,
         0.9911,  0.1058,  0.1466,  0.3407,  0.9010,  0.3019,  0.8326,
         0.5426,  0.6741,  0.1289,  0.9694,  0.9197,  0.0578,  0.0141,
         0.0661,  0.0876,  0.9428,  0.8594,  0.1527,  0.8588,  0.9461,
         0.5515,  0.6402,  0.9861,  0.9411,  0.3254,  0.5181,  0.9770,
         0.0043,  0.9637,  0.8341,  0.4533,  0.2224,  0.7361,  0.7482,
         0.7632,  0.1385,  0.8975,  0.8337,  0.1976,  0.9579,  0.9398,
         0.6830,  0.9415,  0.0097,  0.7713,  0.9135,  0.9182,  0.8854,
         0.8497,  0.8497,  0.9723,  0.7185,  0.2685,  0.1719,  0.9935,
         0.8953,  0.8064,  0.8877,  0.9068,  0.9361,  0.3608,  0.9894,
         0.8203,  0.8636,  0.8436,  0.4014,  0.0445,  0.9873,  0.1462,
         0.9489,  0.8910,  0.3141,  0.9454,  0.7959,  0.8017,  0.1928,
         0.6517,  0.1009,  0.9204,  0.5994,  0.7633,  0.9963,  0.2938,
         0.3475,  0.1452,  0.0827,  0.2030,  0.5275,  0.0503,  0.0193,
         0.9230,  0.8749,  0.8613,  0.9578,  0.9789,  0.0419,  0.8666,
         0.8729,  0.0982,  0.4744,  0.8939,  0.8167,  0.1549,  0.6415,
         0.8554,  0.0087,  0.9938,  0.0284,  0.8944,  0.0030,  0.7194,
         0.1087,  0.8683,  0.1247,  0.0958,  0.2904,  0.1390,  0.6739,
         0.9951,  0.7079,  0.5069,  0.9317,  0.1566,  0.0374,  0.5501,
         0.1169,  0.9920,  0.1705,  0.3398,  0.4612,  0.9086,  0.3732,
         0.8628,  0.3147,  0.9110,  0.7100,  0.8131,  0.9613,  0.0638,
         0.7750,  0.7750,  0.8797,  0.8403,  0.9961,  0.0111,  0.1976,
         0.9062,  0.9340,  0.3303,  0.4398,  0.9276,  0.0313,  0.8490,
         0.1627,  0.8996,  0.8627,  0.1809,  0.9201,  0.1096,  0.9915,
         0.9659,  0.0458,  0.8190,  0.3357,  0.5633,  0.5578,  0.9329,
         0.8240,  0.9637,  0.0549,  0.9864,  0.0859,  0.8632,  0.9565,
         0.9946,  0.9387,  0.7358,  0.1694,  0.2037,  0.9102,  0.1744,
         0.8211,  0.8628,  0.3930,  0.9108,  0.8751,  0.4371,  0.1103,
         0.9790,  0.9146,  0.1352,  0.9820,  0.9353,  0.4196,  0.9412,
         0.5898,  0.0528,  0.1174,  0.8296,  0.2171,  0.9389,  0.9698,
         0.2810,  0.3912,  0.7648,  0.0427,  0.8911,  0.3002,  0.6323,
         0.8174,  0.1060,  0.9351,  0.5896,  0.8611,  0.1044,  0.0432,
         0.0683,  0.6005,  0.1872,  0.4328,  0.9747,  0.1917,  0.7838,
         0.3997,  0.9585,  0.9315,  0.9668,  0.3403,  0.2086,  0.1675,
         0.9418,  0.9198,  0.0663,  0.2919,  0.9909,  0.9653,  0.5115,
         0.9842,  0.7982,  0.8053,  0.7567,  0.6013,  0.9128,  0.9975,
         0.1475,  0.8583,  0.9774,  0.0721,  0.0479,  0.9496,  0.1236,
         0.8818,  0.6349,  0.7664,  0.9317,  0.9452,  0.1289,  0.8468,
         0.1868,  0.9909,  0.7955,  0.9258,  0.8931,  0.8611,  0.0120,
         0.2123,  0.0651,  0.5188,  0.9305,  0.2084,  0.7452,  0.2247,
         0.8935,  0.9134,  0.9244,  0.9597,  0.1453,  0.7387,  0.5644,
         0.8209,  0.8891,  0.2458,  0.9827,  0.9717,  0.0602,  0.9710,
         0.7782,  0.9252,  0.2821,  0.1073,  0.6658,  0.9415,  0.9977,
         0.0704,  0.8974,  0.1777,  0.2456,  0.2104,  0.8933,  0.9943,
         0.1850,  0.8421,  0.1775,  0.0756,  0.4668,  0.8519,  0.9392,
         0.0505,  0.7583,  0.1267,  0.9101,  0.8019,  0.7361,  0.9669,
         0.0170,  0.9096,  0.1675,  0.6366,  0.1472,  0.5153,  0.8374,
         0.0107,  0.7310,  0.0101,  0.6009,  0.9666,  0.9697,  0.9447,
         0.0365,  0.3026,  0.3467,  0.9813,  0.9089,  0.9133,  0.1894,
         0.1229,  0.8770,  0.7260,  0.1548,  0.9718,  0.9978,  0.3005,
         0.8526,  0.9245,  0.8836,  0.2554,  0.7261,  0.9306,  0.3214,
         0.8827,  0.5919,  0.2852,  0.7766,  0.0083,  0.8274,  0.9666,
         0.7311,  0.4585,  0.0823,  0.8632,  0.9593,  0.8883,  0.3852,
         0.3025,  0.9814,  0.9985,  0.1343,  0.9218,  0.1442,  0.8873,
         0.3168,  0.0976,  0.0397,  0.9437,  0.2450,  0.7856,  0.3874,
         0.1114,  0.8489,  0.2313,  0.1389,  0.0164,  0.8051,  0.8767,
         0.9632,  0.0140,  0.4925,  0.5159,  0.0836,  0.4385,  0.2692,
         0.0902,  0.7562,  0.9253,  0.5038,  0.7945,  0.1759,  0.9582,
         0.1582,  0.2307,  0.8874,  0.1071,  0.6968,  0.0285,  0.9089,
         0.9834,  0.4868,  0.2319,  0.0908,  0.4392,  0.0119,  0.0776,
         0.1011,  0.4914,  0.4423,  0.4971,  0.9074,  0.1359,  0.1648,
         0.2700,  0.9574,  0.9270,  0.9041,  0.7946,  0.8232,  0.0573,
         0.1234], device='cuda:0')
tensor(0.4115, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1901,  0.9184,  0.9805,  0.8995,  0.0162,  0.0331,  0.1005,
         0.9352,  0.8225,  0.9239,  0.6477,  0.9210,  0.9494,  0.3317,
         0.5037,  0.1667,  0.7804,  0.4899,  0.0505,  0.6589,  0.8621,
         0.9525,  0.2358,  0.5870,  0.9495,  0.9452,  0.2092,  0.7980,
         0.9601,  0.5029,  0.3623,  0.0149,  0.9438,  0.8609,  0.1298,
         0.2105,  0.0538,  0.3263,  0.1812,  0.9210,  0.0347,  0.0882,
         0.2778,  0.9177,  0.7068,  0.9689,  0.2753,  0.1987,  0.1933,
         0.8445,  0.2625,  0.9981,  0.4925,  0.0568,  0.1646,  0.2125,
         0.9696,  0.6992,  0.1605,  0.3063,  0.9103,  0.9584,  0.3946,
         0.4498,  0.2232,  0.1324,  0.8557,  0.6167,  0.9783,  0.9969,
         0.7400,  0.0410,  0.4442,  0.9973,  0.8762,  0.9192,  0.3064,
         0.0803,  0.3053,  0.3590,  0.0486,  0.9203,  0.9068,  0.2311,
         0.4765,  0.1041,  0.2578,  0.9387,  0.0563,  0.0712,  0.9610,
         0.8612,  0.9824,  0.3276,  0.1818,  0.3311,  0.8910,  0.8150,
         0.8061,  0.3347,  0.1667,  0.3637,  0.8698,  0.7436,  0.9852,
         0.6751,  0.7317,  0.1771,  0.8050,  0.2523,  0.1082,  0.5245,
         0.9274,  0.0882,  0.7558,  0.1948,  0.2506,  0.8770,  0.5551,
         0.1480,  0.5110,  0.8043,  0.0679,  0.8507,  0.8910,  0.2530,
         0.4518,  0.2990,  0.9111,  0.4806,  0.2923,  0.1103,  0.8634,
         0.8252,  0.9412,  0.9321,  0.8812,  0.2096,  0.8103,  0.2812,
         0.8571,  0.9243,  0.9743,  0.8812,  0.8567,  0.0600,  0.1002,
         0.8887,  0.1202,  0.1668,  0.9189,  0.9597,  0.9111,  0.0936,
         0.4389,  0.9447,  0.2481,  0.7284,  0.9517,  0.8657,  0.0946,
         0.4065,  0.1441,  0.9340,  0.0468,  0.9809,  0.2375,  0.9147,
         0.8211,  0.9571,  0.6938,  0.0433,  0.0769,  0.8940,  0.2059,
         0.1387,  0.1192,  0.5997,  0.4492,  0.5390,  0.9131,  0.1658,
         0.3394,  0.9942,  0.7622,  0.7668,  0.5387,  0.4779,  0.9762,
         0.0800,  0.8962,  0.4573,  0.8568,  0.0613,  0.2947,  0.9172,
         0.0268,  0.0304,  0.4761,  0.8727,  0.1667,  0.9435,  0.9610,
         0.6975,  0.6939,  0.9307,  0.1514,  0.2107,  0.0193,  0.0637,
         0.0902,  0.5565,  0.8874,  0.2396,  0.5073,  0.9783,  0.8729,
         0.1556,  0.8806,  0.9215,  0.2069,  0.0944,  0.9021,  0.7947,
         0.3568,  0.3187,  0.2054,  0.3181,  0.0468,  0.8906,  0.1045,
         0.8778,  0.9540,  0.8194,  0.4200,  0.8053,  0.5052,  0.6519,
         0.4628,  0.5494,  0.8583,  0.9190,  0.9773,  0.5309,  0.9105,
         0.9727,  0.0717,  0.5059,  0.1816,  0.9500,  0.9341,  0.5020,
         0.1347,  0.7334,  0.2351,  0.4010,  0.8521,  0.3548,  0.2216,
         0.7240,  0.9601,  0.0503,  0.1085,  0.8950,  0.8098,  0.9472,
         0.8613,  0.9281,  0.9056,  0.1285,  0.0324,  0.0738,  0.9047,
         0.8480,  0.7676,  0.0560,  0.7992,  0.9986,  0.9600,  0.2098,
         0.2329,  0.1915,  0.9450,  0.0328,  0.9155,  0.9381,  0.2346,
         0.3334,  0.8438,  0.1689,  0.8188,  0.8013,  0.1304,  0.3383,
         0.1346,  0.6757,  0.5050,  0.6364,  0.9298,  0.0314,  0.8432,
         0.2222,  0.4495,  0.1566,  0.9423,  0.6640,  0.3493,  0.7207,
         0.9412,  0.6025,  0.2603,  0.8679,  0.7258,  0.9215,  0.8859,
         0.0123,  0.9025,  0.1358,  0.7721,  0.8741,  0.5484,  0.2024,
         0.6388,  0.9411,  0.7891,  0.1586,  0.1040,  0.2880,  0.9193,
         0.9842,  0.9524,  0.4649,  0.0403,  0.9658,  0.1319,  0.8445,
         0.8673,  0.1623,  0.7624,  0.8563,  0.2974,  0.9807,  0.7245,
         0.0207,  0.9585,  0.9606,  0.1080,  0.8841,  0.8671,  0.5520,
         0.9534,  0.2853,  0.8845,  0.8597,  0.9781,  0.9308,  0.3594,
         0.4911,  0.8296,  0.0914,  0.0530,  0.1156,  0.9245,  0.3264,
         0.8681,  0.8918,  0.6746,  0.0230,  0.9699,  0.1410,  0.9552,
         0.3232,  0.6445,  0.8466,  0.0857,  0.0763,  0.2947,  0.9531,
         0.0311,  0.7796,  0.6919,  0.8809,  0.8050,  0.8377,  0.2012,
         0.6282,  0.7862,  0.9754,  0.0372,  0.9178,  0.8997,  0.0780,
         0.1651,  0.9076,  0.7955,  0.3809,  0.9005,  0.0899,  0.5277,
         0.8727,  0.5634,  0.9466,  0.8841,  0.8411,  0.5003,  0.6450,
         0.2107,  0.3495,  0.2046,  0.9398,  0.9137,  0.8207,  0.0240,
         0.8595,  0.1808,  0.1495,  0.8637,  0.9645,  0.0236,  0.1808,
         0.9252,  0.6488,  0.2043,  0.9204,  0.9063,  0.3552,  0.0204,
         0.9448,  0.9433,  0.8941,  0.0862,  0.0513,  0.0373,  0.9438,
         0.8626,  0.8947,  0.9877,  0.3265,  0.5366,  0.8305,  0.2054,
         0.0470,  0.4944,  0.2026,  0.2077,  0.9111,  0.6291,  0.0102,
         0.9375,  0.3174,  0.0435,  0.8716,  0.0192,  0.2891,  0.1316,
         0.1097,  0.9184,  0.1782,  0.0410,  0.9033,  0.0793,  0.4282,
         0.3198,  0.0461,  0.6207,  0.0126,  0.2304,  0.4864,  0.2234,
         0.1528,  0.3897,  0.8516,  0.9283,  0.9798,  0.9777,  0.0630,
         0.8327,  0.9105,  0.5655,  0.0476,  0.1708,  0.8959,  0.9454,
         0.9249,  0.9148,  0.2408,  0.1744,  0.9280,  0.8675,  0.7725,
         0.0845,  0.7877,  0.9723,  0.0213,  0.4412,  0.1761,  0.8909,
         0.9743,  0.8806,  0.1100,  0.9695,  0.1117,  0.2148,  0.8575,
         0.6198,  0.9387,  0.1283,  0.0240,  0.9512,  0.8760,  0.1121,
         0.9371], device='cuda:0')
tensor(0.4424, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8840,  0.3814,  0.7862,  0.0485,  0.0337,  0.7574,  0.7976,
         0.0631,  0.2828,  0.7624,  0.2141,  0.4211,  0.8033,  0.9464,
         0.8778,  0.6992,  0.3056,  0.1199,  0.5306,  0.7245,  0.0055,
         0.0971,  0.7911,  0.8827,  0.8107,  0.8020,  0.1342,  0.3698,
         0.0895,  0.0436,  0.5221,  0.4862,  0.0320,  0.5679,  0.0265,
         0.0379,  0.8525,  0.6316,  0.4995,  0.7102,  0.6917,  0.2055,
         0.4158,  0.8472,  0.9216,  0.0645,  0.9488,  0.0460,  0.8433,
         0.2484,  0.2090,  0.9381,  0.5214,  0.4467,  0.2155,  0.4477,
         0.0682,  0.0851,  0.3612,  0.4312,  0.7907,  0.8135,  0.0194,
         0.9222,  0.9828,  0.7828,  0.6379,  0.0839,  0.0561,  0.7953,
         0.5337,  0.8904,  0.9543,  0.7603,  0.8098,  0.2494,  0.7890,
         0.9031,  0.3921,  0.4165,  0.0939,  0.7990,  0.0458,  0.9813,
         0.0062,  0.2831,  0.8553,  0.2556,  0.4591,  0.0273,  0.9157,
         0.6169,  0.0173,  0.2918,  0.5029,  0.2465,  0.1216,  0.0618,
         0.8875,  0.5716,  0.3864,  0.8991,  0.6446,  0.9373,  0.8828,
         0.4485,  0.8362,  0.9558,  0.9605,  0.1245,  0.2718,  0.0903,
         0.7622,  0.8620,  0.3444,  0.5488,  0.7047,  0.1380,  0.0313,
         0.8000,  0.0123,  0.8577,  0.0389,  0.0668,  0.1945,  0.0181,
         0.0383,  0.8793,  0.9222,  0.0867,  0.7479,  0.0597,  0.9399,
         0.6936,  0.0297,  0.2524,  0.2987,  0.0564,  0.4599,  0.9031,
         0.3805,  0.6097,  0.9500,  0.1089,  0.9674,  0.2368,  0.9219,
         0.8295,  0.1917,  0.1282,  0.8834,  0.1325,  0.7678,  0.7225,
         0.8942,  0.9633,  0.0985,  0.9495,  0.7056,  0.8568,  0.7877,
         0.0797,  0.1029,  0.3999,  0.9887,  0.0908,  0.5128,  0.3003,
         0.9823,  0.0102,  0.8300,  0.2241,  0.7441,  0.1780,  0.0317,
         0.9486,  0.0746,  0.8209,  0.5609,  0.0265,  0.0871,  0.7383,
         0.0962,  0.9020,  0.6272,  0.9417,  0.6175,  0.0478,  0.8702,
         0.7272,  0.7726,  0.7844,  0.2375,  0.4421,  0.2387,  0.0322,
         0.0346,  0.6367,  0.5653,  0.9784,  0.7744,  0.7235,  0.3648,
         0.9664,  0.0799,  0.6251,  0.0875,  0.3368,  0.9698,  0.0852,
         0.9216,  0.6587,  0.2638,  0.1112,  0.0549,  0.0643,  0.9208,
         0.8087,  0.5481,  0.2232,  0.3136,  0.1896,  0.5706,  0.8809,
         0.7689,  0.1000,  0.7686,  0.9091,  0.1730,  0.8916,  0.0523,
         0.6697,  0.9350,  0.8440,  0.4563,  0.0421,  0.8424,  0.9943,
         0.9561,  0.2201,  0.0486,  0.7233,  0.3157,  0.9425,  0.9221,
         0.0557,  0.3189,  0.3770,  0.0236,  0.0698,  0.8817,  0.1967,
         0.2630,  0.5375,  0.8431,  0.1549,  0.8041,  0.6414,  0.8086,
         0.6876,  0.6261,  0.5776,  0.5746,  0.9984,  0.5049,  0.8631,
         0.9630,  0.8638,  0.1755,  0.9756,  0.2535,  0.3018,  0.3253,
         0.8835,  0.1281,  0.7666,  0.9165,  0.0110,  0.9409,  0.1513,
         0.9157,  0.4844,  0.0614,  0.7372,  0.8236,  0.1233,  0.8347,
         0.3178,  0.4048,  0.0457,  0.2189,  0.2289,  0.1127,  0.0936,
         0.7559,  0.5221,  0.5666,  0.2493,  0.5386,  0.9986,  0.8270,
         0.9566,  0.7701,  0.0638,  0.9483,  0.1087,  0.2531,  0.9115,
         0.0389,  0.8658,  0.9216,  0.4755,  0.9357,  0.3607,  0.6539,
         0.8298,  0.9644,  0.7476,  0.6749,  0.6748,  0.7680,  0.9680,
         0.0628,  0.0699,  0.7287,  0.7160,  0.9750,  0.9061,  0.2054,
         0.8718,  0.5753,  0.0969,  0.2407,  0.6129,  0.3149,  0.6507,
         0.6936,  0.0507,  0.9605,  0.9238,  0.0484,  0.0943,  0.9984,
         0.9320,  0.0504,  0.7207,  0.2732,  0.1796,  0.2823,  0.8833,
         0.0744,  0.1145,  0.0340,  0.8831,  0.5910,  0.8960,  0.7529,
         0.7388,  0.5830,  0.4922,  0.4205,  0.9149,  0.0761,  0.3707,
         0.5972,  0.0606,  0.1560,  0.1939,  0.9888,  0.0445,  0.9660,
         0.9872,  0.0850,  0.8704,  0.1597,  0.2070,  0.9188,  0.4016,
         0.6349,  0.2012,  0.1383,  0.8817,  0.9766,  0.9969,  0.5083,
         0.0979,  0.9676,  0.0668,  0.2425,  0.6135,  0.0184,  0.9042,
         0.0282,  0.8939,  0.0360,  0.4401,  0.7210,  0.0325,  0.9678,
         0.9783,  0.1776,  0.3454,  0.1383,  0.9835,  0.3034,  0.9144,
         0.0442,  0.0066,  0.8321,  0.0917,  0.0369,  0.0551,  0.6577,
         0.6642,  0.9496,  0.1992,  0.8744,  0.8835,  0.7682,  0.8801,
         0.2631,  0.2373,  0.7929,  0.1494,  0.3352,  0.6190,  0.6488,
         0.3364,  0.6773,  0.8082,  0.0155,  0.2136,  0.3960,  0.8353,
         0.1404,  0.6256,  0.5645,  0.9451,  0.1047,  0.1788,  0.9197,
         0.3319,  0.9494,  0.9522,  0.0431,  0.3277,  0.6716,  0.1465,
         0.9828,  0.0479,  0.0466,  0.2851,  0.4651,  0.1528,  0.4751,
         0.0530,  0.4050,  0.6708,  0.8517,  0.0100,  0.1164,  0.9966,
         0.1725,  0.2184,  0.5270,  0.8697,  0.6675,  0.2142,  0.8016,
         0.7554,  0.0171,  0.5962,  0.1133,  0.3060,  0.1817,  0.2388,
         0.8162,  0.2778,  0.0442,  0.9131,  0.9451,  0.9223,  0.1781,
         0.3304,  0.9146,  0.6843,  0.0559,  0.0311,  0.0523,  0.5286,
         0.0699,  0.7209,  0.9389,  0.8981,  0.4425,  0.8043,  0.9365,
         0.1327,  0.4638,  0.9395,  0.9663,  0.1190,  0.9406,  0.0136,
         0.7678,  0.8423,  0.0583,  0.2900,  0.6438,  0.9911,  0.7800,
         0.0160], device='cuda:0')
tensor(0.3962, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6125,  0.2839,  0.9790,  0.9921,  0.6473,  0.9715,  0.2027,
         0.9724,  0.8477,  0.5725,  0.2617,  0.3337,  0.4297,  0.7399,
         0.5842,  0.7920,  0.9296,  0.1539,  0.7132,  0.6610,  0.9344,
         0.4438,  0.0064,  0.0304,  0.2070,  0.9646,  0.8614,  0.8072,
         0.4695,  0.4573,  0.5431,  0.3009,  0.7279,  0.5947,  0.9679,
         0.9345,  0.9131,  0.6944,  0.0936,  0.3927,  0.9895,  0.7764,
         0.6408,  0.1376,  0.9345,  0.2917,  0.9732,  0.8307,  0.7377,
         0.0204,  0.1933,  0.7696,  0.2180,  0.9119,  0.8861,  0.4870,
         0.7210,  0.0643,  0.5906,  0.9134,  0.6757,  0.0690,  0.7380,
         0.5997,  0.0544,  0.6492,  0.0182,  0.0555,  0.6767,  0.7761,
         0.0136,  0.0841,  0.0065,  0.7825,  0.3379,  0.4343,  0.2205,
         0.9004,  0.8710,  0.1971,  0.0236,  0.8096,  0.4491,  0.9506,
         0.1081,  0.1369,  0.9383,  0.7765,  0.6850,  0.5629,  0.2353,
         0.6584,  0.7079,  0.6376,  0.0108,  0.3794,  0.1082,  0.8805,
         0.2981,  0.9662,  0.0412,  0.8020,  0.8610,  0.1341,  0.3257,
         0.2868,  0.1204,  0.9005,  0.6566,  0.4236,  0.6942,  0.2020,
         0.3230,  0.6715,  0.0614,  0.4203,  0.8387,  0.2678,  0.7454,
         0.9502,  0.5891,  0.7290,  0.1283,  0.9306,  0.7739,  0.0413,
         0.3307,  0.4433,  0.9462,  0.2286,  0.1037,  0.9417,  0.2031,
         0.1723,  0.4518,  0.6813,  0.2305,  0.8384,  0.9569,  0.8402,
         0.4667,  0.2623,  0.1988,  0.7457,  0.2917,  0.8549,  0.0598,
         0.8823,  0.5917,  0.0744,  0.4775,  0.9178,  0.9424,  0.9434,
         0.1446,  0.5377,  0.4938,  0.7659,  0.9285,  0.4608,  0.0268,
         0.8936,  0.1899,  0.1225,  0.1660,  0.9739,  0.4924,  0.8334,
         0.2622,  0.8921,  0.4174,  0.8556,  0.6203,  0.3882,  0.6426,
         0.7828,  0.1721,  0.1648,  0.9019,  0.5971,  0.0589,  0.8680,
         0.2312,  0.1002,  0.9989,  0.9930,  0.1296,  0.7849,  0.9484,
         0.0258,  0.4547,  0.1428,  0.4560,  0.8098,  0.8515,  0.8081,
         0.9237,  0.2881,  0.9485,  0.9453,  0.0129,  0.7057,  0.9920,
         0.4234,  0.2929,  0.6385,  0.2275,  0.0214,  0.8957,  0.8941,
         0.5290,  0.9938,  0.9294,  0.1205,  0.1876,  0.0960,  0.0254,
         0.2201,  0.6245,  0.7426,  0.8673,  0.0221,  0.0216,  0.1024,
         0.7463,  0.3852,  0.2300,  0.0658,  0.1189,  0.7691,  0.1151,
         0.8509,  0.0954,  0.9182,  0.1466,  0.8454,  0.8308,  0.9649,
         0.3018,  0.0254,  0.0536,  0.4983,  0.9851,  0.1579,  0.8277,
         0.6588,  0.1424,  0.0959,  0.7179,  0.3469,  0.4821,  0.8146,
         0.2495,  0.1141,  0.1108,  0.1853,  0.2139,  0.0505,  0.3223,
         0.1704,  0.9941,  0.2055,  0.2698,  0.7818,  0.3576,  0.0609,
         0.2279,  0.1400,  0.3186,  0.1337,  0.2104,  0.6378,  0.4563,
         0.1186,  0.6061,  0.2903,  0.9771,  0.9132,  0.0464,  0.1230,
         0.4824,  0.7676,  0.9835,  0.0838,  0.3447,  0.0437,  0.6088,
         0.9039,  0.2208,  0.0419,  0.5867,  0.5674,  0.3123,  0.0329,
         0.9649,  0.4164,  0.7103,  0.6174,  0.3591,  0.8803,  0.8356,
         0.4581,  0.3799,  0.0864,  0.7441,  0.0772,  0.2285,  0.9636,
         0.1819,  0.6110,  0.0228,  0.9380,  0.3997,  0.9902,  0.2626,
         0.3840,  0.9155,  0.8250,  0.6217,  0.9114,  0.1493,  0.1103,
         0.2540,  0.8670,  0.3829,  0.0543,  0.3999,  0.4288,  0.2396,
         0.4600,  0.1860,  0.0767,  0.9020,  0.1336,  0.8194,  0.1060,
         0.8870,  0.1121,  0.6975,  0.1735,  0.0621,  0.9118,  0.4098,
         0.8437,  0.8075,  0.1886,  0.6323,  0.4496,  0.5673,  0.3693,
         0.7589,  0.5048,  0.1887,  0.3511,  0.1648,  0.4631,  0.6184,
         0.1959,  0.0362,  0.9756,  0.0227,  0.0303,  0.5879,  0.6803,
         0.9340,  0.9047,  0.1398,  0.5888,  0.8639,  0.8619,  0.0458,
         0.0982,  0.0783,  0.5407,  0.8955,  0.0759,  0.0919,  0.3683,
         0.1411,  0.6574,  0.8580,  0.3211,  0.5123,  0.3552,  0.4882,
         0.0851,  0.6853,  0.7327,  0.0331,  0.9445,  0.7543,  0.1075,
         0.0996,  0.0306,  0.9018,  0.8910,  0.1797,  0.0291,  0.7695,
         0.1636,  0.6798,  0.0316,  0.1255,  0.7896,  0.3088,  0.0580,
         0.9921,  0.8899,  0.5548,  0.0247,  0.0231,  0.7162,  0.7867,
         0.2151,  0.4933,  0.0856,  0.9212,  0.0362,  0.7404,  0.8741,
         0.0336,  0.7545,  0.5152,  0.2218,  0.0285,  0.3638,  0.3548,
         0.9108,  0.6116,  0.7951,  0.4381,  0.5284,  0.6157,  0.7179,
         0.9988,  0.9854,  0.3089,  0.0486,  0.7605,  0.9533,  0.1796,
         0.0590,  0.4409,  0.9813,  0.0964,  0.3378,  0.8172,  0.0782,
         0.7024,  0.7530,  0.0587,  0.1711,  0.2026,  0.8612,  0.0898,
         0.8385,  0.7380,  0.5074,  0.1121,  0.9209,  0.9414,  0.8435,
         0.7561,  0.9812,  0.0395,  0.0665,  0.8872,  0.1468,  0.4805,
         0.9974,  0.3346,  0.2591,  0.1406,  0.7471,  0.8344,  0.8427,
         0.0428,  0.0240,  0.8925,  0.6683,  0.9619,  0.6381,  0.8952,
         0.8041,  0.1376,  0.0994,  0.2671,  0.0357,  0.3840,  0.7807,
         0.0942,  0.3165,  0.8560,  0.0748,  0.2439,  0.0942,  0.2543,
         0.8465,  0.9851,  0.6431,  0.2851,  0.2000,  0.4593,  0.3066,
         0.9169,  0.9368,  0.8064,  0.0321,  0.9686,  0.9325,  0.9713,
         0.5830], device='cuda:0')
tensor(0.3825, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8296,  0.0581,  0.4391,  0.9804,  0.9431,  0.6371,  0.0433,
         0.6202,  0.8242,  0.7120,  0.2912,  0.2540,  0.1871,  0.8553,
         0.1142,  0.2317,  0.2752,  0.7319,  0.0483,  0.6656,  0.6865,
         0.0941,  0.9078,  0.8972,  0.2050,  0.5295,  0.8159,  0.7721,
         0.5913,  0.0756,  0.9105,  0.8954,  0.1952,  0.4838,  0.7628,
         0.5741,  0.4703,  0.6963,  0.8701,  0.3482,  0.0740,  0.1567,
         0.9770,  0.3601,  0.1434,  0.8506,  0.6073,  0.8106,  0.7964,
         0.8294,  0.9936,  0.3619,  0.1256,  0.9370,  0.0319,  0.8319,
         0.1519,  0.3256,  0.1342,  0.0558,  0.7976,  0.0890,  0.6111,
         0.8026,  0.5417,  0.0819,  0.6780,  0.8524,  0.3874,  0.2518,
         0.8545,  0.8487,  0.1418,  0.0704,  0.1200,  0.6478,  0.1750,
         0.7741,  0.1655,  0.9106,  0.3296,  0.4064,  0.9960,  0.0759,
         0.7692,  0.9866,  0.7411,  0.0918,  0.8388,  0.1187,  0.1012,
         0.1186,  0.3058,  0.1967,  0.9864,  0.0383,  0.7888,  0.7116,
         0.1105,  0.2994,  0.1318,  0.8304,  0.0608,  0.9862,  0.2857,
         0.8974,  0.1368,  0.7349,  0.3260,  0.6106,  0.1809,  0.7004,
         0.0893,  0.8377,  0.0805,  0.9889,  0.0709,  0.6278,  0.0311,
         0.8354,  0.7949,  0.8311,  0.0573,  0.7187,  0.2032,  0.6625,
         0.3003,  0.5092,  0.0809,  0.0831,  0.8992,  0.3398,  0.6120,
         0.0768,  0.9766,  0.3611,  0.8141,  0.1724,  0.7986,  0.9086,
         0.9101,  0.7199,  0.9156,  0.9918,  0.7857,  0.2017,  0.4388,
         0.2148,  0.2793,  0.8458,  0.0696,  0.8430,  0.7639,  0.1407,
         0.4876,  0.9773,  0.8751,  0.1366,  0.0459,  0.8557,  0.8765,
         0.6863,  0.7075,  0.9334,  0.1682,  0.0147,  0.0620,  0.2654,
         0.5061,  0.9135,  0.8919,  0.5591,  0.1549,  0.7108,  0.8250,
         0.7202,  0.1233,  0.1528,  0.7459,  0.8422,  0.9619,  0.6034,
         0.0735,  0.9212,  0.2905,  0.3442,  0.6675,  0.1034,  0.2225,
         0.2120,  0.9794,  0.0899,  0.3115,  0.2038,  0.1683,  0.0479,
         0.5046,  0.8853,  0.9689,  0.8662,  0.0162,  0.9300,  0.9139,
         0.3571,  0.1842,  0.7619,  0.6028,  0.1551,  0.1652,  0.8781,
         0.5406,  0.3497,  0.9191,  0.6573,  0.4520,  0.6871,  0.4000,
         0.8236,  0.7974,  0.7439,  0.3540,  0.6806,  0.7341,  0.3998,
         0.2019,  0.8993,  0.7538,  0.5487,  0.7461,  0.4161,  0.1153,
         0.4409,  0.9179,  0.8393,  0.6940,  0.5438,  0.9088,  0.3671,
         0.8680,  0.4871,  0.8634,  0.1564,  0.5551,  0.6357,  0.6876,
         0.9113,  0.9406,  0.9431,  0.7877,  0.0330,  0.7128,  0.4653,
         0.6313,  0.5422,  0.9494,  0.9716,  0.9585,  0.0507,  0.8648,
         0.1324,  0.9825,  0.1969,  0.8288,  0.9989,  0.2822,  0.9368,
         0.7874,  0.9607,  0.9682,  0.1651,  0.4250,  0.3943,  0.4778,
         0.0660,  0.0292,  0.8212,  0.8654,  0.9710,  0.8250,  0.8122,
         0.2148,  0.7485,  0.7739,  0.1169,  0.5574,  0.5110,  0.1381,
         0.1477,  0.3126,  0.6700,  0.0439,  0.2878,  0.3288,  0.8683,
         0.1953,  0.7267,  0.7341,  0.6684,  0.6324,  0.9345,  0.1877,
         0.0240,  0.9042,  0.9835,  0.2552,  0.2675,  0.7655,  0.7128,
         0.4024,  0.5246,  0.3563,  0.8703,  0.7272,  0.8205,  0.0723,
         0.1641,  0.2586,  0.3914,  0.7965,  0.9872,  0.8557,  0.6328,
         0.8763,  0.7168,  0.7732,  0.5839,  0.7195,  0.0658,  0.8292,
         0.8751,  0.8990,  0.0443,  0.0456,  0.8801,  0.4246,  0.2566,
         0.9666,  0.8851,  0.3918,  0.0465,  0.2963,  0.0231,  0.6518,
         0.8597,  0.9566,  0.1816,  0.6575,  0.4485,  0.2398,  0.1814,
         0.9319,  0.3152,  0.1690,  0.8968,  0.0167,  0.8074,  0.9309,
         0.2047,  0.5437,  0.1947,  0.8245,  0.0213,  0.8485,  0.1814,
         0.8420,  0.7104,  0.9896,  0.2459,  0.9537,  0.8393,  0.8499,
         0.7381,  0.3877,  0.2790,  0.2761,  0.2614,  0.8919,  0.6556,
         0.9778,  0.2769,  0.0400,  0.2698,  0.0833,  0.9701,  0.3658,
         0.0454,  0.6883,  0.5879,  0.7996,  0.9210,  0.9716,  0.6286,
         0.6612,  0.8918,  0.1254,  0.1308,  0.1358,  0.6982,  0.2508,
         0.2386,  0.8663,  0.0134,  0.8918,  0.1680,  0.7236,  0.1861,
         0.0474,  0.9673,  0.9809,  0.1444,  0.9060,  0.8055,  0.8544,
         0.8301,  0.6296,  0.9452,  0.4654,  0.6561,  0.0623,  0.9665,
         0.8348,  0.4548,  0.0898,  0.4572,  0.2985,  0.9156,  0.0341,
         0.9456,  0.2624,  0.9677,  0.0321,  0.3885,  0.8701,  0.2880,
         0.5712,  0.0363,  0.8760,  0.9631,  0.3264,  0.1127,  0.4364,
         0.6911,  0.7019,  0.3391,  0.0328,  0.1237,  0.0124,  0.9479,
         0.1383,  0.7697,  0.1045,  0.1254,  0.4256,  0.2524,  0.3497,
         0.9577,  0.0112,  0.7662,  0.2353,  0.8616,  0.9522,  0.9759,
         0.7992,  0.4663,  0.0235,  0.6449,  0.1439,  0.3341,  0.0725,
         0.3455,  0.3445,  0.1228,  0.9122,  0.1143,  0.9191,  0.9547,
         0.0100,  0.1815,  0.8495,  0.9314,  0.8674,  0.6989,  0.8372,
         0.9799,  0.5180,  0.5829,  0.5515,  0.4601,  0.0566,  0.8874,
         0.3084,  0.1120,  0.8499,  0.7974,  0.0719,  0.9936,  0.2384,
         0.8788,  0.0382,  0.1167,  0.2346,  0.0442,  0.9242,  0.1512,
         0.7936,  0.9411,  0.9177,  0.7880,  0.4463,  0.7952,  0.8374,
         0.1880], device='cuda:0')
tensor(0.4321, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6457,  0.1988,  0.8643,  0.8793,  0.3278,  0.3441,  0.5079,
         0.4192,  0.4003,  0.9291,  0.1250,  0.8730,  0.1644,  0.1080,
         0.8727,  0.0351,  0.2312,  0.6326,  0.9629,  0.0378,  0.9591,
         0.1079,  0.9557,  0.2583,  0.0806,  0.8256,  0.9492,  0.1237,
         0.9992,  0.9275,  0.0446,  0.4240,  0.1784,  0.3674,  0.9492,
         0.9831,  0.9536,  0.0198,  0.4989,  0.9542,  0.8864,  0.1973,
         0.3318,  0.9102,  0.9353,  0.8806,  0.7906,  0.8307,  0.1773,
         0.9807,  0.9151,  0.0815,  0.6166,  0.9137,  0.1950,  0.8399,
         0.7558,  0.4981,  0.0437,  0.3786,  0.0459,  0.8501,  0.0602,
         0.2164,  0.1799,  0.0308,  0.5256,  0.9969,  0.4745,  0.8976,
         0.9994,  0.2465,  0.4566,  0.0106,  0.9685,  0.1383,  0.8478,
         0.0867,  0.3006,  0.7827,  0.6735,  0.0684,  0.9404,  0.0041,
         0.5421,  0.9997,  0.1743,  0.9974,  0.5672,  0.0204,  0.3605,
         0.2010,  0.6646,  0.0696,  0.9448,  0.3096,  0.8851,  0.5262,
         0.9685,  0.9668,  0.6981,  0.1130,  0.5877,  0.0483,  0.0736,
         0.6750,  0.7325,  0.6412,  0.0975,  0.1876,  0.5648,  0.3586,
         0.9331,  0.6934,  0.0245,  0.9153,  0.5719,  0.4595,  0.9240,
         0.2125,  0.9962,  0.1271,  0.9825,  0.9198,  0.2331,  0.6079,
         0.1624,  0.1217,  0.4961,  0.1484,  0.9241,  0.8747,  0.1100,
         0.2208,  0.7685,  0.8804,  0.9645,  0.7753,  0.0826,  0.9479,
         0.9965,  0.7915,  0.2167,  0.3233,  0.7580,  0.1937,  0.5432,
         0.9034,  0.0690,  0.9042,  0.0210,  0.6661,  0.9471,  0.6530,
         0.1631,  0.0524,  0.0637,  0.6457,  0.6168,  0.6119,  0.2534,
         0.2388,  0.8932,  0.5083,  0.6472,  0.3326,  0.9478,  0.1319,
         0.5764,  0.5175,  0.1782,  0.0602,  0.8009,  0.7867,  0.2880,
         0.5298,  0.9593,  0.9145,  0.6409,  0.1726,  0.7955,  0.5060,
         0.4287,  0.0860,  0.1747,  0.5955,  0.1644,  0.0670,  0.1648,
         0.0643,  0.5711,  0.3179,  0.2999,  0.0614,  0.9432,  0.0642,
         0.8512,  0.8327,  0.0967,  0.0820,  0.2267,  0.0831,  0.1530,
         0.3349,  0.4504,  0.9986,  0.8159,  0.9257,  0.9693,  0.7689,
         0.0621,  0.8790,  0.1865,  0.1356,  0.1340,  0.0067,  0.5849,
         0.1869,  0.1433,  0.9790,  0.3584,  0.4185,  0.9064,  0.1045,
         0.0146,  0.8441,  0.1342,  0.8767,  0.3147,  0.9467,  0.8600,
         0.1550,  0.8822,  0.9516,  0.8704,  0.8192,  0.6169,  0.8842,
         0.2289,  0.4400,  0.9913,  0.3014,  0.8946,  0.8599,  0.2018,
         0.8322,  0.0241,  0.7877,  0.0497,  0.5282,  0.6937,  0.4021,
         0.4040,  0.7676,  0.2377,  0.8491,  0.7046,  0.1236,  0.2361,
         0.2799,  0.6778,  0.6825,  0.2654,  0.1215,  0.9514,  0.9794,
         0.4740,  0.7096,  0.9574,  0.0658,  0.6020,  0.0336,  0.0021,
         0.9853,  0.9259,  0.9163,  0.3251,  0.1869,  0.4316,  0.0789,
         0.0226,  0.4980,  0.0651,  0.6032,  0.1160,  0.6888,  0.1642,
         0.0758,  0.4593,  0.7648,  0.9067,  0.0227,  0.3831,  0.0324,
         0.8314,  0.1542,  0.7845,  0.6991,  0.7416,  0.6849,  0.8146,
         0.4607,  0.1499,  0.4952,  0.8675,  0.0125,  0.0235,  0.8865,
         0.0466,  0.1056,  0.5091,  0.2709,  0.8554,  0.5271,  0.9101,
         0.9705,  0.3596,  0.4820,  0.7974,  0.6815,  0.0521,  0.9883,
         0.5076,  0.9639,  0.6610,  0.9610,  0.7918,  0.7090,  0.9964,
         0.9902,  0.1940,  0.7770,  0.8763,  0.9241,  0.7786,  0.1734,
         0.1255,  0.4886,  0.9336,  0.0351,  0.0374,  0.5131,  0.8816,
         0.1301,  0.0965,  0.0273,  0.1644,  0.9144,  0.9254,  0.0853,
         0.2810,  0.8791,  0.7547,  0.1496,  0.2626,  0.0280,  0.8943,
         0.0864,  0.5871,  0.4058,  0.1647,  0.0686,  0.9006,  0.4483,
         0.6836,  0.3183,  0.7587,  0.7246,  0.9149,  0.0616,  0.0102,
         0.0549,  0.8764,  0.0520,  0.5046,  0.2280,  0.4855,  0.9441,
         0.5547,  0.0559,  0.9451,  0.2131,  0.9253,  0.1564,  0.8700,
         0.0629,  0.1829,  0.8487,  0.2406,  0.6620,  0.1494,  0.0329,
         0.3463,  0.8656,  0.7003,  0.9029,  0.1921,  0.7180,  0.9023,
         0.9106,  0.8160,  0.1029,  0.7300,  0.8041,  0.0816,  0.9938,
         0.8196,  0.0465,  0.8458,  0.0837,  0.6783,  0.9568,  0.5258,
         0.1503,  0.9264,  0.9371,  0.4695,  0.1488,  0.1981,  0.5512,
         0.6122,  0.7134,  0.3597,  0.9745,  0.2654,  0.0044,  0.7178,
         0.0753,  0.5835,  0.7270,  0.3961,  0.6981,  0.5632,  0.9492,
         0.9976,  0.1812,  0.8728,  0.2687,  0.0331,  0.3009,  0.0960,
         0.1046,  0.0819,  0.1940,  0.9647,  0.8796,  0.2316,  0.0361,
         0.0857,  0.7318,  0.8902,  0.3206,  0.0420,  0.0681,  0.8675,
         0.0865,  0.5415,  0.6796,  0.1837,  0.2076,  0.0938,  0.4253,
         0.7832,  0.0234,  0.6788,  0.0795,  0.5554,  0.1672,  0.0847,
         0.8509,  0.9887,  0.6332,  0.5169,  0.1013,  0.0159,  0.0481,
         0.8359,  0.9530,  0.1350,  0.7571,  0.0404,  0.5856,  0.0876,
         0.2109,  0.0445,  0.4587,  0.8751,  0.0989,  0.4927,  0.1179,
         0.1205,  0.9983,  0.2182,  0.8373,  0.0290,  0.8629,  0.1777,
         0.4661,  0.9590,  0.8260,  0.9202,  0.1057,  0.0246,  0.4451,
         0.9053,  0.0697,  0.2092,  0.8251,  0.4598,  0.8278,  0.5709,
         0.0935], device='cuda:0')
tensor(0.3569, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9303,  0.3583,  0.9838,  0.8564,  0.0542,  0.7231,  0.9520,
         0.3778,  0.9943,  0.0432,  0.7375,  0.0223,  0.3083,  0.8438,
         0.0940,  0.8728,  0.8770,  0.3032,  0.0773,  0.7784,  0.2885,
         0.9306,  0.6714,  0.0873,  0.5178,  0.1773,  0.0560,  0.9459,
         0.2688,  0.4482,  0.5368,  0.9415,  0.0867,  0.9724,  0.9788,
         0.3908,  0.1075,  0.9966,  0.0448,  0.0380,  0.0217,  0.2150,
         0.9304,  0.1140,  0.0031,  0.9986,  0.8338,  0.5507,  0.9202,
         0.9049,  0.6330,  0.1755,  0.3344,  0.2527,  0.1809,  0.3678,
         0.8532,  0.2356,  0.1315,  0.1658,  0.8967,  0.1446,  0.6233,
         0.6934,  0.0629,  0.0558,  0.9503,  0.0303,  0.0753,  0.9128,
         0.8321,  0.8085,  0.9364,  0.9551,  0.5068,  0.0976,  0.0513,
         0.0296,  0.5167,  0.0341,  0.9623,  0.0680,  0.8322,  0.1270,
         0.0434,  0.2017,  0.0218,  0.6978,  0.0481,  0.8765,  0.2265,
         0.1687,  0.7975,  0.8370,  0.8987,  0.2036,  0.2546,  0.7716,
         0.0904,  0.8754,  0.0717,  0.3177,  0.8347,  0.0269,  0.9809,
         0.3388,  0.3834,  0.1207,  0.4068,  0.8328,  0.4074,  0.3084,
         0.2337,  0.0121,  0.3872,  0.7312,  0.7170,  0.2768,  0.8248,
         0.4063,  0.2872,  0.9805,  0.9877,  0.0913,  0.1513,  0.3288,
         0.7094,  0.0213,  0.0649,  0.0951,  0.2631,  0.8186,  0.0758,
         0.2477,  0.7664,  0.7885,  0.7944,  0.0480,  0.8855,  0.6492,
         0.7856,  0.6885,  0.7103,  0.1111,  0.7823,  0.3752,  0.9143,
         0.9698,  0.9169,  0.9558,  0.2947,  0.7063,  0.4758,  0.7161,
         0.0681,  0.1028,  0.5643,  0.3542,  0.0889,  0.5878,  0.4918,
         0.5564,  0.9619,  0.0944,  0.0416,  0.9604,  0.7398,  0.2247,
         0.8768,  0.5902,  0.0682,  0.1946,  0.2301,  0.7864,  0.6783,
         0.8836,  0.6693,  0.0331,  0.1167,  0.6054,  0.5012,  0.3115,
         0.0032,  0.9106,  0.6884,  0.6710,  0.8980,  0.0176,  0.4684,
         0.9659,  0.1500,  0.1155,  0.1246,  0.4208,  0.0583,  0.1689,
         0.1651,  0.7828,  0.0991,  0.1942,  0.0921,  0.9943,  0.1303,
         0.4029,  0.7351,  0.2217,  0.5409,  0.1630,  0.5864,  0.8140,
         0.3804,  0.6045,  0.0457,  0.9832,  0.7844,  0.6964,  0.0560,
         0.7784,  0.8595,  0.5693,  0.1040,  0.0085,  0.9069,  0.1216,
         0.2900,  0.4385,  0.7872,  0.2537,  0.6609,  0.0398,  0.6641,
         0.3630,  0.9343,  0.7518,  0.0460,  0.1363,  0.5837,  0.9724,
         0.9715,  0.9303,  0.0809,  0.5398,  0.4924,  0.9401,  0.4797,
         0.1291,  0.0331,  0.0517,  0.9982,  0.0873,  0.1469,  0.8718,
         0.5284,  0.7846,  0.0468,  0.3873,  0.4283,  0.8295,  0.0713,
         0.1765,  0.9091,  0.1639,  0.7833,  0.8827,  0.0212,  0.9586,
         0.2078,  0.3087,  0.5437,  0.0221,  0.9074,  0.9024,  0.6341,
         0.2586,  0.1245,  0.9728,  0.1738,  0.7094,  0.2253,  0.0283,
         0.0895,  0.9755,  0.9310,  0.8296,  0.6058,  0.3752,  0.8209,
         0.8987,  0.2426,  0.8647,  0.0810,  0.2441,  0.0851,  0.2718,
         0.9480,  0.0246,  0.0648,  0.2345,  0.7801,  0.0642,  0.9033,
         0.1211,  0.2456,  0.1596,  0.1135,  0.7858,  0.1554,  0.9462,
         0.0739,  0.2482,  0.2417,  0.6358,  0.8975,  0.3221,  0.3547,
         0.6693,  0.1089,  0.3136,  0.9060,  0.3610,  0.7825,  0.0867,
         0.0431,  0.9502,  0.1829,  0.0918,  0.9014,  0.8462,  0.0379,
         0.9211,  0.0102,  0.9707,  0.0636,  0.1791,  0.2503,  0.4966,
         0.4327,  0.8343,  0.8731,  0.3063,  0.8076,  0.1982,  0.8924,
         0.8736,  0.0715,  0.9787,  0.8333,  0.8668,  0.1536,  0.1110,
         0.1214,  0.1717,  0.9237,  0.2499,  0.5246,  0.1993,  0.4282,
         0.6020,  0.9753,  0.6592,  0.6523,  0.0133,  0.2280,  0.0844,
         0.7598,  0.0062,  0.0292,  0.7762,  0.0357,  0.6859,  0.8880,
         0.2763,  0.7906,  0.7123,  0.9926,  0.0237,  0.5039,  0.9128,
         0.1997,  0.1309,  0.0454,  0.8829,  0.8223,  0.0082,  0.0227,
         0.8683,  0.2737,  0.0750,  0.2653,  0.0791,  0.5954,  0.7661,
         0.9679,  0.0235,  0.7986,  0.4175,  0.9637,  0.7703,  0.1034,
         0.0686,  0.9074,  0.0332,  0.7127,  0.1864,  0.9476,  0.9688,
         0.8351,  0.9524,  0.3653,  0.9542,  0.0789,  0.0385,  0.1997,
         0.0519,  0.8345,  0.7595,  0.8416,  0.0138,  0.7896,  0.0735,
         0.9872,  0.8975,  0.0202,  0.0258,  0.9800,  0.0218,  0.9588,
         0.0682,  0.1051,  0.8050,  0.8528,  0.9003,  0.9703,  0.1805,
         0.9674,  0.6823,  0.2248,  0.9860,  0.7863,  0.4912,  0.8451,
         0.1047,  0.1564,  0.0606,  0.0766,  0.2821,  0.8761,  0.8852,
         0.9332,  0.3750,  0.8983,  0.7813,  0.8738,  0.8606,  0.8503,
         0.7279,  0.4154,  0.5264,  0.0800,  0.0685,  0.9527,  0.9135,
         0.7958,  0.3256,  0.9121,  0.3332,  0.9909,  0.2853,  0.9359,
         0.2263,  0.8233,  0.7233,  0.0412,  0.1756,  0.1483,  0.0660,
         0.7526,  0.9958,  0.0257,  0.9732,  0.2292,  0.9510,  0.7304,
         0.9713,  0.0724,  0.0832,  0.1157,  0.7306,  0.0900,  0.1859,
         0.9995,  0.0871,  0.9307,  0.0482,  0.1781,  0.8726,  0.2947,
         0.1642,  0.8956,  0.1539,  0.8678,  0.8719,  0.0838,  0.9373,
         0.8311,  0.9189,  0.0520,  0.9085,  0.2409,  0.8680,  0.8668,
         0.7827], device='cuda:0')
tensor(0.3641, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3885,  0.9306,  0.9180,  0.0677,  0.0705,  0.1074,  0.0331,
         0.9868,  0.0830,  0.0530,  0.9588,  0.9522,  0.9896,  0.9302,
         0.0194,  0.9949,  0.8004,  0.1294,  0.6010,  0.6178,  0.5177,
         0.5699,  0.1340,  0.1022,  0.1200,  0.9769,  0.4205,  0.5397,
         0.8617,  0.4113,  0.6602,  0.3773,  0.9975,  0.0074,  0.7243,
         0.9841,  0.0066,  0.8507,  0.0433,  0.6424,  0.3188,  0.1094,
         0.0496,  0.8869,  0.0935,  0.1209,  0.0317,  0.0314,  0.0682,
         0.0784,  0.0053,  0.2090,  0.0788,  0.5613,  0.8462,  0.5529,
         0.7387,  0.8577,  0.9371,  0.2891,  0.9047,  0.6035,  0.5959,
         0.8122,  0.1084,  0.8713,  0.0251,  0.3901,  0.3262,  0.9922,
         0.1547,  0.0875,  0.3359,  0.0201,  0.0505,  0.6783,  0.8982,
         0.0255,  0.0873,  0.9347,  0.4772,  0.5357,  0.9665,  0.1739,
         0.8278,  0.9374,  0.0623,  0.7756,  0.0481,  0.9508,  0.0212,
         0.9139,  0.2155,  0.0152,  0.1308,  0.0056,  0.4045,  0.1961,
         0.6527,  0.9523,  0.9637,  0.0449,  0.0322,  0.4157,  0.1754,
         0.8334,  0.0296,  0.9422,  0.2473,  0.1957,  0.9544,  0.2067,
         0.3056,  0.8519,  0.0265,  0.8870,  0.0826,  0.3191,  0.9505,
         0.9726,  0.5702,  0.5219,  0.0408,  0.8956,  0.9111,  0.0281,
         0.8013,  0.9291,  0.9434,  0.4102,  0.7518,  0.1579,  0.1188,
         0.9608,  0.7473,  0.3864,  0.9539,  0.0476,  0.5353,  0.5191,
         0.0500,  0.6016,  0.8498,  0.0030,  0.9808,  0.0462,  0.8229,
         0.1105,  0.0900,  0.0431,  0.0934,  0.0050,  0.0648,  0.1250,
         0.5711,  0.9482,  0.7288,  0.1112,  0.8126,  0.9294,  0.0477,
         0.1269,  0.7937,  0.3364,  0.4260,  0.8460,  0.0805,  0.1236,
         0.0966,  0.0180,  0.4856,  0.0054,  0.8428,  0.8779,  0.1171,
         0.3028,  0.2384,  0.5427,  0.4800,  0.0070,  0.1168,  0.2160,
         0.0029,  0.0104,  0.0222,  0.0215,  0.0327,  0.0451,  0.7790,
         0.0200,  0.4143,  0.5503,  0.0528,  0.9341,  0.9400,  0.8931,
         0.0517,  0.0132,  0.1257,  0.0577,  0.0445,  0.7955,  0.9588,
         0.0689,  0.0662,  0.9247,  0.0282,  0.2151,  0.0389,  0.0209,
         0.0955,  0.0781,  0.1262,  0.0729,  0.1299,  0.0217,  0.7829,
         0.4983,  0.9224,  0.0654,  0.0602,  0.0952,  0.4766,  0.9037,
         0.1235,  0.9489,  0.2210,  0.9244,  0.1398,  0.5717,  0.7237,
         0.8526,  0.0215,  0.9821,  0.0523,  0.1761,  0.0772,  0.0529,
         0.0342,  0.1528,  0.1190,  0.1723,  0.2788,  0.4367,  0.8766,
         0.0232,  0.0488,  0.5144,  0.0129,  0.1050,  0.7335,  0.8806,
         0.9334,  0.8951,  0.9306,  0.1696,  0.8885,  0.0317,  0.2524,
         0.0864,  0.0393,  0.8552,  0.3586,  0.0507,  0.9403,  0.5942,
         0.0210,  0.2676,  0.0671,  0.0112,  0.0827,  0.9267,  0.0210,
         0.0480,  0.8132,  0.0561,  0.0091,  0.6622,  0.6499,  0.1977,
         0.6425,  0.1499,  0.7972,  0.0393,  0.7191,  0.0720,  0.1422,
         0.8741,  0.2494,  0.8409,  0.0256,  0.1908,  0.8174,  0.9448,
         0.8743,  0.0420,  0.4509,  0.6689,  0.7604,  0.0295,  0.1142,
         0.1386,  0.0873,  0.0899,  0.6362,  0.0666,  0.0420,  0.0138,
         0.9078,  0.0799,  0.1157,  0.6408,  0.0230,  0.1253,  0.2319,
         0.0173,  0.0086,  0.2874,  0.1991,  0.1277,  0.8379,  0.4321,
         0.1005,  0.8391,  0.1787,  0.3661,  0.1991,  0.9488,  0.0152,
         0.1427,  0.0349,  0.0137,  0.7371,  0.9743,  0.4423,  0.9222,
         0.0225,  0.0471,  0.7291,  0.0416,  0.2910,  0.7014,  0.1827,
         0.0979,  0.1300,  0.2674,  0.0654,  0.7674,  0.0662,  0.0139,
         0.7435,  0.5936,  0.8542,  0.9515,  0.9588,  0.7249,  0.7742,
         0.0940,  0.9032,  0.9972,  0.1827,  0.6602,  0.0032,  0.0456,
         0.3495,  0.0041,  0.0112,  0.9153,  0.9366,  0.2643,  0.9219,
         0.7569,  0.2389,  0.0277,  0.1025,  0.9010,  0.4911,  0.9744,
         0.0165,  0.0885,  0.9171,  0.9268,  0.8507,  0.8750,  0.0048,
         0.0152,  0.1233,  0.8611,  0.1086,  0.8872,  0.0546,  0.8291,
         0.1086,  0.0477,  0.0420,  0.9740,  0.8519,  0.2652,  0.9120,
         0.0424,  0.8538,  0.0116,  0.1189,  0.4662,  0.3461,  0.8951,
         0.2290,  0.4563,  0.2351,  0.8818,  0.4203,  0.9267,  0.9288,
         0.8510,  0.9012,  0.4377,  0.7692,  0.9340,  0.0454,  0.9954,
         0.0450,  0.1966,  0.7161,  0.8775,  0.1100,  0.9227,  0.4380,
         0.0191,  0.0387,  0.8379,  0.4280,  0.0629,  0.0192,  0.4051,
         0.0619,  0.0968,  0.0263,  0.5702,  0.0372,  0.8530,  0.0050,
         0.2194,  0.1316,  0.0235,  0.5608,  0.6786,  0.8534,  0.8028,
         0.9432,  0.1019,  0.8088,  0.2797,  0.0696,  0.0111,  0.3239,
         0.0294,  0.1584,  0.4585,  0.1431,  0.5075,  0.6433,  0.0423,
         0.1296,  0.8992,  0.0461,  0.0536,  0.9445,  0.5481,  0.1892,
         0.1282,  0.0565,  0.9345,  0.0152,  0.0735,  0.2271,  0.0084,
         0.7235,  0.7702,  0.0139,  0.4417,  0.0183,  0.0164,  0.1018,
         0.1536,  0.0432,  0.4226,  0.7321,  0.0618,  0.6209,  0.0107,
         0.0385,  0.0742,  0.9084,  0.9353,  0.9563,  0.2298,  0.8865,
         0.9621,  0.9306,  0.0614,  0.9993,  0.0653,  0.1602,  0.9834,
         0.1597,  0.7308,  0.0091,  0.5541,  0.7887,  0.3657,  0.4223,
         0.1241], device='cuda:0')
tensor(0.4265, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9193,  0.5230,  0.0831,  0.8951,  0.0022,  0.7916,  0.9398,
         0.2098,  0.1675,  0.0714,  0.1552,  0.0475,  0.3322,  0.0312,
         0.3251,  0.8558,  0.0543,  0.1040,  0.9146,  0.2517,  0.8979,
         0.1356,  0.0731,  0.9027,  0.0153,  0.6740,  0.0436,  0.0471,
         0.8918,  0.8316,  0.1538,  0.0195,  0.3631,  0.5867,  0.8499,
         0.7773,  0.0553,  0.1674,  0.0966,  0.1575,  0.7871,  0.3955,
         0.6326,  0.9751,  0.0342,  0.1430,  0.8250,  0.0825,  0.1024,
         0.2203,  0.0258,  0.5031,  0.1790,  0.1013,  0.8594,  0.8888,
         0.9620,  0.6041,  0.0862,  0.4625,  0.0162,  0.9280,  0.0446,
         0.9814,  0.0680,  0.8412,  0.0269,  0.9657,  0.1806,  0.9178,
         0.4091,  0.7272,  0.0327,  0.0125,  0.8597,  0.0527,  0.0139,
         0.9574,  0.0625,  0.7068,  0.3241,  0.9429,  0.8274,  0.0864,
         0.2734,  0.9632,  0.8874,  0.9300,  0.0022,  0.7288,  0.9798,
         0.9684,  0.8244,  0.0450,  0.4849,  0.5094,  0.9571,  0.2590,
         0.9820,  0.8899,  0.0514,  0.5212,  0.4265,  0.0361,  0.1442,
         0.0284,  0.8712,  0.0154,  0.1086,  0.1607,  0.0127,  0.9315,
         0.2548,  0.0778,  0.0105,  0.5936,  0.9008,  0.0526,  0.9314,
         0.7097,  0.7716,  0.7627,  0.9359,  0.0464,  0.0260,  0.9140,
         0.0113,  0.1606,  0.8732,  0.7897,  0.0209,  0.4807,  0.7869,
         0.1854,  0.5319,  0.2703,  0.0633,  0.0167,  0.0231,  0.9056,
         0.9009,  0.0688,  0.0195,  0.3183,  0.0431,  0.0360,  0.0498,
         0.0265,  0.0748,  0.0102,  0.9695,  0.0344,  0.0090,  0.7236,
         0.9961,  0.0510,  0.0779,  0.0516,  0.0851,  0.4439,  0.2111,
         0.0989,  0.0065,  0.4585,  0.8415,  0.7305,  0.0850,  0.9778,
         0.0878,  0.1213,  0.9759,  0.0198,  0.0100,  0.0122,  0.7115,
         0.0197,  0.0136,  0.5363,  0.9085,  0.9459,  0.2376,  0.8658,
         0.9484,  0.1528,  0.0652,  0.8120,  0.6021,  0.1014,  0.1196,
         0.7078,  0.9196,  0.9828,  0.6504,  0.3646,  0.2954,  0.0188,
         0.5990,  0.9109,  0.7827,  0.0873,  0.0530,  0.9120,  0.9931,
         0.1322,  0.8033,  0.0928,  0.9277,  0.1089,  0.8687,  0.9865,
         0.0301,  0.6619,  0.2534,  0.9444,  0.4669,  0.8810,  0.5624,
         0.0177,  0.1225,  0.3162,  0.1869,  0.9016,  0.0199,  0.0346,
         0.4032,  0.8847,  0.0419,  0.5113,  0.0401,  0.9995,  0.0099,
         0.0727,  0.8585,  0.9994,  0.0899,  0.2560,  0.0773,  0.1114,
         0.8317,  0.1541,  0.0510,  0.9952,  0.0165,  0.0390,  0.6634,
         0.2256,  0.7731,  0.2427,  0.6382,  0.8635,  0.8024,  0.0539,
         0.5382,  0.1360,  0.9947,  0.9314,  0.0436,  0.9414,  0.1970,
         0.0599,  0.9073,  0.9945,  0.0978,  0.6874,  0.8829,  0.0056,
         0.9232,  0.2601,  0.0219,  0.1101,  0.1589,  0.7730,  0.9408,
         0.0126,  0.9203,  0.2695,  0.1284,  0.6484,  0.0538,  0.8508,
         0.6646,  0.0282,  0.9461,  0.1257,  0.8064,  0.9285,  0.1872,
         0.6519,  0.0776,  0.9170,  0.0719,  0.5485,  0.0795,  0.0510,
         0.9581,  0.1379,  0.1240,  0.2589,  0.9576,  0.2056,  0.9714,
         0.0801,  0.0273,  0.9373,  0.0466,  0.5694,  0.4212,  0.4151,
         0.9242,  0.0271,  0.1310,  0.0193,  0.0208,  0.8740,  0.8951,
         0.8890,  0.2165,  0.9992,  0.9444,  0.8281,  0.0303,  0.0972,
         0.6547,  0.9550,  0.0118,  0.4452,  0.4247,  0.7310,  0.9263,
         0.0373,  0.9637,  0.0353,  0.2094,  0.2236,  0.2798,  0.0121,
         0.6920,  0.9091,  0.0209,  0.9191,  0.0062,  0.8204,  0.5786,
         0.0524,  0.7596,  0.9667,  0.9967,  0.0316,  0.9715,  0.2304,
         0.3337,  0.2831,  0.2883,  0.3329,  0.0691,  0.0282,  0.0538,
         0.8323,  0.9266,  0.0508,  0.1743,  0.0208,  0.0261,  0.1138,
         0.0107,  0.8357,  0.9524,  0.0922,  0.9893,  0.0782,  0.7767,
         0.5062,  0.0644,  0.6480,  0.0071,  0.0781,  0.0402,  0.0421,
         0.3747,  0.0045,  0.8954,  0.9924,  0.8473,  0.0585,  0.9776,
         0.8805,  0.8667,  0.0249,  0.0735,  0.6577,  0.8586,  0.3294,
         0.0427,  0.0082,  0.9418,  0.8842,  0.9929,  0.8964,  0.0265,
         0.7106,  0.4110,  0.4607,  0.8185,  0.8482,  0.9475,  0.8821,
         0.9290,  0.8689,  0.3166,  0.6489,  0.2302,  0.6082,  0.6285,
         0.9850,  0.9414,  0.0943,  0.9970,  0.7244,  0.9811,  0.1148,
         0.6162,  0.7472,  0.4603,  0.7372,  0.9155,  0.8546,  0.6435,
         0.9368,  0.0305,  0.0604,  0.0141,  0.6515,  0.0957,  0.1331,
         0.8995,  0.9422,  0.0850,  0.8927,  0.9147,  0.3272,  0.8799,
         0.1876,  0.7722,  0.8297,  0.8949,  0.0157,  0.5480,  0.8656,
         0.2047,  0.0183,  0.8754,  0.8845,  0.0065,  0.0616,  0.0437,
         0.9212,  0.8801,  0.0934,  0.0066,  0.1708,  0.0355,  0.8827,
         0.9430,  0.9689,  0.1693,  0.8653,  0.0343,  0.0119,  0.9077,
         0.9273,  0.8119,  0.7313,  0.0211,  0.0393,  0.0246,  0.8272,
         0.1454,  0.0679,  0.3441,  0.1457,  0.0143,  0.3494,  0.7774,
         0.9161,  0.8630,  0.3640,  0.1820,  0.9329,  0.2935,  0.0498,
         0.4333,  0.8196,  0.0310,  0.9958,  0.6886,  0.9408,  0.4108,
         0.0682,  0.0994,  0.0365,  0.0534,  0.0478,  0.0365,  0.8184,
         0.9405,  0.0753,  0.0085,  0.0563,  0.9548,  0.2916,  0.3643,
         0.4703], device='cuda:0')
tensor(0.3796, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1662,  0.1450,  0.9923,  0.2805,  0.2446,  0.9924,  0.9559,
         0.0080,  0.8334,  0.1049,  0.3875,  0.0268,  0.9705,  0.3689,
         0.9400,  0.1443,  0.1306,  0.2777,  0.7942,  0.1690,  0.9046,
         0.8273,  0.9556,  0.0619,  0.8318,  0.0177,  0.7652,  0.0401,
         0.4193,  0.6200,  0.0832,  0.1320,  0.2496,  0.9679,  0.0054,
         0.0541,  0.0164,  0.7176,  0.7631,  0.8603,  0.3665,  0.3609,
         0.3184,  0.3967,  0.7447,  0.0712,  0.0165,  0.0675,  0.1807,
         0.8835,  0.0413,  0.2548,  0.7774,  0.0500,  0.2250,  0.6822,
         0.1541,  0.6322,  0.0811,  0.7666,  0.1780,  0.8754,  0.9843,
         0.9109,  0.0552,  0.7843,  0.1630,  0.2116,  0.4963,  0.5396,
         0.0349,  0.3635,  0.9648,  0.0337,  0.8424,  0.9285,  0.2028,
         0.1969,  0.5363,  0.7282,  0.6608,  0.1990,  0.8557,  0.0443,
         0.3433,  0.1516,  0.0259,  0.7872,  0.8162,  0.9039,  0.9258,
         0.7193,  0.8205,  0.9991,  0.9968,  0.5038,  0.3711,  0.2101,
         0.1718,  0.9121,  0.0213,  0.0098,  0.9256,  0.1068,  0.1031,
         0.9641,  0.0184,  0.9141,  0.0263,  0.3387,  0.0504,  0.9038,
         0.0377,  0.9372,  0.5759,  0.1451,  0.1629,  0.4692,  0.5444,
         0.8442,  0.0861,  0.3389,  0.9396,  0.7875,  0.8503,  0.0397,
         0.1254,  0.0047,  0.7986,  0.4670,  0.8401,  0.0334,  0.1376,
         0.8211,  0.5974,  0.0981,  0.9741,  0.2330,  0.9238,  0.0795,
         0.1387,  0.0194,  0.7937,  0.8466,  0.1150,  0.3706,  0.2458,
         0.1931,  0.3306,  0.9760,  0.0395,  0.8919,  0.7170,  0.0501,
         0.0339,  0.3302,  0.9793,  0.9638,  0.0916,  0.3128,  0.9391,
         0.1097,  0.4464,  0.9289,  0.9242,  0.0604,  0.9895,  0.1287,
         0.8752,  0.4734,  0.7967,  0.8075,  0.2896,  0.6480,  0.5465,
         0.8684,  0.4247,  0.9498,  0.4704,  0.0737,  0.0237,  0.2335,
         0.3380,  0.7855,  0.9231,  0.8204,  0.8268,  0.9507,  0.9566,
         0.7589,  0.1261,  0.6164,  0.0917,  0.6537,  0.4520,  0.0456,
         0.0278,  0.6401,  0.0315,  0.1971,  0.9695,  0.3592,  0.3278,
         0.9728,  0.1085,  0.4182,  0.6457,  0.7467,  0.2499,  0.0762,
         0.8647,  0.4638,  0.6709,  0.0243,  0.0685,  0.9735,  0.8496,
         0.8596,  0.7123,  0.8817,  0.0456,  0.3189,  0.0632,  0.7653,
         0.7730,  0.8382,  0.1309,  0.8911,  0.9979,  0.9615,  0.9276,
         0.1049,  0.3270,  0.8262,  0.1998,  0.8924,  0.1366,  0.6626,
         0.1670,  0.9314,  0.2128,  0.9036,  0.9431,  0.4398,  0.5075,
         0.7295,  0.9681,  0.7857,  0.8834,  0.6855,  0.9891,  0.1229,
         0.0112,  0.6708,  0.0853,  0.9231,  0.4356,  0.8211,  0.0179,
         0.9365,  0.2539,  0.2853,  0.8874,  0.5578,  0.2460,  0.0797,
         0.9216,  0.0361,  0.9247,  0.5180,  0.0861,  0.5117,  0.0379,
         0.2142,  0.9528,  0.5752,  0.8703,  0.0879,  0.1882,  0.0986,
         0.7832,  0.9962,  0.7072,  0.8865,  0.8285,  0.8938,  0.0584,
         0.1141,  0.1275,  0.2005,  0.0159,  0.0649,  0.2737,  0.6396,
         0.8142,  0.3807,  0.9088,  0.2391,  0.9643,  0.3283,  0.9798,
         0.0358,  0.1458,  0.2410,  0.0419,  0.0129,  0.9493,  0.0395,
         0.9992,  0.5315,  0.6703,  0.9964,  0.7205,  0.2397,  0.2048,
         0.5887,  0.3253,  0.2452,  0.9782,  0.8401,  0.2760,  0.9135,
         0.1058,  0.9645,  0.8557,  0.1560,  0.1525,  0.1386,  0.1876,
         0.9771,  0.0119,  0.0765,  0.0996,  0.4613,  0.0474,  0.5113,
         0.0097,  0.0478,  0.7873,  0.1745,  0.7039,  0.1497,  0.9991,
         0.0497,  0.9979,  0.9182,  0.2745,  0.0276,  0.0716,  0.2179,
         0.0762,  0.6312,  0.1201,  0.0498,  0.6962,  0.1527,  0.8951,
         0.7616,  0.5040,  0.4165,  0.2681,  0.7687,  0.0560,  0.3817,
         0.8231,  0.0886,  0.6479,  0.8616,  0.0193,  0.3797,  0.0425,
         0.5388,  0.0312,  0.0686,  0.9577,  0.2174,  0.9036,  0.3652,
         0.9823,  0.7606,  0.0507,  0.1393,  0.8210,  0.4567,  0.0234,
         0.7168,  0.1520,  0.0455,  0.5689,  0.1920,  0.1493,  0.8185,
         0.8394,  0.7880,  0.9053,  0.0061,  0.4215,  0.0806,  0.9849,
         0.0809,  0.9359,  0.4193,  0.8151,  0.1065,  0.0324,  0.8920,
         0.0387,  0.2816,  0.0442,  0.1610,  0.8100,  0.9272,  0.9902,
         0.8661,  0.1384,  0.7951,  0.2004,  0.9326,  0.0284,  0.0279,
         0.8989,  0.3969,  0.0082,  0.9705,  0.8045,  0.0384,  0.9896,
         0.3619,  0.0375,  0.9368,  0.9462,  0.0876,  0.0559,  0.8697,
         0.8018,  0.6513,  0.8932,  0.0969,  0.4516,  0.5996,  0.2840,
         0.8734,  0.8734,  0.4476,  0.6146,  0.0371,  0.4168,  0.0236,
         0.0867,  0.6091,  0.1834,  0.9207,  0.0809,  0.9354,  0.1295,
         0.8747,  0.8434,  0.8866,  0.9892,  0.1497,  0.0064,  0.9310,
         0.0388,  0.7282,  0.6391,  0.7926,  0.3489,  0.7900,  0.9053,
         0.7743,  0.0182,  0.9712,  0.0173,  0.0981,  0.7551,  0.1212,
         0.0257,  0.9528,  0.5934,  0.6391,  0.9716,  0.6064,  0.3392,
         0.9041,  0.1521,  0.7469,  0.8973,  0.0033,  0.1475,  0.9647,
         0.9479,  0.9932,  0.6756,  0.0504,  0.8431,  0.8549,  0.9678,
         0.4074,  0.0632,  0.1591,  0.4635,  0.3302,  0.7908,  0.8228,
         0.9837,  0.7196,  0.8967,  0.9400,  0.9155,  0.1113,  0.9530,
         0.7290], device='cuda:0')
tensor(0.3514, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8136,  0.4988,  0.8373,  0.9620,  0.7663,  0.8228,  0.9870,
         0.1743,  0.9404,  0.9877,  0.9348,  0.8188,  0.2359,  0.8554,
         0.3859,  0.2765,  0.4394,  0.9996,  0.1560,  0.0944,  0.0059,
         0.4622,  0.0679,  0.3647,  0.3076,  0.1751,  0.3581,  0.7995,
         0.9503,  0.7628,  0.1872,  0.1632,  0.8870,  0.6720,  0.9173,
         0.9259,  0.2116,  0.1417,  0.0644,  0.2683,  0.9540,  0.0440,
         0.8893,  0.4584,  0.2413,  0.1775,  0.7995,  0.7088,  0.9955,
         0.1143,  0.9601,  0.9608,  0.0504,  0.2027,  0.1053,  0.9100,
         0.9404,  0.9587,  0.2164,  0.7185,  0.0997,  0.9193,  0.0284,
         0.9711,  0.3908,  0.5644,  0.0343,  0.8766,  0.8591,  0.8624,
         0.9585,  0.9978,  0.9538,  0.1587,  0.8531,  0.8346,  0.1600,
         0.2590,  0.8760,  0.7449,  0.8767,  0.2901,  0.8657,  0.9668,
         0.8419,  0.0764,  0.9454,  0.0456,  0.2703,  0.1587,  0.1939,
         0.0309,  0.9713,  0.1161,  0.9841,  0.3772,  0.9445,  0.7659,
         0.8290,  0.4104,  0.8365,  0.1072,  0.8694,  0.0772,  0.8251,
         0.9031,  0.7879,  0.7863,  0.4874,  0.6845,  0.3647,  0.9569,
         0.1989,  0.1597,  0.4237,  0.8737,  0.3991,  0.3582,  0.9020,
         0.0559,  0.8732,  0.3324,  0.9375,  0.0814,  0.1631,  0.7962,
         0.6791,  0.8731,  0.2121,  0.4815,  0.9677,  0.0840,  0.3322,
         0.3060,  0.8734,  0.2713,  0.8417,  0.9573,  0.9334,  0.9233,
         0.8629,  0.8373,  0.1142,  0.1738,  0.0445,  0.1450,  0.8938,
         0.8998,  0.7680,  0.4480,  0.9949,  0.9939,  0.9965,  0.8158,
         0.1209,  0.9122,  0.9391,  0.5814,  0.7378,  0.7642,  0.9441,
         0.4548,  0.1390,  0.8459,  0.0475,  0.4383,  0.3161,  0.0133,
         0.5896,  0.5724,  0.6078,  0.8915,  0.2412,  0.7715,  0.1471,
         0.0785,  0.1022,  0.9569,  0.3653,  0.8927,  0.9673,  0.0974,
         0.4623,  0.9503,  0.3260,  0.7485,  0.1408,  0.5995,  0.9549,
         0.3210,  0.1237,  0.8968,  0.1716,  0.6440,  0.8625,  0.9381,
         0.1166,  0.9084,  0.4251,  0.0334,  0.2915,  0.0942,  0.6858,
         0.7447,  0.8523,  0.9960,  0.5884,  0.5578,  0.8705,  0.1689,
         0.0721,  0.9955,  0.1645,  0.9133,  0.8117,  0.0098,  0.1912,
         0.5785,  0.9922,  0.4680,  0.1906,  0.0942,  0.9019,  0.0593,
         0.9901,  0.9023,  0.9828,  0.8423,  0.0283,  0.8816,  0.2041,
         0.9888,  0.8520,  0.9282,  0.4390,  0.9481,  0.2656,  0.0987,
         0.1572,  0.9491,  0.0951,  0.4380,  0.0397,  0.2344,  0.3431,
         0.8774,  0.0280,  0.1233,  0.9765,  0.9373,  0.1825,  0.2071,
         0.7525,  0.9973,  0.2330,  0.1078,  0.6107,  0.0244,  0.2517,
         0.4115,  0.5435,  0.0275,  0.2288,  0.9010,  0.1745,  0.9843,
         0.0135,  0.9557,  0.9559,  0.1739,  0.1550,  0.6046,  0.5123,
         0.9293,  0.2508,  0.9022,  0.8806,  0.8468,  0.9117,  0.0562,
         0.4004,  0.0075,  0.9086,  0.0733,  0.8208,  0.9491,  0.9839,
         0.0865,  0.9405,  0.1502,  0.7292,  0.0250,  0.8191,  0.3011,
         0.8907,  0.2069,  0.8644,  0.9019,  0.7353,  0.3762,  0.5961,
         0.6427,  0.3549,  0.8433,  0.2795,  0.9905,  0.0175,  0.4346,
         0.0445,  0.9194,  0.8816,  0.4662,  0.3841,  0.3220,  0.8198,
         0.2685,  0.9063,  0.6580,  0.2927,  0.5480,  0.5908,  0.1652,
         0.9483,  0.0725,  0.4981,  0.8938,  0.9577,  0.3662,  0.8688,
         0.9463,  0.7937,  0.3965,  0.1490,  0.9647,  0.0451,  0.2341,
         0.8477,  0.1625,  0.7690,  0.9405,  0.8339,  0.6265,  0.2370,
         0.1095,  0.3898,  0.4300,  0.9522,  0.1056,  0.9207,  0.5313,
         0.5449,  0.3725,  0.8427,  0.9003,  0.0191,  0.9649,  0.8086,
         0.0773,  0.9820,  0.1530,  0.3147,  0.9943,  0.1419,  0.8578,
         0.1672,  0.9169,  0.6226,  0.5258,  0.8970,  0.1082,  0.9432,
         0.5128,  0.0923,  0.5449,  0.0927,  0.8299,  0.1704,  0.7412,
         0.9080,  0.5135,  0.4650,  0.1860,  0.6438,  0.2870,  0.4825,
         0.6351,  0.7145,  0.9390,  0.0166,  0.2551,  0.9597,  0.0191,
         0.9158,  0.9111,  0.8121,  0.8710,  0.1374,  0.1769,  0.6725,
         0.0813,  0.8405,  0.3136,  0.0377,  0.3185,  0.2098,  0.9348,
         0.9933,  0.9234,  0.0464,  0.8344,  0.6240,  0.2499,  0.0278,
         0.8929,  0.8147,  0.7743,  0.1778,  0.6778,  0.1354,  0.9343,
         0.5800,  0.1092,  0.1363,  0.7938,  0.6100,  0.1204,  0.0161,
         0.2734,  0.8492,  0.5558,  0.8871,  0.1934,  0.0797,  0.2633,
         0.9126,  0.9811,  0.7807,  0.0115,  0.0365,  0.7293,  0.3265,
         0.1088,  0.9791,  0.1876,  0.7292,  0.5057,  0.2524,  0.1566,
         0.8983,  0.7145,  0.1637,  0.0464,  0.0059,  0.4086,  0.8325,
         0.8362,  0.1394,  0.9668,  0.8366,  0.0288,  0.9632,  0.0247,
         0.0030,  0.9307,  0.7260,  0.9656,  0.8082,  0.1252,  0.4353,
         0.3487,  0.7122,  0.7908,  0.3449,  0.5523,  0.9381,  0.6441,
         0.1699,  0.9317,  0.8256,  0.6733,  0.8895,  0.9366,  0.9699,
         0.9680,  0.8888,  0.1640,  0.9721,  0.1776,  0.2100,  0.7279,
         0.6967,  0.8020,  0.5133,  0.7390,  0.1604,  0.2259,  0.6955,
         0.9938,  0.8078,  0.6588,  0.9253,  0.2309,  0.5636,  0.8187,
         0.8953,  0.3953,  0.9729,  0.3231,  0.2198,  0.7037,  0.9412,
         0.1693], device='cuda:0')
tensor(0.3754, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9298,  0.7740,  0.2762,  0.9223,  0.9117,  0.2044,  0.1905,
         0.0684,  0.3365,  0.8429,  0.5106,  0.1637,  0.1212,  0.8489,
         0.9619,  0.9647,  0.9506,  0.2611,  0.2017,  0.7447,  0.6403,
         0.2227,  0.5788,  0.8663,  0.1036,  0.2030,  0.8600,  0.2545,
         0.9708,  0.7132,  0.7704,  0.4370,  0.9067,  0.9284,  0.6174,
         0.4120,  0.8664,  0.7607,  0.4708,  0.9375,  0.9609,  0.2244,
         0.8137,  0.3017,  0.7762,  0.2346,  0.1734,  0.8918,  0.4147,
         0.1687,  0.7485,  0.8765,  0.1398,  0.7702,  0.0051,  0.0857,
         0.9635,  0.8429,  0.2516,  0.0284,  0.9450,  0.9413,  0.6009,
         0.2086,  0.4026,  0.8909,  0.8195,  0.1261,  0.8422,  0.1885,
         0.6871,  0.9166,  0.5728,  0.3777,  0.9633,  0.3681,  0.6728,
         0.9520,  0.0537,  0.5322,  0.6875,  0.1227,  0.8187,  0.4944,
         0.0354,  0.8487,  0.9358,  0.4414,  0.5759,  0.9480,  0.9437,
         0.9023,  0.9734,  0.8447,  0.9284,  0.0755,  0.8951,  0.1339,
         0.8984,  0.1508,  0.1033,  0.2258,  0.6878,  0.6420,  0.6964,
         0.9220,  0.8506,  0.4251,  0.1962,  0.0581,  0.2935,  0.9664,
         0.2390,  0.8842,  0.9053,  0.9577,  0.6051,  0.0938,  0.5940,
         0.7813,  0.3858,  0.9592,  0.8861,  0.2073,  0.1761,  0.9994,
         0.2080,  0.7348,  0.9265,  0.0108,  0.9915,  0.7457,  0.7697,
         0.3380,  0.7383,  0.9294,  0.8474,  0.2913,  0.1889,  0.6110,
         0.9638,  0.9136,  0.5093,  0.4273,  0.8727,  0.9424,  0.6674,
         0.9497,  0.3166,  0.8042,  0.0775,  0.6249,  0.2438,  0.9581,
         0.9094,  0.9076,  0.0305,  0.9585,  0.9542,  0.2775,  0.4569,
         0.9602,  0.0714,  0.9375,  0.9766,  0.9232,  0.8981,  0.9139,
         0.1711,  0.8878,  0.4309,  0.5349,  0.9704,  0.9907,  0.7985,
         0.2746,  0.3754,  0.1037,  0.7188,  0.9561,  0.8983,  0.8368,
         0.8623,  0.7206,  0.5499,  0.7252,  0.6724,  0.7737,  0.0657,
         0.8814,  0.5717,  0.6282,  0.8089,  0.0573,  0.9144,  0.9198,
         0.0780,  0.2182,  0.4632,  0.8940,  0.7380,  0.7927,  0.7738,
         0.8808,  0.9934,  0.9062,  0.9220,  0.1624,  0.9000,  0.3437,
         0.9185,  0.9171,  0.8230,  0.2560,  0.9598,  0.8409,  0.3430,
         0.3587,  0.7299,  0.8693,  0.8759,  0.1775,  0.8948,  0.0813,
         0.6135,  0.0980,  0.5425,  0.2335,  0.8113,  0.4448,  0.8873,
         0.0603,  0.8869,  0.9984,  0.2477,  0.9763,  0.4026,  0.0326,
         0.9320,  0.4373,  0.9193,  0.9410,  0.9900,  0.9843,  0.7363,
         0.2218,  0.8378,  0.2862,  0.9041,  0.9994,  0.4680,  0.9174,
         0.1159,  0.9112,  0.4885,  0.5392,  0.0437,  0.7221,  0.9049,
         0.9020,  0.5684,  0.7710,  0.0833,  0.9072,  0.4216,  0.0349,
         0.8890,  0.1212,  0.0737,  0.4121,  0.2563,  0.3746,  0.1029,
         0.9431,  0.8534,  0.9335,  0.4299,  0.8373,  0.9531,  0.9393,
         0.4597,  0.5086,  0.0207,  0.6654,  0.9656,  0.9616,  0.7104,
         0.5894,  0.9319,  0.6781,  0.4820,  0.9029,  0.1785,  0.3873,
         0.6088,  0.1593,  0.2110,  0.6123,  0.7657,  0.1469,  0.1171,
         0.8843,  0.6516,  0.3560,  0.2796,  0.9385,  0.7067,  0.9514,
         0.9285,  0.8869,  0.9630,  0.9229,  0.6983,  0.1226,  0.8520,
         0.0136,  0.8267,  0.7545,  0.1725,  0.9150,  0.9437,  0.5797,
         0.1721,  0.0362,  0.9375,  0.5612,  0.2035,  0.8327,  0.2068,
         0.8434,  0.9776,  0.6902,  0.0236,  0.5960,  0.7888,  0.5160,
         0.0029,  0.4013,  0.8906,  0.3103,  0.9836,  0.7283,  0.5823,
         0.8195,  0.9470,  0.7674,  0.1524,  0.0778,  0.9114,  0.7762,
         0.9677,  0.9538,  0.9601,  0.8775,  0.5614,  0.1465,  0.1698,
         0.9241,  0.9749,  0.8541,  0.0219,  0.5704,  0.9405,  0.0038,
         0.1859,  0.8952,  0.8079,  0.0656,  0.7305,  0.9299,  0.8043,
         0.9085,  0.8533,  0.2135,  0.9875,  0.0968,  0.8373,  0.1464,
         0.3267,  0.8537,  0.3682,  0.0228,  0.7485,  0.6878,  0.3095,
         0.8968,  0.9960,  0.0209,  0.2707,  0.2279,  0.1723,  0.0696,
         0.0406,  0.1876,  0.8166,  0.9465,  0.2817,  0.1420,  0.4692,
         0.6909,  0.9749,  0.2444,  0.9499,  0.7579,  0.5364,  0.1060,
         0.7161,  0.8418,  0.7770,  0.7565,  0.9909,  0.0853,  0.2088,
         0.2512,  0.8789,  0.9220,  0.2798,  0.2163,  0.1706,  0.0090,
         0.5313,  0.1111,  0.3648,  0.2597,  0.8152,  0.4294,  0.7159,
         0.0558,  0.2081,  0.4826,  0.0880,  0.4241,  0.3040,  0.8505,
         0.3687,  0.5561,  0.9058,  0.2050,  0.9909,  0.7539,  0.9716,
         0.0828,  0.0844,  0.9307,  0.8197,  0.8757,  0.7917,  0.0856,
         0.9569,  0.3841,  0.9603,  0.0967,  0.1507,  0.9712,  0.8846,
         0.9943,  0.0427,  0.0620,  0.5324,  0.7465,  0.1984,  0.8743,
         0.0481,  0.1445,  0.1919,  0.8250,  0.8760,  0.6826,  0.9364,
         0.7138,  0.0955,  0.1734,  0.8891,  0.8754,  0.0670,  0.8961,
         0.5632,  0.9968,  0.9322,  0.5615,  0.0922,  0.4235,  0.6667,
         0.8757,  0.6272,  0.7768,  0.6081,  0.9133,  0.1759,  0.9735,
         0.9848,  0.9205,  0.0153,  0.9459,  0.3513,  0.6093,  0.8256,
         0.9576,  0.9822,  0.6185,  0.9777,  0.1986,  0.9697,  0.9437,
         0.3734,  0.2098,  0.1158,  0.1988,  0.8956,  0.0140,  0.0421,
         0.9036], device='cuda:0')
tensor(0.3982, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0257,  0.1127,  0.1109,  0.1504,  0.7139,  0.8854,  0.6931,
         0.9461,  0.8880,  0.0863,  0.0851,  0.3251,  0.5973,  0.0098,
         0.8720,  0.8422,  0.1173,  0.9399,  0.4929,  0.7999,  0.0821,
         0.1792,  0.9204,  0.0964,  0.9944,  0.7725,  0.2193,  0.8330,
         0.3626,  0.8604,  0.5086,  0.1873,  0.3974,  0.0997,  0.8318,
         0.9907,  0.9037,  0.4934,  0.0508,  0.8604,  0.8775,  0.0563,
         0.5518,  0.7504,  0.5052,  0.3490,  0.9096,  0.9879,  0.8275,
         0.0596,  0.0208,  0.0296,  0.3138,  0.7725,  0.8866,  0.0626,
         0.7533,  0.8013,  0.0173,  0.5823,  0.0418,  0.8599,  0.8561,
         0.1017,  0.0718,  0.4895,  0.9024,  0.1389,  0.8828,  0.0767,
         0.5504,  0.0128,  0.2499,  0.9804,  0.9639,  0.0859,  0.8240,
         0.8005,  0.7766,  0.8517,  0.9390,  0.8340,  0.8953,  0.7843,
         0.8812,  0.9824,  0.0734,  0.2557,  0.8522,  0.0313,  0.0658,
         0.5062,  0.9287,  0.6918,  0.5086,  0.1638,  0.3949,  0.8956,
         0.9175,  0.3485,  0.0088,  0.0538,  0.2400,  0.1388,  0.1059,
         0.8463,  0.9196,  0.6960,  0.7573,  0.8246,  0.8739,  0.1541,
         0.7706,  0.1039,  0.5261,  0.3541,  0.8004,  0.9087,  0.2439,
         0.2581,  0.8884,  0.5771,  0.9156,  0.8030,  0.0672,  0.8645,
         0.6652,  0.8600,  0.0068,  0.2826,  0.4294,  0.9374,  0.4765,
         0.3207,  0.9348,  0.9849,  0.1596,  0.6820,  0.9204,  0.7123,
         0.1165,  0.6531,  0.5378,  0.6662,  0.8980,  0.2091,  0.0417,
         0.1682,  0.7321,  0.3503,  0.7522,  0.1427,  0.1928,  0.8934,
         0.0453,  0.9639,  0.0233,  0.2651,  0.9915,  0.8868,  0.7233,
         0.4214,  0.3538,  0.9646,  0.7993,  0.6737,  0.0470,  0.0283,
         0.7996,  0.9056,  0.5912,  0.5576,  0.8826,  0.2215,  0.2850,
         0.8438,  0.9513,  0.2082,  0.8828,  0.4887,  0.6061,  0.9590,
         0.9002,  0.8172,  0.2062,  0.2634,  0.4038,  0.9288,  0.8986,
         0.7636,  0.1900,  0.7968,  0.3599,  0.4822,  0.9586,  0.6774,
         0.2420,  0.6772,  0.8624,  0.9944,  0.1169,  0.9763,  0.0374,
         0.2676,  0.7021,  0.8423,  0.9481,  0.2784,  0.1545,  0.0710,
         0.9337,  0.9064,  0.9414,  0.8087,  0.8422,  0.9288,  0.8926,
         0.7657,  0.5612,  0.0578,  0.5996,  0.6399,  0.9060,  0.0604,
         0.9275,  0.8897,  0.9571,  0.8193,  0.5234,  0.9969,  0.9868,
         0.8644,  0.0677,  0.9589,  0.6641,  0.8977,  0.8171,  0.0211,
         0.9214,  0.1414,  0.9896,  0.3869,  0.5851,  0.4192,  0.7068,
         0.8929,  0.3308,  0.7750,  0.5301,  0.0295,  0.5451,  0.1282,
         0.1142,  0.9321,  0.1847,  0.5727,  0.9050,  0.8361,  0.3947,
         0.9328,  0.0486,  0.8204,  0.8207,  0.7869,  0.8941,  0.8971,
         0.8073,  0.9226,  0.8415,  0.2434,  0.8017,  0.9054,  0.7625,
         0.5664,  0.2037,  0.3986,  0.0767,  0.2652,  0.0617,  0.7207,
         0.2390,  0.8379,  0.8035,  0.0810,  0.0391,  0.9133,  0.1228,
         0.0120,  0.0998,  0.5744,  0.9807,  0.0601,  0.6606,  0.9640,
         0.7754,  0.6464,  0.8842,  0.9306,  0.1151,  0.0365,  0.9423,
         0.1002,  0.4309,  0.7966,  0.6728,  0.9559,  0.2912,  0.0447,
         0.9339,  0.1240,  0.8351,  0.8754,  0.8906,  0.1785,  0.7125,
         0.9633,  0.8245,  0.0740,  0.7906,  0.6241,  0.0161,  0.9263,
         0.9955,  0.6318,  0.8959,  0.7445,  0.9462,  0.9412,  0.9697,
         0.1100,  0.1620,  0.9730,  0.6558,  0.9314,  0.9538,  0.2559,
         0.9687,  0.8611,  0.1971,  0.1307,  0.1672,  0.5872,  0.3044,
         0.8017,  0.5036,  0.4060,  0.4875,  0.8627,  0.8905,  0.7291,
         0.8848,  0.9247,  0.0833,  0.3764,  0.8711,  0.5814,  0.3837,
         0.3101,  0.2819,  0.1052,  0.8584,  0.6273,  0.9538,  0.7144,
         0.5198,  0.3227,  0.9408,  0.7528,  0.5353,  0.8251,  0.9342,
         0.9589,  0.0914,  0.8307,  0.2144,  0.3757,  0.7670,  0.6927,
         0.0498,  0.8393,  0.0176,  0.6238,  0.9654,  0.2311,  0.2825,
         0.9717,  0.1328,  0.9881,  0.2200,  0.0161,  0.8896,  0.4467,
         0.3060,  0.0784,  0.3513,  0.2141,  0.0330,  0.9718,  0.6903,
         0.0380,  0.8674,  0.1625,  0.0999,  0.1223,  0.2181,  0.2380,
         0.0416,  0.9112,  0.1371,  0.7954,  0.9428,  0.7178,  0.9426,
         0.0606,  0.9542,  0.3440,  0.3677,  0.9422,  0.2539,  0.0298,
         0.0721,  0.3432,  0.7188,  0.9750,  0.3334,  0.8987,  0.0252,
         0.8652,  0.7699,  0.8978,  0.3498,  0.8916,  0.9008,  0.0488,
         0.8844,  0.7713,  0.7634,  0.6137,  0.9194,  0.6525,  0.7855,
         0.1185,  0.3094,  0.3128,  0.5935,  0.9014,  0.3549,  0.9000,
         0.9269,  0.8878,  0.2974,  0.0382,  0.2284,  0.8244,  0.9833,
         0.7967,  0.8472,  0.5537,  0.4272,  0.6036,  0.4330,  0.9521,
         0.7731,  0.5664,  0.8529,  0.8911,  0.1661,  0.3072,  0.9806,
         0.1834,  0.6288,  0.0139,  0.8099,  0.9387,  0.5575,  0.6739,
         0.9201,  0.3402,  0.6485,  0.2805,  0.8901,  0.8253,  0.2410,
         0.9536,  0.0280,  0.5382,  0.6768,  0.3539,  0.4936,  0.1409,
         0.9082,  0.0840,  0.8956,  0.7419,  0.1699,  0.4510,  0.2206,
         0.1170,  0.6396,  0.1077,  0.1708,  0.7976,  0.1577,  0.3400,
         0.7108,  0.7672,  0.5444,  0.4491,  0.8857,  0.9687,  0.0536,
         0.4970], device='cuda:0')
tensor(0.3962, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0384,  0.8763,  0.8117,  0.5641,  0.1688,  0.0244,  0.0367,
         0.8927,  0.6954,  0.0669,  0.3331,  0.2381,  0.4771,  0.4183,
         0.3711,  0.4343,  0.1265,  0.0454,  0.1070,  0.1198,  0.6870,
         0.0698,  0.9921,  0.8464,  0.0325,  0.1002,  0.0872,  0.2617,
         0.9644,  0.1761,  0.1290,  0.0137,  0.1417,  0.0030,  0.3337,
         0.8426,  0.0844,  0.8791,  0.8712,  0.9585,  0.5528,  0.0896,
         0.6302,  0.1640,  0.8641,  0.3337,  0.2394,  0.3418,  0.7635,
         0.5852,  0.7604,  0.2306,  0.5272,  0.7854,  0.1534,  0.9319,
         0.6757,  0.5750,  0.9228,  0.1697,  0.1984,  0.3903,  0.2488,
         0.8268,  0.8668,  0.8758,  0.9761,  0.1475,  0.0431,  0.9144,
         0.0869,  0.0555,  0.8057,  0.0532,  0.1231,  0.6924,  0.8525,
         0.5440,  0.9086,  0.0106,  0.0240,  0.6511,  0.8927,  0.5599,
         0.8882,  0.3358,  0.8662,  0.8277,  0.2244,  0.9135,  0.1174,
         0.9090,  0.7755,  0.1460,  0.5620,  0.1886,  0.5596,  0.9539,
         0.2111,  0.8083,  0.4669,  0.1705,  0.7292,  0.5848,  0.1069,
         0.8890,  0.9551,  0.6985,  0.0564,  0.8817,  0.0282,  0.6795,
         0.3388,  0.9171,  0.0731,  0.8799,  0.9519,  0.5503,  0.0476,
         0.8060,  0.0662,  0.7747,  0.3473,  0.9946,  0.9446,  0.9107,
         0.7637,  0.0209,  0.0894,  0.7440,  0.9909,  0.9586,  0.3519,
         0.2846,  0.2290,  0.0991,  0.8845,  0.2836,  0.1116,  0.5833,
         0.0905,  0.7948,  0.2923,  0.1767,  0.8549,  0.4274,  0.5565,
         0.1557,  0.6051,  0.0134,  0.0382,  0.9642,  0.7473,  0.0472,
         0.9033,  0.9414,  0.1057,  0.2499,  0.0579,  0.2544,  0.0822,
         0.1030,  0.6873,  0.1548,  0.0174,  0.9469,  0.0932,  0.2438,
         0.0170,  0.1019,  0.1200,  0.8517,  0.6347,  0.3195,  0.4601,
         0.4263,  0.8001,  0.4569,  0.9385,  0.9090,  0.0451,  0.0388,
         0.5750,  0.0285,  0.6518,  0.9702,  0.3961,  0.3211,  0.7767,
         0.9545,  0.2636,  0.0211,  0.7449,  0.7804,  0.0479,  0.1286,
         0.5825,  0.7231,  0.6139,  0.3727,  0.9728,  0.5223,  0.8037,
         0.9312,  0.6681,  0.5333,  0.9981,  0.6300,  0.8353,  0.7352,
         0.5240,  0.6038,  0.1840,  0.9608,  0.1226,  0.9207,  0.2373,
         0.1138,  0.0753,  0.9869,  0.9700,  0.1953,  0.9683,  0.0880,
         0.9033,  0.4896,  0.8066,  0.7348,  0.8645,  0.0756,  0.7833,
         0.0206,  0.2564,  0.8351,  0.2421,  0.2868,  0.0153,  0.4813,
         0.9985,  0.8835,  0.2211,  0.8696,  0.7822,  0.3894,  0.5893,
         0.5695,  0.8840,  0.7604,  0.7561,  0.1505,  0.3692,  0.1634,
         0.6072,  0.1645,  0.1165,  0.6981,  0.4895,  0.8997,  0.5459,
         0.4379,  0.1190,  0.8337,  0.9449,  0.9318,  0.1379,  0.9239,
         0.9537,  0.9719,  0.0347,  0.6505,  0.1051,  0.7517,  0.9946,
         0.8243,  0.9700,  0.2871,  0.6061,  0.8013,  0.1400,  0.0651,
         0.3467,  0.0631,  0.0224,  0.7716,  0.4069,  0.8900,  0.0478,
         0.3350,  0.9513,  0.3688,  0.8185,  0.3201,  0.1035,  0.7018,
         0.5416,  0.0216,  0.1067,  0.1179,  0.0416,  0.1881,  0.0275,
         0.0200,  0.0511,  0.6218,  0.8740,  0.8073,  0.6433,  0.6147,
         0.5858,  0.5858,  0.9757,  0.2894,  0.2213,  0.9167,  0.7896,
         0.0875,  0.0087,  0.2854,  0.5576,  0.0915,  0.8903,  0.7990,
         0.8298,  0.5482,  0.4788,  0.7881,  0.8520,  0.0058,  0.1741,
         0.8334,  0.9983,  0.8776,  0.7860,  0.8829,  0.7488,  0.7810,
         0.7741,  0.8251,  0.5798,  0.1386,  0.1768,  0.0039,  0.1140,
         0.8973,  0.1760,  0.0117,  0.8835,  0.9662,  0.5498,  0.1891,
         0.3876,  0.0920,  0.1873,  0.9413,  0.8700,  0.5773,  0.7353,
         0.8119,  0.9375,  0.9492,  0.2070,  0.4792,  0.3959,  0.7687,
         0.0745,  0.6086,  0.8545,  0.7253,  0.2337,  0.4457,  0.9430,
         0.6628,  0.0878,  0.7031,  0.1877,  0.9667,  0.4644,  0.4888,
         0.1363,  0.9161,  0.9771,  0.8302,  0.7871,  0.3471,  0.9147,
         0.9220,  0.7218,  0.3500,  0.0337,  0.0775,  0.7455,  0.2556,
         0.9770,  0.0906,  0.0648,  0.7801,  0.8105,  0.2406,  0.7861,
         0.2380,  0.0413,  0.1118,  0.9047,  0.1275,  0.1338,  0.0578,
         0.8427,  0.8704,  0.0431,  0.9843,  0.0927,  0.9122,  0.1212,
         0.3260,  0.0719,  0.0510,  0.1250,  0.0189,  0.1420,  0.4657,
         0.1392,  0.1161,  0.8536,  0.9655], device='cuda:0')
tensor(0.3892, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 5, BCELoss: 0.41177836242987187
tensor([ 0.4187,  0.9681,  0.1266,  0.9129,  0.8044,  0.1227,  0.0275,
         0.9923,  0.2205,  0.6712,  0.0432,  0.4965,  0.3505,  0.3160,
         0.0332,  0.7580,  0.1589,  0.1853,  0.0972,  0.0225,  0.2012,
         0.9201,  0.1325,  0.8905,  0.1075,  0.3230,  0.6862,  0.9845,
         0.8129,  0.3318,  0.9528,  0.9600,  0.5155,  0.4714,  0.1615,
         0.0545,  0.8469,  0.7811,  0.0377,  0.0210,  0.3692,  0.7578,
         0.0036,  0.0142,  0.5718,  0.2369,  0.6212,  0.7382,  0.8745,
         0.0518,  0.0797,  0.0628,  0.7102,  0.7676,  0.2214,  0.1364,
         0.9595,  0.8210,  0.8672,  0.9641,  0.2814,  0.7209,  0.8311,
         0.1072,  0.7051,  0.1847,  0.9537,  0.5860,  0.9200,  0.4823,
         0.0579,  0.8095,  0.0416,  0.0129,  0.9977,  0.9903,  0.0488,
         0.1498,  0.0678,  0.0765,  0.1561,  0.9541,  0.7274,  0.0442,
         0.2426,  0.6825,  0.0214,  0.8405,  0.9020,  0.1463,  0.1586,
         0.1518,  0.2346,  0.1462,  0.6909,  0.7327,  0.9063,  0.9706,
         0.0789,  0.0962,  0.3281,  0.0696,  0.1569,  0.9417,  0.4438,
         0.9064,  0.1863,  0.1722,  0.0742,  0.1092,  0.8281,  0.6638,
         0.5728,  0.5077,  0.8357,  0.0640,  0.0896,  0.9721,  0.7436,
         0.8270,  0.4332,  0.9885,  0.5939,  0.0429,  0.0076,  0.3187,
         0.8008,  0.1409,  0.3503,  0.5136,  0.8336,  0.2830,  0.7068,
         0.0828,  0.0078,  0.9686,  0.1512,  0.3333,  0.6523,  0.4503,
         0.0994,  0.1574,  0.8103,  0.6409,  0.5692,  0.2118,  0.0752,
         0.3344,  0.0280,  0.0219,  0.8120,  0.3104,  0.4760,  0.2353,
         0.1535,  0.1498,  0.9662,  0.3308,  0.1598,  0.6940,  0.9654,
         0.9498,  0.4770,  0.7065,  0.6909,  0.3677,  0.3740,  0.8569,
         0.8899,  0.2033,  0.6396,  0.7431,  0.8012,  0.8673,  0.0181,
         0.9227,  0.3626,  0.8999,  0.4903,  0.0713,  0.1057,  0.5396,
         0.9897,  0.9520,  0.8456,  0.0369,  0.9247,  0.9746,  0.2052,
         0.0634,  0.4563,  0.1731,  0.7262,  0.9315,  0.0794,  0.4582,
         0.8449,  0.7864,  0.0430,  0.6179,  0.4486,  0.1441,  0.4916,
         0.8720,  0.1157,  0.8448,  0.4271,  0.1262,  0.8141,  0.8606,
         0.3401,  0.6017,  0.0129,  0.2395,  0.1445,  0.6387,  0.9917,
         0.0605,  0.6549,  0.4734,  0.0967,  0.9445,  0.9801,  0.4185,
         0.0138,  0.8876,  0.0951,  0.8471,  0.5793,  0.8843,  0.9905,
         0.8315,  0.5504,  0.7997,  0.0272,  0.1350,  0.9315,  0.4458,
         0.8158,  0.0729,  0.2167,  0.7501,  0.3911,  0.0660,  0.6765,
         0.8653,  0.0374,  0.0198,  0.6730,  0.9729,  0.1360,  0.9775,
         0.0628,  0.0701,  0.7163,  0.0390,  0.7008,  0.6465,  0.7534,
         0.8841,  0.0318,  0.9549,  0.7606,  0.8779,  0.3014,  0.1293,
         0.9786,  0.0790,  0.5770,  0.1040,  0.0758,  0.0580,  0.0423,
         0.1666,  0.9337,  0.8922,  0.2275,  0.3881,  0.2303,  0.8347,
         0.7234,  0.0507,  0.9006,  0.6542,  0.1709,  0.0363,  0.5390,
         0.1990,  0.2278,  0.8850,  0.3949,  0.3679,  0.7824,  0.1844,
         0.9195,  0.0348,  0.9952,  0.6363,  0.7042,  0.1342,  0.7553,
         0.4555,  0.6723,  0.9308,  0.5556,  0.9576,  0.0399,  0.0546,
         0.2405,  0.7215,  0.4439,  0.2307,  0.9419,  0.8869,  0.3997,
         0.0166,  0.9228,  0.5625,  0.0297,  0.9936,  0.0178,  0.7632,
         0.8717,  0.3538,  0.1450,  0.6692,  0.8120,  0.1606,  0.0464,
         0.9063,  0.3500,  0.0454,  0.0296,  0.1926,  0.0266,  0.5619,
         0.0497,  0.0255,  0.2695,  0.6797,  0.5683,  0.1826,  0.1594,
         0.0195,  0.8162,  0.8359,  0.9290,  0.0317,  0.8952,  0.4528,
         0.2669,  0.8046,  0.8934,  0.7743,  0.0616,  0.2583,  0.7348,
         0.8788,  0.1357,  0.7559,  0.4231,  0.7230,  0.0126,  0.0490,
         0.0038,  0.0819,  0.9918,  0.3054,  0.2585,  0.1527,  0.0304,
         0.1286,  0.2383,  0.5228,  0.1222,  0.1528,  0.3164,  0.7808,
         0.7069,  0.9144,  0.2552,  0.2316,  0.3838,  0.6098,  0.9873,
         0.1311,  0.3018,  0.9970,  0.3335,  0.8024,  0.7356,  0.4656,
         0.0444,  0.1124,  0.8520,  0.3239,  0.1906,  0.0996,  0.8463,
         0.3600,  0.7513,  0.0300,  0.8703,  0.1628,  0.0167,  0.9695,
         0.1725,  0.0735,  0.1375,  0.8629,  0.0562,  0.9271,  0.0325,
         0.4783,  0.5243,  0.3394,  0.9482,  0.0202,  0.0768,  0.5121,
         0.9141,  0.8916,  0.6854,  0.6524,  0.9746,  0.0933,  0.4325,
         0.0466,  0.8621,  0.5062,  0.7411,  0.1090,  0.1391,  0.0135,
         0.2972,  0.5709,  0.8314,  0.6892,  0.1090,  0.7944,  0.9031,
         0.1290,  0.9780,  0.9047,  0.7319,  0.3270,  0.7822,  0.0805,
         0.0483,  0.8226,  0.8125,  0.6760,  0.6083,  0.3002,  0.0983,
         0.5440,  0.4745,  0.9949,  0.9064,  0.1625,  0.5921,  0.6927,
         0.8515,  0.4833,  0.1040,  0.0517,  0.1783,  0.2591,  0.2061,
         0.5137,  0.5475,  0.3466,  0.0642,  0.0418,  0.1484,  0.2910,
         0.4713,  0.0987,  0.9120,  0.9810,  0.2183,  0.6965,  0.0675,
         0.1362,  0.8674,  0.0717,  0.9249,  0.4354,  0.1031,  0.2490,
         0.2970,  0.8482,  0.4256,  0.8326,  0.7090,  0.2749,  0.0452,
         0.0533,  0.3899,  0.2383,  0.1798,  0.1299,  0.3826,  0.0423,
         0.7756,  0.6791,  0.8819,  0.4761,  0.8585,  0.9081,  0.8616,
         0.0288], device='cuda:0')
tensor(0.3950, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0238,  0.0817,  0.0671,  0.5017,  0.0359,  0.7023,  0.9474,
         0.8997,  0.9738,  0.0198,  0.3651,  0.6134,  0.8018,  0.7599,
         0.7672,  0.0498,  0.3091,  0.3889,  0.1402,  0.0437,  0.2379,
         0.8380,  0.7410,  0.7537,  0.0509,  0.2575,  0.4718,  0.7621,
         0.7638,  0.4663,  0.8097,  0.0508,  0.8887,  0.8124,  0.2084,
         0.2426,  0.9688,  0.0060,  0.3196,  0.4536,  0.7118,  0.0442,
         0.1272,  0.4854,  0.1236,  0.0556,  0.5491,  0.0526,  0.8768,
         0.0584,  0.0597,  0.5815,  0.7785,  0.9247,  0.9492,  0.6235,
         0.1996,  0.0803,  0.7202,  0.9720,  0.1100,  0.8350,  0.9255,
         0.7485,  0.0417,  0.7918,  0.0500,  0.9892,  0.6189,  0.0282,
         0.0268,  0.7328,  0.0465,  0.9084,  0.4919,  0.0046,  0.6658,
         0.0249,  0.0703,  0.9526,  0.8762,  0.1302,  0.0797,  0.0492,
         0.5938,  0.0229,  0.2448,  0.1770,  0.9241,  0.7807,  0.0529,
         0.1701,  0.3557,  0.1682,  0.0655,  0.9252,  0.0676,  0.1597,
         0.6632,  0.0932,  0.9266,  0.3830,  0.0853,  0.9727,  0.0322,
         0.0392,  0.0368,  0.7772,  0.1867,  0.8375,  0.0347,  0.1048,
         0.3209,  0.9727,  0.5078,  0.8781,  0.8906,  0.7720,  0.5700,
         0.1543,  0.8674,  0.0322,  0.5471,  0.1698,  0.6762,  0.1028,
         0.8687,  0.2752,  0.4755,  0.0657,  0.0341,  0.8046,  0.7892,
         0.9856,  0.8244,  0.8240,  0.0200,  0.0515,  0.1452,  0.9445,
         0.0527,  0.0502,  0.1641,  0.0972,  0.6725,  0.0905,  0.0835,
         0.8928,  0.0074,  0.1441,  0.8968,  0.0719,  0.0707,  0.1638,
         0.0764,  0.8685,  0.4150,  0.1981,  0.7238,  0.8105,  0.2908,
         0.9108,  0.0498,  0.8319,  0.8804,  0.9349,  0.7262,  0.0445,
         0.6439,  0.8972,  0.8634,  0.5172,  0.0222,  0.0271,  0.4076,
         0.5638,  0.0118,  0.0221,  0.8011,  0.7641,  0.2236,  0.0467,
         0.2992,  0.7534,  0.0154,  0.6475,  0.3486,  0.7765,  0.2951,
         0.1432,  0.0048,  0.8722,  0.7094,  0.0075,  0.1149,  0.1667,
         0.8123,  0.9506,  0.0057,  0.1168,  0.0273,  0.3102,  0.2771,
         0.7411,  0.0303,  0.7660,  0.7851,  0.9188,  0.0081,  0.3226,
         0.8742,  0.7772,  0.8556,  0.0231,  0.1878,  0.7836,  0.0180,
         0.0295,  0.4811,  0.0268,  0.0179,  0.0640,  0.1230,  0.2699,
         0.1113,  0.9323,  0.2765,  0.6876,  0.4975,  0.2974,  0.2348,
         0.7419,  0.5697,  0.1243,  0.9363,  0.7648,  0.9926,  0.1446,
         0.8641,  0.0223,  0.0416,  0.9151,  0.0529,  0.6131,  0.1510,
         0.4975,  0.8679,  0.0284,  0.9342,  0.8932,  0.8560,  0.1712,
         0.5301,  0.0657,  0.3088,  0.9431,  0.9491,  0.9729,  0.0800,
         0.7628,  0.4510,  0.1845,  0.8734,  0.1138,  0.9811,  0.3320,
         0.3384,  0.5047,  0.6194,  0.7672,  0.2345,  0.8192,  0.4738,
         0.1210,  0.8553,  0.9261,  0.1683,  0.0637,  0.8620,  0.9310,
         0.9921,  0.0299,  0.0217,  0.7425,  0.2845,  0.1533,  0.0169,
         0.8851,  0.0069,  0.8420,  0.7671,  0.0666,  0.5040,  0.0567,
         0.0794,  0.0568,  0.5356,  0.8407,  0.3189,  0.7205,  0.1290,
         0.6802,  0.0534,  0.9887,  0.0219,  0.1922,  0.8753,  0.9457,
         0.0682,  0.0312,  0.8283,  0.7277,  0.4762,  0.0057,  0.6686,
         0.8980,  0.0161,  0.7913,  0.5351,  0.1447,  0.0605,  0.7968,
         0.0940,  0.2939,  0.0958,  0.2100,  0.8673,  0.2786,  0.8549,
         0.9359,  0.1272,  0.9681,  0.0200,  0.0119,  0.8506,  0.2259,
         0.8551,  0.4154,  0.9924,  0.3406,  0.6854,  0.1134,  0.8903,
         0.7990,  0.5772,  0.0968,  0.0375,  0.9641,  0.0495,  0.7718,
         0.3234,  0.9975,  0.7120,  0.0431,  0.0490,  0.0258,  0.8068,
         0.1708,  0.7985,  0.2903,  0.0468,  0.0020,  0.7986,  0.1921,
         0.0825,  0.1615,  0.1112,  0.4416,  0.2225,  0.7779,  0.8638,
         0.9794,  0.1134,  0.8115,  0.7355,  0.1493,  0.0442,  0.0576,
         0.7426,  0.9957,  0.0644,  0.8573,  0.9934,  0.9594,  0.0016,
         0.7075,  0.5286,  0.8053,  0.9080,  0.1401,  0.0849,  0.9964,
         0.8345,  0.0275,  0.2696,  0.4858,  0.4991,  0.5616,  0.1406,
         0.1378,  0.4415,  0.1216,  0.0654,  0.7232,  0.2168,  0.5109,
         0.3086,  0.4390,  0.0213,  0.8882,  0.0192,  0.7056,  0.0385,
         0.0368,  0.9582,  0.8489,  0.4396,  0.0871,  0.9775,  0.4068,
         0.9478,  0.0584,  0.0507,  0.5716,  0.2010,  0.9382,  0.9799,
         0.7480,  0.8552,  0.9861,  0.4202,  0.7395,  0.8567,  0.0231,
         0.7030,  0.1411,  0.1142,  0.1225,  0.7919,  0.3479,  0.9085,
         0.1831,  0.9298,  0.7967,  0.7499,  0.2136,  0.0917,  0.0410,
         0.0446,  0.4562,  0.9588,  0.8848,  0.9605,  0.7483,  0.7816,
         0.8774,  0.8539,  0.8319,  0.3420,  0.9424,  0.0271,  0.8092,
         0.9673,  0.2602,  0.1116,  0.0575,  0.2147,  0.6126,  0.4013,
         0.1360,  0.2445,  0.6926,  0.8489,  0.0690,  0.9790,  0.0214,
         0.3866,  0.6103,  0.9105,  0.0224,  0.4129,  0.9691,  0.5989,
         0.0189,  0.0603,  0.0018,  0.8180,  0.2366,  0.2283,  0.0764,
         0.1103,  0.1571,  0.1785,  0.2257,  0.9225,  0.0281,  0.7961,
         0.9657,  0.0512,  0.7874,  0.8818,  0.7143,  0.6642,  0.9754,
         0.4656,  0.8768,  0.0423,  0.8222,  0.3938,  0.2930,  0.7379,
         0.0096], device='cuda:0')
tensor(0.3552, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8708,  0.1060,  0.0514,  0.7980,  0.9476,  0.3719,  0.1290,
         0.5147,  0.0197,  0.5558,  0.9691,  0.9852,  0.8332,  0.9749,
         0.0369,  0.9512,  0.0956,  0.8596,  0.9482,  0.1191,  0.0275,
         0.5361,  0.9105,  0.9762,  0.4647,  0.6030,  0.0579,  0.8499,
         0.0088,  0.0990,  0.0639,  0.8139,  0.0163,  0.0582,  0.9965,
         0.8043,  0.2364,  0.3898,  0.4445,  0.8413,  0.0499,  0.5884,
         0.0682,  0.2194,  0.7761,  0.9559,  0.6904,  0.2669,  0.8452,
         0.9189,  0.9139,  0.2803,  0.0602,  0.0994,  0.0346,  0.8820,
         0.6931,  0.1549,  0.0254,  0.8002,  0.6037,  0.9138,  0.3090,
         0.1344,  0.2776,  0.8715,  0.8064,  0.0041,  0.9343,  0.0235,
         0.9203,  0.9493,  0.2807,  0.0961,  0.9546,  0.9775,  0.0739,
         0.0624,  0.7571,  0.0299,  0.9534,  0.0251,  0.7900,  0.9244,
         0.9663,  0.1550,  0.0328,  0.1193,  0.1908,  0.9727,  0.7865,
         0.9601,  0.0247,  0.2064,  0.6435,  0.6724,  0.0790,  0.6009,
         0.9483,  0.7888,  0.8003,  0.9645,  0.0090,  0.0171,  0.0179,
         0.8857,  0.9697,  0.6178,  0.9201,  0.7703,  0.0632,  0.9092,
         0.6363,  0.9260,  0.0183,  0.9714,  0.8238,  0.1485,  0.1541,
         0.0749,  0.8732,  0.2686,  0.7526,  0.9502,  0.7682,  0.8947,
         0.9391,  0.1306,  0.1520,  0.0667,  0.9220,  0.0390,  0.7982,
         0.7980,  0.8688,  0.8399,  0.1708,  0.0194,  0.8970,  0.3461,
         0.7703,  0.9074,  0.9233,  0.8556,  0.3925,  0.1228,  0.2818,
         0.6100,  0.0197,  0.0068,  0.9652,  0.0391,  0.0914,  0.4908,
         0.0296,  0.7771,  0.0445,  0.5908,  0.0976,  0.0345,  0.8692,
         0.0350,  0.0668,  0.8802,  0.6555,  0.7803,  0.7825,  0.6603,
         0.9669,  0.0058,  0.9236,  0.7176,  0.7846,  0.8369,  0.2239,
         0.4838,  0.0403,  0.9101,  0.1818,  0.9640,  0.8655,  0.7392,
         0.9026,  0.8349,  0.9973,  0.1453,  0.5921,  0.1172,  0.7284,
         0.9079,  0.8824,  0.1840,  0.7837,  0.0076,  0.9315,  0.9329,
         0.1101,  0.8884,  0.0712,  0.0124,  0.9503,  0.1362,  0.0196,
         0.0145,  0.7509,  0.0569,  0.8269,  0.0682,  0.8862,  0.0240,
         0.0315,  0.0754,  0.0903,  0.8707,  0.7175,  0.0740,  0.8640,
         0.5101,  0.2467,  0.2106,  0.4273,  0.9616,  0.0021,  0.8318,
         0.6698,  0.8016,  0.9203,  0.8937,  0.5726,  0.0539,  0.9965,
         0.9130,  0.9530,  0.2339,  0.0120,  0.7999,  0.5886,  0.0126,
         0.1258,  0.0309,  0.8391,  0.0114,  0.3167,  0.8692,  0.0422,
         0.8961,  0.6906,  0.2913,  0.8840,  0.8794,  0.8976,  0.0691,
         0.7729,  0.0363,  0.0691,  0.1775,  0.9463,  0.6469,  0.0213,
         0.8624,  0.0085,  0.7960,  0.8897,  0.8746,  0.9697,  0.8048,
         0.0526,  0.0915,  0.0276,  0.8007,  0.9325,  0.0612,  0.9733,
         0.8979,  0.3533,  0.0113,  0.9007,  0.2556,  0.1427,  0.3633,
         0.0717,  0.0129,  0.0107,  0.7408,  0.9696,  0.9506,  0.0679,
         0.7997,  0.0363,  0.0226,  0.4666,  0.9753,  0.7787,  0.0512,
         0.9479,  0.1271,  0.8831,  0.8277,  0.8285,  0.9283,  0.4168,
         0.0666,  0.5649,  0.8911,  0.8847,  0.9070,  0.5285,  0.8834,
         0.7577,  0.7423,  0.7770,  0.0997,  0.1308,  0.0332,  0.0401,
         0.8960,  0.9561,  0.0935,  0.1142,  0.3568,  0.2385,  0.8268,
         0.2426,  0.2290,  0.7309,  0.9364,  0.0554,  0.0326,  0.9658,
         0.0630,  0.7995,  0.7885,  0.8626,  0.1411,  0.9080,  0.8051,
         0.1330,  0.1158,  0.0319,  0.6629,  0.9352,  0.2578,  0.0458,
         0.4413,  0.9521,  0.2268,  0.3921,  0.0264,  0.1495,  0.1040,
         0.5944,  0.8400,  0.9311,  0.0749,  0.5519,  0.9622,  0.1319,
         0.0694,  0.1177,  0.0813,  0.9667,  0.2053,  0.0730,  0.9214,
         0.9349,  0.9950,  0.6676,  0.3924,  0.2076,  0.7384,  0.1722,
         0.8345,  0.9413,  0.0149,  0.7825,  0.3166,  0.0500,  0.9135,
         0.1352,  0.0264,  0.1331,  0.4259,  0.0521,  0.1535,  0.9544,
         0.9129,  0.9687,  0.1029,  0.8931,  0.5924,  0.4711,  0.9803,
         0.8181,  0.5271,  0.9783,  0.0497,  0.0756,  0.9450,  0.0635,
         0.9581,  0.0053,  0.0628,  0.9015,  0.0194,  0.8653,  0.8137,
         0.0259,  0.9090,  0.3413,  0.0206,  0.0271,  0.8896,  0.9579,
         0.8639,  0.0809,  0.8683,  0.9853,  0.1613,  0.7051,  0.0297,
         0.0101,  0.0872,  0.0489,  0.6590,  0.9456,  0.1892,  0.9463,
         0.9007,  0.4139,  0.3657,  0.0524,  0.9440,  0.9204,  0.6408,
         0.9437,  0.2394,  0.0945,  0.2456,  0.4141,  0.1056,  0.7989,
         0.7291,  0.0679,  0.7533,  0.5668,  0.1798,  0.8114,  0.0666,
         0.2849,  0.0404,  0.7838,  0.1865,  0.0895,  0.4682,  0.0203,
         0.8679,  0.6402,  0.2020,  0.0144,  0.2616,  0.0847,  0.0303,
         0.9813,  0.1192,  0.6001,  0.7907,  0.8073,  0.0339,  0.3203,
         0.0255,  0.8046,  0.0439,  0.1383,  0.9613,  0.5308,  0.0118,
         0.1260,  0.9027,  0.9471,  0.1376,  0.9127,  0.9210,  0.3906,
         0.7167,  0.1031,  0.2260,  0.0390,  0.0811,  0.9689,  0.8769,
         0.8925,  0.9340,  0.9358,  0.4263,  0.2957,  0.8981,  0.1863,
         0.0027,  0.1337,  0.7176,  0.8215,  0.0088,  0.1592,  0.7613,
         0.1629,  0.3630,  0.8068,  0.1682,  0.7346,  0.9618,  0.9658,
         0.1108], device='cuda:0')
tensor(0.3443, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0914,  0.4022,  0.0749,  0.9507,  0.0233,  0.0343,  0.9577,
         0.0128,  0.1035,  0.0690,  0.0120,  0.1647,  0.1693,  0.8603,
         0.0482,  0.0326,  0.9424,  0.0262,  0.4747,  0.0698,  0.7306,
         0.0182,  0.0504,  0.7382,  0.8638,  0.9581,  0.9550,  0.8782,
         0.9670,  0.3120,  0.9295,  0.0097,  0.8591,  0.0039,  0.9204,
         0.0520,  0.9340,  0.6004,  0.1145,  0.9177,  0.0495,  0.4075,
         0.9148,  0.0379,  0.1022,  0.1695,  0.5691,  0.7843,  0.0634,
         0.8150,  0.2195,  0.9154,  0.9424,  0.8061,  0.8428,  0.4368,
         0.3985,  0.1754,  0.4934,  0.0429,  0.0258,  0.9239,  0.8364,
         0.9086,  0.0890,  0.9295,  0.4138,  0.9190,  0.0021,  0.7631,
         0.6988,  0.0973,  0.9436,  0.9523,  0.0059,  0.6218,  0.0469,
         0.9175,  0.1238,  0.5273,  0.0865,  0.4632,  0.0139,  0.1027,
         0.0233,  0.7571,  0.9160,  0.9467,  0.0116,  0.8023,  0.7710,
         0.9111,  0.5654,  0.9327,  0.9072,  0.8946,  0.5029,  0.7983,
         0.0568,  0.8979,  0.8979,  0.9956,  0.2039,  0.8370,  0.7325,
         0.0132,  0.0885,  0.9085,  0.8925,  0.0687,  0.3104,  0.0758,
         0.0943,  0.1427,  0.0589,  0.9525,  0.0091,  0.8924,  0.0023,
         0.7580,  0.9974,  0.1928,  0.0349,  0.0473,  0.2114,  0.0317,
         0.5722,  0.8857,  0.8695,  0.2783,  0.1361,  0.9229,  0.7908,
         0.9440,  0.0802,  0.0024,  0.5586,  0.9825,  0.0255,  0.8154,
         0.9409,  0.0501,  0.2602,  0.0192,  0.8622,  0.4718,  0.2932,
         0.9741,  0.8105,  0.5000,  0.0503,  0.7645,  0.0653,  0.0132,
         0.5171,  0.2804,  0.9031,  0.0735,  0.8069,  0.0160,  0.1290,
         0.5130,  0.9866,  0.9342,  0.0233,  0.9092,  0.0082,  0.8621,
         0.1023,  0.9160,  0.8853,  0.8723,  0.6981,  0.5362,  0.0299,
         0.9034,  0.0414,  0.4599,  0.0019,  0.6700,  0.7059,  0.0295,
         0.7588,  0.8801,  0.9123,  0.9496,  0.1053,  0.1114,  0.1999,
         0.9505,  0.8435,  0.1077,  0.9271,  0.0955,  0.0048,  0.0739,
         0.8134,  0.9958,  0.7822,  0.5293,  0.4467,  0.9393,  0.8534,
         0.9728,  0.9503,  0.7467,  0.8350,  0.9443,  0.9225,  0.8837,
         0.8386,  0.9618,  0.0535,  0.9659,  0.7994,  0.9847,  0.9453,
         0.2644,  0.0210,  0.0616,  0.7707,  0.0198,  0.1942,  0.0668,
         0.7648,  0.1675,  0.1122,  0.8984,  0.0122,  0.5714,  0.1546,
         0.9655,  0.0079,  0.0377,  0.9594,  0.2498,  0.0090,  0.6197,
         0.0493,  0.1013,  0.0188,  0.7913,  0.9560,  0.8538,  0.0864,
         0.8544,  0.0507,  0.3517,  0.0054,  0.8567,  0.8377,  0.1806,
         0.9552,  0.8416,  0.9277,  0.0041,  0.3790,  0.9677,  0.2312,
         0.9721,  0.6791,  0.0091,  0.6769,  0.0084,  0.9433,  0.8915,
         0.0265,  0.7860,  0.1393,  0.0248,  0.6680,  0.9492,  0.8722,
         0.6134,  0.8466,  0.9706,  0.6836,  0.9152,  0.9621,  0.5075,
         0.1000,  0.9567,  0.0522,  0.8856,  0.7200,  0.9165,  0.8025,
         0.0396,  0.0355,  0.9776,  0.5176,  0.9547,  0.4862,  0.0313,
         0.3345,  0.9777,  0.5092,  0.8849,  0.0406,  0.9117,  0.0312,
         0.5530,  0.6529,  0.9692,  0.9896,  0.0347,  0.9479,  0.8210,
         0.0746,  0.9655,  0.9524,  0.9004,  0.0978,  0.9554,  0.8255,
         0.6514,  0.0929,  0.9466,  0.0158,  0.9335,  0.9961,  0.9101,
         0.6899,  0.2929,  0.4273,  0.0124,  0.7369,  0.2578,  0.1766,
         0.0975,  0.4513,  0.8436,  0.9189,  0.8025,  0.0086,  0.0611,
         0.0917,  0.9392,  0.0409,  0.1221,  0.0539,  0.0239,  0.7481,
         0.0191,  0.9474,  0.1569,  0.9988,  0.6975,  0.1330,  0.7817,
         0.8138,  0.8503,  0.7738,  0.8157,  0.3552,  0.8441,  0.8423,
         0.9099,  0.0696,  0.9472,  0.0699,  0.4499,  0.9596,  0.8693,
         0.8504,  0.0683,  0.0373,  0.5866,  0.6455,  0.1952,  0.9343,
         0.4683,  0.7501,  0.2586,  0.9905,  0.7441,  0.0066,  0.0488,
         0.9024,  0.3730,  0.0048,  0.9976,  0.5979,  0.5612,  0.6523,
         0.1214,  0.7375,  0.5419,  0.9219,  0.8832,  0.8982,  0.2637,
         0.4775,  0.5248,  0.6778,  0.5394,  0.8025,  0.0694,  0.2459,
         0.2366,  0.9150,  0.9805,  0.7049,  0.8078,  0.8716,  0.0440,
         0.8199,  0.6278,  0.7617,  0.8985,  0.0706,  0.3507,  0.0019,
         0.4935,  0.4466,  0.9638,  0.9601,  0.9364,  0.9503,  0.7063,
         0.3095,  0.3522,  0.9334,  0.8134,  0.1060,  0.0259,  0.7932,
         0.0625,  0.9030,  0.9700,  0.3918,  0.3300,  0.0431,  0.0361,
         0.9013,  0.0215,  0.9352,  0.0080,  0.5781,  0.7861,  0.5017,
         0.6933,  0.1221,  0.9136,  0.9759,  0.7169,  0.1139,  0.0110,
         0.9858,  0.8834,  0.7794,  0.0390,  0.1936,  0.9157,  0.9013,
         0.1531,  0.7246,  0.0621,  0.0543,  0.0534,  0.9447,  0.0122,
         0.7819,  0.8077,  0.5486,  0.5236,  0.0417,  0.6865,  0.9098,
         0.8396,  0.0318,  0.1328,  0.8048,  0.0251,  0.0920,  0.0137,
         0.0528,  0.8742,  0.0387,  0.0707,  0.0437,  0.9275,  0.9337,
         0.2350,  0.4353,  0.0846,  0.8658,  0.7283,  0.8457,  0.0997,
         0.8331,  0.8164,  0.9456,  0.0545,  0.1538,  0.9559,  0.8616,
         0.9276,  0.6608,  0.5071,  0.4857,  0.9772,  0.0579,  0.9408,
         0.0358,  0.4227,  0.4454,  0.0733,  0.1710,  0.0737,  0.9467,
         0.9313], device='cuda:0')
tensor(0.3776, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9401,  0.8384,  0.0827,  0.7869,  0.1262,  0.1541,  0.1760,
         0.1030,  0.0104,  0.1470,  0.9161,  0.9269,  0.7688,  0.0353,
         0.0196,  0.0786,  0.0352,  0.9063,  0.3067,  0.8844,  0.9231,
         0.0223,  0.0160,  0.8649,  0.3876,  0.8998,  0.6887,  0.7575,
         0.0436,  0.0670,  0.4694,  0.9468,  0.9532,  0.9621,  0.3938,
         0.6320,  0.6821,  0.9272,  0.6812,  0.3105,  0.9412,  0.6547,
         0.0456,  0.3863,  0.8922,  0.9942,  0.0639,  0.0517,  0.9113,
         0.8712,  0.9290,  0.0181,  0.0229,  0.7865,  0.0801,  0.0253,
         0.3690,  0.9144,  0.6919,  0.0583,  0.9476,  0.9497,  0.8540,
         0.8268,  0.0081,  0.2890,  0.2255,  0.8275,  0.0866,  0.1857,
         0.0173,  0.8773,  0.2435,  0.9924,  0.9707,  0.0987,  0.9923,
         0.9024,  0.9149,  0.0225,  0.9719,  0.9647,  0.7714,  0.0136,
         0.9540,  0.8773,  0.0153,  0.6592,  0.5844,  0.8851,  0.0236,
         0.6665,  0.8649,  0.0137,  0.0699,  0.2250,  0.5939,  0.0871,
         0.9563,  0.8095,  0.0588,  0.0442,  0.9036,  0.1560,  0.0129,
         0.9427,  0.0320,  0.2744,  0.8576,  0.7442,  0.8083,  0.9576,
         0.9702,  0.8562,  0.1343,  0.3429,  0.8317,  0.0100,  0.9110,
         0.0308,  0.7948,  0.0235,  0.9543,  0.8351,  0.1997,  0.9189,
         0.6923,  0.0963,  0.0460,  0.0100,  0.0714,  0.0182,  0.0079,
         0.0411,  0.3967,  0.0695,  0.0312,  0.1669,  0.8679,  0.0326,
         0.0116,  0.2271,  0.0716,  0.9196,  0.0078,  0.0082,  0.8898,
         0.8178,  0.2278,  0.2772,  0.0968,  0.8706,  0.8685,  0.8359,
         0.7812,  0.0831,  0.9357,  0.8233,  0.0793,  0.9247,  0.7049,
         0.7758,  0.9622,  0.0169,  0.0255,  0.0342,  0.7862,  0.4019,
         0.0036,  0.8009,  0.9454,  0.0107,  0.0195,  0.3166,  0.0776,
         0.2806,  0.8078,  0.9431,  0.0223,  0.0284,  0.8896,  0.0632,
         0.9529,  0.9038,  0.0931,  0.4782,  0.0129,  0.9344,  0.9272,
         0.0169,  0.9555,  0.0093,  0.8313,  0.3889,  0.6436,  0.8519,
         0.0574,  0.8808,  0.9848,  0.9171,  0.2440,  0.1036,  0.9607,
         0.3649,  0.2596,  0.0190,  0.9466,  0.0335,  0.8668,  0.0115,
         0.1118,  0.0132,  0.7509,  0.9272,  0.9099,  0.0418,  0.1888,
         0.0457,  0.7393,  0.0824,  0.1652,  0.0268,  0.0367,  0.5903,
         0.7904,  0.2774,  0.9032,  0.7541,  0.8007,  0.7792,  0.0347,
         0.9043,  0.4987,  0.7174,  0.7295,  0.0670,  0.0552,  0.0148,
         0.9137,  0.0667,  0.2539,  0.9598,  0.7468,  0.9291,  0.0574,
         0.0429,  0.8410,  0.0516,  0.2093,  0.8294,  0.8563,  0.8817,
         0.7220,  0.0044,  0.9520,  0.2447,  0.0411,  0.8663,  0.9079,
         0.5075,  0.0422,  0.5209,  0.7726,  0.8999,  0.8332,  0.9968,
         0.3978,  0.0076,  0.9049,  0.0114,  0.0600,  0.8789,  0.0043,
         0.0426,  0.7953,  0.1275,  0.0624,  0.9898,  0.2828,  0.8472,
         0.0807,  0.9538,  0.9604,  0.0227,  0.8603,  0.0596,  0.0889,
         0.0327,  0.0430,  0.7740,  0.8674,  0.8563,  0.0230,  0.0597,
         0.4543,  0.8912,  0.0362,  0.0664,  0.0401,  0.7359,  0.9424,
         0.0878,  0.9078,  0.9791,  0.9052,  0.0555,  0.9479,  0.7071,
         0.8880,  0.8003,  0.0168,  0.8761,  0.1811,  0.0525,  0.3270,
         0.7116,  0.0485,  0.8122,  0.3419,  0.0938,  0.6919,  0.9936,
         0.9112,  0.0120,  0.9239,  0.0047,  0.1184,  0.3176,  0.6774,
         0.9710,  0.6991,  0.7948,  0.4412,  0.7513,  0.8336,  0.7546,
         0.8419,  0.8235,  0.1629,  0.0358,  0.9129,  0.9929,  0.1726,
         0.9983,  0.0187,  0.5994,  0.8299,  0.9338,  0.0549,  0.9299,
         0.9970,  0.0588,  0.2098,  0.8005,  0.8742,  0.8026,  0.9541,
         0.8309,  0.8798,  0.0792,  0.0517,  0.9505,  0.7891,  0.0212,
         0.9788,  0.9760,  0.7897,  0.8666,  0.0221,  0.9524,  0.0874,
         0.0618,  0.0043,  0.9705,  0.1547,  0.0632,  0.2681,  0.0786,
         0.0080,  0.1026,  0.1101,  0.6058,  0.1568,  0.1264,  0.3842,
         0.8705,  0.9842,  0.9372,  0.0138,  0.1130,  0.9370,  0.7686,
         0.9033,  0.7798,  0.8994,  0.6832,  0.0691,  0.7988,  0.0820,
         0.9393,  0.0048,  0.4831,  0.9382,  0.0053,  0.8605,  0.0282,
         0.0220,  0.9483,  0.1578,  0.0784,  0.0528,  0.4131,  0.3802,
         0.0183,  0.9392,  0.9157,  0.0377,  0.4309,  0.0690,  0.5692,
         0.1370,  0.1099,  0.0690,  0.3985,  0.0300,  0.0064,  0.8701,
         0.0358,  0.0631,  0.0344,  0.8925,  0.0842,  0.9324,  0.0374,
         0.0465,  0.2760,  0.7331,  0.2213,  0.0570,  0.9117,  0.9921,
         0.5096,  0.1270,  0.2232,  0.0561,  0.8773,  0.8713,  0.9941,
         0.8923,  0.9298,  0.9248,  0.0897,  0.5317,  0.7912,  0.9109,
         0.6011,  0.3684,  0.0160,  0.9406,  0.1338,  0.4802,  0.7752,
         0.0298,  0.0840,  0.1476,  0.9146,  0.9348,  0.0838,  0.5190,
         0.0915,  0.7851,  0.4554,  0.8347,  0.1792,  0.8888,  0.3206,
         0.9232,  0.0716,  0.0143,  0.0815,  0.9332,  0.8758,  0.0041,
         0.7439,  0.0378,  0.5828,  0.8534,  0.9006,  0.8484,  0.8742,
         0.8092,  0.9647,  0.0701,  0.1194,  0.8822,  0.0262,  0.4648,
         0.2563,  0.8861,  0.0801,  0.1274,  0.9432,  0.6979,  0.9979,
         0.9018,  0.0200,  0.1073,  0.1406,  0.8781,  0.0169,  0.9610,
         0.1199], device='cuda:0')
tensor(0.3802, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2700,  0.7991,  0.0145,  0.7238,  0.9958,  0.9932,  0.5983,
         0.7003,  0.8958,  0.6980,  0.8586,  0.2082,  0.8075,  0.7882,
         0.8536,  0.9171,  0.5704,  0.8813,  0.8692,  0.9302,  0.0231,
         0.0097,  0.1243,  0.1465,  0.0021,  0.0744,  0.5189,  0.8671,
         0.9539,  0.8883,  0.7821,  0.8488,  0.4881,  0.0253,  0.2189,
         0.7175,  0.0104,  0.9131,  0.3133,  0.0407,  0.7469,  0.2385,
         0.4522,  0.9337,  0.0619,  0.8510,  0.8340,  0.9047,  0.1862,
         0.6228,  0.1429,  0.3404,  0.0125,  0.4274,  0.0859,  0.1033,
         0.0741,  0.7904,  0.5992,  0.9886,  0.8777,  0.9371,  0.8597,
         0.9008,  0.7343,  0.8581,  0.5126,  0.0167,  0.0592,  0.2590,
         0.7995,  0.7298,  0.7496,  0.8067,  0.2189,  0.8202,  0.9150,
         0.0235,  0.9008,  0.7436,  0.0292,  0.0160,  0.8582,  0.9299,
         0.0990,  0.0123,  0.3587,  0.9223,  0.8997,  0.0189,  0.6032,
         0.9859,  0.0841,  0.1013,  0.0906,  0.2065,  0.0116,  0.9641,
         0.3858,  0.8144,  0.0185,  0.0514,  0.2871,  0.9887,  0.4992,
         0.9507,  0.8872,  0.3452,  0.8943,  0.0116,  0.8181,  0.6745,
         0.1182,  0.9042,  0.0120,  0.8056,  0.2267,  0.1252,  0.2968,
         0.0181,  0.9907,  0.2546,  0.7268,  0.6910,  0.8429,  0.9976,
         0.6048,  0.8907,  0.1105,  0.8952,  0.9747,  0.1452,  0.9285,
         0.9620,  0.0262,  0.2397,  0.8858,  0.0199,  0.7510,  0.0729,
         0.0493,  0.9415,  0.0351,  0.8871,  0.0207,  0.8448,  0.2090,
         0.8279,  0.0244,  0.0188,  0.0884,  0.4084,  0.5310,  0.1485,
         0.1366,  0.8553,  0.0491,  0.4507,  0.9188,  0.9979,  0.7496,
         0.9253,  0.1939,  0.1386,  0.1813,  0.0676,  0.1505,  0.8654,
         0.0488,  0.0257,  0.4768,  0.9109,  0.9926,  0.8156,  0.2308,
         0.8950,  0.7599,  0.8653,  0.0424,  0.2826,  0.7386,  0.0433,
         0.5017,  0.8796,  0.7072,  0.7294,  0.9795,  0.8457,  0.6943,
         0.4348,  0.9805,  0.9044,  0.3307,  0.0371,  0.0174,  0.9575,
         0.9484,  0.7893,  0.0516,  0.9975,  0.0164,  0.4743,  0.8198,
         0.9725,  0.4653,  0.1216,  0.2831,  0.1380,  0.0323,  0.0471,
         0.8615,  0.0140,  0.0592,  0.0178,  0.6734,  0.2278,  0.9821,
         0.9138,  0.1386,  0.1793,  0.9614,  0.0060,  0.9342,  0.0806,
         0.0098,  0.0032,  0.1008,  0.7717,  0.1070,  0.8277,  0.0235,
         0.0120,  0.9415,  0.9122,  0.7551,  0.7260,  0.0736,  0.0608,
         0.8670,  0.0378,  0.0728,  0.0444,  0.9548,  0.7157,  0.2732,
         0.6506,  0.1413,  0.9578,  0.9699,  0.3396,  0.2109,  0.3332,
         0.0410,  0.8724,  0.9495,  0.7814,  0.9150,  0.1495,  0.0821,
         0.0912,  0.8129,  0.9263,  0.8204,  0.9245,  0.2686,  0.0023,
         0.8681,  0.4714,  0.3087,  0.4988,  0.0340,  0.0336,  0.2888,
         0.8918,  0.8528,  0.9106,  0.4987,  0.7328,  0.0878,  0.6980,
         0.1002,  0.0410,  0.9042,  0.0618,  0.9655,  0.8583,  0.9254,
         0.0284,  0.3745,  0.1543,  0.7724,  0.7585,  0.9549,  0.8763,
         0.0591,  0.9287,  0.8454,  0.6495,  0.9877,  0.0259,  0.0875,
         0.9720,  0.0991,  0.5988,  0.0394,  0.6132,  0.8473,  0.9655,
         0.0853,  0.8757,  0.9035,  0.0706,  0.0544,  0.9572,  0.4688,
         0.6408,  0.7645,  0.1495,  0.8172,  0.8771,  0.9489,  0.0222,
         0.3553,  0.8464,  0.1340,  0.9216,  0.9625,  0.7470,  0.4401,
         0.1207,  0.1884,  0.4119,  0.0428,  0.9009,  0.8142,  0.0022,
         0.9205,  0.7384,  0.0438,  0.9652,  0.9941,  0.9122,  0.0601,
         0.0441,  0.8193,  0.0409,  0.8070,  0.4905,  0.8040,  0.0653,
         0.7008,  0.8452,  0.9656,  0.6248,  0.8511,  0.7015,  0.3450,
         0.7659,  0.0527,  0.1091,  0.0025,  0.9597,  0.1356,  0.9058,
         0.8911,  0.1776,  0.0602,  0.0454,  0.9640,  0.8186,  0.8071,
         0.5331,  0.9057,  0.6814,  0.2628,  0.0469,  0.0167,  0.1315,
         0.2368,  0.8035,  0.9523,  0.3039,  0.0085,  0.0303,  0.9853,
         0.7303,  0.0418,  0.3150,  0.9694,  0.6413,  0.9670,  0.7854,
         0.0118,  0.2600,  0.8904,  0.6517,  0.4015,  0.0177,  0.2687,
         0.9762,  0.8729,  0.0205,  0.5628,  0.0457,  0.4155,  0.9085,
         0.0330,  0.8743,  0.1638,  0.8704,  0.7382,  0.9162,  0.0431,
         0.2135,  0.0108,  0.8740,  0.4422,  0.1770,  0.7697,  0.0306,
         0.1465,  0.0344,  0.0177,  0.1488,  0.8720,  0.0023,  0.7270,
         0.2826,  0.3733,  0.8231,  0.8447,  0.0137,  0.5233,  0.1795,
         0.9005,  0.0263,  0.5492,  0.9443,  0.9812,  0.6842,  0.0535,
         0.1276,  0.9697,  0.5273,  0.1766,  0.0966,  0.0357,  0.4468,
         0.9394,  0.6194,  0.0321,  0.0663,  0.4269,  0.8503,  0.1806,
         0.9239,  0.0411,  0.6900,  0.2608,  0.9538,  0.6845,  0.9954,
         0.1036,  0.4199,  0.9047,  0.5893,  0.9179,  0.8373,  0.2122,
         0.9707,  0.0585,  0.9342,  0.1569,  0.2186,  0.3147,  0.0365,
         0.9114,  0.9840,  0.9548,  0.0412,  0.9095,  0.8348,  0.6412,
         0.1753,  0.0101,  0.5982,  0.7519,  0.1798,  0.9590,  0.7928,
         0.0254,  0.9040,  0.2381,  0.0333,  0.0521,  0.7269,  0.1694,
         0.9217,  0.7520,  0.0204,  0.2910,  0.2496,  0.0207,  0.7959,
         0.9602,  0.7055,  0.0570,  0.0546,  0.8640,  0.0400,  0.8528,
         0.0173], device='cuda:0')
tensor(0.4004, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9256,  0.1094,  0.0826,  0.0432,  0.1264,  0.3373,  0.1884,
         0.8996,  0.8391,  0.0900,  0.6175,  0.9051,  0.3074,  0.1146,
         0.8611,  0.8415,  0.1038,  0.7082,  0.0794,  0.9946,  0.3328,
         0.5803,  0.9893,  0.0921,  0.4967,  0.0374,  0.9865,  0.8564,
         0.8246,  0.1389,  0.2091,  0.2579,  0.0358,  0.9004,  0.1500,
         0.6833,  0.3485,  0.1542,  0.7888,  0.4446,  0.0530,  0.0448,
         0.0669,  0.2977,  0.9716,  0.3394,  0.6232,  0.8091,  0.7483,
         0.3903,  0.2477,  0.6345,  0.2096,  0.6733,  0.0636,  0.3234,
         0.8564,  0.6230,  0.0372,  0.0456,  0.7287,  0.1142,  0.8039,
         0.0634,  0.7209,  0.6529,  0.8851,  0.0493,  0.9011,  0.5825,
         0.6469,  0.0071,  0.1125,  0.3094,  0.8324,  0.4664,  0.2688,
         0.8086,  0.9176,  0.0336,  0.7852,  0.9853,  0.5797,  0.8891,
         0.0091,  0.9779,  0.8976,  0.3455,  0.0143,  0.0520,  0.8668,
         0.9536,  0.4007,  0.8399,  0.3066,  0.8791,  0.9023,  0.1574,
         0.7852,  0.7829,  0.9823,  0.0365,  0.5164,  0.4101,  0.2982,
         0.8698,  0.7579,  0.9184,  0.9992,  0.3657,  0.9562,  0.9143,
         0.1058,  0.0882,  0.1984,  0.1559,  0.2258,  0.3579,  0.9654,
         0.9063,  0.9057,  0.9084,  0.0800,  0.9301,  0.7875,  0.9826,
         0.2540,  0.1571,  0.2694,  0.7311,  0.4179,  0.1435,  0.1240,
         0.5331,  0.6048,  0.0349,  0.7494,  0.2916,  0.5278,  0.5038,
         0.1648,  0.9872,  0.1539,  0.0487,  0.7468,  0.6079,  0.1582,
         0.4039,  0.0098,  0.7316,  0.1522,  0.5624,  0.1631,  0.8869,
         0.9093,  0.2457,  0.2514,  0.9183,  0.8916,  0.8080,  0.9094,
         0.8241,  0.9421,  0.3601,  0.2049,  0.0549,  0.2434,  0.6511,
         0.7214,  0.3266,  0.1209,  0.1663,  0.8149,  0.1832,  0.1580,
         0.3366,  0.0755,  0.5190,  0.1786,  0.3823,  0.9283,  0.1207,
         0.0196,  0.7719,  0.0832,  0.1385,  0.4645,  0.4832,  0.9158,
         0.0312,  0.1199,  0.7026,  0.5935,  0.1776,  0.8267,  0.7901,
         0.7174,  0.4823,  0.1612,  0.6837,  0.5424,  0.8823,  0.9366,
         0.0587,  0.0895,  0.7518,  0.9583,  0.1091,  0.5564,  0.7517,
         0.0445,  0.0418,  0.0923,  0.0236,  0.8264,  0.6521,  0.1358,
         0.0156,  0.5895,  0.9205,  0.2978,  0.8121,  0.8978,  0.7859,
         0.3344,  0.6251,  0.7105,  0.1743,  0.6996,  0.0474,  0.1295,
         0.0981,  0.1860,  0.9299,  0.8631,  0.4831,  0.0901,  0.7237,
         0.6076,  0.6908,  0.9862,  0.9804,  0.4405,  0.1641,  0.0686,
         0.0627,  0.0366,  0.7146,  0.5826,  0.8704,  0.0383,  0.9287,
         0.8272,  0.1904,  0.8722,  0.8206,  0.5118,  0.2305,  0.8467,
         0.8691,  0.9553,  0.5262,  0.4898,  0.6922,  0.2402,  0.9041,
         0.8561,  0.9553,  0.3997,  0.8250,  0.2391,  0.7401,  0.3865,
         0.6630,  0.1569,  0.8604,  0.7154,  0.3530,  0.2175,  0.9035,
         0.7056,  0.9013,  0.0379,  0.9018,  0.5832,  0.0279,  0.8287,
         0.0328,  0.8466,  0.0595,  0.3178,  0.8522,  0.7932,  0.8512,
         0.8004,  0.8499,  0.6643,  0.0502,  0.9925,  0.0616,  0.4383,
         0.7929,  0.8635,  0.8161,  0.8182,  0.0936,  0.0948,  0.1040,
         0.8870,  0.8633,  0.8979,  0.0441,  0.9738,  0.1565,  0.8983,
         0.0674,  0.0798,  0.8365,  0.1457,  0.3575,  0.0852,  0.1246,
         0.7384,  0.4541,  0.0843,  0.2273,  0.8775,  0.8769,  0.4370,
         0.1421,  0.8254,  0.8834,  0.3176,  0.0081,  0.7455,  0.5885,
         0.9392,  0.6594,  0.1478,  0.8231,  0.6845,  0.6243,  0.9262,
         0.1813,  0.2421,  0.5896,  0.0699,  0.1108,  0.0834,  0.8760,
         0.6505,  0.8999,  0.8620,  0.7471,  0.8597,  0.5115,  0.9502,
         0.0808,  0.4193,  0.7415,  0.9443,  0.6882,  0.9024,  0.7848,
         0.9399,  0.8179,  0.7817,  0.6754,  0.8318,  0.6093,  0.4859,
         0.7126,  0.0156,  0.9281,  0.0398,  0.9239,  0.0620,  0.7155,
         0.1472,  0.9974,  0.2669,  0.9483,  0.0738,  0.9583,  0.9929,
         0.7936,  0.9077,  0.5745,  0.6367,  0.2421,  0.5159,  0.0365,
         0.1532,  0.6793,  0.7497,  0.7449,  0.9709,  0.2901,  0.0585,
         0.5214,  0.8063,  0.2091,  0.8071,  0.9025,  0.8132,  0.8748,
         0.9178,  0.7254,  0.9128,  0.7743,  0.8369,  0.2134,  0.5107,
         0.9785,  0.9041,  0.8658,  0.9201,  0.1783,  0.9181,  0.9557,
         0.9218,  0.7654,  0.4844,  0.9139,  0.7615,  0.0401,  0.2221,
         0.7909,  0.7996,  0.3601,  0.6846,  0.8850,  0.9239,  0.7402,
         0.6497,  0.4127,  0.4028,  0.8427,  0.0845,  0.1552,  0.0560,
         0.3471,  0.1792,  0.7346,  0.2191,  0.9803,  0.7210,  0.2195,
         0.9849,  0.0504,  0.0581,  0.0409,  0.4138,  0.9281,  0.5536,
         0.8072,  0.8796,  0.9256,  0.1361,  0.9234,  0.8122,  0.8494,
         0.2067,  0.6031,  0.9094,  0.1804,  0.9420,  0.0478,  0.0161,
         0.8087,  0.9726,  0.9920,  0.5148,  0.1799,  0.0778,  0.1617,
         0.9342,  0.2814,  0.5766,  0.9462,  0.3177,  0.1793,  0.0441,
         0.3104,  0.1812,  0.5205,  0.2195,  0.2886,  0.8171,  0.8270,
         0.8567,  0.0229,  0.3001,  0.6254,  0.8785,  0.5392,  0.8304,
         0.9448,  0.0682,  0.8209,  0.1482,  0.3584,  0.7587,  0.1603,
         0.0172,  0.1445,  0.0090,  0.8537,  0.7094,  0.9875,  0.3507,
         0.8833], device='cuda:0')
tensor(0.3822, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8743,  0.8662,  0.6552,  0.7515,  0.7885,  0.6395,  0.9214,
         0.4212,  0.1220,  0.2292,  0.9023,  0.6334,  0.1904,  0.4610,
         0.4512,  0.5160,  0.8892,  0.6386,  0.9123,  0.3930,  0.9189,
         0.0206,  0.2676,  0.0819,  0.9677,  0.9685,  0.7910,  0.7377,
         0.6112,  0.0915,  0.2238,  0.8806,  0.0186,  0.9781,  0.2542,
         0.7944,  0.0537,  0.5019,  0.8378,  0.8617,  0.1030,  0.9193,
         0.8401,  0.8898,  0.6558,  0.5090,  0.5840,  0.9506,  0.2046,
         0.9211,  0.1924,  0.3996,  0.2925,  0.2021,  0.1689,  0.8988,
         0.9262,  0.0973,  0.7551,  0.8802,  0.8986,  0.5689,  0.0299,
         0.6277,  0.7799,  0.4435,  0.3527,  0.4283,  0.1528,  0.1412,
         0.0479,  0.6856,  0.3555,  0.1662,  0.1202,  0.4093,  0.8445,
         0.6500,  0.0331,  0.2446,  0.8526,  0.2582,  0.8451,  0.0306,
         0.7311,  0.0153,  0.6918,  0.0746,  0.5814,  0.9492,  0.1518,
         0.7227,  0.7009,  0.2872,  0.8488,  0.3456,  0.5153,  0.8781,
         0.1306,  0.4733,  0.7060,  0.0790,  0.0323,  0.6951,  0.1482,
         0.0639,  0.9283,  0.9144,  0.0662,  0.1729,  0.5763,  0.9356,
         0.2606,  0.0076,  0.1174,  0.4226,  0.7843,  0.3760,  0.8454,
         0.9984,  0.2264,  0.8958,  0.0817,  0.7609,  0.7101,  0.0831,
         0.1162,  0.8393,  0.0688,  0.0380,  0.9070,  0.7964,  0.0193,
         0.9427,  0.1663,  0.8707,  0.3423,  0.7708,  0.1239,  0.4935,
         0.7906,  0.2749,  0.0195,  0.9641,  0.2093,  0.1894,  0.8172,
         0.2189,  0.2137,  0.9024,  0.1233,  0.8099,  0.6764,  0.1425,
         0.7868,  0.8025,  0.0321,  0.1880,  0.6800,  0.9532,  0.8384,
         0.2158,  0.0218,  0.0049,  0.1652,  0.9949,  0.9802,  0.6759,
         0.0695,  0.7150,  0.7516,  0.6766,  0.1371,  0.0689,  0.8667,
         0.8979,  0.0659,  0.0821,  0.0319,  0.1672,  0.5441,  0.0213,
         0.1091,  0.2217,  0.6327,  0.1772,  0.5894,  0.7369,  0.0088,
         0.0049,  0.6438,  0.9268,  0.8421,  0.7589,  0.7626,  0.0511,
         0.5509,  0.4097,  0.4383,  0.5671,  0.0466,  0.4541,  0.7653,
         0.2377,  0.9755,  0.8025,  0.6738,  0.9506,  0.6349,  0.1223,
         0.9022,  0.7702,  0.9101,  0.8346,  0.8921,  0.0985,  0.3369,
         0.3364,  0.0633,  0.8672,  0.8621,  0.1628,  0.7980,  0.5537,
         0.6057,  0.6814,  0.1797,  0.6425,  0.6529,  0.2160,  0.8657,
         0.8920,  0.9662,  0.3013,  0.0352,  0.8515,  0.8085,  0.1779,
         0.0108,  0.6314,  0.9058,  0.7890,  0.1475,  0.7599,  0.6946,
         0.4603,  0.7903,  0.7251,  0.4071,  0.1789,  0.6753,  0.0747,
         0.4550,  0.5119,  0.7636,  0.7258,  0.4704,  0.3674,  0.0156,
         0.2898,  0.7925,  0.9265,  0.2579,  0.1327,  0.1721,  0.1372,
         0.0395,  0.6825,  0.8410,  0.2576,  0.0459,  0.8156,  0.0358,
         0.2208,  0.0426,  0.9214,  0.7222,  0.0303,  0.6962,  0.1225,
         0.0703,  0.3336,  0.3531,  0.8543,  0.9358,  0.4708,  0.7108,
         0.5538,  0.8732,  0.4889,  0.3922,  0.0371,  0.8192,  0.8069,
         0.9373,  0.2034,  0.6879,  0.7839,  0.0336,  0.9341,  0.1476,
         0.1268,  0.7904,  0.0248,  0.6208,  0.0898,  0.9235,  0.0071,
         0.3761,  0.7838,  0.1511,  0.1520,  0.1497,  0.1015,  0.7260,
         0.0910,  0.0937,  0.0629,  0.0116,  0.1243,  0.2123,  0.8034,
         0.5449,  0.0620,  0.7245,  0.1593,  0.7249,  0.7414,  0.6423,
         0.8037,  0.2537,  0.9877,  0.7955,  0.1226,  0.1508,  0.8077,
         0.6196,  0.0832,  0.7837,  0.9175,  0.1285,  0.2632,  0.9435,
         0.8226,  0.8747,  0.9540,  0.9820,  0.5049,  0.5433,  0.6427,
         0.1560,  0.1976,  0.9526,  0.1807,  0.0787,  0.6769,  0.0680,
         0.1393,  0.9299,  0.2729,  0.2526,  0.4298,  0.0369,  0.9426,
         0.0323,  0.2020,  0.9208,  0.8983,  0.1759,  0.8746,  0.1355,
         0.0057,  0.2108,  0.8365,  0.0111,  0.1410,  0.8786,  0.6855,
         0.2796,  0.6603,  0.8025,  0.6621,  0.7965,  0.9240,  0.2391,
         0.1222,  0.1391,  0.9575,  0.3914,  0.8676,  0.7031,  0.2836,
         0.9518,  0.7789,  0.0149,  0.3691,  0.3074,  0.9383,  0.8561,
         0.2038,  0.6886,  0.3295,  0.8539,  0.1181,  0.1634,  0.0306,
         0.4665,  0.0198,  0.6614,  0.0370,  0.0733,  0.5327,  0.5129,
         0.9104,  0.1343,  0.6072,  0.9913,  0.0198,  0.1553,  0.5182,
         0.0409,  0.4259,  0.6580,  0.3004,  0.5364,  0.3230,  0.0983,
         0.8488,  0.0191,  0.1568,  0.7095,  0.4544,  0.9097,  0.0470,
         0.9123,  0.1006,  0.4730,  0.8579,  0.8455,  0.9327,  0.0471,
         0.0707,  0.7512,  0.3179,  0.7077,  0.6374,  0.6205,  0.9602,
         0.1792,  0.8467,  0.7537,  0.3137,  0.9181,  0.4288,  0.4843,
         0.8452,  0.8607,  0.2999,  0.1034,  0.3025,  0.8525,  0.3791,
         0.1538,  0.3732,  0.1116,  0.1704,  0.3957,  0.4773,  0.6964,
         0.0862,  0.2298,  0.8501,  0.0480,  0.1102,  0.9545,  0.1276,
         0.7759,  0.0298,  0.3766,  0.3606,  0.7401,  0.2685,  0.6676,
         0.4092,  0.8563,  0.1161,  0.8485,  0.1167,  0.6043,  0.6972,
         0.3411,  0.6476,  0.9559,  0.2363,  0.8782,  0.8796,  0.2171,
         0.3481,  0.0861,  0.9183,  0.6872,  0.9003,  0.4890,  0.3253,
         0.4491,  0.9408,  0.6778,  0.7479,  0.9269,  0.9428,  0.7132,
         0.0535], device='cuda:0')
tensor(0.3591, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8942,  0.1049,  0.7288,  0.8641,  0.8078,  0.8024,  0.7962,
         0.5344,  0.0864,  0.6472,  0.2946,  0.9541,  0.8976,  0.4540,
         0.9037,  0.0259,  0.2184,  0.2882,  0.6278,  0.6670,  0.1231,
         0.9814,  0.1717,  0.6259,  0.4623,  0.4930,  0.5450,  0.1841,
         0.1880,  0.9570,  0.0999,  0.7845,  0.4845,  0.2787,  0.0627,
         0.0201,  0.0417,  0.0276,  0.2080,  0.9731,  0.0346,  0.0446,
         0.5643,  0.6796,  0.4052,  0.9510,  0.8876,  0.5210,  0.2862,
         0.0928,  0.8095,  0.0163,  0.3943,  0.2058,  0.9727,  0.5895,
         0.1003,  0.2592,  0.6240,  0.9466,  0.7698,  0.5809,  0.5910,
         0.4443,  0.8907,  0.8862,  0.0238,  0.8457,  0.7414,  0.6457,
         0.5200,  0.7968,  0.0651,  0.7784,  0.9655,  0.9454,  0.1973,
         0.6438,  0.3913,  0.2121,  0.7428,  0.7416,  0.6940,  0.1373,
         0.1529,  0.9050,  0.0237,  0.6542,  0.2608,  0.1725,  0.0672,
         0.1415,  0.6762,  0.4542,  0.1900,  0.8703,  0.2014,  0.3008,
         0.3868,  0.8566,  0.3154,  0.9371,  0.0097,  0.0433,  0.2181,
         0.9776,  0.1865,  0.5754,  0.5778,  0.5999,  0.3700,  0.6797,
         0.7440,  0.8959,  0.3962,  0.7312,  0.1083,  0.7233,  0.8026,
         0.5379,  0.8565,  0.7716,  0.1410,  0.8610,  0.7159,  0.2823,
         0.9540,  0.5413,  0.9853,  0.7193,  0.5046,  0.8650,  0.6801,
         0.2408,  0.0694,  0.9598,  0.8361,  0.8389,  0.5402,  0.2075,
         0.6391,  0.1195,  0.2506,  0.1783,  0.6116,  0.0328,  0.8645,
         0.7967,  0.8114,  0.7638,  0.9935,  0.9572,  0.8014,  0.6236,
         0.4928,  0.8710,  0.0713,  0.1645,  0.0475,  0.6130,  0.0140,
         0.1876,  0.5357,  0.3054,  0.0276,  0.8472,  0.7673,  0.3110,
         0.9038,  0.0430,  0.7943,  0.7654,  0.8945,  0.1803,  0.7824,
         0.6903,  0.7529,  0.3901,  0.9215,  0.8584,  0.0988,  0.0911,
         0.2944,  0.1189,  0.3072,  0.6290,  0.8609,  0.6879,  0.6721,
         0.8848,  0.4757,  0.8259,  0.1052,  0.7103,  0.2357,  0.8148,
         0.0585,  0.8168,  0.8060,  0.2171,  0.6509,  0.0115,  0.0327,
         0.1239,  0.2932,  0.4855,  0.2234,  0.7152,  0.8119,  0.7069,
         0.6843,  0.8250,  0.0189,  0.7542,  0.2157,  0.1670,  0.0940,
         0.9814,  0.4939,  0.5721,  0.7871,  0.2049,  0.8468,  0.4469,
         0.8928,  0.6203,  0.3687,  0.0334,  0.8806,  0.2718,  0.0740,
         0.9198,  0.8084,  0.9564,  0.0385,  0.2230,  0.4541,  0.4546,
         0.7681,  0.4725,  0.6822,  0.9351,  0.4249,  0.9208,  0.3426,
         0.8937,  0.1362,  0.0581,  0.0717,  0.9497,  0.7347,  0.5259,
         0.6324,  0.6899,  0.0379,  0.8335,  0.0471,  0.7660,  0.9341,
         0.7092,  0.1761,  0.2252,  0.4816,  0.1418,  0.7709,  0.1527,
         0.7659,  0.0695,  0.1987,  0.0472,  0.1265,  0.0111,  0.8445,
         0.5341,  0.7746,  0.1835,  0.0895,  0.0725,  0.1749,  0.0518,
         0.1990,  0.3850,  0.8524,  0.3735,  0.0604,  0.0557,  0.5060,
         0.5965,  0.8020,  0.4221,  0.0445,  0.3598,  0.5407,  0.1335,
         0.9033,  0.8592,  0.0864,  0.6950,  0.1497,  0.0221,  0.0927,
         0.3283,  0.0996,  0.9163,  0.9956,  0.0526,  0.2963,  0.0537,
         0.3789,  0.7173,  0.0813,  0.6178,  0.2256,  0.0783,  0.0654,
         0.8120,  0.3950,  0.0590,  0.8739,  0.7401,  0.3306,  0.6318,
         0.1093,  0.1217,  0.8368,  0.8631,  0.0287,  0.6541,  0.0532,
         0.0951,  0.1214,  0.1331,  0.5815,  0.1653,  0.8378,  0.2948,
         0.1180,  0.7866,  0.2689,  0.1837,  0.9561,  0.6760,  0.1656,
         0.7978,  0.3899,  0.6578,  0.7266,  0.9071,  0.2007,  0.6205,
         0.7580,  0.1473,  0.6815,  0.3922,  0.5094,  0.8872,  0.4751,
         0.8670,  0.9063,  0.9881,  0.6656,  0.8240,  0.8104,  0.7663,
         0.7883,  0.6933,  0.8722,  0.8862,  0.6450,  0.2963,  0.2659,
         0.1300,  0.4763,  0.6512,  0.2879,  0.9261,  0.6106,  0.3475,
         0.0786,  0.4146,  0.0757,  0.9789,  0.9138,  0.6966,  0.7585,
         0.9662,  0.5677,  0.7305,  0.2385,  0.9023,  0.0901,  0.7245,
         0.1480,  0.9654,  0.7940,  0.6556,  0.8943,  0.0159,  0.1301,
         0.5498,  0.7037,  0.2620,  0.5743,  0.6521,  0.7812,  0.4549,
         0.0940,  0.7474,  0.5684,  0.1799,  0.8680,  0.0129,  0.8225,
         0.0522,  0.7689,  0.7841,  0.6003,  0.1786,  0.1234,  0.5709,
         0.3512,  0.3457,  0.4596,  0.7469,  0.9002,  0.0357,  0.6441,
         0.0436,  0.5587,  0.2855,  0.2419,  0.5847,  0.7578,  0.8760,
         0.7991,  0.2961,  0.8512,  0.8987,  0.3901,  0.8908,  0.6059,
         0.4767,  0.0377,  0.2392,  0.8408,  0.2104,  0.6611,  0.7669,
         0.7445,  0.5077,  0.5436,  0.1272,  0.8100,  0.1352,  0.5404,
         0.3158,  0.3817,  0.9326,  0.8227,  0.5144,  0.9649,  0.9138,
         0.6507,  0.2538,  0.5951,  0.4417,  0.7923,  0.8604,  0.8761,
         0.5469,  0.2244,  0.2390,  0.6270,  0.6237,  0.6336,  0.3384,
         0.0126,  0.4417,  0.7179,  0.5374,  0.2362,  0.5041,  0.6987,
         0.9895,  0.6638,  0.5148,  0.1042,  0.1519,  0.2337,  0.9306,
         0.9774,  0.3652,  0.8140,  0.4894,  0.4829,  0.3959,  0.9746,
         0.0884,  0.5372,  0.0535,  0.4515,  0.1059,  0.0646,  0.2777,
         0.6106,  0.4224,  0.1295,  0.2302,  0.5618,  0.8112,  0.8214,
         0.7209], device='cuda:0')
tensor(0.3860, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7344,  0.1560,  0.9087,  0.9199,  0.7617,  0.6623,  0.3488,
         0.3885,  0.4605,  0.9815,  0.9972,  0.0848,  0.8576,  0.9617,
         0.8320,  0.0970,  0.0301,  0.8506,  0.0051,  0.4831,  0.2156,
         0.0327,  0.6036,  0.1707,  0.1893,  0.8066,  0.4582,  0.8197,
         0.9234,  0.0700,  0.3169,  0.2727,  0.0164,  0.3086,  0.4204,
         0.1285,  0.8847,  0.1734,  0.0735,  0.5254,  0.0408,  0.9799,
         0.0622,  0.0215,  0.8745,  0.9072,  0.8487,  0.6566,  0.8839,
         0.7233,  0.4056,  0.6371,  0.3583,  0.3358,  0.4333,  0.8515,
         0.4821,  0.0089,  0.4783,  0.4300,  0.0733,  0.9121,  0.0410,
         0.6020,  0.0974,  0.8194,  0.1087,  0.6175,  0.4449,  0.4750,
         0.8044,  0.4625,  0.0766,  0.8379,  0.8628,  0.0581,  0.8364,
         0.2708,  0.0191,  0.6611,  0.8613,  0.3543,  0.4081,  0.7504,
         0.6227,  0.5377,  0.2858,  0.2398,  0.8512,  0.9627,  0.8099,
         0.2606,  0.4467,  0.4079,  0.0899,  0.8907,  0.8587,  0.0545,
         0.9549,  0.8726,  0.0242,  0.2403,  0.7453,  0.7493,  0.8578,
         0.9370,  0.2597,  0.6024,  0.7892,  0.0888,  0.7834,  0.8226,
         0.7425,  0.8847,  0.5811,  0.8157,  0.6724,  0.9979,  0.2099,
         0.1634,  0.1293,  0.2731,  0.8417,  0.9953,  0.0455,  0.1333,
         0.5528,  0.7731,  0.1268,  0.0873,  0.7917,  0.5295,  0.8461,
         0.9764,  0.1612,  0.8778,  0.1664,  0.9931,  0.0728,  0.9790,
         0.8235,  0.9314,  0.7583,  0.4320,  0.0880,  0.8438,  0.6510,
         0.8715,  0.0644,  0.8715,  0.0915,  0.2721,  0.1737,  0.9810,
         0.1362,  0.1223,  0.6260,  0.0305,  0.8280,  0.9973,  0.6213,
         0.9316,  0.0153,  0.1223,  0.0652,  0.1109,  0.1269,  0.0262,
         0.9814,  0.9977,  0.5992,  0.0896,  0.4383,  0.9519,  0.0427,
         0.2558,  0.8356,  0.1843,  0.7509,  0.0876,  0.9018,  0.3412,
         0.9950,  0.0194,  0.1410,  0.8958,  0.0143,  0.7637,  0.8945,
         0.9517,  0.1044,  0.4105,  0.7172,  0.1295,  0.0053,  0.4618,
         0.9781,  0.1262,  0.6888,  0.0186,  0.1563,  0.8632,  0.0645,
         0.0787,  0.9665,  0.2928,  0.9196,  0.0249,  0.6411,  0.9555,
         0.9831,  0.2705,  0.3056,  0.0434,  0.8671,  0.3965,  0.1857,
         0.1873,  0.1431,  0.9686,  0.8941,  0.7817,  0.1140,  0.0616,
         0.0491,  0.2274,  0.0060,  0.5073,  0.2665,  0.5782,  0.2904,
         0.7915,  0.9405,  0.8279,  0.7192,  0.1900,  0.8176,  0.5776,
         0.9015,  0.8644,  0.5337,  0.1368,  0.6708,  0.0471,  0.4311,
         0.7435,  0.9965,  0.8032,  0.7606,  0.8422,  0.4224,  0.6852,
         0.2480,  0.0723,  0.2591,  0.9705,  0.1956,  0.8450,  0.6519,
         0.9591,  0.0435,  0.4927,  0.6498,  0.8636,  0.9792,  0.4465,
         0.9896,  0.6759,  0.1342,  0.0241,  0.5819,  0.8465,  0.2613,
         0.3735,  0.8260,  0.9566,  0.0789,  0.9231,  0.1239,  0.7777,
         0.9491,  0.0734,  0.9795,  0.9968,  0.9927,  0.8647,  0.1194,
         0.8483,  0.1341,  0.9665,  0.8481,  0.8678,  0.2084,  0.1111,
         0.7463,  0.1125,  0.1683,  0.1173,  0.7425,  0.7293,  0.1219,
         0.0354,  0.0517,  0.9956,  0.5117,  0.5018,  0.0303,  0.5304,
         0.9322,  0.3518,  0.7639,  0.8299,  0.2508,  0.0948,  0.7313,
         0.2423,  0.8991,  0.8672,  0.3490,  0.5071,  0.1916,  0.0402,
         0.5859,  0.2819,  0.2196,  0.1619,  0.0555,  0.2804,  0.7343,
         0.4400,  0.3282,  0.0284,  0.6608,  0.3889,  0.4023,  0.6461,
         0.9294,  0.6356,  0.1430,  0.5457,  0.9862,  0.2251,  0.0135,
         0.0225,  0.0374,  0.0738,  0.1446,  0.7566,  0.0163,  0.8446,
         0.6752,  0.5469,  0.8934,  0.9407,  0.9750,  0.6156,  0.9390,
         0.0250,  0.5598,  0.8986,  0.8904,  0.3457,  0.4123,  0.0158,
         0.1246,  0.6206,  0.4557,  0.6568,  0.5024,  0.0164,  0.0099,
         0.0234,  0.5806,  0.1286,  0.2150,  0.0358,  0.2187,  0.8454,
         0.9111,  0.0772,  0.4373,  0.8616,  0.8295,  0.7973,  0.5792,
         0.1311,  0.0163,  0.9355,  0.2576,  0.3613,  0.3718,  0.0408,
         0.7706,  0.2307,  0.8317,  0.8183,  0.1122,  0.9483,  0.6865,
         0.9783,  0.7468,  0.9121,  0.9704,  0.8697,  0.6431,  0.8426,
         0.0718,  0.7426,  0.0155,  0.4394,  0.7758,  0.4325,  0.5801,
         0.2055,  0.9639,  0.3966,  0.0129,  0.1827,  0.3768,  0.5946,
         0.8000,  0.4059,  0.2346,  0.0884,  0.7838,  0.0522,  0.7109,
         0.0151,  0.9735,  0.5739,  0.8795,  0.0383,  0.0324,  0.7974,
         0.4453,  0.9030,  0.5516,  0.9723,  0.7905,  0.8461,  0.0172,
         0.0389,  0.8445,  0.1208,  0.8765,  0.9773,  0.4964,  0.7648,
         0.4866,  0.7161,  0.1207,  0.2446,  0.8559,  0.2468,  0.7006,
         0.8760,  0.0626,  0.1213,  0.6449,  0.2547,  0.2711,  0.0729,
         0.0693,  0.9361,  0.8163,  0.1611,  0.8946,  0.7962,  0.7032,
         0.7883,  0.0323,  0.6170,  0.8249,  0.5206,  0.9231,  0.4742,
         0.5807,  0.2582,  0.2131,  0.8848,  0.9043,  0.4650,  0.2755,
         0.9100,  0.9077,  0.5495,  0.9720,  0.9327,  0.0784,  0.9204,
         0.9621,  0.7980,  0.8520,  0.9448,  0.5759,  0.9754,  0.2079,
         0.0035,  0.4747,  0.7292,  0.0621,  0.9002,  0.0907,  0.0524,
         0.9960,  0.0218,  0.2101,  0.7638,  0.9040,  0.4015,  0.9272,
         0.6945], device='cuda:0')
tensor(0.3730, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2825,  0.8394,  0.1949,  0.8598,  0.4713,  0.8703,  0.8177,
         0.2868,  0.0346,  0.8992,  0.5919,  0.1165,  0.7773,  0.1027,
         0.0378,  0.0880,  0.9901,  0.9324,  0.9816,  0.7303,  0.9241,
         0.8832,  0.7419,  0.5502,  0.0277,  0.9355,  0.0403,  0.5938,
         0.0443,  0.1144,  0.0149,  0.9529,  0.7336,  0.1923,  0.9398,
         0.0007,  0.9015,  0.6291,  0.1882,  0.8536,  0.9135,  0.3505,
         0.6313,  0.2110,  0.9081,  0.8737,  0.0656,  0.9109,  0.0059,
         0.1565,  0.0783,  0.9059,  0.1675,  0.3894,  0.1532,  0.1779,
         0.0656,  0.0752,  0.1445,  0.6727,  0.4862,  0.9476,  0.0616,
         0.0142,  0.9531,  0.4025,  0.9474,  0.8017,  0.9568,  0.0282,
         0.9817,  0.8971,  0.0293,  0.1482,  0.0076,  0.2203,  0.9531,
         0.8858,  0.0513,  0.9170,  0.1739,  0.6304,  0.0568,  0.1218,
         0.9266,  0.0953,  0.7955,  0.1515,  0.0320,  0.9841,  0.5206,
         0.8647,  0.9349,  0.3650,  0.0396,  0.2240,  0.8565,  0.1306,
         0.0307,  0.2673,  0.9672,  0.3128,  0.0302,  0.1224,  0.3607,
         0.9659,  0.0656,  0.1480,  0.5622,  0.0676,  0.0782,  0.1815,
         0.2629,  0.0056,  0.9524,  0.2216,  0.0180,  0.1785,  0.6373,
         0.8097,  0.9953,  0.1650,  0.9665,  0.7201,  0.0438,  0.0179,
         0.7592,  0.0459,  0.0209,  0.9604,  0.0256,  0.9323,  0.7774,
         0.2714,  0.8479,  0.9883,  0.8373,  0.7290,  0.8941,  0.8356,
         0.2611,  0.9657,  0.0057,  0.1336,  0.8308,  0.7408,  0.8355,
         0.9392,  0.6742,  0.4264,  0.0378,  0.9061,  0.8746,  0.0088,
         0.2769,  0.0217,  0.1189,  0.0262,  0.9157,  0.5748,  0.9111,
         0.8340,  0.8268,  0.9993,  0.0586,  0.7717,  0.0353,  0.6009,
         0.4194,  0.4430,  0.5748,  0.0991,  0.2986,  0.5800,  0.9518,
         0.7114,  0.2570,  0.9348,  0.4648,  0.0922,  0.0060,  0.9441,
         0.0405,  0.8271,  0.0101,  0.1223,  0.4335,  0.9282,  0.4387,
         0.5615,  0.0925,  0.9454,  0.9743,  0.6190,  0.0374,  0.8943,
         0.0394,  0.9967,  0.3430,  0.1124,  0.0907,  0.3217,  0.8282,
         0.9278,  0.9216,  0.2092,  0.0245,  0.9664,  0.7084,  0.9017,
         0.4015,  0.8583,  0.0646,  0.4042,  0.0941,  0.0430,  0.0134,
         0.0788,  0.1281,  0.5944,  0.0327,  0.9473,  0.7330,  0.1390,
         0.7993,  0.8988,  0.7898,  0.8162,  0.0250,  0.3333,  0.0192,
         0.0390,  0.8457,  0.8981,  0.2398,  0.0983,  0.9340,  0.0121,
         0.1950,  0.7595,  0.5364,  0.0965,  0.0259,  0.0968,  0.0471,
         0.0440,  0.6484,  0.1998,  0.0065,  0.0730,  0.8819,  0.8440,
         0.6050,  0.1854,  0.8589,  0.1258,  0.8795,  0.9735,  0.1682,
         0.0070,  0.0393,  0.8315,  0.1272,  0.1434,  0.8377,  0.0430,
         0.3336,  0.1499,  0.9463,  0.0806,  0.0504,  0.9512,  0.2167,
         0.6935,  0.9130,  0.9144,  0.0076,  0.0457,  0.1265,  0.0270,
         0.4931,  0.1522,  0.0403,  0.5732,  0.8678,  0.9655,  0.9433,
         0.4227,  0.1489,  0.1708,  0.0809,  0.9180,  0.8380,  0.8476,
         0.1010,  0.9532,  0.1116,  0.1987,  0.9273,  0.4359,  0.6021,
         0.7567,  0.0255,  0.2858,  0.9321,  0.9453,  0.8589,  0.1745,
         0.0638,  0.7804,  0.1687,  0.5280,  0.0632,  0.3720,  0.1106,
         0.9535,  0.9791,  0.9806,  0.1677,  0.9607,  0.0023,  0.0438,
         0.9261,  0.0428,  0.0029,  0.1092,  0.3525,  0.2356,  0.1164,
         0.6222,  0.0480,  0.2306,  0.0127,  0.1742,  0.9633,  0.0186,
         0.6910,  0.0257,  0.9853,  0.3708,  0.0457,  0.0072,  0.8970,
         0.0697,  0.0690,  0.8806,  0.5813,  0.9107,  0.0226,  0.8055,
         0.0416,  0.3785,  0.0486,  0.4612,  0.1507,  0.9580,  0.0513,
         0.7705,  0.1848,  0.0686,  0.5787,  0.0816,  0.0675,  0.1820,
         0.1092,  0.5566,  0.7840,  0.0208,  0.0479,  0.9602,  0.7875,
         0.0428,  0.3287,  0.8385,  0.8205,  0.8837,  0.0215,  0.5859,
         0.0341,  0.8675,  0.8452,  0.1268,  0.0408,  0.9353,  0.6696,
         0.0047,  0.4758,  0.0230,  0.0980,  0.0110,  0.4563,  0.9428,
         0.7694,  0.2843,  0.0422,  0.2803,  0.9990,  0.9346,  0.9751,
         0.7745,  0.9413,  0.2234,  0.0228,  0.0078,  0.8668,  0.7219,
         0.5867,  0.4347,  0.9540,  0.8930,  0.0983,  0.0200,  0.0227,
         0.0782,  0.0463,  0.0114,  0.0039,  0.1119,  0.0145,  0.9591,
         0.9937,  0.8998,  0.0351,  0.1808,  0.9566,  0.7919,  0.8903,
         0.9938,  0.8721,  0.0960,  0.4586,  0.0123,  0.7995,  0.0423,
         0.0410,  0.0991,  0.1101,  0.7619,  0.0123,  0.0385,  0.1581,
         0.8107,  0.0062,  0.0655,  0.0288,  0.5502,  0.0703,  0.8264,
         0.8913,  0.8690,  0.1318,  0.4949,  0.9409,  0.0789,  0.0645,
         0.9028,  0.0695,  0.1667,  0.8629,  0.4863,  0.0086,  0.9679,
         0.8226,  0.0220,  0.9158,  0.4813,  0.8594,  0.0072,  0.0180,
         0.0752,  0.2297,  0.9993,  0.1227,  0.8636,  0.0044,  0.0296,
         0.1269,  0.0231,  0.9216,  0.9198,  0.3159,  0.8302,  0.0718,
         0.0689,  0.0388,  0.6382,  0.8174,  0.0227,  0.8986,  0.6430,
         0.1005,  0.9741,  0.0259,  0.6052,  0.0353,  0.1118,  0.9068,
         0.0660,  0.0939,  0.9488,  0.0673,  0.8449,  0.9299,  0.1848,
         0.7926,  0.0834,  0.4795,  0.9938,  0.2791,  0.0128,  0.2860,
         0.7933], device='cuda:0')
tensor(0.3611, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8570,  0.7364,  0.1149,  0.0721,  0.9613,  0.9746,  0.3143,
         0.9587,  0.8097,  0.9876,  0.0249,  0.7681,  0.8788,  0.0458,
         0.4190,  0.9383,  0.0817,  0.0191,  0.0057,  0.0956,  0.9459,
         0.0660,  0.9605,  0.9283,  0.0398,  0.9938,  0.8941,  0.0434,
         0.3626,  0.9434,  0.0676,  0.9937,  0.0342,  0.0849,  0.9467,
         0.8162,  0.0190,  0.9227,  0.8325,  0.4892,  0.9988,  0.0139,
         0.0348,  0.1478,  0.9990,  0.7165,  0.7784,  0.0337,  0.0720,
         0.9382,  0.9929,  0.4132,  0.9240,  0.1370,  0.0340,  0.9307,
         0.9072,  0.0422,  0.9472,  0.0632,  0.0708,  0.4905,  0.3050,
         0.4226,  0.9488,  0.0197,  0.5809,  0.9383,  0.9864,  0.1023,
         0.9521,  0.9763,  0.1015,  0.9768,  0.0086,  0.9643,  0.9034,
         0.8706,  0.0313,  0.9902,  0.1412,  0.0080,  0.5607,  0.1583,
         0.0948,  0.5460,  0.0538,  0.0052,  0.3624,  0.7405,  0.9898,
         0.7440,  0.2436,  0.7137,  0.0163,  0.9910,  0.6250,  0.9776,
         0.8521,  0.0310,  0.9981,  0.9080,  0.7821,  0.0027,  0.9295,
         0.1213,  0.0023,  0.0382,  0.3798,  0.8819,  0.0231,  0.0089,
         0.9818,  0.0789,  0.0566,  0.0421,  0.8593,  0.9788,  0.0765,
         0.1733,  0.0612,  0.7118,  0.4618,  0.9193,  0.7899,  0.9228,
         0.9868,  0.0499,  0.6644,  0.0263,  0.8834,  0.0993,  0.0447,
         0.7587,  0.3595,  0.5099,  0.0577,  0.0394,  0.0465,  0.1757,
         0.6597,  0.9595,  0.1092,  0.0680,  0.6795,  0.9908,  0.1913,
         0.9875,  0.6771,  0.0447,  0.0369,  0.2070,  0.0506,  0.0317,
         0.9647,  0.9895,  0.9251,  0.0098,  0.9844,  0.0069,  0.6283,
         0.8843,  0.9171,  0.0066,  0.9462,  0.9053,  0.0163,  0.0438,
         0.0028,  0.9726,  0.9148,  0.9443,  0.1943,  0.1890,  0.9527,
         0.3881,  0.9679,  0.1572,  0.9992,  0.8218,  0.9574,  0.9767,
         0.9817,  0.2897,  0.9643,  0.0025,  0.9948,  0.9808,  0.9032,
         0.5136,  0.0613,  0.7288,  0.1162,  0.0675,  0.3847,  0.0376,
         0.8966,  0.8332,  0.3857,  0.8899,  0.0112,  0.1163,  0.7284,
         0.6831,  0.0675,  0.9040,  0.0196,  0.7076,  0.1421,  0.1302,
         0.9860,  0.2222,  0.0350,  0.8377,  0.0090,  0.0482,  0.4444,
         0.9689,  0.0756,  0.0070,  0.0242,  0.8676,  0.9391,  0.9473,
         0.9053,  0.5984,  0.0175,  0.9653,  0.9631,  0.3219,  0.0495,
         0.9980,  0.9731,  0.9627,  0.9667,  0.0549,  0.9674,  0.1509,
         0.9893,  0.2190,  0.0372,  0.0137,  0.0323,  0.9917,  0.8641,
         0.0096,  0.4586,  0.6956,  0.8518,  0.1373,  0.6764,  0.0845,
         0.9689,  0.8596,  0.8940,  0.0063,  0.0129,  0.9584,  0.0415,
         0.3100,  0.0151,  0.9807,  0.1296,  0.9143,  0.8563,  0.9254,
         0.9703,  0.8316,  0.7848,  0.0219,  0.7144,  0.3089,  0.0110,
         0.0137,  0.8433,  0.2156,  0.3989,  0.0818,  0.9549,  0.9162,
         0.0828,  0.0418,  0.0083,  0.9183,  0.0389,  0.9969,  0.5852,
         0.0951,  0.8145,  0.0403,  0.0212,  0.9757,  0.8638,  0.0861,
         0.7520,  0.0280,  0.9892,  0.2762,  0.9090,  0.9230,  0.0427,
         0.0689,  0.0391,  0.8215,  0.9270,  0.6159,  0.8829,  0.0168,
         0.0230,  0.0904,  0.9552,  0.7732,  0.2448,  0.3748,  0.9756,
         0.0253,  0.9939,  0.9604,  0.3766,  0.9324,  0.6961,  0.1246,
         0.0146,  0.0257,  0.7635,  0.7688,  0.0178,  0.0211,  0.0067,
         0.9206,  0.7621,  0.6925,  0.3585,  0.3326,  0.9304,  0.0096,
         0.1019,  0.8587,  0.3536,  0.6826,  0.9685,  0.9212,  0.0359,
         0.9009,  0.9663,  0.0085,  0.2363,  0.9670,  0.0788,  0.0035,
         0.5678,  0.8768,  0.2298,  0.6716,  0.7298,  0.7606,  0.7630,
         0.1267,  0.5384,  0.4523,  0.8897,  0.9743,  0.0416,  0.0273,
         0.0276,  0.0445,  0.7488,  0.9168,  0.9133,  0.0516,  0.0506,
         0.8137,  0.0206,  0.0051,  0.2230,  0.8760,  0.0301,  0.1650,
         0.9365,  0.0319,  0.9319,  0.9729,  0.0515,  0.1098,  0.7793,
         0.0054,  0.4267,  0.8486,  0.0650,  0.9693,  0.9454,  0.9242,
         0.9402,  0.9584,  0.8857,  0.6546,  0.1372,  0.9217,  0.1765,
         0.7433,  0.0597,  0.0166,  0.1233,  0.9175,  0.0870,  0.9250,
         0.9556,  0.2876,  0.2466,  0.0513,  0.9888,  0.5211,  0.0781,
         0.0064,  0.6935,  0.0596,  0.9555,  0.0119,  0.2607,  0.0131,
         0.8133,  0.0574,  0.8153,  0.0088,  0.9991,  0.9913,  0.9784,
         0.6274,  0.9753,  0.9781,  0.9350,  0.9508,  0.0591,  0.8967,
         0.1009,  0.1277,  0.9936,  0.5184,  0.9413,  0.8298,  0.0099,
         0.4298,  0.8244,  0.0033,  0.3291,  0.9675,  0.9723,  0.0175,
         0.9023,  0.5683,  0.7489,  0.9756,  0.0019,  0.9490,  0.0039,
         0.9736,  0.1517,  0.9249,  0.5029,  0.0068,  0.8514,  0.8874,
         0.0141,  0.0569,  0.8015,  0.8548,  0.0552,  0.0433,  0.1173,
         0.0820,  0.9624,  0.8941,  0.0509,  0.3035,  0.0210,  0.9410,
         0.0404,  0.8031,  0.9624,  0.0313,  0.8722,  0.9303,  0.7121,
         0.6509,  0.6577,  0.0463,  0.4602,  0.4865,  0.9269,  0.1476,
         0.9222,  0.0171,  0.9713,  0.3590,  0.7151,  0.6433,  0.9309,
         0.7593,  0.2333,  0.9081,  0.1160,  0.9637,  0.6420,  0.3784,
         0.0284,  0.0184,  0.0217,  0.6664,  0.0166,  0.7823,  0.0862,
         0.0558], device='cuda:0')
tensor(0.3929, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9263,  0.0454,  0.9487,  0.9569,  0.8097,  0.7342,  0.0413,
         0.5636,  0.0923,  0.0232,  0.1475,  0.8591,  0.9291,  0.0608,
         0.3029,  0.0300,  0.0531,  0.0229,  0.9669,  0.9930,  0.7999,
         0.9863,  0.0088,  0.0343,  0.1297,  0.9711,  0.7507,  0.9381,
         0.8821,  0.1375,  0.8123,  0.0927,  0.0303,  0.0311,  0.8103,
         0.1954,  0.9949,  0.6234,  0.0203,  0.8802,  0.4803,  0.8793,
         0.9795,  0.0267,  0.2679,  0.9031,  0.0660,  0.8838,  0.0557,
         0.0533,  0.0189,  0.8160,  0.8950,  0.7074,  0.1049,  0.7870,
         0.1144,  0.0496,  0.2890,  0.0769,  0.9783,  0.5704,  0.7941,
         0.0544,  0.6601,  0.0370,  0.9420,  0.0799,  0.0880,  0.8847,
         0.0847,  0.1654,  0.0974,  0.0420,  0.7227,  0.4185,  0.0278,
         0.5991,  0.5461,  0.2686,  0.1670,  0.1247,  0.7658,  0.9294,
         0.0542,  0.9011,  0.0392,  0.9360,  0.2277,  0.7022,  0.0080,
         0.3193,  0.1734,  0.0484,  0.1114,  0.9241,  0.0606,  0.9675,
         0.2020,  0.0389,  0.4130,  0.3116,  0.8049,  0.0115,  0.9542,
         0.4754,  0.3144,  0.1223,  0.1760,  0.0377,  0.0973,  0.9401,
         0.0609,  0.8236,  0.7515,  0.8019,  0.1727,  0.1307,  0.6530,
         0.0996,  0.9910,  0.6764,  0.7965,  0.9899,  0.3760,  0.0929,
         0.0433,  0.0608,  0.4458,  0.0506,  0.6445,  0.1545,  0.8948,
         0.0747,  0.7706,  0.9736,  0.7033,  0.0223,  0.0376,  0.8877,
         0.3032,  0.3248,  0.0199,  0.0349,  0.9100,  0.7090,  0.0344,
         0.0434,  0.0353,  0.4480,  0.1700,  0.0918,  0.9897,  0.4250,
         0.0109,  0.0923,  0.5504,  0.0889,  0.8854,  0.9865,  0.0169,
         0.0805,  0.0938,  0.0207,  0.0391,  0.9375,  0.0216,  0.9277,
         0.2058,  0.9221,  0.0469,  0.9719,  0.3884,  0.5363,  0.4388,
         0.0927,  0.2830,  0.3630,  0.9985,  0.8217,  0.0605,  0.0133,
         0.9389,  0.3034,  0.9610,  0.2492,  0.9608,  0.8860,  0.9194,
         0.0129,  0.9207,  0.4118,  0.4499,  0.7455,  0.7715,  0.6668,
         0.0360,  0.5553,  0.0461,  0.5230,  0.9782,  0.1325,  0.4631,
         0.7400,  0.5785,  0.3430,  0.2369,  0.0131,  0.9197,  0.9711,
         0.8941,  0.9942,  0.8347,  0.0884,  0.8487,  0.0882,  0.8057,
         0.1247,  0.0042,  0.0322,  0.1833,  0.9694,  0.1120,  0.1784,
         0.9469,  0.0359,  0.2106,  0.0529,  0.8188,  0.9928,  0.5951,
         0.0944,  0.1218,  0.0144,  0.2760,  0.6135,  0.1023,  0.9709,
         0.1386,  0.0827,  0.9548,  0.5160,  0.1207,  0.8793,  0.3090,
         0.0512,  0.0089,  0.9626,  0.9022,  0.7386,  0.7627,  0.3703,
         0.0226,  0.0422,  0.1442,  0.8669,  0.3191,  0.0110,  0.9416,
         0.3118,  0.6105,  0.8339,  0.4859,  0.1548,  0.0204,  0.8844,
         0.6969,  0.3312,  0.0649,  0.8834,  0.4443,  0.9635,  0.9774,
         0.1155,  0.7566,  0.8574,  0.6328,  0.3674,  0.0076,  0.9849,
         0.6620,  0.0440,  0.4756,  0.9144,  0.0318,  0.6903,  0.9112,
         0.0159,  0.8142,  0.0551,  0.5902,  0.9029,  0.2109,  0.9566,
         0.8695,  0.0196,  0.0651,  0.4426,  0.9907,  0.0297,  0.8402,
         0.1211,  0.0399,  0.0515,  0.0887,  0.6655,  0.2297,  0.6491,
         0.0364,  0.7737,  0.0352,  0.6694,  0.6246,  0.3219,  0.0574,
         0.8001,  0.7913,  0.0785,  0.0948,  0.5399,  0.8402,  0.7247,
         0.1638,  0.8801,  0.0239,  0.3019,  0.3396,  0.0609,  0.0625,
         0.1251,  0.8414,  0.0400,  0.9482,  0.3890,  0.5887,  0.9802,
         0.0112,  0.0220,  0.8503,  0.4214,  0.0642,  0.0584,  0.9147,
         0.6500,  0.7365,  0.1991,  0.1407,  0.3369,  0.0067,  0.0152,
         0.4119,  0.7142,  0.0466,  0.0577,  0.1394,  0.9862,  0.0902,
         0.9957,  0.2258,  0.5910,  0.6772,  0.0245,  0.9315,  0.0852,
         0.3463,  0.4112,  0.5722,  0.7896,  0.0307,  0.9065,  0.9348,
         0.9185,  0.0713,  0.2718,  0.0127,  0.9073,  0.0392,  0.9600,
         0.9225,  0.7156,  0.0528,  0.0248,  0.0860,  0.0133,  0.7991,
         0.9590,  0.2771,  0.0227,  0.2131,  0.5474,  0.1797,  0.9713,
         0.2837,  0.6411,  0.8189,  0.5812,  0.0585,  0.0142,  0.7974,
         0.0047,  0.4210,  0.9648,  0.9315,  0.9917,  0.0971,  0.0627,
         0.2813,  0.3663,  0.3084,  0.1939,  0.6642,  0.9714,  0.0460,
         0.9291,  0.7714,  0.8539,  0.0569,  0.3467,  0.9517,  0.2848,
         0.0137,  0.4778,  0.0164,  0.4914,  0.3243,  0.8571,  0.1018,
         0.6970,  0.9810,  0.8994,  0.1141,  0.4269,  0.0717,  0.1410,
         0.0488,  0.3702,  0.0477,  0.5122,  0.0900,  0.0789,  0.4020,
         0.6403,  0.0824,  0.4631,  0.8243,  0.9619,  0.0347,  0.3363,
         0.0811,  0.9991,  0.2139,  0.3076,  0.1816,  0.0634,  0.1037,
         0.1253,  0.7963,  0.7827,  0.0345,  0.0963,  0.0050,  0.4861,
         0.9505,  0.1232,  0.9777,  0.9777,  0.8716,  0.9830,  0.1029,
         0.8325,  0.0474,  0.0756,  0.4704,  0.9661,  0.0472,  0.7482,
         0.9434,  0.9616,  0.0911,  0.0205,  0.9569,  0.9926,  0.9094,
         0.1138,  0.3903,  0.0687,  0.9007,  0.8344,  0.4484,  0.9917,
         0.0047,  0.9727,  0.0039,  0.0148,  0.1076,  0.9843,  0.8691,
         0.2159,  0.0458,  0.9165,  0.7996,  0.2307,  0.8316,  0.0912,
         0.2051,  0.3436,  0.9221,  0.9912,  0.0358,  0.3140,  0.3345,
         0.2532], device='cuda:0')
tensor(0.4385, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3649,  0.0697,  0.2281,  0.7149,  0.7091,  0.2069,  0.8945,
         0.0168,  0.8314,  0.9468,  0.8581,  0.4556,  0.1607,  0.5991,
         0.4804,  0.1013,  0.5009,  0.3827,  0.9526,  0.5168,  0.8828,
         0.0574,  0.4252,  0.0485,  0.0028,  0.7662,  0.1856,  0.8202,
         0.1194,  0.0534,  0.1415,  0.5542,  0.9326,  0.8546,  0.7822,
         0.0759,  0.7642,  0.6588,  0.4295,  0.4908,  0.7624,  0.9983,
         0.8531,  0.6049,  0.2059,  0.7329,  0.6836,  0.6622,  0.0838,
         0.7864,  0.2454,  0.0821,  0.0782,  0.0901,  0.3479,  0.5590,
         0.9422,  0.4202,  0.6926,  0.9626,  0.2545,  0.2623,  0.1013,
         0.9151,  0.8331,  0.9452,  0.9309,  0.6916,  0.9900,  0.9129,
         0.0570,  0.1422,  0.0581,  0.5143,  0.0809,  0.4929,  0.6334,
         0.0353,  0.5375,  0.1574,  0.0139,  0.1539,  0.9366,  0.0140,
         0.8949,  0.8420,  0.2455,  0.8236,  0.9491,  0.8735,  0.8590,
         0.3981,  0.3132,  0.4957,  0.0750,  0.6660,  0.4296,  0.9592,
         0.9229,  0.1321,  0.1882,  0.4775,  0.9711,  0.0263,  0.6531,
         0.9285,  0.1479,  0.0768,  0.8395,  0.0362,  0.9815,  0.4804,
         0.3394,  0.0534,  0.7502,  0.1734,  0.4903,  0.1114,  0.2358,
         0.2645,  0.9581,  0.0050,  0.8377,  0.0645,  0.0763,  0.2936,
         0.9367,  0.5067,  0.9199,  0.2634,  0.6043,  0.8585,  0.6374,
         0.2097,  0.8599,  0.1874,  0.7223,  0.9052,  0.0786,  0.9381,
         0.1812,  0.2174,  0.8268,  0.8613,  0.0734,  0.3965,  0.8236,
         0.1473,  0.4792,  0.5599,  0.7396,  0.1452,  0.1212,  0.9945,
         0.1206,  0.8540,  0.9891,  0.6768,  0.3048,  0.0546,  0.1018,
         0.7707,  0.4164,  0.5561,  0.7112,  0.0675,  0.4693,  0.3014,
         0.9237,  0.6282,  0.6753,  0.7898,  0.8478,  0.5659,  0.2081,
         0.4584,  0.6153,  0.1105,  0.0920,  0.8817,  0.5194,  0.3568,
         0.4087,  0.1999,  0.9255,  0.8814,  0.9152,  0.5471,  0.3930,
         0.9783,  0.0224,  0.6958,  0.7823,  0.0689,  0.8945,  0.9777,
         0.6605,  0.1501,  0.6812,  0.2550,  0.6734,  0.9719,  0.2567,
         0.0792,  0.0515,  0.7840,  0.1327,  0.1704,  0.7090,  0.9704,
         0.9753,  0.2600,  0.7470,  0.8255,  0.8321,  0.8511,  0.1746,
         0.9379,  0.5664,  0.1297,  0.2033,  0.0156,  0.4224,  0.1138,
         0.1966,  0.7672,  0.2827,  0.9228,  0.3424,  0.8841,  0.9307,
         0.8753,  0.0350,  0.8227,  0.0529,  0.9499,  0.4833,  0.8839,
         0.8533,  0.2996,  0.8233,  0.2081,  0.0271,  0.8563,  0.3088,
         0.9250,  0.2466,  0.6870,  0.8943,  0.8536,  0.1887,  0.5248,
         0.1336,  0.6459,  0.9471,  0.7718,  0.2759,  0.9184,  0.9291,
         0.1197,  0.5749,  0.9000,  0.1756,  0.0186,  0.7265,  0.5747,
         0.7909,  0.8068,  0.9041,  0.2627,  0.9416,  0.2714,  0.1467,
         0.1762,  0.5125,  0.2190,  0.8521,  0.2525,  0.2369,  0.9626,
         0.6943,  0.8331,  0.5593,  0.9526,  0.0145,  0.3196,  0.8064,
         0.6946,  0.9823,  0.7047,  0.4441,  0.1307,  0.8741,  0.0792,
         0.7610,  0.1557,  0.9777,  0.0337,  0.1800,  0.5819,  0.7972,
         0.9719,  0.9167,  0.7639,  0.9143,  0.3030,  0.1326,  0.2649,
         0.7985,  0.6652,  0.1532,  0.3492,  0.3439,  0.8822,  0.0131,
         0.9766,  0.1464,  0.9616,  0.5262,  0.1341,  0.0523,  0.8157,
         0.5998,  0.3567,  0.6417,  0.6905,  0.1909,  0.0501,  0.5641,
         0.4375,  0.9866,  0.1961,  0.9969,  0.9940,  0.7733,  0.9975,
         0.9437,  0.8924,  0.1181,  0.9421,  0.9899,  0.9047,  0.8139,
         0.7619,  0.7347,  0.0228,  0.9298,  0.2819,  0.4138,  0.9041,
         0.6473,  0.3225,  0.7105,  0.9829,  0.7794,  0.7305,  0.7172,
         0.5523,  0.1027,  0.9819,  0.2637,  0.2032,  0.1270,  0.9187,
         0.7987,  0.0387,  0.3466,  0.9692,  0.9889,  0.8706,  0.7530,
         0.9252,  0.6138,  0.7192,  0.5791,  0.2272,  0.3909,  0.8555,
         0.3970,  0.0187,  0.2799,  0.7959,  0.6024,  0.0268,  0.9089,
         0.0254,  0.2872,  0.9509,  0.5439,  0.7171,  0.2558,  0.7418,
         0.1211,  0.2129,  0.4332,  0.4154,  0.2200,  0.0306,  0.9176,
         0.6447,  0.4619,  0.9394,  0.4160,  0.3021,  0.6418,  0.9708,
         0.0765,  0.5410,  0.9211,  0.3200,  0.0272,  0.0935,  0.8670,
         0.8402,  0.8053,  0.2614,  0.1205,  0.9556,  0.2630,  0.0589,
         0.1776,  0.0431,  0.9153,  0.8539,  0.9450,  0.8922,  0.0072,
         0.0574,  0.7030,  0.1475,  0.2623,  0.1683,  0.0157,  0.0489,
         0.8665,  0.4949,  0.9330,  0.7761,  0.3219,  0.1252,  0.3225,
         0.0253,  0.5827,  0.0730,  0.2256,  0.8458,  0.9723,  0.4977,
         0.9038,  0.8327,  0.0332,  0.0626,  0.7894,  0.1543,  0.1492,
         0.1141,  0.5747,  0.9694,  0.9327,  0.0227,  0.9287,  0.8273,
         0.0491,  0.5873,  0.9892,  0.4138,  0.9867,  0.8692,  0.9082,
         0.0129,  0.9216,  0.6159,  0.8889,  0.8926,  0.8577,  0.9012,
         0.0107,  0.9790,  0.0348,  0.7901,  0.8597,  0.7831,  0.1586,
         0.5381,  0.9306,  0.3989,  0.9539,  0.9815,  0.5377,  0.7100,
         0.0168,  0.9046,  0.6916,  0.3005,  0.9340,  0.1523,  0.1211,
         0.4063,  0.9697,  0.2200,  0.6483,  0.3808,  0.0516,  0.2536,
         0.1259,  0.5319,  0.0465,  0.0349,  0.6899,  0.4815,  0.4108,
         0.9662], device='cuda:0')
tensor(0.3377, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1060,  0.9509,  0.7391,  0.1130,  0.9385,  0.1120,  0.1641,
         0.1041,  0.9930,  0.2205,  0.6388,  0.2679,  0.3419,  0.9400,
         0.7167,  0.2213,  0.9349,  0.9472,  0.3893,  0.3418,  0.6295,
         0.4729,  0.3840,  0.7960,  0.0762,  0.0853,  0.6860,  0.3847,
         0.4410,  0.8899,  0.7530,  0.8787,  0.9592,  0.7427,  0.0690,
         0.4014,  0.5341,  0.3444,  0.2366,  0.8468,  0.2551,  0.3837,
         0.5818,  0.1224,  0.9585,  0.1811,  0.7547,  0.2193,  0.9609,
         0.3849,  0.9766,  0.6314,  0.7444,  0.2266,  0.6210,  0.0653,
         0.9586,  0.3573,  0.9184,  0.8015,  0.9491,  0.8860,  0.8030,
         0.9088,  0.9525,  0.9583,  0.4540,  0.6891,  0.9005,  0.9223,
         0.0318,  0.9523,  0.8387,  0.6297,  0.8991,  0.3689,  0.0771,
         0.1860,  0.2578,  0.9093,  0.5098,  0.1936,  0.9177,  0.4957,
         0.2593,  0.8662,  0.8642,  0.2507,  0.9378,  0.9210,  0.1276,
         0.6371,  0.2959,  0.7012,  0.3528,  0.8300,  0.3348,  0.7197,
         0.7064,  0.8416,  0.9314,  0.9700,  0.9489,  0.8943,  0.9684,
         0.9398,  0.9321,  0.4604,  0.9468,  0.0742,  0.8314,  0.0892,
         0.2166,  0.8672,  0.6024,  0.2617,  0.7827,  0.5018,  0.2149,
         0.2474,  0.9759,  0.9421,  0.8912,  0.5272,  0.9548,  0.5492,
         0.7871,  0.0777,  0.8870,  0.1993,  0.6546,  0.2016,  0.3141,
         0.1752,  0.9261,  0.8850,  0.1587,  0.9370,  0.3047,  0.7730,
         0.5072,  0.8905,  0.3370,  0.7093,  0.7216,  0.4071,  0.7849,
         0.9381,  0.2534,  0.6201,  0.5392,  0.8998,  0.1898,  0.7959,
         0.8553,  0.3153,  0.2956,  0.0734,  0.9349,  0.8266,  0.0192,
         0.1283,  0.4067,  0.8053,  0.1265,  0.0879,  0.8981,  0.4390,
         0.9975,  0.8591,  0.3995,  0.2811,  0.8506,  0.1409,  0.6927,
         0.9970,  0.7696,  0.9452,  0.6993,  0.5776,  0.3266,  0.8910,
         0.9223,  0.8628,  0.7654,  0.6277,  0.0581,  0.2745,  0.0949,
         0.8673,  0.8904,  0.0970,  0.5671,  0.9575,  0.0773,  0.7539,
         0.3969,  0.3983,  0.1317,  0.8360,  0.5564,  0.8762,  0.2092,
         0.9858,  0.8693,  0.0408,  0.9651,  0.3551,  0.9697,  0.2472,
         0.5640,  0.6642,  0.4900,  0.4643,  0.1303,  0.6148,  0.9067,
         0.5380,  0.5776,  0.9006,  0.6192,  0.9315,  0.8989,  0.8566,
         0.1569,  0.9600,  0.8859,  0.2421,  0.2480,  0.8718,  0.9922,
         0.9320,  0.1225,  0.9068,  0.8545,  0.8841,  0.7851,  0.3580,
         0.8048,  0.8758,  0.9385,  0.9160,  0.9014,  0.9981,  0.1368,
         0.0909,  0.3839,  0.9961,  0.9060,  0.9960,  0.8300,  0.6114,
         0.3035,  0.7578,  0.7595,  0.9579,  0.8879,  0.6008,  0.9279,
         0.9384,  0.9640,  0.4967,  0.4189,  0.5364,  0.9674,  0.2331,
         0.2059,  0.9689,  0.8578,  0.9686,  0.8127,  0.8796,  0.3763,
         0.8422,  0.8738,  0.9401,  0.9136,  0.4880,  0.8204,  0.6187,
         0.2776,  0.7478,  0.9939,  0.8616,  0.2225,  0.8470,  0.9639,
         0.9715,  0.8779,  0.9079,  0.3500,  0.4175,  0.1789,  0.2408,
         0.9754,  0.9550,  0.2382,  0.5435,  0.8118,  0.7299,  0.3158,
         0.0927,  0.9508,  0.0734,  0.0728,  0.8689,  0.4228,  0.9888,
         0.1848,  0.8525,  0.6305,  0.5696,  0.1019,  0.2182,  0.3241,
         0.1411,  0.4857,  0.8206,  0.7203,  0.8633,  0.6549,  0.8349,
         0.7752,  0.7580,  0.4287,  0.3811,  0.1471,  0.0153,  0.5678,
         0.2388,  0.6439,  0.8691,  0.3319,  0.5493,  0.9013,  0.5327,
         0.3820,  0.4344,  0.0693,  0.0567,  0.7203,  0.4894,  0.2088,
         0.5650,  0.8228,  0.9652,  0.2577,  0.1886,  0.5974,  0.8820,
         0.3280,  0.0722,  0.3108,  0.2922,  0.3298,  0.7142,  0.4047,
         0.9638,  0.2191,  0.2315,  0.5792,  0.9343,  0.8442,  0.6657,
         0.8824,  0.3159,  0.1272,  0.6300,  0.3084,  0.8613,  0.4828,
         0.0677,  0.2324,  0.1000,  0.9688,  0.7934,  0.3934,  0.9417,
         0.8105,  0.2714,  0.3608,  0.0102,  0.0940,  0.5007,  0.1470,
         0.2341,  0.8138,  0.4447,  0.4184,  0.2257,  0.5529,  0.5005,
         0.2702,  0.7077,  0.8951,  0.3546,  0.2285,  0.1810,  0.0884,
         0.9441,  0.8462,  0.5634,  0.9762,  0.2463,  0.0822,  0.8186,
         0.8619,  0.5702,  0.8295,  0.1992,  0.3190,  0.6681,  0.8828,
         0.3009,  0.3265,  0.4753,  0.2971,  0.9661,  0.2907,  0.9813,
         0.8972,  0.9474,  0.2117,  0.9524,  0.9335,  0.4659,  0.9507,
         0.8237,  0.1528,  0.3304,  0.2443,  0.3185,  0.1499,  0.9236,
         0.8647,  0.7962,  0.5045,  0.9013,  0.5333,  0.9329,  0.2918,
         0.7807,  0.4067,  0.9100,  0.6977,  0.9511,  0.0678,  0.9506,
         0.7523,  0.2794,  0.7830,  0.6862,  0.9617,  0.1867,  0.1608,
         0.2306,  0.9353,  0.8622,  0.0740,  0.9570,  0.2860,  0.2410,
         0.4544,  0.0155,  0.9512,  0.0702,  0.9565,  0.7122,  0.8989,
         0.1568,  0.5726,  0.5913,  0.8855,  0.7777,  0.9956,  0.1530,
         0.2609,  0.2569,  0.4109,  0.9948,  0.1546,  0.4407,  0.9088,
         0.5620,  0.5153,  0.6744,  0.5318,  0.0353,  0.0171,  0.9940,
         0.1126,  0.0199,  0.4380,  0.5819,  0.9767,  0.9248,  0.8122,
         0.3176,  0.6697,  0.2383,  0.9238,  0.9419,  0.5606,  0.8360,
         0.7885,  0.7994,  0.8009,  0.5400,  0.9942,  0.0985,  0.8116,
         0.9950], device='cuda:0')
tensor(0.4074, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3230,  0.8682,  0.9530,  0.3429,  0.1714,  0.9019,  0.9872,
         0.5499,  0.9539,  0.6752,  0.8701,  0.2957,  0.2465,  0.6232,
         0.1975,  0.1339,  0.9577,  0.9642,  0.2806,  0.6322,  0.2185,
         0.9942,  0.9975,  0.4612,  0.1883,  0.0988,  0.2512,  0.6637,
         0.8126,  0.9455,  0.2286,  0.3375,  0.3750,  0.9383,  0.7489,
         0.4154,  0.3915,  0.2321,  0.5758,  0.8386,  0.5605,  0.4639,
         0.1617,  0.4355,  0.3142,  0.9215,  0.7641,  0.9890,  0.9579,
         0.1429,  0.5695,  0.3938,  0.8046,  0.1077,  0.2311,  0.3007,
         0.4744,  0.6095,  0.8834,  0.2878,  0.1917,  0.5805,  0.1005,
         0.7900,  0.9803,  0.9398,  0.8232,  0.4473,  0.1211,  0.0686,
         0.7629,  0.8853,  0.1482,  0.2359,  0.8822,  0.0909,  0.5254,
         0.4232,  0.2773,  0.8379,  0.9031,  0.4477,  0.8763,  0.7898,
         0.0696,  0.9662,  0.0329,  0.8841,  0.1274,  0.7470,  0.9058,
         0.9969,  0.3280,  0.5879,  0.0840,  0.5352,  0.6024,  0.7197,
         0.8988,  0.1454,  0.0109,  0.8643,  0.8873,  0.5864,  0.3725,
         0.1829,  0.5741,  0.2417,  0.6622,  0.3768,  0.9194,  0.2991,
         0.1157,  0.4517,  0.4367,  0.1704,  0.8143,  0.3275,  0.6296,
         0.5889,  0.2457,  0.2441,  0.9802,  0.8491,  0.5724,  0.4725,
         0.8214,  0.0833,  0.6897,  0.8216,  0.4401,  0.4460,  0.3072,
         0.0863,  0.4094,  0.2758,  0.7761,  0.9034,  0.2658,  0.1405,
         0.7218,  0.8900,  0.3355,  0.3016,  0.5128,  0.4017,  0.7989,
         0.5018,  0.1423,  0.5901,  0.9475,  0.4821,  0.3938,  0.7877,
         0.0931,  0.6768,  0.0236,  0.7517,  0.5915,  0.9279,  0.2403,
         0.7205,  0.4162,  0.9775,  0.1375,  0.0509,  0.4923,  0.6412,
         0.5237,  0.9929,  0.7534,  0.7019,  0.9263,  0.3818,  0.7116,
         0.0300,  0.5009,  0.5390,  0.2805,  0.7072,  0.0622,  0.6070,
         0.9986,  0.6084,  0.5544,  0.8883,  0.7933,  0.6088,  0.7660,
         0.6661,  0.6755,  0.3824,  0.4820,  0.9087,  0.6536,  0.9958,
         0.2557,  0.3337,  0.4583,  0.8389,  0.9641,  0.2503,  0.9875,
         0.0969,  0.2181,  0.8153,  0.1029,  0.5370,  0.4082,  0.2706,
         0.3848,  0.8173,  0.0948,  0.9385,  0.9321,  0.3425,  0.7897,
         0.4908,  0.1698,  0.8221,  0.8732,  0.5156,  0.8391,  0.9225,
         0.9673,  0.1768,  0.8566,  0.9396,  0.9426,  0.8396,  0.8509,
         0.1135,  0.1887,  0.0572,  0.1368,  0.4741,  0.1049,  0.1196,
         0.8422,  0.2677,  0.2834,  0.2946,  0.9442,  0.0266,  0.6999,
         0.4914,  0.9838,  0.2113,  0.6783,  0.9180,  0.3081,  0.9410,
         0.3803,  0.8385,  0.9803,  0.7224,  0.9132,  0.1296,  0.4844,
         0.9260,  0.8186,  0.5038,  0.3567,  0.3857,  0.8079,  0.1893,
         0.7553,  0.8258,  0.9608,  0.8026,  0.8866,  0.2981,  0.3372,
         0.9649,  0.7072,  0.0296,  0.2026,  0.3048,  0.7389,  0.4013,
         0.0455,  0.6889,  0.7170,  0.5672,  0.9166,  0.6349,  0.5046,
         0.0381,  0.7065,  0.2075,  0.1745,  0.4138,  0.1137,  0.9279,
         0.2388,  0.4089,  0.9778,  0.9225,  0.8982,  0.9106,  0.5577,
         0.5715,  0.2354,  0.7874,  0.9420,  0.9462,  0.9669,  0.6885,
         0.8439,  0.0350,  0.6220,  0.7348,  0.9745,  0.5423,  0.9380,
         0.3448,  0.6944,  0.2850,  0.2625,  0.5794,  0.9064,  0.3114,
         0.7501,  0.3121,  0.6127,  0.0626,  0.5310,  0.2315,  0.8016,
         0.9133,  0.4228,  0.6598,  0.8760,  0.2964,  0.1983,  0.1030,
         0.5118,  0.0308,  0.8347,  0.7896,  0.9904,  0.2032,  0.7250,
         0.9660,  0.4655,  0.9074,  0.8551,  0.4832,  0.6524,  0.3750,
         0.9079,  0.5192,  0.9164,  0.9502,  0.0687,  0.7381,  0.7979,
         0.4755,  0.8008,  0.3085,  0.4607,  0.5759,  0.7607,  0.0509,
         0.1703,  0.3530,  0.5058,  0.5531,  0.7365,  0.5103,  0.3359,
         0.4095,  0.2983,  0.4006,  0.8593,  0.9245,  0.8144,  0.0688,
         0.6694,  0.9987,  0.3894,  0.1426,  0.4621,  0.3138,  0.9812,
         0.4156,  0.8512,  0.4739,  0.4807,  0.4002,  0.9022,  0.8979,
         0.3797,  0.7012,  0.4162,  0.8630,  0.2734,  0.4335,  0.8066,
         0.9681,  0.8168,  0.5407,  0.4229,  0.1087,  0.4735,  0.0599,
         0.9547,  0.6993,  0.9419,  0.7165,  0.3867,  0.3680,  0.7339,
         0.1604,  0.8659,  0.9497,  0.4554,  0.6872,  0.9556,  0.1298,
         0.6527,  0.4483,  0.9858,  0.0811,  0.6796,  0.1342,  0.4053,
         0.0939,  0.8348,  0.3258,  0.8879,  0.4599,  0.2418,  0.1499,
         0.5548,  0.5036,  0.3760,  0.9415,  0.5916,  0.3487,  0.8784,
         0.9652,  0.0310,  0.8922,  0.4623,  0.9750,  0.9459,  0.5656,
         0.1027,  0.8952,  0.3973,  0.4994,  0.1466,  0.8448,  0.9097,
         0.7774,  0.7737,  0.8166,  0.1827,  0.0755,  0.8300,  0.4368,
         0.6327,  0.3015,  0.3349,  0.2362,  0.1004,  0.6534,  0.8637,
         0.1210,  0.2919,  0.5483,  0.9318,  0.9797,  0.0978,  0.3884,
         0.0355,  0.9869,  0.4560,  0.7233,  0.4388,  0.1418,  0.1100,
         0.1774,  0.2759,  0.1752,  0.1861,  0.3323,  0.4541,  0.5401,
         0.9833,  0.9988,  0.5688,  0.1846,  0.6316,  0.0518,  0.0244,
         0.0249,  0.2086,  0.7931,  0.2583,  0.6628,  0.4712,  0.0200,
         0.2169,  0.6876,  0.7370,  0.6746,  0.6702,  0.8623,  0.7982,
         0.1173], device='cuda:0')
tensor(0.4023, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8091,  0.7730,  0.8879,  0.6449,  0.2711,  0.5515,  0.0347,
         0.2316,  0.1562,  0.9935,  0.8699,  0.3041,  0.8559,  0.0449,
         0.3952,  0.8918,  0.7486,  0.9250,  0.9361,  0.4081,  0.9001,
         0.4566,  0.8905,  0.0513,  0.5684,  0.8388,  0.9499,  0.6123,
         0.2151,  0.6983,  0.9774,  0.7411,  0.5458,  0.6169,  0.9128,
         0.5733,  0.4509,  0.2519,  0.6219,  0.6287,  0.7032,  0.1756,
         0.0241,  0.8339,  0.1181,  0.4638,  0.4663,  0.9044,  0.9832,
         0.0096,  0.6825,  0.2096,  0.7040,  0.9839,  0.1709,  0.0895,
         0.3328,  0.7920,  0.2162,  0.1333,  0.2066,  0.8331,  0.3382,
         0.6203,  0.3701,  0.9838,  0.9816,  0.9166,  0.0910,  0.9548,
         0.2311,  0.0118,  0.9010,  0.9515,  0.9303,  0.9145,  0.4771,
         0.2364,  0.3826,  0.1372,  0.9583,  0.9447,  0.2037,  0.1706,
         0.3404,  0.7254,  0.0407,  0.9484,  0.5975,  0.9145,  0.7978,
         0.8210,  0.3916,  0.8181,  0.7184,  0.1336,  0.4596,  0.9540,
         0.9008,  0.3967,  0.9474,  0.0423,  0.1723,  0.9395,  0.5086,
         0.9836,  0.5288,  0.1479,  0.7326,  0.4701,  0.8542,  0.1840,
         0.2121,  0.3832,  0.4718,  0.2146,  0.6654,  0.2552,  0.8970,
         0.4258,  0.7546,  0.9768,  0.0718,  0.3947,  0.0716,  0.3522,
         0.8391,  0.4041,  0.6242,  0.7857,  0.8906,  0.8483,  0.6493,
         0.8279,  0.9248,  0.9076,  0.7255,  0.1345,  0.5814,  0.9078,
         0.6318,  0.0775,  0.0761,  0.8994,  0.4324,  0.6788,  0.2277,
         0.7354,  0.7060,  0.2878,  0.2051,  0.3658,  0.8195,  0.3176,
         0.1235,  0.7857,  0.8272,  0.4464,  0.8267,  0.7373,  0.2199,
         0.7304,  0.9985,  0.9645,  0.0775,  0.4278,  0.3131,  0.0076,
         0.5342,  0.9352,  0.5048,  0.8706,  0.1858,  0.2506,  0.5054,
         0.0160,  0.4154,  0.2913,  0.2843,  0.2135,  0.8835,  0.0774,
         0.0885,  0.5251,  0.5968,  0.8978,  0.8631,  0.2387,  0.9320,
         0.5269,  0.9608,  0.6049,  0.9413,  0.9807,  0.0766,  0.8299,
         0.1701,  0.3910,  0.1156,  0.2937,  0.1135,  0.5618,  0.9416,
         0.1168,  0.8423,  0.9156,  0.9671,  0.6061,  0.0153,  0.9303,
         0.8659,  0.8722,  0.4123,  0.9150,  0.7652,  0.7133,  0.8699,
         0.4877,  0.7699,  0.3111,  0.1002,  0.9579,  0.8679,  0.9220,
         0.2474,  0.5871,  0.9653,  0.5624,  0.0176,  0.4835,  0.4575,
         0.3049,  0.4366,  0.5571,  0.8419,  0.6479,  0.4765,  0.9876,
         0.2552,  0.6168,  0.7639,  0.7971,  0.9067,  0.6628,  0.9088,
         0.8514,  0.8964,  0.5605,  0.4262,  0.9177,  0.8916,  0.1205,
         0.8335,  0.9781,  0.4103,  0.2063,  0.0812,  0.8551,  0.8672,
         0.6077,  0.9180,  0.4922,  0.2856,  0.7736,  0.0935,  0.3517,
         0.0826,  0.8332,  0.8680,  0.9065,  0.9593,  0.3793,  0.9858,
         0.9359,  0.2721,  0.1102,  0.9145,  0.7905,  0.8657,  0.9787,
         0.4397,  0.9945,  0.2277,  0.7849,  0.8484,  0.8222,  0.5556,
         0.1782,  0.9944,  0.5999,  0.4487,  0.1639,  0.4756,  0.1067,
         0.9297,  0.7229,  0.9937,  0.6463,  0.0188,  0.8238,  0.4199,
         0.6737,  0.9344,  0.1920,  0.0745,  0.6159,  0.9861,  0.9635,
         0.5061,  0.6199,  0.8468,  0.9235,  0.8902,  0.2909,  0.9847,
         0.3906,  0.5870,  0.4251,  0.2927,  0.9566,  0.5365,  0.9700,
         0.4375,  0.4026,  0.2063,  0.5573,  0.1324,  0.9194,  0.9301,
         0.9533,  0.9034,  0.2239,  0.8195,  0.1243,  0.1293,  0.4233,
         0.1231,  0.1796,  0.2484,  0.1643,  0.7675,  0.7067,  0.1546,
         0.6119,  0.9642,  0.2151,  0.2265,  0.1947,  0.2524,  0.9936,
         0.3540,  0.7453,  0.4627,  0.9942,  0.8122,  0.4257,  0.8448,
         0.2469,  0.3392,  0.3936,  0.2475,  0.6327,  0.2225,  0.4494,
         0.0280,  0.6933,  0.4506,  0.9720,  0.3140,  0.2991,  0.2790,
         0.5477,  0.2232,  0.4831,  0.8962,  0.8723,  0.9085,  0.2050,
         0.3331,  0.6328,  0.9218,  0.7787,  0.2251,  0.9671,  0.6338,
         0.9539,  0.3624,  0.1260,  0.6264,  0.1823,  0.5870,  0.8587,
         0.6639,  0.5257,  0.7978,  0.4972,  0.0845,  0.3666,  0.8860,
         0.2634,  0.6296,  0.6536,  0.4979,  0.9131,  0.1225,  0.5224,
         0.9577,  0.0980,  0.2317,  0.7366,  0.2589,  0.6297,  0.8527,
         0.9977,  0.8590,  0.6770,  0.4036,  0.5786,  0.1070,  0.1158,
         0.9613,  0.3055,  0.1560,  0.6763,  0.6831,  0.9337,  0.2241,
         0.7472,  0.3626,  0.1635,  0.6745,  0.1555,  0.9106,  0.2008,
         0.1791,  0.9262,  0.9980,  0.0504,  0.9483,  0.3862,  0.8758,
         0.9541,  0.0691,  0.7793,  0.4156,  0.1576,  0.8007,  0.9403,
         0.7403,  0.2213,  0.7494,  0.3121,  0.2923,  0.6508,  0.6949,
         0.7062,  0.4239,  0.9650,  0.7408,  0.2801,  0.0885,  0.9065,
         0.4049,  0.6682,  0.1352,  0.5344,  0.9254,  0.7965,  0.0559,
         0.8361,  0.2880,  0.8686,  0.8347,  0.5426,  0.6056,  0.7530,
         0.9758,  0.1035,  0.7378,  0.8357,  0.6878,  0.7152,  0.9541,
         0.9397,  0.9736,  0.7976,  0.4226,  0.4371,  0.7799,  0.2874,
         0.9287,  0.2744,  0.7595,  0.3232,  0.6129,  0.9993,  0.9893,
         0.9189,  0.5616,  0.1577,  0.1005,  0.4957,  0.9484,  0.3932,
         0.6178,  0.6651,  0.6489,  0.9151,  0.7716,  0.9070,  0.5636,
         0.6536], device='cuda:0')
tensor(0.4543, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1484,  0.9511,  0.2059,  0.6908,  0.4158,  0.1727,  0.9444,
         0.0458,  0.9066,  0.1626,  0.3497,  0.9396,  0.0809,  0.1500,
         0.8496,  0.7952,  0.5711,  0.9703,  0.7912,  0.9464,  0.4206,
         0.1788,  0.1259,  0.9421,  0.5440,  0.9686,  0.4667,  0.4583,
         0.0564,  0.1351,  0.1244,  0.1407,  0.0932,  0.2539,  0.4125,
         0.0412,  0.0845,  0.1599,  0.4352,  0.0276,  0.9862,  0.0769,
         0.2978,  0.2582,  0.8748,  0.9266,  0.2551,  0.9484,  0.4327,
         0.2284,  0.1238,  0.8660,  0.3472,  0.5750,  0.1642,  0.1197,
         0.4413,  0.5093,  0.7217,  0.9885,  0.1176,  0.1257,  0.6351,
         0.3939,  0.2347,  0.1671,  0.9574,  0.9344,  0.9669,  0.3016,
         0.9642,  0.0437,  0.5643,  0.0728,  0.4794,  0.4037,  0.9269,
         0.0604,  0.5584,  0.1172,  0.3425,  0.9484,  0.0266,  0.9451,
         0.8704,  0.3044,  0.9650,  0.7451,  0.9870,  0.9089,  0.0945,
         0.6181,  0.0231,  0.0148,  0.8689,  0.2241,  0.7442,  0.1151,
         0.6936,  0.9168,  0.0104,  0.2161,  0.3534,  0.8621,  0.1339,
         0.6801,  0.0928,  0.2187,  0.1687,  0.3080,  0.9030,  0.3931,
         0.5721,  0.4903,  0.6155,  0.8471,  0.2256,  0.8352,  0.5894,
         0.6301,  0.2107,  0.0504,  0.7018,  0.1113,  0.6692,  0.0965,
         0.2706,  0.4507,  0.5598,  0.8096,  0.1503,  0.8120,  0.5547,
         0.9319,  0.1677,  0.9291,  0.2149,  0.1637,  0.8704,  0.0298,
         0.5303,  0.2819,  0.4127,  0.5419,  0.9700,  0.2631,  0.0438,
         0.2374,  0.2680,  0.9844,  0.4144,  0.9634,  0.4826,  0.2260,
         0.6756,  0.2011,  0.7845,  0.1809,  0.2274,  0.0892,  0.9298,
         0.3733,  0.8516,  0.4912,  0.2181,  0.7994,  0.6741,  0.3922,
         0.4684,  0.9866,  0.2134,  0.4226,  0.5087,  0.1812,  0.1054,
         0.9755,  0.8129,  0.2501,  0.8986,  0.1760,  0.7722,  0.8081,
         0.1709,  0.3922,  0.7925,  0.2986,  0.0620,  0.6185,  0.7957,
         0.9900,  0.9823,  0.1265,  0.0046,  0.4658,  0.1280,  0.6874,
         0.9401,  0.0431,  0.2044,  0.5307,  0.2738,  0.2082,  0.8941,
         0.4062,  0.9956,  0.5701,  0.9953,  0.0868,  0.0592,  0.3532,
         0.7623,  0.0301,  0.9225,  0.8201,  0.8682,  0.5304,  0.0197,
         0.9965,  0.8979,  0.5098,  0.2090,  0.1576,  0.1344,  0.1441,
         0.2540,  0.9903,  0.6865,  0.7791,  0.9450,  0.9978,  0.2379,
         0.0327,  0.5583,  0.1185,  0.8166,  0.6227,  0.9697,  0.0541,
         0.4342,  0.8959,  0.2590,  0.3930,  0.5695,  0.5867,  0.1796,
         0.0591,  0.1469,  0.6301,  0.1884,  0.1560,  0.5712,  0.5776,
         0.0887,  0.2467,  0.9588,  0.1190,  0.7576,  0.0132,  0.9834,
         0.9681,  0.8995,  0.4101,  0.5019,  0.9306,  0.3167,  0.8131,
         0.1138,  0.2447,  0.3832,  0.1117,  0.8776,  0.2570,  0.0677,
         0.7956,  0.4772,  0.1584,  0.5200,  0.0821,  0.3198,  0.9450,
         0.5451,  0.1849,  0.9544,  0.5305,  0.7328,  0.6699,  0.4682,
         0.9872,  0.1476,  0.7134,  0.5436,  0.9616,  0.3324,  0.3133,
         0.1898,  0.0624,  0.2888,  0.9715,  0.3908,  0.3427,  0.5962,
         0.3033,  0.9500,  0.3469,  0.1888,  0.0542,  0.2160,  0.2356,
         0.0631,  0.9292,  0.4598,  0.7835,  0.9622,  0.1186,  0.4552,
         0.1438,  0.7811,  0.7042,  0.0739,  0.2645,  0.9188,  0.1511,
         0.9046,  0.8841,  0.2673,  0.9305,  0.8943,  0.9624,  0.5876,
         0.7063,  0.9975,  0.8246,  0.8125,  0.9964,  0.7833,  0.9426,
         0.9205,  0.4409,  0.3117,  0.8345,  0.0494,  0.9950,  0.8369,
         0.3549,  0.1877,  0.4344,  0.9981,  0.9236,  0.9469,  0.0456,
         0.4772,  0.0250,  0.6416,  0.9410,  0.9508,  0.9172,  0.1469,
         0.1129,  0.6077,  0.0923,  0.8644,  0.5926,  0.1957,  0.0442,
         0.1278,  0.4066,  0.4356,  0.9293,  0.3256,  0.7974,  0.3278,
         0.7782,  0.9551,  0.2606,  0.0097,  0.2889,  0.2316,  0.9470,
         0.6547,  0.5881,  0.8793,  0.0696,  0.3108,  0.2039,  0.2030,
         0.9536,  0.2164,  0.3863,  0.8067,  0.2530,  0.1461,  0.3079,
         0.9545,  0.9489,  0.2822,  0.9395,  0.6632,  0.9970,  0.3043,
         0.2293,  0.9421,  0.9408,  0.9456,  0.9128,  0.0928,  0.0580,
         0.8998,  0.2382,  0.6260,  0.2307,  0.7798,  0.1865,  0.1690,
         0.9703,  0.9112,  0.5827,  0.1472,  0.1480,  0.8276,  0.2754,
         0.2169,  0.5741,  0.0305,  0.9130,  0.9972,  0.4292,  0.9566,
         0.9502,  0.9689,  0.0458,  0.9985,  0.9533,  0.9211,  0.1780,
         0.0888,  0.1009,  0.5156,  0.2013,  0.9184,  0.2626,  0.1569,
         0.6397,  0.9498,  0.7061,  0.0856,  0.1210,  0.1821,  0.9886,
         0.3033,  0.7940,  0.0581,  0.1024,  0.1044,  0.8752,  0.4093,
         0.3170,  0.9744,  0.9479,  0.9676,  0.2755,  0.9574,  0.4800,
         0.9422,  0.3126,  0.9924,  0.2450,  0.1263,  0.9184,  0.6790,
         0.2613,  0.5302,  0.3716,  0.7092,  0.6516,  0.2272,  0.8651,
         0.9332,  0.8439,  0.8886,  0.1058,  0.3073,  0.8685,  0.9119,
         0.1934,  0.9402,  0.9229,  0.8956,  0.1409,  0.1028,  0.7992,
         0.7186,  0.2640,  0.4300,  0.3960,  0.9883,  0.0183,  0.8357,
         0.5317,  0.9773,  0.8734,  0.2493,  0.4374,  0.0372,  0.1624,
         0.1058,  0.9345,  0.9024,  0.1077,  0.9903,  0.3386,  0.5130,
         0.6815], device='cuda:0')
tensor(0.3606, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1481,  0.7281,  0.8468,  0.6368,  0.3500,  0.9726,  0.7144,
         0.5447,  0.1665,  0.2141,  0.9040,  0.7491,  0.5028,  0.9356,
         0.5083,  0.9658,  0.9742,  0.0184,  0.1529,  0.5198,  0.0491,
         0.9840,  0.8938,  0.3836,  0.0604,  0.2784,  0.1251,  0.7992,
         0.5931,  0.7184,  0.0708,  0.9034,  0.9640,  0.4882,  0.9420,
         0.9274,  0.7193,  0.1359,  0.0594,  0.0989,  0.0818,  0.4302,
         0.4073,  0.0483,  0.9528,  0.9418,  0.9318,  0.8592,  0.9978,
         0.3832,  0.7692,  0.2358,  0.9268,  0.8928,  0.1540,  0.9094,
         0.7084,  0.7202,  0.9697,  0.1072,  0.9403,  0.1331,  0.0922,
         0.0459,  0.3867,  0.9057,  0.0905,  0.4110,  0.8561,  0.1121,
         0.7930,  0.1270,  0.0637,  0.0502,  0.1230,  0.3048,  0.0528,
         0.5207,  0.4241,  0.1339,  0.9402,  0.2878,  0.8744,  0.0756,
         0.7589,  0.9662,  0.3901,  0.1108,  0.3352,  0.9315,  0.0097,
         0.0096,  0.2191,  0.9515,  0.1499,  0.0722,  0.7847,  0.8205,
         0.6074,  0.1051,  0.3436,  0.9579,  0.9594,  0.0601,  0.6456,
         0.0524,  0.5506,  0.8078,  0.0673,  0.9811,  0.9909,  0.7775,
         0.2282,  0.0777,  0.1183,  0.9391,  0.9208,  0.9973,  0.9447,
         0.0260,  0.2118,  0.4646,  0.5023,  0.2032,  0.9391,  0.0954,
         0.1639,  0.8372,  0.9851,  0.3452,  0.9972,  0.9719,  0.5843,
         0.9745,  0.5931,  0.0085,  0.3220,  0.1172,  0.9841,  0.1083,
         0.0897,  0.1947,  0.3492,  0.1836,  0.8362,  0.0640,  0.1126,
         0.6163,  0.1922,  0.2982,  0.9374,  0.9579,  0.9690,  0.6798,
         0.7041,  0.3696,  0.1825,  0.9592,  0.6400,  0.3619,  0.9995,
         0.9668,  0.0755,  0.1108,  0.2795,  0.1707,  0.9469,  0.8184,
         0.3972,  0.0685,  0.9366,  0.2426,  0.7199,  0.2539,  0.1974,
         0.3000,  0.1674,  0.0058,  0.9699,  0.8725,  0.0323,  0.1213,
         0.7752,  0.2450,  0.4475,  0.9860,  0.2684,  0.9696,  0.1468,
         0.0167,  0.1181,  0.4543,  0.9715,  0.7168,  0.3610,  0.5539,
         0.0418,  0.1995,  0.3563,  0.2727,  0.1897,  0.1603,  0.7591,
         0.0622,  0.5123,  0.7066,  0.2271,  0.7192,  0.2957,  0.2837,
         0.9142,  0.0970,  0.2090,  0.2108,  0.9709,  0.4245,  0.1635,
         0.1064,  0.0647,  0.1247,  0.5361,  0.1579,  0.0889,  0.1486,
         0.3713,  0.0421,  0.8903,  0.1205,  0.3137,  0.5898,  0.9440,
         0.0667,  0.1180,  0.2997,  0.9939,  0.1668,  0.2494,  0.9265,
         0.9523,  0.2369,  0.9334,  0.0597,  0.9439,  0.4399,  0.8139,
         0.0659,  0.1546,  0.1244,  0.2159,  0.2015,  0.2110,  0.9955,
         0.8477,  0.3424,  0.4530,  0.0513,  0.8599,  0.3828,  0.2940,
         0.6665,  0.1840,  0.6719,  0.7081,  0.1622,  0.7380,  0.5902,
         0.3938,  0.9873,  0.4431,  0.3146,  0.1176,  0.1438,  0.0398,
         0.0489,  0.0980,  0.2416,  0.0606,  0.1502,  0.2492,  0.0517,
         0.5958,  0.9718,  0.0493,  0.6179,  0.7244,  0.2826,  0.5004,
         0.9687,  0.1824,  0.2764,  0.2972,  0.9914,  0.2720,  0.9151,
         0.3251,  0.4764,  0.2928,  0.1301,  0.8970,  0.0734,  0.2436,
         0.3535,  0.8967,  0.0285,  0.1268,  0.0609,  0.4643,  0.3052,
         0.2996,  0.0611,  0.5523,  0.4732,  0.8301,  0.1407,  0.7804,
         0.8442,  0.3813,  0.4449,  0.1091,  0.9964,  0.9684,  0.8389,
         0.7779,  0.1485,  0.9479,  0.1585,  0.9440,  0.1439,  0.1414,
         0.9313,  0.1076,  0.9318,  0.9646,  0.0876,  0.6705,  0.0935,
         0.1747,  0.7886,  0.0696,  0.9831,  0.2083,  0.2712,  0.8295,
         0.7103,  0.4293,  0.9766,  0.2013,  0.6528,  0.2314,  0.2541,
         0.9187,  0.2256,  0.1789,  0.9967,  0.7461,  0.4569,  0.3794,
         0.9682,  0.4261,  0.1410,  0.9797,  0.9074,  0.4099,  0.4512,
         0.8773,  0.3821,  0.9219,  0.8892,  0.0105,  0.0300,  0.1297,
         0.1693,  0.7827,  0.7544,  0.7777,  0.9386,  0.9528,  0.8775,
         0.2266,  0.9603,  0.4438,  0.2772,  0.2050,  0.0780,  0.2164,
         0.0223,  0.6665,  0.4713,  0.2163,  0.0786,  0.7430,  0.8535,
         0.1586,  0.6395,  0.9539,  0.9555,  0.9737,  0.8063,  0.2081,
         0.1169,  0.5133,  0.1703,  0.4567,  0.0881,  0.9413,  0.0571,
         0.8663,  0.1133,  0.1886,  0.9519,  0.3159,  0.1160,  0.0922,
         0.8964,  0.0850,  0.0831,  0.1300,  0.0874,  0.9835,  0.1668,
         0.1345,  0.7546,  0.2722,  0.0998,  0.3259,  0.1411,  0.8366,
         0.2143,  0.6753,  0.0904,  0.1632,  0.0663,  0.9364,  0.0894,
         0.9570,  0.9314,  0.0249,  0.1015,  0.8797,  0.1591,  0.1994,
         0.2505,  0.0566,  0.9333,  0.9984,  0.2264,  0.3850,  0.2362,
         0.9569,  0.1074,  0.9872,  0.1384,  0.9474,  0.9712,  0.9542,
         0.9755,  0.8848,  0.2062,  0.9272,  0.9846,  0.1095,  0.9547,
         0.8267,  0.2499,  0.2502,  0.9058,  0.8565,  0.0584,  0.9565,
         0.1167,  0.1486,  0.8740,  0.9909,  0.4012,  0.2016,  0.0304,
         0.2159,  0.9985,  0.9283,  0.0895,  0.7736,  0.2859,  0.9632,
         0.3051,  0.9750,  0.5720,  0.9163,  0.8550,  0.9991,  0.8167,
         0.0792,  0.9675,  0.9635,  0.1101,  0.1546,  0.7487,  0.1413,
         0.0181,  0.3258,  0.1758,  0.1652,  0.1706,  0.1356,  0.8359,
         0.8653,  0.1489,  0.2724,  0.1556,  0.3012,  0.3700,  0.0543,
         0.0967], device='cuda:0')
tensor(0.3710, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2165,  0.1018,  0.1733,  0.8750,  0.1842,  0.0120,  0.0575,
         0.1776,  0.0506,  0.0782,  0.9437,  0.4443,  0.4094,  0.0734,
         0.9955,  0.9224,  0.9855,  0.0394,  0.9922,  0.2084,  0.9644,
         0.1380,  0.9011,  0.8440,  0.2383,  0.2160,  0.9957,  0.4806,
         0.2055,  0.8016,  0.2891,  0.3764,  0.6908,  0.7215,  0.4185,
         0.1979,  0.5355,  0.9859,  0.0673,  0.0333,  0.1738,  0.0946,
         0.9736,  0.5269,  0.6182,  0.1734,  0.4410,  0.1155,  0.8677,
         0.0770,  0.9928,  0.3955,  0.9887,  0.2898,  0.9976,  0.1029,
         0.5146,  0.1265,  0.9992,  0.1394,  0.8805,  0.1330,  0.5441,
         0.1080,  0.9722,  0.9949,  0.3181,  0.8394,  0.1983,  0.1234,
         0.1230,  0.9345,  0.2869,  0.3806,  0.7737,  0.2005,  0.9684,
         0.3849,  0.4539,  0.0821,  0.0151,  0.0571,  0.0541,  0.2268,
         0.1193,  0.4530,  0.9704,  0.1343,  0.4500,  0.2594,  0.1958,
         0.2640,  0.1427,  0.0482,  0.2289,  0.3661,  0.9650,  0.9444,
         0.2774,  0.9763,  0.4694,  0.2621,  0.1687,  0.9993,  0.9399,
         0.3430,  0.6559,  0.3543,  0.9248,  0.0533,  0.8692,  0.3035,
         0.2875,  0.7347,  0.8764,  0.4470,  0.2827,  0.2388,  0.9254,
         0.0676,  0.2292,  0.9873,  0.1849,  0.8997,  0.9694,  0.6997,
         0.9975,  0.0801,  0.9008,  0.9716,  0.9964,  0.2160,  0.1473,
         0.1119,  0.6077,  0.6230,  0.1480,  0.1230,  0.1467,  0.0729,
         0.1611,  0.9885,  0.0989,  0.4447,  0.9885,  0.1182,  0.0359,
         0.5694,  0.5004,  0.0613,  0.1558,  0.6580,  0.2542,  0.9548,
         0.9665,  0.9805,  0.9643,  0.9547,  0.9340,  0.0601,  0.6618,
         0.1170,  0.9432,  0.1144,  0.1098,  0.9585,  0.1804,  0.7241,
         0.9677,  0.9227,  0.9330,  0.0857,  0.7422,  0.3739,  0.9389,
         0.9741,  0.9717,  0.9812,  0.9105,  0.2121,  0.9213,  0.5467,
         0.1265,  0.1300,  0.7821,  0.1063,  0.9061,  0.1984,  0.2503,
         0.1893,  0.3765,  0.1590,  0.9156,  0.0947,  0.9650,  0.9763,
         0.1213,  0.0714,  0.9144,  0.9533,  0.9396,  0.9663,  0.9678,
         0.9504,  0.2278,  0.9790,  0.0687,  0.9695,  0.5679,  0.6650,
         0.4123,  0.0726,  0.3248,  0.9411,  0.8587,  0.1874,  0.2470,
         0.9520,  0.7166,  0.5081,  0.2893,  0.0817,  0.9437,  0.5807,
         0.4538,  0.0946,  0.0289,  0.1017,  0.8797,  0.0195,  0.9744,
         0.1325,  0.0105,  0.6034,  0.2138,  0.8038,  0.5636,  0.1469,
         0.8626,  0.1123,  0.3012,  0.9619,  0.9450,  0.9957,  0.9540,
         0.8975,  0.9698,  0.8933,  0.2293,  0.9429,  0.9984,  0.0780,
         0.9891,  0.9863,  0.9190,  0.0461,  0.9855,  0.1451,  0.0835,
         0.3961,  0.0280,  0.9198,  0.9953,  0.0870,  0.9730,  0.7573,
         0.9813,  0.9869,  0.8521,  0.8285,  0.1753,  0.4497,  0.9898,
         0.9825,  0.1876,  0.2033,  0.9104,  0.9804,  0.1787,  0.9745,
         0.4511,  0.1373,  0.8236,  0.9776,  0.9953,  0.1587,  0.9924,
         0.9959,  0.1257,  0.1921,  0.9649,  0.9786,  0.3594,  0.8180,
         0.9963,  0.9640,  0.9836,  0.9803,  0.1273,  0.8506,  0.9818,
         0.8885,  0.6273,  0.8440,  0.0956,  0.9891,  0.9915,  0.5166,
         0.0413,  0.0881,  0.5341,  0.0651,  0.8821,  0.9816,  0.9745,
         0.5911,  0.8410,  0.9716,  0.3069,  0.4334,  0.8925,  0.1053,
         0.6231,  0.4504,  0.9909,  0.8376,  0.3579,  0.2570,  0.2007,
         0.9762,  0.9228,  0.1261,  0.0981,  0.3056,  0.9702,  0.5814,
         0.0799,  0.0748,  0.9983,  0.9672,  0.8523,  0.2372,  0.0612,
         0.0392,  0.9925,  0.7017,  0.0362,  0.1360,  0.1233,  0.7613,
         0.9632,  0.2499,  0.7249,  0.4782,  0.1447,  0.3661,  0.9848,
         0.1907,  0.0192,  0.1058,  0.2603,  0.4108,  0.5051,  0.0789,
         0.0761,  0.0039,  0.2369,  0.1658,  0.1314,  0.9878,  0.9259,
         0.1482,  0.9882,  0.1453,  0.7347,  0.1872,  0.9991,  0.2131,
         0.0207,  0.1063,  0.1426,  0.8392,  0.9568,  0.7847,  0.9392,
         0.9701,  0.4160,  0.0548,  0.9439,  0.9639,  0.0050,  0.6700,
         0.9854,  0.9840,  0.3224,  0.5254,  0.9921,  0.3215,  0.6915,
         0.6733,  0.9850,  0.9992,  0.6610,  0.9339,  0.9860,  0.1453,
         0.9591,  0.9409,  0.9440,  0.1815,  0.2279,  0.3557,  0.9670,
         0.3582,  0.1989,  0.1452,  0.9440,  0.1858,  0.5097,  0.9721,
         0.0393,  0.8806,  0.4261,  0.9607,  0.0716,  0.7577,  0.8306,
         0.0386,  0.1988,  0.5450,  0.0217,  0.9447,  0.1604,  0.9975,
         0.1302,  0.9503,  0.3561,  0.8522,  0.9578,  0.9145,  0.2097,
         0.9952,  0.2358,  0.1527,  0.9699,  0.8205,  0.4243,  0.4261,
         0.1378,  0.9905,  0.1588,  0.1773,  0.8739,  0.1144,  0.0998,
         0.8588,  0.7458,  0.9855,  0.1609,  0.0189,  0.5084,  0.1511,
         0.0919,  0.0323,  0.1476,  0.0599,  0.7217,  0.9326,  0.0633,
         0.3784,  0.2128,  0.1172,  0.9147,  0.5122,  0.1909,  0.7955,
         0.9936,  0.0792,  0.0135,  0.0939,  0.8621,  0.6920,  0.1063,
         0.9904,  0.7648,  0.3563,  0.9223,  0.9897,  0.0723,  0.0798,
         0.1787,  0.1584,  0.6500,  0.1508,  0.6033,  0.9833,  0.3246,
         0.6179,  0.0964,  0.0156,  0.4372,  0.0843,  0.3890,  0.9885,
         0.9863,  0.9151,  0.4563,  0.9759,  0.1982,  0.1451,  0.0769,
         0.9425], device='cuda:0')
tensor(0.4109, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2368,  0.0941,  0.2745,  0.0756,  0.0800,  0.0638,  0.0048,
         0.1347,  0.8646,  0.1721,  0.2746,  0.9912,  0.0534,  0.9725,
         0.1051,  0.2126,  0.9469,  0.0616,  0.9985,  0.7770,  0.1495,
         0.9891,  0.3034,  0.0291,  0.0268,  0.5424,  0.0649,  0.8898,
         0.2359,  0.9644,  0.1422,  0.2370,  0.7857,  0.9647,  0.1020,
         0.1531,  0.0596,  0.1572,  0.9170,  0.9002,  0.9460,  0.9414,
         0.7037,  0.0102,  0.0727,  0.7573,  0.9284,  0.8638,  0.9713,
         0.9568,  0.2917,  0.9955,  0.6792,  0.0809,  0.9554,  0.9313,
         0.7579,  0.9114,  0.8634,  0.9923,  0.1025,  0.3792,  0.8995,
         0.1425,  0.9101,  0.8171,  0.0174,  0.3974,  0.9932,  0.1621,
         0.4299,  0.9599,  0.9391,  0.9676,  0.9291,  0.8034,  0.5335,
         0.1512,  0.7852,  0.9757,  0.9910,  0.1169,  0.1149,  0.9626,
         0.2013,  0.0606,  0.0121,  0.1189,  0.1994,  0.0728,  0.5027,
         0.0864,  0.9928,  0.1587,  0.1669,  0.2029,  0.6458,  0.1113,
         0.2065,  0.1508,  0.6092,  0.9854,  0.2633,  0.2335,  0.0504,
         0.7573,  0.0437,  0.1252,  0.4661,  0.9443,  0.7695,  0.9776,
         0.9686,  0.0453,  0.9408,  0.9583,  0.9829,  0.1359,  0.1091,
         0.9428,  0.0964,  0.2616,  0.2911,  0.9923,  0.7766,  0.9774,
         0.9860,  0.4418,  0.8952,  0.1572,  0.7054,  0.9944,  0.9919,
         0.2131,  0.8465,  0.1935,  0.0727,  0.0701,  0.9440,  0.4907,
         0.9851,  0.4809,  0.0944,  0.9659,  0.4307,  0.9474,  0.1006,
         0.1056,  0.1292,  0.9053,  0.8799,  0.8812,  0.0741,  0.9852,
         0.3946,  0.9991,  0.0038,  0.1305,  0.0655,  0.8626,  0.9805,
         0.8376,  0.9004,  0.9041,  0.1318,  0.1428,  0.1107,  0.9305,
         0.0654,  0.0748,  0.8389,  0.9870,  0.1648,  0.1232,  0.2608,
         0.1511,  0.0821,  0.9572,  0.2033,  0.0275,  0.9260,  0.8397,
         0.0713,  0.1593,  0.1842,  0.7748,  0.1484,  0.9265,  0.9566,
         0.0553,  0.9752,  0.3090,  0.7146,  0.0327,  0.3765,  0.0396,
         0.9671,  0.9202,  0.0842,  0.0799,  0.9262,  0.2091,  0.6173,
         0.2267,  0.7491,  0.0162,  0.0543,  0.4917,  0.9598,  0.8179,
         0.7377,  0.0417,  0.8393,  0.2269,  0.1561,  0.2977,  0.9500,
         0.0176,  0.8317,  0.1427,  0.9851,  0.0554,  0.0815,  0.8508,
         0.7593,  0.9183,  0.3997,  0.6225,  0.9708,  0.2276,  0.1910,
         0.1426,  0.6303,  0.5125,  0.7389,  0.2194,  0.9076,  0.1780,
         0.0369,  0.2823,  0.9743,  0.0716,  0.0954,  0.9573,  0.3442,
         0.9551,  0.9956,  0.8207,  0.1038,  0.2060,  0.0159,  0.9680,
         0.0970,  0.1414,  0.1507,  0.2957,  0.3288,  0.8794,  0.9542,
         0.0883,  0.0872,  0.1866,  0.1891,  0.2148,  0.5678,  0.9536,
         0.9196,  0.1501,  0.6977,  0.5789,  0.0317,  0.1840,  0.3941,
         0.2936,  0.1612,  0.9825,  0.9436,  0.9549,  0.1426,  0.0734,
         0.9267,  0.4529,  0.9502,  0.9688,  0.3801,  0.0237,  0.4810,
         0.1082,  0.3316,  0.8812,  0.9729,  0.7703,  0.1698,  0.7906,
         0.9872,  0.1063,  0.5401,  0.0935,  0.0942,  0.9700,  0.9270,
         0.9237,  0.9834,  0.2488,  0.9926,  0.2683,  0.1111,  0.9889,
         0.0179,  0.0883,  0.8893,  0.5176,  0.0067,  0.9813,  0.0152,
         0.4298,  0.6164,  0.1463,  0.9562,  0.1635,  0.1760,  0.8712,
         0.7247,  0.9303,  0.1505,  0.0138,  0.1397,  0.3134,  0.0495,
         0.7280,  0.1648,  0.0598,  0.9873,  0.9262,  0.7533,  0.9539,
         0.1682,  0.2442,  0.0315,  0.2028,  0.7812,  0.2518,  0.1458,
         0.8966,  0.7935,  0.0847,  0.7372,  0.3115,  0.1613,  0.9690,
         0.1772,  0.9398,  0.9830,  0.9435,  0.9799,  0.2772,  0.3305,
         0.9403,  0.2131,  0.3932,  0.9516,  0.8987,  0.9390,  0.0085,
         0.9682,  0.5216,  0.0588,  0.9694,  0.2039,  0.1846,  0.9551,
         0.8705,  0.9846,  0.9398,  0.9571,  0.9006,  0.4327,  0.3659,
         0.6867,  0.6795,  0.0638,  0.1929,  0.9976,  0.9972,  0.0298,
         0.2095,  0.9665,  0.9807,  0.2670,  0.9745,  0.9010,  0.9225,
         0.4941,  0.0808,  0.3587,  0.2655,  0.0752,  0.1818,  0.9545,
         0.9561,  0.2425,  0.0948,  0.9641,  0.4487,  0.8189,  0.6731,
         0.0857,  0.0768,  0.9904,  0.1564,  0.9653,  0.9818,  0.1957,
         0.2773,  0.1576,  0.9974,  0.2221,  0.9748,  0.9618,  0.1915,
         0.9926,  0.0289,  0.0605,  0.9842,  0.0283,  0.9882,  0.9818,
         0.2591,  0.0590,  0.9819,  0.6061,  0.1065,  0.4991,  0.2905,
         0.0731,  0.1054,  0.1191,  0.1681,  0.9427,  0.1807,  0.9592,
         0.0395,  0.9530,  0.0981,  0.9742,  0.9658,  0.9056,  0.1404,
         0.1191,  0.2506,  0.1851,  0.9841,  0.9711,  0.1678,  0.9587,
         0.9147,  0.1535,  0.9563,  0.1281,  0.1371,  0.9868,  0.0343,
         0.1687,  0.9985,  0.8952,  0.8790,  0.2357,  0.0139,  0.9667,
         0.9774,  0.9350,  0.9719,  0.8219,  0.9493,  0.9974,  0.1108,
         0.0348,  0.7726,  0.1148,  0.9597,  0.0057,  0.2858,  0.1538,
         0.1739,  0.9341,  0.9362,  0.9867,  0.8869,  0.5929,  0.0954,
         0.0868,  0.0577,  0.2854,  0.0861,  0.1020,  0.9478,  0.9737,
         0.0179,  0.9740,  0.9342,  0.1187,  0.3262,  0.8363,  0.1120,
         0.0804,  0.6320,  0.9539,  0.9889,  0.9860,  0.1016,  0.8978,
         0.1916], device='cuda:0')
tensor(0.3822, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8683,  0.1305,  0.1759,  0.0348,  0.0408,  0.8667,  0.1767,
         0.9015,  0.0511,  0.2199,  0.1607,  0.8556,  0.8964,  0.8676,
         0.0773,  0.3438,  0.2332,  0.2811,  0.2309,  0.9160,  0.8377,
         0.9525,  0.6164,  0.9351,  0.0217,  0.5621,  0.1613,  0.4792,
         0.7014,  0.8415,  0.7703,  0.1293,  0.1119,  0.3756,  0.0965,
         0.7783,  0.9052,  0.2305,  0.9861,  0.3670,  0.1078,  0.8759,
         0.0790,  0.0322,  0.9281,  0.0623,  0.4690,  0.3176,  0.8216,
         0.1142,  0.9574,  0.0855,  0.1356,  0.1659,  0.9929,  0.9401,
         0.1517,  0.1638,  0.5608,  0.1282,  0.6548,  0.2423,  0.6419,
         0.9005,  0.6355,  0.0559,  0.1410,  0.3171,  0.8007,  0.0223,
         0.6871,  0.0421,  0.2451,  0.1125,  0.9429,  0.1051,  0.1091,
         0.4253,  0.0746,  0.4394,  0.0452,  0.9458,  0.9093,  0.0307,
         0.2162,  0.7209,  0.4154,  0.0628,  0.7093,  0.2119,  0.2237,
         0.9246,  0.0396,  0.1087,  0.3531,  0.0180,  0.7331,  0.0910,
         0.5535,  0.4314,  0.7884,  0.2190,  0.1814,  0.9679,  0.9504,
         0.0825,  0.1470,  0.8294,  0.4293,  0.3082,  0.9473,  0.9398,
         0.9533,  0.1910,  0.0997,  0.1077,  0.9388,  0.7319,  0.0201,
         0.9177,  0.8773,  0.2671,  0.2306,  0.9359,  0.0230,  0.2108,
         0.1614,  0.9220,  0.6633,  0.7388,  0.8411,  0.5977,  0.0714,
         0.5403,  0.9243,  0.9316,  0.8935,  0.2896,  0.3661,  0.1333,
         0.0832,  0.5600,  0.0052,  0.3114,  0.0795,  0.8406,  0.9293,
         0.0207,  0.9138,  0.0648,  0.9827,  0.7525,  0.4588,  0.2472,
         0.9494,  0.9810,  0.4492,  0.0219,  0.9508,  0.2441,  0.9379,
         0.1156,  0.2553,  0.3108,  0.8530,  0.1028,  0.2293,  0.1716,
         0.9362,  0.8899,  0.1607,  0.9262,  0.5709,  0.1482,  0.8991,
         0.5531,  0.3284,  0.1250,  0.4271,  0.0629,  0.7385,  0.8071,
         0.5125,  0.7522,  0.8812,  0.3486,  0.9923,  0.8583,  0.1075,
         0.1772,  0.0425,  0.7824,  0.8788,  0.1190,  0.9950,  0.8073,
         0.1007,  0.6280,  0.8182,  0.4623,  0.9134,  0.8882,  0.2405,
         0.1567,  0.0144,  0.8961,  0.3557,  0.0790,  0.9662,  0.9105,
         0.0445,  0.8688,  0.0492,  0.0467,  0.2204,  0.3747,  0.4340,
         0.3407,  0.1690,  0.1130,  0.0818,  0.6705,  0.6921,  0.1134,
         0.0543,  0.0178,  0.9983,  0.1258,  0.1663,  0.8685,  0.9675,
         0.0609,  0.3668,  0.8955,  0.9101,  0.5152,  0.9506,  0.3855,
         0.8502,  0.5680,  0.0041,  0.3450,  0.1247,  0.8769,  0.6465,
         0.1672,  0.0753,  0.9728,  0.1328,  0.8931,  0.0514,  0.9935,
         0.1633,  0.2389,  0.9444,  0.5086,  0.9118,  0.2667,  0.2396,
         0.7914,  0.8185,  0.9952,  0.0835,  0.2547,  0.0125,  0.1842,
         0.9515,  0.2518,  0.0783,  0.2614,  0.9352,  0.3772,  0.9667,
         0.6628,  0.6021,  0.1278,  0.5102,  0.6914,  0.9216,  0.8002,
         0.9774,  0.1679,  0.8822,  0.9862,  0.9486,  0.2203,  0.3564,
         0.9071,  0.3675,  0.4038,  0.9108,  0.3925,  0.0767,  0.1859,
         0.0167,  0.3143,  0.3167,  0.3812,  0.2371,  0.9485,  0.7259,
         0.8105,  0.8640,  0.6000,  0.2148,  0.6382,  0.4224,  0.9592,
         0.9274,  0.9284,  0.4905,  0.0080,  0.1502,  0.9474,  0.2483,
         0.3023,  0.7484,  0.9503,  0.1762,  0.3001,  0.5992,  0.0485,
         0.0303,  0.3362,  0.3737,  0.2790,  0.9532,  0.8803,  0.9154,
         0.9733,  0.9427,  0.9324,  0.0224,  0.9503,  0.5565,  0.3180,
         0.0996,  0.2085,  0.7196,  0.9854,  0.1520,  0.1416,  0.1278,
         0.2197,  0.9129,  0.1687,  0.2499,  0.4004,  0.4858,  0.2300,
         0.8799,  0.9019,  0.9191,  0.0312,  0.0509,  0.1668,  0.8819,
         0.3393,  0.4843,  0.1840,  0.4917,  0.9059,  0.3303,  0.7328,
         0.2975,  0.1123,  0.1880,  0.1619,  0.7145,  0.9439,  0.0540,
         0.4800,  0.0594,  0.4569,  0.9943,  0.6749,  0.9164,  0.5648,
         0.9381,  0.2266,  0.0398,  0.1533,  0.3731,  0.0303,  0.6797,
         0.9856,  0.9517,  0.9411,  0.8952,  0.1536,  0.6963,  0.0364,
         0.6894,  0.3458,  0.1977,  0.7250,  0.9493,  0.8625,  0.0969,
         0.8962,  0.5915,  0.9180,  0.9543,  0.7348,  0.0512,  0.2852,
         0.0660,  0.0762,  0.9460,  0.4591,  0.9359,  0.8664,  0.8558,
         0.0428,  0.9905,  0.0978,  0.2512,  0.8171,  0.9215,  0.6575,
         0.0765,  0.8962,  0.1772,  0.2608,  0.9906,  0.0474,  0.1260,
         0.1026,  0.0179,  0.1309,  0.1721,  0.0876,  0.9935,  0.0933,
         0.1318,  0.6702,  0.1632,  0.0898,  0.6254,  0.8479,  0.0408,
         0.0392,  0.9914,  0.2709,  0.5329,  0.8723,  0.8704,  0.5097,
         0.1515,  0.8058,  0.7502,  0.1109,  0.9159,  0.4908,  0.0109,
         0.0368,  0.1507,  0.9423,  0.1757,  0.9450,  0.2028,  0.0193,
         0.9547,  0.1641,  0.9252,  0.0931,  0.0962,  0.7705,  0.6453,
         0.9257,  0.5960,  0.1279,  0.9237,  0.2987,  0.0580,  0.1430,
         0.1102,  0.4401,  0.9174,  0.9379,  0.2753,  0.7725,  0.4714,
         0.9966,  0.8597,  0.9901,  0.6292,  0.0717,  0.0379,  0.3759,
         0.9054,  0.9624,  0.8954,  0.9159,  0.5839,  0.9596,  0.0221,
         0.3003,  0.0893,  0.9026,  0.0454,  0.0524,  0.6523,  0.1703,
         0.2541,  0.9281,  0.3116,  0.9131,  0.8079,  0.0369,  0.0409,
         0.8016], device='cuda:0')
tensor(0.3718, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1434,  0.7114,  0.2873,  0.9900,  0.1958,  0.0260,  0.1105,
         0.3687,  0.9889,  0.1587,  0.7787,  0.2479,  0.0760,  0.7317,
         0.3118,  0.3323,  0.3655,  0.9988,  0.5329,  0.2234,  0.7592,
         0.1622,  0.0645,  0.8673,  0.7055,  0.0435,  0.1918,  0.1857,
         0.1232,  0.6596,  0.3380,  0.7424,  0.1885,  0.4338,  0.1617,
         0.9684,  0.6140,  0.3831,  0.2676,  0.0340,  0.4051,  0.7772,
         0.6558,  0.8679,  0.0159,  0.7852,  0.9433,  0.1346,  0.9558,
         0.5349,  0.6656,  0.4539,  0.2562,  0.1010,  0.0423,  0.2796,
         0.9775,  0.0681,  0.8871,  0.0675,  0.1018,  0.5855,  0.4737,
         0.2279,  0.4682,  0.5200,  0.9034,  0.2167,  0.2074,  0.3834,
         0.2449,  0.8144,  0.3095,  0.1259,  0.5024,  0.2291,  0.3418,
         0.0459,  0.4776,  0.7168,  0.2662,  0.6370,  0.1200,  0.1765,
         0.1015,  0.2313,  0.8173,  0.2563,  0.4352,  0.0571,  0.9604,
         0.2326,  0.7986,  0.0574,  0.1339,  0.6352,  0.1446,  0.9007,
         0.3289,  0.9402,  0.6059,  0.6176,  0.9455,  0.0984,  0.1268,
         0.0305,  0.0875,  0.8853,  0.0120,  0.0983,  0.6977,  0.3614,
         0.3548,  0.1070,  0.9013,  0.7691,  0.8149,  0.2500,  0.6085,
         0.8558,  0.3643,  0.2449,  0.6925,  0.1642,  0.7105,  0.1279,
         0.4804,  0.0576,  0.8385,  0.5977,  0.8766,  0.2634,  0.2326,
         0.0791,  0.0591,  0.7844,  0.8033,  0.0899,  0.9565,  0.0501,
         0.0525,  0.1099,  0.6760,  0.9608,  0.8326,  0.7274,  0.9138,
         0.9367,  0.7505,  0.0714,  0.9450,  0.4145,  0.2799,  0.4219,
         0.6793,  0.1178,  0.0765,  0.3582,  0.5059,  0.0633,  0.5749,
         0.5576,  0.0686,  0.4180,  0.3035,  0.8870,  0.2678,  0.9356,
         0.3817,  0.9600,  0.7189,  0.9337,  0.2662,  0.0831,  0.7875,
         0.8778,  0.9934,  0.5146,  0.3445,  0.0743,  0.7846,  0.4023,
         0.5704,  0.4273,  0.1362,  0.8280,  0.2880,  0.0437,  0.9095,
         0.0709,  0.9337,  0.1548,  0.0611,  0.9701,  0.0239,  0.2875,
         0.8652,  0.8767,  0.6527,  0.7847,  0.4832,  0.3315,  0.0524,
         0.0607,  0.2560,  0.0887,  0.2418,  0.9062,  0.3785,  0.3241,
         0.8734,  0.2496,  0.7863,  0.6169,  0.5470,  0.0400,  0.8554,
         0.0738,  0.6832,  0.8220,  0.9475,  0.0303,  0.1004,  0.5534,
         0.2807,  0.5398,  0.5506,  0.9961,  0.2068,  0.1612,  0.9096,
         0.2048,  0.3765,  0.0180,  0.2257,  0.5869,  0.0968,  0.4761,
         0.0469,  0.2487,  0.2827,  0.3035,  0.5611,  0.1686,  0.8801,
         0.6413,  0.3694,  0.3523,  0.6636,  0.8821,  0.8616,  0.1180,
         0.0499,  0.4861,  0.1019,  0.0341,  0.2915,  0.8158,  0.0299,
         0.4722,  0.1834,  0.8561,  0.4549,  0.7360,  0.2761,  0.0756,
         0.0638,  0.1028,  0.2131,  0.2772,  0.8664,  0.3139,  0.2802,
         0.3061,  0.6555,  0.6910,  0.7147,  0.7394,  0.4899,  0.0031,
         0.8102,  0.8985,  0.8788,  0.7939,  0.5203,  0.1440,  0.1113,
         0.6902,  0.0364,  0.3203,  0.9823,  0.8959,  0.3879,  0.0441,
         0.1409,  0.8950,  0.0906,  0.1378,  0.4321,  0.8790,  0.9646,
         0.7571,  0.8050,  0.4056,  0.2819,  0.0797,  0.2604,  0.2896,
         0.6464,  0.3205,  0.5158,  0.8655,  0.1239,  0.7877,  0.3334,
         0.7375,  0.5623,  0.0108,  0.9961,  0.1377,  0.4988,  0.2919,
         0.9454,  0.0103,  0.8882,  0.2594,  0.0194,  0.1816,  0.3346,
         0.6120,  0.7868,  0.5612,  0.5317,  0.8959,  0.5487,  0.2413,
         0.1876,  0.2466,  0.0635,  0.6774,  0.6553,  0.6017,  0.2070,
         0.3404,  0.3920,  0.1871,  0.2382,  0.6074,  0.6504,  0.2714,
         0.0994,  0.5732,  0.8989,  0.1476,  0.7275,  0.2722,  0.9837,
         0.6090,  0.1502,  0.7437,  0.6476,  0.0424,  0.2566,  0.8880,
         0.2318,  0.9807,  0.7976,  0.6304,  0.0305,  0.8146,  0.2864,
         0.8337,  0.5476,  0.1822,  0.1414,  0.8593,  0.3058,  0.6459,
         0.2127,  0.0139,  0.1482,  0.3283,  0.5309,  0.6700,  0.9246,
         0.9263,  0.9967,  0.0315,  0.4676,  0.8632,  0.0651,  0.0599,
         0.5641,  0.1135,  0.0779,  0.4620,  0.9093,  0.9205,  0.9216,
         0.2633,  0.6079,  0.0467,  0.9486,  0.2637,  0.9808,  0.0631,
         0.2656,  0.5923,  0.8449,  0.8263,  0.4541,  0.1051,  0.1134,
         0.7135,  0.4775,  0.1208,  0.2617,  0.4792,  0.0295,  0.2002,
         0.7482,  0.0350,  0.1491,  0.8354,  0.4950,  0.0695,  0.4519,
         0.2414,  0.9809,  0.0728,  0.1687,  0.1451,  0.2561,  0.7367,
         0.0682,  0.3002,  0.7792,  0.1017,  0.6813,  0.0180,  0.9242,
         0.9180,  0.2822,  0.6290,  0.9003,  0.3151,  0.9177,  0.8229,
         0.7892,  0.8239,  0.8638,  0.1166,  0.2195,  0.0326,  0.8091,
         0.9728,  0.1129,  0.7454,  0.5531,  0.8694,  0.9135,  0.4285,
         0.1974,  0.5939,  0.4323,  0.7929,  0.9508,  0.8710,  0.7715,
         0.0708,  0.8491,  0.6935,  0.5820,  0.0576,  0.3161,  0.2250,
         0.9512,  0.1887,  0.2976,  0.3006,  0.1362,  0.1483,  0.6027,
         0.0716,  0.2142,  0.0492,  0.9514,  0.0136,  0.0417,  0.2362,
         0.7557,  0.0902,  0.8660,  0.9733,  0.3818,  0.2324,  0.7216,
         0.8168,  0.9383,  0.1033,  0.3056,  0.2278,  0.7939,  0.5878,
         0.6149,  0.9654,  0.5270,  0.9197,  0.1631,  0.9450,  0.6650,
         0.7712], device='cuda:0')
tensor(0.3826, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3546,  0.4271,  0.7348,  0.6010,  0.2062,  0.1188,  0.6820,
         0.5469,  0.9724,  0.6288,  0.1584,  0.7665,  0.0462,  0.9299,
         0.4424,  0.8908,  0.5739,  0.0456,  0.3251,  0.2759,  0.0232,
         0.2298,  0.8902,  0.0630,  0.0866,  0.4045,  0.0412,  0.7736,
         0.0642,  0.0486,  0.1635,  0.8061,  0.2834,  0.9001,  0.1428,
         0.9714,  0.9704,  0.8408,  0.9782,  0.8178,  0.5397,  0.0458,
         0.8323,  0.5220,  0.8165,  0.4998,  0.3010,  0.0214,  0.6707,
         0.1382,  0.3519,  0.4606,  0.3312,  0.8288,  0.2893,  0.6341,
         0.9145,  0.3921,  0.6163,  0.7865,  0.2131,  0.1174,  0.2362,
         0.7436,  0.0129,  0.4383,  0.9624,  0.0444,  0.0585,  0.8378,
         0.8919,  0.7957,  0.2316,  0.4455,  0.2738,  0.8487,  0.8133,
         0.5657,  0.9025,  0.3300,  0.2199,  0.7988,  0.3144,  0.1349,
         0.3003,  0.5834,  0.7547,  0.0263,  0.4821,  0.4540,  0.7897,
         0.4070,  0.8819,  0.6448,  0.7331,  0.7732,  0.4451,  0.2237,
         0.8125,  0.4289,  0.1376,  0.5221,  0.8172,  0.0229,  0.1198,
         0.0706,  0.0064,  0.2780,  0.6559,  0.0913,  0.5713,  0.6298,
         0.1632,  0.6195,  0.7521,  0.5183,  0.8262,  0.2649,  0.5400,
         0.9193,  0.1151,  0.7787,  0.6744,  0.6093,  0.6420,  0.2772,
         0.5576,  0.8436,  0.0597,  0.8974,  0.3661,  0.9275,  0.8584,
         0.4339,  0.2594,  0.5549,  0.4769,  0.5316,  0.9320,  0.1399,
         0.0867,  0.0300,  0.9798,  0.5629,  0.1822,  0.7207,  0.0746,
         0.4189,  0.5989,  0.3225,  0.1427,  0.0548,  0.6342,  0.9912,
         0.2406,  0.2091,  0.3078,  0.7428,  0.0672,  0.9758,  0.8416,
         0.6803,  0.1261,  0.5900,  0.9540,  0.0879,  0.8149,  0.2829,
         0.6103,  0.9609,  0.3870,  0.9444,  0.5978,  0.3224,  0.8541,
         0.9438,  0.2328,  0.8965,  0.4087,  0.2458,  0.8355,  0.8963,
         0.4090,  0.0203,  0.5059,  0.0342,  0.4253,  0.9328,  0.5091,
         0.4914,  0.6267,  0.4168,  0.7283,  0.1427,  0.4293,  0.0791,
         0.7835,  0.7918,  0.1942,  0.2452,  0.7821,  0.4595,  0.4343,
         0.3948,  0.3217,  0.8374,  0.2214,  0.8987,  0.0448,  0.1316,
         0.1602,  0.0457,  0.9289,  0.0153,  0.7102,  0.9138,  0.1903,
         0.7795,  0.8810,  0.1297,  0.7989,  0.0454,  0.8037,  0.8583,
         0.6665,  0.1901,  0.1559,  0.2382,  0.4113,  0.8037,  0.4991,
         0.5941,  0.1748,  0.5414,  0.1932,  0.1462,  0.2118,  0.7513,
         0.7623,  0.9454,  0.7730,  0.3257,  0.9728,  0.8460,  0.1510,
         0.8240,  0.0125,  0.3202,  0.8652,  0.3146,  0.2951,  0.1342,
         0.8814,  0.1105,  0.2370,  0.7342,  0.3950,  0.1805,  0.7724,
         0.6366,  0.3631,  0.1412,  0.7394,  0.7639,  0.9116,  0.4039,
         0.2491,  0.4541,  0.7990,  0.7811,  0.7569,  0.9186,  0.8504,
         0.0715,  0.2763,  0.4545,  0.3035,  0.0910,  0.0745,  0.5907,
         0.2600,  0.8887,  0.6422,  0.1646,  0.8234,  0.3453,  0.8370,
         0.1383,  0.5476,  0.0586,  0.7997,  0.3493,  0.5190,  0.0921,
         0.3614,  0.6332,  0.8432,  0.2459,  0.9812,  0.1780,  0.7299,
         0.7548,  0.8506,  0.9683,  0.0329,  0.4892,  0.8832,  0.9278,
         0.4718,  0.6584,  0.7298,  0.9604,  0.3735,  0.3069,  0.1864,
         0.6809,  0.8239,  0.1619,  0.0786,  0.8638,  0.8288,  0.0554,
         0.0481,  0.4920,  0.3254,  0.7651,  0.3876,  0.8915,  0.0107,
         0.1933,  0.7440,  0.3776,  0.2682,  0.8040,  0.2624,  0.2556,
         0.4918,  0.0939,  0.0992,  0.1903,  0.2143,  0.7888,  0.0952,
         0.1989,  0.5457,  0.3665,  0.5806,  0.6059,  0.8228,  0.2606,
         0.4836,  0.7689,  0.9104,  0.8285,  0.0501,  0.8147,  0.7709,
         0.5522,  0.8575,  0.6999,  0.1515,  0.9065,  0.2130,  0.8306,
         0.7828,  0.6179,  0.3475,  0.3929,  0.8358,  0.2451,  0.2068,
         0.1238,  0.0834,  0.6581,  0.8126,  0.1304,  0.0327,  0.9499,
         0.0344,  0.0714,  0.4931,  0.7758,  0.7373,  0.5990,  0.1760,
         0.6363,  0.5105,  0.1028,  0.5898,  0.3343,  0.7125,  0.9213,
         0.3690,  0.0145,  0.8873,  0.9942,  0.1430,  0.3197,  0.6822,
         0.6873,  0.4792,  0.8516,  0.0038,  0.6994,  0.1298,  0.8457,
         0.4475,  0.1089,  0.1584,  0.8995,  0.1705,  0.8455,  0.6447,
         0.2547,  0.6476,  0.6146,  0.7908,  0.1736,  0.8723,  0.0132,
         0.3152,  0.4118,  0.0580,  0.9390,  0.1925,  0.2532,  0.1859,
         0.5263,  0.0909,  0.5140,  0.1071,  0.0392,  0.8118,  0.0731,
         0.8864,  0.8245,  0.8739,  0.7861,  0.8074,  0.0703,  0.7877,
         0.8349,  0.2817,  0.2028,  0.9260,  0.9301,  0.2021,  0.6292,
         0.4652,  0.8355,  0.7061,  0.1687,  0.0144,  0.1578,  0.6952,
         0.1236,  0.7065,  0.1180,  0.7346,  0.4165,  0.5163,  0.2958,
         0.7840,  0.9030,  0.9232,  0.5958,  0.5588,  0.8834,  0.3045,
         0.4285,  0.7282,  0.6662,  0.2290,  0.1150,  0.9332,  0.4665,
         0.5029,  0.1768,  0.6540,  0.0751,  0.6741,  0.0517,  0.5445,
         0.4895,  0.8092,  0.0781,  0.9169,  0.7478,  0.7742,  0.5687,
         0.1576,  0.8944,  0.5837,  0.8955,  0.1941,  0.2961,  0.0991,
         0.9081,  0.1334,  0.0348,  0.9712,  0.5451,  0.3220,  0.0713,
         0.0740,  0.8646,  0.1532,  0.0647,  0.0638,  0.8239,  0.0883,
         0.9282], device='cuda:0')
tensor(0.3650, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4291,  0.3909,  0.6144,  0.6838,  0.8523,  0.1823,  0.0765,
         0.7297,  0.0318,  0.0592,  0.6055,  0.2753,  0.6125,  0.4115,
         0.2208,  0.4660,  0.8737,  0.2351,  0.5008,  0.5145,  0.7356,
         0.0120,  0.7274,  0.8101,  0.5395,  0.8593,  0.8437,  0.8655,
         0.5621,  0.5333,  0.1961,  0.8263,  0.3083,  0.1545,  0.8194,
         0.8411,  0.1937,  0.7274,  0.3036,  0.2250,  0.3399,  0.2529,
         0.6965,  0.1620,  0.0385,  0.0088,  0.8485,  0.7070,  0.7986,
         0.2485,  0.0050,  0.6734,  0.5070,  0.8410,  0.1134,  0.6060,
         0.8079,  0.8441,  0.8862,  0.2260,  0.1439,  0.6523,  0.7662,
         0.7127,  0.2302,  0.7981,  0.4844,  0.6571,  0.3987,  0.5310,
         0.8635,  0.8495,  0.6438,  0.1860,  0.0499,  0.5308,  0.4283,
         0.4161,  0.7681,  0.1258,  0.8183,  0.8794,  0.1543,  0.4047,
         0.0258,  0.3228,  0.3055,  0.3369,  0.5987,  0.7546,  0.9589,
         0.3383,  0.7602,  0.2846,  0.6198,  0.0548,  0.7674,  0.0165,
         0.1340,  0.1377,  0.5294,  0.7561,  0.0642,  0.8836,  0.3521,
         0.7949,  0.8797,  0.9711,  0.5297,  0.1904,  0.5924,  0.9740,
         0.0239,  0.8506,  0.7989,  0.6105,  0.2236,  0.1668,  0.8045,
         0.8441,  0.9334,  0.0958,  0.8288,  0.0558,  0.0763,  0.0736,
         0.8595,  0.9239,  0.7436,  0.0733,  0.8252,  0.8566,  0.5126,
         0.0065,  0.9836,  0.1534,  0.6621,  0.0038,  0.2753,  0.2988,
         0.6096,  0.1336,  0.7096,  0.5966,  0.0129,  0.1946,  0.5030,
         0.9116,  0.2388,  0.7443,  0.8101,  0.0071,  0.7096,  0.8822,
         0.6347,  0.4870,  0.4224,  0.1298,  0.6393,  0.8209,  0.3968,
         0.5892,  0.7814,  0.0715,  0.7549,  0.5354,  0.8445,  0.2591,
         0.0306,  0.0568,  0.0073,  0.5047,  0.8113,  0.8109,  0.0147,
         0.0681,  0.0254,  0.8256,  0.6941,  0.1894,  0.2198,  0.0280,
         0.2610,  0.7188,  0.9026,  0.6735,  0.5731,  0.5677,  0.9903,
         0.4413,  0.6945,  0.7029,  0.0615,  0.0619,  0.0302,  0.9021,
         0.4222,  0.7182,  0.8144,  0.2688,  0.5566,  0.3906,  0.4881,
         0.7474,  0.0956,  0.3241,  0.6704,  0.8532,  0.9539,  0.0974,
         0.0436,  0.0367,  0.5796,  0.4543,  0.3242,  0.0214,  0.2157,
         0.6980,  0.9087,  0.0071,  0.9299,  0.8397,  0.8808,  0.1139,
         0.0642,  0.9252,  0.5539,  0.1882,  0.8221,  0.8732,  0.4299,
         0.9110,  0.5647,  0.3800,  0.5483,  0.5058,  0.4515,  0.9146,
         0.3095,  0.8560,  0.3851,  0.0985,  0.0863,  0.8844,  0.2646,
         0.9859,  0.1146,  0.1827,  0.0756,  0.0052,  0.1979,  0.8207,
         0.2351,  0.2746,  0.8172,  0.3335,  0.6567,  0.7242,  0.6253,
         0.8923,  0.6492,  0.8973,  0.6350,  0.7995,  0.0237,  0.8669,
         0.0429,  0.5156,  0.9927,  0.6122,  0.6362,  0.4599,  0.9653,
         0.3148,  0.9141,  0.6907,  0.8955,  0.2407,  0.6241,  0.3764,
         0.0212,  0.2853,  0.3544,  0.1003,  0.6848,  0.4294,  0.2000,
         0.5108,  0.1165,  0.7578,  0.0863,  0.6278,  0.9015,  0.3254,
         0.2958,  0.7142,  0.0929,  0.4303,  0.1231,  0.0955,  0.6037,
         0.1223,  0.8957,  0.2557,  0.0616,  0.1655,  0.7296,  0.0130,
         0.0854,  0.8787,  0.7445,  0.5238,  0.8333,  0.0529,  0.0840,
         0.7963,  0.4130,  0.7467,  0.0115,  0.5174,  0.7435,  0.9614,
         0.6871,  0.8121,  0.1951,  0.7681,  0.3470,  0.0529,  0.0275,
         0.8308,  0.3611,  0.8597,  0.9435,  0.8761,  0.7256,  0.0144,
         0.8105,  0.1641,  0.1943,  0.2999,  0.6185,  0.8769,  0.1633,
         0.2144,  0.9306,  0.3068,  0.6836,  0.0346,  0.7644,  0.1483,
         0.2338,  0.0465,  0.8373,  0.3056,  0.8274,  0.1773,  0.6698,
         0.7822,  0.2143,  0.7014,  0.0549,  0.5816,  0.6474,  0.2366,
         0.6805,  0.7111,  0.8236,  0.1592,  0.9753,  0.3568,  0.9937,
         0.1346,  0.9332,  0.1769,  0.9531,  0.0951,  0.0640,  0.5237,
         0.3189,  0.8046,  0.7871,  0.5232,  0.8166,  0.2148,  0.0152,
         0.1294,  0.0898,  0.8911,  0.1807,  0.9500,  0.2185,  0.0975,
         0.3163,  0.4484,  0.2846,  0.9163,  0.8608,  0.9742,  0.0536,
         0.6472,  0.3263,  0.8092,  0.2832,  0.9130,  0.8347,  0.1170,
         0.7910,  0.9104,  0.0708,  0.4286,  0.2544,  0.1247,  0.3458,
         0.1666,  0.9562,  0.8121,  0.6523,  0.3162,  0.9155,  0.6108,
         0.5241,  0.5109,  0.0526,  0.1131,  0.1230,  0.8970,  0.7568,
         0.8898,  0.7815,  0.4663,  0.0244,  0.0468,  0.0093,  0.4800,
         0.0653,  0.7868,  0.5330,  0.1195,  0.6109,  0.7685,  0.3446,
         0.7604,  0.8412,  0.6138,  0.2429,  0.1371,  0.8000,  0.2015,
         0.9792,  0.5808,  0.6811,  0.2452,  0.0206,  0.7852,  0.3347,
         0.1783,  0.8862,  0.4919,  0.8856,  0.8716,  0.1428,  0.9364,
         0.6144,  0.5262,  0.0478,  0.6939,  0.9273,  0.4208,  0.8526,
         0.7033,  0.3270,  0.9883,  0.5210,  0.3262,  0.5370,  0.3346,
         0.2456,  0.0951,  0.1085,  0.5296,  0.1425,  0.1428,  0.7370,
         0.1705,  0.4441,  0.2218,  0.8719,  0.8054,  0.0129,  0.0569,
         0.4341,  0.8826,  0.8985,  0.2194,  0.2233,  0.8274,  0.8334,
         0.1012,  0.6736,  0.1672,  0.9043,  0.1500,  0.1547,  0.8027,
         0.7381,  0.8031,  0.7925,  0.7508,  0.0686,  0.9569,  0.6501,
         0.1510], device='cuda:0')
tensor(0.3778, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3179,  0.5713,  0.1630,  0.9391,  0.0635,  0.8477,  0.8167,
         0.8836,  0.7869,  0.1082,  0.0321,  0.1374,  0.8901,  0.7432,
         0.1708,  0.8383,  0.2572,  0.0050,  0.6489,  0.4430,  0.0956,
         0.5155,  0.0083,  0.0118,  0.5481,  0.7615,  0.8653,  0.5074,
         0.0320,  0.5611,  0.3815,  0.3057,  0.2806,  0.3043,  0.0181,
         0.9747,  0.5291,  0.7224,  0.6709,  0.0895,  0.3222,  0.4103,
         0.8890,  0.1200,  0.8074,  0.7452,  0.1083,  0.0135,  0.1196,
         0.6245,  0.8538,  0.8595,  0.0084,  0.0229,  0.8847,  0.4200,
         0.8316,  0.9092,  0.0331,  0.8937,  0.9516,  0.2371,  0.9714,
         0.1966,  0.0497,  0.7769,  0.0048,  0.7750,  0.0095,  0.3438,
         0.3116,  0.2132,  0.9951,  0.7438,  0.7520,  0.0228,  0.8522,
         0.8142,  0.9903,  0.8611,  0.5450,  0.0363,  0.3020,  0.2851,
         0.8766,  0.3063,  0.2857,  0.9351,  0.7533,  0.1041,  0.5516,
         0.0475,  0.4698,  0.2500,  0.8452,  0.0338,  0.3969,  0.7336,
         0.8238,  0.2277,  0.4670,  0.4822,  0.7950,  0.9105,  0.9271,
         0.2617,  0.7897,  0.5674,  0.0694,  0.7001,  0.2128,  0.0137,
         0.1441,  0.1258,  0.3419,  0.9177,  0.4281,  0.9235,  0.1046,
         0.8836,  0.8048,  0.1494,  0.5008,  0.9386,  0.7308,  0.5551,
         0.3536,  0.6218,  0.1242,  0.6459,  0.2756,  0.9414,  0.8471,
         0.6264,  0.0059,  0.1124,  0.8019,  0.9384,  0.9454,  0.7536,
         0.8827,  0.6784,  0.9695,  0.6517,  0.5377,  0.7980,  0.1891,
         0.0343,  0.6512,  0.4711,  0.5230,  0.3970,  0.7428,  0.6343,
         0.4416,  0.2414,  0.0403,  0.7385,  0.8282,  0.3202,  0.8262,
         0.4633,  0.9250,  0.2526,  0.8410,  0.0364,  0.9908,  0.0339,
         0.8094,  0.0329,  0.1153,  0.0095,  0.8542,  0.9393,  0.1398,
         0.1229,  0.9217,  0.9714,  0.7822,  0.8245,  0.8326,  0.8691,
         0.9756,  0.3507,  0.7911,  0.9173,  0.5237,  0.8959,  0.1566,
         0.6277,  0.8179,  0.3480,  0.8997,  0.6641,  0.7096,  0.8142,
         0.3318,  0.2326,  0.6203,  0.0382,  0.0921,  0.0307,  0.2308,
         0.0459,  0.9877,  0.1457,  0.8267,  0.6229,  0.5468,  0.0364,
         0.0442,  0.7066,  0.8619,  0.6754,  0.9425,  0.7124,  0.8869,
         0.9254,  0.0482,  0.0312,  0.6313,  0.8691,  0.8359,  0.9042,
         0.4346,  0.8932,  0.4394,  0.2620,  0.0188,  0.8765,  0.0973,
         0.2662,  0.0395,  0.2530,  0.5774,  0.0533,  0.2559,  0.3529,
         0.5215,  0.6840,  0.8170,  0.7685,  0.9002,  0.1812,  0.7330,
         0.4799,  0.0066,  0.0259,  0.5650,  0.0715,  0.8077,  0.6013,
         0.0816,  0.6185,  0.6765,  0.3825,  0.1709,  0.5227,  0.0240,
         0.0967,  0.4657,  0.7654,  0.0448,  0.2924,  0.2102,  0.0350,
         0.0154,  0.7217,  0.0803,  0.1600,  0.9111,  0.4828,  0.9631,
         0.1353,  0.2640,  0.8739,  0.2369,  0.2964,  0.4266,  0.8168,
         0.9276,  0.8309,  0.8800,  0.7342,  0.5010,  0.5131,  0.7969,
         0.5977,  0.0889,  0.8352,  0.0463,  0.9945,  0.5710,  0.9090,
         0.9073,  0.4085,  0.9545,  0.9363,  0.0236,  0.8032,  0.7960,
         0.7649,  0.9153,  0.0682,  0.0689,  0.2149,  0.3744,  0.5256,
         0.8724,  0.2099,  0.0879,  0.5724,  0.2140,  0.8271,  0.9026,
         0.8982,  0.1906,  0.9825,  0.5788,  0.7847,  0.9819,  0.0549,
         0.3723,  0.8123,  0.3166,  0.8463,  0.6243,  0.9257,  0.6278,
         0.0790,  0.2008,  0.1523,  0.0414,  0.4143,  0.6065,  0.8072,
         0.4085,  0.3242,  0.0097,  0.9038,  0.7467,  0.3496,  0.8409,
         0.4386,  0.1039,  0.7412,  0.6934,  0.8528,  0.0650,  0.0209,
         0.9502,  0.0254,  0.7542,  0.0366,  0.8150,  0.7176,  0.0841,
         0.2505,  0.8716,  0.2610,  0.7834,  0.9245,  0.0411,  0.2993,
         0.9130,  0.8797,  0.9319,  0.2806,  0.5587,  0.0179,  0.4749,
         0.9240,  0.2404,  0.8179,  0.1308,  0.8453,  0.6801,  0.0996,
         0.0842,  0.0195,  0.0544,  0.3225,  0.1710,  0.0090,  0.7992,
         0.5349,  0.2176,  0.3301,  0.5872,  0.9350,  0.0260,  0.6963,
         0.8858,  0.8073,  0.0066,  0.5218,  0.8776,  0.2972,  0.8910,
         0.2263,  0.6683,  0.7935,  0.8839,  0.7793,  0.4074,  0.1016,
         0.9159,  0.3129,  0.8275,  0.2250,  0.8941,  0.8507,  0.9212,
         0.7389,  0.9074,  0.0899,  0.7726,  0.0876,  0.0452,  0.0410,
         0.1384,  0.3217,  0.2229,  0.8126,  0.3056,  0.5925,  0.6135,
         0.9866,  0.0201,  0.1314,  0.0267,  0.0398,  0.9247,  0.0785,
         0.2378,  0.9859,  0.4572,  0.8308,  0.1473,  0.7678,  0.9212,
         0.0355,  0.0241,  0.7310,  0.0344,  0.4269,  0.8031,  0.1094,
         0.3933,  0.0826,  0.0873,  0.6809,  0.5095,  0.3529,  0.1397,
         0.5144,  0.9183,  0.0579,  0.1455,  0.2389,  0.9731,  0.5606,
         0.7285,  0.0796,  0.2800,  0.9813,  0.8688,  0.9474,  0.5434,
         0.1907,  0.5790,  0.0953,  0.0318,  0.0455,  0.0408,  0.7935,
         0.6885,  0.8629,  0.9887,  0.0601,  0.0324,  0.9433,  0.9681,
         0.9697,  0.0467,  0.1985,  0.3093,  0.3781,  0.7166,  0.8759,
         0.8133,  0.9539,  0.2220,  0.3460,  0.0793,  0.7030,  0.7574,
         0.3912,  0.8830,  0.9616,  0.8544,  0.0622,  0.9935,  0.2077,
         0.3393,  0.3509,  0.8019,  0.8687,  0.0330,  0.8213,  0.6661,
         0.5431], device='cuda:0')
tensor(0.3562, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0337,  0.2173,  0.3847,  0.0106,  0.9278,  0.0692,  0.8751,
         0.5448,  0.8958,  0.8749,  0.7529,  0.0454,  0.4480,  0.8521,
         0.1495,  0.0967,  0.0351,  0.1404,  0.9242,  0.9172,  0.6913,
         0.1628,  0.0343,  0.8767,  0.5794,  0.7111,  0.3199,  0.0606,
         0.4377,  0.9193,  0.2712,  0.0352,  0.8271,  0.8923,  0.0025,
         0.0997,  0.8486,  0.0183,  0.8787,  0.9651,  0.0397,  0.0207,
         0.9120,  0.2139,  0.9512,  0.7248,  0.9218,  0.4692,  0.7510,
         0.9958,  0.9733,  0.9365,  0.8327,  0.0689,  0.0021,  0.9122,
         0.7280,  0.9752,  0.3817,  0.7080,  0.1667,  0.9471,  0.0085,
         0.0627,  0.0978,  0.9210,  0.6699,  0.1159,  0.2902,  0.0244,
         0.1081,  0.5814,  0.0465,  0.2586,  0.0175,  0.2328,  0.6719,
         0.9398,  0.5425,  0.0224,  0.6048,  0.8637,  0.5837,  0.0261,
         0.3752,  0.0027,  0.8866,  0.0238,  0.8373,  0.4577,  0.8295,
         0.5509,  0.3000,  0.8056,  0.0387,  0.3810,  0.6240,  0.9070,
         0.8923,  0.0437,  0.0180,  0.7889,  0.2733,  0.8796,  0.4929,
         0.9544,  0.7149,  0.4496,  0.7049,  0.0209,  0.9933,  0.9276,
         0.3501,  0.4293,  0.3468,  0.0905,  0.7241,  0.9169,  0.3734,
         0.1459,  0.9630,  0.6591,  0.3204,  0.1718,  0.8032,  0.8665,
         0.0641,  0.0064,  0.7617,  0.0396,  0.9275,  0.8899,  0.8624,
         0.9717,  0.8435,  0.6712,  0.9976,  0.9405,  0.8181,  0.5257,
         0.9155,  0.8037,  0.3611,  0.8608,  0.8743,  0.3396,  0.3831,
         0.6995,  0.6633,  0.8359,  0.2923,  0.8693,  0.0928,  0.8875,
         0.9123,  0.8106,  0.9748,  0.0996,  0.9343,  0.0078,  0.8681,
         0.0391,  0.9793,  0.1144,  0.7194,  0.1077,  0.0030,  0.0122,
         0.2188,  0.0809,  0.8895,  0.5564,  0.0536,  0.1235,  0.0548,
         0.6568,  0.6941,  0.8667,  0.9365,  0.4138,  0.0041,  0.8951,
         0.8841,  0.0055,  0.9373,  0.0302,  0.9221,  0.0240,  0.8733,
         0.1280,  0.0324,  0.6816,  0.1371,  0.8216,  0.3220,  0.0425,
         0.7479,  0.8603,  0.6806,  0.8047,  0.6205,  0.9287,  0.8525,
         0.1216,  0.9293,  0.9893,  0.1504,  0.7461,  0.6566,  0.8019,
         0.0268,  0.8327,  0.0728,  0.8301,  0.8082,  0.8113,  0.6632,
         0.4255,  0.7014,  0.3844,  0.2412,  0.0666,  0.3402,  0.7997,
         0.8746,  0.1384,  0.7599,  0.8513,  0.0366,  0.6501,  0.1114,
         0.0590,  0.9333,  0.0140,  0.8110,  0.2011,  0.8833,  0.0653,
         0.0801,  0.8694,  0.2038,  0.9521,  0.7139,  0.0465,  0.6894,
         0.0336,  0.4370,  0.0248,  0.7806,  0.0736,  0.7404,  0.2599,
         0.0048,  0.0709,  0.8820,  0.3059,  0.0022,  0.0349,  0.5638,
         0.0660,  0.9750,  0.9041,  0.9209,  0.0715,  0.8938,  0.2495,
         0.8123,  0.9314,  0.8601,  0.9480,  0.5848,  0.5034,  0.5499,
         0.4312,  0.3268,  0.0750,  0.7855,  0.0298,  0.0487,  0.9363,
         0.0296,  0.0524,  0.0975,  0.9856,  0.8096,  0.9099,  0.6675,
         0.7357,  0.9031,  0.0163,  0.0055,  0.0816,  0.8381,  0.8173,
         0.7016,  0.6798,  0.8147,  0.0936,  0.0631,  0.8256,  0.1125,
         0.4157,  0.7597,  0.6582,  0.0042,  0.2915,  0.0272,  0.8729,
         0.0661,  0.8661,  0.2766,  0.0498,  0.9250,  0.2006,  0.3980,
         0.4238,  0.7272,  0.1879,  0.2176,  0.7204,  0.0625,  0.7103,
         0.4983,  0.3362,  0.7425,  0.7598,  0.1012,  0.5293,  0.1865,
         0.8351,  0.0517,  0.8724,  0.8881,  0.1042,  0.0152,  0.8445,
         0.9388,  0.6754,  0.9976,  0.7636,  0.1120,  0.0291,  0.9808,
         0.3868,  0.2175,  0.7924,  0.9070,  0.6135,  0.0163,  0.3171,
         0.9014,  0.9119,  0.0331,  0.1974,  0.0061,  0.0229,  0.0765,
         0.0271,  0.7131,  0.7658,  0.3251,  0.3322,  0.8887,  0.5568,
         0.0089,  0.8122,  0.9266,  0.0879,  0.9089,  0.7764,  0.1220,
         0.0936,  0.6021,  0.0124,  0.8495,  0.0365,  0.9291,  0.8943,
         0.7463,  0.9891,  0.0268,  0.0722,  0.2429,  0.0378,  0.0237,
         0.0019,  0.6100,  0.4540,  0.9170,  0.9754,  0.9190,  0.0535,
         0.3299,  0.8439,  0.1597,  0.0325,  0.6093,  0.7456,  0.9018,
         0.0396,  0.3620,  0.0229,  0.5493,  0.9384,  0.9611,  0.0244,
         0.8368,  0.0565,  0.1777,  0.0544,  0.0163,  0.3321,  0.5434,
         0.4738,  0.8781,  0.9332,  0.8353,  0.8355,  0.0620,  0.9639,
         0.0451,  0.7362,  0.1265,  0.8841,  0.0931,  0.0713,  0.9531,
         0.5853,  0.0916,  0.4244,  0.9272,  0.0112,  0.8929,  0.4258,
         0.7984,  0.9818,  0.8693,  0.8618,  0.1799,  0.5055,  0.9510,
         0.4049,  0.0780,  0.8707,  0.0273,  0.1215,  0.0094,  0.7504,
         0.4767,  0.8444,  0.8052,  0.1947,  0.3472,  0.9567,  0.8894,
         0.8610,  0.1058,  0.0415,  0.0621,  0.6231,  0.8683,  0.9086,
         0.4315,  0.9416,  0.9055,  0.6566,  0.7594,  0.8759,  0.8115,
         0.6698,  0.1089,  0.4210,  0.9664,  0.8649,  0.9544,  0.3897,
         0.8628,  0.1013,  0.9930,  0.8800,  0.0352,  0.8860,  0.0538,
         0.2669,  0.0372,  0.9924,  0.9278,  0.0309,  0.7651,  0.9271,
         0.2345,  0.5879,  0.0284,  0.2610,  0.1081,  0.4464,  0.7159,
         0.8405,  0.2209,  0.0400,  0.4899,  0.2661,  0.0386,  0.0419,
         0.0202,  0.9707,  0.7619,  0.9060,  0.8034,  0.2153,  0.2429,
         0.7526], device='cuda:0')
tensor(0.3456, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7066,  0.9552,  0.0072,  0.6852,  0.9535,  0.9018,  0.8626,
         0.0014,  0.1038,  0.1157,  0.9413,  0.0154,  0.9121,  0.5241,
         0.9123,  0.2816,  0.9721,  0.9452,  0.6460,  0.0256,  0.9211,
         0.9835,  0.7939,  0.0167,  0.0460,  0.0175,  0.6648,  0.9919,
         0.9385,  0.7201,  0.9361,  0.0063,  0.8059,  0.0095,  0.0129,
         0.9527,  0.5940,  0.3655,  0.8524,  0.7707,  0.9030,  0.0463,
         0.2838,  0.0375,  0.8268,  0.0068,  0.0304,  0.7026,  0.7320,
         0.1448,  0.0055,  0.0204,  0.7432,  0.9085,  0.8456,  0.9245,
         0.0520,  0.2786,  0.5357,  0.0022,  0.8436,  0.9349,  0.0430,
         0.0812,  0.0911,  0.9369,  0.8763,  0.2058,  0.0085,  0.1772,
         0.2865,  0.3411,  0.0113,  0.2919,  0.0932,  0.8916,  0.4126,
         0.6343,  0.9355,  0.0317,  0.0685,  0.0132,  0.6063,  0.4778,
         0.2138,  0.0104,  0.9584,  0.6773,  0.0187,  0.0695,  0.1622,
         0.9933,  0.0390,  0.9035,  0.0404,  0.0523,  0.9068,  0.0025,
         0.9670,  0.9411,  0.0044,  0.9006,  0.0120,  0.0282,  0.9544,
         0.9621,  0.0167,  0.7991,  0.8931,  0.6601,  0.9258,  0.0453,
         0.9784,  0.9225,  0.0809,  0.0043,  0.9488,  0.9280,  0.0732,
         0.0213,  0.3270,  0.9917,  0.2565,  0.7534,  0.9286,  0.2576,
         0.1785,  0.0418,  0.9177,  0.0053,  0.8620,  0.7701,  0.9481,
         0.8797,  0.0209,  0.4975,  0.0844,  0.0296,  0.7573,  0.1087,
         0.6820,  0.0413,  0.8234,  0.7944,  0.9251,  0.7351,  0.0789,
         0.9886,  0.0214,  0.0054,  0.6992,  0.5731,  0.6553,  0.1518,
         0.7232,  0.6910,  0.9422,  0.9762,  0.4108,  0.9436,  0.5421,
         0.9754,  0.1214,  0.9296,  0.8072,  0.0288,  0.7740,  0.9566,
         0.3093,  0.8144,  0.9659,  0.7979,  0.0018,  0.9976,  0.0103,
         0.0312,  0.9462,  0.8980,  0.2061,  0.0198,  0.3260,  0.7586,
         0.9951,  0.8298,  0.0164,  0.8978,  0.8152,  0.9781,  0.8892,
         0.9403,  0.8967,  0.8603,  0.7690,  0.9863,  0.8204,  0.9114,
         0.9560,  0.0318,  0.2885,  0.3116,  0.0301,  0.0624,  0.0043,
         0.0573,  0.8674,  0.9006,  0.0202,  0.8000,  0.9586,  0.9839,
         0.1093,  0.2185,  0.8995,  0.0413,  0.9385,  0.0682,  0.0118,
         0.8006,  0.6732,  0.9564,  0.0456,  0.0562,  0.0380,  0.0852,
         0.4905,  0.8992,  0.9103,  0.0410,  0.0089,  0.3662,  0.9754,
         0.9681,  0.7996,  0.8772,  0.5852,  0.1506,  0.3476,  0.9947,
         0.1980,  0.9339,  0.0025,  0.0067,  0.9252,  0.8395,  0.0558,
         0.0139,  0.8826,  0.0730,  0.9667,  0.5648,  0.0300,  0.9913,
         0.0053,  0.9983,  0.9738,  0.9172,  0.0584,  0.2543,  0.5848,
         0.2887,  0.4208,  0.9051,  0.0279,  0.0613,  0.9266,  0.7128,
         0.1837,  0.1682,  0.9275,  0.9714,  0.9490,  0.9743,  0.7605,
         0.9389,  0.9334,  0.1454,  0.6952,  0.7171,  0.9078,  0.8578,
         0.6032,  0.0317,  0.0427,  0.7756,  0.0433,  0.8544,  0.8907,
         0.0115,  0.7464,  0.0630,  0.8753,  0.1368,  0.9031,  0.2276,
         0.9203,  0.9059,  0.9760,  0.1661,  0.7029,  0.0151,  0.2633,
         0.7419,  0.4446,  0.9183,  0.3081,  0.0164,  0.9037,  0.7969,
         0.7523,  0.8957,  0.0096,  0.5974,  0.1189,  0.5960,  0.3177,
         0.2178,  0.9320,  0.0145,  0.0237,  0.0019,  0.9342,  0.8994,
         0.8837,  0.0370,  0.0219,  0.8788,  0.0682,  0.8714,  0.9483,
         0.4280,  0.4077,  0.7881,  0.7562,  0.8309,  0.8745,  0.7440,
         0.7772,  0.0214,  0.8352,  0.9124,  0.8874,  0.0916,  0.4571,
         0.0244,  0.8686,  0.4514,  0.4675,  0.0242,  0.9142,  0.9357,
         0.8471,  0.4079,  0.5253,  0.0464,  0.6799,  0.0199,  0.7973,
         0.2738,  0.9219,  0.0070,  0.9748,  0.8561,  0.9171,  0.9289,
         0.9465,  0.0205,  0.7884,  0.1011,  0.0038,  0.0666,  0.9392,
         0.9543,  0.9386,  0.0750,  0.9000,  0.8777,  0.7244,  0.0115,
         0.0452,  0.9246,  0.0018,  0.0528,  0.8668,  0.9158,  0.8603,
         0.9757,  0.8892,  0.9015,  0.0717,  0.9156,  0.1838,  0.8500,
         0.5430,  0.0216,  0.7033,  0.8916,  0.6063,  0.0277,  0.8662,
         0.9532,  0.7651,  0.6909,  0.7963,  0.0186,  0.9357,  0.0011,
         0.8381,  0.9816,  0.6719,  0.0423,  0.0049,  0.1327,  0.0060,
         0.8927,  0.9636,  0.0119,  0.0176,  0.8947,  0.9988,  0.4428,
         0.0914,  0.1070,  0.9788,  0.1428,  0.0298,  0.9464,  0.9137,
         0.9557,  0.9275,  0.0395,  0.8642,  0.0288,  0.9451,  0.7983,
         0.9263,  0.9224,  0.0301,  0.8589,  0.0976,  0.9244,  0.9504,
         0.9530,  0.8539,  0.1765,  0.0084,  0.9118,  0.8777,  0.1707,
         0.8944,  0.7655,  0.9825,  0.9668,  0.9958,  0.0221,  0.3877,
         0.0087,  0.9387,  0.0163,  0.0163,  0.0456,  0.1775,  0.7762,
         0.0749,  0.1138,  0.9594,  0.0098,  0.0141,  0.6986,  0.9050,
         0.8582,  0.8575,  0.7911,  0.0117,  0.6734,  0.7769,  0.9100,
         0.8147,  0.8971,  0.9574,  0.0066,  0.9244,  0.0168,  0.9416,
         0.1414,  0.2620,  0.0198,  0.5155,  0.1131,  0.0092,  0.9097,
         0.6581,  0.6204,  0.6181,  0.7226,  0.0025,  0.0136,  0.0221,
         0.6611,  0.0015,  0.1219,  0.0412,  0.0068,  0.9685,  0.9854,
         0.9197,  0.0753,  0.4101,  0.5875,  0.9158,  0.0109,  0.8691,
         0.8072], device='cuda:0')
tensor(0.4240, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8070,  0.2491,  0.9413,  0.0603,  0.9075,  0.0100,  0.1335,
         0.0584,  0.0133,  0.6229,  0.8693,  0.0339,  0.8540,  0.8883,
         0.3559,  0.1952,  0.0186,  0.0564,  0.1853,  0.8870,  0.9284,
         0.9784,  0.9178,  0.0667,  0.6767,  0.9102,  0.7803,  0.8265,
         0.0649,  0.3742,  0.1110,  0.9206,  0.1585,  0.8762,  0.6432,
         0.3519,  0.8846,  0.0990,  0.9018,  0.2610,  0.9950,  0.8139,
         0.7748,  0.1505,  0.0219,  0.1853,  0.4192,  0.0386,  0.6067,
         0.0881,  0.0216,  0.0146,  0.0129,  0.0112,  0.0092,  0.1340,
         0.0134,  0.9893,  0.2909,  0.0233,  0.9321,  0.1381,  0.2649,
         0.9915,  0.9664,  0.8347,  0.9375,  0.3452,  0.7263,  0.9016,
         0.0987,  0.9938,  0.0353,  0.3666,  0.6925,  0.6864,  0.0747,
         0.1025,  0.4020,  0.4848,  0.8490,  0.0090,  0.0067,  0.6736,
         0.0014,  0.8839,  0.1405,  0.8001,  0.9170,  0.1115,  0.6058,
         0.1139,  0.8894,  0.9271,  0.0754,  0.9478,  0.8931,  0.9380,
         0.7985,  0.7779,  0.6775,  0.9553,  0.0139,  0.9970,  0.0271,
         0.9297,  0.8471,  0.0388,  0.0065,  0.8777,  0.1710,  0.9137,
         0.0495,  0.0080,  0.9987,  0.8954,  0.4340,  0.7970,  0.0344,
         0.1312,  0.0249,  0.0413,  0.9908,  0.7968,  0.9131,  0.9588,
         0.0190,  0.9127,  0.0995,  0.8545,  0.2614,  0.0162,  0.2049,
         0.0172,  0.0220,  0.0064,  0.0176,  0.0634,  0.1257,  0.0461,
         0.0595,  0.0242,  0.2123,  0.9931,  0.0943,  0.8463,  0.6134,
         0.8277,  0.0893,  0.5393,  0.0998,  0.9548,  0.3081,  0.0389,
         0.1996,  0.1667,  0.8554,  0.0061,  0.9389,  0.7548,  0.7350,
         0.8024,  0.0138,  0.2286,  0.8163,  0.0119,  0.6290,  0.0424,
         0.0239,  0.5573,  0.3764,  0.9050,  0.3840,  0.0032,  0.0327,
         0.9214,  0.2243,  0.0024,  0.0304,  0.0292,  0.0397,  0.0495,
         0.5912,  0.0072,  0.9742,  0.9540,  0.9706,  0.8506,  0.1085,
         0.9194,  0.9642,  0.5306,  0.0233,  0.8939,  0.0967,  0.0428,
         0.9872,  0.0150,  0.8487,  0.8861,  0.8863,  0.0923,  0.9024,
         0.9368,  0.3809,  0.9711,  0.0967,  0.2309,  0.0112,  0.6879,
         0.0063,  0.0443,  0.8860,  0.7233,  0.0193,  0.0159,  0.1028,
         0.7085,  0.8583,  0.0313,  0.0625,  0.2952,  0.9178,  0.0354,
         0.0021,  0.9662,  0.1058,  0.2180,  0.0794,  0.0146,  0.0503,
         0.0294,  0.2745,  0.0098,  0.8468,  0.8413,  0.8484,  0.8459,
         0.8192,  0.8182,  0.8254,  0.0548,  0.7973,  0.9396,  0.9309,
         0.1194,  0.0055,  0.6879,  0.7089,  0.2002,  0.9539,  0.8351,
         0.8762,  0.7646,  0.9812,  0.9149,  0.0235,  0.0685,  0.8705,
         0.9196,  0.1632,  0.3390,  0.9635,  0.9071,  0.1406,  0.0489,
         0.9291,  0.3840,  0.0072,  0.0991,  0.2034,  0.5146,  0.2211,
         0.8946,  0.1579,  0.8951,  0.0255,  0.6594,  0.9018,  0.2106,
         0.0119,  0.9897,  0.8079,  0.0097,  0.6095,  0.0419,  0.0036,
         0.0070,  0.3185,  0.0475,  0.9411,  0.8730,  0.0998,  0.2603,
         0.8983,  0.0141,  0.8129,  0.7913,  0.9333,  0.0828,  0.8647,
         0.0417,  0.7186,  0.0526,  0.9269,  0.7045,  0.3230,  0.7524,
         0.7929,  0.3416,  0.1130,  0.0242,  0.9969,  0.0654,  0.0572,
         0.9172,  0.7993,  0.9976,  0.7084,  0.0012,  0.0144,  0.0381,
         0.8422,  0.0091,  0.7726,  0.6562,  0.1981,  0.9251,  0.0074,
         0.8350,  0.8954,  0.2070,  0.1981,  0.9802,  0.1624,  0.5639,
         0.0194,  0.0056,  0.0438,  0.0046,  0.8754,  0.3834,  0.8522,
         0.4507,  0.7383,  0.0354,  0.6520,  0.7549,  0.7652,  0.0334,
         0.9691,  0.8717,  0.8893,  0.9012,  0.5655,  0.8836,  0.8567,
         0.7955,  0.0103,  0.0456,  0.9620,  0.0214,  0.0641,  0.1133,
         0.0103,  0.1275,  0.8415,  0.8739,  0.6049,  0.9584,  0.8852,
         0.9412,  0.0021,  0.8878,  0.9427,  0.7786,  0.0966,  0.0384,
         0.0977,  0.9656,  0.7966,  0.2377,  0.9711,  0.1393,  0.9509,
         0.9611,  0.0716,  0.7282,  0.0528,  0.8040,  0.9648,  0.0133,
         0.3543,  0.8522,  0.0265,  0.0321,  0.1020,  0.0785,  0.0590,
         0.9059,  0.4504,  0.4889,  0.0025,  0.3792,  0.9060,  0.0158,
         0.0217,  0.0056,  0.9709,  0.7558,  0.1159,  0.0747,  0.8917,
         0.9413,  0.1707,  0.0006,  0.9025,  0.9156,  0.0438,  0.9439,
         0.6952,  0.9467,  0.0354,  0.8668,  0.0590,  0.9573,  0.6911,
         0.0739,  0.7597,  0.8964,  0.9151,  0.2211,  0.7979,  0.4150,
         0.4386,  0.0131,  0.5301,  0.9462,  0.0930,  0.3148,  0.9031,
         0.0198,  0.9874,  0.8374,  0.2356,  0.9474,  0.0301,  0.3663,
         0.8275,  0.4983,  0.9870,  0.0097,  0.9688,  0.1977,  0.9807,
         0.0226,  0.9477,  0.0142,  0.8984,  0.7771,  0.8069,  0.9020,
         0.0326,  0.0243,  0.8967,  0.6780,  0.5786,  0.9903,  0.9039,
         0.0866,  0.6179,  0.2096,  0.2651,  0.0981,  0.9962,  0.8434,
         0.2397,  0.6625,  0.9156,  0.8575,  0.9147,  0.2179,  0.9217,
         0.9456,  0.6635,  0.8236,  0.8070,  0.0019,  0.0068,  0.1100,
         0.0013,  0.0282,  0.7525,  0.2731,  0.8956,  0.5496,  0.1433,
         0.0261,  0.0825,  0.2127,  0.4515,  0.7428,  0.8853,  0.8676,
         0.0206,  0.9347,  0.1621,  0.0577,  0.7182,  0.0618,  0.0866,
         0.0158], device='cuda:0')
tensor(0.3786, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7641,  0.4156,  0.9287,  0.8877,  0.9643,  0.9413,  0.8601,
         0.5616,  0.1375,  0.0674,  0.1921,  0.0657,  0.9237,  0.9393,
         0.9809,  0.0589,  0.9088,  0.0033,  0.3335,  0.9147,  0.8080,
         0.1201,  0.1153,  0.8179,  0.1614,  0.7527,  0.0643,  0.8919,
         0.9275,  0.6363,  0.2300,  0.9741,  0.5666,  0.8874,  0.0105,
         0.0781,  0.4008,  0.5611,  0.1195,  0.9906,  0.8937,  0.0771,
         0.9974,  0.0049,  0.2164,  0.8965,  0.8539,  0.0559,  0.5291,
         0.0676,  0.2844,  0.0436,  0.0191,  0.8111,  0.0104,  0.5856,
         0.7991,  0.9058,  0.0197,  0.1060,  0.2621,  0.1298,  0.8989,
         0.0455,  0.0571,  0.3280,  0.4595,  0.0042,  0.8293,  0.0398,
         0.9317,  0.6705,  0.0746,  0.9932,  0.9619,  0.5325,  0.9751,
         0.1703,  0.8089,  0.3854,  0.8606,  0.9519,  0.9149,  0.0067,
         0.9935,  0.8894,  0.1086,  0.0053,  0.4361,  0.4252,  0.9423,
         0.8104,  0.8246,  0.1432,  0.9628,  0.7279,  0.4699,  0.7745,
         0.0050,  0.9017,  0.4547,  0.9938,  0.1292,  0.9486,  0.7213,
         0.1019,  0.9194,  0.9588,  0.9241,  0.5636,  0.0560,  0.7597,
         0.7985,  0.0556,  0.8228,  0.0092,  0.5315,  0.8319,  0.9701,
         0.9211,  0.9064,  0.1954,  0.8660,  0.9687,  0.6311,  0.9902,
         0.8470,  0.8147,  0.0398,  0.0726,  0.2077,  0.7351,  0.9563,
         0.9262,  0.2444,  0.9155,  0.0122,  0.9181,  0.9247,  0.6233,
         0.9739,  0.0979,  0.2443,  0.1030,  0.8594,  0.9315,  0.1877,
         0.1676,  0.0217,  0.5978,  0.1576,  0.7732,  0.9075,  0.8412,
         0.0331,  0.0339,  0.1101,  0.9266,  0.2153,  0.0552,  0.0331,
         0.9216,  0.8352,  0.5722,  0.2008,  0.5115,  0.4587,  0.9827,
         0.9315,  0.6917,  0.0147,  0.0237,  0.0836,  0.1757,  0.0064,
         0.7437,  0.6846,  0.9471,  0.6780,  0.6214,  0.9321,  0.3562,
         0.8844,  0.9531,  0.1171,  0.2909,  0.4164,  0.9433,  0.0657,
         0.8466,  0.9483,  0.9277,  0.9540,  0.9137,  0.9026,  0.0274,
         0.0544,  0.8168,  0.8358,  0.9224,  0.1694,  0.0461,  0.8453,
         0.9749,  0.3252,  0.1805,  0.8897,  0.9668,  0.7824,  0.7044,
         0.9301,  0.6188,  0.8148,  0.0632,  0.7715,  0.8115,  0.8774,
         0.9041,  0.3655,  0.9579,  0.0785,  0.0422,  0.0481,  0.0423,
         0.8444,  0.2312,  0.1044,  0.8699,  0.0949,  0.9632,  0.0917,
         0.7745,  0.2927,  0.7837,  0.7967,  0.9297,  0.5415,  0.0064,
         0.0625,  0.2458,  0.7243,  0.8090,  0.7903,  0.9336,  0.0403,
         0.1263,  0.0719,  0.8743,  0.7342,  0.9492,  0.9507,  0.1673,
         0.7487,  0.9270,  0.9305,  0.8933,  0.9464,  0.3011,  0.9812,
         0.0177,  0.7058,  0.0191,  0.9607,  0.3664,  0.9021,  0.9201,
         0.9287,  0.7436,  0.9393,  0.1912,  0.0070,  0.0246,  0.4076,
         0.6375,  0.3080,  0.9476,  0.9645,  0.9471,  0.2067,  0.0578,
         0.2685,  0.9200,  0.7955,  0.7972,  0.1921,  0.8588,  0.9216,
         0.0214,  0.7511,  0.9713,  0.3599,  0.9927,  0.0154,  0.0101,
         0.0131,  0.5092,  0.4966,  0.0865,  0.8643,  0.2648,  0.8732,
         0.6062,  0.0737,  0.0329,  0.9094,  0.9411,  0.0249,  0.8194,
         0.9392,  0.8782,  0.0514,  0.9542,  0.6364,  0.8818,  0.9713,
         0.1742,  0.1749,  0.0460,  0.9555,  0.6319,  0.0653,  0.8355,
         0.8996,  0.8022,  0.0312,  0.9712,  0.9022,  0.0466,  0.7935,
         0.2741,  0.2072,  0.8119,  0.7504,  0.8232,  0.4211,  0.0393,
         0.1297,  0.3390,  0.0316,  0.1021,  0.3846,  0.2911,  0.1676,
         0.8376,  0.0373,  0.1811,  0.2443,  0.0311,  0.9556,  0.5557,
         0.0178,  0.0109,  0.9111,  0.1427,  0.1077,  0.0562,  0.8917,
         0.0579,  0.7345,  0.7868,  0.9453,  0.8372,  0.3641,  0.5050,
         0.2377,  0.8911,  0.8850,  0.5470,  0.8042,  0.2894,  0.0130,
         0.6437,  0.9548,  0.2799,  0.8564,  0.9054,  0.3096,  0.7396,
         0.8045,  0.1235,  0.8973,  0.0456,  0.0129,  0.0351,  0.9703,
         0.8584,  0.9106,  0.9075,  0.9228,  0.1625,  0.9405,  0.6760,
         0.0977,  0.8683,  0.5598,  0.0252,  0.5461,  0.6280,  0.7948,
         0.7554,  0.0921,  0.7916,  0.9751,  0.8852,  0.0286,  0.7540,
         0.8623,  0.0421,  0.1142,  0.9249,  0.7509,  0.0297,  0.2760,
         0.8924,  0.8063,  0.8595,  0.9852,  0.8092,  0.8870,  0.8105,
         0.1054,  0.8871,  0.9345,  0.8597,  0.8833,  0.8906,  0.0440,
         0.0372,  0.8260,  0.5069,  0.8437,  0.1703,  0.4221,  0.7939,
         0.9653,  0.5073,  0.9169,  0.7058,  0.9699,  0.1505,  0.8253,
         0.0222,  0.8649,  0.5366,  0.3820,  0.7505,  0.0456,  0.6359,
         0.0955,  0.0495,  0.0221,  0.1311,  0.0038,  0.8888,  0.0300,
         0.8342,  0.0239,  0.9167,  0.7884,  0.1146,  0.0311,  0.1855,
         0.6457,  0.9383,  0.9483,  0.0134,  0.6973,  0.0672,  0.4724,
         0.7496,  0.4055,  0.4363,  0.0838,  0.9959,  0.2068,  0.7582,
         0.9115,  0.9962,  0.8398,  0.9084,  0.9310,  0.1159,  0.3691,
         0.8984,  0.0300,  0.9451,  0.6983,  0.4594,  0.9803,  0.8045,
         0.2517,  0.1767,  0.0583,  0.0953,  0.9035,  0.0078,  0.6052,
         0.8599,  0.8984,  0.9381,  0.9485,  0.3320,  0.0489,  0.0105,
         0.9317,  0.0843,  0.0784,  0.9585,  0.0239,  0.8618,  0.9140,
         0.8530], device='cuda:0')
tensor(0.3139, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3648,  0.7445,  0.0565,  0.9561,  0.8734,  0.8885,  0.9654,
         0.6159,  0.9820,  0.1624,  0.1033,  0.7508,  0.7524,  0.0937,
         0.7800,  0.0924,  0.9698,  0.9408,  0.1589,  0.9310,  0.0245,
         0.0096,  0.0492,  0.0272,  0.2949,  0.8730,  0.7991,  0.6657,
         0.8225,  0.9008,  0.8511,  0.3290,  0.0060,  0.3410,  0.8830,
         0.4172,  0.4240,  0.5672,  0.8446,  0.4661,  0.5629,  0.3166,
         0.1017,  0.7003,  0.9511,  0.0845,  0.8514,  0.8027,  0.3417,
         0.4832,  0.8453,  0.8492,  0.8920,  0.1042,  0.2921,  0.3129,
         0.1707,  0.2265,  0.7350,  0.8782,  0.9292,  0.9110,  0.1585,
         0.5531,  0.8747,  0.8687,  0.8512,  0.8820,  0.5971,  0.5521,
         0.9129,  0.8925,  0.2999,  0.3080,  0.3062,  0.7684,  0.9570,
         0.5697,  0.8980,  0.8997,  0.0129,  0.9391,  0.3895,  0.0793,
         0.8249,  0.1120,  0.2112,  0.1319,  0.1069,  0.8940,  0.1848,
         0.0260,  0.0672,  0.9698,  0.7911,  0.0534,  0.6472,  0.4017,
         0.0476,  0.2348,  0.3603,  0.4388,  0.9142,  0.5911,  0.8214,
         0.5343,  0.0153,  0.8664,  0.1096,  0.0415,  0.8968,  0.9219,
         0.7841,  0.6784,  0.8965,  0.2261,  0.8820,  0.0113,  0.3847,
         0.1843,  0.8804,  0.8499,  0.3224,  0.9082,  0.8423,  0.0484,
         0.1622,  0.8818,  0.0354,  0.0974,  0.4818,  0.2805,  0.1509,
         0.5467,  0.8766,  0.0691,  0.8572,  0.1872,  0.2046,  0.3705,
         0.4152,  0.3080,  0.4643,  0.1562,  0.0893,  0.0467,  0.7233,
         0.7502,  0.0809,  0.0219,  0.1958,  0.8815,  0.7958,  0.0106,
         0.0122,  0.9269,  0.0757,  0.1921,  0.0774,  0.9562,  0.6955,
         0.7552,  0.1219,  0.9245,  0.5957,  0.9169,  0.0487,  0.9512,
         0.7121,  0.9074,  0.9148,  0.0254,  0.8829,  0.7243,  0.8461,
         0.9154,  0.8942,  0.8648,  0.0024,  0.1142,  0.3812,  0.3248,
         0.3017,  0.6129,  0.6982,  0.6969,  0.9556,  0.9074,  0.1921,
         0.9161,  0.1488,  0.1747,  0.2895,  0.7460,  0.8991,  0.8462,
         0.1713,  0.7945,  0.8352,  0.0312,  0.0261,  0.8107,  0.2522,
         0.5749,  0.9555,  0.7318,  0.8303,  0.8804,  0.1334,  0.1132,
         0.1993,  0.9915,  0.0306,  0.2557,  0.7363,  0.7670,  0.2518,
         0.8330,  0.0695,  0.2761,  0.9142,  0.0483,  0.3346,  0.7635,
         0.4790,  0.0432,  0.5118,  0.0821,  0.7490,  0.1212,  0.2408,
         0.1773,  0.4090,  0.6272,  0.1503,  0.2646,  0.0904,  0.4955,
         0.7791,  0.0866,  0.9200,  0.1164,  0.4777,  0.4110,  0.6320,
         0.5458,  0.7420,  0.1680,  0.7372,  0.7590,  0.4979,  0.3420,
         0.2524,  0.1660,  0.1269,  0.9466,  0.9198,  0.9008,  0.0384,
         0.4298,  0.0879,  0.7315,  0.7981,  0.5764,  0.1322,  0.1647,
         0.8402,  0.4624,  0.0882,  0.1334,  0.4978,  0.2055,  0.0873,
         0.6172,  0.3735,  0.6482,  0.8726,  0.0649,  0.9819,  0.0594,
         0.6881,  0.8641,  0.7916,  0.7873,  0.4287,  0.0465,  0.7627,
         0.0824,  0.0666,  0.9164,  0.6520,  0.6075,  0.6679,  0.0029,
         0.0311,  0.6596,  0.9474,  0.4035,  0.0215,  0.9090,  0.9491,
         0.8554,  0.3689,  0.4000,  0.0680,  0.3006,  0.0896,  0.8723,
         0.3556,  0.7220,  0.8148,  0.0441,  0.1747,  0.8662,  0.0261,
         0.1250,  0.9053,  0.3406,  0.0109,  0.6565,  0.9885,  0.2852,
         0.9381,  0.4974,  0.1182,  0.0124,  0.8077,  0.1162,  0.0257,
         0.2728,  0.8230,  0.9058,  0.6512,  0.4488,  0.5843,  0.1457,
         0.0831,  0.4934,  0.8107,  0.7171,  0.9890,  0.3771,  0.9307,
         0.0232,  0.2364,  0.6594,  0.2028,  0.9307,  0.0684,  0.3702,
         0.0554,  0.5520,  0.9088,  0.9052,  0.8117,  0.1249,  0.6544,
         0.7842,  0.0924,  0.2539,  0.1639,  0.7678,  0.8569,  0.5086,
         0.9969,  0.9921,  0.0112,  0.7867,  0.0360,  0.0491,  0.9648,
         0.7955,  0.6885,  0.7704,  0.6614,  0.8930,  0.3703,  0.6762,
         0.1850,  0.0279,  0.6705,  0.3621,  0.9665,  0.1989,  0.0613,
         0.7410,  0.7927,  0.1006,  0.4781,  0.6036,  0.5481,  0.1563,
         0.8993,  0.1227,  0.1221,  0.0728,  0.7681,  0.8539,  0.7842,
         0.9068,  0.8827,  0.0508,  0.0610,  0.0054,  0.9379,  0.1513,
         0.6084,  0.0310,  0.3444,  0.0513,  0.0316,  0.9137,  0.4695,
         0.6795,  0.0179,  0.9688,  0.2532,  0.3456,  0.7072,  0.4589,
         0.6952,  0.1083,  0.0935,  0.8766,  0.2755,  0.8547,  0.8950,
         0.0747,  0.9919,  0.8154,  0.8914,  0.7505,  0.0174,  0.4847,
         0.9008,  0.8075,  0.8492,  0.3562,  0.3804,  0.5381,  0.5547,
         0.8903,  0.0710,  0.9362,  0.8524,  0.0924,  0.5054,  0.4298,
         0.2006,  0.9577,  0.0445,  0.3805,  0.0963,  0.0201,  0.0769,
         0.7477,  0.8087,  0.0028,  0.8545,  0.9264,  0.0820,  0.5214,
         0.9664,  0.1094,  0.9044,  0.1752,  0.8241,  0.8740,  0.1158,
         0.9584,  0.3350,  0.7349,  0.7514,  0.8595,  0.0485,  0.0889,
         0.8298,  0.6199,  0.2366,  0.9490,  0.0714,  0.1351,  0.4215,
         0.9234,  0.2141,  0.9938,  0.9336,  0.7947,  0.6404,  0.8492,
         0.0631,  0.9881,  0.2572,  0.0587,  0.0409,  0.9164,  0.1849,
         0.5888,  0.7467,  0.4880,  0.8030,  0.0787,  0.5299,  0.1315,
         0.8369,  0.5934,  0.0183,  0.3864,  0.5700,  0.8345,  0.2378,
         0.7719], device='cuda:0')
tensor(0.3464, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7325,  0.2055,  0.6184,  0.1510,  0.0388,  0.8288,  0.2073,
         0.1126,  0.0239,  0.8566,  0.1282,  0.9452,  0.9617,  0.9119,
         0.3567,  0.2134,  0.4972,  0.4568,  0.9172,  0.1912,  0.8454,
         0.3358,  0.0799,  0.0766,  0.7370,  0.3848,  0.9210,  0.8854,
         0.9074,  0.4668,  0.2301,  0.8453,  0.9317,  0.2787,  0.1314,
         0.8691,  0.6397,  0.2719,  0.6675,  0.2193,  0.9266,  0.0192,
         0.0296,  0.9519,  0.7841,  0.0245,  0.3176,  0.3077,  0.2495,
         0.8736,  0.9330,  0.8595,  0.1829,  0.3319,  0.7474,  0.8357,
         0.0754,  0.8335,  0.9434,  0.8752,  0.0472,  0.1144,  0.6282,
         0.0556,  0.4804,  0.1102,  0.6137,  0.5419,  0.9686,  0.4906,
         0.8306,  0.8475,  0.9390,  0.2302,  0.7076,  0.2766,  0.6895,
         0.1270,  0.0235,  0.8674,  0.4377,  0.0061,  0.9719,  0.8809,
         0.0176,  0.7376,  0.1379,  0.7042,  0.7458,  0.4697,  0.2206,
         0.6821,  0.2194,  0.9502,  0.8911,  0.1681,  0.7291,  0.8390,
         0.9764,  0.9981,  0.2054,  0.0397,  0.3313,  0.4631,  0.0326,
         0.9044,  0.8500,  0.1181,  0.9660,  0.8265,  0.0841,  0.2136,
         0.7554,  0.4816,  0.7469,  0.8270,  0.9565,  0.7281,  0.6787,
         0.2707,  0.2494,  0.1450,  0.9906,  0.7553,  0.3935,  0.8481,
         0.7910,  0.4743,  0.8660,  0.6524,  0.0068,  0.3217,  0.0906,
         0.3997,  0.9340,  0.1322,  0.7560,  0.8806,  0.7398,  0.0956,
         0.3883,  0.6077,  0.8887,  0.4782,  0.2559,  0.2471,  0.8852,
         0.0738,  0.9190,  0.1592,  0.1101,  0.8723,  0.9154,  0.0911,
         0.5452,  0.0646,  0.7519,  0.7423,  0.2122,  0.7566,  0.7183,
         0.2006,  0.0919,  0.9229,  0.7506,  0.6708,  0.4442,  0.8381,
         0.1813,  0.1486,  0.8351,  0.0931,  0.7029,  0.8388,  0.2327,
         0.1594,  0.1008,  0.6913,  0.3515,  0.1221,  0.3467,  0.0554,
         0.6675,  0.0615,  0.8520,  0.9633,  0.0346,  0.0725,  0.1862,
         0.3541,  0.0320,  0.6433,  0.3849,  0.3102,  0.7723,  0.7856,
         0.6480,  0.8813,  0.7144,  0.0101,  0.5107,  0.8912,  0.9687,
         0.9473,  0.4754,  0.8559,  0.0684,  0.0232,  0.7391,  0.3801,
         0.0180,  0.2210,  0.8578,  0.4209,  0.5024,  0.0337,  0.8964,
         0.5991,  0.8909,  0.0430,  0.8115,  0.0884,  0.5986,  0.7841,
         0.9351,  0.0903,  0.1037,  0.1665,  0.0082,  0.0992,  0.8672,
         0.9171,  0.8977,  0.3770,  0.0500,  0.3439,  0.5692,  0.0575,
         0.0150,  0.0891,  0.1860,  0.3945,  0.8199,  0.0968,  0.3137,
         0.8685,  0.5680,  0.8381,  0.8754,  0.1702,  0.2988,  0.9522,
         0.1256,  0.8252,  0.2275,  0.1415,  0.0532,  0.8061,  0.7331,
         0.3190,  0.5492,  0.8095,  0.3669,  0.2414,  0.1232,  0.6126,
         0.8586,  0.2289,  0.4673,  0.0460,  0.9538,  0.8034,  0.1481,
         0.6477,  0.5713,  0.4731,  0.7339,  0.0459,  0.8417,  0.0374,
         0.0258,  0.9241,  0.8814,  0.1568,  0.0389,  0.0084,  0.6426,
         0.8746,  0.8646,  0.0090,  0.6909,  0.7178,  0.8494,  0.8833,
         0.8608,  0.0167,  0.5340,  0.5746,  0.8760,  0.0703,  0.0923,
         0.4779,  0.0619,  0.8442,  0.9224,  0.0864,  0.7036,  0.6615,
         0.0676,  0.1106,  0.3235,  0.9408,  0.2518,  0.7672,  0.3840,
         0.8253,  0.8798,  0.9117,  0.9666,  0.3550,  0.7124,  0.0202,
         0.4680,  0.1326,  0.2027,  0.8890,  0.2104,  0.9020,  0.5863,
         0.1009,  0.2754,  0.9330,  0.0138,  0.0707,  0.1439,  0.0851,
         0.6940,  0.0421,  0.0964,  0.1888,  0.8623,  0.5727,  0.8138,
         0.9365,  0.6485,  0.1894,  0.4734,  0.9104,  0.2663,  0.5166,
         0.3868,  0.1873,  0.0606,  0.5009,  0.8855,  0.7947,  0.1065,
         0.7001,  0.8623,  0.7971,  0.9510,  0.3737,  0.7009,  0.1616,
         0.0453,  0.5402,  0.2740,  0.3594,  0.4357,  0.8110,  0.9890,
         0.0743,  0.1487,  0.0823,  0.2085,  0.7687,  0.7805,  0.7766,
         0.9938,  0.2940,  0.7872,  0.7658,  0.6759,  0.0843,  0.1185,
         0.2102,  0.7010,  0.2767,  0.3849,  0.1960,  0.3864,  0.6589,
         0.6071,  0.4415,  0.1376,  0.1358,  0.2312,  0.1266,  0.0883,
         0.6647,  0.8728,  0.8258,  0.8970,  0.0722,  0.8920,  0.8933,
         0.0854,  0.8983,  0.9705,  0.4174,  0.9142,  0.0457,  0.1274,
         0.1591,  0.8812,  0.6924,  0.1472,  0.9858,  0.8420,  0.2979,
         0.3377,  0.6633,  0.0416,  0.4782,  0.2776,  0.1625,  0.8712,
         0.3351,  0.1118,  0.0525,  0.4078,  0.0977,  0.0177,  0.9276,
         0.8264,  0.4755,  0.9202,  0.0143,  0.0794,  0.8596,  0.0052,
         0.3404,  0.0392,  0.5486,  0.6012,  0.8823,  0.7012,  0.9008,
         0.9668,  0.0424,  0.9491,  0.1996,  0.2712,  0.3211,  0.8992,
         0.9093,  0.0137,  0.4634,  0.7125,  0.6820,  0.7558,  0.8434,
         0.1416,  0.8621,  0.4175,  0.6342,  0.1345,  0.5197,  0.3676,
         0.8389,  0.7168,  0.1655,  0.8267,  0.2054,  0.8893,  0.7899,
         0.4428,  0.8254,  0.7667,  0.0520,  0.0089,  0.9478,  0.0075,
         0.2311,  0.7242,  0.9616,  0.9495,  0.1956,  0.2726,  0.3277,
         0.7333,  0.0366,  0.9539,  0.4373,  0.5579,  0.1968,  0.1842,
         0.5153,  0.7117,  0.7823,  0.8804,  0.0567,  0.0582,  0.7696,
         0.0062,  0.8222,  0.2835,  0.9936,  0.0711,  0.3065,  0.1023,
         0.3813], device='cuda:0')
tensor(0.3546, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8559,  0.6851,  0.6551,  0.4886,  0.2393,  0.9593,  0.7269,
         0.9969,  0.8293,  0.2783,  0.5828,  0.6446,  0.0308,  0.0564,
         0.7634,  0.3076,  0.1998,  0.0353,  0.5739,  0.5383,  0.1213,
         0.0327,  0.2551,  0.8315,  0.0565,  0.2896,  0.9979,  0.3706,
         0.0714,  0.1282,  0.0702,  0.0533,  0.0039,  0.9229,  0.0907,
         0.3995,  0.6930,  0.2159,  0.4837,  0.0979,  0.4071,  0.1161,
         0.2976,  0.3285,  0.9499,  0.1744,  0.7874,  0.6188,  0.4941,
         0.8263,  0.6500,  0.9698,  0.9047,  0.8286,  0.2942,  0.6005,
         0.3167,  0.8515,  0.1535,  0.9222,  0.1617,  0.1990,  0.1058,
         0.8083,  0.7125,  0.5725,  0.8447,  0.3632,  0.7152,  0.6648,
         0.9590,  0.7281,  0.1872,  0.0500,  0.6157,  0.5726,  0.7798,
         0.1368,  0.9777,  0.9807,  0.8440,  0.0276,  0.1910,  0.3864,
         0.0144,  0.0726,  0.3837,  0.7752,  0.7827,  0.0561,  0.8220,
         0.0729,  0.4042,  0.0376,  0.4681,  0.8449,  0.0518,  0.1441,
         0.4739,  0.2553,  0.3034,  0.0635,  0.4721,  0.5718,  0.2569,
         0.5998,  0.1639,  0.7546,  0.0617,  0.3316,  0.6003,  0.7204,
         0.7992,  0.4123,  0.9847,  0.2248,  0.5676,  0.1448,  0.0893,
         0.2588,  0.1340,  0.7939,  0.8964,  0.8934,  0.9703,  0.9812,
         0.1683,  0.2807,  0.0041,  0.7748,  0.0272,  0.3338,  0.9753,
         0.3745,  0.1137,  0.5653,  0.0109,  0.1227,  0.9525,  0.6798,
         0.8436,  0.1383,  0.2421,  0.0036,  0.9631,  0.0164,  0.8280,
         0.7630,  0.0647,  0.7158,  0.8982,  0.9722,  0.8604,  0.9220,
         0.0513,  0.0742,  0.7074,  0.7665,  0.8914,  0.9970,  0.1447,
         0.8426,  0.4502,  0.0686,  0.5305,  0.1217,  0.2259,  0.8222,
         0.0046,  0.1293,  0.9395,  0.6473,  0.7250,  0.7817,  0.1958,
         0.0185,  0.8056,  0.0669,  0.9091,  0.9727,  0.4755,  0.2305,
         0.9181,  0.4399,  0.6725,  0.8613,  0.9222,  0.2150,  0.1433,
         0.5897,  0.1909,  0.2015,  0.4563,  0.0553,  0.5225,  0.1156,
         0.0337,  0.1200,  0.6809,  0.5248,  0.0357,  0.1753,  0.1005,
         0.0114,  0.0505,  0.4715,  0.9516,  0.6704,  0.2918,  0.9903,
         0.9473,  0.9588,  0.1872,  0.1318,  0.0473,  0.5426,  0.8660,
         0.3027,  0.8734,  0.9245,  0.8099,  0.9344,  0.1277,  0.8924,
         0.6389,  0.8581,  0.9116,  0.9053,  0.1408,  0.6969,  0.2396,
         0.5596,  0.1648,  0.2504,  0.5047,  0.7142,  0.0429,  0.1488,
         0.3264,  0.1813,  0.7268,  0.1515,  0.0959,  0.2308,  0.2123,
         0.1567,  0.6727,  0.0234,  0.0682,  0.0426,  0.0057,  0.8131,
         0.0800,  0.1194,  0.6985,  0.3327,  0.6666,  0.8176,  0.6778,
         0.7861,  0.8110,  0.8538,  0.3305,  0.0685,  0.0352,  0.8842,
         0.0078,  0.2889,  0.1903,  0.3367,  0.2561,  0.0546,  0.0723,
         0.9069,  0.2418,  0.0424,  0.9165,  0.5922,  0.0729,  0.7276,
         0.7208,  0.9869,  0.5692,  0.0537,  0.0848,  0.7774,  0.7264,
         0.2622,  0.6306,  0.5010,  0.7317,  0.9216,  0.8487,  0.9580,
         0.7627,  0.0375,  0.3535,  0.5451,  0.0519,  0.2257,  0.8346,
         0.9587,  0.1108,  0.9094,  0.8010,  0.6345,  0.4779,  0.0907,
         0.9352,  0.0521,  0.9419,  0.4705,  0.0194,  0.1069,  0.2995,
         0.4431,  0.4309,  0.0040,  0.0118,  0.3348,  0.4369,  0.6695,
         0.1872,  0.9479,  0.0590,  0.8552,  0.9514,  0.8530,  0.1294,
         0.8776,  0.3440,  0.1925,  0.8947,  0.0869,  0.1703,  0.0386,
         0.6581,  0.6989,  0.0353,  0.3191,  0.4016,  0.6752,  0.1471,
         0.2859,  0.1679,  0.0280,  0.7960,  0.6601,  0.8186,  0.0402,
         0.9706,  0.9927,  0.6016,  0.0067,  0.0627,  0.6617,  0.0047,
         0.3910,  0.5983,  0.8956,  0.9218,  0.0304,  0.8097,  0.7700,
         0.7670,  0.7859,  0.9422,  0.3343,  0.3129,  0.7197,  0.9869,
         0.3783,  0.0441,  0.6670,  0.0783,  0.3671,  0.9393,  0.1099,
         0.3064,  0.8667,  0.8568,  0.4002,  0.9041,  0.0626,  0.9743,
         0.8908,  0.1509,  0.1604,  0.2988,  0.6775,  0.0031,  0.8862,
         0.7012,  0.0845,  0.0306,  0.0487,  0.4035,  0.4824,  0.0573,
         0.8756,  0.3474,  0.9902,  0.9155,  0.3995,  0.5649,  0.0698,
         0.2086,  0.9659,  0.0492,  0.1323,  0.2042,  0.9260,  0.5726,
         0.2453,  0.8546,  0.7123,  0.8154,  0.3141,  0.8205,  0.1852,
         0.7580,  0.0132,  0.6114,  0.3983,  0.4095,  0.7758,  0.5066,
         0.4359,  0.0492,  0.0898,  0.0134,  0.5720,  0.8253,  0.0152,
         0.3466,  0.0958,  0.0268,  0.2514,  0.6320,  0.0053,  0.7461,
         0.8917,  0.9130,  0.8861,  0.0297,  0.9552,  0.0515,  0.9443,
         0.1038,  0.9024,  0.1251,  0.3889,  0.1965,  0.7321,  0.8912,
         0.0520,  0.0486,  0.0687,  0.0058,  0.6715,  0.8277,  0.5076,
         0.2824,  0.6643,  0.9878,  0.1289,  0.2464,  0.1364,  0.1898,
         0.2756,  0.3716,  0.8310,  0.2997,  0.8645,  0.7101,  0.5087,
         0.8963,  0.5691,  0.7324,  0.9601,  0.8022,  0.9702,  0.2060,
         0.9087,  0.0296,  0.0409,  0.9056,  0.5011,  0.8316,  0.0298,
         0.1000,  0.1561,  0.8828,  0.3020,  0.9288,  0.9094,  0.5762,
         0.4097,  0.9094,  0.7647,  0.5868,  0.8687,  0.6000,  0.0179,
         0.7948,  0.0250,  0.8584,  0.9010,  0.0299,  0.0450,  0.8012,
         0.2748], device='cuda:0')
tensor(0.3728, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0876,  0.1738,  0.0725,  0.1841,  0.0993,  0.2085,  0.4053,
         0.4751,  0.9630,  0.6066,  0.0254,  0.0128,  0.1086,  0.0926,
         0.0317,  0.8982,  0.9683,  0.4648,  0.1099,  0.0522,  0.1091,
         0.8317,  0.3495,  0.4664,  0.8984,  0.0503,  0.7099,  0.0691,
         0.2236,  0.4270,  0.6917,  0.9664,  0.9437,  0.2515,  0.7650,
         0.1067,  0.8592,  0.0608,  0.1320,  0.8496,  0.6103,  0.1127,
         0.7671,  0.6040,  0.0217,  0.9529,  0.8949,  0.0030,  0.0474,
         0.7936,  0.0605,  0.9058,  0.0416,  0.7409,  0.6922,  0.4860,
         0.5835,  0.9873,  0.4209,  0.1076,  0.9002,  0.0384,  0.8630,
         0.2945,  0.2655,  0.0195,  0.5599,  0.1147,  0.0671,  0.1877,
         0.8467,  0.1620,  0.1390,  0.3916,  0.2061,  0.9067,  0.7759,
         0.0267,  0.4280,  0.3589,  0.6071,  0.1917,  0.8453,  0.0178,
         0.1320,  0.1053,  0.3055,  0.6073,  0.6802,  0.8786,  0.4222,
         0.4062,  0.1098,  0.9389,  0.3507,  0.9225,  0.3829,  0.1041,
         0.0943,  0.9454,  0.0452,  0.7930,  0.1494,  0.0250,  0.1927,
         0.8245,  0.3067,  0.0601,  0.0982,  0.8732,  0.3908,  0.1961,
         0.0378,  0.1796,  0.1934,  0.5769,  0.0895,  0.2196,  0.5001,
         0.3872,  0.6948,  0.7988,  0.3213,  0.8474,  0.3294,  0.3237,
         0.1677,  0.8969,  0.0581,  0.0967,  0.7341,  0.6739,  0.0328,
         0.9346,  0.9300,  0.0874,  0.2513,  0.0583,  0.9697,  0.5652,
         0.2748,  0.0634,  0.7575,  0.7481,  0.9382,  0.9087,  0.6016,
         0.2697,  0.6147,  0.8054,  0.9339,  0.0554,  0.0167,  0.9556,
         0.9670,  0.9535,  0.2323,  0.1916,  0.2218,  0.8901,  0.9774,
         0.8059,  0.5326,  0.4418,  0.0240,  0.3134,  0.7836,  0.7398,
         0.3485,  0.9032,  0.1157,  0.0503,  0.2645,  0.0862,  0.8424,
         0.1731,  0.4072,  0.8213,  0.9451,  0.0338,  0.9459,  0.6100,
         0.9259,  0.9762,  0.5226,  0.4199,  0.2387,  0.2880,  0.2363,
         0.7127,  0.9700,  0.2597,  0.5916,  0.0835,  0.1019,  0.2555,
         0.1732,  0.9825,  0.0402,  0.3220,  0.0321,  0.5457,  0.4212,
         0.8239,  0.9613,  0.0457,  0.0202,  0.3622,  0.0710,  0.9377,
         0.5113,  0.1223,  0.1198,  0.2797,  0.7934,  0.9928,  0.9533,
         0.9054,  0.9523,  0.4011,  0.2925,  0.1445,  0.7116,  0.1639,
         0.0317,  0.8357,  0.8638,  0.3920,  0.3985,  0.6531,  0.8732,
         0.0390,  0.8543,  0.9009,  0.1472,  0.0668,  0.9606,  0.0045,
         0.3986,  0.0070,  0.6086,  0.5230,  0.9944,  0.7941,  0.7721,
         0.0775,  0.3593,  0.5352,  0.1288,  0.5310,  0.8162,  0.0456,
         0.6521,  0.9588,  0.9268,  0.8941,  0.1871,  0.8827,  0.7963,
         0.0309,  0.0976,  0.9718,  0.2208,  0.8508,  0.6491,  0.7471,
         0.0706,  0.5692,  0.9193,  0.5171,  0.0412,  0.0266,  0.3403,
         0.9802,  0.5095,  0.9052,  0.3620,  0.2688,  0.9330,  0.1288,
         0.0475,  0.1505,  0.6476,  0.0969,  0.9781,  0.5326,  0.0101,
         0.0060,  0.1776,  0.9990,  0.0285,  0.0924,  0.1287,  0.9342,
         0.1681,  0.6142,  0.0197,  0.0216,  0.8952,  0.0908,  0.1928,
         0.0271,  0.7488,  0.2857,  0.7098,  0.9503,  0.8894,  0.0564,
         0.9202,  0.7711,  0.4859,  0.6560,  0.0368,  0.0704,  0.2565,
         0.8396,  0.4900,  0.9488,  0.3513,  0.0479,  0.7029,  0.0338,
         0.3589,  0.0844,  0.8691,  0.3425,  0.3555,  0.0384,  0.8757,
         0.1039,  0.4126,  0.1283,  0.9483,  0.2203,  0.0736,  0.0668,
         0.0344,  0.0548,  0.3036,  0.0394,  0.3699,  0.2665,  0.8883,
         0.9421,  0.0357,  0.1128,  0.8423,  0.8717,  0.7552,  0.5939,
         0.0425,  0.0518,  0.4311,  0.2511,  0.8249,  0.7744,  0.5998,
         0.3239,  0.8474,  0.2629,  0.8760,  0.0619,  0.8966,  0.5095,
         0.2817,  0.0755,  0.8087,  0.8668,  0.7279,  0.0074,  0.9817,
         0.8438,  0.1363,  0.9621,  0.1700,  0.0945,  0.7477,  0.8983,
         0.0289,  0.5904,  0.1422,  0.9292,  0.4754,  0.9116,  0.0152,
         0.2098,  0.4634,  0.9221,  0.9322,  0.2657,  0.1958,  0.1983,
         0.4389,  0.9095,  0.1667,  0.4278,  0.0777,  0.8599,  0.0641,
         0.9670,  0.8731,  0.0411,  0.8508,  0.1302,  0.1868,  0.8867,
         0.0420,  0.7307,  0.0781,  0.0077,  0.6677,  0.7263,  0.0931,
         0.5994,  0.9494,  0.5311,  0.0435,  0.0083,  0.0362,  0.5871,
         0.0346,  0.5520,  0.0635,  0.1173,  0.5992,  0.0377,  0.0606,
         0.9671,  0.8050,  0.7961,  0.7628,  0.7133,  0.7714,  0.5973,
         0.3584,  0.2026,  0.0958,  0.9338,  0.6141,  0.0105,  0.9466,
         0.0460,  0.0736,  0.1574,  0.9697,  0.8532,  0.2364,  0.9734,
         0.2251,  0.1450,  0.0146,  0.6696,  0.9947,  0.2528,  0.2665,
         0.3325,  0.0047,  0.9817,  0.4689,  0.3358,  0.4483,  0.6766,
         0.1180,  0.0056,  0.0192,  0.5438,  0.7791,  0.9276,  0.8775,
         0.8685,  0.8467,  0.1094,  0.1250,  0.0411,  0.6095,  0.8149,
         0.3812,  0.9236,  0.1708,  0.0486,  0.4512,  0.3233,  0.0457,
         0.5806,  0.5829,  0.9440,  0.0992,  0.6209,  0.8043,  0.1549,
         0.1222,  0.8018,  0.9574,  0.1628,  0.2374,  0.8947,  0.9012,
         0.5166,  0.1398,  0.7734,  0.8222,  0.8985,  0.5044,  0.2631,
         0.9773,  0.9697,  0.7080,  0.0823,  0.1588,  0.6096,  0.4665,
         0.2533], device='cuda:0')
tensor(0.3682, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0129,  0.9144,  0.0214,  0.3801,  0.3983,  0.5974,  0.0105,
         0.3776,  0.7993,  0.9214,  0.7606,  0.0369,  0.0313,  0.8371,
         0.0225,  0.4357,  0.3361,  0.9230,  0.0151,  0.6454,  0.9686,
         0.2778,  0.1488,  0.2222,  0.9799,  0.9952,  0.9114,  0.1890,
         0.9556,  0.0056,  0.0763,  0.8057,  0.8686,  0.4216,  0.2197,
         0.7268,  0.3321,  0.9241,  0.0657,  0.0831,  0.7779,  0.9311,
         0.1333,  0.2174,  0.0565,  0.1076,  0.1416,  0.0373,  0.5979,
         0.0813,  0.9649,  0.0502,  0.1064,  0.0315,  0.0336,  0.0888,
         0.2377,  0.0599,  0.9968,  0.1051,  0.7829,  0.9896,  0.9769,
         0.8974,  0.3720,  0.0479,  0.0877,  0.6440,  0.0092,  0.6822,
         0.3695,  0.0321,  0.5254,  0.5336,  0.8782,  0.8613,  0.6639,
         0.0361,  0.7652,  0.9621,  0.5678,  0.6113,  0.9480,  0.5030,
         0.1064,  0.1237,  0.3181,  0.7843,  0.1032,  0.9306,  0.0692,
         0.9394,  0.0275,  0.6038,  0.0872,  0.1611,  0.6186,  0.9112,
         0.1720,  0.3915,  0.1504,  0.0462,  0.0310,  0.1752,  0.1021,
         0.9813,  0.9445,  0.0426,  0.9708,  0.6750,  0.8478,  0.7894,
         0.9183,  0.0392,  0.8777,  0.0608,  0.9433,  0.9295,  0.9722,
         0.2810,  0.0712,  0.6482,  0.0263,  0.7155,  0.0862,  0.0468,
         0.9087,  0.9138,  0.2159,  0.1041,  0.0362,  0.9978,  0.0594,
         0.7085,  0.9565,  0.0523,  0.9592,  0.3006,  0.9136,  0.9704,
         0.0498,  0.8148,  0.7610,  0.7283,  0.8245,  0.0833,  0.1473,
         0.2410,  0.8955,  0.0602,  0.7683,  0.4264,  0.7900,  0.9791,
         0.3084,  0.8993,  0.8869,  0.0038,  0.9762,  0.7993,  0.8119,
         0.1108,  0.2083,  0.0951,  0.0170,  0.5727,  0.0474,  0.0349,
         0.2976,  0.9192,  0.1552,  0.0793,  0.1666,  0.5441,  0.3876,
         0.6614,  0.1852,  0.7272,  0.0418,  0.2219,  0.0257,  0.5547,
         0.9955,  0.9491,  0.1782,  0.6646,  0.0868,  0.9453,  0.9027,
         0.7638,  0.1701,  0.3593,  0.0363,  0.2653,  0.0254,  0.0721,
         0.2375,  0.1066,  0.0772,  0.0524,  0.2791,  0.8995,  0.6595,
         0.9947,  0.0342,  0.2484,  0.9361,  0.8837,  0.9033,  0.1628,
         0.9652,  0.8656,  0.8607,  0.3171,  0.0883,  0.9550,  0.5792,
         0.0116,  0.0076,  0.0562,  0.0989,  0.9445,  0.0122,  0.0846,
         0.0891,  0.1228,  0.9830,  0.8496,  0.8173,  0.8844,  0.0179,
         0.6925,  0.0010,  0.1060,  0.9572,  0.4224,  0.9440,  0.8047,
         0.7435,  0.0502,  0.8605,  0.0039,  0.1304,  0.0845,  0.0982,
         0.4005,  0.9869,  0.1459,  0.8713,  0.0184,  0.2916,  0.0510,
         0.6931,  0.2400,  0.0396,  0.8959,  0.5074,  0.9562,  0.9471,
         0.8870,  0.0395,  0.2697,  0.0808,  0.3200,  0.0186,  0.9258,
         0.0100,  0.0210,  0.3927,  0.9529,  0.0428,  0.0643,  0.9318,
         0.0292,  0.9883,  0.1302,  0.4450,  0.0266,  0.9926,  0.0107,
         0.0259,  0.0734,  0.7128,  0.9355,  0.0123,  0.1345,  0.8478,
         0.8790,  0.8482,  0.0661,  0.9131,  0.0286,  0.1120,  0.5102,
         0.2021,  0.0450,  0.0662,  0.0105,  0.8632,  0.9807,  0.0236,
         0.6533,  0.9639,  0.9275,  0.9366,  0.1167,  0.7539,  0.6041,
         0.1419,  0.0444,  0.0143,  0.6938,  0.7661,  0.9066,  0.9011,
         0.1296,  0.8529,  0.9782,  0.9789,  0.8059,  0.0714,  0.9515,
         0.2231,  0.8472,  0.0206,  0.1083,  0.0286,  0.0694,  0.4529,
         0.1268,  0.2421,  0.9571,  0.0035,  0.7951,  0.8930,  0.9973,
         0.9259,  0.0931,  0.0976,  0.0927,  0.9893,  0.1363,  0.0475,
         0.7000,  0.9712,  0.1033,  0.0508,  0.9976,  0.5727,  0.1027,
         0.0122,  0.0688,  0.4557,  0.5725,  0.7099,  0.1065,  0.1725,
         0.0842,  0.8267,  0.8419,  0.0266,  0.9242,  0.4143,  0.9182,
         0.0050,  0.9646,  0.9612,  0.4999,  0.9176,  0.0653,  0.0934,
         0.1903,  0.8746,  0.9061,  0.2908,  0.5221,  0.9699,  0.6515,
         0.0460,  0.5436,  0.1531,  0.1600,  0.3577,  0.8093,  0.0469,
         0.2217,  0.5501,  0.7862,  0.7784,  0.0220,  0.9518,  0.3359,
         0.5824,  0.2421,  0.9754,  0.1657,  0.2256,  0.8712,  0.9224,
         0.1481,  0.9453,  0.1316,  0.1241,  0.9829,  0.6923,  0.7951,
         0.0975,  0.9723,  0.0060,  0.0509,  0.0758,  0.2369,  0.1266,
         0.8378,  0.0306,  0.8805,  0.0888,  0.9305,  0.2193,  0.0987,
         0.1596,  0.6415,  0.9824,  0.8141,  0.8681,  0.8728,  0.9156,
         0.1847,  0.9456,  0.1471,  0.5649,  0.6219,  0.4378,  0.0195,
         0.2483,  0.8890,  0.9099,  0.4483,  0.0744,  0.8908,  0.0473,
         0.1307,  0.4537,  0.9692,  0.9982,  0.1461,  0.9563,  0.4796,
         0.1052,  0.7784,  0.0065,  0.0657,  0.9462,  0.7645,  0.0355,
         0.6149,  0.0755,  0.8598,  0.1218,  0.6203,  0.1225,  0.0854,
         0.9799,  0.1312,  0.8149,  0.1142,  0.1313,  0.2821,  0.6629,
         0.0493,  0.1530,  0.7433,  0.3664,  0.9544,  0.8011,  0.9103,
         0.2209,  0.4787,  0.0974,  0.2466,  0.0785,  0.1535,  0.0279,
         0.9585,  0.1113,  0.0812,  0.0105,  0.5724,  0.1966,  0.0509,
         0.0825,  0.9387,  0.8536,  0.9643,  0.0934,  0.0217,  0.0438,
         0.0810,  0.3956,  0.7821,  0.1233,  0.7125,  0.7311,  0.5956,
         0.3529,  0.0475,  0.2303,  0.0702,  0.2197,  0.9268,  0.8978,
         0.8996], device='cuda:0')
tensor(0.3164, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8457,  0.0489,  0.2175,  0.0932,  0.9891,  0.1878,  0.9287,
         0.9405,  0.9950,  0.6292,  0.1719,  0.9976,  0.9859,  0.0661,
         0.0511,  0.0056,  0.9119,  0.0104,  0.9357,  0.1088,  0.9947,
         0.0693,  0.3691,  0.4492,  0.9845,  0.9124,  0.1033,  0.0167,
         0.9976,  0.3022,  0.8731,  0.3103,  0.4502,  0.9251,  0.2812,
         0.0796,  0.7342,  0.9738,  0.9558,  0.9123,  0.9576,  0.1311,
         0.5975,  0.1583,  0.1829,  0.0458,  0.0176,  0.0216,  0.0094,
         0.0085,  0.0565,  0.9769,  0.2127,  0.8627,  0.0278,  0.0869,
         0.9860,  0.8402,  0.9034,  0.2016,  0.0945,  0.9221,  0.0391,
         0.1859,  0.8806,  0.9292,  0.0601,  0.0275,  0.0169,  0.0050,
         0.0877,  0.0298,  0.8860,  0.0963,  0.1041,  0.1625,  0.3710,
         0.8666,  0.1267,  0.1873,  0.8800,  0.2210,  0.0647,  0.9804,
         0.9923,  0.0646,  0.0965,  0.1693,  0.8476,  0.1800,  0.6731,
         0.6435,  0.2534,  0.0702,  0.9817,  0.9347,  0.0294,  0.0089,
         0.0415,  0.0495,  0.9545,  0.8840,  0.1235,  0.9060,  0.9698,
         0.5229,  0.6835,  0.9891,  0.9570,  0.1943,  0.6037,  0.9838,
         0.0019,  0.9715,  0.8094,  0.2905,  0.1408,  0.5596,  0.6688,
         0.9241,  0.0878,  0.9234,  0.8435,  0.1774,  0.9698,  0.9372,
         0.3992,  0.9597,  0.0041,  0.8330,  0.9530,  0.9346,  0.8668,
         0.9027,  0.8724,  0.9497,  0.6428,  0.2210,  0.0947,  0.9962,
         0.9197,  0.7261,  0.9015,  0.9298,  0.9399,  0.2581,  0.9872,
         0.3716,  0.9017,  0.8697,  0.2907,  0.0197,  0.9902,  0.0804,
         0.9586,  0.9126,  0.1950,  0.9612,  0.8480,  0.8645,  0.1611,
         0.6886,  0.0420,  0.9475,  0.5883,  0.8004,  0.9969,  0.2431,
         0.2007,  0.1190,  0.0663,  0.1161,  0.2042,  0.0207,  0.0110,
         0.9109,  0.9046,  0.8974,  0.9687,  0.9837,  0.0188,  0.8705,
         0.8887,  0.0628,  0.0737,  0.9188,  0.8682,  0.0837,  0.5578,
         0.8713,  0.0035,  0.9922,  0.0134,  0.9102,  0.0013,  0.4216,
         0.0525,  0.9278,  0.0737,  0.0510,  0.1642,  0.0956,  0.7329,
         0.9942,  0.8726,  0.2312,  0.9482,  0.1665,  0.0209,  0.3792,
         0.0685,  0.9938,  0.1153,  0.1662,  0.6772,  0.9194,  0.2345,
         0.8953,  0.2136,  0.9211,  0.4537,  0.8148,  0.9640,  0.0351,
         0.4666,  0.8218,  0.9136,  0.8787,  0.9956,  0.0053,  0.1075,
         0.9194,  0.9517,  0.1771,  0.3640,  0.9328,  0.0090,  0.5332,
         0.1043,  0.9124,  0.8877,  0.1424,  0.9472,  0.0565,  0.9935,
         0.9791,  0.0285,  0.8397,  0.1353,  0.6193,  0.4588,  0.9289,
         0.8595,  0.9751,  0.0259,  0.9896,  0.0477,  0.9381,  0.9701,
         0.9961,  0.9538,  0.3901,  0.0679,  0.0526,  0.9108,  0.1002,
         0.7843,  0.8435,  0.4984,  0.9314,  0.7872,  0.1652,  0.0851,
         0.9786,  0.9091,  0.0737,  0.9752,  0.9506,  0.5550,  0.9585,
         0.1737,  0.0270,  0.0602,  0.8429,  0.1229,  0.9536,  0.9673,
         0.1745,  0.3171,  0.7529,  0.0240,  0.3885,  0.1456,  0.4491,
         0.8594,  0.0707,  0.9398,  0.4869,  0.8512,  0.1304,  0.0235,
         0.0282,  0.6836,  0.1063,  0.2748,  0.9781,  0.1487,  0.8439,
         0.2301,  0.9680,  0.9518,  0.9827,  0.0689,  0.1164,  0.0643,
         0.9586,  0.9463,  0.5192,  0.1887,  0.9893,  0.9640,  0.1919,
         0.9871,  0.8358,  0.7333,  0.8059,  0.4804,  0.7423,  0.9980,
         0.0892,  0.8701,  0.9768,  0.0404,  0.0260,  0.9507,  0.0580,
         0.8771,  0.4950,  0.8017,  0.9518,  0.9602,  0.0760,  0.8785,
         0.0985,  0.9932,  0.8393,  0.8590,  0.9420,  0.6545,  0.0059,
         0.1530,  0.0398,  0.2117,  0.9278,  0.1397,  0.7441,  0.1927,
         0.9251,  0.9079,  0.9380,  0.9632,  0.1454,  0.7972,  0.6459,
         0.8438,  0.9066,  0.1206,  0.9809,  0.9778,  0.0332,  0.9779,
         0.8360,  0.9528,  0.2771,  0.0644,  0.6420,  0.9556,  0.9983,
         0.0431,  0.9303,  0.1088,  0.2478,  0.1445,  0.8406,  0.9937,
         0.1305,  0.8877,  0.0941,  0.0374,  0.4285,  0.8739,  0.9466,
         0.0088,  0.5051,  0.0784,  0.9175,  0.8665,  0.7904,  0.9738,
         0.0098,  0.8403,  0.1046,  0.4441,  0.0857,  0.4035,  0.8645,
         0.0047,  0.7104,  0.0039,  0.3149,  0.9718,  0.9738,  0.5835,
         0.0244,  0.1738,  0.1888,  0.9812,  0.9396,  0.9374,  0.0705,
         0.0848,  0.9078,  0.6937,  0.0783,  0.9722,  0.9976,  0.0581,
         0.8834,  0.9197,  0.9287,  0.2619,  0.7567,  0.9190,  0.2399,
         0.9334,  0.3180,  0.1058,  0.7952,  0.0038,  0.8935,  0.9754,
         0.7627,  0.2552,  0.0498,  0.7190,  0.9708,  0.9080,  0.2356,
         0.3224,  0.9830,  0.9986,  0.1542,  0.9361,  0.0835,  0.9460,
         0.1791,  0.0463,  0.0192,  0.9572,  0.3025,  0.6632,  0.3492,
         0.0643,  0.7015,  0.1904,  0.0903,  0.0105,  0.7458,  0.8592,
         0.9592,  0.0056,  0.1965,  0.6385,  0.0646,  0.1801,  0.1943,
         0.0783,  0.7704,  0.9567,  0.6125,  0.7928,  0.4347,  0.9648,
         0.0729,  0.1474,  0.9051,  0.0879,  0.5555,  0.0138,  0.9223,
         0.9856,  0.2857,  0.0767,  0.0429,  0.2964,  0.0047,  0.0535,
         0.0600,  0.3995,  0.4646,  0.4870,  0.9276,  0.0742,  0.0772,
         0.1890,  0.9677,  0.9540,  0.9358,  0.8082,  0.8237,  0.0363,
         0.0738], device='cuda:0')
tensor(0.3762, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1063,  0.9621,  0.9845,  0.9530,  0.0099,  0.0167,  0.0444,
         0.9674,  0.9282,  0.9717,  0.4489,  0.9397,  0.9731,  0.5977,
         0.3405,  0.0833,  0.9252,  0.7867,  0.0267,  0.8767,  0.9271,
         0.9757,  0.1447,  0.8015,  0.9798,  0.9645,  0.1431,  0.8851,
         0.9780,  0.4103,  0.2205,  0.0056,  0.9681,  0.8914,  0.5728,
         0.1076,  0.0319,  0.1714,  0.0814,  0.9591,  0.0163,  0.0444,
         0.2489,  0.9513,  0.8822,  0.9857,  0.1806,  0.0963,  0.0985,
         0.9238,  0.1307,  0.9987,  0.8836,  0.0290,  0.1167,  0.1498,
         0.9824,  0.8775,  0.1275,  0.6039,  0.9665,  0.9929,  0.1961,
         0.6003,  0.1222,  0.0804,  0.9593,  0.6580,  0.9867,  0.9982,
         0.8996,  0.0186,  0.1848,  0.9984,  0.9284,  0.9686,  0.0645,
         0.0395,  0.2035,  0.4965,  0.0389,  0.9660,  0.9503,  0.0899,
         0.9192,  0.0641,  0.3669,  0.9745,  0.0297,  0.0319,  0.9803,
         0.9235,  0.9838,  0.4409,  0.1392,  0.1550,  0.9423,  0.8008,
         0.8353,  0.3381,  0.1012,  0.6095,  0.6462,  0.8720,  0.9894,
         0.8697,  0.6353,  0.1145,  0.8526,  0.3557,  0.0734,  0.8343,
         0.9457,  0.0486,  0.8769,  0.1515,  0.2332,  0.9239,  0.7079,
         0.0756,  0.5409,  0.8753,  0.0339,  0.9398,  0.9466,  0.1469,
         0.5312,  0.1375,  0.9533,  0.3468,  0.4865,  0.0689,  0.8971,
         0.7469,  0.9732,  0.9669,  0.9334,  0.1759,  0.7835,  0.1389,
         0.8751,  0.9589,  0.9830,  0.9328,  0.9233,  0.0380,  0.0676,
         0.9368,  0.0724,  0.1205,  0.9540,  0.9709,  0.9601,  0.0715,
         0.3392,  0.9659,  0.1681,  0.8215,  0.9652,  0.9410,  0.4045,
         0.4476,  0.7211,  0.9636,  0.0196,  0.9869,  0.1568,  0.9486,
         0.9108,  0.9807,  0.8396,  0.0235,  0.0300,  0.9682,  0.0973,
         0.0898,  0.1139,  0.6186,  0.9709,  0.3639,  0.9491,  0.1082,
         0.3607,  0.9987,  0.9045,  0.8221,  0.2170,  0.4237,  0.9827,
         0.0414,  0.9463,  0.6146,  0.9512,  0.0264,  0.2608,  0.9530,
         0.0361,  0.0150,  0.8889,  0.9055,  0.0622,  0.9725,  0.9618,
         0.6116,  0.8433,  0.9674,  0.0916,  0.1077,  0.0093,  0.0420,
         0.0698,  0.7401,  0.9402,  0.2066,  0.5412,  0.9855,  0.9218,
         0.1066,  0.9322,  0.9542,  0.3609,  0.0562,  0.9565,  0.9046,
         0.3367,  0.1895,  0.1365,  0.2243,  0.0298,  0.9481,  0.0594,
         0.9361,  0.9767,  0.9047,  0.7909,  0.9278,  0.3684,  0.7139,
         0.2975,  0.6959,  0.9408,  0.9712,  0.9848,  0.3767,  0.9632,
         0.9883,  0.0451,  0.3876,  0.1134,  0.9727,  0.9618,  0.4891,
         0.0910,  0.3804,  0.1382,  0.2545,  0.5276,  0.6560,  0.1897,
         0.4528,  0.9749,  0.0285,  0.0560,  0.9576,  0.8820,  0.9714,
         0.9423,  0.9579,  0.9446,  0.1127,  0.0194,  0.0395,  0.9532,
         0.8807,  0.8849,  0.0339,  0.8722,  0.9991,  0.9756,  0.1645,
         0.1295,  0.0608,  0.9715,  0.0146,  0.9538,  0.9609,  0.0525,
         0.1298,  0.9195,  0.2121,  0.7807,  0.9024,  0.0671,  0.3832,
         0.0734,  0.8458,  0.3044,  0.7437,  0.9629,  0.0202,  0.5626,
         0.2427,  0.2497,  0.0877,  0.4194,  0.6916,  0.2280,  0.8431,
         0.9696,  0.5708,  0.2713,  0.8822,  0.7786,  0.9469,  0.9554,
         0.0054,  0.9504,  0.0710,  0.8601,  0.9590,  0.3638,  0.8291,
         0.8330,  0.9685,  0.8557,  0.0691,  0.0424,  0.2138,  0.9438,
         0.9851,  0.9653,  0.5940,  0.0168,  0.9784,  0.1705,  0.9329,
         0.9398,  0.1128,  0.8731,  0.8770,  0.1425,  0.9875,  0.4389,
         0.0126,  0.9798,  0.9781,  0.0525,  0.9394,  0.7517,  0.5979,
         0.9686,  0.1636,  0.9182,  0.9333,  0.9886,  0.9555,  0.6162,
         0.7368,  0.9252,  0.0735,  0.0322,  0.0663,  0.9660,  0.2130,
         0.9167,  0.9351,  0.8054,  0.0117,  0.9825,  0.0786,  0.9657,
         0.5465,  0.8499,  0.9083,  0.0412,  0.0334,  0.2947,  0.9691,
         0.0139,  0.8909,  0.8177,  0.9341,  0.8714,  0.9052,  0.1246,
         0.4529,  0.8997,  0.9855,  0.0416,  0.9493,  0.9487,  0.0451,
         0.0927,  0.9521,  0.5635,  0.3661,  0.9708,  0.0707,  0.3424,
         0.9361,  0.5211,  0.9696,  0.9402,  0.8937,  0.3309,  0.3665,
         0.1874,  0.3598,  0.0962,  0.9655,  0.9552,  0.8872,  0.0129,
         0.7864,  0.0803,  0.0834,  0.9263,  0.9745,  0.0157,  0.1248,
         0.9596,  0.1534,  0.1094,  0.9576,  0.9612,  0.3267,  0.0125,
         0.9759,  0.9570,  0.9466,  0.0619,  0.0280,  0.0255,  0.9705,
         0.9238,  0.9364,  0.9908,  0.1961,  0.4888,  0.9093,  0.1793,
         0.0229,  0.6612,  0.1918,  0.1376,  0.9584,  0.8855,  0.0056,
         0.9608,  0.1406,  0.0314,  0.8171,  0.0107,  0.4657,  0.2086,
         0.0689,  0.9599,  0.3672,  0.0220,  0.9340,  0.0350,  0.9568,
         0.2065,  0.0552,  0.5565,  0.0071,  0.1788,  0.3598,  0.2309,
         0.0925,  0.2712,  0.9372,  0.9629,  0.9858,  0.9826,  0.0354,
         0.9133,  0.9595,  0.3902,  0.0208,  0.1569,  0.9709,  0.9691,
         0.9517,  0.9636,  0.1815,  0.1293,  0.9613,  0.9416,  0.8455,
         0.0569,  0.8442,  0.9792,  0.0095,  0.5318,  0.1548,  0.9305,
         0.9850,  0.9666,  0.0812,  0.9798,  0.0887,  0.9023,  0.9164,
         0.6027,  0.9702,  0.1021,  0.0133,  0.9485,  0.9158,  0.0607,
         0.8768], device='cuda:0')
tensor(0.4435, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9372,  0.2521,  0.8111,  0.0265,  0.0294,  0.7200,  0.8131,
         0.0262,  0.4405,  0.7725,  0.1832,  0.6288,  0.8210,  0.9556,
         0.9136,  0.8153,  0.2100,  0.0861,  0.6577,  0.8247,  0.0024,
         0.0640,  0.8429,  0.9132,  0.8470,  0.8455,  0.0728,  0.3064,
         0.0627,  0.0389,  0.3559,  0.6400,  0.0174,  0.5496,  0.0155,
         0.0248,  0.8889,  0.6398,  0.7412,  0.8326,  0.7670,  0.2191,
         0.3098,  0.9204,  0.9186,  0.0430,  0.9702,  0.0288,  0.9415,
         0.1624,  0.1617,  0.9558,  0.5995,  0.8248,  0.0989,  0.3032,
         0.0430,  0.0502,  0.3796,  0.5534,  0.8616,  0.8520,  0.0105,
         0.9428,  0.9962,  0.8082,  0.6581,  0.0521,  0.0438,  0.9078,
         0.3838,  0.9244,  0.9725,  0.8844,  0.9218,  0.1925,  0.8072,
         0.9352,  0.3530,  0.3447,  0.0763,  0.8658,  0.0403,  0.9875,
         0.0035,  0.4158,  0.9022,  0.1830,  0.4470,  0.0145,  0.9416,
         0.5927,  0.0116,  0.2228,  0.6803,  0.2383,  0.0714,  0.0573,
         0.9302,  0.8051,  0.4883,  0.9499,  0.5502,  0.9338,  0.9964,
         0.6092,  0.8953,  0.9677,  0.9699,  0.0702,  0.2803,  0.0687,
         0.6449,  0.9143,  0.2707,  0.6304,  0.8207,  0.4270,  0.0212,
         0.9361,  0.0053,  0.9172,  0.0272,  0.0479,  0.1439,  0.0100,
         0.0231,  0.9046,  0.9416,  0.0861,  0.7899,  0.0340,  0.9618,
         0.5180,  0.0186,  0.1290,  0.2556,  0.0306,  0.2768,  0.9265,
         0.2938,  0.7526,  0.9639,  0.0555,  0.9738,  0.1344,  0.9434,
         0.8613,  0.1247,  0.0998,  0.9333,  0.1075,  0.8050,  0.8098,
         0.9376,  0.9740,  0.0679,  0.9599,  0.7054,  0.8837,  0.8857,
         0.0664,  0.0686,  0.1079,  0.9890,  0.1300,  0.6112,  0.1772,
         0.9884,  0.0056,  0.8690,  0.1259,  0.8363,  0.1355,  0.0198,
         0.9827,  0.1136,  0.8668,  0.6937,  0.0115,  0.0712,  0.8032,
         0.1381,  0.9385,  0.4651,  0.9503,  0.7183,  0.0258,  0.9410,
         0.8281,  0.8756,  0.8850,  0.1436,  0.4554,  0.1752,  0.0232,
         0.0557,  0.5615,  0.7334,  0.9786,  0.8477,  0.8101,  0.1830,
         0.9752,  0.0631,  0.7479,  0.0662,  0.1453,  0.9768,  0.0565,
         0.9460,  0.7776,  0.1793,  0.0626,  0.0286,  0.0338,  0.9228,
         0.9068,  0.5982,  0.1499,  0.5608,  0.2312,  0.5763,  0.9247,
         0.5476,  0.0514,  0.8306,  0.9118,  0.1364,  0.9208,  0.0152,
         0.5963,  0.9619,  0.8912,  0.3347,  0.0252,  0.9120,  0.9962,
         0.9782,  0.1880,  0.0320,  0.8258,  0.2031,  0.9625,  0.9274,
         0.0997,  0.2234,  0.4277,  0.0130,  0.0427,  0.9190,  0.1692,
         0.2012,  0.3818,  0.7932,  0.1156,  0.9213,  0.5407,  0.9106,
         0.7160,  0.6592,  0.8042,  0.4958,  0.9986,  0.5471,  0.9557,
         0.9676,  0.9175,  0.2650,  0.9768,  0.1570,  0.2022,  0.1891,
         0.9186,  0.0788,  0.8322,  0.9455,  0.0078,  0.9541,  0.2953,
         0.9420,  0.8677,  0.0316,  0.7818,  0.8960,  0.0977,  0.9139,
         0.2167,  0.3128,  0.0123,  0.1956,  0.4661,  0.1032,  0.0887,
         0.9100,  0.2376,  0.6072,  0.2387,  0.7584,  0.9993,  0.8501,
         0.9669,  0.8732,  0.0482,  0.9634,  0.0717,  0.2136,  0.9387,
         0.0241,  0.9010,  0.9503,  0.8288,  0.9560,  0.6655,  0.6409,
         0.8985,  0.9809,  0.8485,  0.7365,  0.7805,  0.7199,  0.9762,
         0.0546,  0.0683,  0.7973,  0.8801,  0.9800,  0.9243,  0.2344,
         0.9165,  0.6240,  0.0511,  0.1806,  0.4939,  0.3670,  0.7122,
         0.7223,  0.0379,  0.9560,  0.9448,  0.0341,  0.0702,  0.9980,
         0.9525,  0.0309,  0.7899,  0.2046,  0.1220,  0.2877,  0.9053,
         0.1137,  0.0762,  0.0266,  0.9166,  0.5198,  0.9306,  0.8459,
         0.7680,  0.7417,  0.5766,  0.5135,  0.9341,  0.0625,  0.2202,
         0.5422,  0.0337,  0.1102,  0.1257,  0.9903,  0.0221,  0.9779,
         0.9896,  0.0636,  0.8846,  0.1593,  0.1490,  0.9407,  0.5273,
         0.6687,  0.1254,  0.1439,  0.8989,  0.9840,  0.9979,  0.9728,
         0.0638,  0.9753,  0.0396,  0.2096,  0.7852,  0.0100,  0.9180,
         0.0175,  0.9306,  0.0233,  0.3328,  0.8680,  0.0213,  0.9757,
         0.9835,  0.1618,  0.6131,  0.0889,  0.9952,  0.4399,  0.9298,
         0.0301,  0.0039,  0.8883,  0.0462,  0.0194,  0.0357,  0.3366,
         0.6215,  0.9609,  0.1922,  0.8917,  0.9179,  0.8316,  0.8988,
         0.3342,  0.2971,  0.9042,  0.1082,  0.2774,  0.8515,  0.7146,
         0.8971,  0.7082,  0.9080,  0.0070,  0.2476,  0.4229,  0.9011,
         0.1267,  0.7243,  0.6306,  0.9484,  0.0744,  0.1244,  0.9470,
         0.3397,  0.9689,  0.9728,  0.0261,  0.2334,  0.6994,  0.1052,
         0.9890,  0.0286,  0.0310,  0.3196,  0.4697,  0.0864,  0.5315,
         0.0426,  0.3634,  0.6652,  0.9122,  0.0068,  0.0730,  0.9969,
         0.1120,  0.2311,  0.6947,  0.8501,  0.8955,  0.1211,  0.9020,
         0.7964,  0.0126,  0.7165,  0.0709,  0.2081,  0.1100,  0.2200,
         0.8738,  0.2157,  0.0245,  0.9382,  0.9572,  0.9465,  0.1304,
         0.2068,  0.9377,  0.7969,  0.0528,  0.0108,  0.0222,  0.6095,
         0.0252,  0.7347,  0.9637,  0.9333,  0.2257,  0.7446,  0.9669,
         0.0917,  0.1804,  0.9582,  0.9808,  0.0818,  0.9438,  0.0124,
         0.9006,  0.8960,  0.0352,  0.1157,  0.8576,  0.9936,  0.8833,
         0.0083], device='cuda:0')
tensor(0.3525, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6592,  0.3011,  0.9857,  0.9868,  0.7942,  0.9694,  0.2578,
         0.9670,  0.8738,  0.7029,  0.2139,  0.3400,  0.3580,  0.7089,
         0.5674,  0.6583,  0.9470,  0.1062,  0.7847,  0.4992,  0.9541,
         0.4008,  0.0055,  0.0266,  0.1603,  0.9591,  0.9064,  0.8170,
         0.4632,  0.3629,  0.6590,  0.3657,  0.7129,  0.4512,  0.9636,
         0.9582,  0.9122,  0.7920,  0.0587,  0.6327,  0.9939,  0.7778,
         0.5920,  0.1107,  0.9532,  0.7000,  0.9745,  0.8170,  0.8362,
         0.0132,  0.2172,  0.7722,  0.2826,  0.9352,  0.9334,  0.5385,
         0.6064,  0.0627,  0.3569,  0.9029,  0.6573,  0.0526,  0.8024,
         0.6263,  0.0515,  0.6079,  0.0251,  0.0521,  0.5488,  0.8321,
         0.0089,  0.0655,  0.0046,  0.8077,  0.2807,  0.5765,  0.2889,
         0.9055,  0.9245,  0.2333,  0.0139,  0.8427,  0.4968,  0.9478,
         0.0865,  0.0949,  0.9311,  0.7988,  0.7034,  0.5823,  0.2997,
         0.5913,  0.6347,  0.5587,  0.0059,  0.2554,  0.0759,  0.8252,
         0.3192,  0.9876,  0.0242,  0.9111,  0.7679,  0.0946,  0.4302,
         0.3641,  0.2152,  0.8772,  0.7361,  0.4892,  0.7481,  0.1448,
         0.2158,  0.7863,  0.0409,  0.4685,  0.8643,  0.1821,  0.7124,
         0.9598,  0.5281,  0.6657,  0.0754,  0.9348,  0.7413,  0.0362,
         0.3424,  0.4265,  0.9619,  0.1812,  0.1039,  0.9469,  0.3158,
         0.0957,  0.4454,  0.7153,  0.2095,  0.8216,  0.9624,  0.8092,
         0.3597,  0.2534,  0.2629,  0.6905,  0.2826,  0.8701,  0.0475,
         0.8811,  0.7683,  0.0738,  0.7080,  0.9243,  0.9668,  0.9488,
         0.1147,  0.5698,  0.5244,  0.7828,  0.9607,  0.3682,  0.0262,
         0.9074,  0.2174,  0.1529,  0.1938,  0.9827,  0.4137,  0.8570,
         0.2332,  0.9427,  0.5283,  0.9133,  0.6104,  0.6067,  0.6259,
         0.7182,  0.1382,  0.1359,  0.9249,  0.4196,  0.0362,  0.8639,
         0.2176,  0.0929,  0.9988,  0.9921,  0.1121,  0.7659,  0.9709,
         0.0181,  0.4551,  0.1306,  0.4583,  0.7567,  0.8707,  0.8477,
         0.9358,  0.3152,  0.9460,  0.9497,  0.0104,  0.7311,  0.9942,
         0.4172,  0.4202,  0.5677,  0.1908,  0.0177,  0.9001,  0.9481,
         0.4014,  0.9944,  0.9640,  0.0847,  0.1904,  0.0898,  0.0226,
         0.2317,  0.7624,  0.7841,  0.8710,  0.0131,  0.0170,  0.0687,
         0.7378,  0.3146,  0.2612,  0.0386,  0.1084,  0.7885,  0.0868,
         0.8523,  0.0756,  0.9255,  0.1329,  0.8834,  0.8112,  0.9655,
         0.3757,  0.0298,  0.1117,  0.5462,  0.9878,  0.1437,  0.8388,
         0.7310,  0.1297,  0.0652,  0.6941,  0.2559,  0.4413,  0.7766,
         0.2969,  0.1250,  0.1226,  0.1176,  0.2186,  0.0439,  0.3514,
         0.1311,  0.9892,  0.1823,  0.2789,  0.7563,  0.2149,  0.0529,
         0.1359,  0.1249,  0.2667,  0.1178,  0.1245,  0.7301,  0.4227,
         0.1072,  0.6938,  0.2979,  0.9664,  0.9293,  0.0332,  0.0963,
         0.4675,  0.7912,  0.9852,  0.0736,  0.2916,  0.0431,  0.4800,
         0.9368,  0.1759,  0.0405,  0.5632,  0.6047,  0.5464,  0.0194,
         0.9609,  0.5239,  0.7532,  0.7312,  0.4624,  0.8921,  0.8652,
         0.3676,  0.4186,  0.0560,  0.7427,  0.0768,  0.1620,  0.9684,
         0.1982,  0.5351,  0.0184,  0.9390,  0.2159,  0.9939,  0.2292,
         0.3685,  0.9361,  0.8985,  0.5522,  0.9022,  0.1112,  0.0744,
         0.1788,  0.8406,  0.5858,  0.0559,  0.5172,  0.3968,  0.2501,
         0.4508,  0.1539,  0.0498,  0.6642,  0.1012,  0.8444,  0.3650,
         0.9150,  0.0852,  0.6362,  0.1813,  0.0278,  0.9348,  0.6193,
         0.8891,  0.8064,  0.2127,  0.6351,  0.5098,  0.6961,  0.4578,
         0.8334,  0.4731,  0.1582,  0.3555,  0.1327,  0.3684,  0.6597,
         0.1415,  0.0360,  0.9766,  0.0141,  0.0327,  0.6962,  0.4830,
         0.9441,  0.8951,  0.0989,  0.5044,  0.8270,  0.8573,  0.0391,
         0.1234,  0.0662,  0.5213,  0.8886,  0.0619,  0.0713,  0.4380,
         0.1245,  0.7930,  0.8310,  0.2634,  0.5468,  0.2761,  0.4769,
         0.0706,  0.6150,  0.8454,  0.0490,  0.9408,  0.7586,  0.1032,
         0.1058,  0.0222,  0.9157,  0.9084,  0.2616,  0.0245,  0.6442,
         0.1449,  0.6556,  0.0180,  0.1099,  0.8311,  0.3859,  0.0378,
         0.9909,  0.9091,  0.5782,  0.0237,  0.0208,  0.7013,  0.8202,
         0.1968,  0.3574,  0.0747,  0.9260,  0.0373,  0.6678,  0.8884,
         0.0314,  0.7057,  0.4130,  0.1576,  0.0301,  0.3026,  0.3736,
         0.9229,  0.6897,  0.8758,  0.3792,  0.3312,  0.7787,  0.7578,
         0.9982,  0.9902,  0.3336,  0.0438,  0.8519,  0.9542,  0.2234,
         0.0512,  0.6824,  0.9936,  0.0733,  0.3283,  0.8279,  0.1103,
         0.8242,  0.7279,  0.0618,  0.1812,  0.1831,  0.8734,  0.0755,
         0.7654,  0.7589,  0.3414,  0.0744,  0.9495,  0.9573,  0.8797,
         0.8533,  0.9757,  0.0383,  0.0529,  0.8986,  0.1301,  0.4060,
         0.9971,  0.4822,  0.2777,  0.1180,  0.6358,  0.8780,  0.8304,
         0.0395,  0.0205,  0.8830,  0.6804,  0.9541,  0.7154,  0.8886,
         0.8436,  0.1030,  0.1003,  0.2023,  0.0390,  0.4426,  0.8911,
         0.1012,  0.2983,  0.8723,  0.0718,  0.2867,  0.0771,  0.1495,
         0.8728,  0.9856,  0.8575,  0.3077,  0.2406,  0.3746,  0.3549,
         0.8972,  0.9341,  0.8773,  0.0242,  0.9651,  0.9307,  0.9810,
         0.5773], device='cuda:0')
tensor(0.3613, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8107,  0.0451,  0.4399,  0.9790,  0.9218,  0.5297,  0.0368,
         0.5535,  0.8225,  0.6500,  0.2715,  0.1955,  0.1759,  0.8627,
         0.0835,  0.2330,  0.3395,  0.6079,  0.0444,  0.6784,  0.7707,
         0.0515,  0.8875,  0.8631,  0.2064,  0.4359,  0.8502,  0.6971,
         0.4543,  0.0952,  0.8850,  0.9055,  0.1546,  0.4167,  0.5406,
         0.4027,  0.3611,  0.8703,  0.8419,  0.2979,  0.0927,  0.1337,
         0.9810,  0.3049,  0.1307,  0.8280,  0.5950,  0.7751,  0.7561,
         0.8027,  0.9947,  0.4231,  0.1242,  0.9162,  0.0300,  0.8400,
         0.1690,  0.3627,  0.1911,  0.0650,  0.7697,  0.0872,  0.5251,
         0.8229,  0.4075,  0.0880,  0.5757,  0.8436,  0.6653,  0.2233,
         0.7817,  0.8206,  0.1215,  0.1041,  0.0799,  0.6801,  0.2484,
         0.7177,  0.1558,  0.9073,  0.3140,  0.4814,  0.9935,  0.0811,
         0.6902,  0.9888,  0.6958,  0.0764,  0.7767,  0.1269,  0.1596,
         0.1111,  0.2785,  0.3465,  0.9806,  0.0452,  0.7533,  0.7172,
         0.1645,  0.3690,  0.1111,  0.7182,  0.0535,  0.9783,  0.2031,
         0.9257,  0.1138,  0.5347,  0.1799,  0.7077,  0.2381,  0.7817,
         0.0742,  0.8894,  0.0876,  0.9915,  0.0846,  0.4672,  0.0172,
         0.8035,  0.7833,  0.8134,  0.0471,  0.6447,  0.2115,  0.5947,
         0.2728,  0.4909,  0.0950,  0.0770,  0.8685,  0.3534,  0.6187,
         0.0640,  0.9560,  0.4270,  0.8085,  0.1896,  0.7769,  0.9001,
         0.9140,  0.6979,  0.9318,  0.9916,  0.7354,  0.3072,  0.4084,
         0.0495,  0.2081,  0.8231,  0.0669,  0.8331,  0.8152,  0.1195,
         0.5358,  0.9739,  0.8795,  0.0862,  0.0466,  0.8408,  0.7765,
         0.5720,  0.6982,  0.9198,  0.1363,  0.0151,  0.0459,  0.2057,
         0.4674,  0.8684,  0.8400,  0.7824,  0.1290,  0.8415,  0.8116,
         0.6073,  0.1239,  0.1422,  0.6578,  0.8440,  0.9411,  0.4959,
         0.0759,  0.8767,  0.1958,  0.3061,  0.6117,  0.0873,  0.2349,
         0.1556,  0.9681,  0.0707,  0.4350,  0.3574,  0.1935,  0.0381,
         0.3977,  0.8692,  0.9722,  0.8185,  0.0139,  0.8886,  0.8583,
         0.3324,  0.2125,  0.7109,  0.5798,  0.1757,  0.2363,  0.8397,
         0.4737,  0.2470,  0.8608,  0.6281,  0.2550,  0.4811,  0.3508,
         0.8780,  0.7851,  0.6155,  0.3388,  0.6793,  0.6283,  0.4226,
         0.2003,  0.8901,  0.6154,  0.5561,  0.7079,  0.3818,  0.1590,
         0.6013,  0.9042,  0.7281,  0.7437,  0.4573,  0.8829,  0.4528,
         0.8640,  0.5200,  0.8218,  0.1649,  0.5004,  0.4311,  0.7158,
         0.9093,  0.9367,  0.9193,  0.7443,  0.0274,  0.7208,  0.7694,
         0.5944,  0.6597,  0.9391,  0.9707,  0.9478,  0.0452,  0.7938,
         0.1390,  0.9887,  0.1810,  0.8308,  0.9986,  0.3679,  0.9301,
         0.7967,  0.9359,  0.9531,  0.1860,  0.3697,  0.2713,  0.4255,
         0.1221,  0.0231,  0.8517,  0.8123,  0.9651,  0.7692,  0.7392,
         0.2366,  0.8413,  0.7147,  0.1356,  0.3325,  0.4838,  0.0802,
         0.1563,  0.2600,  0.5794,  0.0402,  0.2784,  0.4952,  0.8262,
         0.1551,  0.6354,  0.6537,  0.4049,  0.5413,  0.9096,  0.2433,
         0.0181,  0.8618,  0.9770,  0.2013,  0.3226,  0.7810,  0.4459,
         0.3908,  0.4303,  0.2934,  0.8528,  0.5842,  0.7809,  0.0633,
         0.1228,  0.2587,  0.6228,  0.7566,  0.9738,  0.8327,  0.7002,
         0.8194,  0.7226,  0.7011,  0.5006,  0.7000,  0.0968,  0.7334,
         0.8744,  0.8961,  0.0386,  0.0600,  0.7948,  0.7602,  0.2388,
         0.9567,  0.8780,  0.4224,  0.0514,  0.3232,  0.0118,  0.6649,
         0.8483,  0.9564,  0.1511,  0.6483,  0.4668,  0.2338,  0.1468,
         0.9265,  0.2648,  0.1299,  0.8525,  0.0081,  0.7901,  0.9171,
         0.2329,  0.5325,  0.2423,  0.7913,  0.0117,  0.8102,  0.1909,
         0.8456,  0.7122,  0.9886,  0.2514,  0.9461,  0.7700,  0.7588,
         0.7227,  0.3324,  0.1353,  0.1680,  0.2101,  0.8561,  0.6440,
         0.9885,  0.3214,  0.0311,  0.3312,  0.1244,  0.9692,  0.3570,
         0.0456,  0.5876,  0.6103,  0.7316,  0.9112,  0.9592,  0.6768,
         0.5417,  0.8908,  0.1420,  0.1369,  0.2770,  0.7245,  0.5026,
         0.1407,  0.8877,  0.0141,  0.8947,  0.1524,  0.5223,  0.1281,
         0.0409,  0.9624,  0.9933,  0.1460,  0.8596,  0.7677,  0.8051,
         0.7598,  0.6292,  0.9492,  0.3933,  0.5732,  0.0646,  0.9736,
         0.7878,  0.5845,  0.1170,  0.4826,  0.2556,  0.9130,  0.0224,
         0.9103,  0.2791,  0.9440,  0.0327,  0.4874,  0.8389,  0.2326,
         0.7491,  0.0460,  0.8914,  0.9571,  0.4234,  0.1197,  0.5627,
         0.5829,  0.6618,  0.2658,  0.0306,  0.1315,  0.0114,  0.8891,
         0.1724,  0.7411,  0.0765,  0.1271,  0.3483,  0.3523,  0.3741,
         0.9479,  0.0088,  0.6515,  0.2066,  0.8205,  0.9280,  0.9731,
         0.7990,  0.4894,  0.0162,  0.4216,  0.1332,  0.3254,  0.0779,
         0.4070,  0.3633,  0.1345,  0.8643,  0.1003,  0.9032,  0.9586,
         0.0083,  0.1589,  0.8529,  0.9488,  0.8328,  0.6603,  0.8393,
         0.9737,  0.6794,  0.4115,  0.5398,  0.6551,  0.0593,  0.8856,
         0.2159,  0.0874,  0.8780,  0.7249,  0.0586,  0.9921,  0.2694,
         0.8779,  0.0264,  0.1274,  0.1781,  0.0439,  0.8794,  0.1250,
         0.7045,  0.9591,  0.8873,  0.7225,  0.3795,  0.7504,  0.8111,
         0.1244], device='cuda:0')
tensor(0.4220, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5757,  0.3050,  0.8194,  0.8003,  0.3372,  0.2479,  0.3734,
         0.4380,  0.5194,  0.8953,  0.1669,  0.8515,  0.3041,  0.1360,
         0.8275,  0.0588,  0.2075,  0.6182,  0.9382,  0.0374,  0.9458,
         0.1563,  0.9276,  0.1329,  0.1077,  0.8381,  0.9573,  0.1301,
         0.9990,  0.8636,  0.0652,  0.5315,  0.2405,  0.3200,  0.9207,
         0.9532,  0.9246,  0.0182,  0.3791,  0.9439,  0.7633,  0.2870,
         0.1891,  0.8974,  0.8852,  0.8216,  0.7006,  0.7067,  0.2115,
         0.9716,  0.7848,  0.0752,  0.4376,  0.8592,  0.1935,  0.6744,
         0.6574,  0.5738,  0.0587,  0.3786,  0.0469,  0.7746,  0.0340,
         0.2199,  0.2072,  0.0263,  0.5548,  0.9945,  0.4608,  0.8915,
         0.9990,  0.3109,  0.5167,  0.0082,  0.9475,  0.1955,  0.8933,
         0.0819,  0.4898,  0.7543,  0.5362,  0.0769,  0.9218,  0.0037,
         0.7087,  0.9998,  0.2563,  0.9936,  0.5441,  0.0221,  0.3199,
         0.1921,  0.7149,  0.0756,  0.9069,  0.2329,  0.8416,  0.4267,
         0.9199,  0.9524,  0.5609,  0.1071,  0.3546,  0.0516,  0.0896,
         0.6578,  0.6417,  0.4324,  0.1090,  0.1873,  0.5521,  0.2082,
         0.8807,  0.5856,  0.0288,  0.9215,  0.5607,  0.4721,  0.8436,
         0.1939,  0.9915,  0.1291,  0.9587,  0.8183,  0.2288,  0.5919,
         0.1986,  0.2086,  0.4896,  0.1226,  0.8923,  0.8253,  0.1303,
         0.1675,  0.7111,  0.9164,  0.9312,  0.6194,  0.0902,  0.9425,
         0.9844,  0.6818,  0.2302,  0.3037,  0.5959,  0.2780,  0.4725,
         0.7588,  0.1029,  0.8952,  0.0245,  0.5291,  0.9058,  0.6637,
         0.1644,  0.0330,  0.0721,  0.7163,  0.5537,  0.6863,  0.3559,
         0.3159,  0.9188,  0.5608,  0.5296,  0.3785,  0.9320,  0.1900,
         0.6314,  0.4405,  0.2193,  0.1853,  0.5861,  0.6974,  0.3612,
         0.5332,  0.9247,  0.8834,  0.5728,  0.2854,  0.8780,  0.2924,
         0.3721,  0.0971,  0.4464,  0.4618,  0.1425,  0.0665,  0.1372,
         0.0762,  0.5702,  0.4214,  0.2939,  0.0665,  0.9160,  0.0601,
         0.7706,  0.8903,  0.1116,  0.1696,  0.2928,  0.0996,  0.0753,
         0.3588,  0.2415,  0.9978,  0.7321,  0.8341,  0.9594,  0.7553,
         0.0727,  0.8452,  0.1313,  0.1609,  0.1667,  0.0054,  0.7084,
         0.2351,  0.3112,  0.9725,  0.2653,  0.3735,  0.8716,  0.1381,
         0.0130,  0.7721,  0.0936,  0.9089,  0.3158,  0.9161,  0.8125,
         0.1421,  0.8390,  0.9159,  0.7965,  0.6145,  0.4161,  0.7919,
         0.2444,  0.5038,  0.9870,  0.3290,  0.7617,  0.8103,  0.2182,
         0.6116,  0.0147,  0.6261,  0.0530,  0.5491,  0.5606,  0.4653,
         0.3673,  0.6260,  0.2838,  0.8365,  0.4990,  0.2364,  0.2818,
         0.2973,  0.6045,  0.6518,  0.3088,  0.1376,  0.9448,  0.9696,
         0.7123,  0.6409,  0.9614,  0.0885,  0.4549,  0.0566,  0.0020,
         0.9786,  0.9366,  0.8742,  0.3490,  0.2261,  0.3905,  0.0985,
         0.0318,  0.6541,  0.0967,  0.7471,  0.1484,  0.4953,  0.3291,
         0.0587,  0.2882,  0.6159,  0.8222,  0.0295,  0.3662,  0.0319,
         0.7659,  0.1417,  0.5603,  0.4731,  0.6518,  0.6073,  0.7539,
         0.3611,  0.2217,  0.4918,  0.7903,  0.0139,  0.0161,  0.8434,
         0.0624,  0.1343,  0.4415,  0.3547,  0.6633,  0.3952,  0.8844,
         0.9288,  0.2589,  0.4697,  0.7138,  0.6138,  0.0622,  0.9774,
         0.4344,  0.9384,  0.5293,  0.9374,  0.6923,  0.5720,  0.9957,
         0.9674,  0.2695,  0.6574,  0.8459,  0.8758,  0.6863,  0.2489,
         0.1402,  0.4479,  0.8355,  0.0566,  0.0415,  0.4542,  0.8531,
         0.1373,  0.0888,  0.0317,  0.1626,  0.8139,  0.9056,  0.0505,
         0.4084,  0.8224,  0.6579,  0.1663,  0.2132,  0.0302,  0.7975,
         0.2039,  0.4752,  0.4399,  0.1997,  0.0698,  0.8452,  0.4770,
         0.6714,  0.2109,  0.6440,  0.5620,  0.9131,  0.0520,  0.0113,
         0.0609,  0.8273,  0.0547,  0.1922,  0.1709,  0.4507,  0.9158,
         0.4554,  0.0426,  0.9435,  0.2917,  0.8523,  0.1531,  0.8079,
         0.0796,  0.1287,  0.8231,  0.2007,  0.7392,  0.1406,  0.0345,
         0.3532,  0.8671,  0.7266,  0.8600,  0.3086,  0.5894,  0.8658,
         0.8609,  0.6307,  0.1599,  0.4825,  0.6844,  0.0556,  0.9858,
         0.7445,  0.0645,  0.7882,  0.0699,  0.5728,  0.9392,  0.6816,
         0.1568,  0.9410,  0.9122,  0.3261,  0.2210,  0.2118,  0.5245,
         0.5477,  0.7119,  0.2603,  0.9576,  0.2347,  0.0053,  0.7824,
         0.0672,  0.5285,  0.6809,  0.3043,  0.4145,  0.6133,  0.8954,
         0.9967,  0.2345,  0.7760,  0.2833,  0.0418,  0.4575,  0.1030,
         0.1116,  0.0803,  0.2457,  0.9309,  0.8410,  0.1425,  0.0508,
         0.1103,  0.5831,  0.8799,  0.2054,  0.0653,  0.0893,  0.8272,
         0.0758,  0.6651,  0.5850,  0.1190,  0.1687,  0.0376,  0.2642,
         0.6290,  0.0211,  0.6928,  0.0787,  0.3692,  0.1692,  0.1016,
         0.6983,  0.9734,  0.5308,  0.5308,  0.0937,  0.0166,  0.0636,
         0.7616,  0.9531,  0.2128,  0.7228,  0.0450,  0.4026,  0.0839,
         0.1986,  0.0823,  0.5540,  0.8251,  0.1135,  0.5450,  0.1688,
         0.2440,  0.9969,  0.2621,  0.7631,  0.0241,  0.7561,  0.4256,
         0.4076,  0.9439,  0.6795,  0.9047,  0.1357,  0.0228,  0.4369,
         0.8662,  0.0819,  0.1779,  0.7178,  0.5106,  0.6906,  0.5384,
         0.1458], device='cuda:0')
tensor(0.3460, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8673,  0.5259,  0.9776,  0.8170,  0.0545,  0.5801,  0.9522,
         0.4589,  0.9893,  0.0588,  0.7240,  0.0267,  0.3418,  0.7838,
         0.1228,  0.8409,  0.8768,  0.3648,  0.1492,  0.6539,  0.1412,
         0.8958,  0.6429,  0.1579,  0.6401,  0.4864,  0.0774,  0.9252,
         0.2180,  0.5261,  0.4045,  0.9299,  0.1129,  0.9468,  0.9664,
         0.4025,  0.1192,  0.9958,  0.0700,  0.0503,  0.0396,  0.5463,
         0.8909,  0.1631,  0.0025,  0.9969,  0.8970,  0.7742,  0.9110,
         0.8628,  0.3710,  0.2696,  0.3785,  0.4237,  0.2598,  0.6378,
         0.7632,  0.3765,  0.1950,  0.2026,  0.8679,  0.2110,  0.6067,
         0.5860,  0.0735,  0.0691,  0.9052,  0.0353,  0.1085,  0.9099,
         0.9519,  0.8060,  0.8849,  0.9134,  0.2515,  0.1078,  0.0236,
         0.0721,  0.5473,  0.0667,  0.9728,  0.1316,  0.8491,  0.2151,
         0.0439,  0.2606,  0.0305,  0.5429,  0.0525,  0.8816,  0.1793,
         0.1765,  0.7722,  0.6389,  0.8093,  0.3348,  0.1720,  0.5169,
         0.1421,  0.8981,  0.0946,  0.5310,  0.5961,  0.0499,  0.9618,
         0.5541,  0.4864,  0.0883,  0.4223,  0.8678,  0.7379,  0.1674,
         0.0956,  0.0175,  0.4310,  0.5824,  0.8570,  0.3587,  0.8293,
         0.4533,  0.1890,  0.9751,  0.9808,  0.0926,  0.1666,  0.4610,
         0.6458,  0.0195,  0.2059,  0.1433,  0.4607,  0.9215,  0.0931,
         0.4593,  0.7594,  0.7047,  0.6300,  0.0990,  0.8692,  0.5826,
         0.8559,  0.6888,  0.6569,  0.1995,  0.6702,  0.3712,  0.8564,
         0.9804,  0.9049,  0.9508,  0.3560,  0.4112,  0.6477,  0.8039,
         0.1317,  0.1339,  0.3300,  0.6142,  0.1125,  0.4552,  0.3470,
         0.4583,  0.9490,  0.0958,  0.0369,  0.9134,  0.6416,  0.3330,
         0.8779,  0.3543,  0.0865,  0.4599,  0.3765,  0.8509,  0.5809,
         0.8339,  0.7922,  0.0403,  0.2281,  0.3454,  0.1618,  0.3707,
         0.0032,  0.9143,  0.6632,  0.4180,  0.7853,  0.0243,  0.3477,
         0.9404,  0.1578,  0.0277,  0.2560,  0.3292,  0.1083,  0.2596,
         0.1724,  0.6744,  0.0733,  0.3451,  0.1903,  0.9920,  0.1287,
         0.3877,  0.7999,  0.1416,  0.6330,  0.2411,  0.5929,  0.8276,
         0.3006,  0.3851,  0.1571,  0.9619,  0.7689,  0.6893,  0.0693,
         0.7667,  0.7547,  0.5787,  0.0980,  0.0115,  0.8723,  0.1449,
         0.2293,  0.2969,  0.6800,  0.1944,  0.4782,  0.0768,  0.7725,
         0.7072,  0.9137,  0.7930,  0.0758,  0.1033,  0.6138,  0.9647,
         0.9597,  0.8752,  0.1032,  0.3579,  0.7609,  0.8731,  0.3173,
         0.1451,  0.0579,  0.0521,  0.9995,  0.1343,  0.1181,  0.7616,
         0.7673,  0.6320,  0.0527,  0.2357,  0.5626,  0.7324,  0.1133,
         0.2844,  0.8607,  0.2471,  0.7757,  0.8800,  0.0225,  0.9181,
         0.1938,  0.3994,  0.7474,  0.0272,  0.8821,  0.8674,  0.7049,
         0.4791,  0.1949,  0.9668,  0.3430,  0.6118,  0.2552,  0.0345,
         0.1157,  0.9639,  0.8716,  0.7630,  0.5484,  0.5728,  0.6790,
         0.8749,  0.3868,  0.7990,  0.0998,  0.1722,  0.2094,  0.1599,
         0.9271,  0.0262,  0.0780,  0.4434,  0.6562,  0.1046,  0.8439,
         0.1840,  0.4482,  0.2259,  0.1562,  0.8165,  0.1115,  0.8487,
         0.1057,  0.2592,  0.2779,  0.5675,  0.7947,  0.3121,  0.5438,
         0.5678,  0.1939,  0.2179,  0.8837,  0.2390,  0.6759,  0.1071,
         0.0430,  0.9463,  0.0731,  0.1435,  0.8755,  0.8239,  0.0567,
         0.8614,  0.0088,  0.9610,  0.0684,  0.2081,  0.3938,  0.6536,
         0.4437,  0.9039,  0.8169,  0.1818,  0.7099,  0.3524,  0.8479,
         0.8488,  0.1078,  0.9715,  0.6695,  0.7155,  0.3939,  0.1342,
         0.1174,  0.2448,  0.9091,  0.2467,  0.4306,  0.2811,  0.1282,
         0.5559,  0.9627,  0.4470,  0.6685,  0.0183,  0.3466,  0.2618,
         0.6871,  0.0075,  0.0942,  0.8453,  0.0433,  0.4768,  0.8933,
         0.2675,  0.6758,  0.6617,  0.9873,  0.0336,  0.5947,  0.8716,
         0.2645,  0.1934,  0.0427,  0.8336,  0.7357,  0.0127,  0.0323,
         0.8211,  0.3845,  0.1020,  0.3931,  0.0872,  0.7625,  0.7350,
         0.9577,  0.0306,  0.7495,  0.4846,  0.8950,  0.5396,  0.1011,
         0.0831,  0.8998,  0.0462,  0.6418,  0.2709,  0.9261,  0.9545,
         0.5918,  0.9272,  0.5270,  0.9471,  0.1277,  0.0608,  0.3196,
         0.0845,  0.8245,  0.5155,  0.5975,  0.0202,  0.6941,  0.1204,
         0.9736,  0.7960,  0.0372,  0.0156,  0.9679,  0.0306,  0.9369,
         0.1603,  0.2360,  0.7926,  0.8104,  0.8588,  0.9652,  0.3016,
         0.9567,  0.4796,  0.3037,  0.9843,  0.7656,  0.4055,  0.7608,
         0.1311,  0.1525,  0.0873,  0.0943,  0.3830,  0.8592,  0.8384,
         0.8521,  0.4035,  0.9067,  0.7913,  0.8026,  0.7572,  0.7652,
         0.4377,  0.6070,  0.4057,  0.1661,  0.0915,  0.9406,  0.8869,
         0.5181,  0.4222,  0.8487,  0.2825,  0.9887,  0.1836,  0.8850,
         0.1857,  0.7095,  0.3728,  0.0487,  0.2489,  0.0742,  0.0691,
         0.8226,  0.9952,  0.0331,  0.9644,  0.2949,  0.9060,  0.4701,
         0.9587,  0.1005,  0.1260,  0.1541,  0.4712,  0.1295,  0.2256,
         0.9991,  0.2060,  0.8461,  0.0653,  0.0774,  0.8487,  0.4105,
         0.2167,  0.8328,  0.1916,  0.8739,  0.7874,  0.1380,  0.9165,
         0.6416,  0.8916,  0.0646,  0.8753,  0.2728,  0.7910,  0.8323,
         0.5226], device='cuda:0')
tensor(0.3744, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5601,  0.9078,  0.9043,  0.0982,  0.1335,  0.2478,  0.0596,
         0.9781,  0.1925,  0.1261,  0.9429,  0.9386,  0.9808,  0.9159,
         0.0310,  0.9894,  0.7209,  0.1355,  0.6215,  0.7591,  0.6857,
         0.6984,  0.0713,  0.1778,  0.0948,  0.9732,  0.3833,  0.4571,
         0.8234,  0.5340,  0.6114,  0.6348,  0.9924,  0.0084,  0.6425,
         0.9827,  0.0079,  0.8328,  0.0627,  0.6881,  0.3402,  0.2686,
         0.1364,  0.8414,  0.2212,  0.3379,  0.0412,  0.0833,  0.1656,
         0.2145,  0.0065,  0.4650,  0.1193,  0.5190,  0.8352,  0.5953,
         0.7834,  0.7230,  0.9196,  0.7062,  0.8936,  0.6355,  0.7899,
         0.7539,  0.2422,  0.8201,  0.0296,  0.5607,  0.5778,  0.9867,
         0.2516,  0.1803,  0.4372,  0.0279,  0.1173,  0.4965,  0.9083,
         0.0365,  0.1207,  0.9453,  0.7424,  0.4887,  0.9406,  0.6019,
         0.6885,  0.9214,  0.1005,  0.5313,  0.0512,  0.9596,  0.0271,
         0.9401,  0.7323,  0.0427,  0.1663,  0.0107,  0.2606,  0.2764,
         0.7061,  0.9018,  0.9286,  0.1405,  0.0519,  0.4987,  0.2979,
         0.9299,  0.0668,  0.9359,  0.2816,  0.3255,  0.9495,  0.4040,
         0.2865,  0.7937,  0.0544,  0.8313,  0.0759,  0.5184,  0.9289,
         0.9667,  0.6109,  0.7751,  0.0834,  0.7950,  0.8993,  0.0686,
         0.6536,  0.9083,  0.9420,  0.7901,  0.6158,  0.0690,  0.2395,
         0.9432,  0.6894,  0.7500,  0.9477,  0.0835,  0.2130,  0.4243,
         0.0752,  0.4441,  0.8174,  0.0040,  0.9719,  0.0659,  0.6879,
         0.2939,  0.2995,  0.1491,  0.1477,  0.0072,  0.1056,  0.2051,
         0.8406,  0.8794,  0.7595,  0.2157,  0.7001,  0.8539,  0.1253,
         0.4369,  0.5705,  0.6805,  0.7558,  0.7338,  0.1836,  0.1754,
         0.1587,  0.0486,  0.4836,  0.0089,  0.8597,  0.8321,  0.2142,
         0.3270,  0.5204,  0.7085,  0.6892,  0.0091,  0.1897,  0.2942,
         0.0053,  0.0096,  0.0452,  0.0269,  0.0704,  0.0871,  0.6884,
         0.0384,  0.3519,  0.7809,  0.0919,  0.8809,  0.8675,  0.8330,
         0.0810,  0.0144,  0.2577,  0.1433,  0.0776,  0.6290,  0.9609,
         0.1048,  0.1370,  0.9371,  0.0467,  0.6017,  0.1048,  0.0173,
         0.3188,  0.1823,  0.2414,  0.1542,  0.1719,  0.0415,  0.6136,
         0.8107,  0.9397,  0.1559,  0.1295,  0.1782,  0.8046,  0.7604,
         0.2182,  0.9518,  0.4048,  0.8942,  0.1407,  0.4724,  0.6646,
         0.7847,  0.0514,  0.9710,  0.1470,  0.2922,  0.0697,  0.1753,
         0.0488,  0.3315,  0.1707,  0.3041,  0.1690,  0.3282,  0.7808,
         0.0439,  0.0719,  0.5450,  0.0177,  0.1265,  0.7402,  0.8692,
         0.9150,  0.8745,  0.9082,  0.6132,  0.8285,  0.0456,  0.4855,
         0.1435,  0.0401,  0.8217,  0.7775,  0.0726,  0.8455,  0.6390,
         0.0347,  0.4746,  0.1012,  0.0162,  0.1564,  0.8234,  0.0335,
         0.0920,  0.7934,  0.1191,  0.0193,  0.5185,  0.4403,  0.3497,
         0.8817,  0.1741,  0.8970,  0.1025,  0.9589,  0.1796,  0.1700,
         0.8507,  0.4980,  0.8936,  0.0545,  0.3915,  0.7321,  0.9214,
         0.8320,  0.0692,  0.4522,  0.5643,  0.7737,  0.0646,  0.2523,
         0.1079,  0.2047,  0.1311,  0.7178,  0.1258,  0.1317,  0.0214,
         0.8550,  0.1721,  0.3851,  0.6357,  0.0559,  0.2386,  0.2642,
         0.0325,  0.0106,  0.3821,  0.5624,  0.1420,  0.9248,  0.4715,
         0.2242,  0.7749,  0.2718,  0.4685,  0.2421,  0.9046,  0.0212,
         0.1878,  0.0554,  0.0276,  0.6608,  0.9708,  0.5860,  0.8767,
         0.0503,  0.1352,  0.8390,  0.0519,  0.5703,  0.6246,  0.2369,
         0.1916,  0.5140,  0.4510,  0.0883,  0.8681,  0.2745,  0.0164,
         0.8010,  0.6148,  0.8170,  0.9473,  0.9372,  0.4604,  0.8142,
         0.0867,  0.8896,  0.9961,  0.4955,  0.4644,  0.0035,  0.1151,
         0.2285,  0.0058,  0.0195,  0.8681,  0.9528,  0.4636,  0.9002,
         0.6259,  0.5175,  0.0637,  0.4361,  0.8805,  0.2428,  0.9918,
         0.0220,  0.1020,  0.8834,  0.8946,  0.8641,  0.8392,  0.0055,
         0.0182,  0.1077,  0.7976,  0.1640,  0.8195,  0.1242,  0.8421,
         0.1446,  0.0778,  0.0631,  0.9607,  0.7400,  0.3626,  0.8872,
         0.0620,  0.8658,  0.0164,  0.1991,  0.6783,  0.4009,  0.7461,
         0.3833,  0.5724,  0.2466,  0.7992,  0.3097,  0.9104,  0.9051,
         0.8161,  0.8394,  0.6568,  0.5577,  0.9636,  0.0750,  0.9930,
         0.1015,  0.3141,  0.7348,  0.8147,  0.2014,  0.8976,  0.8258,
         0.0282,  0.0817,  0.8182,  0.3710,  0.0769,  0.0372,  0.4563,
         0.1608,  0.4196,  0.0835,  0.9020,  0.0735,  0.8277,  0.0056,
         0.4710,  0.3226,  0.0505,  0.5271,  0.9441,  0.7491,  0.6546,
         0.9130,  0.3135,  0.7447,  0.4261,  0.1287,  0.0238,  0.3807,
         0.0626,  0.1392,  0.7283,  0.2184,  0.5049,  0.7906,  0.0863,
         0.2844,  0.8464,  0.1077,  0.1978,  0.9409,  0.4241,  0.0723,
         0.1596,  0.1452,  0.9091,  0.0270,  0.1153,  0.4537,  0.0123,
         0.5904,  0.7722,  0.0141,  0.5437,  0.0347,  0.0268,  0.1353,
         0.2032,  0.0865,  0.2339,  0.6201,  0.1013,  0.3883,  0.0203,
         0.0667,  0.2652,  0.8179,  0.9260,  0.9325,  0.3483,  0.8609,
         0.9611,  0.9025,  0.1307,  0.9993,  0.1237,  0.2063,  0.9753,
         0.2763,  0.5202,  0.0139,  0.7783,  0.5555,  0.4321,  0.6655,
         0.1292], device='cuda:0')
tensor(0.4072, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9339,  0.4602,  0.0627,  0.8820,  0.0016,  0.7850,  0.9310,
         0.2555,  0.1936,  0.0791,  0.1625,  0.2659,  0.5617,  0.0305,
         0.3664,  0.8046,  0.0532,  0.0987,  0.9005,  0.4005,  0.9409,
         0.1753,  0.0817,  0.8938,  0.0155,  0.6446,  0.0493,  0.0672,
         0.9088,  0.8289,  0.1620,  0.0146,  0.3514,  0.4788,  0.8565,
         0.7193,  0.0536,  0.5842,  0.0965,  0.3630,  0.8152,  0.3538,
         0.6321,  0.9642,  0.0432,  0.0987,  0.7922,  0.0861,  0.0346,
         0.1064,  0.0314,  0.4687,  0.3974,  0.1609,  0.8251,  0.8509,
         0.9391,  0.4522,  0.0620,  0.4130,  0.0151,  0.9474,  0.0536,
         0.9772,  0.0537,  0.6677,  0.0254,  0.9593,  0.2367,  0.8992,
         0.5400,  0.7138,  0.0393,  0.0102,  0.7091,  0.0695,  0.0109,
         0.9736,  0.0871,  0.7196,  0.6368,  0.9343,  0.7939,  0.1270,
         0.3977,  0.9618,  0.9170,  0.9223,  0.0015,  0.5279,  0.9765,
         0.9585,  0.7829,  0.0443,  0.4627,  0.5716,  0.9345,  0.2544,
         0.9737,  0.8545,  0.0630,  0.4733,  0.3546,  0.0506,  0.2308,
         0.0207,  0.7560,  0.0204,  0.1127,  0.3695,  0.0130,  0.9225,
         0.2357,  0.1005,  0.0074,  0.7544,  0.9227,  0.0403,  0.8977,
         0.8161,  0.8085,  0.7993,  0.9286,  0.0517,  0.0307,  0.9255,
         0.0098,  0.1778,  0.8683,  0.7804,  0.0184,  0.6871,  0.7511,
         0.1404,  0.6462,  0.4930,  0.0712,  0.0169,  0.0255,  0.8473,
         0.9412,  0.0784,  0.0231,  0.3627,  0.0459,  0.0674,  0.0704,
         0.0276,  0.0652,  0.0084,  0.9684,  0.0397,  0.0082,  0.4304,
         0.9955,  0.0541,  0.0972,  0.0284,  0.0446,  0.3921,  0.2474,
         0.1667,  0.0059,  0.5609,  0.5706,  0.7779,  0.0838,  0.9593,
         0.0749,  0.1576,  0.9729,  0.0152,  0.0154,  0.0105,  0.4273,
         0.0153,  0.0154,  0.3046,  0.9113,  0.9319,  0.2827,  0.8254,
         0.9340,  0.2430,  0.0505,  0.7879,  0.6573,  0.1115,  0.1948,
         0.6323,  0.9112,  0.9758,  0.5603,  0.4525,  0.4457,  0.0120,
         0.3818,  0.9062,  0.5957,  0.0451,  0.0586,  0.9257,  0.9852,
         0.1780,  0.7887,  0.1193,  0.9231,  0.1061,  0.8345,  0.9859,
         0.0210,  0.6429,  0.3077,  0.9293,  0.6552,  0.8915,  0.5376,
         0.0133,  0.2022,  0.2943,  0.3018,  0.9005,  0.0136,  0.0347,
         0.3664,  0.9003,  0.0458,  0.3586,  0.0444,  0.9995,  0.0073,
         0.1091,  0.7892,  0.9994,  0.0957,  0.3187,  0.1174,  0.0973,
         0.7797,  0.1835,  0.0308,  0.9955,  0.0712,  0.0479,  0.6837,
         0.2638,  0.1911,  0.2738,  0.5580,  0.7647,  0.8502,  0.0528,
         0.6127,  0.1464,  0.9940,  0.9262,  0.0528,  0.9297,  0.2613,
         0.0578,  0.8634,  0.9930,  0.1748,  0.6630,  0.8509,  0.0044,
         0.8169,  0.3127,  0.0179,  0.1191,  0.1549,  0.8513,  0.9384,
         0.0129,  0.9145,  0.3038,  0.0958,  0.4610,  0.0445,  0.8771,
         0.5426,  0.0300,  0.9116,  0.1243,  0.9287,  0.9201,  0.3863,
         0.6022,  0.0599,  0.8888,  0.1356,  0.5198,  0.0902,  0.0462,
         0.9482,  0.1726,  0.1758,  0.1632,  0.9525,  0.5754,  0.9700,
         0.1050,  0.0198,  0.9500,  0.0496,  0.6818,  0.2658,  0.2285,
         0.9371,  0.0280,  0.1087,  0.0189,  0.0217,  0.8550,  0.8329,
         0.9008,  0.2116,  0.9989,  0.9296,  0.8235,  0.0330,  0.0747,
         0.5544,  0.9422,  0.0142,  0.6432,  0.4469,  0.6825,  0.9025,
         0.0266,  0.9695,  0.0402,  0.5526,  0.4459,  0.3419,  0.0115,
         0.7395,  0.9183,  0.0144,  0.8737,  0.0054,  0.7834,  0.5622,
         0.0428,  0.5696,  0.9556,  0.9946,  0.0478,  0.9704,  0.3763,
         0.3166,  0.1302,  0.3924,  0.3191,  0.0729,  0.0271,  0.0602,
         0.8785,  0.9163,  0.0453,  0.1766,  0.0155,  0.0233,  0.0714,
         0.0102,  0.8538,  0.9394,  0.1081,  0.9844,  0.0764,  0.6604,
         0.1970,  0.0675,  0.5836,  0.0062,  0.1241,  0.0528,  0.0329,
         0.4522,  0.0040,  0.9039,  0.9918,  0.7155,  0.0472,  0.9839,
         0.9443,  0.8687,  0.0128,  0.1069,  0.6972,  0.8177,  0.3931,
         0.0474,  0.0076,  0.9455,  0.9173,  0.9894,  0.8880,  0.0254,
         0.6136,  0.4967,  0.2575,  0.7962,  0.8521,  0.9289,  0.5540,
         0.9231,  0.6899,  0.3004,  0.7518,  0.1198,  0.7613,  0.8817,
         0.9870,  0.9223,  0.0631,  0.9963,  0.6251,  0.9753,  0.0780,
         0.6279,  0.6235,  0.2529,  0.7371,  0.8662,  0.8430,  0.7365,
         0.9307,  0.0285,  0.0297,  0.0105,  0.4209,  0.1276,  0.0095,
         0.9069,  0.9451,  0.0370,  0.8773,  0.9195,  0.3101,  0.8496,
         0.2588,  0.7925,  0.7942,  0.8937,  0.0308,  0.5068,  0.8540,
         0.4424,  0.0149,  0.8350,  0.8310,  0.0038,  0.0591,  0.0318,
         0.9261,  0.8610,  0.1043,  0.0054,  0.1106,  0.0451,  0.8600,
         0.9626,  0.9566,  0.2484,  0.8019,  0.0302,  0.0125,  0.9184,
         0.9366,  0.8105,  0.6781,  0.0154,  0.0375,  0.0225,  0.7561,
         0.1908,  0.0758,  0.2706,  0.1626,  0.0122,  0.2781,  0.9414,
         0.8193,  0.7960,  0.5508,  0.1390,  0.9335,  0.1310,  0.0470,
         0.7044,  0.7204,  0.0357,  0.9959,  0.7168,  0.9502,  0.4538,
         0.0574,  0.1242,  0.0403,  0.0569,  0.0836,  0.0481,  0.8733,
         0.9351,  0.0769,  0.0056,  0.0471,  0.9419,  0.4735,  0.1076,
         0.5552], device='cuda:0')
tensor(0.3479, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0613,  0.0503,  0.9937,  0.1616,  0.0892,  0.8333,  0.9593,
         0.0033,  0.7749,  0.0394,  0.1606,  0.0068,  0.9050,  0.2097,
         0.9501,  0.0748,  0.0478,  0.2106,  0.7388,  0.1283,  0.9283,
         0.8485,  0.9684,  0.0238,  0.8406,  0.0063,  0.7049,  0.0192,
         0.2992,  0.6220,  0.0390,  0.0574,  0.2586,  0.9772,  0.0016,
         0.0165,  0.0050,  0.7898,  0.8373,  0.5032,  0.5583,  0.3292,
         0.4449,  0.2347,  0.7465,  0.0311,  0.0084,  0.0249,  0.0915,
         0.7156,  0.0193,  0.1335,  0.8246,  0.0262,  0.0421,  0.7954,
         0.1329,  0.2399,  0.0346,  0.7722,  0.0592,  0.8878,  0.9889,
         0.9191,  0.0251,  0.8349,  0.0618,  0.0578,  0.2950,  0.4737,
         0.0176,  0.4374,  0.9675,  0.0191,  0.8712,  0.9409,  0.0961,
         0.0747,  0.1714,  0.8661,  0.6760,  0.0715,  0.8929,  0.0209,
         0.2887,  0.1100,  0.0110,  0.7673,  0.8697,  0.8340,  0.9347,
         0.7496,  0.8132,  0.9991,  0.9961,  0.2504,  0.1426,  0.0727,
         0.0922,  0.9375,  0.0113,  0.0034,  0.9082,  0.0453,  0.0589,
         0.9408,  0.0070,  0.9255,  0.0127,  0.3835,  0.0193,  0.9206,
         0.0427,  0.9384,  0.5202,  0.0760,  0.1125,  0.3060,  0.5350,
         0.8774,  0.0420,  0.3778,  0.9584,  0.8155,  0.7642,  0.0161,
         0.0502,  0.0018,  0.4253,  0.2296,  0.4240,  0.0150,  0.0507,
         0.5673,  0.2127,  0.0526,  0.9764,  0.1197,  0.9324,  0.0189,
         0.0691,  0.0078,  0.7985,  0.8829,  0.0559,  0.2388,  0.1101,
         0.1013,  0.3223,  0.9777,  0.0176,  0.5612,  0.3399,  0.0204,
         0.0227,  0.2008,  0.9878,  0.9667,  0.0419,  0.0865,  0.9564,
         0.0605,  0.2985,  0.9354,  0.9188,  0.0377,  0.9898,  0.0440,
         0.8680,  0.5315,  0.8832,  0.8223,  0.1691,  0.5247,  0.4107,
         0.8953,  0.2333,  0.9381,  0.3855,  0.0299,  0.0093,  0.1708,
         0.1827,  0.8182,  0.9471,  0.8507,  0.9025,  0.9626,  0.9764,
         0.7451,  0.0413,  0.5798,  0.0375,  0.5922,  0.5079,  0.0191,
         0.0059,  0.4787,  0.0099,  0.1002,  0.9635,  0.3890,  0.1359,
         0.9765,  0.0614,  0.2396,  0.7781,  0.7258,  0.1486,  0.0408,
         0.9041,  0.2512,  0.4009,  0.0071,  0.0373,  0.9760,  0.8725,
         0.8766,  0.6058,  0.8542,  0.0161,  0.1326,  0.0160,  0.8321,
         0.7835,  0.8706,  0.0568,  0.9375,  0.9980,  0.9496,  0.9315,
         0.0567,  0.1113,  0.1233,  0.0806,  0.8678,  0.0800,  0.6163,
         0.0908,  0.9430,  0.1532,  0.8500,  0.9549,  0.2145,  0.5400,
         0.7568,  0.9705,  0.7339,  0.8786,  0.2027,  0.9896,  0.0594,
         0.0033,  0.6442,  0.0374,  0.9178,  0.0468,  0.8484,  0.0064,
         0.9476,  0.3134,  0.1555,  0.8951,  0.6853,  0.0873,  0.0323,
         0.9316,  0.0126,  0.9401,  0.6689,  0.0325,  0.6059,  0.0164,
         0.0576,  0.9629,  0.6566,  0.8909,  0.0320,  0.0799,  0.0467,
         0.7741,  0.9955,  0.3021,  0.9221,  0.8443,  0.9163,  0.0324,
         0.0757,  0.0737,  0.1777,  0.0068,  0.0295,  0.0617,  0.5621,
         0.7996,  0.1463,  0.9259,  0.1180,  0.9754,  0.1960,  0.9825,
         0.0078,  0.0625,  0.1313,  0.0210,  0.0053,  0.9640,  0.0200,
         0.9993,  0.5665,  0.4125,  0.9972,  0.8346,  0.1166,  0.0979,
         0.6612,  0.1290,  0.1409,  0.9832,  0.8435,  0.0783,  0.9228,
         0.0596,  0.9722,  0.8410,  0.0609,  0.0620,  0.0629,  0.0962,
         0.9740,  0.0052,  0.0302,  0.0552,  0.2768,  0.0228,  0.5601,
         0.0040,  0.0237,  0.7719,  0.0331,  0.3969,  0.0651,  0.9991,
         0.0265,  0.9982,  0.9305,  0.3451,  0.0078,  0.0315,  0.0761,
         0.0336,  0.5397,  0.0362,  0.0193,  0.7427,  0.0653,  0.9226,
         0.7904,  0.5443,  0.2290,  0.1537,  0.8439,  0.0296,  0.4374,
         0.8275,  0.0328,  0.4840,  0.9066,  0.0063,  0.0743,  0.0207,
         0.2073,  0.0301,  0.0312,  0.9721,  0.1015,  0.2526,  0.2342,
         0.9829,  0.8082,  0.0241,  0.0620,  0.9273,  0.3001,  0.0077,
         0.7871,  0.0637,  0.0133,  0.7503,  0.0778,  0.0901,  0.8744,
         0.8657,  0.8066,  0.9396,  0.0020,  0.1123,  0.0389,  0.9623,
         0.0400,  0.9431,  0.1898,  0.8844,  0.0239,  0.0131,  0.8976,
         0.0130,  0.1588,  0.0180,  0.1386,  0.8259,  0.9408,  0.9942,
         0.8931,  0.0849,  0.7852,  0.0856,  0.9397,  0.0097,  0.0147,
         0.9156,  0.2256,  0.0027,  0.9690,  0.8753,  0.0159,  0.9922,
         0.2011,  0.0198,  0.9451,  0.9565,  0.0383,  0.0242,  0.8840,
         0.7926,  0.6580,  0.9360,  0.0453,  0.3609,  0.6054,  0.1029,
         0.8918,  0.8807,  0.1649,  0.5208,  0.0117,  0.4368,  0.0129,
         0.0326,  0.3352,  0.0862,  0.9389,  0.0319,  0.9532,  0.0607,
         0.8606,  0.8652,  0.8998,  0.9887,  0.1393,  0.0028,  0.9570,
         0.0205,  0.8195,  0.5116,  0.1196,  0.4022,  0.7701,  0.9189,
         0.7131,  0.0054,  0.9658,  0.0070,  0.0433,  0.7174,  0.0607,
         0.0089,  0.9392,  0.5537,  0.5774,  0.9796,  0.6479,  0.0951,
         0.9079,  0.0701,  0.7803,  0.8995,  0.0018,  0.0657,  0.9654,
         0.9574,  0.9933,  0.7528,  0.0133,  0.8682,  0.8882,  0.9777,
         0.4325,  0.0268,  0.0478,  0.2585,  0.1917,  0.8557,  0.9381,
         0.9826,  0.5492,  0.9160,  0.9567,  0.9220,  0.0436,  0.9571,
         0.6701], device='cuda:0')
tensor(0.3461, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8252,  0.6551,  0.8878,  0.9812,  0.8694,  0.5866,  0.9952,
         0.0699,  0.9579,  0.9902,  0.9603,  0.8638,  0.1526,  0.9155,
         0.2486,  0.1000,  0.0781,  0.9998,  0.0376,  0.0271,  0.0016,
         0.2921,  0.0235,  0.3276,  0.0962,  0.0753,  0.3499,  0.9099,
         0.9760,  0.8460,  0.0941,  0.0990,  0.9304,  0.7508,  0.9465,
         0.9592,  0.1624,  0.0554,  0.0580,  0.1630,  0.9741,  0.0138,
         0.9362,  0.6260,  0.1005,  0.0858,  0.8844,  0.7289,  0.9969,
         0.0524,  0.8595,  0.9703,  0.0225,  0.1121,  0.0428,  0.9420,
         0.9591,  0.9680,  0.0630,  0.7133,  0.0391,  0.9360,  0.0098,
         0.9850,  0.0869,  0.6678,  0.0164,  0.9399,  0.9141,  0.8298,
         0.9713,  0.9988,  0.9613,  0.0566,  0.9104,  0.9031,  0.0461,
         0.0530,  0.9117,  0.6868,  0.9276,  0.1711,  0.9194,  0.9775,
         0.8919,  0.0181,  0.9654,  0.0150,  0.2381,  0.0761,  0.2708,
         0.0097,  0.9810,  0.0446,  0.9808,  0.2212,  0.9566,  0.8568,
         0.9047,  0.2456,  0.8672,  0.0431,  0.9029,  0.0258,  0.8307,
         0.9574,  0.8781,  0.8600,  0.6642,  0.4412,  0.0989,  0.9684,
         0.0849,  0.1049,  0.2970,  0.9325,  0.2541,  0.0849,  0.5513,
         0.0218,  0.9049,  0.1863,  0.9504,  0.0246,  0.0367,  0.8752,
         0.4136,  0.9206,  0.1126,  0.6241,  0.9182,  0.0363,  0.1062,
         0.1169,  0.9332,  0.1091,  0.9034,  0.9700,  0.9579,  0.9396,
         0.9108,  0.8893,  0.0599,  0.1630,  0.0177,  0.0795,  0.9181,
         0.9110,  0.8554,  0.5534,  0.9958,  0.9956,  0.9976,  0.9234,
         0.0544,  0.9421,  0.9749,  0.6573,  0.8108,  0.8646,  0.9520,
         0.1386,  0.0455,  0.9175,  0.0244,  0.5071,  0.4634,  0.0046,
         0.4840,  0.1537,  0.1359,  0.9449,  0.0761,  0.8819,  0.0208,
         0.0285,  0.0460,  0.9716,  0.3350,  0.9141,  0.9706,  0.0459,
         0.6063,  0.9589,  0.3586,  0.8450,  0.0639,  0.8211,  0.9687,
         0.1161,  0.0298,  0.9308,  0.1229,  0.5417,  0.9244,  0.9616,
         0.0241,  0.9497,  0.2356,  0.0098,  0.0910,  0.0244,  0.7527,
         0.8372,  0.9311,  0.9970,  0.7229,  0.6461,  0.9297,  0.0419,
         0.0214,  0.9968,  0.0610,  0.9420,  0.8398,  0.0036,  0.0551,
         0.8341,  0.9939,  0.3092,  0.0916,  0.0505,  0.9597,  0.0185,
         0.9927,  0.9311,  0.9819,  0.8702,  0.0150,  0.9068,  0.0828,
         0.9942,  0.9024,  0.9569,  0.6579,  0.9565,  0.1086,  0.0464,
         0.0626,  0.9591,  0.0281,  0.2255,  0.0116,  0.4762,  0.1226,
         0.9090,  0.0118,  0.0648,  0.9803,  0.9432,  0.0874,  0.0811,
         0.7552,  0.9984,  0.0648,  0.0516,  0.5574,  0.0093,  0.0463,
         0.5533,  0.7687,  0.0109,  0.0965,  0.9342,  0.1352,  0.9915,
         0.0054,  0.9716,  0.9754,  0.0639,  0.0664,  0.0599,  0.5629,
         0.9462,  0.0728,  0.9395,  0.8231,  0.8956,  0.9421,  0.0224,
         0.3022,  0.0030,  0.9412,  0.0262,  0.8575,  0.9762,  0.9912,
         0.0256,  0.9623,  0.0371,  0.7587,  0.0084,  0.8665,  0.1463,
         0.9254,  0.1102,  0.9060,  0.9198,  0.8598,  0.5061,  0.4756,
         0.7800,  0.1218,  0.8902,  0.1785,  0.9954,  0.0053,  0.0810,
         0.0143,  0.9399,  0.9109,  0.1369,  0.0760,  0.4215,  0.8693,
         0.3651,  0.9485,  0.2833,  0.0933,  0.5854,  0.1576,  0.0497,
         0.9666,  0.0203,  0.7729,  0.9582,  0.6471,  0.1862,  0.9038,
         0.9682,  0.9028,  0.5260,  0.0761,  0.9768,  0.0181,  0.0477,
         0.8991,  0.0725,  0.9163,  0.9620,  0.8924,  0.3344,  0.1629,
         0.1344,  0.3240,  0.2306,  0.9699,  0.0527,  0.9520,  0.2562,
         0.6298,  0.5228,  0.8924,  0.9420,  0.0059,  0.9780,  0.8285,
         0.0193,  0.9808,  0.0622,  0.0621,  0.9970,  0.0740,  0.8920,
         0.0569,  0.9414,  0.5218,  0.4711,  0.9550,  0.0355,  0.9641,
         0.6127,  0.0459,  0.4270,  0.0346,  0.8915,  0.0677,  0.8906,
         0.9652,  0.1732,  0.1481,  0.0833,  0.7148,  0.1978,  0.4534,
         0.5032,  0.7195,  0.9577,  0.0061,  0.0626,  0.9728,  0.0066,
         0.9429,  0.9519,  0.8549,  0.8120,  0.0569,  0.0638,  0.7947,
         0.0335,  0.9021,  0.4275,  0.0172,  0.1490,  0.0850,  0.9517,
         0.9951,  0.9379,  0.0193,  0.9005,  0.8284,  0.1021,  0.0063,
         0.4015,  0.8097,  0.8433,  0.0711,  0.5910,  0.0809,  0.9192,
         0.4683,  0.0360,  0.0664,  0.8634,  0.2343,  0.0671,  0.0056,
         0.0794,  0.8936,  0.4248,  0.8930,  0.0502,  0.0358,  0.1232,
         0.9666,  0.9926,  0.8904,  0.0043,  0.0112,  0.5583,  0.1216,
         0.0595,  0.9817,  0.0762,  0.7904,  0.1178,  0.0843,  0.0912,
         0.7954,  0.2762,  0.7999,  0.0120,  0.0026,  0.5599,  0.9141,
         0.8748,  0.1169,  0.9825,  0.9034,  0.0118,  0.9733,  0.0060,
         0.0012,  0.9502,  0.8111,  0.9787,  0.9083,  0.0487,  0.2927,
         0.2395,  0.8837,  0.8394,  0.4679,  0.6811,  0.9604,  0.7506,
         0.0591,  0.9569,  0.9413,  0.4467,  0.9258,  0.9663,  0.9668,
         0.9774,  0.9326,  0.0419,  0.9796,  0.0502,  0.0967,  0.8017,
         0.5770,  0.6881,  0.0499,  0.7667,  0.0560,  0.2567,  0.8626,
         0.9976,  0.8574,  0.7370,  0.9479,  0.0812,  0.5455,  0.9334,
         0.9204,  0.1510,  0.9856,  0.4880,  0.1237,  0.8437,  0.9598,
         0.0694], device='cuda:0')
tensor(0.3754, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9643,  0.8480,  0.1461,  0.9461,  0.9390,  0.2007,  0.1187,
         0.0418,  0.2009,  0.9041,  0.6932,  0.0897,  0.0656,  0.9192,
         0.9744,  0.9736,  0.9748,  0.1705,  0.7402,  0.7707,  0.4972,
         0.1254,  0.6846,  0.9218,  0.1006,  0.2861,  0.9357,  0.2014,
         0.9822,  0.8577,  0.8757,  0.5756,  0.9429,  0.9406,  0.7068,
         0.2918,  0.9238,  0.8059,  0.5586,  0.9634,  0.9729,  0.1579,
         0.9052,  0.1957,  0.8838,  0.0942,  0.1158,  0.9105,  0.6287,
         0.1043,  0.8562,  0.9330,  0.1007,  0.8612,  0.0021,  0.0598,
         0.9767,  0.9038,  0.0923,  0.0127,  0.9646,  0.9653,  0.4231,
         0.1087,  0.2100,  0.9335,  0.9168,  0.0759,  0.9307,  0.1512,
         0.8553,  0.9265,  0.6605,  0.2693,  0.9719,  0.2557,  0.8571,
         0.9675,  0.0371,  0.6357,  0.8361,  0.0571,  0.9373,  0.4494,
         0.0196,  0.8970,  0.9618,  0.2773,  0.8295,  0.9619,  0.9705,
         0.9492,  0.9919,  0.9031,  0.9385,  0.0387,  0.9389,  0.0895,
         0.9233,  0.1182,  0.0621,  0.1875,  0.7756,  0.8029,  0.7704,
         0.9689,  0.9304,  0.4930,  0.0982,  0.0289,  0.2151,  0.9739,
         0.0789,  0.9274,  0.9444,  0.9674,  0.5248,  0.0572,  0.6166,
         0.8910,  0.3723,  0.9732,  0.9380,  0.1657,  0.1309,  0.9996,
         0.1280,  0.8170,  0.9534,  0.0054,  0.9933,  0.9497,  0.7260,
         0.4514,  0.8058,  0.9576,  0.9036,  0.1451,  0.1350,  0.6006,
         0.9725,  0.9553,  0.6908,  0.4363,  0.8982,  0.9648,  0.6635,
         0.9688,  0.1861,  0.8849,  0.0496,  0.7251,  0.5118,  0.9745,
         0.9378,  0.9364,  0.0195,  0.9723,  0.9699,  0.4516,  0.3890,
         0.9738,  0.0447,  0.9578,  0.9846,  0.9541,  0.9849,  0.9375,
         0.1054,  0.9288,  0.4283,  0.5646,  0.9854,  0.9914,  0.8448,
         0.3685,  0.2885,  0.0752,  0.7469,  0.9775,  0.9323,  0.8940,
         0.9166,  0.7113,  0.4867,  0.8187,  0.5638,  0.8400,  0.0346,
         0.9296,  0.6920,  0.7560,  0.8112,  0.0331,  0.9508,  0.9572,
         0.0489,  0.1042,  0.4635,  0.9458,  0.8666,  0.9401,  0.6950,
         0.9206,  0.9953,  0.9406,  0.9391,  0.1093,  0.9390,  0.2960,
         0.9518,  0.9491,  0.8441,  0.1342,  0.9767,  0.9080,  0.3218,
         0.2555,  0.8826,  0.7951,  0.9411,  0.4096,  0.9422,  0.0473,
         0.8146,  0.0773,  0.7458,  0.3990,  0.9078,  0.2910,  0.9222,
         0.0393,  0.9401,  0.9990,  0.3750,  0.9906,  0.2818,  0.0204,
         0.9498,  0.3368,  0.9690,  0.9618,  0.9956,  0.9946,  0.7623,
         0.2292,  0.8732,  0.3972,  0.9380,  0.9995,  0.4505,  0.9602,
         0.0595,  0.9486,  0.5426,  0.5704,  0.0262,  0.6468,  0.9440,
         0.9427,  0.6840,  0.8620,  0.0366,  0.9480,  0.4334,  0.0203,
         0.9348,  0.0656,  0.0481,  0.2372,  0.0926,  0.4838,  0.0664,
         0.9752,  0.9199,  0.9519,  0.3651,  0.9048,  0.9719,  0.9540,
         0.6513,  0.8033,  0.0133,  0.6165,  0.9749,  0.9772,  0.8373,
         0.7212,  0.9595,  0.8129,  0.6756,  0.9367,  0.0903,  0.3142,
         0.5960,  0.1159,  0.2359,  0.7986,  0.8403,  0.0939,  0.0784,
         0.9359,  0.4516,  0.3649,  0.2413,  0.9592,  0.4795,  0.9712,
         0.9632,  0.9356,  0.9795,  0.9787,  0.7889,  0.0924,  0.9004,
         0.0066,  0.9478,  0.8759,  0.1210,  0.9574,  0.9670,  0.4140,
         0.1222,  0.0195,  0.9549,  0.5536,  0.1234,  0.8986,  0.0874,
         0.9553,  0.9882,  0.7891,  0.0071,  0.8295,  0.7401,  0.1662,
         0.0012,  0.5090,  0.9279,  0.3642,  0.9898,  0.8400,  0.6941,
         0.8232,  0.9646,  0.8249,  0.1010,  0.0406,  0.9479,  0.8336,
         0.9783,  0.9733,  0.9761,  0.9234,  0.5753,  0.1739,  0.1804,
         0.9603,  0.9841,  0.9058,  0.0124,  0.7794,  0.9636,  0.0020,
         0.1235,  0.9223,  0.9168,  0.0241,  0.7288,  0.9569,  0.8538,
         0.9489,  0.8990,  0.1116,  0.9915,  0.0493,  0.9069,  0.0979,
         0.3026,  0.9087,  0.2872,  0.0130,  0.8091,  0.7606,  0.3584,
         0.9253,  0.9978,  0.0087,  0.2247,  0.2094,  0.1243,  0.0307,
         0.0230,  0.1399,  0.9007,  0.9657,  0.1921,  0.1292,  0.5143,
         0.8273,  0.9841,  0.1724,  0.9543,  0.8346,  0.2840,  0.0463,
         0.8177,  0.9097,  0.8424,  0.8430,  0.9943,  0.0426,  0.1429,
         0.2134,  0.9180,  0.9369,  0.2390,  0.1149,  0.1296,  0.0052,
         0.5285,  0.1047,  0.2008,  0.1844,  0.9128,  0.4076,  0.7144,
         0.0418,  0.1509,  0.4441,  0.1622,  0.8053,  0.2813,  0.9009,
         0.3406,  0.5019,  0.9473,  0.1890,  0.9958,  0.8195,  0.9843,
         0.0478,  0.0374,  0.9511,  0.8804,  0.9187,  0.8855,  0.0517,
         0.9733,  0.4741,  0.9807,  0.0811,  0.1900,  0.9878,  0.9275,
         0.9965,  0.0306,  0.0304,  0.7086,  0.8649,  0.0899,  0.9225,
         0.0272,  0.1525,  0.1126,  0.8571,  0.9348,  0.7784,  0.9592,
         0.8546,  0.0443,  0.0779,  0.9503,  0.9372,  0.0338,  0.9018,
         0.3654,  0.9977,  0.9547,  0.6346,  0.0654,  0.7660,  0.8092,
         0.9342,  0.8787,  0.8433,  0.7201,  0.9522,  0.2787,  0.9875,
         0.9876,  0.9541,  0.0082,  0.9687,  0.5437,  0.7662,  0.9173,
         0.9721,  0.9892,  0.7041,  0.9849,  0.2957,  0.9859,  0.9667,
         0.2511,  0.0896,  0.0767,  0.1408,  0.9451,  0.0077,  0.0225,
         0.9437], device='cuda:0')
tensor(0.3973, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0167,  0.0554,  0.1046,  0.1280,  0.8016,  0.9570,  0.7861,
         0.9603,  0.9484,  0.1838,  0.0811,  0.4654,  0.6823,  0.0072,
         0.9062,  0.8444,  0.0849,  0.9483,  0.5041,  0.8121,  0.0847,
         0.1632,  0.9194,  0.0734,  0.9945,  0.8861,  0.1838,  0.8470,
         0.3315,  0.8941,  0.5685,  0.1498,  0.4374,  0.1139,  0.8950,
         0.9934,  0.9164,  0.5457,  0.0396,  0.9055,  0.9130,  0.0589,
         0.9155,  0.8101,  0.7523,  0.3755,  0.9448,  0.9924,  0.8192,
         0.0480,  0.0203,  0.0191,  0.4084,  0.8052,  0.9233,  0.0549,
         0.7801,  0.8626,  0.0096,  0.7214,  0.0324,  0.8934,  0.8856,
         0.0938,  0.0410,  0.6465,  0.9253,  0.1520,  0.9102,  0.0631,
         0.6143,  0.0095,  0.6893,  0.9857,  0.9735,  0.0817,  0.8701,
         0.8444,  0.8106,  0.8105,  0.9569,  0.8083,  0.9388,  0.8225,
         0.9071,  0.9860,  0.0451,  0.3880,  0.8922,  0.0227,  0.0742,
         0.5693,  0.9348,  0.6708,  0.5057,  0.1305,  0.2529,  0.8962,
         0.9402,  0.2592,  0.0098,  0.0489,  0.3380,  0.1413,  0.1131,
         0.8703,  0.9301,  0.7802,  0.7704,  0.8809,  0.8989,  0.4006,
         0.8052,  0.1683,  0.9320,  0.4204,  0.8851,  0.9308,  0.3340,
         0.3248,  0.9418,  0.6393,  0.9436,  0.8809,  0.0620,  0.8883,
         0.8693,  0.9155,  0.0044,  0.2835,  0.5794,  0.9464,  0.5881,
         0.2481,  0.9555,  0.9884,  0.1785,  0.6757,  0.9471,  0.8746,
         0.1397,  0.7659,  0.6622,  0.6722,  0.9149,  0.1653,  0.0431,
         0.1519,  0.8463,  0.4772,  0.7566,  0.1179,  0.6168,  0.9346,
         0.0268,  0.9748,  0.0922,  0.2216,  0.9948,  0.8927,  0.7408,
         0.4237,  0.5141,  0.9748,  0.8590,  0.7096,  0.0235,  0.0331,
         0.8600,  0.9161,  0.7040,  0.7333,  0.9144,  0.2128,  0.2647,
         0.9110,  0.9720,  0.2357,  0.9273,  0.6412,  0.7166,  0.9648,
         0.9474,  0.8715,  0.1658,  0.3199,  0.4200,  0.9600,  0.9314,
         0.7709,  0.1010,  0.8017,  0.4187,  0.5055,  0.9634,  0.6095,
         0.1735,  0.7506,  0.8977,  0.9961,  0.1312,  0.9864,  0.0261,
         0.3404,  0.7240,  0.8558,  0.9659,  0.1686,  0.1757,  0.0647,
         0.9446,  0.9368,  0.9540,  0.9157,  0.8518,  0.9529,  0.9186,
         0.8492,  0.6889,  0.0371,  0.9043,  0.7053,  0.9438,  0.0852,
         0.9493,  0.9077,  0.9714,  0.9072,  0.7665,  0.9978,  0.9916,
         0.9114,  0.0391,  0.9679,  0.4995,  0.9218,  0.9035,  0.0118,
         0.9224,  0.1440,  0.9917,  0.4263,  0.6965,  0.3509,  0.8066,
         0.9169,  0.2403,  0.8504,  0.5273,  0.0205,  0.5726,  0.1312,
         0.1865,  0.9354,  0.2841,  0.4641,  0.9236,  0.8718,  0.4248,
         0.9596,  0.0682,  0.8771,  0.8938,  0.8611,  0.9357,  0.9193,
         0.8820,  0.9407,  0.9125,  0.2045,  0.8999,  0.9449,  0.8111,
         0.6423,  0.1056,  0.5158,  0.0983,  0.2282,  0.0561,  0.7847,
         0.2749,  0.8954,  0.8597,  0.0828,  0.0340,  0.9301,  0.1274,
         0.0081,  0.0756,  0.5205,  0.9845,  0.0536,  0.7367,  0.9762,
         0.8335,  0.7102,  0.9192,  0.9501,  0.1544,  0.0286,  0.9550,
         0.0921,  0.5963,  0.7392,  0.6651,  0.9793,  0.3819,  0.0236,
         0.9400,  0.0950,  0.9173,  0.9137,  0.9184,  0.2370,  0.8942,
         0.9484,  0.8700,  0.0558,  0.7959,  0.6921,  0.0068,  0.9400,
         0.9966,  0.6501,  0.9130,  0.6485,  0.9667,  0.9648,  0.9721,
         0.0874,  0.1305,  0.9798,  0.7303,  0.9650,  0.9708,  0.2968,
         0.9781,  0.9027,  0.2225,  0.1040,  0.1501,  0.7722,  0.3582,
         0.8382,  0.6075,  0.3719,  0.6989,  0.9039,  0.8895,  0.7692,
         0.9086,  0.9281,  0.0600,  0.5135,  0.9042,  0.6807,  0.4600,
         0.4482,  0.2713,  0.1254,  0.8685,  0.7337,  0.9702,  0.8197,
         0.5551,  0.8105,  0.9530,  0.7637,  0.6292,  0.9220,  0.9439,
         0.9449,  0.0418,  0.8545,  0.2355,  0.2590,  0.6608,  0.6688,
         0.0624,  0.8647,  0.0086,  0.6726,  0.9659,  0.2302,  0.3098,
         0.9738,  0.1304,  0.9932,  0.2318,  0.0089,  0.9450,  0.5946,
         0.2227,  0.0840,  0.4437,  0.4702,  0.0228,  0.9826,  0.6658,
         0.0375,  0.9134,  0.1698,  0.1042,  0.0430,  0.2019,  0.1985,
         0.0423,  0.9012,  0.0884,  0.7950,  0.9508,  0.7545,  0.9493,
         0.0467,  0.9650,  0.5609,  0.3631,  0.9639,  0.3384,  0.0256,
         0.0912,  0.4017,  0.7725,  0.9814,  0.4824,  0.9130,  0.0201,
         0.9125,  0.6940,  0.9083,  0.2517,  0.9130,  0.9218,  0.0509,
         0.9152,  0.8309,  0.8415,  0.7812,  0.9521,  0.7227,  0.8240,
         0.0831,  0.5435,  0.3118,  0.6840,  0.9419,  0.4301,  0.9098,
         0.9502,  0.9018,  0.4477,  0.0374,  0.2267,  0.8335,  0.9857,
         0.8693,  0.9112,  0.6698,  0.2909,  0.7386,  0.5207,  0.9846,
         0.7843,  0.7256,  0.8501,  0.9157,  0.2028,  0.3848,  0.9753,
         0.1079,  0.7347,  0.0121,  0.8538,  0.9552,  0.5373,  0.7851,
         0.9432,  0.4167,  0.4161,  0.3963,  0.9244,  0.8726,  0.1903,
         0.9696,  0.0255,  0.6341,  0.5776,  0.2351,  0.5448,  0.1558,
         0.9384,  0.0736,  0.9292,  0.7293,  0.0872,  0.4064,  0.1940,
         0.0740,  0.8341,  0.0825,  0.1348,  0.7128,  0.2070,  0.4214,
         0.8375,  0.7728,  0.6586,  0.3088,  0.8921,  0.9805,  0.0458,
         0.6912], device='cuda:0')
tensor(0.3943, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0453,  0.9123,  0.8182,  0.6147,  0.1718,  0.0214,  0.0501,
         0.8833,  0.7837,  0.0629,  0.4541,  0.3500,  0.4638,  0.7704,
         0.5582,  0.4336,  0.1190,  0.0406,  0.1707,  0.2137,  0.7370,
         0.1052,  0.9929,  0.9239,  0.0610,  0.1488,  0.0771,  0.2358,
         0.9640,  0.2158,  0.3486,  0.0196,  0.1853,  0.0035,  0.5209,
         0.8671,  0.0906,  0.8546,  0.8574,  0.9545,  0.5422,  0.1555,
         0.6311,  0.2497,  0.8599,  0.3256,  0.2860,  0.4699,  0.7848,
         0.7445,  0.7794,  0.3017,  0.5266,  0.8225,  0.2830,  0.9372,
         0.6934,  0.6815,  0.9324,  0.2268,  0.3166,  0.4410,  0.3000,
         0.7535,  0.8545,  0.8641,  0.9774,  0.1950,  0.0567,  0.8931,
         0.0702,  0.0780,  0.8132,  0.0453,  0.1943,  0.5956,  0.8649,
         0.5192,  0.9001,  0.0126,  0.0299,  0.8066,  0.8943,  0.7237,
         0.9447,  0.5447,  0.8343,  0.8563,  0.2411,  0.9156,  0.2168,
         0.9118,  0.7833,  0.2406,  0.5510,  0.2617,  0.5315,  0.9389,
         0.4006,  0.8639,  0.5468,  0.4108,  0.6190,  0.7868,  0.1963,
         0.8798,  0.9531,  0.8451,  0.1054,  0.8840,  0.0268,  0.7056,
         0.4454,  0.9184,  0.0667,  0.8582,  0.9649,  0.4715,  0.1272,
         0.8487,  0.0637,  0.7530,  0.5563,  0.9969,  0.9774,  0.8958,
         0.7883,  0.0336,  0.1201,  0.8826,  0.9908,  0.9629,  0.3946,
         0.2975,  0.2463,  0.1307,  0.9001,  0.1674,  0.0948,  0.6771,
         0.1469,  0.7524,  0.4517,  0.3168,  0.8739,  0.5349,  0.5804,
         0.1889,  0.5982,  0.0152,  0.0372,  0.9593,  0.7437,  0.0543,
         0.9143,  0.9484,  0.1344,  0.3450,  0.0424,  0.0942,  0.1089,
         0.1735,  0.8040,  0.2878,  0.0173,  0.9294,  0.1109,  0.1994,
         0.0187,  0.1158,  0.1229,  0.8692,  0.5942,  0.3909,  0.5321,
         0.4437,  0.8185,  0.4378,  0.9309,  0.8925,  0.0651,  0.0693,
         0.6686,  0.0218,  0.7004,  0.9695,  0.3166,  0.3973,  0.7558,
         0.9386,  0.3054,  0.0189,  0.7428,  0.8315,  0.0448,  0.1864,
         0.5559,  0.7976,  0.4750,  0.4714,  0.9751,  0.4348,  0.7981,
         0.9229,  0.6959,  0.6318,  0.9981,  0.7271,  0.9003,  0.7586,
         0.8944,  0.7155,  0.1070,  0.9597,  0.2338,  0.9220,  0.2814,
         0.1072,  0.1165,  0.9898,  0.9905,  0.1903,  0.9683,  0.0967,
         0.9262,  0.5866,  0.7671,  0.7807,  0.8736,  0.1121,  0.8239,
         0.0272,  0.3756,  0.8795,  0.3214,  0.5485,  0.0202,  0.4314,
         0.9988,  0.8733,  0.4839,  0.8837,  0.7462,  0.6082,  0.5503,
         0.4956,  0.8932,  0.7265,  0.6852,  0.2561,  0.3094,  0.1892,
         0.5919,  0.2253,  0.1533,  0.7747,  0.4316,  0.8940,  0.5935,
         0.6914,  0.1482,  0.8363,  0.9716,  0.9466,  0.3204,  0.9352,
         0.9467,  0.9658,  0.0379,  0.6749,  0.1693,  0.8654,  0.9925,
         0.8669,  0.9752,  0.3783,  0.7131,  0.8440,  0.1032,  0.0858,
         0.3433,  0.0653,  0.0176,  0.7817,  0.4145,  0.9150,  0.0709,
         0.3137,  0.9437,  0.6184,  0.8051,  0.3366,  0.1631,  0.6736,
         0.8137,  0.0257,  0.2982,  0.1653,  0.0345,  0.3644,  0.0532,
         0.0353,  0.0586,  0.5447,  0.8801,  0.8096,  0.6316,  0.7563,
         0.6046,  0.5690,  0.9825,  0.4603,  0.3535,  0.8950,  0.7737,
         0.1237,  0.0125,  0.3710,  0.4992,  0.1234,  0.9066,  0.8244,
         0.8541,  0.6729,  0.7062,  0.8266,  0.8453,  0.0066,  0.4134,
         0.8383,  0.9985,  0.8891,  0.7528,  0.9048,  0.8131,  0.7224,
         0.6554,  0.8672,  0.5884,  0.1875,  0.3395,  0.0031,  0.0905,
         0.9134,  0.2120,  0.0159,  0.9407,  0.9651,  0.3185,  0.2372,
         0.6339,  0.0942,  0.2481,  0.9549,  0.8876,  0.6589,  0.7689,
         0.8224,  0.9410,  0.9542,  0.2831,  0.5997,  0.2403,  0.7084,
         0.0770,  0.4231,  0.8681,  0.6603,  0.5619,  0.4089,  0.9495,
         0.6843,  0.0830,  0.7552,  0.2049,  0.9662,  0.4384,  0.5626,
         0.2127,  0.9123,  0.9406,  0.8280,  0.7671,  0.2694,  0.9205,
         0.9214,  0.7477,  0.3716,  0.0347,  0.1096,  0.6662,  0.2885,
         0.9753,  0.1262,  0.0850,  0.7734,  0.7930,  0.2518,  0.8077,
         0.2667,  0.0364,  0.1693,  0.8795,  0.1467,  0.1724,  0.0592,
         0.8975,  0.8764,  0.0560,  0.9850,  0.1515,  0.9092,  0.0918,
         0.5280,  0.0607,  0.0755,  0.1930,  0.0200,  0.2028,  0.6468,
         0.1667,  0.1906,  0.8209,  0.9854], device='cuda:0')
tensor(0.3795, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 6, BCELoss: 0.376927018773799
tensor([ 0.6388,  0.9676,  0.2511,  0.8996,  0.7485,  0.2098,  0.0473,
         0.9912,  0.3416,  0.7948,  0.0872,  0.6702,  0.3827,  0.4083,
         0.0811,  0.6848,  0.2264,  0.3970,  0.1511,  0.0507,  0.2377,
         0.8479,  0.2540,  0.8504,  0.1892,  0.5095,  0.6967,  0.9811,
         0.6727,  0.6918,  0.9404,  0.9574,  0.6928,  0.4779,  0.1668,
         0.0764,  0.8320,  0.7218,  0.0784,  0.0355,  0.5705,  0.5965,
         0.0045,  0.0175,  0.6490,  0.3539,  0.5629,  0.5060,  0.8220,
         0.0983,  0.1098,  0.1456,  0.7433,  0.6904,  0.2665,  0.1264,
         0.9786,  0.6763,  0.8563,  0.9548,  0.2627,  0.6030,  0.7635,
         0.0593,  0.6989,  0.4392,  0.9460,  0.4202,  0.9196,  0.3402,
         0.1283,  0.8018,  0.0584,  0.0280,  0.9977,  0.9862,  0.1378,
         0.2213,  0.0965,  0.1395,  0.3086,  0.9403,  0.6433,  0.0671,
         0.4831,  0.6398,  0.0521,  0.8733,  0.8495,  0.2369,  0.2192,
         0.2456,  0.2152,  0.1983,  0.5663,  0.6456,  0.8793,  0.9592,
         0.1380,  0.0254,  0.4959,  0.0869,  0.2517,  0.9339,  0.5836,
         0.9021,  0.4258,  0.1032,  0.1586,  0.2135,  0.8211,  0.6476,
         0.7078,  0.5176,  0.8047,  0.1390,  0.1363,  0.9848,  0.7883,
         0.7399,  0.3629,  0.9766,  0.6627,  0.0637,  0.0091,  0.3220,
         0.6747,  0.1012,  0.3486,  0.3245,  0.7691,  0.4130,  0.6289,
         0.1068,  0.0207,  0.9689,  0.1696,  0.3977,  0.6442,  0.2633,
         0.0982,  0.2885,  0.8433,  0.4256,  0.3903,  0.1696,  0.1188,
         0.5595,  0.0404,  0.0386,  0.7375,  0.3564,  0.6462,  0.2911,
         0.1666,  0.1118,  0.9644,  0.4900,  0.2344,  0.7511,  0.9589,
         0.9454,  0.4797,  0.7814,  0.7078,  0.2540,  0.4745,  0.8110,
         0.8766,  0.1152,  0.5712,  0.7475,  0.6862,  0.8078,  0.0272,
         0.8680,  0.2589,  0.8597,  0.4830,  0.0744,  0.1636,  0.3799,
         0.9765,  0.9565,  0.8876,  0.0525,  0.9120,  0.9778,  0.3616,
         0.1159,  0.5691,  0.3216,  0.6523,  0.9119,  0.1220,  0.5951,
         0.7238,  0.8349,  0.0779,  0.5020,  0.6038,  0.2008,  0.6841,
         0.7987,  0.2407,  0.7882,  0.3864,  0.2378,  0.7886,  0.8331,
         0.5844,  0.5538,  0.0212,  0.0946,  0.3805,  0.5255,  0.9969,
         0.1381,  0.5699,  0.6925,  0.1702,  0.9414,  0.9456,  0.2328,
         0.0193,  0.9267,  0.1274,  0.7705,  0.6130,  0.8212,  0.9895,
         0.7673,  0.4146,  0.7827,  0.0324,  0.1800,  0.9197,  0.4511,
         0.7058,  0.0951,  0.4105,  0.7539,  0.4769,  0.1830,  0.7081,
         0.8363,  0.0701,  0.0289,  0.6134,  0.9710,  0.2312,  0.9680,
         0.1120,  0.1569,  0.7216,  0.0525,  0.6805,  0.5534,  0.6947,
         0.8141,  0.0219,  0.9401,  0.8827,  0.8791,  0.3398,  0.1443,
         0.9755,  0.1062,  0.6463,  0.2390,  0.1553,  0.2060,  0.0646,
         0.3088,  0.9235,  0.8742,  0.4404,  0.4690,  0.2014,  0.8003,
         0.7062,  0.0886,  0.9109,  0.6092,  0.2844,  0.0420,  0.6993,
         0.2571,  0.4425,  0.8319,  0.3710,  0.2218,  0.7493,  0.2717,
         0.8824,  0.0817,  0.9942,  0.5759,  0.6585,  0.1920,  0.7051,
         0.2858,  0.6816,  0.9076,  0.6170,  0.9634,  0.0601,  0.2019,
         0.3748,  0.8495,  0.4236,  0.4644,  0.9434,  0.8646,  0.3957,
         0.0148,  0.9081,  0.6749,  0.0771,  0.9914,  0.0282,  0.7365,
         0.8453,  0.5566,  0.2255,  0.7475,  0.5735,  0.1906,  0.0939,
         0.8760,  0.3419,  0.1005,  0.0406,  0.3714,  0.0558,  0.4332,
         0.0654,  0.0634,  0.3873,  0.5678,  0.6850,  0.2887,  0.2616,
         0.0244,  0.7911,  0.7927,  0.8980,  0.0519,  0.8597,  0.3815,
         0.5360,  0.7500,  0.8075,  0.6892,  0.1107,  0.2796,  0.6391,
         0.8575,  0.2010,  0.8831,  0.4904,  0.6905,  0.0213,  0.0704,
         0.0026,  0.1346,  0.9926,  0.6152,  0.2705,  0.1800,  0.0564,
         0.3145,  0.1385,  0.4087,  0.1974,  0.1997,  0.2819,  0.8734,
         0.6101,  0.8875,  0.4574,  0.3585,  0.5361,  0.6095,  0.9915,
         0.1339,  0.2862,  0.9968,  0.2186,  0.8681,  0.7153,  0.5294,
         0.0900,  0.0961,  0.8034,  0.3580,  0.2897,  0.0663,  0.8368,
         0.5025,  0.7670,  0.0827,  0.8362,  0.1192,  0.0255,  0.9843,
         0.2312,  0.1345,  0.2938,  0.8484,  0.0887,  0.9150,  0.0555,
         0.4304,  0.6336,  0.3745,  0.9451,  0.0360,  0.1789,  0.5559,
         0.8739,  0.8471,  0.8220,  0.4462,  0.9724,  0.1637,  0.2740,
         0.0722,  0.8273,  0.4081,  0.7234,  0.2064,  0.3451,  0.0174,
         0.4231,  0.5343,  0.7972,  0.6030,  0.2534,  0.7844,  0.8524,
         0.2987,  0.9869,  0.8664,  0.7243,  0.4058,  0.8371,  0.1477,
         0.1174,  0.7230,  0.7803,  0.5729,  0.5625,  0.5784,  0.1566,
         0.6634,  0.7530,  0.9947,  0.8855,  0.1720,  0.4986,  0.6234,
         0.8111,  0.2995,  0.2426,  0.0988,  0.3299,  0.4350,  0.2094,
         0.5707,  0.3269,  0.2384,  0.1604,  0.0588,  0.3038,  0.5437,
         0.5455,  0.1784,  0.9081,  0.9716,  0.2792,  0.6476,  0.1043,
         0.1735,  0.8250,  0.1302,  0.9291,  0.4533,  0.1708,  0.3559,
         0.6096,  0.7699,  0.6878,  0.7654,  0.7859,  0.4114,  0.0568,
         0.0956,  0.6430,  0.1371,  0.4656,  0.2587,  0.5210,  0.1304,
         0.7249,  0.5275,  0.8486,  0.3789,  0.8424,  0.9002,  0.8151,
         0.0409], device='cuda:0')
tensor(0.4017, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0681,  0.1645,  0.1434,  0.4845,  0.0768,  0.6791,  0.9083,
         0.8159,  0.9602,  0.0418,  0.4601,  0.5293,  0.7677,  0.6551,
         0.6004,  0.1468,  0.6273,  0.4010,  0.2808,  0.0805,  0.4729,
         0.7747,  0.7216,  0.4696,  0.1353,  0.3503,  0.6169,  0.6557,
         0.5567,  0.4442,  0.6570,  0.1389,  0.8504,  0.6437,  0.1645,
         0.3227,  0.9346,  0.0109,  0.5026,  0.4945,  0.6548,  0.1345,
         0.2255,  0.2188,  0.1162,  0.1797,  0.3317,  0.1898,  0.7997,
         0.1135,  0.1409,  0.7125,  0.5983,  0.8956,  0.8984,  0.3822,
         0.3814,  0.1184,  0.6466,  0.9658,  0.2273,  0.8426,  0.9024,
         0.4915,  0.0811,  0.5940,  0.0932,  0.9898,  0.4132,  0.0586,
         0.0864,  0.5910,  0.1166,  0.9034,  0.4778,  0.0061,  0.3981,
         0.0762,  0.1262,  0.9489,  0.8000,  0.1402,  0.2445,  0.0861,
         0.6731,  0.0740,  0.3974,  0.5419,  0.8584,  0.7151,  0.0836,
         0.4195,  0.2973,  0.3711,  0.1408,  0.8807,  0.0728,  0.2768,
         0.4799,  0.1862,  0.8894,  0.3009,  0.1670,  0.9843,  0.0794,
         0.0752,  0.0999,  0.5778,  0.1803,  0.8446,  0.0808,  0.3227,
         0.3171,  0.9455,  0.5164,  0.8002,  0.8027,  0.6151,  0.3390,
         0.2559,  0.6513,  0.0220,  0.5663,  0.4645,  0.4366,  0.2316,
         0.7787,  0.3308,  0.5373,  0.2524,  0.0257,  0.5892,  0.5926,
         0.9695,  0.6740,  0.7687,  0.0734,  0.1046,  0.3493,  0.9049,
         0.0479,  0.0851,  0.3201,  0.2963,  0.4365,  0.0868,  0.1578,
         0.9094,  0.0109,  0.3714,  0.8408,  0.1322,  0.1881,  0.1589,
         0.1897,  0.6866,  0.2365,  0.3042,  0.5533,  0.7224,  0.1653,
         0.8538,  0.1536,  0.7357,  0.7971,  0.8921,  0.4626,  0.1103,
         0.6350,  0.8319,  0.6274,  0.4291,  0.0620,  0.0488,  0.5277,
         0.4528,  0.0158,  0.0678,  0.6018,  0.6538,  0.2664,  0.0969,
         0.3436,  0.5105,  0.0397,  0.4031,  0.3781,  0.7804,  0.4947,
         0.2826,  0.0082,  0.7917,  0.6043,  0.0060,  0.2042,  0.3957,
         0.7287,  0.9219,  0.0149,  0.1341,  0.0636,  0.5140,  0.4585,
         0.5876,  0.0854,  0.6795,  0.5828,  0.8803,  0.0164,  0.4797,
         0.8200,  0.5966,  0.8571,  0.0546,  0.4458,  0.7984,  0.0652,
         0.0761,  0.6356,  0.0664,  0.0546,  0.1600,  0.0689,  0.4186,
         0.1899,  0.8549,  0.3765,  0.4335,  0.3031,  0.1232,  0.2491,
         0.5323,  0.8277,  0.1271,  0.9134,  0.7189,  0.9915,  0.4089,
         0.7597,  0.0565,  0.0575,  0.8470,  0.0728,  0.3569,  0.2925,
         0.4880,  0.8328,  0.0439,  0.8116,  0.9280,  0.6727,  0.1725,
         0.1614,  0.0971,  0.3890,  0.9291,  0.8903,  0.9546,  0.2470,
         0.6250,  0.4710,  0.0646,  0.8153,  0.2952,  0.9586,  0.4618,
         0.5788,  0.8018,  0.5825,  0.6656,  0.1769,  0.8267,  0.4964,
         0.3157,  0.7804,  0.8753,  0.2787,  0.1468,  0.8212,  0.9022,
         0.9829,  0.0604,  0.0574,  0.5385,  0.6519,  0.0792,  0.0346,
         0.8365,  0.0159,  0.7208,  0.7250,  0.1552,  0.7239,  0.1904,
         0.1079,  0.0287,  0.3066,  0.7408,  0.3312,  0.4908,  0.0883,
         0.4306,  0.0428,  0.9786,  0.0398,  0.2044,  0.8109,  0.9233,
         0.0661,  0.0770,  0.8285,  0.5187,  0.3500,  0.0091,  0.5942,
         0.7481,  0.0421,  0.4368,  0.7862,  0.3320,  0.1053,  0.8163,
         0.2782,  0.5079,  0.1577,  0.3814,  0.7235,  0.5094,  0.7736,
         0.8676,  0.1935,  0.9852,  0.0401,  0.0215,  0.8143,  0.4189,
         0.7672,  0.4314,  0.9956,  0.3868,  0.6724,  0.1805,  0.8377,
         0.6311,  0.5112,  0.0967,  0.1239,  0.9296,  0.0767,  0.6942,
         0.2871,  0.9963,  0.6609,  0.1104,  0.1153,  0.0583,  0.8240,
         0.4435,  0.8217,  0.2062,  0.0524,  0.0028,  0.8356,  0.4417,
         0.2684,  0.2803,  0.1277,  0.3031,  0.3025,  0.7750,  0.8113,
         0.9529,  0.1961,  0.5812,  0.6986,  0.2697,  0.1084,  0.1130,
         0.5539,  0.9932,  0.0970,  0.7950,  0.9866,  0.9536,  0.0021,
         0.5985,  0.3664,  0.7882,  0.8842,  0.1031,  0.1442,  0.9941,
         0.6829,  0.0405,  0.3789,  0.7611,  0.5584,  0.5420,  0.1953,
         0.2826,  0.4534,  0.1732,  0.1584,  0.6337,  0.3117,  0.6964,
         0.4221,  0.8245,  0.0767,  0.7976,  0.0531,  0.7744,  0.0506,
         0.0857,  0.9149,  0.7490,  0.3619,  0.1487,  0.9434,  0.4271,
         0.9197,  0.0813,  0.2239,  0.5150,  0.1661,  0.9080,  0.9815,
         0.5110,  0.6860,  0.9806,  0.4800,  0.5252,  0.7738,  0.0459,
         0.6056,  0.3621,  0.1463,  0.1669,  0.7133,  0.3048,  0.8212,
         0.1607,  0.8823,  0.8140,  0.6074,  0.3343,  0.1781,  0.0913,
         0.1128,  0.6408,  0.9458,  0.7996,  0.9334,  0.6382,  0.7091,
         0.8174,  0.7220,  0.6186,  0.2887,  0.8962,  0.0835,  0.5516,
         0.9542,  0.3614,  0.3507,  0.0988,  0.3276,  0.4403,  0.6848,
         0.2834,  0.6109,  0.5023,  0.7207,  0.1310,  0.9748,  0.0514,
         0.2654,  0.7007,  0.8526,  0.0369,  0.3253,  0.9595,  0.4993,
         0.0388,  0.1141,  0.0041,  0.8281,  0.3394,  0.5308,  0.2574,
         0.1636,  0.3178,  0.1764,  0.1700,  0.8865,  0.0568,  0.8160,
         0.9462,  0.1351,  0.5710,  0.7168,  0.6975,  0.7387,  0.9638,
         0.4521,  0.8180,  0.0689,  0.7007,  0.6696,  0.3745,  0.9252,
         0.0239], device='cuda:0')
tensor(0.3883, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7021,  0.2442,  0.1201,  0.4359,  0.8550,  0.2355,  0.2913,
         0.6043,  0.0783,  0.1943,  0.9524,  0.9486,  0.7357,  0.9513,
         0.0568,  0.9126,  0.1645,  0.7096,  0.8924,  0.2400,  0.0869,
         0.7038,  0.8052,  0.9358,  0.2325,  0.2739,  0.0740,  0.7041,
         0.0064,  0.2347,  0.0771,  0.6313,  0.0213,  0.0593,  0.9956,
         0.6542,  0.0587,  0.7220,  0.4647,  0.5648,  0.1210,  0.4853,
         0.2379,  0.2761,  0.5866,  0.9696,  0.6073,  0.4295,  0.5151,
         0.8532,  0.7538,  0.5136,  0.1721,  0.2057,  0.0817,  0.7940,
         0.4175,  0.3312,  0.0276,  0.6305,  0.4607,  0.7782,  0.1395,
         0.2649,  0.4134,  0.7264,  0.7099,  0.0068,  0.8336,  0.0606,
         0.8707,  0.8136,  0.3831,  0.2107,  0.9305,  0.9563,  0.1243,
         0.1531,  0.3478,  0.0645,  0.9065,  0.0587,  0.5807,  0.8548,
         0.9088,  0.1595,  0.0910,  0.1261,  0.3028,  0.9508,  0.5974,
         0.9197,  0.0186,  0.2189,  0.5412,  0.3501,  0.1861,  0.7643,
         0.8834,  0.4719,  0.5561,  0.9504,  0.0169,  0.0418,  0.0336,
         0.7904,  0.9329,  0.6292,  0.8737,  0.5148,  0.1129,  0.5974,
         0.6084,  0.8553,  0.0431,  0.9315,  0.6286,  0.3293,  0.1529,
         0.1371,  0.7248,  0.5379,  0.4129,  0.9134,  0.5103,  0.8100,
         0.8633,  0.2750,  0.1137,  0.0612,  0.8488,  0.0831,  0.5764,
         0.4440,  0.7496,  0.6840,  0.0789,  0.0392,  0.7467,  0.3437,
         0.6156,  0.8021,  0.8413,  0.7797,  0.5127,  0.2005,  0.1327,
         0.7350,  0.0140,  0.0028,  0.8327,  0.1701,  0.0769,  0.5484,
         0.0452,  0.4511,  0.0519,  0.5066,  0.3099,  0.0881,  0.5876,
         0.1077,  0.1480,  0.6800,  0.2118,  0.4291,  0.6716,  0.7604,
         0.8415,  0.0120,  0.8626,  0.3705,  0.4440,  0.6803,  0.1548,
         0.1910,  0.0509,  0.7735,  0.2111,  0.9200,  0.6753,  0.7127,
         0.7480,  0.6536,  0.9961,  0.1161,  0.5118,  0.1298,  0.4495,
         0.6890,  0.7995,  0.3572,  0.5972,  0.0166,  0.8694,  0.7278,
         0.1947,  0.8111,  0.1186,  0.0365,  0.9050,  0.2075,  0.0328,
         0.0159,  0.5889,  0.0990,  0.7146,  0.0948,  0.6907,  0.0507,
         0.1006,  0.1363,  0.0624,  0.6285,  0.4165,  0.1259,  0.8043,
         0.2381,  0.3158,  0.3442,  0.2672,  0.9359,  0.0032,  0.5728,
         0.4613,  0.6483,  0.8718,  0.8364,  0.3256,  0.1465,  0.9959,
         0.7804,  0.9387,  0.2953,  0.0113,  0.7035,  0.4602,  0.0221,
         0.2359,  0.0386,  0.6334,  0.0133,  0.4452,  0.7163,  0.0516,
         0.7634,  0.6825,  0.0450,  0.6836,  0.6590,  0.7961,  0.1317,
         0.6316,  0.0681,  0.1298,  0.1245,  0.8730,  0.1642,  0.0513,
         0.3732,  0.0211,  0.7165,  0.7221,  0.8299,  0.9420,  0.5468,
         0.0745,  0.1972,  0.0607,  0.3013,  0.9137,  0.0884,  0.9368,
         0.8717,  0.3872,  0.0132,  0.7376,  0.5188,  0.2153,  0.1377,
         0.1931,  0.0185,  0.0251,  0.4460,  0.9450,  0.8977,  0.2514,
         0.4900,  0.0568,  0.0306,  0.1682,  0.8132,  0.4518,  0.1385,
         0.9004,  0.1501,  0.7225,  0.6067,  0.5215,  0.9015,  0.3086,
         0.1467,  0.5593,  0.8104,  0.7687,  0.7889,  0.5731,  0.7599,
         0.6773,  0.5553,  0.5361,  0.0403,  0.2976,  0.0718,  0.0953,
         0.6110,  0.9182,  0.3084,  0.1669,  0.0784,  0.1620,  0.5697,
         0.4468,  0.3708,  0.3666,  0.9006,  0.2036,  0.0489,  0.9108,
         0.1215,  0.8375,  0.4918,  0.7505,  0.2330,  0.8855,  0.4909,
         0.2296,  0.3879,  0.0610,  0.2794,  0.7561,  0.1237,  0.0811,
         0.2284,  0.8422,  0.2662,  0.1855,  0.0295,  0.2455,  0.2159,
         0.2548,  0.7392,  0.8704,  0.0947,  0.3021,  0.7979,  0.1694,
         0.2130,  0.4052,  0.0194,  0.9453,  0.1498,  0.1430,  0.9019,
         0.8439,  0.9882,  0.2006,  0.0769,  0.3281,  0.5979,  0.2303,
         0.5774,  0.9041,  0.0231,  0.8225,  0.1677,  0.1208,  0.7695,
         0.2463,  0.0698,  0.1888,  0.3883,  0.1025,  0.2585,  0.9150,
         0.8209,  0.9501,  0.1156,  0.6775,  0.4821,  0.1363,  0.9283,
         0.5943,  0.3442,  0.9375,  0.0772,  0.0744,  0.7855,  0.1422,
         0.8897,  0.0098,  0.0633,  0.7796,  0.0198,  0.7817,  0.6123,
         0.0699,  0.8621,  0.5688,  0.0546,  0.0394,  0.7020,  0.9088,
         0.7230,  0.1033,  0.6940,  0.9745,  0.2323,  0.5907,  0.0782,
         0.0192,  0.1561,  0.1138,  0.4845,  0.9225,  0.3359,  0.9035,
         0.7655,  0.1508,  0.2479,  0.0777,  0.9019,  0.8853,  0.3516,
         0.8836,  0.2220,  0.2334,  0.2690,  0.3343,  0.1789,  0.5463,
         0.6258,  0.2177,  0.2190,  0.3842,  0.0731,  0.6136,  0.0797,
         0.5648,  0.0513,  0.7056,  0.4195,  0.0755,  0.3960,  0.0458,
         0.7161,  0.2212,  0.1780,  0.0230,  0.3596,  0.2176,  0.0321,
         0.9500,  0.1676,  0.5942,  0.4715,  0.4323,  0.0643,  0.4804,
         0.0388,  0.6317,  0.1057,  0.2160,  0.9208,  0.2289,  0.0131,
         0.0488,  0.8745,  0.8930,  0.2945,  0.8362,  0.8515,  0.5272,
         0.5566,  0.1920,  0.2780,  0.0932,  0.0533,  0.9381,  0.7855,
         0.7472,  0.8993,  0.8971,  0.0743,  0.2033,  0.8482,  0.0970,
         0.0042,  0.0639,  0.6489,  0.6576,  0.0135,  0.1472,  0.6231,
         0.1629,  0.1276,  0.8496,  0.0419,  0.3687,  0.8969,  0.9433,
         0.1311], device='cuda:0')
tensor(0.3712, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0947,  0.1931,  0.0869,  0.9222,  0.0203,  0.0569,  0.9029,
         0.0317,  0.1370,  0.1259,  0.0232,  0.1817,  0.1543,  0.5680,
         0.0521,  0.0611,  0.7374,  0.0304,  0.3483,  0.0655,  0.5724,
         0.0219,  0.0419,  0.4037,  0.8608,  0.9252,  0.9495,  0.7052,
         0.8782,  0.0838,  0.8976,  0.0176,  0.3617,  0.0054,  0.8693,
         0.0893,  0.8702,  0.1762,  0.2128,  0.8760,  0.0575,  0.3127,
         0.7683,  0.0266,  0.1651,  0.1112,  0.2152,  0.5921,  0.0460,
         0.7484,  0.1284,  0.6683,  0.9075,  0.3275,  0.7126,  0.2825,
         0.2534,  0.1388,  0.3638,  0.0602,  0.0531,  0.8888,  0.9210,
         0.8745,  0.1178,  0.8947,  0.2533,  0.8775,  0.0024,  0.4192,
         0.7968,  0.0966,  0.8707,  0.8474,  0.0127,  0.6674,  0.1144,
         0.5222,  0.2346,  0.3281,  0.1729,  0.2263,  0.0316,  0.1202,
         0.0361,  0.4415,  0.8585,  0.8874,  0.0270,  0.5369,  0.4988,
         0.4912,  0.2653,  0.8799,  0.8279,  0.7625,  0.2357,  0.3275,
         0.1359,  0.5300,  0.5546,  0.9903,  0.2520,  0.6938,  0.4225,
         0.0099,  0.1604,  0.7375,  0.7766,  0.0802,  0.0957,  0.0921,
         0.1064,  0.2826,  0.0664,  0.8228,  0.0055,  0.8534,  0.0051,
         0.4783,  0.9926,  0.3553,  0.0866,  0.0687,  0.0730,  0.0575,
         0.0785,  0.8209,  0.6922,  0.1067,  0.2685,  0.7794,  0.7597,
         0.8016,  0.0991,  0.0019,  0.1896,  0.9639,  0.0461,  0.2398,
         0.6729,  0.1124,  0.1033,  0.0382,  0.7552,  0.2860,  0.1794,
         0.9584,  0.6187,  0.1209,  0.0226,  0.4086,  0.0592,  0.0158,
         0.3270,  0.1148,  0.7619,  0.1517,  0.6516,  0.0441,  0.2487,
         0.3171,  0.9798,  0.8482,  0.0420,  0.7262,  0.0146,  0.5972,
         0.0560,  0.8699,  0.7782,  0.4904,  0.4361,  0.4191,  0.0549,
         0.8001,  0.1137,  0.3968,  0.0029,  0.8041,  0.3818,  0.0236,
         0.4781,  0.8200,  0.8219,  0.8390,  0.1898,  0.2093,  0.3182,
         0.8021,  0.7857,  0.2984,  0.8789,  0.0184,  0.0076,  0.1517,
         0.7234,  0.9950,  0.8484,  0.3502,  0.2389,  0.8892,  0.6446,
         0.9418,  0.9057,  0.3272,  0.3568,  0.9307,  0.8853,  0.7059,
         0.6407,  0.9505,  0.1252,  0.8842,  0.6038,  0.9098,  0.9196,
         0.1367,  0.0283,  0.1078,  0.8165,  0.0086,  0.2673,  0.1005,
         0.6561,  0.1792,  0.2324,  0.7497,  0.0286,  0.2233,  0.0564,
         0.8900,  0.0097,  0.0710,  0.9444,  0.1502,  0.0155,  0.6314,
         0.0883,  0.1131,  0.0530,  0.4688,  0.9476,  0.7289,  0.1515,
         0.6488,  0.0986,  0.3335,  0.0092,  0.7567,  0.3946,  0.2138,
         0.8994,  0.5642,  0.8431,  0.0076,  0.4871,  0.9353,  0.2904,
         0.9381,  0.4986,  0.0240,  0.6769,  0.0179,  0.7255,  0.8044,
         0.0425,  0.2574,  0.0397,  0.0404,  0.5043,  0.9256,  0.5348,
         0.1981,  0.4444,  0.9443,  0.4502,  0.8540,  0.9409,  0.1585,
         0.1155,  0.8976,  0.1076,  0.6461,  0.3238,  0.7845,  0.5115,
         0.0543,  0.0812,  0.9615,  0.1780,  0.9316,  0.1759,  0.0328,
         0.2041,  0.9690,  0.4124,  0.7481,  0.0735,  0.8320,  0.0764,
         0.1966,  0.1282,  0.9396,  0.9686,  0.0827,  0.9229,  0.6706,
         0.1371,  0.9639,  0.9035,  0.7752,  0.0621,  0.9348,  0.7553,
         0.4996,  0.0664,  0.9173,  0.0327,  0.8847,  0.9746,  0.8417,
         0.2782,  0.0961,  0.3069,  0.0218,  0.4735,  0.2372,  0.2222,
         0.0966,  0.3311,  0.7072,  0.8305,  0.4711,  0.0273,  0.1187,
         0.0051,  0.8668,  0.1223,  0.2664,  0.0915,  0.0381,  0.4469,
         0.0160,  0.9124,  0.2002,  0.9985,  0.4270,  0.1950,  0.3824,
         0.4420,  0.5217,  0.4539,  0.6737,  0.1920,  0.6892,  0.7501,
         0.8201,  0.0906,  0.8643,  0.1312,  0.6193,  0.9242,  0.6917,
         0.7470,  0.1050,  0.0685,  0.2193,  0.2091,  0.1569,  0.8469,
         0.2566,  0.3627,  0.4552,  0.9873,  0.4396,  0.0086,  0.0791,
         0.7939,  0.4930,  0.0058,  0.9968,  0.2195,  0.1958,  0.3194,
         0.2363,  0.7886,  0.4375,  0.8206,  0.5358,  0.5222,  0.4378,
         0.4379,  0.6015,  0.4794,  0.5168,  0.5163,  0.1310,  0.0687,
         0.2293,  0.8506,  0.9691,  0.3849,  0.6311,  0.4076,  0.0758,
         0.2564,  0.5036,  0.5537,  0.7797,  0.1532,  0.4931,  0.0025,
         0.1737,  0.4399,  0.9165,  0.9186,  0.8779,  0.9149,  0.2938,
         0.1474,  0.1961,  0.8779,  0.9410,  0.0358,  0.0390,  0.4965,
         0.1061,  0.7616,  0.9005,  0.2503,  0.2354,  0.0275,  0.0200,
         0.8706,  0.0263,  0.8719,  0.0058,  0.2286,  0.4984,  0.3794,
         0.3521,  0.1442,  0.7363,  0.9613,  0.2755,  0.1204,  0.0176,
         0.9811,  0.6644,  0.6343,  0.0731,  0.1397,  0.8372,  0.7170,
         0.1935,  0.3684,  0.0452,  0.0667,  0.0939,  0.8534,  0.0112,
         0.3232,  0.6585,  0.2787,  0.3933,  0.0657,  0.1903,  0.7695,
         0.5719,  0.0420,  0.1276,  0.8647,  0.0325,  0.1661,  0.0145,
         0.1019,  0.7439,  0.0543,  0.1030,  0.0822,  0.8716,  0.8945,
         0.2228,  0.2643,  0.1660,  0.6395,  0.3224,  0.6592,  0.0194,
         0.6013,  0.6951,  0.8240,  0.1287,  0.3677,  0.9099,  0.5945,
         0.8700,  0.3168,  0.0987,  0.3193,  0.9597,  0.0679,  0.8691,
         0.0421,  0.5776,  0.2055,  0.1269,  0.0168,  0.0332,  0.7646,
         0.8590], device='cuda:0')
tensor(0.3912, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9151,  0.7028,  0.1724,  0.5372,  0.2493,  0.2574,  0.1392,
         0.1879,  0.0236,  0.2292,  0.8497,  0.8523,  0.6150,  0.0570,
         0.0243,  0.0957,  0.0926,  0.8464,  0.1483,  0.8188,  0.8571,
         0.0416,  0.0405,  0.8158,  0.1343,  0.8049,  0.5147,  0.5051,
         0.0547,  0.4075,  0.4263,  0.9304,  0.9365,  0.9242,  0.5912,
         0.6831,  0.5721,  0.8767,  0.2999,  0.2404,  0.8445,  0.4506,
         0.1542,  0.0636,  0.7926,  0.9771,  0.1465,  0.0951,  0.4818,
         0.7283,  0.8320,  0.0378,  0.0164,  0.6711,  0.1132,  0.0308,
         0.1654,  0.8947,  0.4006,  0.1335,  0.8878,  0.7323,  0.7899,
         0.6823,  0.0097,  0.4537,  0.4050,  0.6770,  0.0594,  0.2126,
         0.0192,  0.8273,  0.1390,  0.9619,  0.9535,  0.2454,  0.9951,
         0.8089,  0.8715,  0.0380,  0.9693,  0.9186,  0.4647,  0.0400,
         0.9497,  0.6959,  0.0161,  0.5666,  0.5933,  0.7467,  0.0350,
         0.2329,  0.7729,  0.0202,  0.1013,  0.2304,  0.4066,  0.1764,
         0.9383,  0.8074,  0.1682,  0.0325,  0.9472,  0.3017,  0.0324,
         0.9279,  0.0761,  0.3574,  0.6670,  0.5669,  0.7551,  0.9219,
         0.9170,  0.7606,  0.1824,  0.0934,  0.7018,  0.0224,  0.8622,
         0.0489,  0.7301,  0.0305,  0.9426,  0.7516,  0.4029,  0.4057,
         0.4151,  0.1985,  0.0136,  0.0236,  0.1680,  0.0556,  0.0166,
         0.1130,  0.1252,  0.1494,  0.0423,  0.0951,  0.6980,  0.0741,
         0.0158,  0.4069,  0.0693,  0.8884,  0.0085,  0.0085,  0.6357,
         0.5472,  0.2476,  0.0890,  0.0606,  0.7510,  0.7940,  0.5143,
         0.6596,  0.0832,  0.9152,  0.3690,  0.1199,  0.7874,  0.1977,
         0.4589,  0.9489,  0.0292,  0.0209,  0.0746,  0.7247,  0.1642,
         0.0066,  0.7096,  0.9211,  0.0246,  0.0301,  0.4803,  0.0220,
         0.4226,  0.6737,  0.8984,  0.0370,  0.0219,  0.8841,  0.2164,
         0.9193,  0.7457,  0.1314,  0.5991,  0.0247,  0.8629,  0.8879,
         0.0330,  0.8165,  0.0128,  0.4278,  0.3074,  0.3810,  0.1799,
         0.0637,  0.4525,  0.9826,  0.8519,  0.1510,  0.0954,  0.5774,
         0.6357,  0.4140,  0.0458,  0.9052,  0.1347,  0.7343,  0.0246,
         0.1153,  0.0209,  0.3385,  0.8694,  0.8752,  0.0654,  0.1058,
         0.0646,  0.2476,  0.1173,  0.0818,  0.0427,  0.0586,  0.1566,
         0.6665,  0.4422,  0.8659,  0.2841,  0.6966,  0.4637,  0.0603,
         0.8649,  0.1585,  0.3154,  0.6679,  0.0672,  0.0769,  0.0329,
         0.8441,  0.1127,  0.0817,  0.9081,  0.6410,  0.9157,  0.1549,
         0.0849,  0.5733,  0.0531,  0.0854,  0.5908,  0.7981,  0.7916,
         0.5272,  0.0105,  0.7626,  0.1389,  0.0698,  0.2705,  0.8753,
         0.7821,  0.0644,  0.5970,  0.7245,  0.7885,  0.5209,  0.9957,
         0.2379,  0.0131,  0.8695,  0.0270,  0.1075,  0.7754,  0.0041,
         0.0415,  0.4180,  0.2697,  0.0215,  0.9311,  0.0858,  0.8247,
         0.0853,  0.9153,  0.9330,  0.0462,  0.3825,  0.0569,  0.0560,
         0.0597,  0.1114,  0.7608,  0.6902,  0.8036,  0.0521,  0.0939,
         0.1926,  0.7882,  0.0653,  0.0378,  0.0479,  0.3426,  0.7358,
         0.0369,  0.8296,  0.9450,  0.8293,  0.0739,  0.9227,  0.3283,
         0.6417,  0.7109,  0.0198,  0.8140,  0.1456,  0.0488,  0.1361,
         0.4826,  0.0334,  0.7087,  0.2849,  0.0454,  0.3453,  0.9925,
         0.8168,  0.0263,  0.8326,  0.0093,  0.1294,  0.0886,  0.4880,
         0.9556,  0.5384,  0.4798,  0.5729,  0.3719,  0.4879,  0.4174,
         0.6949,  0.6279,  0.0343,  0.0385,  0.4039,  0.9912,  0.2665,
         0.9964,  0.0347,  0.4864,  0.1289,  0.9137,  0.1255,  0.8854,
         0.9970,  0.2303,  0.3165,  0.7126,  0.7525,  0.7202,  0.9217,
         0.7325,  0.8040,  0.1498,  0.0540,  0.9012,  0.6879,  0.0611,
         0.9713,  0.9298,  0.5478,  0.8105,  0.0558,  0.9401,  0.2220,
         0.1036,  0.0094,  0.9653,  0.1692,  0.1207,  0.2870,  0.1132,
         0.0238,  0.0918,  0.1400,  0.1428,  0.3352,  0.1454,  0.3091,
         0.8531,  0.9482,  0.8928,  0.0217,  0.2742,  0.8972,  0.2581,
         0.7531,  0.4112,  0.8578,  0.1613,  0.2487,  0.6663,  0.0843,
         0.9065,  0.0105,  0.0626,  0.8591,  0.0067,  0.7662,  0.0649,
         0.0339,  0.8605,  0.1477,  0.1849,  0.0321,  0.3408,  0.3872,
         0.0227,  0.9055,  0.7478,  0.0605,  0.3500,  0.0632,  0.1619,
         0.1314,  0.1661,  0.0451,  0.0860,  0.0441,  0.0071,  0.5600,
         0.0731,  0.0186,  0.0556,  0.7360,  0.1299,  0.9101,  0.0247,
         0.0641,  0.1973,  0.3295,  0.1929,  0.1135,  0.4389,  0.9813,
         0.1090,  0.1356,  0.2538,  0.0919,  0.7594,  0.6696,  0.9920,
         0.7435,  0.8703,  0.7493,  0.1379,  0.7351,  0.7520,  0.8324,
         0.3426,  0.2910,  0.0447,  0.8670,  0.1045,  0.2235,  0.6451,
         0.0342,  0.0822,  0.2291,  0.8780,  0.8962,  0.1122,  0.8696,
         0.2217,  0.6286,  0.2975,  0.3300,  0.0946,  0.7782,  0.1770,
         0.8495,  0.0750,  0.0357,  0.2478,  0.5881,  0.8037,  0.0116,
         0.2293,  0.0548,  0.2887,  0.7875,  0.6950,  0.7481,  0.6473,
         0.7749,  0.9475,  0.0956,  0.1302,  0.7856,  0.0807,  0.1411,
         0.1210,  0.8622,  0.0351,  0.1390,  0.7738,  0.2890,  0.9984,
         0.7872,  0.0262,  0.0952,  0.2041,  0.8935,  0.0165,  0.9435,
         0.1775], device='cuda:0')
tensor(0.3769, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0558,  0.4877,  0.0195,  0.7995,  0.9964,  0.9935,  0.2043,
         0.6856,  0.8963,  0.6478,  0.2225,  0.2157,  0.8099,  0.7808,
         0.8799,  0.9329,  0.5646,  0.8818,  0.8690,  0.9053,  0.0240,
         0.0085,  0.1533,  0.0673,  0.0021,  0.1613,  0.4007,  0.8596,
         0.9596,  0.9163,  0.7506,  0.8399,  0.2274,  0.0467,  0.0929,
         0.8012,  0.0269,  0.8998,  0.2110,  0.0480,  0.7070,  0.0470,
         0.3882,  0.9387,  0.0838,  0.8420,  0.8081,  0.8864,  0.3640,
         0.5581,  0.0931,  0.1400,  0.0171,  0.1970,  0.0851,  0.1044,
         0.0779,  0.7459,  0.4875,  0.9921,  0.9080,  0.9554,  0.6137,
         0.8888,  0.6045,  0.5467,  0.4989,  0.0251,  0.0839,  0.1888,
         0.7198,  0.4434,  0.7286,  0.7241,  0.1275,  0.8024,  0.8100,
         0.0393,  0.8267,  0.7782,  0.0402,  0.0170,  0.8087,  0.9278,
         0.0737,  0.0140,  0.1564,  0.9294,  0.8692,  0.0226,  0.5458,
         0.9839,  0.1550,  0.0928,  0.0759,  0.2176,  0.0170,  0.9688,
         0.2170,  0.8167,  0.0281,  0.0488,  0.0603,  0.9894,  0.2813,
         0.9538,  0.8989,  0.2552,  0.8567,  0.0158,  0.8081,  0.4945,
         0.0818,  0.8698,  0.0103,  0.8267,  0.1545,  0.1439,  0.1484,
         0.0251,  0.9923,  0.1438,  0.5213,  0.6669,  0.8182,  0.9986,
         0.2068,  0.8287,  0.0680,  0.8445,  0.9720,  0.1201,  0.9337,
         0.9727,  0.0228,  0.1799,  0.8599,  0.0367,  0.5304,  0.0853,
         0.0689,  0.9415,  0.0285,  0.8214,  0.0037,  0.8699,  0.1792,
         0.8862,  0.0260,  0.0211,  0.0408,  0.3607,  0.2951,  0.1245,
         0.1867,  0.8625,  0.0397,  0.3892,  0.9267,  0.9985,  0.7882,
         0.9219,  0.6058,  0.1133,  0.2132,  0.0644,  0.1154,  0.8746,
         0.0801,  0.0338,  0.4839,  0.9194,  0.9928,  0.6581,  0.1298,
         0.8704,  0.7295,  0.8696,  0.0473,  0.2221,  0.5086,  0.0339,
         0.5480,  0.8262,  0.4779,  0.5554,  0.9868,  0.8470,  0.3379,
         0.3190,  0.9820,  0.9262,  0.1382,  0.0459,  0.0251,  0.9615,
         0.9535,  0.8915,  0.0793,  0.9985,  0.0239,  0.3556,  0.8280,
         0.9760,  0.1951,  0.1344,  0.1162,  0.0628,  0.0292,  0.0840,
         0.8843,  0.0090,  0.0247,  0.0203,  0.4108,  0.2027,  0.9867,
         0.8976,  0.0939,  0.1528,  0.9539,  0.0033,  0.9316,  0.0773,
         0.0100,  0.0043,  0.0975,  0.6341,  0.1640,  0.7720,  0.0401,
         0.0193,  0.9295,  0.9142,  0.6328,  0.5693,  0.0578,  0.0765,
         0.8092,  0.0454,  0.0726,  0.0600,  0.9555,  0.2432,  0.1422,
         0.4303,  0.2212,  0.8246,  0.9795,  0.2883,  0.1515,  0.1300,
         0.0609,  0.8538,  0.8672,  0.5828,  0.9130,  0.0875,  0.0868,
         0.0952,  0.6341,  0.9323,  0.7639,  0.9010,  0.1015,  0.0021,
         0.8267,  0.4433,  0.2130,  0.4821,  0.0457,  0.0226,  0.1516,
         0.9500,  0.8547,  0.8897,  0.1696,  0.4416,  0.1047,  0.5412,
         0.0915,  0.0077,  0.8834,  0.0565,  0.9504,  0.8577,  0.9290,
         0.0439,  0.4913,  0.2006,  0.8152,  0.6011,  0.9431,  0.8611,
         0.0545,  0.9524,  0.8254,  0.4697,  0.9893,  0.0151,  0.0962,
         0.9756,  0.0929,  0.5543,  0.0485,  0.4180,  0.7823,  0.9745,
         0.0720,  0.8031,  0.8587,  0.1257,  0.0652,  0.9574,  0.3634,
         0.5459,  0.7852,  0.1742,  0.7567,  0.8667,  0.9418,  0.0275,
         0.3512,  0.3189,  0.1250,  0.9148,  0.9403,  0.7182,  0.3945,
         0.1351,  0.1823,  0.5505,  0.0719,  0.8897,  0.8298,  0.0020,
         0.9462,  0.8311,  0.0623,  0.9658,  0.9964,  0.8910,  0.0528,
         0.0663,  0.3751,  0.0161,  0.7662,  0.4417,  0.7297,  0.1096,
         0.6143,  0.6896,  0.9749,  0.5577,  0.7782,  0.5958,  0.2967,
         0.6344,  0.0817,  0.1498,  0.0020,  0.9513,  0.1024,  0.8956,
         0.8885,  0.1661,  0.0986,  0.0599,  0.9695,  0.8747,  0.6018,
         0.5697,  0.8994,  0.6048,  0.4469,  0.0648,  0.0156,  0.1345,
         0.0949,  0.7925,  0.9509,  0.2406,  0.0131,  0.0548,  0.9871,
         0.7424,  0.0539,  0.6726,  0.9638,  0.4428,  0.9689,  0.8136,
         0.0132,  0.1320,  0.9309,  0.5618,  0.4480,  0.0183,  0.0985,
         0.9782,  0.8284,  0.0249,  0.5298,  0.0446,  0.3630,  0.8962,
         0.0226,  0.8623,  0.1631,  0.6990,  0.6262,  0.9278,  0.0358,
         0.4040,  0.0084,  0.8641,  0.5406,  0.2159,  0.6950,  0.0387,
         0.1881,  0.0247,  0.0223,  0.1879,  0.8694,  0.0013,  0.7759,
         0.3519,  0.3125,  0.6886,  0.7800,  0.0173,  0.4801,  0.1265,
         0.7932,  0.0277,  0.4851,  0.9365,  0.9810,  0.8206,  0.0747,
         0.1608,  0.9734,  0.5384,  0.1435,  0.0910,  0.0240,  0.5018,
         0.9531,  0.5867,  0.0326,  0.0636,  0.3224,  0.7858,  0.2031,
         0.9130,  0.0184,  0.5879,  0.1043,  0.9432,  0.6856,  0.9954,
         0.1139,  0.6356,  0.9152,  0.6310,  0.8969,  0.8208,  0.3365,
         0.9713,  0.0586,  0.9361,  0.1040,  0.1672,  0.2433,  0.0383,
         0.8835,  0.9904,  0.9649,  0.0261,  0.8684,  0.7281,  0.2397,
         0.1504,  0.0084,  0.6033,  0.5006,  0.1963,  0.9521,  0.6620,
         0.0288,  0.8805,  0.2217,  0.0477,  0.0276,  0.6957,  0.1754,
         0.8734,  0.7511,  0.0162,  0.3931,  0.3134,  0.0114,  0.7020,
         0.9601,  0.6395,  0.0502,  0.0553,  0.8860,  0.0237,  0.8358,
         0.0267], device='cuda:0')
tensor(0.3727, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9612,  0.0815,  0.0502,  0.0250,  0.0644,  0.1879,  0.1915,
         0.9442,  0.8726,  0.0561,  0.7000,  0.9425,  0.2878,  0.3241,
         0.9105,  0.8712,  0.0595,  0.8429,  0.0479,  0.9984,  0.2293,
         0.7329,  0.9979,  0.0640,  0.4646,  0.0334,  0.9947,  0.9331,
         0.8872,  0.1093,  0.1190,  0.1434,  0.0446,  0.9332,  0.0668,
         0.5419,  0.2634,  0.0683,  0.9076,  0.4512,  0.0217,  0.0277,
         0.0340,  0.2392,  0.9836,  0.4020,  0.7897,  0.9632,  0.8404,
         0.1782,  0.1893,  0.8166,  0.1090,  0.7808,  0.0334,  0.2619,
         0.9173,  0.7670,  0.0235,  0.0344,  0.8543,  0.0602,  0.8857,
         0.0366,  0.6411,  0.7227,  0.9146,  0.0342,  0.9593,  0.7648,
         0.8367,  0.0042,  0.1012,  0.2267,  0.8962,  0.4410,  0.1968,
         0.8273,  0.9612,  0.0158,  0.8263,  0.9945,  0.6475,  0.9488,
         0.0045,  0.9929,  0.9186,  0.4176,  0.0059,  0.0448,  0.9161,
         0.9728,  0.5781,  0.9440,  0.4240,  0.9321,  0.9318,  0.1401,
         0.8731,  0.8264,  0.9918,  0.0213,  0.6183,  0.7530,  0.2294,
         0.9113,  0.8757,  0.9632,  0.9997,  0.4958,  0.9778,  0.9625,
         0.0750,  0.0736,  0.1939,  0.1179,  0.1225,  0.4584,  0.9826,
         0.9343,  0.9551,  0.9440,  0.0391,  0.9646,  0.8089,  0.9888,
         0.1390,  0.3368,  0.2641,  0.8040,  0.4589,  0.1570,  0.0353,
         0.8989,  0.6240,  0.0176,  0.8078,  0.4306,  0.6096,  0.3869,
         0.0790,  0.9937,  0.0994,  0.0238,  0.8330,  0.7106,  0.0913,
         0.4022,  0.0060,  0.7301,  0.1799,  0.6455,  0.1040,  0.9325,
         0.9449,  0.2321,  0.1490,  0.9567,  0.9586,  0.8006,  0.9444,
         0.8602,  0.9731,  0.3473,  0.1461,  0.0312,  0.3912,  0.8509,
         0.8137,  0.4709,  0.0517,  0.1975,  0.9120,  0.0888,  0.1950,
         0.1983,  0.0557,  0.4701,  0.0957,  0.1675,  0.9564,  0.0784,
         0.0076,  0.8185,  0.0555,  0.1110,  0.7760,  0.3991,  0.9740,
         0.0214,  0.0608,  0.7812,  0.6643,  0.1024,  0.8605,  0.7767,
         0.8019,  0.7428,  0.1235,  0.6600,  0.6118,  0.9249,  0.9665,
         0.0637,  0.0505,  0.7973,  0.9760,  0.0857,  0.5853,  0.7782,
         0.0256,  0.0321,  0.0430,  0.0198,  0.8575,  0.6578,  0.0820,
         0.0049,  0.6997,  0.9476,  0.2130,  0.8437,  0.9417,  0.7964,
         0.2378,  0.7086,  0.8353,  0.1965,  0.7060,  0.0247,  0.1216,
         0.0295,  0.1425,  0.9571,  0.9137,  0.6851,  0.0830,  0.7642,
         0.8296,  0.8010,  0.9922,  0.9907,  0.4421,  0.1013,  0.0531,
         0.0332,  0.0320,  0.5848,  0.7327,  0.9298,  0.0215,  0.9601,
         0.9059,  0.1537,  0.9125,  0.9137,  0.4162,  0.2079,  0.9004,
         0.9385,  0.9745,  0.6559,  0.5391,  0.9179,  0.2016,  0.9471,
         0.9207,  0.9715,  0.3145,  0.8655,  0.0940,  0.8504,  0.4151,
         0.5947,  0.0900,  0.9425,  0.8152,  0.5739,  0.1338,  0.9669,
         0.8400,  0.9508,  0.0284,  0.9488,  0.6927,  0.0328,  0.9256,
         0.0222,  0.9015,  0.0284,  0.4125,  0.9100,  0.8850,  0.8799,
         0.7837,  0.9243,  0.6303,  0.0445,  0.9969,  0.0339,  0.5412,
         0.8492,  0.9072,  0.8619,  0.8516,  0.0441,  0.0671,  0.1073,
         0.9454,  0.9023,  0.9431,  0.0222,  0.9950,  0.1262,  0.9311,
         0.0753,  0.0487,  0.8737,  0.1500,  0.4003,  0.0684,  0.1526,
         0.8030,  0.2782,  0.0447,  0.1616,  0.9317,  0.9177,  0.4765,
         0.0969,  0.8562,  0.9222,  0.3788,  0.0048,  0.8869,  0.6638,
         0.9629,  0.6680,  0.1225,  0.7622,  0.7775,  0.3851,  0.9753,
         0.1140,  0.0754,  0.4927,  0.0259,  0.0928,  0.0890,  0.9423,
         0.7126,  0.9311,  0.9342,  0.8492,  0.9268,  0.5634,  0.9779,
         0.0552,  0.5186,  0.8299,  0.9649,  0.6535,  0.9333,  0.9298,
         0.9707,  0.8740,  0.8407,  0.7742,  0.9137,  0.6713,  0.6778,
         0.7998,  0.0077,  0.9521,  0.0233,  0.9667,  0.0388,  0.9035,
         0.1122,  0.9989,  0.2370,  0.9698,  0.0494,  0.9833,  0.9973,
         0.8742,  0.9424,  0.6921,  0.5566,  0.1562,  0.4669,  0.0490,
         0.0628,  0.7104,  0.7873,  0.7179,  0.9838,  0.1400,  0.0239,
         0.5865,  0.8689,  0.1674,  0.8673,  0.9269,  0.8924,  0.9272,
         0.9575,  0.8633,  0.9407,  0.8425,  0.8633,  0.1008,  0.7300,
         0.9886,  0.9477,  0.9184,  0.9551,  0.1668,  0.9623,  0.9773,
         0.9546,  0.8046,  0.6894,  0.9314,  0.8330,  0.0201,  0.1652,
         0.8269,  0.8631,  0.4228,  0.8545,  0.9512,  0.9483,  0.8738,
         0.7876,  0.4083,  0.4463,  0.8584,  0.1427,  0.0776,  0.0384,
         0.2168,  0.1399,  0.8037,  0.1518,  0.9932,  0.7899,  0.3611,
         0.9939,  0.0151,  0.0458,  0.0333,  0.5869,  0.9607,  0.5354,
         0.9139,  0.9379,  0.9602,  0.0945,  0.9658,  0.9021,  0.9006,
         0.2062,  0.5641,  0.9546,  0.1306,  0.9607,  0.0459,  0.0099,
         0.8907,  0.9855,  0.9969,  0.6433,  0.1039,  0.0395,  0.1760,
         0.9780,  0.2835,  0.6143,  0.9695,  0.3669,  0.1844,  0.0266,
         0.4875,  0.1322,  0.5376,  0.3423,  0.4722,  0.8764,  0.9034,
         0.8385,  0.0173,  0.1462,  0.6723,  0.9433,  0.6429,  0.8739,
         0.9622,  0.0342,  0.8981,  0.1228,  0.3352,  0.7975,  0.1453,
         0.0108,  0.1164,  0.0059,  0.9027,  0.8618,  0.9940,  0.2523,
         0.9259], device='cuda:0')
tensor(0.3676, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9424,  0.9439,  0.8775,  0.8689,  0.8627,  0.7692,  0.9788,
         0.6752,  0.1158,  0.2580,  0.9869,  0.8642,  0.1245,  0.8297,
         0.4279,  0.7192,  0.8716,  0.8090,  0.9775,  0.5300,  0.9628,
         0.0047,  0.4941,  0.0326,  0.9878,  0.9887,  0.9161,  0.9092,
         0.8608,  0.0724,  0.0398,  0.9591,  0.0087,  0.9945,  0.1372,
         0.9171,  0.0154,  0.9235,  0.9170,  0.9625,  0.0439,  0.9624,
         0.9345,  0.9561,  0.8342,  0.2770,  0.7449,  0.9814,  0.5958,
         0.9729,  0.1208,  0.4897,  0.2133,  0.1033,  0.2139,  0.9571,
         0.9645,  0.0519,  0.8988,  0.9408,  0.9763,  0.5169,  0.0102,
         0.8735,  0.8961,  0.3152,  0.6682,  0.6429,  0.1205,  0.0898,
         0.0266,  0.9175,  0.5300,  0.1132,  0.0334,  0.7225,  0.9239,
         0.8097,  0.0113,  0.0885,  0.9590,  0.2401,  0.9805,  0.0161,
         0.8393,  0.0067,  0.9125,  0.0414,  0.6891,  0.9793,  0.1187,
         0.8901,  0.7690,  0.1096,  0.9609,  0.6300,  0.7113,  0.9658,
         0.1015,  0.8213,  0.9581,  0.0397,  0.0123,  0.9290,  0.0759,
         0.1598,  0.9750,  0.9657,  0.0317,  0.1088,  0.7688,  0.9813,
         0.4177,  0.0025,  0.0569,  0.3885,  0.9100,  0.1833,  0.9245,
         0.9996,  0.1498,  0.9514,  0.0281,  0.8785,  0.8546,  0.0447,
         0.0316,  0.9240,  0.0505,  0.0290,  0.9566,  0.8377,  0.0079,
         0.9776,  0.0739,  0.9469,  0.1972,  0.8337,  0.0352,  0.8700,
         0.8826,  0.6359,  0.0091,  0.9902,  0.1264,  0.2627,  0.9539,
         0.0930,  0.1326,  0.9587,  0.0553,  0.9393,  0.8435,  0.0691,
         0.9428,  0.8707,  0.0143,  0.1501,  0.7367,  0.9823,  0.9468,
         0.1278,  0.0115,  0.0022,  0.0610,  0.9988,  0.9936,  0.9316,
         0.1205,  0.9248,  0.9022,  0.9009,  0.0802,  0.0376,  0.9597,
         0.9527,  0.0374,  0.0682,  0.0190,  0.3549,  0.6701,  0.0050,
         0.0685,  0.2120,  0.8738,  0.5078,  0.7715,  0.8808,  0.0035,
         0.0018,  0.8945,  0.9730,  0.9427,  0.9155,  0.9206,  0.0235,
         0.8799,  0.5538,  0.7463,  0.7430,  0.0157,  0.7683,  0.9092,
         0.1070,  0.9971,  0.9233,  0.8160,  0.9827,  0.8049,  0.1021,
         0.9690,  0.9472,  0.9794,  0.9646,  0.9591,  0.0453,  0.5666,
         0.2528,  0.0221,  0.9048,  0.9208,  0.1627,  0.9592,  0.5320,
         0.4214,  0.8805,  0.0743,  0.9304,  0.8416,  0.2150,  0.9370,
         0.9420,  0.9862,  0.4012,  0.0125,  0.6121,  0.9467,  0.1081,
         0.0034,  0.6413,  0.9582,  0.9291,  0.1003,  0.9149,  0.8932,
         0.7800,  0.9362,  0.9416,  0.3841,  0.3910,  0.8887,  0.0213,
         0.6310,  0.7303,  0.9319,  0.9565,  0.6152,  0.4701,  0.0079,
         0.1367,  0.8974,  0.9708,  0.1280,  0.0888,  0.1963,  0.0808,
         0.0149,  0.8315,  0.9348,  0.2979,  0.0574,  0.9240,  0.0187,
         0.2317,  0.0228,  0.9616,  0.8526,  0.0240,  0.9022,  0.0530,
         0.0427,  0.2088,  0.6408,  0.9627,  0.9806,  0.6106,  0.8826,
         0.7842,  0.9431,  0.7399,  0.3168,  0.0803,  0.9167,  0.9285,
         0.9670,  0.0612,  0.9097,  0.8962,  0.0155,  0.9626,  0.0622,
         0.2093,  0.9443,  0.0203,  0.7956,  0.4403,  0.9660,  0.0026,
         0.2504,  0.9514,  0.1220,  0.4079,  0.2056,  0.0550,  0.8703,
         0.0324,  0.0826,  0.0380,  0.0052,  0.0498,  0.0889,  0.9288,
         0.8451,  0.0224,  0.8800,  0.1210,  0.9602,  0.8436,  0.7221,
         0.9327,  0.3536,  0.9968,  0.8893,  0.0934,  0.3359,  0.9406,
         0.6679,  0.0374,  0.9506,  0.9645,  0.0493,  0.1246,  0.9791,
         0.9094,  0.9572,  0.9951,  0.9935,  0.9134,  0.4274,  0.6445,
         0.2365,  0.1176,  0.9870,  0.0765,  0.0326,  0.8809,  0.0246,
         0.1052,  0.9699,  0.5514,  0.1555,  0.7840,  0.0189,  0.9782,
         0.0242,  0.0877,  0.9695,  0.9488,  0.1055,  0.9369,  0.0847,
         0.0018,  0.1507,  0.9422,  0.0067,  0.0800,  0.9546,  0.8457,
         0.3107,  0.8775,  0.9464,  0.8127,  0.8722,  0.9671,  0.1643,
         0.1127,  0.3687,  0.9857,  0.5330,  0.9604,  0.8441,  0.5079,
         0.9822,  0.8522,  0.0046,  0.1829,  0.2530,  0.9753,  0.9445,
         0.1010,  0.8305,  0.6992,  0.9379,  0.0669,  0.0733,  0.0138,
         0.6819,  0.0085,  0.9289,  0.0184,  0.0711,  0.8475,  0.6480,
         0.9780,  0.0659,  0.4824,  0.9982,  0.0049,  0.0770,  0.8490,
         0.0199,  0.4447,  0.8463,  0.1815,  0.7602,  0.5585,  0.0499,
         0.9513,  0.0123,  0.0833,  0.7948,  0.3646,  0.9443,  0.0131,
         0.9510,  0.0494,  0.8013,  0.9607,  0.9217,  0.9742,  0.0247,
         0.0268,  0.8961,  0.1716,  0.8599,  0.7016,  0.7761,  0.9884,
         0.2006,  0.9446,  0.7906,  0.7261,  0.9654,  0.8091,  0.7979,
         0.9633,  0.9584,  0.3057,  0.0415,  0.3021,  0.9259,  0.6607,
         0.0528,  0.2904,  0.0336,  0.1145,  0.2622,  0.8750,  0.8215,
         0.0345,  0.8223,  0.9349,  0.0214,  0.0700,  0.9821,  0.0416,
         0.9451,  0.0164,  0.3819,  0.6958,  0.9295,  0.1700,  0.8605,
         0.3082,  0.9199,  0.0754,  0.9569,  0.0520,  0.8020,  0.8278,
         0.5818,  0.8707,  0.9810,  0.0960,  0.9265,  0.9411,  0.1371,
         0.2875,  0.0508,  0.9525,  0.8608,  0.9716,  0.7816,  0.1667,
         0.7658,  0.9796,  0.8321,  0.8922,  0.9701,  0.9772,  0.8540,
         0.0183], device='cuda:0')
tensor(0.3252, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9793,  0.0491,  0.8564,  0.9306,  0.9172,  0.9282,  0.8887,
         0.6544,  0.3396,  0.8888,  0.1294,  0.9900,  0.9610,  0.1958,
         0.9727,  0.0643,  0.1578,  0.5895,  0.8775,  0.8673,  0.0606,
         0.9949,  0.0868,  0.5344,  0.7056,  0.5621,  0.8120,  0.3546,
         0.5049,  0.9787,  0.0570,  0.9393,  0.8769,  0.4033,  0.1235,
         0.0069,  0.0330,  0.0126,  0.1167,  0.9918,  0.0101,  0.0215,
         0.6011,  0.7765,  0.8437,  0.9850,  0.9538,  0.7363,  0.5065,
         0.0517,  0.9264,  0.0083,  0.2182,  0.2537,  0.9930,  0.6911,
         0.0456,  0.4127,  0.8266,  0.9186,  0.8568,  0.8629,  0.8229,
         0.3848,  0.9502,  0.9666,  0.0075,  0.9431,  0.8535,  0.4183,
         0.3215,  0.9305,  0.0143,  0.9319,  0.9914,  0.9779,  0.6725,
         0.8458,  0.6389,  0.1569,  0.9212,  0.8400,  0.8937,  0.0654,
         0.0681,  0.9699,  0.0069,  0.8813,  0.7794,  0.0580,  0.0174,
         0.2452,  0.8664,  0.7555,  0.0449,  0.9444,  0.1200,  0.6620,
         0.6638,  0.9481,  0.1406,  0.9736,  0.0028,  0.0157,  0.1235,
         0.9897,  0.0655,  0.7234,  0.6175,  0.3783,  0.5916,  0.8285,
         0.9124,  0.9521,  0.7183,  0.8713,  0.0500,  0.8830,  0.9446,
         0.2033,  0.9384,  0.8989,  0.0575,  0.9345,  0.8776,  0.1085,
         0.9792,  0.7689,  0.9982,  0.9077,  0.7340,  0.9491,  0.6476,
         0.2193,  0.0460,  0.9872,  0.9169,  0.9404,  0.7828,  0.0816,
         0.8222,  0.0567,  0.1838,  0.1802,  0.8815,  0.0111,  0.9425,
         0.9096,  0.9075,  0.8426,  0.9978,  0.9875,  0.9303,  0.7649,
         0.7757,  0.9513,  0.0318,  0.0943,  0.0327,  0.9297,  0.0031,
         0.0877,  0.8420,  0.2163,  0.0130,  0.9453,  0.6139,  0.1392,
         0.9667,  0.0211,  0.8852,  0.8610,  0.9630,  0.1852,  0.8743,
         0.8165,  0.8955,  0.3096,  0.9620,  0.9263,  0.0514,  0.0426,
         0.6215,  0.0606,  0.1489,  0.8784,  0.9343,  0.7553,  0.7312,
         0.9557,  0.7976,  0.9022,  0.0359,  0.9470,  0.1004,  0.8964,
         0.0280,  0.8848,  0.9179,  0.1171,  0.8601,  0.0043,  0.0073,
         0.0268,  0.1699,  0.6540,  0.0792,  0.8550,  0.9185,  0.7680,
         0.8826,  0.9232,  0.0071,  0.9028,  0.5814,  0.2105,  0.0804,
         0.9956,  0.5588,  0.7955,  0.9219,  0.4873,  0.9591,  0.6040,
         0.9771,  0.8056,  0.8030,  0.0121,  0.9814,  0.5851,  0.0249,
         0.9778,  0.8836,  0.9864,  0.0066,  0.5416,  0.8402,  0.1202,
         0.9676,  0.2577,  0.8968,  0.9789,  0.2591,  0.9768,  0.2536,
         0.9788,  0.0330,  0.0849,  0.0384,  0.9829,  0.8723,  0.3230,
         0.8237,  0.8577,  0.0540,  0.9202,  0.0210,  0.8317,  0.9787,
         0.8988,  0.0891,  0.5115,  0.8210,  0.1738,  0.9039,  0.1160,
         0.8866,  0.0257,  0.2699,  0.0155,  0.0315,  0.0034,  0.9629,
         0.8625,  0.8513,  0.0925,  0.0224,  0.0356,  0.3066,  0.0218,
         0.0988,  0.4416,  0.9585,  0.7209,  0.0285,  0.0164,  0.7952,
         0.6299,  0.8846,  0.5274,  0.0230,  0.7069,  0.8846,  0.0609,
         0.9618,  0.9366,  0.0585,  0.8982,  0.0748,  0.0055,  0.0289,
         0.6871,  0.0549,  0.9691,  0.9992,  0.0138,  0.3112,  0.0238,
         0.6267,  0.8675,  0.0389,  0.7991,  0.1391,  0.0183,  0.0822,
         0.9124,  0.6392,  0.1655,  0.9339,  0.8599,  0.2189,  0.8069,
         0.0455,  0.2360,  0.9315,  0.9282,  0.0178,  0.7972,  0.0233,
         0.0368,  0.0457,  0.2194,  0.8706,  0.1522,  0.7402,  0.3096,
         0.1685,  0.8944,  0.1531,  0.3598,  0.9868,  0.8467,  0.0519,
         0.8755,  0.5364,  0.8532,  0.9108,  0.9788,  0.1589,  0.7349,
         0.9668,  0.1304,  0.8183,  0.6289,  0.9023,  0.9611,  0.5874,
         0.9316,  0.9620,  0.9955,  0.9345,  0.9526,  0.9437,  0.9222,
         0.8930,  0.8584,  0.9342,  0.9307,  0.8790,  0.8094,  0.5496,
         0.3006,  0.5192,  0.9433,  0.1664,  0.9682,  0.8392,  0.5047,
         0.0366,  0.8004,  0.0746,  0.9925,  0.9709,  0.9192,  0.9004,
         0.9894,  0.6539,  0.9237,  0.4503,  0.9602,  0.0475,  0.9018,
         0.1033,  0.9920,  0.9306,  0.9159,  0.9638,  0.0033,  0.0846,
         0.7760,  0.9393,  0.5222,  0.2820,  0.8588,  0.9204,  0.5209,
         0.0885,  0.9287,  0.8353,  0.0346,  0.9291,  0.0043,  0.9375,
         0.0196,  0.8551,  0.8892,  0.8411,  0.0987,  0.1401,  0.7969,
         0.6828,  0.3643,  0.2899,  0.9258,  0.9775,  0.0591,  0.3818,
         0.0174,  0.7634,  0.1306,  0.1526,  0.8092,  0.9251,  0.9446,
         0.8847,  0.2291,  0.9503,  0.9744,  0.1896,  0.9654,  0.7254,
         0.7966,  0.0158,  0.1111,  0.9260,  0.0783,  0.8894,  0.9367,
         0.9231,  0.8317,  0.8419,  0.0417,  0.9109,  0.0584,  0.6638,
         0.4572,  0.2700,  0.9870,  0.8995,  0.8565,  0.9844,  0.9611,
         0.8739,  0.6963,  0.6458,  0.8319,  0.8784,  0.9836,  0.9355,
         0.7998,  0.0906,  0.3547,  0.8475,  0.3533,  0.8401,  0.2827,
         0.0115,  0.7981,  0.7786,  0.8097,  0.3485,  0.4383,  0.9311,
         0.9968,  0.8099,  0.7754,  0.0511,  0.2163,  0.3165,  0.9643,
         0.9935,  0.3164,  0.9319,  0.3787,  0.6575,  0.2149,  0.9956,
         0.0252,  0.8420,  0.0241,  0.6654,  0.0457,  0.0162,  0.1318,
         0.8324,  0.2884,  0.1754,  0.1413,  0.6768,  0.9306,  0.9533,
         0.9324], device='cuda:0')
tensor(0.4254, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7930,  0.1161,  0.9518,  0.9457,  0.8384,  0.8110,  0.2136,
         0.2589,  0.3785,  0.9944,  0.9987,  0.0437,  0.9417,  0.9582,
         0.8756,  0.2153,  0.0117,  0.9288,  0.0017,  0.5293,  0.1228,
         0.0168,  0.7597,  0.1262,  0.1233,  0.9275,  0.6859,  0.8769,
         0.9749,  0.0281,  0.5883,  0.3471,  0.0065,  0.1753,  0.3549,
         0.0441,  0.9434,  0.1337,  0.0550,  0.6936,  0.0211,  0.9885,
         0.0390,  0.0090,  0.9056,  0.9437,  0.9128,  0.6247,  0.9235,
         0.8000,  0.3532,  0.8469,  0.6101,  0.2174,  0.6912,  0.8977,
         0.6731,  0.0029,  0.5437,  0.6633,  0.0475,  0.9545,  0.0141,
         0.8422,  0.0275,  0.9139,  0.1210,  0.8849,  0.4048,  0.6049,
         0.8252,  0.5462,  0.0332,  0.8875,  0.9200,  0.0344,  0.8951,
         0.1645,  0.0068,  0.8652,  0.8715,  0.1853,  0.2684,  0.8523,
         0.7469,  0.6597,  0.2082,  0.2619,  0.9286,  0.9779,  0.8237,
         0.4929,  0.6555,  0.2084,  0.0477,  0.9553,  0.9002,  0.0481,
         0.9723,  0.9299,  0.0082,  0.3573,  0.8106,  0.7851,  0.8915,
         0.9656,  0.1498,  0.7065,  0.8975,  0.0273,  0.7959,  0.9161,
         0.8444,  0.9193,  0.5842,  0.9292,  0.8494,  0.9988,  0.1381,
         0.0607,  0.0727,  0.3168,  0.8794,  0.9974,  0.0308,  0.0936,
         0.4130,  0.8699,  0.0572,  0.0505,  0.8787,  0.3707,  0.8805,
         0.9841,  0.1128,  0.9194,  0.0895,  0.9977,  0.0259,  0.9922,
         0.8883,  0.9669,  0.8590,  0.5426,  0.0466,  0.9204,  0.7724,
         0.8986,  0.0311,  0.9373,  0.0651,  0.1864,  0.1908,  0.9876,
         0.0776,  0.0904,  0.7821,  0.0132,  0.8873,  0.9988,  0.6262,
         0.9667,  0.0065,  0.0562,  0.0388,  0.0691,  0.0729,  0.0111,
         0.9898,  0.9988,  0.8187,  0.0604,  0.2573,  0.9755,  0.0116,
         0.1661,  0.8904,  0.1219,  0.9231,  0.0405,  0.9305,  0.2483,
         0.9978,  0.0081,  0.0698,  0.9433,  0.0050,  0.9157,  0.9258,
         0.9663,  0.0363,  0.3284,  0.7727,  0.0557,  0.0018,  0.4970,
         0.9848,  0.0640,  0.8679,  0.0046,  0.0711,  0.9090,  0.0582,
         0.0483,  0.9786,  0.4433,  0.9644,  0.0102,  0.8048,  0.9714,
         0.9915,  0.7745,  0.4982,  0.0242,  0.9256,  0.5614,  0.1697,
         0.1834,  0.0948,  0.9791,  0.9452,  0.8834,  0.0406,  0.0359,
         0.0163,  0.3553,  0.0019,  0.6256,  0.4159,  0.8370,  0.1261,
         0.8331,  0.9694,  0.9114,  0.8682,  0.1488,  0.7973,  0.7768,
         0.9560,  0.8932,  0.6866,  0.0802,  0.7906,  0.0291,  0.3873,
         0.8486,  0.9983,  0.8315,  0.8398,  0.8669,  0.5421,  0.8536,
         0.2120,  0.0415,  0.1445,  0.9833,  0.2473,  0.9121,  0.6804,
         0.9786,  0.0119,  0.6507,  0.7308,  0.9044,  0.9928,  0.4947,
         0.9954,  0.7991,  0.0761,  0.0220,  0.7204,  0.8880,  0.1068,
         0.5537,  0.8808,  0.9878,  0.0310,  0.9460,  0.0387,  0.9436,
         0.9733,  0.0359,  0.9874,  0.9985,  0.9967,  0.9334,  0.0565,
         0.8779,  0.1696,  0.9835,  0.9291,  0.9105,  0.2821,  0.0457,
         0.8680,  0.0659,  0.0972,  0.1740,  0.8389,  0.7907,  0.1721,
         0.0180,  0.0243,  0.9982,  0.2337,  0.7177,  0.0143,  0.3924,
         0.9543,  0.3478,  0.8277,  0.8800,  0.3010,  0.0980,  0.8861,
         0.3210,  0.9442,  0.9106,  0.2306,  0.4269,  0.1150,  0.0177,
         0.6610,  0.1787,  0.1276,  0.1285,  0.0183,  0.1306,  0.6319,
         0.8112,  0.1623,  0.0118,  0.8059,  0.6839,  0.6651,  0.8595,
         0.9468,  0.7807,  0.1274,  0.7021,  0.9928,  0.1871,  0.0046,
         0.0092,  0.0112,  0.0804,  0.0798,  0.8558,  0.0051,  0.8639,
         0.7671,  0.6567,  0.9223,  0.9647,  0.9819,  0.6776,  0.9780,
         0.0102,  0.8898,  0.9393,  0.9323,  0.3753,  0.6668,  0.0048,
         0.0761,  0.8166,  0.6129,  0.6836,  0.6260,  0.0083,  0.0033,
         0.0151,  0.7545,  0.1171,  0.1591,  0.0190,  0.1259,  0.9025,
         0.9377,  0.0354,  0.3338,  0.9090,  0.8779,  0.9032,  0.4884,
         0.0971,  0.0054,  0.9600,  0.4590,  0.4019,  0.6550,  0.0467,
         0.8987,  0.1815,  0.8759,  0.9383,  0.0631,  0.9693,  0.8369,
         0.9821,  0.8276,  0.9318,  0.9800,  0.9482,  0.6739,  0.8904,
         0.0299,  0.8384,  0.0032,  0.2079,  0.8822,  0.4676,  0.7960,
         0.2591,  0.9787,  0.4560,  0.0053,  0.1872,  0.3587,  0.7183,
         0.8571,  0.2374,  0.2047,  0.1921,  0.8049,  0.1171,  0.7989,
         0.0058,  0.9920,  0.4812,  0.9453,  0.0160,  0.0266,  0.8567,
         0.5709,  0.9253,  0.6978,  0.9820,  0.8438,  0.9381,  0.0066,
         0.0245,  0.8974,  0.0863,  0.9437,  0.9873,  0.7026,  0.8387,
         0.5365,  0.8796,  0.1817,  0.2694,  0.9428,  0.4485,  0.8172,
         0.9325,  0.0223,  0.0509,  0.7952,  0.2571,  0.1661,  0.0558,
         0.0404,  0.9620,  0.8449,  0.0752,  0.9660,  0.8462,  0.8122,
         0.8498,  0.0120,  0.8628,  0.9361,  0.3761,  0.9565,  0.6405,
         0.7003,  0.2128,  0.1773,  0.9376,  0.9589,  0.6063,  0.3173,
         0.9416,  0.9224,  0.6577,  0.9835,  0.9598,  0.0313,  0.9478,
         0.9768,  0.8955,  0.8900,  0.9636,  0.4055,  0.9832,  0.1430,
         0.0015,  0.4014,  0.8490,  0.0227,  0.9603,  0.0526,  0.0532,
         0.9986,  0.0107,  0.3140,  0.7821,  0.9150,  0.4759,  0.9627,
         0.7645], device='cuda:0')
tensor(0.3487, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4045,  0.7571,  0.2525,  0.8297,  0.2901,  0.8458,  0.7634,
         0.2255,  0.0167,  0.8497,  0.1317,  0.1100,  0.8246,  0.0927,
         0.0257,  0.0838,  0.9918,  0.9387,  0.9810,  0.1053,  0.9176,
         0.7993,  0.7415,  0.5666,  0.0215,  0.9265,  0.0211,  0.4998,
         0.0306,  0.0760,  0.0098,  0.9184,  0.7193,  0.1673,  0.9151,
         0.0003,  0.8393,  0.6862,  0.1486,  0.7189,  0.9066,  0.2992,
         0.7161,  0.1633,  0.8666,  0.8080,  0.0265,  0.7946,  0.0025,
         0.1423,  0.0998,  0.8991,  0.5436,  0.3121,  0.0912,  0.1698,
         0.0437,  0.0474,  0.1693,  0.5513,  0.5062,  0.9402,  0.0598,
         0.0076,  0.9640,  0.3215,  0.9421,  0.7592,  0.9396,  0.0162,
         0.9763,  0.9433,  0.0221,  0.1004,  0.0050,  0.1396,  0.9461,
         0.9036,  0.0683,  0.9249,  0.2356,  0.4570,  0.0267,  0.0930,
         0.9004,  0.2242,  0.7357,  0.1282,  0.0236,  0.9835,  0.6271,
         0.8275,  0.9441,  0.2687,  0.0218,  0.1139,  0.8799,  0.1264,
         0.0247,  0.3013,  0.9595,  0.2312,  0.0118,  0.1230,  0.5828,
         0.9500,  0.0533,  0.1172,  0.4867,  0.1095,  0.0394,  0.2868,
         0.1196,  0.0024,  0.9477,  0.1835,  0.0114,  0.1727,  0.7886,
         0.8015,  0.9962,  0.1425,  0.9626,  0.7660,  0.0151,  0.0098,
         0.8052,  0.0329,  0.0143,  0.9315,  0.0323,  0.8973,  0.8468,
         0.2743,  0.8223,  0.9951,  0.6799,  0.7337,  0.8434,  0.9072,
         0.4458,  0.9678,  0.0018,  0.1051,  0.8295,  0.8028,  0.8582,
         0.9539,  0.3330,  0.5385,  0.0160,  0.8143,  0.8691,  0.0071,
         0.2523,  0.0141,  0.0808,  0.0209,  0.8310,  0.6209,  0.9223,
         0.7818,  0.7636,  0.9994,  0.0223,  0.7422,  0.0243,  0.5834,
         0.2396,  0.3829,  0.4980,  0.0533,  0.5056,  0.5786,  0.9501,
         0.7341,  0.4940,  0.9600,  0.4181,  0.0742,  0.0034,  0.9296,
         0.0328,  0.7333,  0.0060,  0.1610,  0.4896,  0.8924,  0.4120,
         0.4526,  0.0744,  0.9434,  0.9630,  0.6837,  0.0353,  0.8768,
         0.0161,  0.9963,  0.3270,  0.0557,  0.0678,  0.3184,  0.8911,
         0.9181,  0.8718,  0.4220,  0.0135,  0.9606,  0.5935,  0.8880,
         0.4844,  0.8830,  0.0511,  0.4719,  0.0637,  0.0255,  0.0114,
         0.0287,  0.1057,  0.7209,  0.0160,  0.9042,  0.8235,  0.1011,
         0.7167,  0.8918,  0.7844,  0.7369,  0.0182,  0.2831,  0.0145,
         0.0136,  0.8512,  0.8334,  0.1913,  0.0368,  0.9669,  0.0044,
         0.1157,  0.6191,  0.4589,  0.1072,  0.0171,  0.0887,  0.0393,
         0.0192,  0.6773,  0.2645,  0.0036,  0.1053,  0.9105,  0.6784,
         0.6449,  0.2839,  0.9356,  0.0183,  0.8248,  0.9756,  0.1446,
         0.0047,  0.0146,  0.7979,  0.1106,  0.1660,  0.8145,  0.0339,
         0.2669,  0.1312,  0.9436,  0.0422,  0.0252,  0.9655,  0.1916,
         0.8044,  0.9069,  0.8930,  0.0040,  0.0242,  0.0900,  0.0073,
         0.3467,  0.0839,  0.0220,  0.6005,  0.8181,  0.9588,  0.9242,
         0.1075,  0.1013,  0.1620,  0.1070,  0.9107,  0.7031,  0.7914,
         0.0652,  0.9338,  0.0651,  0.1087,  0.8941,  0.5895,  0.5972,
         0.6007,  0.0197,  0.2104,  0.9320,  0.9207,  0.8502,  0.1412,
         0.0602,  0.8302,  0.0736,  0.6169,  0.0603,  0.3552,  0.0817,
         0.9560,  0.9802,  0.9758,  0.2372,  0.9461,  0.0012,  0.0243,
         0.9244,  0.0280,  0.0014,  0.0703,  0.3191,  0.3108,  0.0681,
         0.7532,  0.0342,  0.3175,  0.0072,  0.1851,  0.9588,  0.0080,
         0.4690,  0.0211,  0.9932,  0.1773,  0.0392,  0.0029,  0.8876,
         0.0471,  0.0316,  0.8939,  0.7632,  0.9418,  0.0153,  0.8156,
         0.0261,  0.2628,  0.1010,  0.4972,  0.1628,  0.9560,  0.0424,
         0.8084,  0.1311,  0.0325,  0.7337,  0.0638,  0.0483,  0.1767,
         0.0795,  0.5955,  0.8683,  0.0147,  0.0412,  0.9448,  0.6692,
         0.0383,  0.4202,  0.8891,  0.7779,  0.8265,  0.0110,  0.7133,
         0.0414,  0.8058,  0.7780,  0.1408,  0.0171,  0.9369,  0.6541,
         0.0032,  0.5820,  0.0100,  0.0774,  0.0050,  0.6961,  0.9293,
         0.7236,  0.4916,  0.0252,  0.2715,  0.9992,  0.9353,  0.9757,
         0.8169,  0.9466,  0.8382,  0.0184,  0.0076,  0.8183,  0.5568,
         0.4523,  0.5438,  0.9645,  0.9090,  0.0734,  0.0190,  0.0177,
         0.1226,  0.0194,  0.0086,  0.0022,  0.0758,  0.0062,  0.9633,
         0.9924,  0.8566,  0.0177,  0.0767,  0.9477,  0.6404,  0.8658,
         0.9906,  0.8402,  0.0770,  0.8004,  0.0048,  0.7091,  0.0461,
         0.0240,  0.1041,  0.0599,  0.5256,  0.0057,  0.0214,  0.1209,
         0.7718,  0.0028,  0.0353,  0.0186,  0.4992,  0.0669,  0.7337,
         0.8558,  0.8984,  0.0789,  0.3304,  0.9487,  0.0682,  0.0508,
         0.8923,  0.0550,  0.1881,  0.8302,  0.6863,  0.0045,  0.9706,
         0.8010,  0.0163,  0.9046,  0.2544,  0.7988,  0.0048,  0.0107,
         0.0420,  0.7959,  0.9994,  0.0469,  0.9170,  0.0018,  0.0194,
         0.0710,  0.0106,  0.8969,  0.9189,  0.2959,  0.7833,  0.0388,
         0.0530,  0.0240,  0.4544,  0.7790,  0.0158,  0.8389,  0.5351,
         0.0655,  0.9659,  0.0171,  0.4564,  0.0318,  0.0953,  0.8495,
         0.0887,  0.0435,  0.9301,  0.0471,  0.7579,  0.8943,  0.2518,
         0.8934,  0.0776,  0.4626,  0.9929,  0.1216,  0.0077,  0.5012,
         0.7971], device='cuda:0')
tensor(0.3394, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6120,  0.3177,  0.0270,  0.0639,  0.8957,  0.9319,  0.1460,
         0.8972,  0.7789,  0.9758,  0.0231,  0.7497,  0.7042,  0.0369,
         0.3607,  0.8262,  0.0586,  0.0146,  0.0059,  0.1118,  0.8306,
         0.0602,  0.8862,  0.6453,  0.0324,  0.9861,  0.7588,  0.0657,
         0.2344,  0.8282,  0.0587,  0.9891,  0.0333,  0.0747,  0.8784,
         0.3860,  0.0159,  0.7785,  0.8507,  0.0689,  0.9819,  0.0081,
         0.0269,  0.0690,  0.9983,  0.5022,  0.6031,  0.0233,  0.0732,
         0.8579,  0.9771,  0.7192,  0.4435,  0.1113,  0.0259,  0.8926,
         0.7333,  0.0465,  0.8731,  0.0945,  0.0613,  0.2051,  0.2072,
         0.0898,  0.5474,  0.0161,  0.0808,  0.8828,  0.9697,  0.0559,
         0.8924,  0.9404,  0.0861,  0.9484,  0.0049,  0.9132,  0.2576,
         0.8083,  0.0420,  0.9909,  0.1598,  0.0083,  0.1424,  0.1394,
         0.0669,  0.2870,  0.0374,  0.0029,  0.4325,  0.7122,  0.9422,
         0.7953,  0.2356,  0.6219,  0.0165,  0.9821,  0.6792,  0.9532,
         0.6073,  0.0314,  0.9969,  0.7138,  0.4843,  0.0014,  0.8593,
         0.0327,  0.0013,  0.0194,  0.5988,  0.7561,  0.0168,  0.0061,
         0.9664,  0.0819,  0.0537,  0.0509,  0.8170,  0.9406,  0.1029,
         0.0898,  0.0393,  0.5127,  0.4926,  0.8100,  0.7632,  0.8416,
         0.9724,  0.0642,  0.7716,  0.0187,  0.7821,  0.0797,  0.0521,
         0.8364,  0.1039,  0.3364,  0.0544,  0.0392,  0.0549,  0.2838,
         0.8120,  0.9613,  0.1242,  0.0401,  0.3040,  0.9872,  0.0822,
         0.9701,  0.1148,  0.0441,  0.0263,  0.2641,  0.0342,  0.0273,
         0.9164,  0.9425,  0.8545,  0.0058,  0.9289,  0.0051,  0.0815,
         0.4885,  0.8548,  0.0028,  0.8638,  0.8033,  0.0118,  0.0320,
         0.0013,  0.9335,  0.7736,  0.8008,  0.2147,  0.2127,  0.9098,
         0.2400,  0.9931,  0.0690,  0.9991,  0.6011,  0.8885,  0.9327,
         0.9709,  0.0377,  0.9677,  0.0016,  0.9920,  0.9372,  0.7740,
         0.4260,  0.0570,  0.2217,  0.0871,  0.1003,  0.3938,  0.0277,
         0.7212,  0.3939,  0.8636,  0.5082,  0.0084,  0.1154,  0.2754,
         0.8428,  0.0500,  0.7763,  0.0182,  0.1535,  0.2199,  0.1345,
         0.9661,  0.4897,  0.0425,  0.6172,  0.0065,  0.0411,  0.0168,
         0.9264,  0.0333,  0.0049,  0.0249,  0.4059,  0.8558,  0.8239,
         0.8129,  0.1599,  0.0254,  0.9144,  0.8880,  0.2410,  0.0349,
         0.9969,  0.9311,  0.9176,  0.9242,  0.1433,  0.9107,  0.1122,
         0.9779,  0.1253,  0.0512,  0.0102,  0.0306,  0.9789,  0.7063,
         0.0067,  0.0493,  0.4991,  0.7921,  0.1491,  0.9294,  0.0939,
         0.8679,  0.6567,  0.8078,  0.0055,  0.0067,  0.8851,  0.0270,
         0.3362,  0.0100,  0.9682,  0.0544,  0.7958,  0.5946,  0.7551,
         0.8968,  0.6964,  0.7389,  0.0229,  0.3409,  0.0391,  0.0109,
         0.0113,  0.9099,  0.1902,  0.7131,  0.0735,  0.7257,  0.8384,
         0.0907,  0.0052,  0.0077,  0.7146,  0.0361,  0.9913,  0.4262,
         0.0721,  0.5551,  0.0339,  0.0282,  0.9014,  0.8594,  0.0433,
         0.5524,  0.0267,  0.9834,  0.3373,  0.4778,  0.7191,  0.0316,
         0.0475,  0.0417,  0.7317,  0.7810,  0.4436,  0.3528,  0.0112,
         0.0178,  0.0773,  0.9011,  0.6011,  0.0599,  0.1097,  0.9464,
         0.0189,  0.9884,  0.8790,  0.3122,  0.9128,  0.4581,  0.1008,
         0.0120,  0.0221,  0.6673,  0.8843,  0.0163,  0.0187,  0.0036,
         0.6794,  0.5290,  0.3932,  0.1163,  0.3422,  0.7477,  0.0089,
         0.1985,  0.6301,  0.4809,  0.6092,  0.9403,  0.8096,  0.0412,
         0.7582,  0.9160,  0.0055,  0.2128,  0.9407,  0.0934,  0.0020,
         0.3391,  0.8758,  0.1669,  0.8233,  0.3335,  0.6404,  0.7089,
         0.0509,  0.3138,  0.3937,  0.7757,  0.9549,  0.0305,  0.0132,
         0.0290,  0.0321,  0.5600,  0.8572,  0.2770,  0.0477,  0.0471,
         0.3843,  0.0131,  0.0028,  0.3777,  0.6971,  0.0106,  0.2098,
         0.8482,  0.0461,  0.8237,  0.9378,  0.0521,  0.1233,  0.3526,
         0.0053,  0.3424,  0.6184,  0.1045,  0.8791,  0.8671,  0.8256,
         0.8026,  0.9078,  0.7840,  0.4777,  0.1314,  0.3206,  0.0926,
         0.2746,  0.0992,  0.0115,  0.1040,  0.7686,  0.1091,  0.7283,
         0.9056,  0.2204,  0.3852,  0.0556,  0.9798,  0.6434,  0.0742,
         0.0055,  0.2789,  0.0420,  0.9233,  0.0120,  0.0800,  0.0106,
         0.6433,  0.0530,  0.5114,  0.0070,  0.9989,  0.9844,  0.9498,
         0.2804,  0.9755,  0.9252,  0.9367,  0.8941,  0.1144,  0.8893,
         0.0765,  0.0807,  0.9862,  0.6045,  0.8796,  0.7868,  0.0058,
         0.3635,  0.7612,  0.0023,  0.3358,  0.9264,  0.9345,  0.0176,
         0.7636,  0.2305,  0.1738,  0.9168,  0.0011,  0.8417,  0.0019,
         0.9420,  0.0221,  0.8278,  0.4622,  0.0054,  0.6776,  0.7504,
         0.0122,  0.0430,  0.2076,  0.6927,  0.1000,  0.0338,  0.0901,
         0.1110,  0.9113,  0.6848,  0.0566,  0.0376,  0.0189,  0.8692,
         0.0274,  0.4833,  0.9307,  0.0392,  0.8027,  0.8205,  0.7740,
         0.2750,  0.5809,  0.0430,  0.3329,  0.5654,  0.7884,  0.2581,
         0.8212,  0.0119,  0.9249,  0.0865,  0.2573,  0.4471,  0.8133,
         0.7116,  0.2514,  0.6034,  0.1470,  0.9369,  0.4913,  0.3751,
         0.0198,  0.0083,  0.0253,  0.5990,  0.0161,  0.8287,  0.0724,
         0.0582], device='cuda:0')
tensor(0.3704, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8866,  0.1499,  0.8983,  0.9244,  0.6394,  0.5722,  0.0473,
         0.1621,  0.1006,  0.0314,  0.1159,  0.4707,  0.8660,  0.0947,
         0.3604,  0.0469,  0.0917,  0.0184,  0.9071,  0.9871,  0.7181,
         0.9641,  0.0079,  0.0123,  0.2930,  0.9201,  0.5557,  0.8428,
         0.6644,  0.2196,  0.3537,  0.1457,  0.0254,  0.0458,  0.6488,
         0.2146,  0.9925,  0.2778,  0.0624,  0.7774,  0.7674,  0.7954,
         0.9632,  0.0300,  0.4081,  0.7966,  0.1267,  0.7763,  0.0681,
         0.1234,  0.0208,  0.7451,  0.8086,  0.7197,  0.1219,  0.7365,
         0.0508,  0.0300,  0.4887,  0.0241,  0.9499,  0.7508,  0.6569,
         0.0572,  0.5860,  0.0455,  0.9006,  0.1429,  0.0939,  0.7902,
         0.1158,  0.1918,  0.1458,  0.0373,  0.7214,  0.7305,  0.0177,
         0.5995,  0.5469,  0.3142,  0.2952,  0.1586,  0.5690,  0.8406,
         0.1097,  0.7222,  0.0643,  0.8866,  0.2494,  0.5568,  0.0093,
         0.2138,  0.1993,  0.0392,  0.1126,  0.8784,  0.0523,  0.9100,
         0.2420,  0.0477,  0.1691,  0.1338,  0.8212,  0.0119,  0.8997,
         0.8491,  0.2343,  0.1634,  0.4232,  0.0421,  0.2187,  0.8700,
         0.0857,  0.5701,  0.4062,  0.5288,  0.2290,  0.2542,  0.5410,
         0.0851,  0.9870,  0.3489,  0.5759,  0.9817,  0.6202,  0.1088,
         0.0600,  0.1033,  0.4603,  0.0993,  0.4798,  0.2378,  0.7422,
         0.0775,  0.4932,  0.9952,  0.8705,  0.0169,  0.0291,  0.7812,
         0.4164,  0.3347,  0.0162,  0.0517,  0.9613,  0.6995,  0.0418,
         0.0447,  0.0420,  0.6177,  0.2945,  0.1307,  0.9721,  0.4678,
         0.0155,  0.0899,  0.3820,  0.0582,  0.9042,  0.9815,  0.0118,
         0.1162,  0.1382,  0.0192,  0.0335,  0.9319,  0.0224,  0.8725,
         0.1396,  0.8242,  0.0838,  0.9460,  0.4045,  0.3300,  0.4040,
         0.1116,  0.4629,  0.5301,  0.9983,  0.6073,  0.2082,  0.0070,
         0.8889,  0.1090,  0.9686,  0.3463,  0.9326,  0.8270,  0.8493,
         0.0101,  0.8192,  0.0978,  0.4016,  0.5582,  0.8416,  0.3248,
         0.0313,  0.7917,  0.0738,  0.4767,  0.9702,  0.1497,  0.3539,
         0.6596,  0.2146,  0.4825,  0.5166,  0.0134,  0.8601,  0.9386,
         0.8622,  0.9898,  0.7722,  0.0886,  0.7774,  0.0904,  0.7971,
         0.2355,  0.0029,  0.0485,  0.5922,  0.9265,  0.1735,  0.4671,
         0.8204,  0.0417,  0.2763,  0.0618,  0.6821,  0.9949,  0.6657,
         0.1191,  0.0489,  0.0197,  0.5237,  0.6134,  0.4633,  0.9507,
         0.2794,  0.0981,  0.9390,  0.6506,  0.1826,  0.7848,  0.6314,
         0.0737,  0.0051,  0.9136,  0.8379,  0.7344,  0.7379,  0.2647,
         0.0197,  0.0708,  0.1252,  0.7156,  0.4569,  0.0112,  0.9311,
         0.4309,  0.2139,  0.7081,  0.5021,  0.5285,  0.0273,  0.7748,
         0.6975,  0.4073,  0.0869,  0.7663,  0.2833,  0.9084,  0.9703,
         0.0677,  0.5568,  0.7547,  0.5144,  0.3771,  0.0094,  0.9640,
         0.8405,  0.0314,  0.5067,  0.7086,  0.0426,  0.4785,  0.8554,
         0.0224,  0.5841,  0.1311,  0.5093,  0.7938,  0.2233,  0.9022,
         0.6613,  0.0130,  0.0890,  0.8715,  0.9788,  0.0254,  0.5457,
         0.1134,  0.0338,  0.0938,  0.1242,  0.1734,  0.3899,  0.2990,
         0.0320,  0.8066,  0.0373,  0.4150,  0.6296,  0.4998,  0.0529,
         0.6917,  0.6423,  0.0910,  0.1500,  0.2491,  0.7467,  0.2853,
         0.1388,  0.7639,  0.0248,  0.4001,  0.2948,  0.0831,  0.0525,
         0.6074,  0.8512,  0.0476,  0.7999,  0.3143,  0.6576,  0.9577,
         0.0092,  0.0274,  0.6963,  0.7650,  0.0789,  0.0881,  0.7996,
         0.8578,  0.5260,  0.0302,  0.1061,  0.4963,  0.0066,  0.0158,
         0.3181,  0.6957,  0.1178,  0.1083,  0.0783,  0.9711,  0.1871,
         0.9943,  0.3820,  0.3910,  0.3368,  0.0265,  0.9032,  0.0570,
         0.5533,  0.3186,  0.7279,  0.4999,  0.0061,  0.9213,  0.9391,
         0.8475,  0.0548,  0.3795,  0.0203,  0.8516,  0.0791,  0.9886,
         0.9311,  0.3698,  0.0836,  0.0365,  0.1361,  0.0131,  0.6796,
         0.9051,  0.8700,  0.0242,  0.2323,  0.4418,  0.2165,  0.9512,
         0.2419,  0.8184,  0.7103,  0.6294,  0.0773,  0.0116,  0.5265,
         0.0028,  0.1733,  0.9419,  0.8513,  0.9890,  0.0749,  0.1024,
         0.3716,  0.0861,  0.2309,  0.1901,  0.3746,  0.9377,  0.0381,
         0.8369,  0.6807,  0.7188,  0.0596,  0.5043,  0.8980,  0.0918,
         0.0113,  0.2993,  0.0216,  0.5538,  0.3787,  0.7048,  0.1760,
         0.9691,  0.9589,  0.7742,  0.2477,  0.4411,  0.1221,  0.1645,
         0.0599,  0.3428,  0.0128,  0.6281,  0.0981,  0.0854,  0.5502,
         0.7195,  0.1174,  0.4567,  0.6632,  0.9622,  0.0129,  0.2794,
         0.1219,  0.9986,  0.1300,  0.4376,  0.2334,  0.0543,  0.2089,
         0.2137,  0.8105,  0.7464,  0.0895,  0.0742,  0.0031,  0.4977,
         0.9052,  0.3324,  0.9398,  0.9602,  0.7152,  0.9702,  0.1676,
         0.6719,  0.0491,  0.0874,  0.5823,  0.9257,  0.1365,  0.5372,
         0.8597,  0.9128,  0.1667,  0.0197,  0.9596,  0.9870,  0.8332,
         0.1065,  0.7078,  0.0653,  0.7582,  0.4956,  0.5352,  0.9870,
         0.0029,  0.9536,  0.0025,  0.0122,  0.0477,  0.9610,  0.6569,
         0.1823,  0.0566,  0.9040,  0.6379,  0.2148,  0.6729,  0.1792,
         0.3934,  0.7708,  0.8702,  0.9857,  0.0323,  0.2447,  0.5829,
         0.1189], device='cuda:0')
tensor(0.4235, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2218,  0.0343,  0.0870,  0.4066,  0.4174,  0.1416,  0.8220,
         0.0088,  0.7337,  0.9150,  0.6611,  0.2470,  0.1270,  0.6542,
         0.2851,  0.0778,  0.2971,  0.1609,  0.9245,  0.4462,  0.7217,
         0.0371,  0.3356,  0.0287,  0.0010,  0.5645,  0.1668,  0.7328,
         0.0510,  0.0296,  0.0980,  0.5412,  0.8800,  0.8767,  0.5519,
         0.0245,  0.7106,  0.6889,  0.2432,  0.3653,  0.6954,  0.9982,
         0.6120,  0.5744,  0.2174,  0.5061,  0.7155,  0.3792,  0.0599,
         0.7900,  0.1965,  0.0440,  0.0567,  0.0621,  0.3036,  0.2878,
         0.8587,  0.4119,  0.5060,  0.9326,  0.2025,  0.1641,  0.0493,
         0.7822,  0.7030,  0.8603,  0.8704,  0.5663,  0.9830,  0.8454,
         0.0337,  0.1062,  0.0358,  0.3426,  0.0475,  0.3766,  0.3748,
         0.0142,  0.4058,  0.0977,  0.0066,  0.0956,  0.8507,  0.0079,
         0.7673,  0.6933,  0.1946,  0.6698,  0.9182,  0.7632,  0.7746,
         0.1845,  0.3175,  0.2488,  0.0400,  0.5848,  0.3689,  0.9386,
         0.8342,  0.0989,  0.1519,  0.3771,  0.9318,  0.0096,  0.5006,
         0.8132,  0.0954,  0.0415,  0.7187,  0.0228,  0.9673,  0.4643,
         0.3104,  0.0268,  0.7131,  0.1071,  0.5213,  0.0673,  0.1273,
         0.2498,  0.9280,  0.0030,  0.7221,  0.0490,  0.0419,  0.2725,
         0.8553,  0.2012,  0.8623,  0.1499,  0.5459,  0.8206,  0.4271,
         0.1376,  0.7757,  0.1480,  0.2339,  0.8340,  0.0555,  0.8829,
         0.1663,  0.1422,  0.6333,  0.7407,  0.0523,  0.3493,  0.6828,
         0.0974,  0.2547,  0.2793,  0.3627,  0.1335,  0.0812,  0.9851,
         0.0714,  0.5462,  0.9822,  0.4461,  0.2078,  0.0219,  0.0718,
         0.6650,  0.2363,  0.5468,  0.7408,  0.0262,  0.4882,  0.1623,
         0.8127,  0.3440,  0.5800,  0.5639,  0.8124,  0.1350,  0.1401,
         0.4281,  0.6317,  0.0735,  0.0727,  0.7931,  0.3852,  0.3408,
         0.2912,  0.1390,  0.8994,  0.7872,  0.7723,  0.5109,  0.3053,
         0.9775,  0.0129,  0.4585,  0.5829,  0.0394,  0.8673,  0.9573,
         0.5438,  0.0830,  0.6186,  0.1595,  0.6767,  0.9361,  0.2132,
         0.0540,  0.0300,  0.7200,  0.0863,  0.1340,  0.4332,  0.9609,
         0.9645,  0.2475,  0.6319,  0.7210,  0.6975,  0.8298,  0.1223,
         0.8630,  0.5207,  0.0874,  0.1570,  0.0046,  0.3415,  0.0823,
         0.1432,  0.7101,  0.3085,  0.9261,  0.3262,  0.7878,  0.8742,
         0.7110,  0.0212,  0.6879,  0.0322,  0.8847,  0.5409,  0.8521,
         0.8131,  0.2122,  0.6940,  0.1752,  0.0122,  0.7549,  0.4004,
         0.8311,  0.1979,  0.6493,  0.7824,  0.6761,  0.1475,  0.5063,
         0.1000,  0.6303,  0.9008,  0.7676,  0.2432,  0.8403,  0.8451,
         0.0296,  0.6136,  0.8021,  0.1056,  0.0157,  0.6777,  0.4302,
         0.5420,  0.7056,  0.8292,  0.1944,  0.8128,  0.2046,  0.0824,
         0.1121,  0.2076,  0.1758,  0.8026,  0.2011,  0.1410,  0.9165,
         0.7177,  0.6757,  0.6310,  0.8807,  0.0094,  0.2580,  0.6195,
         0.5860,  0.9628,  0.5930,  0.3757,  0.0636,  0.8028,  0.0477,
         0.5881,  0.1249,  0.9553,  0.0225,  0.1314,  0.5328,  0.7630,
         0.9510,  0.8381,  0.8502,  0.8186,  0.2529,  0.1028,  0.2529,
         0.6100,  0.5788,  0.1529,  0.3086,  0.2487,  0.8736,  0.0052,
         0.9497,  0.1037,  0.9428,  0.4155,  0.0638,  0.0170,  0.6435,
         0.3773,  0.3091,  0.3239,  0.6984,  0.1527,  0.0207,  0.5543,
         0.2526,  0.9709,  0.1120,  0.9964,  0.9913,  0.6116,  0.9960,
         0.8792,  0.7711,  0.0574,  0.8886,  0.9810,  0.8471,  0.6884,
         0.5290,  0.5771,  0.0075,  0.8353,  0.2902,  0.3036,  0.8113,
         0.6084,  0.2639,  0.7079,  0.9673,  0.5636,  0.4401,  0.7024,
         0.4985,  0.0416,  0.9633,  0.1977,  0.1640,  0.0677,  0.8024,
         0.6954,  0.0332,  0.2727,  0.9096,  0.9731,  0.6963,  0.5616,
         0.8580,  0.6874,  0.6030,  0.6017,  0.2610,  0.3397,  0.6374,
         0.2269,  0.0124,  0.1753,  0.5947,  0.4419,  0.0119,  0.8981,
         0.0134,  0.1218,  0.9291,  0.3937,  0.5982,  0.2123,  0.6520,
         0.0524,  0.1158,  0.2866,  0.2005,  0.2174,  0.0147,  0.7997,
         0.6815,  0.4311,  0.8848,  0.1586,  0.1887,  0.5537,  0.9230,
         0.0557,  0.3845,  0.8004,  0.2265,  0.0114,  0.0601,  0.7735,
         0.8563,  0.4813,  0.2148,  0.0392,  0.9250,  0.2199,  0.0323,
         0.1215,  0.0171,  0.8665,  0.6404,  0.8860,  0.8239,  0.0031,
         0.0342,  0.3884,  0.0662,  0.0928,  0.1655,  0.0091,  0.0300,
         0.7393,  0.3919,  0.8762,  0.6277,  0.1434,  0.0657,  0.2355,
         0.0143,  0.4164,  0.0329,  0.1326,  0.7559,  0.9577,  0.2257,
         0.7892,  0.7598,  0.0166,  0.0379,  0.7417,  0.0792,  0.1654,
         0.0822,  0.4400,  0.9502,  0.9120,  0.0155,  0.8584,  0.7046,
         0.0237,  0.3776,  0.9856,  0.3482,  0.9874,  0.8480,  0.8787,
         0.0054,  0.8236,  0.3905,  0.7465,  0.8236,  0.7223,  0.8019,
         0.0045,  0.9878,  0.0188,  0.6967,  0.7938,  0.4897,  0.1369,
         0.4228,  0.9031,  0.1940,  0.8978,  0.9673,  0.3751,  0.6885,
         0.0057,  0.8543,  0.4819,  0.2800,  0.8893,  0.1149,  0.0660,
         0.2660,  0.9234,  0.1252,  0.6014,  0.3010,  0.0212,  0.1797,
         0.0657,  0.6191,  0.0338,  0.0132,  0.6417,  0.3186,  0.1572,
         0.9233], device='cuda:0')
tensor(0.3340, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0757,  0.9137,  0.5135,  0.0458,  0.9022,  0.0485,  0.0681,
         0.0421,  0.9933,  0.1301,  0.4459,  0.1822,  0.2201,  0.9014,
         0.6124,  0.1290,  0.9341,  0.9193,  0.3264,  0.2097,  0.5452,
         0.5312,  0.2579,  0.6850,  0.0395,  0.0329,  0.6429,  0.2757,
         0.3345,  0.8208,  0.5653,  0.8529,  0.9354,  0.8082,  0.0301,
         0.3215,  0.5630,  0.2587,  0.1471,  0.7604,  0.2061,  0.1278,
         0.5384,  0.0887,  0.9540,  0.1133,  0.6695,  0.1203,  0.9100,
         0.3157,  0.9679,  0.4373,  0.6551,  0.1409,  0.5447,  0.0346,
         0.9126,  0.2268,  0.8231,  0.5617,  0.8890,  0.8295,  0.7831,
         0.9115,  0.9261,  0.9315,  0.2884,  0.6165,  0.8268,  0.9181,
         0.0140,  0.8909,  0.8037,  0.5317,  0.8836,  0.1921,  0.0297,
         0.1135,  0.2047,  0.7850,  0.4271,  0.1301,  0.8751,  0.3707,
         0.1749,  0.8205,  0.8836,  0.1460,  0.9323,  0.8489,  0.0535,
         0.3843,  0.2361,  0.5181,  0.1920,  0.6763,  0.3117,  0.5945,
         0.6471,  0.7422,  0.8924,  0.9469,  0.9052,  0.7516,  0.9437,
         0.9477,  0.8547,  0.4072,  0.9037,  0.0464,  0.8356,  0.0322,
         0.1512,  0.8574,  0.5613,  0.0970,  0.7212,  0.3394,  0.1585,
         0.1852,  0.9814,  0.8866,  0.7944,  0.2857,  0.8507,  0.4248,
         0.7502,  0.0287,  0.7851,  0.0903,  0.3705,  0.1173,  0.1919,
         0.0867,  0.8752,  0.8966,  0.0948,  0.8496,  0.1736,  0.7650,
         0.3918,  0.8018,  0.3094,  0.5313,  0.5639,  0.3106,  0.7290,
         0.9191,  0.1870,  0.4224,  0.5605,  0.7974,  0.1380,  0.6151,
         0.7762,  0.1652,  0.1852,  0.0253,  0.9268,  0.7013,  0.0055,
         0.0665,  0.1927,  0.5968,  0.0664,  0.0376,  0.8121,  0.2613,
         0.9931,  0.6927,  0.2683,  0.2350,  0.5977,  0.1047,  0.3981,
         0.9961,  0.6720,  0.8882,  0.3932,  0.4961,  0.1947,  0.8646,
         0.8712,  0.8153,  0.6345,  0.5768,  0.0274,  0.1493,  0.0266,
         0.8203,  0.8787,  0.0252,  0.5504,  0.9517,  0.0324,  0.7028,
         0.2113,  0.2907,  0.0563,  0.7021,  0.4364,  0.8250,  0.1273,
         0.9796,  0.8255,  0.0129,  0.9483,  0.3256,  0.9327,  0.1264,
         0.5816,  0.5206,  0.4532,  0.3264,  0.0720,  0.3724,  0.8136,
         0.4253,  0.4623,  0.8837,  0.5459,  0.8528,  0.8104,  0.6799,
         0.0832,  0.9270,  0.7933,  0.1761,  0.1313,  0.7900,  0.9932,
         0.8461,  0.0875,  0.8488,  0.8504,  0.7684,  0.6416,  0.2562,
         0.7613,  0.7913,  0.8626,  0.8520,  0.8912,  0.9966,  0.0589,
         0.0532,  0.2869,  0.9929,  0.8841,  0.9960,  0.8292,  0.5484,
         0.2887,  0.6826,  0.6470,  0.9164,  0.9149,  0.4857,  0.8782,
         0.9126,  0.9525,  0.2571,  0.3460,  0.3739,  0.9305,  0.1038,
         0.1136,  0.9679,  0.7022,  0.9368,  0.8566,  0.7886,  0.3024,
         0.7081,  0.7730,  0.8746,  0.8783,  0.3881,  0.7381,  0.6137,
         0.1459,  0.6080,  0.9912,  0.8461,  0.1209,  0.8698,  0.9536,
         0.9501,  0.7781,  0.8602,  0.2115,  0.2229,  0.1185,  0.1385,
         0.9697,  0.9187,  0.1061,  0.4958,  0.6060,  0.5335,  0.1867,
         0.0488,  0.9434,  0.0260,  0.0364,  0.7864,  0.3013,  0.9871,
         0.1373,  0.8315,  0.4813,  0.5807,  0.0340,  0.1198,  0.2566,
         0.1070,  0.5022,  0.6649,  0.7210,  0.8396,  0.5429,  0.7382,
         0.6274,  0.6284,  0.2274,  0.2414,  0.0589,  0.0050,  0.5376,
         0.1432,  0.4966,  0.7919,  0.2974,  0.4621,  0.8636,  0.5605,
         0.2661,  0.2734,  0.0278,  0.0294,  0.6276,  0.3675,  0.1145,
         0.4764,  0.6984,  0.9390,  0.1597,  0.0982,  0.4105,  0.7672,
         0.2745,  0.0231,  0.2720,  0.2020,  0.1732,  0.7224,  0.3504,
         0.9280,  0.2239,  0.1384,  0.2713,  0.8580,  0.7539,  0.4907,
         0.7682,  0.2000,  0.0790,  0.4762,  0.2565,  0.7947,  0.2779,
         0.0509,  0.1353,  0.0689,  0.9132,  0.6399,  0.4432,  0.8841,
         0.7035,  0.1842,  0.1373,  0.0027,  0.0317,  0.4531,  0.0777,
         0.1426,  0.8717,  0.3142,  0.2230,  0.2010,  0.4230,  0.3824,
         0.2075,  0.6323,  0.8566,  0.1760,  0.1004,  0.1050,  0.0273,
         0.9226,  0.7553,  0.4868,  0.9735,  0.1200,  0.0248,  0.7923,
         0.6888,  0.5262,  0.6961,  0.1023,  0.2000,  0.6478,  0.7890,
         0.2379,  0.2957,  0.4361,  0.1565,  0.9766,  0.1551,  0.9636,
         0.8424,  0.9262,  0.1315,  0.9254,  0.9586,  0.5002,  0.9481,
         0.7025,  0.0761,  0.2074,  0.1955,  0.1820,  0.0648,  0.9130,
         0.7597,  0.8110,  0.3295,  0.7464,  0.2275,  0.9034,  0.2045,
         0.6723,  0.3546,  0.8158,  0.6226,  0.9258,  0.0329,  0.9154,
         0.7341,  0.1468,  0.5785,  0.5960,  0.9106,  0.0857,  0.1314,
         0.1325,  0.9250,  0.8464,  0.0295,  0.9149,  0.2010,  0.1429,
         0.4250,  0.0061,  0.9410,  0.0313,  0.9003,  0.6188,  0.7643,
         0.0653,  0.4533,  0.5718,  0.8336,  0.6431,  0.9949,  0.1018,
         0.1679,  0.1433,  0.2477,  0.9896,  0.0860,  0.2458,  0.8496,
         0.6618,  0.5552,  0.6062,  0.3217,  0.0105,  0.0073,  0.9918,
         0.0499,  0.0071,  0.4382,  0.5500,  0.9684,  0.8867,  0.8144,
         0.1405,  0.6957,  0.1778,  0.8168,  0.8551,  0.5334,  0.6328,
         0.7820,  0.6738,  0.8509,  0.5265,  0.9890,  0.0409,  0.6669,
         0.9916], device='cuda:0')
tensor(0.3810, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1911,  0.8717,  0.9528,  0.2706,  0.1109,  0.8433,  0.9855,
         0.4106,  0.9467,  0.7051,  0.8147,  0.2276,  0.1477,  0.7422,
         0.1396,  0.0724,  0.9302,  0.9459,  0.3035,  0.4667,  0.0953,
         0.9938,  0.9974,  0.2997,  0.0905,  0.0322,  0.1225,  0.6767,
         0.8025,  0.8942,  0.0720,  0.2559,  0.3643,  0.9128,  0.4877,
         0.2967,  0.2511,  0.1158,  0.5659,  0.8127,  0.4449,  0.3928,
         0.1226,  0.3954,  0.1886,  0.9331,  0.8177,  0.9909,  0.9263,
         0.0460,  0.5275,  0.3747,  0.7328,  0.0507,  0.1331,  0.2437,
         0.5574,  0.5786,  0.6314,  0.2570,  0.0650,  0.3297,  0.0216,
         0.8382,  0.9797,  0.9119,  0.7740,  0.3674,  0.0248,  0.0163,
         0.5556,  0.8286,  0.0463,  0.1295,  0.9077,  0.0417,  0.5142,
         0.2758,  0.1084,  0.7872,  0.8596,  0.4775,  0.8304,  0.5830,
         0.0200,  0.9380,  0.0090,  0.8218,  0.0382,  0.7489,  0.8942,
         0.9954,  0.2484,  0.5525,  0.0363,  0.3421,  0.5587,  0.6468,
         0.8495,  0.0605,  0.0023,  0.8801,  0.8787,  0.5148,  0.3976,
         0.0830,  0.6104,  0.2326,  0.5549,  0.3525,  0.9199,  0.1861,
         0.0510,  0.2909,  0.4731,  0.0848,  0.7286,  0.3371,  0.6655,
         0.6647,  0.3423,  0.1417,  0.9686,  0.7457,  0.4059,  0.4471,
         0.8644,  0.0316,  0.5833,  0.8470,  0.4055,  0.3555,  0.2616,
         0.0503,  0.4582,  0.1093,  0.6369,  0.8426,  0.1738,  0.0661,
         0.7130,  0.8558,  0.3620,  0.3002,  0.4459,  0.4372,  0.8233,
         0.5364,  0.0295,  0.5244,  0.9603,  0.5961,  0.4865,  0.7859,
         0.0326,  0.6507,  0.0035,  0.6896,  0.3718,  0.9123,  0.1787,
         0.7893,  0.4278,  0.9745,  0.0782,  0.0156,  0.2725,  0.5608,
         0.4066,  0.9952,  0.6910,  0.6768,  0.8791,  0.2180,  0.6841,
         0.0130,  0.2913,  0.4744,  0.1108,  0.7462,  0.0167,  0.6900,
         0.9988,  0.6267,  0.5509,  0.9446,  0.8526,  0.5822,  0.8338,
         0.6551,  0.6619,  0.3825,  0.3702,  0.9035,  0.7534,  0.9955,
         0.0888,  0.1824,  0.4546,  0.7320,  0.9588,  0.1883,  0.9769,
         0.0368,  0.0944,  0.8337,  0.0366,  0.3818,  0.3973,  0.0710,
         0.4133,  0.8154,  0.0323,  0.8935,  0.9012,  0.2839,  0.6655,
         0.3406,  0.0734,  0.8184,  0.8931,  0.3090,  0.7381,  0.9034,
         0.9528,  0.0414,  0.8840,  0.9001,  0.9036,  0.7107,  0.8032,
         0.0452,  0.1033,  0.0190,  0.0507,  0.4664,  0.0223,  0.0452,
         0.7251,  0.1758,  0.1388,  0.2785,  0.9105,  0.0146,  0.6816,
         0.4528,  0.9695,  0.1421,  0.5655,  0.9389,  0.2567,  0.9302,
         0.3824,  0.8122,  0.9834,  0.7109,  0.8554,  0.0428,  0.4414,
         0.9224,  0.7765,  0.3755,  0.2550,  0.1865,  0.8158,  0.0719,
         0.7806,  0.8206,  0.9354,  0.7397,  0.8266,  0.1798,  0.3839,
         0.9574,  0.8213,  0.0182,  0.0880,  0.2461,  0.6556,  0.2077,
         0.0215,  0.7274,  0.6146,  0.5440,  0.9385,  0.7369,  0.5380,
         0.0107,  0.6465,  0.0904,  0.1082,  0.3378,  0.0490,  0.9197,
         0.1706,  0.3634,  0.9797,  0.8683,  0.7959,  0.9323,  0.5979,
         0.6239,  0.1847,  0.8360,  0.9217,  0.8758,  0.9512,  0.6742,
         0.8391,  0.0119,  0.6267,  0.7551,  0.9612,  0.3272,  0.8937,
         0.2833,  0.6531,  0.1629,  0.1577,  0.5963,  0.8896,  0.1672,
         0.6624,  0.2118,  0.4189,  0.0303,  0.3200,  0.1463,  0.8556,
         0.8865,  0.3563,  0.6157,  0.8101,  0.2098,  0.1535,  0.0298,
         0.3429,  0.0106,  0.8784,  0.7521,  0.9944,  0.1035,  0.7038,
         0.9588,  0.3258,  0.8367,  0.8084,  0.5816,  0.5122,  0.2505,
         0.8615,  0.3353,  0.8659,  0.9420,  0.0232,  0.7439,  0.6530,
         0.4229,  0.6708,  0.1504,  0.3984,  0.3920,  0.7972,  0.0125,
         0.0833,  0.1901,  0.4806,  0.6000,  0.7103,  0.4697,  0.2452,
         0.2863,  0.1372,  0.2579,  0.8925,  0.9190,  0.8050,  0.0221,
         0.6744,  0.9988,  0.1611,  0.0637,  0.5073,  0.2867,  0.9628,
         0.2759,  0.8442,  0.3231,  0.5213,  0.2879,  0.8759,  0.8972,
         0.2746,  0.7184,  0.2997,  0.8774,  0.0867,  0.4322,  0.7159,
         0.9375,  0.8379,  0.5301,  0.4167,  0.0551,  0.4377,  0.0233,
         0.9223,  0.7306,  0.9607,  0.7864,  0.3261,  0.2933,  0.7820,
         0.1059,  0.7667,  0.9602,  0.2680,  0.6552,  0.9440,  0.0363,
         0.6431,  0.5910,  0.9869,  0.0259,  0.6793,  0.0620,  0.4950,
         0.0428,  0.7256,  0.1404,  0.8781,  0.2910,  0.1140,  0.0709,
         0.3486,  0.3028,  0.3346,  0.9358,  0.5776,  0.2997,  0.8098,
         0.9413,  0.0047,  0.8240,  0.3045,  0.9764,  0.8905,  0.4962,
         0.0320,  0.8909,  0.2537,  0.5330,  0.0707,  0.8243,  0.8409,
         0.7909,  0.6973,  0.7744,  0.1095,  0.0253,  0.8693,  0.4433,
         0.6074,  0.1541,  0.3570,  0.1213,  0.0319,  0.6436,  0.8192,
         0.0528,  0.1348,  0.4535,  0.8630,  0.9675,  0.0537,  0.2351,
         0.0067,  0.9604,  0.4953,  0.6967,  0.2313,  0.0358,  0.0491,
         0.0883,  0.0925,  0.0731,  0.0658,  0.1608,  0.2927,  0.3934,
         0.9772,  0.9947,  0.6077,  0.0922,  0.6139,  0.0172,  0.0045,
         0.0051,  0.0829,  0.7028,  0.1184,  0.7109,  0.4229,  0.0057,
         0.0914,  0.6725,  0.6432,  0.7063,  0.7210,  0.8979,  0.8107,
         0.0516], device='cuda:0')
tensor(0.3581, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8718,  0.8787,  0.9079,  0.8339,  0.2437,  0.6633,  0.0072,
         0.1026,  0.1148,  0.9904,  0.9057,  0.2325,  0.8458,  0.0321,
         0.3858,  0.7816,  0.6552,  0.8925,  0.8962,  0.3360,  0.8676,
         0.1499,  0.9045,  0.0295,  0.7305,  0.7008,  0.9134,  0.6296,
         0.0808,  0.6218,  0.9809,  0.6523,  0.5690,  0.8006,  0.8498,
         0.7082,  0.1106,  0.1554,  0.4771,  0.3432,  0.6322,  0.0724,
         0.0187,  0.7902,  0.0405,  0.3897,  0.5668,  0.9195,  0.9701,
         0.0045,  0.5368,  0.0868,  0.7444,  0.9770,  0.0542,  0.0223,
         0.2753,  0.7818,  0.2351,  0.0589,  0.0665,  0.8990,  0.2651,
         0.4724,  0.4253,  0.9769,  0.9900,  0.8552,  0.0340,  0.9689,
         0.1158,  0.0025,  0.8663,  0.9600,  0.9533,  0.8847,  0.4998,
         0.0407,  0.1787,  0.0471,  0.9510,  0.9294,  0.0668,  0.0623,
         0.2038,  0.7708,  0.0092,  0.9497,  0.7373,  0.8663,  0.8392,
         0.7801,  0.4163,  0.8102,  0.6510,  0.0229,  0.2523,  0.9220,
         0.9515,  0.3932,  0.9442,  0.0097,  0.1241,  0.9254,  0.6647,
         0.9779,  0.5707,  0.0580,  0.8263,  0.4468,  0.8519,  0.0530,
         0.0570,  0.2016,  0.5625,  0.1877,  0.8170,  0.2960,  0.9051,
         0.4254,  0.8643,  0.9588,  0.0626,  0.2726,  0.0263,  0.3330,
         0.7980,  0.5794,  0.6427,  0.7355,  0.7891,  0.8519,  0.5695,
         0.7135,  0.8923,  0.8634,  0.7469,  0.0948,  0.2547,  0.9310,
         0.6754,  0.0201,  0.0541,  0.8752,  0.3654,  0.6046,  0.0994,
         0.8121,  0.7708,  0.1776,  0.1584,  0.2017,  0.8258,  0.3703,
         0.0267,  0.8262,  0.8453,  0.2588,  0.8259,  0.7948,  0.1239,
         0.6803,  0.9948,  0.9389,  0.0257,  0.2604,  0.1810,  0.0016,
         0.5187,  0.9116,  0.5913,  0.8395,  0.1079,  0.1923,  0.4556,
         0.0021,  0.3064,  0.0689,  0.2016,  0.1480,  0.8722,  0.0230,
         0.0202,  0.6835,  0.5688,  0.9109,  0.8472,  0.0790,  0.8759,
         0.6202,  0.9442,  0.5923,  0.9203,  0.9799,  0.0296,  0.9448,
         0.0652,  0.1384,  0.0366,  0.1119,  0.0197,  0.6939,  0.9644,
         0.0367,  0.8631,  0.7745,  0.9402,  0.6616,  0.0031,  0.8850,
         0.8189,  0.8327,  0.1524,  0.9532,  0.8376,  0.7690,  0.7173,
         0.1939,  0.7529,  0.1671,  0.0324,  0.9697,  0.8912,  0.8679,
         0.1604,  0.7148,  0.9618,  0.4025,  0.0034,  0.5190,  0.3906,
         0.1206,  0.2987,  0.4391,  0.8694,  0.6014,  0.4801,  0.9767,
         0.2013,  0.7640,  0.7877,  0.8093,  0.9458,  0.7249,  0.8613,
         0.8827,  0.8270,  0.2746,  0.4379,  0.9196,  0.8661,  0.0451,
         0.7738,  0.9737,  0.3713,  0.1559,  0.0241,  0.8064,  0.8632,
         0.7601,  0.9318,  0.2690,  0.2543,  0.8333,  0.0204,  0.1838,
         0.0131,  0.7999,  0.8731,  0.9113,  0.9829,  0.4648,  0.9934,
         0.9364,  0.1960,  0.0423,  0.8332,  0.6406,  0.9266,  0.9692,
         0.2646,  0.9952,  0.1260,  0.8129,  0.7782,  0.8980,  0.6105,
         0.0523,  0.9955,  0.5046,  0.3019,  0.0476,  0.4899,  0.0333,
         0.8812,  0.6958,  0.9899,  0.5846,  0.0042,  0.7664,  0.3216,
         0.7483,  0.9222,  0.0509,  0.0192,  0.6104,  0.9762,  0.9547,
         0.4871,  0.6885,  0.8878,  0.8766,  0.9099,  0.2707,  0.9790,
         0.4811,  0.6308,  0.4492,  0.2008,  0.9147,  0.7044,  0.9487,
         0.6437,  0.4374,  0.0572,  0.6519,  0.0322,  0.8991,  0.9455,
         0.9427,  0.8539,  0.0601,  0.8352,  0.0705,  0.0261,  0.2617,
         0.0410,  0.0660,  0.1062,  0.0436,  0.7720,  0.6270,  0.0646,
         0.5282,  0.9643,  0.0836,  0.0944,  0.1503,  0.2137,  0.9876,
         0.2683,  0.7105,  0.4673,  0.9934,  0.7916,  0.6117,  0.9096,
         0.0551,  0.1775,  0.3673,  0.1539,  0.5679,  0.0883,  0.3435,
         0.0056,  0.7928,  0.4464,  0.9516,  0.5225,  0.1513,  0.1446,
         0.6690,  0.0652,  0.5195,  0.8880,  0.8108,  0.9314,  0.1812,
         0.0934,  0.6077,  0.9082,  0.7338,  0.0366,  0.9677,  0.7415,
         0.9252,  0.1148,  0.0412,  0.7145,  0.1198,  0.4358,  0.9288,
         0.6743,  0.4492,  0.8567,  0.4733,  0.0114,  0.1784,  0.8451,
         0.1108,  0.6068,  0.6022,  0.2724,  0.9181,  0.0305,  0.2340,
         0.9567,  0.0206,  0.0903,  0.7306,  0.1142,  0.6608,  0.9068,
         0.9983,  0.8667,  0.6593,  0.3605,  0.6033,  0.0265,  0.0559,
         0.9300,  0.2978,  0.0405,  0.8260,  0.6022,  0.9481,  0.0807,
         0.7886,  0.2423,  0.0905,  0.5872,  0.0769,  0.9295,  0.0817,
         0.0506,  0.8862,  0.9972,  0.0205,  0.9715,  0.3338,  0.8600,
         0.9409,  0.0131,  0.8933,  0.5621,  0.0817,  0.8658,  0.9538,
         0.7895,  0.0883,  0.7017,  0.3620,  0.1516,  0.5442,  0.7943,
         0.7833,  0.4394,  0.9530,  0.7231,  0.0993,  0.0566,  0.8244,
         0.2300,  0.6835,  0.0392,  0.6724,  0.9202,  0.7105,  0.0107,
         0.8107,  0.1644,  0.9072,  0.7879,  0.3249,  0.3292,  0.6373,
         0.9619,  0.0221,  0.8828,  0.9027,  0.8161,  0.7761,  0.9583,
         0.9160,  0.9556,  0.8588,  0.3115,  0.5213,  0.7991,  0.0859,
         0.8968,  0.0871,  0.5158,  0.2088,  0.5890,  0.9993,  0.9894,
         0.9170,  0.7385,  0.1154,  0.0477,  0.4456,  0.9134,  0.1956,
         0.7113,  0.7235,  0.6655,  0.9029,  0.7976,  0.8762,  0.7022,
         0.7076], device='cuda:0')
tensor(0.4077, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0484,  0.9716,  0.1110,  0.7888,  0.2187,  0.1294,  0.9393,
         0.0067,  0.9376,  0.0471,  0.2564,  0.9148,  0.0117,  0.0418,
         0.8671,  0.8850,  0.1905,  0.9365,  0.8724,  0.9187,  0.1952,
         0.0432,  0.0182,  0.9591,  0.7056,  0.9657,  0.4961,  0.6445,
         0.0168,  0.0425,  0.0261,  0.1006,  0.0157,  0.1992,  0.7634,
         0.0039,  0.0123,  0.0589,  0.1690,  0.0030,  0.9812,  0.0071,
         0.1701,  0.0960,  0.8327,  0.8793,  0.0724,  0.9362,  0.2162,
         0.1124,  0.0096,  0.9195,  0.4403,  0.6830,  0.0236,  0.0180,
         0.1562,  0.6145,  0.6965,  0.9801,  0.1155,  0.0441,  0.5620,
         0.1007,  0.4420,  0.0285,  0.9350,  0.9389,  0.9669,  0.7170,
         0.9698,  0.0045,  0.7266,  0.0083,  0.3267,  0.3244,  0.8974,
         0.0127,  0.2462,  0.0237,  0.3932,  0.8891,  0.0037,  0.9337,
         0.8271,  0.0449,  0.9502,  0.8440,  0.9836,  0.9286,  0.0388,
         0.6770,  0.0197,  0.0025,  0.9411,  0.5578,  0.8558,  0.0504,
         0.4503,  0.8487,  0.0014,  0.0464,  0.4797,  0.8954,  0.0852,
         0.6946,  0.0091,  0.0210,  0.0631,  0.1082,  0.9251,  0.5835,
         0.1639,  0.4798,  0.6239,  0.9256,  0.3330,  0.8344,  0.1640,
         0.8498,  0.2038,  0.0124,  0.7038,  0.0106,  0.8443,  0.0128,
         0.2196,  0.2778,  0.8216,  0.9171,  0.0658,  0.9062,  0.2081,
         0.8922,  0.0540,  0.8765,  0.0449,  0.0758,  0.9514,  0.0036,
         0.7193,  0.2264,  0.3361,  0.2723,  0.9733,  0.1473,  0.0086,
         0.0591,  0.0765,  0.9727,  0.4427,  0.9677,  0.6365,  0.0881,
         0.7180,  0.0791,  0.6704,  0.0474,  0.2625,  0.0213,  0.9047,
         0.1108,  0.8058,  0.1972,  0.0343,  0.7674,  0.3295,  0.1535,
         0.1147,  0.9658,  0.0417,  0.2361,  0.5141,  0.0471,  0.0118,
         0.9829,  0.8979,  0.1729,  0.9042,  0.0878,  0.7795,  0.8044,
         0.0338,  0.0262,  0.6985,  0.1003,  0.0039,  0.5897,  0.8311,
         0.9889,  0.9932,  0.1090,  0.0004,  0.5223,  0.0239,  0.6527,
         0.9161,  0.0057,  0.1175,  0.7487,  0.0340,  0.0434,  0.8996,
         0.5529,  0.9980,  0.8510,  0.9826,  0.0202,  0.0153,  0.7989,
         0.7407,  0.0045,  0.9644,  0.8149,  0.8879,  0.7795,  0.0017,
         0.9962,  0.9248,  0.3028,  0.0353,  0.0736,  0.0208,  0.0702,
         0.3695,  0.9834,  0.7949,  0.8593,  0.9541,  0.9993,  0.0749,
         0.0062,  0.7633,  0.0653,  0.7973,  0.8529,  0.9470,  0.0030,
         0.5915,  0.8958,  0.3386,  0.1887,  0.5692,  0.6318,  0.0776,
         0.0163,  0.1617,  0.7291,  0.1230,  0.0451,  0.6775,  0.6491,
         0.0214,  0.0517,  0.9575,  0.0168,  0.8764,  0.0022,  0.9674,
         0.9513,  0.8775,  0.1298,  0.7215,  0.9428,  0.5645,  0.8696,
         0.0156,  0.0717,  0.5064,  0.0432,  0.9125,  0.3013,  0.0173,
         0.7320,  0.1070,  0.0285,  0.1647,  0.0105,  0.2589,  0.9373,
         0.7319,  0.0526,  0.9391,  0.2486,  0.8227,  0.5738,  0.5103,
         0.9746,  0.0373,  0.7636,  0.6311,  0.9266,  0.0868,  0.1487,
         0.0586,  0.0160,  0.4459,  0.9846,  0.0959,  0.0786,  0.5792,
         0.0622,  0.9219,  0.0717,  0.0840,  0.0352,  0.0777,  0.3656,
         0.0060,  0.9399,  0.4541,  0.8474,  0.9091,  0.0214,  0.5431,
         0.0537,  0.8321,  0.8938,  0.0143,  0.3043,  0.8887,  0.0448,
         0.9107,  0.9276,  0.0715,  0.9256,  0.8903,  0.9603,  0.7497,
         0.8974,  0.9988,  0.8596,  0.8190,  0.9975,  0.7283,  0.8722,
         0.8851,  0.3561,  0.1021,  0.9084,  0.0043,  0.9926,  0.7689,
         0.0900,  0.0383,  0.8224,  0.9973,  0.8997,  0.9514,  0.0026,
         0.5135,  0.0025,  0.8112,  0.9259,  0.9274,  0.9309,  0.0916,
         0.0334,  0.6587,  0.0233,  0.8470,  0.8037,  0.1620,  0.0031,
         0.0436,  0.7154,  0.5103,  0.8841,  0.1962,  0.7371,  0.0704,
         0.9013,  0.9555,  0.0474,  0.0020,  0.4263,  0.0747,  0.9368,
         0.8450,  0.7848,  0.8442,  0.0160,  0.3547,  0.1876,  0.0499,
         0.9571,  0.0622,  0.6197,  0.8655,  0.0721,  0.0305,  0.5228,
         0.9515,  0.9875,  0.2345,  0.9400,  0.7803,  0.9970,  0.1850,
         0.0267,  0.9076,  0.9422,  0.8959,  0.9034,  0.0329,  0.0070,
         0.8484,  0.2954,  0.8249,  0.0676,  0.8109,  0.0327,  0.0889,
         0.9711,  0.8684,  0.2493,  0.0545,  0.1096,  0.9006,  0.2056,
         0.3398,  0.6680,  0.0033,  0.8699,  0.9988,  0.8320,  0.9232,
         0.9299,  0.9579,  0.0076,  0.9990,  0.9175,  0.9077,  0.1102,
         0.0115,  0.0121,  0.8535,  0.1016,  0.8737,  0.1257,  0.2593,
         0.7781,  0.9446,  0.7441,  0.0147,  0.0143,  0.0404,  0.9705,
         0.7001,  0.7706,  0.0077,  0.0291,  0.0968,  0.8900,  0.4687,
         0.4655,  0.9748,  0.9268,  0.9563,  0.0557,  0.9231,  0.6714,
         0.8790,  0.1255,  0.9963,  0.1171,  0.0171,  0.9000,  0.6422,
         0.1254,  0.6632,  0.6096,  0.7126,  0.7333,  0.0469,  0.8459,
         0.8636,  0.3713,  0.8898,  0.0535,  0.2951,  0.8074,  0.8585,
         0.1367,  0.8744,  0.9074,  0.9001,  0.2096,  0.0917,  0.8107,
         0.4707,  0.1052,  0.1920,  0.3039,  0.9820,  0.0058,  0.8187,
         0.6363,  0.9802,  0.9053,  0.1946,  0.7145,  0.0035,  0.0334,
         0.0435,  0.9827,  0.8891,  0.1083,  0.9801,  0.0868,  0.5655,
         0.7911], device='cuda:0')
tensor(0.3309, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0133,  0.6848,  0.8258,  0.6236,  0.1715,  0.9679,  0.9028,
         0.1802,  0.0531,  0.2380,  0.9150,  0.8753,  0.8591,  0.9168,
         0.7786,  0.9526,  0.9677,  0.0048,  0.5447,  0.5254,  0.0051,
         0.9561,  0.9004,  0.7455,  0.0570,  0.0595,  0.0132,  0.8089,
         0.5115,  0.8988,  0.0150,  0.9608,  0.9421,  0.1919,  0.8869,
         0.9508,  0.9800,  0.0266,  0.0095,  0.0193,  0.0139,  0.2684,
         0.1524,  0.0061,  0.9623,  0.8853,  0.8744,  0.7205,  0.9975,
         0.6754,  0.8726,  0.1417,  0.8625,  0.9276,  0.0345,  0.8805,
         0.8192,  0.8110,  0.9676,  0.0168,  0.9587,  0.0245,  0.0465,
         0.0056,  0.7286,  0.7954,  0.0122,  0.5717,  0.7710,  0.0226,
         0.8188,  0.0338,  0.0081,  0.0700,  0.0907,  0.0535,  0.0109,
         0.6110,  0.7732,  0.0910,  0.9171,  0.7678,  0.9526,  0.0070,
         0.9517,  0.9215,  0.4129,  0.0250,  0.0818,  0.9122,  0.0010,
         0.0007,  0.0536,  0.9328,  0.1101,  0.2686,  0.8780,  0.7229,
         0.8274,  0.0350,  0.0519,  0.9551,  0.9187,  0.0714,  0.8258,
         0.0077,  0.7419,  0.9158,  0.0090,  0.9569,  0.9875,  0.9367,
         0.0395,  0.0148,  0.0340,  0.9061,  0.8832,  0.9972,  0.9090,
         0.0021,  0.1198,  0.8798,  0.7090,  0.0400,  0.9240,  0.0145,
         0.7285,  0.9333,  0.9715,  0.1024,  0.9963,  0.9421,  0.6879,
         0.9617,  0.5115,  0.0020,  0.1070,  0.0986,  0.9588,  0.0104,
         0.0205,  0.1333,  0.0822,  0.0816,  0.5960,  0.0095,  0.0189,
         0.4270,  0.5895,  0.0329,  0.8819,  0.9733,  0.9560,  0.7057,
         0.9239,  0.7579,  0.0247,  0.9102,  0.9206,  0.0827,  0.9992,
         0.9341,  0.0081,  0.0172,  0.4694,  0.4247,  0.9224,  0.7950,
         0.6409,  0.0055,  0.9236,  0.1490,  0.8821,  0.0684,  0.4131,
         0.1957,  0.0883,  0.0007,  0.9708,  0.7234,  0.0101,  0.0650,
         0.9177,  0.0725,  0.5115,  0.9694,  0.0624,  0.9473,  0.0313,
         0.0013,  0.1018,  0.1190,  0.9319,  0.9061,  0.4107,  0.8254,
         0.0068,  0.0281,  0.5464,  0.6120,  0.0307,  0.0382,  0.8049,
         0.0051,  0.7576,  0.8105,  0.0535,  0.8868,  0.0412,  0.1374,
         0.8965,  0.0079,  0.0335,  0.3724,  0.9584,  0.7292,  0.0259,
         0.1414,  0.0082,  0.0455,  0.7978,  0.0274,  0.0165,  0.0219,
         0.6283,  0.0062,  0.8360,  0.0146,  0.2649,  0.6746,  0.9035,
         0.0058,  0.0192,  0.0913,  0.9874,  0.0302,  0.6610,  0.9729,
         0.9045,  0.0609,  0.7784,  0.0081,  0.8605,  0.3213,  0.9115,
         0.2569,  0.0330,  0.4868,  0.0490,  0.2545,  0.0326,  0.9845,
         0.9622,  0.1806,  0.1061,  0.0085,  0.7966,  0.7022,  0.0607,
         0.5883,  0.0545,  0.9429,  0.7798,  0.0280,  0.3966,  0.8522,
         0.3918,  0.9743,  0.6780,  0.0630,  0.0213,  0.0219,  0.0068,
         0.0240,  0.0136,  0.3895,  0.0053,  0.0335,  0.0502,  0.0057,
         0.9382,  0.9522,  0.0184,  0.6851,  0.6800,  0.0962,  0.5352,
         0.9461,  0.0245,  0.0613,  0.1867,  0.9950,  0.8849,  0.9131,
         0.8454,  0.4505,  0.6305,  0.0235,  0.9917,  0.0224,  0.2218,
         0.0896,  0.9304,  0.0053,  0.0166,  0.0071,  0.2044,  0.3358,
         0.0659,  0.0137,  0.7930,  0.7328,  0.7141,  0.0188,  0.4559,
         0.9079,  0.3244,  0.2132,  0.1332,  0.9967,  0.9398,  0.9097,
         0.8584,  0.0246,  0.8798,  0.0196,  0.9318,  0.0179,  0.0520,
         0.9775,  0.5101,  0.9179,  0.9022,  0.0107,  0.4212,  0.0213,
         0.0302,  0.6423,  0.0089,  0.9705,  0.7638,  0.0997,  0.9171,
         0.7515,  0.3365,  0.9606,  0.0627,  0.7718,  0.1010,  0.1310,
         0.8507,  0.0703,  0.0691,  0.9920,  0.3784,  0.1007,  0.1115,
         0.9525,  0.7860,  0.0558,  0.9514,  0.8312,  0.1457,  0.6056,
         0.8130,  0.0397,  0.8763,  0.8655,  0.0013,  0.0031,  0.0303,
         0.0273,  0.9083,  0.8372,  0.9241,  0.9226,  0.9325,  0.8201,
         0.0859,  0.9165,  0.7969,  0.3786,  0.3292,  0.0431,  0.1457,
         0.0041,  0.7458,  0.3275,  0.0191,  0.0070,  0.8305,  0.8902,
         0.0296,  0.6484,  0.8901,  0.9482,  0.9829,  0.7542,  0.1012,
         0.0278,  0.8705,  0.3694,  0.0805,  0.0140,  0.9115,  0.0024,
         0.9472,  0.0154,  0.0421,  0.9668,  0.0306,  0.0168,  0.0102,
         0.9347,  0.0122,  0.3225,  0.0083,  0.0537,  0.9936,  0.0354,
         0.0235,  0.9198,  0.0530,  0.0090,  0.5562,  0.0291,  0.9214,
         0.0194,  0.8087,  0.0131,  0.0233,  0.3552,  0.9375,  0.0695,
         0.9389,  0.8664,  0.0021,  0.0768,  0.6859,  0.0281,  0.2719,
         0.1041,  0.0066,  0.9610,  0.9982,  0.5028,  0.1256,  0.2812,
         0.9314,  0.0082,  0.9745,  0.0267,  0.9053,  0.9596,  0.9117,
         0.9503,  0.9292,  0.0268,  0.8370,  0.9826,  0.0157,  0.9243,
         0.8797,  0.1848,  0.2410,  0.9752,  0.9205,  0.0511,  0.9144,
         0.0316,  0.0245,  0.7604,  0.9803,  0.2591,  0.0485,  0.0223,
         0.0530,  0.9987,  0.8872,  0.0351,  0.8418,  0.0946,  0.9637,
         0.1081,  0.9451,  0.5371,  0.8132,  0.9652,  0.9983,  0.7496,
         0.0066,  0.9727,  0.9715,  0.0265,  0.0255,  0.7769,  0.0285,
         0.0017,  0.0927,  0.0552,  0.0236,  0.4743,  0.0431,  0.9093,
         0.9080,  0.1342,  0.0564,  0.0184,  0.6740,  0.0957,  0.0241,
         0.0083], device='cuda:0')
tensor(0.3376, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5961,  0.1291,  0.1304,  0.8333,  0.7875,  0.0029,  0.0152,
         0.0672,  0.0241,  0.0306,  0.8647,  0.8677,  0.9422,  0.0221,
         0.9906,  0.9369,  0.9548,  0.0113,  0.9681,  0.1751,  0.9214,
         0.0878,  0.9483,  0.8162,  0.7391,  0.3008,  0.9985,  0.7565,
         0.5586,  0.9142,  0.5786,  0.9476,  0.9348,  0.9382,  0.9604,
         0.0647,  0.8159,  0.9668,  0.0250,  0.0662,  0.1784,  0.0451,
         0.8974,  0.9093,  0.8148,  0.1853,  0.8808,  0.0784,  0.9105,
         0.0715,  0.9769,  0.9356,  0.9708,  0.9019,  0.9930,  0.0275,
         0.8914,  0.3446,  0.9985,  0.0981,  0.9851,  0.0361,  0.8523,
         0.0888,  0.9332,  0.9804,  0.4770,  0.9832,  0.3240,  0.0524,
         0.1669,  0.7955,  0.3162,  0.2563,  0.7257,  0.3854,  0.9358,
         0.8173,  0.9309,  0.2062,  0.0080,  0.0286,  0.0330,  0.3233,
         0.0680,  0.6582,  0.9123,  0.1018,  0.6270,  0.8085,  0.4705,
         0.4065,  0.3914,  0.0528,  0.2640,  0.9040,  0.9163,  0.8002,
         0.3975,  0.9245,  0.8072,  0.7501,  0.0587,  0.9971,  0.8512,
         0.7703,  0.8320,  0.2527,  0.8644,  0.0122,  0.8533,  0.3770,
         0.3109,  0.9773,  0.7610,  0.9238,  0.2598,  0.1040,  0.4368,
         0.0215,  0.1569,  0.9533,  0.4135,  0.7844,  0.8903,  0.8714,
         0.9939,  0.0340,  0.8119,  0.9199,  0.9901,  0.4289,  0.0863,
         0.0349,  0.8427,  0.9456,  0.6870,  0.0478,  0.6550,  0.0240,
         0.1376,  0.9573,  0.0266,  0.4492,  0.9692,  0.0792,  0.0121,
         0.1735,  0.7678,  0.0132,  0.0739,  0.8122,  0.8327,  0.8709,
         0.8478,  0.9461,  0.9436,  0.8484,  0.7032,  0.0202,  0.6578,
         0.0656,  0.7982,  0.3742,  0.2482,  0.8941,  0.0690,  0.9644,
         0.9202,  0.8406,  0.9214,  0.0470,  0.1086,  0.6402,  0.8462,
         0.9130,  0.9485,  0.9539,  0.7839,  0.1398,  0.9238,  0.8571,
         0.1864,  0.0403,  0.8995,  0.0431,  0.8842,  0.1414,  0.2448,
         0.4264,  0.8124,  0.0619,  0.7977,  0.2967,  0.8816,  0.9601,
         0.0751,  0.0169,  0.9040,  0.8946,  0.8741,  0.9045,  0.8938,
         0.8388,  0.1108,  0.9433,  0.0337,  0.9082,  0.8739,  0.9259,
         0.2118,  0.0614,  0.8219,  0.8117,  0.5345,  0.0958,  0.6907,
         0.8776,  0.7859,  0.9177,  0.8271,  0.0333,  0.8450,  0.9260,
         0.7967,  0.0284,  0.0104,  0.0646,  0.7308,  0.0230,  0.9270,
         0.0656,  0.0063,  0.8065,  0.5552,  0.9315,  0.8841,  0.2426,
         0.9507,  0.0463,  0.6786,  0.8742,  0.7927,  0.9856,  0.8996,
         0.8890,  0.9091,  0.9392,  0.7488,  0.7538,  0.9969,  0.0257,
         0.9578,  0.9675,  0.8704,  0.0126,  0.9961,  0.7206,  0.0423,
         0.2535,  0.0171,  0.8651,  0.9973,  0.0303,  0.9683,  0.8705,
         0.9637,  0.9621,  0.8728,  0.9512,  0.2094,  0.4906,  0.9629,
         0.9852,  0.3671,  0.0748,  0.9918,  0.9490,  0.3770,  0.9276,
         0.8906,  0.1390,  0.8857,  0.9208,  0.9884,  0.0932,  0.9831,
         0.9892,  0.2360,  0.0662,  0.9314,  0.9534,  0.9430,  0.8810,
         0.9919,  0.9114,  0.9947,  0.9179,  0.0507,  0.7532,  0.9464,
         0.9630,  0.9353,  0.3595,  0.0892,  0.9609,  0.9548,  0.4703,
         0.0589,  0.0230,  0.9210,  0.0661,  0.7551,  0.9575,  0.9443,
         0.7416,  0.8421,  0.9470,  0.7037,  0.1833,  0.7624,  0.1309,
         0.7039,  0.9321,  0.9749,  0.4057,  0.2961,  0.8018,  0.0789,
         0.9096,  0.8994,  0.5913,  0.0416,  0.5201,  0.9190,  0.7710,
         0.0291,  0.2100,  0.9948,  0.8621,  0.8907,  0.7560,  0.3483,
         0.0474,  0.9716,  0.9511,  0.0084,  0.6271,  0.2992,  0.8572,
         0.8879,  0.1253,  0.9669,  0.8234,  0.0464,  0.3781,  0.9547,
         0.3119,  0.0058,  0.0251,  0.5422,  0.8599,  0.6482,  0.0149,
         0.0393,  0.0004,  0.3819,  0.1665,  0.1455,  0.9615,  0.8429,
         0.3612,  0.9717,  0.0780,  0.9459,  0.1726,  0.9984,  0.1830,
         0.0061,  0.0264,  0.1754,  0.9334,  0.8258,  0.1240,  0.8339,
         0.9435,  0.8624,  0.0170,  0.9620,  0.8320,  0.0013,  0.1836,
         0.9597,  0.9600,  0.8833,  0.4466,  0.9828,  0.8757,  0.9041,
         0.9200,  0.9707,  0.9980,  0.7459,  0.7802,  0.9652,  0.0543,
         0.9019,  0.9263,  0.8329,  0.8157,  0.2113,  0.5096,  0.9968,
         0.3383,  0.8350,  0.1034,  0.8688,  0.1034,  0.7295,  0.9406,
         0.0201,  0.8737,  0.3104,  0.8922,  0.0563,  0.5458,  0.8190,
         0.0347,  0.6028,  0.7473,  0.0265,  0.9200,  0.2555,  0.9929,
         0.0606,  0.8622,  0.8078,  0.9636,  0.8940,  0.9262,  0.1479,
         0.9765,  0.2263,  0.1406,  0.8987,  0.0139,  0.2160,  0.7341,
         0.5498,  0.9727,  0.6945,  0.1148,  0.7019,  0.0698,  0.1603,
         0.9062,  0.8327,  0.9682,  0.0734,  0.0054,  0.9285,  0.0916,
         0.0270,  0.0117,  0.0677,  0.1840,  0.9849,  0.7929,  0.0248,
         0.2891,  0.2836,  0.0865,  0.9209,  0.9538,  0.1883,  0.9545,
         0.9751,  0.2974,  0.0556,  0.0493,  0.8097,  0.7418,  0.0164,
         0.9746,  0.9613,  0.9337,  0.8208,  0.9802,  0.0195,  0.0333,
         0.0790,  0.0906,  0.1393,  0.0532,  0.9391,  0.9765,  0.8310,
         0.8338,  0.0431,  0.0153,  0.7823,  0.0475,  0.3816,  0.9669,
         0.9632,  0.9445,  0.8204,  0.9270,  0.2536,  0.4342,  0.0489,
         0.9440], device='cuda:0')
tensor(0.3712, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4341,  0.0668,  0.5938,  0.0417,  0.1025,  0.0179,  0.0023,
         0.1604,  0.8506,  0.4515,  0.7202,  0.9813,  0.0261,  0.9385,
         0.2101,  0.2937,  0.8822,  0.0315,  0.9974,  0.5833,  0.0593,
         0.9717,  0.6359,  0.0086,  0.0187,  0.7618,  0.0311,  0.7618,
         0.3169,  0.9286,  0.3077,  0.7024,  0.9350,  0.9042,  0.1081,
         0.1327,  0.0392,  0.1036,  0.8139,  0.9309,  0.8804,  0.9323,
         0.9498,  0.0130,  0.0551,  0.8372,  0.9674,  0.7648,  0.9332,
         0.9036,  0.5001,  0.9966,  0.8619,  0.2292,  0.8941,  0.8139,
         0.9795,  0.9158,  0.8551,  0.9767,  0.0386,  0.6275,  0.9301,
         0.2566,  0.9054,  0.9730,  0.0087,  0.8587,  0.9889,  0.4951,
         0.8368,  0.9677,  0.8836,  0.9314,  0.8996,  0.7048,  0.8453,
         0.3130,  0.8788,  0.9806,  0.9831,  0.1203,  0.0652,  0.9271,
         0.1574,  0.1653,  0.0055,  0.0536,  0.2136,  0.3173,  0.7969,
         0.0537,  0.9867,  0.0980,  0.2631,  0.7355,  0.8843,  0.4099,
         0.4576,  0.0590,  0.7328,  0.9745,  0.4965,  0.2838,  0.0387,
         0.8696,  0.0117,  0.3917,  0.7611,  0.9053,  0.9605,  0.9558,
         0.9401,  0.0360,  0.9455,  0.9148,  0.9633,  0.1323,  0.0920,
         0.8628,  0.1353,  0.3893,  0.6660,  0.9861,  0.6574,  0.9568,
         0.9703,  0.6754,  0.7785,  0.0980,  0.8389,  0.9848,  0.9873,
         0.1405,  0.8024,  0.6952,  0.0743,  0.0309,  0.9296,  0.8303,
         0.9656,  0.8177,  0.7288,  0.9464,  0.9269,  0.8507,  0.3720,
         0.7140,  0.5254,  0.8697,  0.7701,  0.8539,  0.1492,  0.9715,
         0.7122,  0.9986,  0.0175,  0.3906,  0.3809,  0.9416,  0.9619,
         0.6315,  0.9145,  0.9547,  0.6664,  0.5290,  0.2924,  0.9004,
         0.0208,  0.1133,  0.9152,  0.9678,  0.1510,  0.1245,  0.4020,
         0.3626,  0.0578,  0.9019,  0.6906,  0.0144,  0.8484,  0.8539,
         0.1966,  0.1556,  0.8727,  0.9071,  0.0823,  0.8072,  0.9223,
         0.0256,  0.9706,  0.6313,  0.6100,  0.0232,  0.5061,  0.0155,
         0.9568,  0.7915,  0.0463,  0.0849,  0.9022,  0.8525,  0.1021,
         0.4080,  0.9141,  0.0138,  0.0221,  0.9201,  0.9086,  0.9263,
         0.4419,  0.0932,  0.8940,  0.6889,  0.3771,  0.4156,  0.8917,
         0.0209,  0.8869,  0.6345,  0.9698,  0.0401,  0.0403,  0.5665,
         0.9300,  0.8877,  0.7044,  0.9377,  0.9483,  0.2006,  0.1716,
         0.7033,  0.8848,  0.8960,  0.5764,  0.5634,  0.9211,  0.1803,
         0.0209,  0.7764,  0.9498,  0.0567,  0.0703,  0.9182,  0.7346,
         0.9191,  0.9951,  0.8954,  0.0792,  0.7158,  0.0247,  0.9314,
         0.0569,  0.0946,  0.2196,  0.5061,  0.9247,  0.9259,  0.9125,
         0.0473,  0.0744,  0.1542,  0.3571,  0.5518,  0.8745,  0.9229,
         0.8207,  0.4118,  0.8814,  0.7578,  0.0249,  0.7628,  0.5253,
         0.5826,  0.0790,  0.9863,  0.9240,  0.8878,  0.1187,  0.0666,
         0.8143,  0.9033,  0.9331,  0.9330,  0.5841,  0.0067,  0.6200,
         0.2483,  0.7993,  0.8482,  0.9125,  0.9160,  0.1502,  0.8471,
         0.9799,  0.3089,  0.7987,  0.0691,  0.3384,  0.9267,  0.8457,
         0.8856,  0.9580,  0.1657,  0.9880,  0.4947,  0.4435,  0.9785,
         0.0065,  0.1296,  0.7537,  0.9540,  0.0019,  0.9497,  0.0044,
         0.6754,  0.9249,  0.0523,  0.8758,  0.0815,  0.1377,  0.8502,
         0.8570,  0.8997,  0.0884,  0.0088,  0.3380,  0.4462,  0.0325,
         0.5083,  0.8870,  0.0300,  0.9693,  0.9779,  0.8824,  0.8894,
         0.0975,  0.7178,  0.0148,  0.4800,  0.7783,  0.3601,  0.4992,
         0.8964,  0.9102,  0.3805,  0.9193,  0.8579,  0.1936,  0.9539,
         0.1285,  0.9536,  0.9650,  0.9421,  0.9487,  0.3439,  0.7658,
         0.8938,  0.1842,  0.6393,  0.9478,  0.9096,  0.9843,  0.0024,
         0.9219,  0.8709,  0.0297,  0.9724,  0.5218,  0.3887,  0.9207,
         0.8921,  0.9678,  0.9750,  0.8963,  0.9798,  0.4681,  0.8386,
         0.9277,  0.9385,  0.0293,  0.3842,  0.9965,  0.9931,  0.0657,
         0.6976,  0.9414,  0.9517,  0.6792,  0.9457,  0.8832,  0.9578,
         0.7716,  0.2899,  0.3421,  0.4778,  0.0443,  0.2954,  0.8892,
         0.9464,  0.5650,  0.0956,  0.9249,  0.5955,  0.5878,  0.9668,
         0.1151,  0.0746,  0.9767,  0.8789,  0.9568,  0.9690,  0.6378,
         0.6147,  0.0921,  0.9987,  0.8426,  0.9689,  0.9267,  0.0965,
         0.9905,  0.0140,  0.0310,  0.9595,  0.0066,  0.9866,  0.9667,
         0.1919,  0.5756,  0.9607,  0.7806,  0.7116,  0.6921,  0.6075,
         0.0403,  0.0979,  0.0565,  0.3440,  0.8823,  0.3141,  0.9257,
         0.0378,  0.8965,  0.0472,  0.9596,  0.9222,  0.7672,  0.1208,
         0.4314,  0.2877,  0.7593,  0.9867,  0.9361,  0.4160,  0.8972,
         0.9166,  0.3707,  0.9083,  0.4569,  0.5622,  0.9802,  0.0170,
         0.2646,  0.9972,  0.6441,  0.9356,  0.2223,  0.0041,  0.9395,
         0.9565,  0.8176,  0.9508,  0.8253,  0.8745,  0.9973,  0.0447,
         0.0239,  0.4553,  0.0843,  0.9323,  0.0154,  0.7787,  0.1453,
         0.7502,  0.8256,  0.8389,  0.9768,  0.6750,  0.8808,  0.0440,
         0.0606,  0.0367,  0.4450,  0.3305,  0.0415,  0.9385,  0.9595,
         0.0358,  0.9664,  0.9750,  0.1055,  0.4495,  0.9709,  0.0502,
         0.0528,  0.8492,  0.9057,  0.9703,  0.9469,  0.0968,  0.7966,
         0.1767], device='cuda:0')
tensor(0.3885, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8876,  0.1905,  0.1789,  0.2740,  0.0372,  0.9077,  0.4917,
         0.9237,  0.0341,  0.7057,  0.1126,  0.8071,  0.8690,  0.9479,
         0.2198,  0.3978,  0.1799,  0.3562,  0.2279,  0.9728,  0.9359,
         0.9512,  0.8217,  0.9523,  0.0093,  0.7426,  0.1277,  0.7356,
         0.8575,  0.8136,  0.7675,  0.1897,  0.0821,  0.5723,  0.0452,
         0.9082,  0.8947,  0.2509,  0.9887,  0.6980,  0.2236,  0.8372,
         0.1118,  0.0215,  0.9603,  0.0940,  0.7485,  0.6006,  0.8699,
         0.0847,  0.9580,  0.1954,  0.1836,  0.2036,  0.9965,  0.9512,
         0.1256,  0.1758,  0.9377,  0.1803,  0.9238,  0.2383,  0.8911,
         0.8985,  0.8913,  0.0554,  0.1920,  0.2153,  0.8793,  0.0108,
         0.6500,  0.0324,  0.4819,  0.0929,  0.9271,  0.1005,  0.1023,
         0.6156,  0.0432,  0.5726,  0.1701,  0.9444,  0.8888,  0.0156,
         0.6785,  0.5926,  0.8238,  0.0324,  0.5658,  0.4404,  0.1607,
         0.9486,  0.0250,  0.0765,  0.4305,  0.0112,  0.6787,  0.0907,
         0.7489,  0.4988,  0.8566,  0.1944,  0.1371,  0.9649,  0.9351,
         0.0440,  0.1052,  0.7978,  0.5509,  0.7891,  0.9450,  0.9987,
         0.9270,  0.1405,  0.0720,  0.0830,  0.9278,  0.8188,  0.0152,
         0.9031,  0.8133,  0.5179,  0.2521,  0.9265,  0.0115,  0.3872,
         0.2299,  0.8831,  0.8107,  0.8533,  0.7724,  0.9211,  0.0655,
         0.8013,  0.9035,  0.9623,  0.8937,  0.7549,  0.6955,  0.1145,
         0.1364,  0.8490,  0.0031,  0.3896,  0.0440,  0.9708,  0.9462,
         0.0103,  0.9463,  0.0569,  0.9777,  0.8499,  0.7909,  0.3432,
         0.9587,  0.9930,  0.6624,  0.0194,  0.9720,  0.2447,  0.9051,
         0.0858,  0.3371,  0.7746,  0.8501,  0.0735,  0.7309,  0.3841,
         0.9384,  0.9548,  0.1674,  0.8937,  0.4970,  0.1555,  0.9129,
         0.8545,  0.2935,  0.0900,  0.8840,  0.0610,  0.8504,  0.8801,
         0.7943,  0.8193,  0.9291,  0.5972,  0.9926,  0.8312,  0.0997,
         0.3600,  0.0176,  0.9479,  0.9451,  0.1482,  0.9953,  0.7356,
         0.2621,  0.9140,  0.8104,  0.8291,  0.9779,  0.9051,  0.3923,
         0.3188,  0.0081,  0.8769,  0.4249,  0.0704,  0.9653,  0.8772,
         0.0347,  0.9181,  0.0719,  0.0328,  0.2076,  0.7090,  0.6678,
         0.4170,  0.2334,  0.1061,  0.0437,  0.8825,  0.8544,  0.0972,
         0.0226,  0.0130,  0.9988,  0.1655,  0.1345,  0.8895,  0.9667,
         0.2929,  0.2360,  0.9111,  0.9380,  0.5857,  0.9270,  0.6020,
         0.8885,  0.8620,  0.0037,  0.7328,  0.1248,  0.9766,  0.6807,
         0.2153,  0.0685,  0.9910,  0.1053,  0.9255,  0.0290,  0.9946,
         0.1794,  0.4018,  0.9476,  0.8893,  0.9363,  0.3024,  0.3189,
         0.8649,  0.8687,  0.9969,  0.0810,  0.6687,  0.0073,  0.1201,
         0.9867,  0.4955,  0.0458,  0.7221,  0.9328,  0.6724,  0.9657,
         0.9237,  0.5865,  0.1324,  0.7109,  0.9062,  0.9368,  0.8946,
         0.9801,  0.1162,  0.8366,  0.9868,  0.9333,  0.2158,  0.4644,
         0.8724,  0.5053,  0.5958,  0.9472,  0.5179,  0.1129,  0.2892,
         0.0158,  0.8119,  0.5407,  0.5709,  0.3031,  0.9604,  0.5896,
         0.7345,  0.8613,  0.8618,  0.3465,  0.5207,  0.6970,  0.9622,
         0.9501,  0.9050,  0.6560,  0.0062,  0.0737,  0.9627,  0.4728,
         0.4426,  0.8384,  0.9813,  0.3336,  0.4789,  0.9287,  0.0456,
         0.0491,  0.4317,  0.5086,  0.6820,  0.9570,  0.9477,  0.9559,
         0.9844,  0.9257,  0.9267,  0.0067,  0.9356,  0.8089,  0.7970,
         0.0412,  0.5790,  0.8757,  0.9944,  0.1527,  0.1019,  0.0938,
         0.3591,  0.9638,  0.4736,  0.5100,  0.5686,  0.6482,  0.1935,
         0.8743,  0.9612,  0.8841,  0.0208,  0.0348,  0.6165,  0.8248,
         0.3196,  0.7993,  0.4061,  0.7434,  0.9074,  0.8910,  0.8374,
         0.2231,  0.0715,  0.6480,  0.1914,  0.8568,  0.9563,  0.0472,
         0.6943,  0.0301,  0.9025,  0.9966,  0.8978,  0.8881,  0.7655,
         0.9566,  0.2434,  0.0180,  0.1543,  0.8056,  0.0137,  0.7529,
         0.9801,  0.9358,  0.9322,  0.9657,  0.0998,  0.7312,  0.0178,
         0.6270,  0.5059,  0.1768,  0.9061,  0.9651,  0.8313,  0.0636,
         0.9116,  0.8298,  0.9387,  0.9367,  0.8994,  0.0597,  0.6862,
         0.0395,  0.0752,  0.9500,  0.6352,  0.9831,  0.9655,  0.8482,
         0.0253,  0.9878,  0.0709,  0.8071,  0.8466,  0.9659,  0.7638,
         0.0405,  0.9251,  0.2582,  0.8673,  0.9877,  0.0357,  0.0511,
         0.4638,  0.1614,  0.2172,  0.4433,  0.0687,  0.9943,  0.0673,
         0.0891,  0.8103,  0.5312,  0.0651,  0.7774,  0.8927,  0.0303,
         0.0398,  0.9887,  0.2725,  0.5306,  0.8969,  0.9503,  0.7063,
         0.1968,  0.8241,  0.8744,  0.1023,  0.8822,  0.8569,  0.0065,
         0.0608,  0.1061,  0.9416,  0.1170,  0.9404,  0.6076,  0.0098,
         0.9547,  0.2363,  0.9765,  0.0570,  0.2492,  0.8541,  0.6958,
         0.9191,  0.5443,  0.0833,  0.9618,  0.8039,  0.0376,  0.0878,
         0.3977,  0.7793,  0.8576,  0.9320,  0.6023,  0.8435,  0.9031,
         0.9986,  0.8999,  0.9902,  0.8995,  0.0571,  0.0459,  0.6500,
         0.8706,  0.9500,  0.9264,  0.9160,  0.5729,  0.9493,  0.0158,
         0.6606,  0.1037,  0.8972,  0.0629,  0.0315,  0.7939,  0.2778,
         0.3730,  0.9185,  0.4971,  0.8941,  0.7189,  0.1112,  0.0367,
         0.8030], device='cuda:0')
tensor(0.3648, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1100,  0.8268,  0.3328,  0.9950,  0.1271,  0.0143,  0.0989,
         0.5202,  0.9930,  0.1028,  0.8487,  0.3049,  0.0717,  0.7873,
         0.5066,  0.7609,  0.3483,  0.9993,  0.6687,  0.1679,  0.8587,
         0.2666,  0.0474,  0.9079,  0.7962,  0.0295,  0.2465,  0.4171,
         0.0749,  0.7907,  0.4380,  0.8946,  0.1952,  0.6605,  0.2150,
         0.9812,  0.6896,  0.6561,  0.4184,  0.0178,  0.5178,  0.8905,
         0.7630,  0.9126,  0.0088,  0.9244,  0.9842,  0.1385,  0.9760,
         0.5912,  0.7206,  0.6484,  0.3748,  0.0577,  0.0236,  0.2383,
         0.9904,  0.0317,  0.8769,  0.0590,  0.1016,  0.7677,  0.6116,
         0.3278,  0.5430,  0.5989,  0.9170,  0.2415,  0.2704,  0.4738,
         0.1871,  0.8923,  0.2608,  0.0988,  0.5159,  0.1795,  0.3178,
         0.0290,  0.5125,  0.8179,  0.2505,  0.7803,  0.1137,  0.1382,
         0.0370,  0.2863,  0.8648,  0.2605,  0.5053,  0.0394,  0.9684,
         0.1894,  0.9232,  0.0284,  0.0908,  0.7982,  0.0749,  0.9256,
         0.4273,  0.9655,  0.8467,  0.7988,  0.9484,  0.0700,  0.0553,
         0.0149,  0.0391,  0.8997,  0.0048,  0.0593,  0.7012,  0.6028,
         0.3918,  0.1554,  0.9530,  0.8418,  0.9141,  0.5843,  0.6914,
         0.9010,  0.5092,  0.2029,  0.8065,  0.3143,  0.6623,  0.2352,
         0.7461,  0.0314,  0.8681,  0.8379,  0.9480,  0.1896,  0.2011,
         0.0561,  0.0430,  0.8288,  0.8552,  0.0568,  0.9778,  0.0209,
         0.0223,  0.0715,  0.7740,  0.9664,  0.9305,  0.8128,  0.9367,
         0.9406,  0.8929,  0.0627,  0.9719,  0.8103,  0.1776,  0.6857,
         0.7901,  0.3515,  0.0577,  0.3426,  0.4668,  0.0439,  0.7394,
         0.7874,  0.0355,  0.5086,  0.3125,  0.9137,  0.3104,  0.9513,
         0.5058,  0.9748,  0.8188,  0.9593,  0.2969,  0.0476,  0.8906,
         0.8922,  0.9968,  0.7091,  0.2502,  0.0777,  0.8398,  0.4634,
         0.6648,  0.5839,  0.1182,  0.8668,  0.5740,  0.0278,  0.9106,
         0.0640,  0.9258,  0.2022,  0.0631,  0.9753,  0.0170,  0.2400,
         0.9364,  0.9282,  0.6543,  0.8649,  0.6046,  0.2348,  0.0302,
         0.0250,  0.1934,  0.0772,  0.1835,  0.9247,  0.2819,  0.5692,
         0.9340,  0.2591,  0.8368,  0.7117,  0.6929,  0.0193,  0.8416,
         0.0383,  0.5604,  0.8732,  0.9349,  0.0275,  0.0818,  0.6941,
         0.5099,  0.7177,  0.8533,  0.9985,  0.2116,  0.1216,  0.9280,
         0.1864,  0.5419,  0.0070,  0.1453,  0.6920,  0.0635,  0.6537,
         0.0326,  0.3965,  0.2823,  0.2932,  0.7388,  0.0899,  0.8841,
         0.8791,  0.6920,  0.2450,  0.7803,  0.9046,  0.9522,  0.0889,
         0.0281,  0.6658,  0.0880,  0.0329,  0.4144,  0.8882,  0.0247,
         0.6232,  0.1153,  0.7942,  0.5455,  0.7679,  0.2351,  0.0614,
         0.0373,  0.0575,  0.1518,  0.4346,  0.8923,  0.3817,  0.2528,
         0.4277,  0.5949,  0.8367,  0.7760,  0.8138,  0.5833,  0.0013,
         0.9343,  0.9255,  0.8759,  0.9147,  0.6976,  0.1081,  0.0818,
         0.8465,  0.0169,  0.5475,  0.9854,  0.9380,  0.3216,  0.0408,
         0.1474,  0.8940,  0.0717,  0.2132,  0.4853,  0.9306,  0.9726,
         0.6693,  0.8367,  0.3886,  0.5332,  0.0732,  0.4610,  0.3067,
         0.7748,  0.2248,  0.6572,  0.9054,  0.0898,  0.8507,  0.3480,
         0.8076,  0.5600,  0.0053,  0.9978,  0.2577,  0.6790,  0.2493,
         0.9506,  0.0033,  0.9716,  0.2697,  0.0087,  0.3164,  0.6121,
         0.7453,  0.8153,  0.7326,  0.7470,  0.9434,  0.8577,  0.2110,
         0.2505,  0.2455,  0.0451,  0.8310,  0.8384,  0.7627,  0.2028,
         0.2551,  0.3726,  0.1443,  0.1872,  0.7437,  0.9164,  0.2871,
         0.0544,  0.8135,  0.9289,  0.0948,  0.8255,  0.1894,  0.9955,
         0.6507,  0.1375,  0.8054,  0.7493,  0.0204,  0.2808,  0.8999,
         0.3886,  0.9866,  0.9030,  0.8022,  0.0085,  0.8885,  0.2704,
         0.8953,  0.7079,  0.2331,  0.1067,  0.8631,  0.3052,  0.7873,
         0.1816,  0.0120,  0.3333,  0.5276,  0.7496,  0.7322,  0.9653,
         0.9461,  0.9985,  0.0210,  0.6267,  0.8655,  0.0453,  0.0332,
         0.6714,  0.1255,  0.1515,  0.5063,  0.9198,  0.9518,  0.9653,
         0.3164,  0.7662,  0.0277,  0.9658,  0.5880,  0.9866,  0.1085,
         0.3378,  0.8344,  0.8923,  0.9275,  0.6397,  0.0658,  0.1189,
         0.7824,  0.7612,  0.2652,  0.3718,  0.3735,  0.0110,  0.1594,
         0.8041,  0.0201,  0.3257,  0.8564,  0.6941,  0.0446,  0.4634,
         0.3722,  0.9921,  0.1348,  0.1226,  0.1493,  0.2779,  0.7351,
         0.0731,  0.1751,  0.8034,  0.0576,  0.7540,  0.0064,  0.9554,
         0.9369,  0.6245,  0.7088,  0.9229,  0.3441,  0.9241,  0.9410,
         0.9031,  0.8967,  0.9221,  0.2814,  0.2217,  0.0133,  0.8335,
         0.9760,  0.0847,  0.8494,  0.6882,  0.9140,  0.9586,  0.6311,
         0.3442,  0.6917,  0.6907,  0.9059,  0.9897,  0.8782,  0.8806,
         0.0684,  0.8760,  0.7918,  0.7177,  0.0581,  0.3171,  0.1531,
         0.9551,  0.3809,  0.4293,  0.3557,  0.1636,  0.1698,  0.7388,
         0.1040,  0.2217,  0.0278,  0.9761,  0.0136,  0.0181,  0.3717,
         0.7989,  0.0630,  0.9113,  0.9769,  0.3782,  0.1571,  0.8490,
         0.8584,  0.9470,  0.1038,  0.4818,  0.1607,  0.9406,  0.8189,
         0.7628,  0.9856,  0.5970,  0.9133,  0.1526,  0.9629,  0.8199,
         0.8615], device='cuda:0')
tensor(0.3484, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2794,  0.3450,  0.9027,  0.6321,  0.2072,  0.0501,  0.8757,
         0.6098,  0.9824,  0.6884,  0.1541,  0.7272,  0.0265,  0.9584,
         0.5672,  0.8848,  0.6802,  0.0240,  0.4776,  0.4026,  0.0107,
         0.1978,  0.9294,  0.0245,  0.0520,  0.3829,  0.0211,  0.8654,
         0.0442,  0.0224,  0.1016,  0.8736,  0.1780,  0.9215,  0.0848,
         0.9781,  0.9795,  0.8682,  0.9841,  0.8601,  0.4959,  0.0155,
         0.9423,  0.5626,  0.8372,  0.5954,  0.2176,  0.0125,  0.6188,
         0.0773,  0.2773,  0.3966,  0.2351,  0.8722,  0.2204,  0.7007,
         0.9630,  0.4018,  0.7227,  0.8711,  0.1376,  0.0706,  0.1434,
         0.7579,  0.0056,  0.4845,  0.9887,  0.0212,  0.0299,  0.8613,
         0.9134,  0.8157,  0.2408,  0.5088,  0.2586,  0.9180,  0.8667,
         0.6568,  0.9138,  0.2610,  0.1833,  0.8236,  0.2681,  0.0690,
         0.2327,  0.4811,  0.7932,  0.0178,  0.2866,  0.4735,  0.8825,
         0.3385,  0.9008,  0.7125,  0.7913,  0.8496,  0.5001,  0.1358,
         0.8313,  0.3738,  0.0784,  0.4430,  0.8989,  0.0096,  0.0766,
         0.0277,  0.0032,  0.2631,  0.8357,  0.0652,  0.7268,  0.7138,
         0.1471,  0.6272,  0.7747,  0.4642,  0.9175,  0.1929,  0.5770,
         0.9678,  0.1044,  0.8910,  0.7850,  0.6960,  0.7416,  0.2991,
         0.5662,  0.8576,  0.0304,  0.9242,  0.4222,  0.9585,  0.9256,
         0.4774,  0.2223,  0.6586,  0.3379,  0.6443,  0.9445,  0.0726,
         0.0742,  0.0095,  0.9889,  0.5691,  0.1510,  0.7523,  0.0401,
         0.4276,  0.6219,  0.2618,  0.1226,  0.0274,  0.6733,  0.9958,
         0.1148,  0.0961,  0.2119,  0.6769,  0.0341,  0.9823,  0.8838,
         0.8211,  0.2316,  0.6292,  0.9863,  0.0402,  0.8397,  0.2218,
         0.6554,  0.9650,  0.3763,  0.9671,  0.7096,  0.2695,  0.8889,
         0.9606,  0.1921,  0.9351,  0.3859,  0.2991,  0.8679,  0.9284,
         0.3196,  0.0108,  0.7874,  0.0141,  0.4146,  0.9543,  0.5713,
         0.4178,  0.6688,  0.4756,  0.7863,  0.0977,  0.3188,  0.0469,
         0.8173,  0.8510,  0.2017,  0.2042,  0.9096,  0.6669,  0.3483,
         0.2768,  0.3675,  0.8882,  0.1482,  0.9165,  0.0206,  0.0636,
         0.0951,  0.0198,  0.9426,  0.0073,  0.7196,  0.9427,  0.1082,
         0.8745,  0.9174,  0.1180,  0.8352,  0.0165,  0.8115,  0.8657,
         0.6603,  0.1673,  0.0745,  0.1577,  0.5374,  0.8991,  0.5540,
         0.6701,  0.1061,  0.5345,  0.1246,  0.0891,  0.1827,  0.7917,
         0.8333,  0.9719,  0.7522,  0.2515,  0.9790,  0.8639,  0.0887,
         0.8726,  0.0045,  0.2402,  0.9042,  0.2540,  0.2819,  0.0699,
         0.8924,  0.0693,  0.1794,  0.8247,  0.4798,  0.1146,  0.8062,
         0.5520,  0.3631,  0.1069,  0.7077,  0.8209,  0.9348,  0.4867,
         0.1858,  0.6178,  0.8563,  0.8757,  0.7755,  0.9403,  0.9014,
         0.0396,  0.1595,  0.4812,  0.3908,  0.0411,  0.0543,  0.6868,
         0.1092,  0.8900,  0.6860,  0.1077,  0.8923,  0.2283,  0.9100,
         0.0907,  0.6755,  0.0551,  0.8273,  0.4719,  0.6413,  0.0756,
         0.2377,  0.6764,  0.8672,  0.1496,  0.9901,  0.1179,  0.7205,
         0.8602,  0.9561,  0.9872,  0.0161,  0.5226,  0.8895,  0.9710,
         0.5608,  0.7753,  0.7893,  0.9725,  0.1889,  0.2416,  0.1959,
         0.7986,  0.8638,  0.1174,  0.0407,  0.8870,  0.8269,  0.0362,
         0.0321,  0.6079,  0.1733,  0.7134,  0.3274,  0.8988,  0.0057,
         0.1438,  0.7745,  0.2838,  0.1679,  0.8229,  0.2176,  0.3115,
         0.5476,  0.0500,  0.0626,  0.1303,  0.1456,  0.8090,  0.0479,
         0.1018,  0.6063,  0.3642,  0.5966,  0.6013,  0.8677,  0.1326,
         0.6847,  0.8513,  0.9501,  0.8823,  0.0309,  0.8720,  0.8076,
         0.5048,  0.9007,  0.7356,  0.1201,  0.9339,  0.1235,  0.8773,
         0.8428,  0.6671,  0.4710,  0.3157,  0.8482,  0.1441,  0.1354,
         0.0628,  0.0450,  0.6794,  0.8655,  0.0810,  0.0221,  0.9753,
         0.0170,  0.0963,  0.6636,  0.8111,  0.8241,  0.7072,  0.1604,
         0.7165,  0.6358,  0.0656,  0.6029,  0.2863,  0.7561,  0.9536,
         0.3833,  0.0107,  0.8931,  0.9969,  0.1098,  0.4128,  0.7382,
         0.8149,  0.5337,  0.8977,  0.0014,  0.7378,  0.0864,  0.8755,
         0.3044,  0.0776,  0.1316,  0.9658,  0.1147,  0.9183,  0.6828,
         0.1682,  0.7501,  0.5185,  0.8403,  0.1498,  0.8934,  0.0081,
         0.2110,  0.6040,  0.0380,  0.9641,  0.1226,  0.1841,  0.1171,
         0.5516,  0.0455,  0.5478,  0.0639,  0.0163,  0.8758,  0.0393,
         0.9195,  0.8617,  0.9261,  0.8174,  0.9065,  0.0327,  0.8101,
         0.8708,  0.3496,  0.1262,  0.9461,  0.9491,  0.1721,  0.6353,
         0.5674,  0.8887,  0.7282,  0.0875,  0.0058,  0.0505,  0.7681,
         0.1738,  0.6947,  0.0728,  0.7958,  0.4818,  0.5498,  0.2471,
         0.8306,  0.9083,  0.9457,  0.4790,  0.7147,  0.9271,  0.3340,
         0.3059,  0.8503,  0.6835,  0.1581,  0.1097,  0.9419,  0.4736,
         0.4426,  0.1739,  0.5984,  0.0382,  0.7582,  0.0331,  0.6287,
         0.5640,  0.9063,  0.0487,  0.9162,  0.8444,  0.8165,  0.5981,
         0.0926,  0.9337,  0.7046,  0.9074,  0.2301,  0.4700,  0.0720,
         0.9435,  0.0982,  0.0166,  0.9843,  0.4706,  0.2134,  0.0412,
         0.0438,  0.8885,  0.2212,  0.0273,  0.0305,  0.8411,  0.0525,
         0.9415], device='cuda:0')
tensor(0.3244, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5794,  0.2918,  0.6266,  0.5815,  0.8392,  0.1124,  0.0362,
         0.8053,  0.0114,  0.0252,  0.4892,  0.1894,  0.4745,  0.3105,
         0.0870,  0.2550,  0.8596,  0.0943,  0.2830,  0.3593,  0.6464,
         0.0024,  0.7895,  0.7594,  0.5230,  0.9100,  0.7851,  0.8679,
         0.3304,  0.2877,  0.1248,  0.8448,  0.1382,  0.0556,  0.8114,
         0.8945,  0.1697,  0.6754,  0.3825,  0.1330,  0.1313,  0.1710,
         0.7256,  0.1245,  0.0108,  0.0027,  0.7726,  0.5728,  0.8093,
         0.1494,  0.0016,  0.6510,  0.3591,  0.7847,  0.0679,  0.4047,
         0.8554,  0.8694,  0.8797,  0.1337,  0.0982,  0.8131,  0.7545,
         0.6957,  0.1368,  0.7450,  0.3802,  0.6810,  0.2552,  0.4376,
         0.8728,  0.8870,  0.5369,  0.0794,  0.0285,  0.3990,  0.2688,
         0.5070,  0.7720,  0.0940,  0.8621,  0.8507,  0.0933,  0.2213,
         0.0096,  0.1356,  0.2229,  0.1678,  0.2184,  0.6883,  0.9682,
         0.2946,  0.7762,  0.1184,  0.6760,  0.0305,  0.7997,  0.0073,
         0.0544,  0.0694,  0.3360,  0.7605,  0.0314,  0.8977,  0.2461,
         0.7917,  0.8996,  0.9835,  0.6184,  0.1217,  0.3704,  0.9804,
         0.0075,  0.8317,  0.8360,  0.4553,  0.0809,  0.0751,  0.7586,
         0.8515,  0.9483,  0.0554,  0.8363,  0.0295,  0.0272,  0.0349,
         0.8393,  0.9287,  0.6862,  0.0443,  0.8533,  0.8061,  0.4369,
         0.0026,  0.9889,  0.1079,  0.5931,  0.0017,  0.1957,  0.2373,
         0.5408,  0.0768,  0.6180,  0.6587,  0.0034,  0.1389,  0.4053,
         0.9219,  0.1736,  0.7160,  0.8140,  0.0018,  0.6860,  0.8685,
         0.7284,  0.2357,  0.3609,  0.0603,  0.5809,  0.8500,  0.2756,
         0.5488,  0.6807,  0.0312,  0.7387,  0.5162,  0.8146,  0.1575,
         0.0156,  0.0249,  0.0023,  0.6299,  0.7993,  0.8414,  0.0054,
         0.0289,  0.0110,  0.8411,  0.4447,  0.0685,  0.1334,  0.0088,
         0.1135,  0.7296,  0.9209,  0.6770,  0.4068,  0.5727,  0.9925,
         0.2835,  0.6546,  0.7137,  0.0366,  0.0211,  0.0083,  0.9141,
         0.2995,  0.7618,  0.8355,  0.1659,  0.6185,  0.3454,  0.4088,
         0.7368,  0.0503,  0.2090,  0.5675,  0.9309,  0.9629,  0.0587,
         0.0166,  0.0119,  0.3884,  0.2632,  0.1856,  0.0102,  0.1691,
         0.6848,  0.8974,  0.0026,  0.9549,  0.8332,  0.8720,  0.0572,
         0.0377,  0.9449,  0.4158,  0.1206,  0.7759,  0.9008,  0.2791,
         0.8997,  0.4383,  0.1895,  0.3799,  0.3373,  0.3143,  0.9203,
         0.3291,  0.8549,  0.1684,  0.0481,  0.0374,  0.8624,  0.1278,
         0.9917,  0.0546,  0.1149,  0.0581,  0.0019,  0.0919,  0.8756,
         0.2381,  0.1361,  0.8038,  0.0962,  0.5062,  0.7006,  0.5472,
         0.8781,  0.5460,  0.8931,  0.7727,  0.7006,  0.0096,  0.8575,
         0.0163,  0.3699,  0.9963,  0.6538,  0.5031,  0.2257,  0.9746,
         0.1329,  0.9320,  0.5928,  0.9097,  0.2039,  0.4768,  0.4002,
         0.0089,  0.2204,  0.2491,  0.0625,  0.5602,  0.3759,  0.1365,
         0.5640,  0.0683,  0.4956,  0.0408,  0.5309,  0.9235,  0.1976,
         0.1551,  0.4159,  0.0203,  0.1734,  0.0831,  0.0402,  0.6051,
         0.0613,  0.9051,  0.1034,  0.0321,  0.0987,  0.7750,  0.0047,
         0.0394,  0.9072,  0.6673,  0.4253,  0.8401,  0.0222,  0.0187,
         0.8285,  0.2747,  0.6974,  0.0045,  0.6330,  0.7257,  0.9798,
         0.6999,  0.5225,  0.0729,  0.7268,  0.1693,  0.0280,  0.0101,
         0.8719,  0.2221,  0.8785,  0.9530,  0.9086,  0.6959,  0.0044,
         0.8466,  0.0643,  0.0989,  0.2309,  0.5752,  0.8772,  0.0831,
         0.1172,  0.9571,  0.1894,  0.6180,  0.0093,  0.7825,  0.0895,
         0.1326,  0.0157,  0.8538,  0.2369,  0.8315,  0.1048,  0.7602,
         0.6311,  0.1062,  0.6230,  0.0151,  0.6512,  0.6202,  0.1633,
         0.7020,  0.7037,  0.8385,  0.0858,  0.9846,  0.2627,  0.9963,
         0.0738,  0.9387,  0.0506,  0.9602,  0.0772,  0.0394,  0.6735,
         0.1728,  0.8112,  0.8139,  0.3583,  0.8187,  0.1713,  0.0060,
         0.0583,  0.0369,  0.9270,  0.0946,  0.9513,  0.1410,  0.0533,
         0.1229,  0.3620,  0.1985,  0.9159,  0.9071,  0.9766,  0.0121,
         0.7083,  0.1463,  0.8839,  0.1356,  0.9403,  0.8074,  0.0511,
         0.6240,  0.8882,  0.0237,  0.2564,  0.1374,  0.0595,  0.1830,
         0.1099,  0.9661,  0.8479,  0.5889,  0.1402,  0.9495,  0.5481,
         0.4099,  0.3977,  0.0165,  0.0303,  0.0498,  0.8969,  0.6394,
         0.9000,  0.7802,  0.5246,  0.0104,  0.0198,  0.0036,  0.3267,
         0.0276,  0.8057,  0.4056,  0.0497,  0.7007,  0.8035,  0.2029,
         0.7041,  0.8230,  0.4047,  0.0651,  0.0843,  0.8112,  0.1124,
         0.9888,  0.3758,  0.6210,  0.1738,  0.0102,  0.7693,  0.2737,
         0.1054,  0.8689,  0.3036,  0.8878,  0.8847,  0.0703,  0.9303,
         0.3806,  0.4673,  0.0167,  0.6485,  0.9347,  0.2165,  0.8376,
         0.7237,  0.1542,  0.9934,  0.3814,  0.2562,  0.4007,  0.2296,
         0.1062,  0.0417,  0.0688,  0.3863,  0.0501,  0.1176,  0.7538,
         0.0688,  0.2315,  0.1369,  0.8466,  0.8177,  0.0065,  0.0369,
         0.3185,  0.8192,  0.8957,  0.1171,  0.1136,  0.8012,  0.8244,
         0.0270,  0.6615,  0.1022,  0.9180,  0.0720,  0.0547,  0.8210,
         0.5699,  0.7305,  0.8273,  0.6491,  0.0406,  0.9778,  0.3954,
         0.0571], device='cuda:0')
tensor(0.3499, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1464,  0.2917,  0.0988,  0.9526,  0.0454,  0.8657,  0.8384,
         0.8797,  0.5249,  0.0550,  0.0179,  0.0148,  0.8813,  0.5480,
         0.1214,  0.7616,  0.1018,  0.0018,  0.5940,  0.4561,  0.0743,
         0.3868,  0.0032,  0.0040,  0.3289,  0.6654,  0.8688,  0.2775,
         0.0179,  0.3863,  0.2606,  0.1578,  0.1598,  0.1695,  0.0085,
         0.9066,  0.3457,  0.6266,  0.5433,  0.0812,  0.2341,  0.2427,
         0.8636,  0.0572,  0.4944,  0.7429,  0.0734,  0.0043,  0.0708,
         0.5479,  0.7713,  0.8629,  0.0031,  0.0054,  0.8982,  0.1498,
         0.7724,  0.8857,  0.0141,  0.8803,  0.9601,  0.1406,  0.9261,
         0.0836,  0.0171,  0.6870,  0.0019,  0.4950,  0.0054,  0.2867,
         0.1203,  0.0542,  0.9971,  0.2382,  0.7304,  0.0180,  0.8436,
         0.6208,  0.9948,  0.8447,  0.3139,  0.0187,  0.1907,  0.1547,
         0.8377,  0.0960,  0.1588,  0.9414,  0.7090,  0.0612,  0.3239,
         0.0247,  0.2037,  0.1330,  0.7638,  0.0066,  0.3120,  0.6223,
         0.7813,  0.1175,  0.1378,  0.3497,  0.5733,  0.8866,  0.8273,
         0.1074,  0.6961,  0.5555,  0.0411,  0.4294,  0.1077,  0.0053,
         0.0382,  0.0360,  0.1346,  0.8289,  0.2907,  0.8991,  0.0489,
         0.8944,  0.7426,  0.0612,  0.4659,  0.9290,  0.5341,  0.1638,
         0.2359,  0.7084,  0.0691,  0.4606,  0.2042,  0.9507,  0.8778,
         0.3741,  0.0027,  0.0678,  0.5966,  0.8857,  0.9597,  0.6481,
         0.8578,  0.2741,  0.9841,  0.4053,  0.3536,  0.7785,  0.0626,
         0.0123,  0.1661,  0.2179,  0.2348,  0.2193,  0.4074,  0.6193,
         0.3040,  0.0977,  0.0189,  0.5859,  0.7947,  0.0639,  0.8200,
         0.2824,  0.8803,  0.1072,  0.7789,  0.0203,  0.9880,  0.0167,
         0.7824,  0.0130,  0.0734,  0.0056,  0.7555,  0.9229,  0.0774,
         0.0591,  0.9190,  0.9764,  0.7258,  0.5988,  0.7844,  0.8285,
         0.9828,  0.1741,  0.2178,  0.7641,  0.4931,  0.8627,  0.0772,
         0.3171,  0.7419,  0.1887,  0.8725,  0.7440,  0.6731,  0.8274,
         0.1564,  0.0691,  0.2495,  0.0315,  0.0433,  0.0162,  0.1613,
         0.0261,  0.9856,  0.0813,  0.5000,  0.4667,  0.4161,  0.0131,
         0.0071,  0.5881,  0.7496,  0.4030,  0.9324,  0.6654,  0.8356,
         0.9214,  0.0174,  0.0118,  0.3088,  0.8848,  0.5977,  0.8858,
         0.3812,  0.8803,  0.2976,  0.1313,  0.0158,  0.8527,  0.0555,
         0.1383,  0.0201,  0.1778,  0.4118,  0.0186,  0.0709,  0.1384,
         0.3531,  0.3147,  0.8085,  0.5705,  0.9043,  0.0704,  0.7418,
         0.2891,  0.0050,  0.0100,  0.4061,  0.0404,  0.7526,  0.5598,
         0.0221,  0.2888,  0.4430,  0.3229,  0.1025,  0.5545,  0.0107,
         0.0437,  0.1592,  0.5921,  0.0308,  0.2022,  0.1232,  0.0138,
         0.0069,  0.5114,  0.0278,  0.0967,  0.9127,  0.1877,  0.9676,
         0.0706,  0.1034,  0.7001,  0.0744,  0.1335,  0.1599,  0.3529,
         0.9235,  0.8406,  0.8547,  0.4166,  0.4279,  0.3730,  0.8210,
         0.1503,  0.0555,  0.8183,  0.0315,  0.9967,  0.2038,  0.8644,
         0.8121,  0.2503,  0.9564,  0.9439,  0.0058,  0.7331,  0.7853,
         0.6289,  0.8444,  0.0198,  0.0403,  0.0096,  0.1341,  0.1962,
         0.8435,  0.1164,  0.0343,  0.4227,  0.0751,  0.6979,  0.8994,
         0.8256,  0.1102,  0.9901,  0.3515,  0.6183,  0.9901,  0.0319,
         0.1850,  0.7924,  0.1975,  0.8424,  0.4552,  0.9146,  0.4376,
         0.0303,  0.0686,  0.0631,  0.0184,  0.3155,  0.4056,  0.7092,
         0.3831,  0.1870,  0.0047,  0.8919,  0.4732,  0.1528,  0.7280,
         0.1252,  0.0476,  0.4226,  0.5085,  0.8647,  0.0272,  0.0081,
         0.9605,  0.0101,  0.7155,  0.0221,  0.5093,  0.5333,  0.0468,
         0.1632,  0.8546,  0.0782,  0.6867,  0.9203,  0.0258,  0.1051,
         0.9032,  0.8585,  0.9110,  0.1439,  0.2968,  0.0067,  0.1420,
         0.9364,  0.0364,  0.7965,  0.0529,  0.8001,  0.5937,  0.0324,
         0.0611,  0.0114,  0.0204,  0.1213,  0.0475,  0.0038,  0.7511,
         0.3733,  0.2341,  0.1595,  0.2577,  0.9308,  0.0127,  0.6828,
         0.8646,  0.7069,  0.0027,  0.2491,  0.8683,  0.1409,  0.8844,
         0.1076,  0.3327,  0.7986,  0.9114,  0.5865,  0.2778,  0.0386,
         0.9249,  0.0628,  0.4976,  0.0989,  0.8978,  0.8031,  0.9314,
         0.5685,  0.9345,  0.0477,  0.6169,  0.0385,  0.0247,  0.0191,
         0.1077,  0.1233,  0.1466,  0.8416,  0.0996,  0.4002,  0.4720,
         0.9912,  0.0114,  0.0617,  0.0159,  0.0188,  0.9222,  0.0315,
         0.1546,  0.9653,  0.3117,  0.7522,  0.0749,  0.3475,  0.9301,
         0.0145,  0.0112,  0.3808,  0.0148,  0.1573,  0.6405,  0.0492,
         0.2835,  0.0398,  0.0629,  0.4141,  0.3265,  0.3348,  0.0365,
         0.4806,  0.7755,  0.0235,  0.0423,  0.1451,  0.9738,  0.4179,
         0.6815,  0.0470,  0.1480,  0.9546,  0.9198,  0.9353,  0.2410,
         0.0795,  0.4287,  0.0558,  0.0140,  0.0287,  0.0127,  0.7234,
         0.4900,  0.8313,  0.9908,  0.0401,  0.0128,  0.9561,  0.9642,
         0.9493,  0.0252,  0.1228,  0.2519,  0.3439,  0.4982,  0.8597,
         0.7519,  0.9575,  0.1444,  0.3027,  0.0407,  0.3117,  0.5419,
         0.3343,  0.8693,  0.9654,  0.8755,  0.0387,  0.9937,  0.1089,
         0.2735,  0.1332,  0.7154,  0.8799,  0.0204,  0.7603,  0.1315,
         0.3961], device='cuda:0')
tensor(0.3630, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0476,  0.2315,  0.2135,  0.0117,  0.9536,  0.0341,  0.7644,
         0.2748,  0.8982,  0.8848,  0.5733,  0.0385,  0.1372,  0.8796,
         0.1377,  0.1820,  0.0285,  0.1060,  0.9330,  0.9163,  0.5420,
         0.1182,  0.0238,  0.8212,  0.3057,  0.4291,  0.0873,  0.0050,
         0.0481,  0.9114,  0.2418,  0.0349,  0.7938,  0.8354,  0.0018,
         0.0757,  0.6298,  0.0176,  0.8845,  0.9714,  0.0365,  0.0158,
         0.9515,  0.1900,  0.9363,  0.7001,  0.9349,  0.4146,  0.4113,
         0.9965,  0.9773,  0.9402,  0.4451,  0.0454,  0.0015,  0.7891,
         0.3675,  0.9653,  0.3301,  0.3484,  0.2318,  0.9457,  0.0067,
         0.0590,  0.1153,  0.8409,  0.1115,  0.1131,  0.2549,  0.0199,
         0.0672,  0.4793,  0.0637,  0.0725,  0.0175,  0.2068,  0.4375,
         0.8761,  0.3070,  0.0160,  0.2906,  0.7462,  0.3116,  0.0227,
         0.3160,  0.0018,  0.8768,  0.0252,  0.7659,  0.2647,  0.7540,
         0.2323,  0.1376,  0.6719,  0.0281,  0.2974,  0.2862,  0.9217,
         0.8182,  0.0428,  0.0140,  0.5878,  0.0977,  0.8667,  0.2036,
         0.9392,  0.4948,  0.1999,  0.5130,  0.0085,  0.9960,  0.8095,
         0.4204,  0.1404,  0.3571,  0.0819,  0.4801,  0.8702,  0.1830,
         0.1149,  0.9498,  0.6437,  0.3081,  0.1942,  0.5974,  0.8298,
         0.0713,  0.0061,  0.3629,  0.0297,  0.8440,  0.8828,  0.8445,
         0.9385,  0.4488,  0.6161,  0.9988,  0.9113,  0.8575,  0.4066,
         0.9151,  0.6769,  0.1782,  0.8086,  0.6951,  0.1182,  0.1583,
         0.3666,  0.5107,  0.8133,  0.3035,  0.8375,  0.0995,  0.7365,
         0.8713,  0.7402,  0.9819,  0.0935,  0.9446,  0.0060,  0.7980,
         0.0354,  0.9825,  0.0825,  0.5339,  0.0792,  0.0028,  0.0109,
         0.1101,  0.0541,  0.8453,  0.2647,  0.0451,  0.1301,  0.0501,
         0.6307,  0.6329,  0.8555,  0.9349,  0.3728,  0.0033,  0.9016,
         0.8600,  0.0023,  0.9221,  0.0395,  0.8899,  0.0256,  0.5852,
         0.0908,  0.0150,  0.3038,  0.1620,  0.7811,  0.2947,  0.0415,
         0.5819,  0.8109,  0.5752,  0.7910,  0.5879,  0.9056,  0.7966,
         0.1314,  0.9236,  0.9842,  0.1064,  0.4613,  0.4969,  0.4889,
         0.0240,  0.7969,  0.0433,  0.8168,  0.5901,  0.7895,  0.3152,
         0.2325,  0.2010,  0.1816,  0.2458,  0.0156,  0.2248,  0.7354,
         0.8717,  0.1596,  0.5339,  0.8000,  0.0359,  0.4680,  0.0335,
         0.0845,  0.9272,  0.0114,  0.7061,  0.1785,  0.8864,  0.0752,
         0.0977,  0.8609,  0.1509,  0.9536,  0.5528,  0.0340,  0.6025,
         0.0397,  0.1579,  0.0345,  0.7519,  0.0809,  0.6741,  0.2186,
         0.0032,  0.0537,  0.8786,  0.2417,  0.0020,  0.0260,  0.4511,
         0.0733,  0.9780,  0.8787,  0.9160,  0.0635,  0.8960,  0.1944,
         0.8117,  0.9334,  0.7481,  0.9393,  0.4105,  0.6493,  0.2948,
         0.2477,  0.0903,  0.0437,  0.7356,  0.0268,  0.0359,  0.9175,
         0.0225,  0.0510,  0.0859,  0.9889,  0.7769,  0.8645,  0.4734,
         0.6809,  0.8915,  0.0205,  0.0068,  0.0519,  0.7666,  0.7536,
         0.5282,  0.7624,  0.7151,  0.0963,  0.0492,  0.7975,  0.0576,
         0.2444,  0.6614,  0.6306,  0.0029,  0.0771,  0.0149,  0.8234,
         0.0265,  0.7979,  0.1605,  0.0486,  0.9295,  0.1279,  0.2166,
         0.2642,  0.5982,  0.0871,  0.2390,  0.7135,  0.0324,  0.3440,
         0.3797,  0.2608,  0.6645,  0.6856,  0.0897,  0.3123,  0.0742,
         0.7792,  0.0255,  0.8373,  0.8793,  0.0832,  0.0153,  0.8749,
         0.9434,  0.6279,  0.9988,  0.6369,  0.0517,  0.0305,  0.9848,
         0.4225,  0.1873,  0.7791,  0.8926,  0.5650,  0.0146,  0.3367,
         0.8760,  0.8730,  0.0316,  0.1257,  0.0047,  0.0162,  0.0915,
         0.0189,  0.7116,  0.5160,  0.1359,  0.2570,  0.7832,  0.3036,
         0.0075,  0.7612,  0.8326,  0.0721,  0.9135,  0.2991,  0.1259,
         0.0681,  0.4798,  0.0130,  0.8312,  0.0303,  0.9261,  0.8716,
         0.6889,  0.9884,  0.0269,  0.0718,  0.0662,  0.0330,  0.0294,
         0.0013,  0.3053,  0.3201,  0.9143,  0.9764,  0.9262,  0.0274,
         0.1063,  0.8243,  0.1096,  0.0374,  0.1046,  0.4361,  0.8634,
         0.0364,  0.3036,  0.0113,  0.2873,  0.9184,  0.9399,  0.0176,
         0.7614,  0.0485,  0.2389,  0.0624,  0.0159,  0.1684,  0.3764,
         0.3111,  0.8191,  0.9158,  0.8804,  0.5600,  0.0493,  0.9677,
         0.0473,  0.5552,  0.1427,  0.8461,  0.0554,  0.0306,  0.9420,
         0.5765,  0.1133,  0.4918,  0.8910,  0.0101,  0.7728,  0.2355,
         0.7405,  0.9862,  0.8327,  0.8113,  0.1513,  0.4741,  0.9635,
         0.1250,  0.0452,  0.8442,  0.0190,  0.0685,  0.0077,  0.5164,
         0.3209,  0.8361,  0.5520,  0.1697,  0.2747,  0.9746,  0.8613,
         0.8338,  0.0556,  0.0308,  0.0485,  0.5607,  0.3671,  0.8644,
         0.2195,  0.9528,  0.8689,  0.6904,  0.3832,  0.5436,  0.5394,
         0.6852,  0.0762,  0.3096,  0.9797,  0.7659,  0.9438,  0.0856,
         0.7315,  0.0611,  0.9948,  0.7643,  0.0219,  0.7557,  0.0376,
         0.1193,  0.0302,  0.9939,  0.8811,  0.0414,  0.8326,  0.8784,
         0.2408,  0.5575,  0.0153,  0.1900,  0.0699,  0.1758,  0.6995,
         0.7556,  0.2778,  0.0491,  0.2499,  0.1695,  0.0309,  0.0416,
         0.0182,  0.9712,  0.7008,  0.8899,  0.7681,  0.1110,  0.1766,
         0.7010], device='cuda:0')
tensor(0.3667, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6490,  0.9496,  0.0134,  0.6355,  0.9490,  0.8602,  0.8537,
         0.0023,  0.3130,  0.3473,  0.9532,  0.0407,  0.8950,  0.1146,
         0.8999,  0.2106,  0.9619,  0.9380,  0.6771,  0.0347,  0.9051,
         0.9885,  0.7080,  0.0427,  0.1585,  0.0309,  0.6944,  0.9947,
         0.9320,  0.5005,  0.9053,  0.0109,  0.7086,  0.0132,  0.0173,
         0.8693,  0.3081,  0.3185,  0.5750,  0.4093,  0.8396,  0.0810,
         0.2008,  0.1240,  0.8015,  0.0133,  0.1286,  0.2163,  0.5922,
         0.1268,  0.0125,  0.0305,  0.8068,  0.8329,  0.7718,  0.9127,
         0.1680,  0.1485,  0.5461,  0.0048,  0.7767,  0.9385,  0.0753,
         0.1779,  0.3032,  0.9078,  0.8440,  0.2421,  0.0166,  0.1261,
         0.2615,  0.3023,  0.0342,  0.3317,  0.3380,  0.8315,  0.4359,
         0.3944,  0.9281,  0.0912,  0.4766,  0.0283,  0.2094,  0.4870,
         0.1841,  0.0161,  0.9650,  0.6609,  0.0431,  0.0594,  0.8902,
         0.9963,  0.5376,  0.8801,  0.0802,  0.1258,  0.9011,  0.0070,
         0.9711,  0.9204,  0.0058,  0.8249,  0.0398,  0.0605,  0.9448,
         0.9605,  0.0819,  0.8625,  0.8802,  0.5854,  0.9285,  0.1743,
         0.9835,  0.8966,  0.0477,  0.0068,  0.9275,  0.9064,  0.0815,
         0.0718,  0.1844,  0.9954,  0.5682,  0.5726,  0.8189,  0.1891,
         0.1785,  0.0828,  0.7657,  0.0185,  0.7230,  0.8316,  0.9584,
         0.8602,  0.1385,  0.5705,  0.2098,  0.0696,  0.6273,  0.2617,
         0.2919,  0.0955,  0.7681,  0.6559,  0.9202,  0.6412,  0.2214,
         0.9925,  0.0401,  0.0103,  0.5532,  0.8113,  0.5176,  0.3053,
         0.6821,  0.4953,  0.9448,  0.9795,  0.4057,  0.9497,  0.1635,
         0.9828,  0.4614,  0.8868,  0.7934,  0.0701,  0.7235,  0.9478,
         0.1053,  0.5922,  0.9612,  0.6327,  0.0036,  0.9987,  0.0154,
         0.0395,  0.9049,  0.8312,  0.5166,  0.0463,  0.4211,  0.5537,
         0.9968,  0.6188,  0.0232,  0.8826,  0.8133,  0.9837,  0.8547,
         0.8350,  0.8468,  0.7908,  0.3942,  0.9835,  0.7178,  0.8760,
         0.9401,  0.0531,  0.1060,  0.3253,  0.0517,  0.1023,  0.0055,
         0.1153,  0.7777,  0.7650,  0.0566,  0.7131,  0.9577,  0.9861,
         0.2257,  0.5249,  0.8605,  0.1439,  0.9269,  0.2265,  0.0291,
         0.8015,  0.6048,  0.9563,  0.0714,  0.1297,  0.0532,  0.2040,
         0.2425,  0.8953,  0.8281,  0.0869,  0.0191,  0.2663,  0.9734,
         0.9694,  0.6825,  0.7322,  0.6977,  0.2328,  0.2689,  0.9951,
         0.4370,  0.9192,  0.0076,  0.0140,  0.9189,  0.8334,  0.3058,
         0.0386,  0.8183,  0.1347,  0.9759,  0.2768,  0.0504,  0.9926,
         0.0199,  0.9992,  0.9688,  0.9050,  0.1530,  0.6622,  0.5206,
         0.1737,  0.4636,  0.8647,  0.0580,  0.3501,  0.8881,  0.6316,
         0.1487,  0.1897,  0.9184,  0.9748,  0.9482,  0.9747,  0.5815,
         0.9141,  0.9137,  0.2786,  0.6158,  0.0793,  0.8836,  0.7925,
         0.3923,  0.0387,  0.0898,  0.5244,  0.1187,  0.7917,  0.8382,
         0.0282,  0.8774,  0.1698,  0.8747,  0.1051,  0.8935,  0.4952,
         0.8916,  0.8686,  0.9587,  0.2584,  0.5722,  0.0405,  0.2831,
         0.6863,  0.1423,  0.8289,  0.1721,  0.0455,  0.8624,  0.8061,
         0.4533,  0.8941,  0.0331,  0.5365,  0.2363,  0.4160,  0.6205,
         0.2244,  0.9310,  0.0225,  0.0791,  0.0076,  0.9012,  0.8961,
         0.7863,  0.0851,  0.0325,  0.7881,  0.1675,  0.4778,  0.9575,
         0.1442,  0.3222,  0.5616,  0.4610,  0.8287,  0.8667,  0.6641,
         0.8322,  0.0373,  0.7329,  0.7894,  0.8810,  0.1607,  0.8147,
         0.0040,  0.7524,  0.3002,  0.1075,  0.0779,  0.8990,  0.8975,
         0.7967,  0.5392,  0.4420,  0.0668,  0.3401,  0.0608,  0.6602,
         0.2651,  0.8925,  0.0230,  0.9806,  0.7781,  0.8982,  0.8873,
         0.9372,  0.0583,  0.7088,  0.0473,  0.0090,  0.1058,  0.9152,
         0.9102,  0.9056,  0.1485,  0.8853,  0.8457,  0.8472,  0.0134,
         0.0853,  0.9771,  0.0020,  0.0610,  0.8509,  0.8356,  0.7966,
         0.9814,  0.8371,  0.9074,  0.0962,  0.8776,  0.4332,  0.8032,
         0.1029,  0.0503,  0.4584,  0.8163,  0.8719,  0.0825,  0.8426,
         0.9612,  0.7946,  0.5674,  0.5709,  0.0430,  0.9282,  0.0016,
         0.7347,  0.9244,  0.5500,  0.0071,  0.0088,  0.0866,  0.0169,
         0.8562,  0.9613,  0.0315,  0.0422,  0.8706,  0.9995,  0.3858,
         0.3170,  0.1105,  0.9852,  0.6837,  0.0516,  0.9148,  0.8941,
         0.9548,  0.9330,  0.0777,  0.7425,  0.0496,  0.9177,  0.5333,
         0.9160,  0.9158,  0.0389,  0.7318,  0.1019,  0.8991,  0.9441,
         0.9523,  0.7051,  0.0816,  0.0113,  0.9225,  0.8382,  0.1134,
         0.8378,  0.0808,  0.9847,  0.9681,  0.9979,  0.0306,  0.0876,
         0.0201,  0.9043,  0.0101,  0.0415,  0.0998,  0.3917,  0.7086,
         0.5473,  0.4672,  0.9696,  0.0264,  0.0339,  0.6759,  0.8553,
         0.8576,  0.8292,  0.9789,  0.0184,  0.3017,  0.6774,  0.8907,
         0.8077,  0.8591,  0.9502,  0.0113,  0.9162,  0.0660,  0.9429,
         0.1011,  0.1355,  0.0510,  0.4401,  0.1267,  0.0128,  0.9105,
         0.2830,  0.2985,  0.5303,  0.4945,  0.0031,  0.0226,  0.0511,
         0.3556,  0.0020,  0.3319,  0.0499,  0.0102,  0.9685,  0.9869,
         0.8207,  0.0818,  0.2461,  0.8559,  0.9055,  0.0236,  0.8346,
         0.7191], device='cuda:0')
tensor(0.3871, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7872,  0.7264,  0.9421,  0.0718,  0.9150,  0.0553,  0.4243,
         0.2860,  0.0552,  0.6205,  0.8494,  0.0916,  0.8134,  0.9069,
         0.5149,  0.8180,  0.0667,  0.1650,  0.4443,  0.9302,  0.9382,
         0.9847,  0.9356,  0.1541,  0.6716,  0.9243,  0.7717,  0.7591,
         0.0927,  0.9812,  0.3162,  0.9459,  0.2276,  0.8782,  0.3678,
         0.2755,  0.8227,  0.2817,  0.9371,  0.5610,  0.9971,  0.7720,
         0.7631,  0.3732,  0.0577,  0.3590,  0.5609,  0.1160,  0.6490,
         0.1077,  0.0563,  0.0389,  0.0369,  0.0499,  0.0438,  0.3448,
         0.0437,  0.9937,  0.9141,  0.0898,  0.9596,  0.7390,  0.6342,
         0.9965,  0.9787,  0.7899,  0.9592,  0.5420,  0.7474,  0.9190,
         0.4406,  0.9973,  0.0834,  0.9197,  0.7228,  0.6375,  0.1859,
         0.1994,  0.8865,  0.4263,  0.8672,  0.0234,  0.0129,  0.6625,
         0.0022,  0.9025,  0.8087,  0.6547,  0.9291,  0.1627,  0.5207,
         0.2172,  0.8688,  0.9327,  0.1420,  0.9636,  0.9161,  0.9533,
         0.9115,  0.7318,  0.7122,  0.9645,  0.0077,  0.9990,  0.0556,
         0.9392,  0.8609,  0.0500,  0.0167,  0.8642,  0.4526,  0.9129,
         0.0473,  0.0126,  0.9995,  0.9026,  0.9088,  0.7278,  0.0902,
         0.0978,  0.0953,  0.1135,  0.9958,  0.7425,  0.8950,  0.9726,
         0.0439,  0.9191,  0.7138,  0.8797,  0.2998,  0.0356,  0.4509,
         0.0772,  0.0449,  0.0276,  0.0497,  0.2796,  0.2227,  0.1239,
         0.2239,  0.0619,  0.1543,  0.9958,  0.2104,  0.8536,  0.6098,
         0.8546,  0.8714,  0.7289,  0.3121,  0.9605,  0.4292,  0.0980,
         0.2572,  0.6463,  0.8863,  0.0097,  0.9500,  0.8079,  0.7103,
         0.7797,  0.0393,  0.2637,  0.8072,  0.0250,  0.8136,  0.0552,
         0.0972,  0.6208,  0.5181,  0.9295,  0.2228,  0.0131,  0.1149,
         0.9214,  0.4716,  0.0076,  0.1119,  0.0552,  0.1491,  0.0594,
         0.4569,  0.0136,  0.9851,  0.9643,  0.9776,  0.8577,  0.4181,
         0.9292,  0.9748,  0.8801,  0.0637,  0.8891,  0.1719,  0.1487,
         0.9899,  0.0325,  0.8692,  0.8947,  0.8602,  0.1794,  0.9451,
         0.9529,  0.7294,  0.9833,  0.3034,  0.3116,  0.0369,  0.9229,
         0.0181,  0.2078,  0.8695,  0.7147,  0.0297,  0.0286,  0.1099,
         0.5540,  0.8702,  0.0817,  0.0918,  0.2720,  0.9342,  0.7424,
         0.0055,  0.9763,  0.1372,  0.2017,  0.0641,  0.0832,  0.1135,
         0.1747,  0.2420,  0.0281,  0.8058,  0.8254,  0.8518,  0.8525,
         0.8110,  0.8373,  0.7718,  0.2603,  0.7771,  0.9446,  0.9549,
         0.3578,  0.0345,  0.7039,  0.8345,  0.4240,  0.9691,  0.7557,
         0.8682,  0.7444,  0.9887,  0.9325,  0.0260,  0.1751,  0.8655,
         0.9179,  0.1727,  0.2670,  0.9797,  0.9231,  0.3809,  0.1415,
         0.9474,  0.3369,  0.0405,  0.8569,  0.2429,  0.3829,  0.2221,
         0.8682,  0.2845,  0.8733,  0.0945,  0.7479,  0.9030,  0.1648,
         0.1385,  0.9906,  0.8295,  0.0221,  0.5402,  0.1398,  0.0075,
         0.0115,  0.6636,  0.1278,  0.9401,  0.8906,  0.3725,  0.3866,
         0.9202,  0.0630,  0.8029,  0.7787,  0.9382,  0.0913,  0.9494,
         0.0903,  0.8833,  0.3607,  0.9403,  0.7849,  0.1774,  0.8386,
         0.7796,  0.8428,  0.5894,  0.0771,  0.9986,  0.1999,  0.1540,
         0.9324,  0.8200,  0.9992,  0.6801,  0.0029,  0.0373,  0.0774,
         0.8761,  0.0443,  0.7363,  0.5733,  0.2187,  0.9215,  0.0129,
         0.8437,  0.8804,  0.1128,  0.7750,  0.9856,  0.7045,  0.8194,
         0.2518,  0.0153,  0.1030,  0.0046,  0.9155,  0.4165,  0.8745,
         0.7462,  0.6197,  0.1414,  0.6878,  0.8289,  0.8841,  0.0830,
         0.9714,  0.8510,  0.9324,  0.9194,  0.5915,  0.9176,  0.8575,
         0.7422,  0.0274,  0.1251,  0.9901,  0.0706,  0.2120,  0.0703,
         0.0377,  0.4176,  0.8952,  0.8263,  0.6436,  0.9752,  0.9087,
         0.9514,  0.0038,  0.9173,  0.9548,  0.8065,  0.5564,  0.1576,
         0.2101,  0.9787,  0.8147,  0.8680,  0.9772,  0.1729,  0.9650,
         0.9703,  0.1406,  0.6703,  0.1360,  0.7901,  0.9725,  0.0617,
         0.8932,  0.9145,  0.0810,  0.1367,  0.1675,  0.3632,  0.2424,
         0.9018,  0.4939,  0.3948,  0.0076,  0.1732,  0.9265,  0.0492,
         0.0553,  0.0107,  0.9821,  0.4228,  0.1832,  0.2612,  0.8422,
         0.9514,  0.3928,  0.0012,  0.9233,  0.9351,  0.1003,  0.9525,
         0.9733,  0.9612,  0.0609,  0.8341,  0.8988,  0.9704,  0.8714,
         0.0353,  0.7299,  0.8841,  0.9221,  0.4045,  0.9135,  0.5450,
         0.7205,  0.0706,  0.4510,  0.9511,  0.4667,  0.7898,  0.9155,
         0.0802,  0.9911,  0.8494,  0.4750,  0.9656,  0.0701,  0.2727,
         0.8093,  0.7864,  0.9911,  0.0361,  0.9878,  0.1563,  0.9924,
         0.1407,  0.9571,  0.0344,  0.8979,  0.7617,  0.7042,  0.9280,
         0.0943,  0.1226,  0.9446,  0.7727,  0.6464,  0.9957,  0.8887,
         0.1433,  0.6679,  0.2355,  0.3269,  0.3689,  0.9984,  0.8339,
         0.1509,  0.5159,  0.9167,  0.8636,  0.8962,  0.2067,  0.9239,
         0.9569,  0.4242,  0.7924,  0.8157,  0.0038,  0.0205,  0.1881,
         0.0027,  0.0360,  0.6950,  0.5691,  0.9096,  0.8887,  0.8593,
         0.0712,  0.6936,  0.2200,  0.5640,  0.7901,  0.8833,  0.8565,
         0.0453,  0.9479,  0.3692,  0.0953,  0.4875,  0.1916,  0.7064,
         0.0622], device='cuda:0')
tensor(0.3480, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8497,  0.4740,  0.9489,  0.9079,  0.9826,  0.9660,  0.9033,
         0.6718,  0.0884,  0.1021,  0.3353,  0.0931,  0.9533,  0.9654,
         0.9919,  0.0848,  0.9553,  0.0040,  0.8316,  0.9554,  0.8734,
         0.2214,  0.1599,  0.8902,  0.3319,  0.8337,  0.0687,  0.9284,
         0.9525,  0.8950,  0.3223,  0.9872,  0.3959,  0.9293,  0.0110,
         0.1104,  0.5414,  0.7074,  0.2398,  0.9967,  0.9019,  0.1212,
         0.9992,  0.0052,  0.4239,  0.9227,  0.8657,  0.0755,  0.3955,
         0.0957,  0.3789,  0.0483,  0.0110,  0.9066,  0.0121,  0.7259,
         0.8452,  0.9556,  0.0272,  0.0684,  0.2641,  0.2613,  0.9406,
         0.0549,  0.0600,  0.6318,  0.7471,  0.0035,  0.8808,  0.0579,
         0.9659,  0.8359,  0.0951,  0.9977,  0.9827,  0.7298,  0.9874,
         0.3876,  0.8803,  0.1427,  0.9199,  0.9726,  0.9651,  0.0099,
         0.9976,  0.9377,  0.0633,  0.0060,  0.5966,  0.8168,  0.9665,
         0.8789,  0.8573,  0.2285,  0.9801,  0.8247,  0.4681,  0.8046,
         0.0071,  0.9344,  0.5675,  0.9984,  0.2670,  0.9774,  0.7564,
         0.0583,  0.9624,  0.9795,  0.9381,  0.6584,  0.0416,  0.8274,
         0.8951,  0.0414,  0.9336,  0.0125,  0.6584,  0.9665,  0.9859,
         0.9678,  0.9420,  0.6816,  0.9238,  0.9829,  0.6853,  0.9964,
         0.9011,  0.8632,  0.0400,  0.0810,  0.6289,  0.5758,  0.9834,
         0.9497,  0.2829,  0.9433,  0.0152,  0.9584,  0.9546,  0.7874,
         0.9887,  0.5255,  0.5493,  0.1016,  0.9078,  0.9586,  0.2166,
         0.2068,  0.0289,  0.6225,  0.2109,  0.6510,  0.9443,  0.9181,
         0.0532,  0.0360,  0.1021,  0.9517,  0.7462,  0.0772,  0.0403,
         0.9531,  0.8724,  0.6442,  0.2226,  0.6972,  0.6639,  0.9940,
         0.9590,  0.6879,  0.0132,  0.0467,  0.1360,  0.2427,  0.0088,
         0.7912,  0.7981,  0.9667,  0.3893,  0.7690,  0.9708,  0.7679,
         0.9196,  0.9851,  0.1837,  0.3872,  0.2466,  0.9658,  0.0419,
         0.9179,  0.9710,  0.9560,  0.9789,  0.9627,  0.9530,  0.0268,
         0.0353,  0.8862,  0.8894,  0.9620,  0.1402,  0.0400,  0.9101,
         0.9917,  0.3240,  0.2805,  0.9163,  0.9822,  0.8354,  0.8637,
         0.9485,  0.6890,  0.8665,  0.0432,  0.9472,  0.9000,  0.9336,
         0.9384,  0.4244,  0.9865,  0.1739,  0.0336,  0.0577,  0.0729,
         0.9172,  0.2399,  0.2136,  0.9151,  0.3277,  0.9840,  0.1839,
         0.7940,  0.4025,  0.8176,  0.8826,  0.9619,  0.6698,  0.0051,
         0.0673,  0.2306,  0.8085,  0.8299,  0.8578,  0.9595,  0.0468,
         0.1408,  0.0704,  0.9292,  0.8177,  0.9610,  0.9747,  0.1351,
         0.8653,  0.9725,  0.9650,  0.9412,  0.9624,  0.4040,  0.9925,
         0.0252,  0.9060,  0.0118,  0.9828,  0.5388,  0.9427,  0.9555,
         0.9576,  0.7561,  0.9687,  0.1350,  0.0106,  0.0313,  0.6295,
         0.9076,  0.3746,  0.9652,  0.9849,  0.9677,  0.2926,  0.1366,
         0.4270,  0.9658,  0.8649,  0.9101,  0.2845,  0.9193,  0.9591,
         0.0235,  0.8688,  0.9858,  0.5751,  0.9976,  0.0190,  0.0076,
         0.0102,  0.4892,  0.7198,  0.0735,  0.9380,  0.2474,  0.9450,
         0.7288,  0.0911,  0.0540,  0.9454,  0.9641,  0.0349,  0.8845,
         0.9747,  0.9375,  0.0385,  0.9696,  0.6820,  0.9448,  0.9889,
         0.3222,  0.2263,  0.0674,  0.9806,  0.8068,  0.0821,  0.8911,
         0.9361,  0.6426,  0.0156,  0.9866,  0.9329,  0.0499,  0.8679,
         0.8364,  0.1576,  0.8361,  0.8398,  0.8915,  0.3266,  0.0303,
         0.1949,  0.3629,  0.0325,  0.1609,  0.3754,  0.2482,  0.1482,
         0.8431,  0.0267,  0.2117,  0.3811,  0.0334,  0.9780,  0.7066,
         0.0207,  0.0222,  0.9158,  0.2318,  0.0765,  0.0573,  0.9396,
         0.0683,  0.8073,  0.8214,  0.9766,  0.9021,  0.4719,  0.4486,
         0.3108,  0.9314,  0.9382,  0.6208,  0.8782,  0.8501,  0.0168,
         0.7943,  0.9839,  0.3127,  0.8899,  0.9427,  0.3892,  0.8756,
         0.9179,  0.1827,  0.9336,  0.0790,  0.0345,  0.0501,  0.9858,
         0.9613,  0.9868,  0.9355,  0.9616,  0.4079,  0.9672,  0.7231,
         0.2062,  0.9108,  0.7684,  0.0291,  0.7275,  0.7609,  0.8995,
         0.8420,  0.1115,  0.8626,  0.9860,  0.9279,  0.0280,  0.8280,
         0.9368,  0.0471,  0.1431,  0.9579,  0.8999,  0.0394,  0.3587,
         0.9350,  0.8461,  0.9067,  0.9952,  0.7957,  0.9236,  0.9105,
         0.1588,  0.9270,  0.9669,  0.8961,  0.9075,  0.9318,  0.0568,
         0.0800,  0.8717,  0.5398,  0.8932,  0.1239,  0.6045,  0.8553,
         0.9817,  0.5464,  0.9545,  0.7146,  0.9839,  0.1947,  0.8506,
         0.0238,  0.8860,  0.6922,  0.3472,  0.7965,  0.0375,  0.6343,
         0.0906,  0.0743,  0.0339,  0.1936,  0.0042,  0.9395,  0.0304,
         0.8830,  0.0114,  0.9440,  0.8701,  0.2780,  0.0338,  0.3403,
         0.7359,  0.9750,  0.9838,  0.0131,  0.8417,  0.0892,  0.5196,
         0.8194,  0.7074,  0.6871,  0.1297,  0.9992,  0.1537,  0.8325,
         0.9567,  0.9995,  0.8943,  0.9471,  0.9562,  0.2197,  0.4548,
         0.9550,  0.0328,  0.9774,  0.8224,  0.5838,  0.9917,  0.8192,
         0.3783,  0.3699,  0.0893,  0.1450,  0.9463,  0.0090,  0.6965,
         0.9145,  0.9516,  0.9589,  0.9721,  0.3873,  0.0987,  0.0105,
         0.9696,  0.1165,  0.0923,  0.9786,  0.0213,  0.9006,  0.9415,
         0.9620], device='cuda:0')
tensor(0.3373, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2314,  0.8318,  0.0302,  0.9843,  0.9265,  0.8805,  0.9487,
         0.6828,  0.9924,  0.3999,  0.0636,  0.8809,  0.7086,  0.1991,
         0.8788,  0.0599,  0.9877,  0.9782,  0.1254,  0.9647,  0.0140,
         0.0051,  0.0365,  0.0150,  0.5019,  0.9418,  0.8619,  0.7892,
         0.8327,  0.9487,  0.9409,  0.3146,  0.0045,  0.4382,  0.9329,
         0.6844,  0.2799,  0.7703,  0.9246,  0.6726,  0.6595,  0.2752,
         0.0392,  0.7863,  0.9774,  0.0513,  0.9235,  0.8575,  0.4797,
         0.8688,  0.9117,  0.9064,  0.9617,  0.0659,  0.1809,  0.4329,
         0.1166,  0.1104,  0.8507,  0.9328,  0.9675,  0.9657,  0.1288,
         0.7439,  0.9242,  0.9186,  0.9075,  0.9186,  0.5885,  0.5364,
         0.9502,  0.9567,  0.4052,  0.6420,  0.5543,  0.8835,  0.9816,
         0.6404,  0.9465,  0.9663,  0.0076,  0.9868,  0.2612,  0.0495,
         0.9083,  0.0612,  0.1043,  0.1210,  0.0785,  0.9692,  0.1404,
         0.0168,  0.0477,  0.9872,  0.8974,  0.0443,  0.5917,  0.1946,
         0.0357,  0.1864,  0.3860,  0.4415,  0.9408,  0.7088,  0.9432,
         0.5957,  0.0081,  0.8837,  0.0581,  0.0220,  0.9443,  0.9619,
         0.9168,  0.7899,  0.9152,  0.1916,  0.9334,  0.0150,  0.3061,
         0.2377,  0.9467,  0.9279,  0.2139,  0.9563,  0.9379,  0.0349,
         0.2903,  0.9347,  0.0209,  0.0490,  0.6634,  0.1883,  0.0680,
         0.4707,  0.9377,  0.0461,  0.9343,  0.1371,  0.1769,  0.5175,
         0.4259,  0.2056,  0.7097,  0.1053,  0.0959,  0.0205,  0.8339,
         0.8239,  0.2525,  0.0167,  0.1539,  0.9525,  0.8779,  0.0060,
         0.0082,  0.9613,  0.0668,  0.1401,  0.0570,  0.9826,  0.8643,
         0.8395,  0.0680,  0.9678,  0.7101,  0.9763,  0.0298,  0.9793,
         0.7820,  0.9631,  0.9799,  0.0132,  0.9320,  0.8231,  0.9009,
         0.9588,  0.9589,  0.9018,  0.0010,  0.2061,  0.1834,  0.1950,
         0.2164,  0.7883,  0.6849,  0.7741,  0.9891,  0.9576,  0.1088,
         0.9681,  0.1944,  0.1108,  0.2641,  0.8915,  0.9438,  0.7784,
         0.3966,  0.8630,  0.7873,  0.0265,  0.0207,  0.9254,  0.3077,
         0.7708,  0.9810,  0.7921,  0.9064,  0.9474,  0.0577,  0.0656,
         0.4064,  0.9973,  0.0121,  0.3582,  0.8650,  0.8050,  0.1368,
         0.9160,  0.0392,  0.2007,  0.9693,  0.0529,  0.2333,  0.8573,
         0.6132,  0.0202,  0.6920,  0.0554,  0.6530,  0.0833,  0.1807,
         0.1338,  0.2308,  0.6240,  0.0803,  0.2023,  0.0266,  0.4448,
         0.8891,  0.0481,  0.9614,  0.0928,  0.6329,  0.4628,  0.7147,
         0.3891,  0.5397,  0.1288,  0.8583,  0.8330,  0.8955,  0.3618,
         0.2842,  0.1163,  0.2181,  0.9737,  0.9642,  0.9577,  0.0351,
         0.7941,  0.0455,  0.8003,  0.8638,  0.6244,  0.0923,  0.1041,
         0.9207,  0.5139,  0.0806,  0.0884,  0.3351,  0.3028,  0.0627,
         0.8583,  0.5218,  0.7223,  0.9320,  0.0579,  0.9908,  0.0390,
         0.7349,  0.9295,  0.8352,  0.8989,  0.5520,  0.0240,  0.7684,
         0.0791,  0.0535,  0.9611,  0.6985,  0.6067,  0.7467,  0.0016,
         0.0149,  0.7642,  0.9740,  0.3702,  0.0106,  0.9664,  0.9844,
         0.9059,  0.4686,  0.3892,  0.0488,  0.5938,  0.2367,  0.9249,
         0.2929,  0.8113,  0.9513,  0.0445,  0.1860,  0.9251,  0.0209,
         0.2426,  0.9573,  0.4167,  0.0067,  0.8277,  0.9956,  0.2139,
         0.9841,  0.2812,  0.0978,  0.0049,  0.8824,  0.0458,  0.0229,
         0.1721,  0.8803,  0.9634,  0.7394,  0.5576,  0.8086,  0.1330,
         0.0811,  0.4213,  0.9275,  0.8910,  0.9971,  0.4139,  0.9722,
         0.0090,  0.1733,  0.8297,  0.1233,  0.9773,  0.0541,  0.4043,
         0.0326,  0.6529,  0.9518,  0.9564,  0.9283,  0.0960,  0.7688,
         0.8763,  0.0645,  0.3298,  0.2565,  0.8692,  0.9192,  0.6312,
         0.9991,  0.9979,  0.0069,  0.8748,  0.0376,  0.0319,  0.9934,
         0.8685,  0.6897,  0.9146,  0.7820,  0.9490,  0.4641,  0.8074,
         0.0516,  0.0185,  0.8852,  0.5851,  0.9864,  0.2156,  0.0393,
         0.8950,  0.8563,  0.0988,  0.5333,  0.8625,  0.6244,  0.0692,
         0.9434,  0.1202,  0.2711,  0.0242,  0.8712,  0.9025,  0.7969,
         0.9064,  0.9265,  0.0348,  0.0336,  0.0057,  0.9692,  0.0901,
         0.6938,  0.0165,  0.3787,  0.0334,  0.0172,  0.9690,  0.5262,
         0.8001,  0.0087,  0.9898,  0.1296,  0.2590,  0.8548,  0.4614,
         0.6346,  0.1011,  0.0707,  0.9284,  0.2442,  0.8986,  0.9370,
         0.0377,  0.9974,  0.9001,  0.9471,  0.9119,  0.0082,  0.3808,
         0.9616,  0.9069,  0.9150,  0.9281,  0.2874,  0.7001,  0.7289,
         0.9478,  0.0356,  0.9848,  0.8905,  0.0972,  0.3719,  0.3496,
         0.1124,  0.9797,  0.0228,  0.4971,  0.0401,  0.0121,  0.0420,
         0.7984,  0.9078,  0.0013,  0.9114,  0.9622,  0.2653,  0.6049,
         0.9895,  0.0670,  0.9470,  0.2866,  0.9051,  0.9308,  0.0869,
         0.9861,  0.4693,  0.8652,  0.8560,  0.9270,  0.0204,  0.0496,
         0.9158,  0.8101,  0.4516,  0.9798,  0.0249,  0.1098,  0.6745,
         0.9637,  0.2178,  0.9980,  0.9712,  0.8802,  0.8645,  0.9240,
         0.0424,  0.9962,  0.1627,  0.0570,  0.0275,  0.9759,  0.1527,
         0.6089,  0.8440,  0.6834,  0.7779,  0.0484,  0.5725,  0.0940,
         0.9216,  0.7845,  0.0102,  0.2835,  0.5907,  0.8943,  0.1261,
         0.8775], device='cuda:0')
tensor(0.3364, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8549,  0.1009,  0.6220,  0.0505,  0.0214,  0.8831,  0.0402,
         0.0387,  0.0059,  0.8934,  0.0695,  0.9220,  0.9796,  0.9454,
         0.1905,  0.0955,  0.3586,  0.1917,  0.9449,  0.1091,  0.9259,
         0.2311,  0.0368,  0.0241,  0.7545,  0.1689,  0.9560,  0.9394,
         0.9565,  0.2345,  0.3909,  0.8974,  0.9636,  0.4127,  0.0418,
         0.9230,  0.7414,  0.1168,  0.8258,  0.0977,  0.9574,  0.0094,
         0.0116,  0.9818,  0.8089,  0.0101,  0.1994,  0.1500,  0.0837,
         0.9360,  0.9647,  0.9064,  0.1074,  0.1482,  0.8270,  0.9006,
         0.0382,  0.7648,  0.9703,  0.9395,  0.0211,  0.0524,  0.7541,
         0.0315,  0.2695,  0.0370,  0.6137,  0.6519,  0.9659,  0.3966,
         0.8906,  0.9129,  0.9105,  0.2899,  0.7668,  0.0893,  0.6306,
         0.0571,  0.0114,  0.9262,  0.2673,  0.0019,  0.9877,  0.9357,
         0.0041,  0.8343,  0.0338,  0.8556,  0.7730,  0.4462,  0.0894,
         0.7125,  0.1497,  0.9745,  0.9360,  0.0340,  0.8850,  0.9383,
         0.9878,  0.9994,  0.1080,  0.0167,  0.2801,  0.1565,  0.0195,
         0.9310,  0.9022,  0.0482,  0.9794,  0.8293,  0.0335,  0.0495,
         0.8644,  0.6073,  0.8584,  0.7997,  0.9756,  0.8678,  0.7696,
         0.2282,  0.1090,  0.0664,  0.9978,  0.8120,  0.4765,  0.9044,
         0.8607,  0.7525,  0.9146,  0.2129,  0.0029,  0.1506,  0.0381,
         0.2023,  0.9604,  0.0491,  0.8373,  0.9563,  0.6864,  0.0393,
         0.5477,  0.7629,  0.9202,  0.4279,  0.1236,  0.1865,  0.9207,
         0.0305,  0.9557,  0.0803,  0.0430,  0.8967,  0.9566,  0.0529,
         0.6770,  0.0241,  0.8983,  0.8341,  0.1124,  0.7814,  0.7917,
         0.1067,  0.0642,  0.9574,  0.5253,  0.6661,  0.3606,  0.9011,
         0.1035,  0.0600,  0.9045,  0.0527,  0.7916,  0.8855,  0.1088,
         0.0760,  0.0447,  0.7372,  0.1936,  0.0461,  0.1934,  0.0197,
         0.7352,  0.0194,  0.9290,  0.9805,  0.0169,  0.0251,  0.1447,
         0.1954,  0.0143,  0.7348,  0.1537,  0.0704,  0.8583,  0.8496,
         0.4529,  0.9098,  0.5866,  0.0025,  0.7242,  0.9553,  0.9834,
         0.9789,  0.3608,  0.8147,  0.0252,  0.0068,  0.7907,  0.5321,
         0.0068,  0.1253,  0.9085,  0.2147,  0.2785,  0.0120,  0.9618,
         0.6478,  0.8013,  0.0159,  0.6725,  0.0464,  0.7817,  0.8230,
         0.9658,  0.0298,  0.0502,  0.0955,  0.0041,  0.0816,  0.9092,
         0.9489,  0.9363,  0.2048,  0.0173,  0.0424,  0.2521,  0.0260,
         0.0068,  0.0570,  0.1931,  0.1679,  0.8665,  0.0369,  0.1613,
         0.8123,  0.5707,  0.8805,  0.9455,  0.0907,  0.1113,  0.9805,
         0.0535,  0.9219,  0.2054,  0.0603,  0.0233,  0.9041,  0.7117,
         0.1549,  0.7016,  0.9074,  0.0796,  0.1128,  0.0472,  0.2554,
         0.9213,  0.1119,  0.4724,  0.0190,  0.9773,  0.8515,  0.0737,
         0.8461,  0.8302,  0.6925,  0.7301,  0.0179,  0.8982,  0.0168,
         0.0123,  0.9672,  0.7829,  0.0791,  0.0195,  0.0024,  0.2214,
         0.9260,  0.9207,  0.0054,  0.7668,  0.7468,  0.8987,  0.9365,
         0.9273,  0.0041,  0.6094,  0.5809,  0.9293,  0.0320,  0.0371,
         0.2840,  0.0377,  0.8813,  0.9554,  0.0409,  0.8811,  0.7980,
         0.0333,  0.1305,  0.2212,  0.9643,  0.1245,  0.8364,  0.4465,
         0.9267,  0.9604,  0.9589,  0.9816,  0.1754,  0.6495,  0.0097,
         0.5670,  0.0942,  0.3898,  0.9298,  0.0995,  0.9356,  0.5131,
         0.0498,  0.1407,  0.9756,  0.0048,  0.0242,  0.0929,  0.0432,
         0.6197,  0.0189,  0.0480,  0.0721,  0.9181,  0.6706,  0.8887,
         0.9619,  0.4822,  0.1163,  0.1978,  0.9428,  0.2039,  0.7754,
         0.2403,  0.1080,  0.0157,  0.7662,  0.9430,  0.8648,  0.0491,
         0.7448,  0.9212,  0.8074,  0.9724,  0.1364,  0.8188,  0.0566,
         0.0181,  0.5423,  0.1002,  0.2309,  0.2211,  0.8754,  0.9962,
         0.0225,  0.0797,  0.0430,  0.0863,  0.8675,  0.9100,  0.8818,
         0.9978,  0.2615,  0.7523,  0.8804,  0.8046,  0.0296,  0.0394,
         0.1097,  0.3439,  0.0915,  0.1648,  0.0910,  0.2961,  0.7485,
         0.4541,  0.4109,  0.0791,  0.0729,  0.0991,  0.0594,  0.0343,
         0.7705,  0.9227,  0.8935,  0.9333,  0.0469,  0.9382,  0.9346,
         0.0388,  0.9538,  0.9867,  0.4765,  0.9592,  0.0204,  0.0517,
         0.0977,  0.8774,  0.8638,  0.0647,  0.9952,  0.8983,  0.1643,
         0.1444,  0.7873,  0.0133,  0.4357,  0.1258,  0.0687,  0.9328,
         0.1036,  0.0534,  0.0237,  0.2424,  0.0556,  0.0068,  0.9559,
         0.8839,  0.2407,  0.9436,  0.0075,  0.0218,  0.8761,  0.0017,
         0.4996,  0.0190,  0.7284,  0.8027,  0.7305,  0.8204,  0.8564,
         0.9819,  0.0174,  0.9704,  0.1116,  0.3278,  0.3297,  0.9512,
         0.9518,  0.0072,  0.2090,  0.8186,  0.4855,  0.8507,  0.8855,
         0.0829,  0.8916,  0.5326,  0.7743,  0.0620,  0.2141,  0.3581,
         0.8920,  0.8652,  0.0661,  0.9347,  0.2222,  0.9410,  0.7164,
         0.1897,  0.8674,  0.8470,  0.0207,  0.0036,  0.9831,  0.0023,
         0.0600,  0.8427,  0.9835,  0.9530,  0.0972,  0.3569,  0.4189,
         0.8319,  0.0139,  0.9792,  0.5237,  0.2687,  0.0950,  0.0588,
         0.5765,  0.7921,  0.8900,  0.9257,  0.0158,  0.0243,  0.7724,
         0.0022,  0.8781,  0.1558,  0.9978,  0.0312,  0.1881,  0.0528,
         0.5971], device='cuda:0')
tensor(0.3175, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8936,  0.7029,  0.2649,  0.5364,  0.1097,  0.9720,  0.5908,
         0.9988,  0.8305,  0.0760,  0.6237,  0.3533,  0.0080,  0.0226,
         0.7689,  0.1263,  0.0707,  0.0109,  0.3242,  0.3831,  0.0462,
         0.0172,  0.1087,  0.8757,  0.0193,  0.1628,  0.9993,  0.2577,
         0.0280,  0.0528,  0.0230,  0.0231,  0.0019,  0.9536,  0.0375,
         0.5840,  0.7008,  0.0679,  0.4046,  0.0420,  0.1151,  0.0342,
         0.1427,  0.0784,  0.9598,  0.0843,  0.5743,  0.6653,  0.2619,
         0.8747,  0.7211,  0.9821,  0.8984,  0.8563,  0.1788,  0.2932,
         0.2824,  0.8660,  0.0436,  0.9467,  0.0597,  0.1009,  0.0482,
         0.5670,  0.7336,  0.6665,  0.8533,  0.2628,  0.7900,  0.4974,
         0.9758,  0.7517,  0.0887,  0.0134,  0.1956,  0.4251,  0.8028,
         0.0812,  0.9881,  0.9692,  0.7741,  0.0073,  0.0624,  0.4914,
         0.0041,  0.0338,  0.1774,  0.6810,  0.8837,  0.0174,  0.8895,
         0.0250,  0.4254,  0.0146,  0.4450,  0.6384,  0.0229,  0.0563,
         0.1714,  0.1048,  0.1265,  0.0252,  0.2373,  0.5644,  0.1432,
         0.5983,  0.0557,  0.8212,  0.0240,  0.2236,  0.7007,  0.6972,
         0.8644,  0.5321,  0.9915,  0.1182,  0.2655,  0.0683,  0.0212,
         0.0865,  0.0477,  0.8441,  0.9178,  0.9155,  0.9874,  0.9911,
         0.0783,  0.1292,  0.0012,  0.5080,  0.0085,  0.4859,  0.9869,
         0.2289,  0.0407,  0.7463,  0.0039,  0.1598,  0.9740,  0.6240,
         0.9315,  0.0587,  0.1490,  0.0015,  0.9756,  0.0056,  0.8883,
         0.8456,  0.0199,  0.8035,  0.8873,  0.9843,  0.8706,  0.9421,
         0.0242,  0.0168,  0.6815,  0.8287,  0.9364,  0.9987,  0.0796,
         0.8887,  0.2009,  0.0332,  0.4881,  0.0535,  0.0611,  0.8877,
         0.0015,  0.0615,  0.9662,  0.6911,  0.8310,  0.7951,  0.0762,
         0.0047,  0.9049,  0.0286,  0.9489,  0.9578,  0.3306,  0.0845,
         0.9653,  0.2218,  0.7268,  0.8208,  0.9502,  0.1316,  0.0655,
         0.6859,  0.0827,  0.0552,  0.5639,  0.0193,  0.4070,  0.0741,
         0.0132,  0.0420,  0.5035,  0.3776,  0.0129,  0.0470,  0.0290,
         0.0037,  0.0242,  0.5174,  0.9638,  0.6417,  0.1137,  0.9946,
         0.9641,  0.9759,  0.0614,  0.0480,  0.0177,  0.5255,  0.9143,
         0.1407,  0.9287,  0.9583,  0.8657,  0.9391,  0.0439,  0.8948,
         0.6001,  0.9024,  0.9479,  0.9508,  0.0495,  0.5113,  0.0887,
         0.5177,  0.0550,  0.1361,  0.4190,  0.7621,  0.0198,  0.0498,
         0.1095,  0.1066,  0.7475,  0.0828,  0.0340,  0.3280,  0.1694,
         0.1213,  0.7986,  0.0078,  0.0323,  0.0203,  0.0029,  0.8869,
         0.0262,  0.0516,  0.7636,  0.1449,  0.4583,  0.8189,  0.6460,
         0.7890,  0.8309,  0.9235,  0.1552,  0.0236,  0.0101,  0.9021,
         0.0032,  0.1375,  0.0663,  0.2285,  0.1149,  0.0270,  0.0266,
         0.9263,  0.1339,  0.0104,  0.9436,  0.6773,  0.0289,  0.7317,
         0.4711,  0.9936,  0.1602,  0.0216,  0.0215,  0.8175,  0.7839,
         0.0679,  0.7600,  0.1629,  0.5373,  0.9309,  0.8827,  0.9746,
         0.7103,  0.0200,  0.1840,  0.3547,  0.0261,  0.1234,  0.8794,
         0.9720,  0.0538,  0.9443,  0.8528,  0.5665,  0.3393,  0.0326,
         0.9499,  0.0269,  0.8838,  0.4749,  0.0057,  0.0458,  0.2275,
         0.1951,  0.4165,  0.0010,  0.0039,  0.1618,  0.2369,  0.3000,
         0.0586,  0.9766,  0.0177,  0.8878,  0.9798,  0.8898,  0.0620,
         0.9114,  0.1276,  0.0804,  0.9259,  0.0414,  0.0758,  0.0129,
         0.6375,  0.6499,  0.0115,  0.2094,  0.3339,  0.7785,  0.0741,
         0.0679,  0.0474,  0.0133,  0.7069,  0.6626,  0.8695,  0.0197,
         0.9808,  0.9974,  0.7343,  0.0019,  0.0224,  0.3957,  0.0012,
         0.3259,  0.7520,  0.9068,  0.9507,  0.0103,  0.8629,  0.7729,
         0.7615,  0.8609,  0.9629,  0.2168,  0.1970,  0.7735,  0.9946,
         0.1903,  0.0173,  0.2268,  0.0218,  0.3481,  0.9573,  0.0478,
         0.1257,  0.9036,  0.9024,  0.3456,  0.9304,  0.0361,  0.9881,
         0.9225,  0.0592,  0.0645,  0.2744,  0.4533,  0.0010,  0.9301,
         0.6055,  0.0167,  0.0045,  0.0212,  0.2851,  0.3273,  0.0247,
         0.9102,  0.1029,  0.9964,  0.9422,  0.1142,  0.4896,  0.0320,
         0.1991,  0.9794,  0.0152,  0.0682,  0.1112,  0.9513,  0.5849,
         0.1560,  0.8723,  0.6135,  0.8603,  0.1293,  0.8715,  0.0833,
         0.7296,  0.0036,  0.3759,  0.0629,  0.3938,  0.8768,  0.5772,
         0.4196,  0.0259,  0.0372,  0.0063,  0.6067,  0.8665,  0.0044,
         0.2658,  0.0478,  0.0092,  0.1252,  0.4887,  0.0015,  0.5067,
         0.8945,  0.9402,  0.9009,  0.0129,  0.9714,  0.0378,  0.9698,
         0.0078,  0.9366,  0.0692,  0.3423,  0.0358,  0.7739,  0.9134,
         0.0175,  0.0192,  0.0407,  0.0018,  0.7598,  0.9003,  0.2876,
         0.1425,  0.6338,  0.9952,  0.0392,  0.2669,  0.0743,  0.1927,
         0.1482,  0.3284,  0.8910,  0.1489,  0.8232,  0.7738,  0.4794,
         0.9459,  0.3508,  0.7254,  0.9636,  0.8411,  0.9778,  0.1046,
         0.9298,  0.0084,  0.0119,  0.9276,  0.3806,  0.8067,  0.0132,
         0.0410,  0.0448,  0.9229,  0.2367,  0.9309,  0.8314,  0.5615,
         0.1431,  0.9429,  0.8215,  0.3145,  0.6632,  0.3770,  0.0073,
         0.8520,  0.0043,  0.8882,  0.9358,  0.0080,  0.0200,  0.8402,
         0.1250], device='cuda:0')
tensor(0.3695, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0512,  0.1767,  0.0235,  0.0845,  0.0662,  0.1315,  0.3548,
         0.4298,  0.9741,  0.4981,  0.0114,  0.0056,  0.0327,  0.0341,
         0.0184,  0.8843,  0.9508,  0.3810,  0.0346,  0.0315,  0.1349,
         0.8496,  0.2312,  0.5009,  0.9155,  0.0260,  0.7564,  0.0372,
         0.1879,  0.3684,  0.7492,  0.9726,  0.9556,  0.3086,  0.6427,
         0.0707,  0.8892,  0.0337,  0.0671,  0.8767,  0.5263,  0.0858,
         0.6487,  0.5587,  0.0097,  0.9654,  0.8985,  0.0009,  0.0274,
         0.7918,  0.0323,  0.9203,  0.0230,  0.6660,  0.7256,  0.5021,
         0.5638,  0.9895,  0.4062,  0.0708,  0.9177,  0.0179,  0.7531,
         0.1993,  0.1370,  0.0095,  0.5496,  0.0602,  0.0292,  0.1137,
         0.8605,  0.0767,  0.1080,  0.3561,  0.0953,  0.9207,  0.8234,
         0.0146,  0.3543,  0.3562,  0.5958,  0.1048,  0.8380,  0.0134,
         0.0942,  0.0759,  0.0840,  0.5105,  0.6634,  0.9186,  0.4297,
         0.3647,  0.0532,  0.9495,  0.3052,  0.9305,  0.2113,  0.0476,
         0.0637,  0.9584,  0.0260,  0.8097,  0.1505,  0.0135,  0.2010,
         0.8575,  0.2485,  0.0314,  0.0632,  0.8671,  0.2906,  0.1377,
         0.0155,  0.0698,  0.1531,  0.6552,  0.0453,  0.1668,  0.3212,
         0.3008,  0.4307,  0.7495,  0.3119,  0.8675,  0.1978,  0.2419,
         0.1134,  0.9156,  0.0247,  0.0681,  0.6538,  0.7070,  0.0153,
         0.9384,  0.9216,  0.0522,  0.1573,  0.0247,  0.9741,  0.4269,
         0.1808,  0.0358,  0.7202,  0.7134,  0.9461,  0.9255,  0.6437,
         0.2209,  0.6293,  0.7714,  0.9208,  0.0269,  0.0065,  0.9619,
         0.9850,  0.9666,  0.2401,  0.1773,  0.1948,  0.8894,  0.9848,
         0.7438,  0.5217,  0.3637,  0.0074,  0.1144,  0.7953,  0.7661,
         0.2719,  0.8551,  0.0448,  0.0240,  0.3125,  0.0337,  0.8079,
         0.1184,  0.4187,  0.8550,  0.9442,  0.0261,  0.9489,  0.3189,
         0.9110,  0.9806,  0.6036,  0.2352,  0.1553,  0.2088,  0.2043,
         0.6762,  0.9774,  0.1777,  0.5829,  0.0536,  0.0501,  0.3338,
         0.1050,  0.9870,  0.0249,  0.2837,  0.0208,  0.4875,  0.5440,
         0.7872,  0.9703,  0.0196,  0.0106,  0.2383,  0.0398,  0.9349,
         0.2927,  0.0672,  0.0709,  0.2424,  0.8086,  0.9968,  0.9520,
         0.9043,  0.9723,  0.3350,  0.1500,  0.1036,  0.7507,  0.0938,
         0.0159,  0.8411,  0.8630,  0.2475,  0.4027,  0.6759,  0.8543,
         0.0178,  0.8443,  0.8562,  0.0872,  0.0402,  0.9567,  0.0019,
         0.3995,  0.0038,  0.5669,  0.5457,  0.9970,  0.7864,  0.4581,
         0.0459,  0.2872,  0.3222,  0.0663,  0.3363,  0.8204,  0.0239,
         0.6907,  0.9600,  0.9362,  0.8685,  0.1100,  0.8142,  0.8265,
         0.0188,  0.0655,  0.9822,  0.1330,  0.9268,  0.6364,  0.5138,
         0.0403,  0.4557,  0.9218,  0.3000,  0.0289,  0.0244,  0.2810,
         0.9816,  0.2474,  0.8935,  0.3026,  0.2489,  0.9390,  0.0683,
         0.0245,  0.1031,  0.7316,  0.0577,  0.9842,  0.5886,  0.0065,
         0.0037,  0.0616,  0.9996,  0.0156,  0.0525,  0.1293,  0.9709,
         0.1247,  0.4555,  0.0075,  0.0103,  0.9068,  0.0363,  0.1032,
         0.0116,  0.6259,  0.1369,  0.6547,  0.9642,  0.8932,  0.0296,
         0.9260,  0.7548,  0.3477,  0.5796,  0.0181,  0.0303,  0.0789,
         0.8364,  0.5046,  0.9510,  0.1766,  0.0365,  0.7530,  0.0122,
         0.1523,  0.0700,  0.9041,  0.2784,  0.2304,  0.0186,  0.8462,
         0.0692,  0.4338,  0.0627,  0.9720,  0.1038,  0.0378,  0.0409,
         0.0217,  0.0309,  0.1976,  0.0271,  0.2931,  0.2301,  0.9010,
         0.9504,  0.0192,  0.0337,  0.8500,  0.7501,  0.8723,  0.4919,
         0.0371,  0.0297,  0.4070,  0.1283,  0.8443,  0.8021,  0.5109,
         0.1777,  0.8629,  0.1719,  0.8941,  0.0368,  0.8687,  0.2779,
         0.2318,  0.0731,  0.8429,  0.8926,  0.6938,  0.0038,  0.9879,
         0.8848,  0.0744,  0.9637,  0.1530,  0.0599,  0.8158,  0.9163,
         0.0130,  0.6113,  0.0845,  0.9541,  0.3098,  0.9149,  0.0031,
         0.0783,  0.5372,  0.9364,  0.9388,  0.2283,  0.1250,  0.1210,
         0.4164,  0.8696,  0.1179,  0.3138,  0.0424,  0.8094,  0.0438,
         0.9765,  0.8677,  0.0215,  0.8594,  0.0990,  0.1589,  0.8948,
         0.0178,  0.6399,  0.0643,  0.0031,  0.4459,  0.6661,  0.0438,
         0.6751,  0.9412,  0.4804,  0.0210,  0.0061,  0.0178,  0.6827,
         0.0164,  0.2135,  0.0392,  0.0804,  0.5803,  0.0160,  0.0374,
         0.9747,  0.8038,  0.8248,  0.7148,  0.6789,  0.7929,  0.4328,
         0.4083,  0.2828,  0.0733,  0.9321,  0.6078,  0.0071,  0.9340,
         0.0104,  0.0375,  0.1151,  0.9810,  0.8650,  0.2353,  0.9842,
         0.1982,  0.0974,  0.0090,  0.5939,  0.9972,  0.2755,  0.2830,
         0.2415,  0.0025,  0.9850,  0.5138,  0.2128,  0.5989,  0.6096,
         0.0622,  0.0018,  0.0133,  0.5403,  0.7627,  0.9315,  0.8899,
         0.7659,  0.8115,  0.0611,  0.1046,  0.0123,  0.4262,  0.8370,
         0.4070,  0.9216,  0.1372,  0.0286,  0.5376,  0.2485,  0.0218,
         0.4188,  0.5960,  0.9558,  0.0592,  0.5802,  0.8053,  0.0879,
         0.0608,  0.7332,  0.9648,  0.1058,  0.1560,  0.8998,  0.9209,
         0.5034,  0.0938,  0.7981,  0.9090,  0.8814,  0.4270,  0.1435,
         0.9840,  0.9748,  0.7187,  0.0600,  0.1291,  0.6119,  0.4351,
         0.1574], device='cuda:0')
tensor(0.3563, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0103,  0.8365,  0.0239,  0.3390,  0.4845,  0.6991,  0.0070,
         0.2505,  0.6674,  0.9025,  0.8117,  0.0383,  0.0224,  0.8116,
         0.0255,  0.2161,  0.1675,  0.8874,  0.0113,  0.4376,  0.7416,
         0.3581,  0.1549,  0.1837,  0.9812,  0.9922,  0.8888,  0.3073,
         0.9419,  0.0037,  0.0637,  0.8198,  0.8480,  0.2750,  0.2859,
         0.2912,  0.2878,  0.8800,  0.0601,  0.1030,  0.8631,  0.9240,
         0.2894,  0.3018,  0.0357,  0.0400,  0.1729,  0.0437,  0.5295,
         0.1015,  0.9576,  0.0524,  0.1031,  0.0295,  0.0275,  0.0292,
         0.1770,  0.0555,  0.9970,  0.0837,  0.7235,  0.9933,  0.9757,
         0.8723,  0.4507,  0.0332,  0.0940,  0.7431,  0.0053,  0.6933,
         0.4076,  0.0288,  0.3278,  0.5497,  0.8602,  0.8935,  0.5075,
         0.0343,  0.6971,  0.9515,  0.6024,  0.4460,  0.9456,  0.1953,
         0.0969,  0.1123,  0.4595,  0.6552,  0.2099,  0.9208,  0.0789,
         0.9648,  0.0336,  0.6035,  0.1159,  0.1252,  0.7719,  0.9265,
         0.1311,  0.2732,  0.1449,  0.0412,  0.0397,  0.1634,  0.0969,
         0.9817,  0.9241,  0.0509,  0.9656,  0.6372,  0.7828,  0.6917,
         0.9157,  0.0326,  0.8409,  0.0583,  0.9435,  0.8827,  0.9638,
         0.2843,  0.0821,  0.4618,  0.0236,  0.7147,  0.0929,  0.0540,
         0.7616,  0.8574,  0.0930,  0.0870,  0.0282,  0.9989,  0.0436,
         0.7808,  0.9439,  0.0483,  0.9517,  0.1931,  0.9131,  0.9591,
         0.0716,  0.8580,  0.5928,  0.8500,  0.8004,  0.0834,  0.0776,
         0.2899,  0.7869,  0.0644,  0.6549,  0.4041,  0.6843,  0.9789,
         0.2972,  0.8791,  0.8143,  0.0025,  0.9832,  0.5682,  0.7919,
         0.1416,  0.3606,  0.0959,  0.0144,  0.4977,  0.0421,  0.0225,
         0.4647,  0.9308,  0.1405,  0.0678,  0.1694,  0.4255,  0.3112,
         0.5038,  0.1640,  0.6788,  0.0408,  0.2271,  0.0238,  0.4558,
         0.9964,  0.9378,  0.1638,  0.8785,  0.0688,  0.9307,  0.9127,
         0.5688,  0.1736,  0.4326,  0.0302,  0.3122,  0.0281,  0.0874,
         0.2800,  0.0731,  0.0810,  0.0329,  0.2398,  0.9369,  0.8057,
         0.9962,  0.0699,  0.2355,  0.9074,  0.8434,  0.8726,  0.1432,
         0.9600,  0.7797,  0.8457,  0.3499,  0.0899,  0.9230,  0.5797,
         0.0107,  0.0058,  0.0741,  0.0989,  0.9175,  0.0080,  0.0661,
         0.0874,  0.1472,  0.9849,  0.8192,  0.8509,  0.6234,  0.0137,
         0.6701,  0.0006,  0.0700,  0.9545,  0.4621,  0.9466,  0.7549,
         0.6784,  0.0519,  0.8055,  0.0032,  0.1809,  0.0887,  0.0975,
         0.4232,  0.9884,  0.1322,  0.8446,  0.0124,  0.4459,  0.0546,
         0.7254,  0.1823,  0.0329,  0.8826,  0.2444,  0.9546,  0.9258,
         0.8705,  0.0343,  0.4119,  0.0892,  0.3989,  0.0152,  0.9236,
         0.0079,  0.0181,  0.3293,  0.9441,  0.0147,  0.0770,  0.9006,
         0.0224,  0.9892,  0.0823,  0.5838,  0.0282,  0.9928,  0.0078,
         0.0229,  0.0875,  0.6075,  0.9249,  0.0099,  0.1110,  0.8381,
         0.8263,  0.8940,  0.0615,  0.8323,  0.0196,  0.0551,  0.6347,
         0.1126,  0.0504,  0.0528,  0.0055,  0.8300,  0.9861,  0.0175,
         0.5626,  0.9703,  0.9008,  0.9234,  0.0961,  0.6893,  0.7308,
         0.1420,  0.0360,  0.0081,  0.5519,  0.7806,  0.8525,  0.8746,
         0.1881,  0.7858,  0.9666,  0.9775,  0.9165,  0.0753,  0.9225,
         0.2267,  0.8334,  0.0234,  0.0998,  0.0308,  0.0737,  0.5317,
         0.1389,  0.2234,  0.9446,  0.0021,  0.7904,  0.8524,  0.9975,
         0.8908,  0.0798,  0.1106,  0.0691,  0.9911,  0.1447,  0.0470,
         0.6325,  0.9686,  0.0977,  0.0472,  0.9972,  0.8626,  0.1131,
         0.0116,  0.0616,  0.6710,  0.4827,  0.6277,  0.1141,  0.2251,
         0.1570,  0.6497,  0.7121,  0.0237,  0.8841,  0.2237,  0.8338,
         0.0032,  0.9509,  0.9554,  0.6445,  0.8561,  0.0708,  0.0901,
         0.1805,  0.8462,  0.8736,  0.5602,  0.6115,  0.9646,  0.5871,
         0.0362,  0.6550,  0.3907,  0.0416,  0.3599,  0.7858,  0.0351,
         0.4289,  0.6556,  0.6482,  0.7172,  0.0171,  0.9507,  0.1253,
         0.5455,  0.2242,  0.9751,  0.2297,  0.2147,  0.8441,  0.9418,
         0.1421,  0.9367,  0.1882,  0.1576,  0.9856,  0.8492,  0.7637,
         0.1950,  0.9611,  0.0042,  0.0700,  0.0532,  0.2199,  0.0762,
         0.6723,  0.0374,  0.8170,  0.0636,  0.9218,  0.2434,  0.1153,
         0.1884,  0.5726,  0.9822,  0.7064,  0.8255,  0.8743,  0.9084,
         0.1757,  0.9309,  0.1519,  0.6128,  0.4165,  0.6172,  0.0181,
         0.1752,  0.8261,  0.9068,  0.2842,  0.0792,  0.9229,  0.0330,
         0.1560,  0.4529,  0.9596,  0.9990,  0.1845,  0.9547,  0.5041,
         0.1101,  0.6630,  0.0035,  0.0667,  0.9331,  0.5424,  0.0418,
         0.5989,  0.0794,  0.8170,  0.1892,  0.7623,  0.1513,  0.1015,
         0.9763,  0.1195,  0.6787,  0.1220,  0.1172,  0.1781,  0.5060,
         0.0613,  0.1477,  0.6912,  0.4390,  0.9542,  0.7231,  0.8905,
         0.2905,  0.6238,  0.1214,  0.3983,  0.0993,  0.1396,  0.0276,
         0.9440,  0.1465,  0.1013,  0.0069,  0.4590,  0.2049,  0.0473,
         0.0696,  0.9320,  0.5838,  0.9633,  0.0845,  0.0169,  0.0468,
         0.0832,  0.4585,  0.7098,  0.1367,  0.7500,  0.6606,  0.3428,
         0.3016,  0.0370,  0.1837,  0.1078,  0.2251,  0.9107,  0.7738,
         0.8094], device='cuda:0')
tensor(0.3089, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7514,  0.1006,  0.2412,  0.1172,  0.9852,  0.2199,  0.8988,
         0.9363,  0.9957,  0.2723,  0.1322,  0.9975,  0.9846,  0.1113,
         0.0815,  0.0083,  0.8114,  0.0110,  0.9030,  0.1432,  0.9914,
         0.0964,  0.6200,  0.4139,  0.9956,  0.8659,  0.1339,  0.0188,
         0.9971,  0.2922,  0.7527,  0.3651,  0.7190,  0.7141,  0.3377,
         0.1134,  0.3459,  0.9484,  0.9223,  0.8800,  0.9441,  0.1840,
         0.6141,  0.3842,  0.2717,  0.0596,  0.0133,  0.0351,  0.0090,
         0.0062,  0.0748,  0.9791,  0.4061,  0.7085,  0.0296,  0.2248,
         0.9853,  0.7434,  0.9044,  0.2099,  0.1931,  0.8585,  0.0402,
         0.2522,  0.8222,  0.8845,  0.0737,  0.0343,  0.0129,  0.0055,
         0.2159,  0.0424,  0.6506,  0.3810,  0.1231,  0.2486,  0.5292,
         0.7703,  0.1301,  0.2593,  0.8866,  0.1413,  0.0966,  0.9591,
         0.9914,  0.1026,  0.1436,  0.2191,  0.8113,  0.2553,  0.5506,
         0.5526,  0.3921,  0.0728,  0.9658,  0.8819,  0.0352,  0.0105,
         0.0446,  0.0565,  0.9280,  0.7501,  0.2147,  0.8287,  0.9546,
         0.3643,  0.6369,  0.9846,  0.9285,  0.2709,  0.7012,  0.9820,
         0.0016,  0.9515,  0.2702,  0.4714,  0.3719,  0.7084,  0.6461,
         0.4575,  0.1166,  0.9059,  0.8053,  0.3085,  0.9412,  0.9101,
         0.5404,  0.9324,  0.0042,  0.6100,  0.8655,  0.8869,  0.8917,
         0.7682,  0.6434,  0.9819,  0.7986,  0.2288,  0.1228,  0.9945,
         0.8761,  0.4990,  0.8332,  0.8385,  0.9097,  0.3190,  0.9845,
         0.6169,  0.7598,  0.7925,  0.4100,  0.0217,  0.9858,  0.1332,
         0.9224,  0.8701,  0.2277,  0.9418,  0.8360,  0.6705,  0.2812,
         0.4133,  0.0736,  0.9035,  0.5393,  0.6689,  0.9958,  0.4641,
         0.5234,  0.1244,  0.2441,  0.1273,  0.6000,  0.0232,  0.0112,
         0.8865,  0.7489,  0.8644,  0.9620,  0.9833,  0.0383,  0.8181,
         0.7367,  0.1021,  0.1051,  0.8178,  0.5909,  0.1619,  0.6388,
         0.7517,  0.0038,  0.9935,  0.0179,  0.8135,  0.0014,  0.4662,
         0.0540,  0.8903,  0.1564,  0.0572,  0.2538,  0.1018,  0.4106,
         0.9944,  0.7524,  0.1559,  0.9344,  0.0398,  0.0165,  0.1755,
         0.0877,  0.9907,  0.2291,  0.2430,  0.6761,  0.8340,  0.3589,
         0.8546,  0.3318,  0.8118,  0.7020,  0.7066,  0.9486,  0.0558,
         0.7725,  0.7312,  0.7151,  0.7832,  0.9963,  0.0024,  0.1563,
         0.8903,  0.9268,  0.3171,  0.7575,  0.8856,  0.0112,  0.6905,
         0.0895,  0.7441,  0.5477,  0.1485,  0.9233,  0.1356,  0.9921,
         0.9759,  0.0397,  0.8408,  0.1924,  0.5435,  0.2947,  0.8972,
         0.8424,  0.9675,  0.0316,  0.9854,  0.0493,  0.9289,  0.9552,
         0.9954,  0.9435,  0.6951,  0.1580,  0.1202,  0.8179,  0.1429,
         0.7763,  0.8979,  0.7485,  0.9013,  0.8170,  0.1970,  0.1317,
         0.9734,  0.9224,  0.1293,  0.9676,  0.9172,  0.2656,  0.9597,
         0.6787,  0.0373,  0.0731,  0.6767,  0.2219,  0.9242,  0.9559,
         0.2864,  0.2969,  0.6383,  0.0262,  0.8058,  0.1818,  0.4081,
         0.7919,  0.1300,  0.8827,  0.2498,  0.8616,  0.1896,  0.0221,
         0.0696,  0.6974,  0.1706,  0.4533,  0.9644,  0.1822,  0.6026,
         0.0905,  0.9566,  0.8999,  0.9861,  0.1075,  0.1940,  0.0854,
         0.9133,  0.9350,  0.1182,  0.2392,  0.9754,  0.9419,  0.3118,
         0.9847,  0.8989,  0.7735,  0.6731,  0.5239,  0.8046,  0.9983,
         0.2638,  0.7755,  0.9625,  0.0396,  0.0355,  0.9451,  0.1047,
         0.8521,  0.7177,  0.4634,  0.9427,  0.9438,  0.1118,  0.7733,
         0.1391,  0.9921,  0.6825,  0.8847,  0.7763,  0.8215,  0.0053,
         0.1839,  0.0587,  0.3370,  0.8818,  0.3127,  0.6506,  0.2404,
         0.8542,  0.6751,  0.9141,  0.9564,  0.1876,  0.7728,  0.6002,
         0.6067,  0.7177,  0.1909,  0.9785,  0.9590,  0.0359,  0.9510,
         0.6813,  0.9272,  0.3314,  0.0631,  0.4671,  0.9210,  0.9988,
         0.0464,  0.8760,  0.1474,  0.1503,  0.1279,  0.8270,  0.9941,
         0.1798,  0.8261,  0.1137,  0.0526,  0.5680,  0.6213,  0.8906,
         0.0098,  0.5475,  0.0878,  0.7352,  0.5717,  0.1651,  0.9676,
         0.0098,  0.3703,  0.1234,  0.7531,  0.1401,  0.7860,  0.8427,
         0.0049,  0.6437,  0.0034,  0.6335,  0.9545,  0.9696,  0.8963,
         0.0247,  0.2393,  0.2316,  0.9779,  0.8591,  0.8790,  0.1214,
         0.1716,  0.8669,  0.5455,  0.1300,  0.9535,  0.9990,  0.0660,
         0.7473,  0.8935,  0.7339,  0.1613,  0.8479,  0.7004,  0.2703,
         0.9506,  0.5239,  0.2817,  0.6893,  0.0030,  0.8265,  0.9688,
         0.5033,  0.4227,  0.0702,  0.8905,  0.9557,  0.8058,  0.3450,
         0.4770,  0.9847,  0.9990,  0.2535,  0.9212,  0.1929,  0.9238,
         0.3149,  0.0684,  0.0239,  0.9282,  0.3583,  0.9499,  0.5349,
         0.0837,  0.8951,  0.1294,  0.2023,  0.0120,  0.7661,  0.8106,
         0.9399,  0.0056,  0.3804,  0.1819,  0.0677,  0.2307,  0.3609,
         0.1288,  0.3798,  0.9443,  0.7314,  0.4727,  0.1293,  0.9506,
         0.0724,  0.3256,  0.8830,  0.0742,  0.4080,  0.0122,  0.8938,
         0.9794,  0.4981,  0.1064,  0.0578,  0.4690,  0.0045,  0.0713,
         0.0644,  0.6369,  0.5666,  0.2214,  0.8992,  0.1204,  0.1224,
         0.1989,  0.9589,  0.9397,  0.9078,  0.3957,  0.7438,  0.0378,
         0.1627], device='cuda:0')
tensor(0.3516, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2255,  0.9476,  0.9810,  0.9117,  0.0097,  0.0214,  0.1413,
         0.9593,  0.8626,  0.9450,  0.6900,  0.9177,  0.9532,  0.5857,
         0.8797,  0.0880,  0.7794,  0.5817,  0.0561,  0.5590,  0.8715,
         0.9487,  0.2599,  0.7120,  0.9732,  0.9260,  0.2446,  0.7426,
         0.9653,  0.7549,  0.4393,  0.0104,  0.9447,  0.9042,  0.1237,
         0.1698,  0.0514,  0.3660,  0.1732,  0.9307,  0.0276,  0.1153,
         0.3895,  0.9391,  0.8298,  0.9791,  0.2538,  0.1688,  0.2388,
         0.9084,  0.3626,  0.9989,  0.3725,  0.0417,  0.2855,  0.2617,
         0.9755,  0.5646,  0.2631,  0.1867,  0.9429,  0.9912,  0.5000,
         0.2793,  0.2321,  0.2549,  0.8558,  0.5663,  0.9821,  0.9984,
         0.4650,  0.0223,  0.4655,  0.9984,  0.8522,  0.9270,  0.1649,
         0.0545,  0.3829,  0.1970,  0.0360,  0.8833,  0.9060,  0.1772,
         0.6109,  0.1339,  0.0823,  0.9452,  0.0475,  0.0577,  0.9710,
         0.8569,  0.9828,  0.4342,  0.2173,  0.2114,  0.8921,  0.9378,
         0.7192,  0.3097,  0.1793,  0.6010,  0.8834,  0.7070,  0.9876,
         0.5450,  0.8589,  0.2174,  0.8810,  0.3145,  0.1155,  0.4139,
         0.8887,  0.0626,  0.8474,  0.2809,  0.4176,  0.8771,  0.7929,
         0.1815,  0.6719,  0.8100,  0.1004,  0.8568,  0.9102,  0.2745,
         0.5267,  0.2773,  0.9147,  0.6108,  0.2469,  0.0901,  0.9092,
         0.7618,  0.9554,  0.8729,  0.8749,  0.4031,  0.8106,  0.2527,
         0.9578,  0.9479,  0.9778,  0.7827,  0.8680,  0.0384,  0.1151,
         0.8960,  0.1463,  0.2228,  0.9246,  0.9664,  0.9349,  0.1160,
         0.7758,  0.9410,  0.5286,  0.6180,  0.9667,  0.8999,  0.1305,
         0.1414,  0.1329,  0.9205,  0.0306,  0.9807,  0.2413,  0.8786,
         0.6271,  0.9757,  0.6386,  0.0375,  0.0818,  0.9354,  0.1337,
         0.1590,  0.2577,  0.6478,  0.8547,  0.5972,  0.8947,  0.1853,
         0.3339,  0.9979,  0.6343,  0.7667,  0.4792,  0.4700,  0.9781,
         0.0558,  0.8663,  0.6001,  0.9205,  0.0671,  0.4643,  0.8877,
         0.0244,  0.0150,  0.6420,  0.8515,  0.1009,  0.9493,  0.9238,
         0.7344,  0.7406,  0.9462,  0.1705,  0.1789,  0.0097,  0.0832,
         0.0948,  0.4985,  0.8953,  0.2118,  0.4863,  0.9816,  0.8539,
         0.1766,  0.8780,  0.9227,  0.4767,  0.0817,  0.9114,  0.7625,
         0.6471,  0.9161,  0.3282,  0.2822,  0.0372,  0.9655,  0.0982,
         0.8929,  0.9570,  0.8381,  0.8658,  0.7682,  0.5713,  0.7448,
         0.6125,  0.3027,  0.8757,  0.9239,  0.9839,  0.7868,  0.9565,
         0.9576,  0.0789,  0.6542,  0.1598,  0.9550,  0.9487,  0.3953,
         0.1318,  0.8483,  0.2589,  0.5398,  0.8397,  0.1771,  0.1584,
         0.6764,  0.9664,  0.0503,  0.0667,  0.8527,  0.8206,  0.9589,
         0.9218,  0.8945,  0.9152,  0.1234,  0.0429,  0.0402,  0.8906,
         0.9661,  0.6811,  0.0401,  0.6364,  0.9993,  0.8964,  0.1257,
         0.2384,  0.1257,  0.9579,  0.0255,  0.9219,  0.9500,  0.1204,
         0.3547,  0.8557,  0.0996,  0.9472,  0.8182,  0.2273,  0.0809,
         0.1596,  0.7422,  0.4752,  0.8532,  0.9437,  0.0206,  0.8249,
         0.4061,  0.5931,  0.1533,  0.8982,  0.6482,  0.3314,  0.6546,
         0.9353,  0.6579,  0.3622,  0.8752,  0.7463,  0.8906,  0.9214,
         0.0057,  0.9210,  0.1153,  0.6099,  0.9097,  0.7215,  0.4030,
         0.7488,  0.9284,  0.6779,  0.1956,  0.0654,  0.2779,  0.8849,
         0.9816,  0.9436,  0.5643,  0.0223,  0.9666,  0.0463,  0.8607,
         0.8191,  0.3996,  0.7153,  0.9312,  0.3324,  0.9860,  0.7855,
         0.0101,  0.9553,  0.9664,  0.1081,  0.9063,  0.7192,  0.5878,
         0.9678,  0.2695,  0.9211,  0.8374,  0.9855,  0.9226,  0.2365,
         0.5602,  0.8610,  0.2480,  0.0331,  0.0763,  0.9608,  0.4134,
         0.8629,  0.8933,  0.6167,  0.0196,  0.9725,  0.2263,  0.9584,
         0.7016,  0.5789,  0.8487,  0.0831,  0.0512,  0.2387,  0.9100,
         0.0200,  0.7706,  0.6558,  0.8952,  0.6395,  0.8274,  0.4855,
         0.8408,  0.7304,  0.9785,  0.0967,  0.8579,  0.9011,  0.0669,
         0.1464,  0.8803,  0.7689,  0.4801,  0.9300,  0.1607,  0.6916,
         0.8795,  0.6143,  0.9024,  0.9072,  0.7155,  0.6410,  0.6629,
         0.1557,  0.4105,  0.1712,  0.9310,  0.9451,  0.7719,  0.0341,
         0.6471,  0.1718,  0.1742,  0.8947,  0.9652,  0.0168,  0.1291,
         0.9343,  0.5596,  0.1991,  0.9217,  0.9062,  0.5226,  0.0202,
         0.9669,  0.9298,  0.8476,  0.0990,  0.0450,  0.0582,  0.9549,
         0.8846,  0.8878,  0.9903,  0.4061,  0.4934,  0.7781,  0.1516,
         0.0317,  0.5663,  0.2347,  0.4479,  0.9281,  0.6314,  0.0067,
         0.9296,  0.2094,  0.0304,  0.8259,  0.0155,  0.1877,  0.0714,
         0.0723,  0.9168,  0.2747,  0.0246,  0.8422,  0.0640,  0.7685,
         0.4023,  0.0348,  0.6457,  0.0059,  0.3980,  0.5066,  0.2844,
         0.2350,  0.4578,  0.8271,  0.9330,  0.9841,  0.9424,  0.0600,
         0.8408,  0.9267,  0.6542,  0.0170,  0.3563,  0.8714,  0.9564,
         0.9335,  0.9305,  0.1988,  0.3577,  0.9290,  0.8610,  0.8270,
         0.0991,  0.7939,  0.9754,  0.0100,  0.1695,  0.1802,  0.9149,
         0.9769,  0.7671,  0.0642,  0.9725,  0.1203,  0.7049,  0.8773,
         0.7946,  0.9369,  0.1186,  0.0189,  0.9468,  0.8972,  0.0969,
         0.9801], device='cuda:0')
tensor(0.3835, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9498,  0.5485,  0.8546,  0.0454,  0.0377,  0.8015,  0.8872,
         0.0560,  0.8087,  0.8085,  0.2494,  0.5874,  0.8295,  0.9710,
         0.8998,  0.8289,  0.3948,  0.1418,  0.7592,  0.8208,  0.0027,
         0.1028,  0.8380,  0.9290,  0.8642,  0.8526,  0.1187,  0.6525,
         0.0827,  0.0485,  0.7798,  0.6573,  0.0181,  0.6785,  0.0117,
         0.0296,  0.9156,  0.5988,  0.8059,  0.8487,  0.8010,  0.3651,
         0.4250,  0.9241,  0.9791,  0.0592,  0.9778,  0.0315,  0.9482,
         0.2425,  0.2574,  0.9603,  0.6988,  0.8908,  0.1517,  0.4295,
         0.0800,  0.0647,  0.7143,  0.5619,  0.8443,  0.8447,  0.0114,
         0.9572,  0.9992,  0.8465,  0.6131,  0.0536,  0.0648,  0.8929,
         0.6149,  0.9225,  0.9830,  0.9280,  0.9591,  0.4297,  0.7951,
         0.9490,  0.4744,  0.4850,  0.1685,  0.8893,  0.0731,  0.9929,
         0.0031,  0.4906,  0.9391,  0.2366,  0.5104,  0.0175,  0.9556,
         0.7788,  0.0096,  0.3374,  0.8181,  0.5140,  0.1158,  0.0874,
         0.9434,  0.7967,  0.6311,  0.9617,  0.7163,  0.9822,  0.9978,
         0.6297,  0.9089,  0.9735,  0.9790,  0.1711,  0.5830,  0.1035,
         0.7654,  0.9189,  0.3466,  0.6918,  0.8406,  0.5639,  0.0474,
         0.9797,  0.0055,  0.9251,  0.0356,  0.0537,  0.1469,  0.0113,
         0.0205,  0.9186,  0.9526,  0.1468,  0.9188,  0.0307,  0.9674,
         0.7949,  0.0305,  0.2132,  0.3275,  0.0322,  0.3737,  0.9361,
         0.5419,  0.7375,  0.9769,  0.0696,  0.9828,  0.2072,  0.9549,
         0.8587,  0.1470,  0.1414,  0.9354,  0.1466,  0.8545,  0.8386,
         0.9395,  0.9793,  0.0935,  0.9852,  0.7630,  0.9082,  0.9132,
         0.0933,  0.0783,  0.2422,  0.9945,  0.1474,  0.8285,  0.2541,
         0.9910,  0.0048,  0.8505,  0.1540,  0.8670,  0.2284,  0.0356,
         0.9865,  0.1191,  0.8564,  0.9035,  0.0114,  0.1153,  0.8453,
         0.1068,  0.9538,  0.7817,  0.9565,  0.8197,  0.0351,  0.9541,
         0.8560,  0.8858,  0.8990,  0.3638,  0.5956,  0.3316,  0.0276,
         0.0986,  0.8014,  0.8831,  0.9854,  0.9250,  0.7586,  0.4098,
         0.9833,  0.0752,  0.7224,  0.0805,  0.2699,  0.9844,  0.0519,
         0.9685,  0.8041,  0.5751,  0.1346,  0.0670,  0.0518,  0.9347,
         0.9191,  0.7268,  0.2030,  0.9194,  0.3812,  0.6090,  0.9334,
         0.8474,  0.0840,  0.8392,  0.9728,  0.1590,  0.9228,  0.0366,
         0.7851,  0.9770,  0.9020,  0.5100,  0.0294,  0.9257,  0.9981,
         0.9867,  0.3170,  0.0372,  0.8881,  0.3639,  0.9733,  0.9449,
         0.1699,  0.5181,  0.7886,  0.0168,  0.0490,  0.9214,  0.1825,
         0.4618,  0.5072,  0.9263,  0.1384,  0.9446,  0.7552,  0.9319,
         0.7799,  0.7289,  0.8537,  0.6835,  0.9994,  0.6131,  0.9683,
         0.9768,  0.9251,  0.4294,  0.9883,  0.3139,  0.5976,  0.3740,
         0.9363,  0.1520,  0.8181,  0.9610,  0.0060,  0.9618,  0.3939,
         0.9738,  0.8867,  0.0388,  0.8869,  0.9129,  0.2399,  0.9197,
         0.3857,  0.5606,  0.0190,  0.1166,  0.3503,  0.1543,  0.1328,
         0.8958,  0.7225,  0.7819,  0.1518,  0.8768,  0.9997,  0.8986,
         0.9844,  0.8561,  0.0592,  0.9704,  0.0856,  0.3640,  0.9529,
         0.0318,  0.9626,  0.9666,  0.9140,  0.9673,  0.7413,  0.7926,
         0.9003,  0.9912,  0.9006,  0.8193,  0.8535,  0.8829,  0.9842,
         0.0798,  0.1183,  0.8182,  0.9006,  0.9882,  0.9319,  0.2583,
         0.9214,  0.5961,  0.0608,  0.3152,  0.7033,  0.7146,  0.7331,
         0.7770,  0.0467,  0.9703,  0.9519,  0.0476,  0.0841,  0.9992,
         0.9600,  0.0341,  0.8198,  0.3542,  0.1509,  0.5555,  0.9173,
         0.1777,  0.1568,  0.0354,  0.9426,  0.6893,  0.9453,  0.8117,
         0.8126,  0.6886,  0.6284,  0.8383,  0.9456,  0.1878,  0.4683,
         0.5360,  0.0438,  0.2318,  0.2256,  0.9943,  0.0320,  0.9797,
         0.9950,  0.0692,  0.9443,  0.1983,  0.1985,  0.9854,  0.8668,
         0.7608,  0.3508,  0.1714,  0.9751,  0.9919,  0.9992,  0.9740,
         0.0913,  0.9844,  0.0477,  0.3897,  0.8228,  0.0104,  0.9427,
         0.0318,  0.9485,  0.0420,  0.4320,  0.7729,  0.0323,  0.9883,
         0.9870,  0.2584,  0.8029,  0.1034,  0.9985,  0.5205,  0.9549,
         0.0233,  0.0047,  0.9297,  0.0468,  0.0289,  0.0470,  0.8738,
         0.8505,  0.9722,  0.3169,  0.9014,  0.9356,  0.8659,  0.9227,
         0.3804,  0.2805,  0.9125,  0.1110,  0.4136,  0.9373,  0.8459,
         0.8792,  0.7225,  0.9541,  0.0136,  0.2093,  0.6616,  0.9431,
         0.4325,  0.6950,  0.5946,  0.9693,  0.1131,  0.1309,  0.9663,
         0.4461,  0.9738,  0.9833,  0.0366,  0.5441,  0.8099,  0.1163,
         0.9920,  0.0229,  0.0337,  0.5272,  0.6632,  0.1012,  0.7846,
         0.0564,  0.5448,  0.6726,  0.9249,  0.0058,  0.1033,  0.9987,
         0.2860,  0.2492,  0.7614,  0.9363,  0.8888,  0.1840,  0.8974,
         0.7783,  0.0114,  0.8214,  0.0821,  0.3253,  0.1272,  0.3234,
         0.8709,  0.4388,  0.0353,  0.9585,  0.9698,  0.9603,  0.1819,
         0.2856,  0.9438,  0.8346,  0.0844,  0.0201,  0.0255,  0.8017,
         0.0554,  0.7910,  0.9745,  0.9543,  0.3583,  0.8948,  0.9662,
         0.1211,  0.5204,  0.9731,  0.9868,  0.1127,  0.9852,  0.0224,
         0.8983,  0.8877,  0.0490,  0.2812,  0.9711,  0.9953,  0.8994,
         0.0053], device='cuda:0')
tensor(0.3341, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7796,  0.6635,  0.9963,  0.9973,  0.9019,  0.9861,  0.3492,
         0.9882,  0.9341,  0.9156,  0.2384,  0.2977,  0.3659,  0.8679,
         0.6386,  0.7605,  0.9666,  0.1172,  0.8533,  0.7157,  0.9857,
         0.6383,  0.0028,  0.0173,  0.1574,  0.9926,  0.9485,  0.9069,
         0.5858,  0.4618,  0.8323,  0.3159,  0.8121,  0.6522,  0.9874,
         0.9780,  0.9636,  0.8401,  0.0555,  0.7454,  0.9984,  0.8928,
         0.7989,  0.1132,  0.9859,  0.9307,  0.9883,  0.9025,  0.9131,
         0.0081,  0.5005,  0.7145,  0.2250,  0.9731,  0.9669,  0.7611,
         0.7404,  0.0372,  0.7522,  0.9525,  0.7061,  0.0324,  0.9097,
         0.7704,  0.0312,  0.7833,  0.0160,  0.0529,  0.7644,  0.9307,
         0.0050,  0.0550,  0.0032,  0.9465,  0.3499,  0.7019,  0.1677,
         0.9696,  0.9700,  0.4679,  0.0116,  0.9259,  0.6321,  0.9768,
         0.0881,  0.0920,  0.9674,  0.8381,  0.8477,  0.8432,  0.2856,
         0.8128,  0.8867,  0.5652,  0.0042,  0.4413,  0.0586,  0.9365,
         0.4023,  0.9971,  0.0132,  0.9575,  0.8868,  0.0623,  0.6549,
         0.3978,  0.4423,  0.9598,  0.8584,  0.5147,  0.8645,  0.2645,
         0.2806,  0.9377,  0.0407,  0.6957,  0.9563,  0.4749,  0.8083,
         0.9762,  0.7693,  0.8573,  0.0670,  0.9778,  0.8168,  0.0347,
         0.4702,  0.4269,  0.9867,  0.1908,  0.1497,  0.9775,  0.4715,
         0.0811,  0.7223,  0.8790,  0.1486,  0.8984,  0.9868,  0.8879,
         0.5769,  0.2985,  0.4804,  0.7602,  0.4720,  0.9534,  0.0392,
         0.9268,  0.8079,  0.1374,  0.7885,  0.9669,  0.9947,  0.9836,
         0.0986,  0.7367,  0.6047,  0.9367,  0.9874,  0.4650,  0.0164,
         0.9677,  0.5424,  0.1584,  0.2563,  0.9935,  0.5761,  0.9292,
         0.3620,  0.9772,  0.6410,  0.9637,  0.7932,  0.8070,  0.8825,
         0.8927,  0.1228,  0.1161,  0.9673,  0.7748,  0.0226,  0.9294,
         0.2264,  0.0809,  0.9997,  0.9981,  0.1088,  0.8539,  0.9819,
         0.0162,  0.6548,  0.1843,  0.6698,  0.8899,  0.9331,  0.9249,
         0.9712,  0.6025,  0.9855,  0.9755,  0.0069,  0.9100,  0.9980,
         0.3995,  0.4090,  0.8088,  0.1960,  0.0127,  0.9585,  0.9678,
         0.6455,  0.9989,  0.9884,  0.0770,  0.2647,  0.1235,  0.0125,
         0.3006,  0.8065,  0.8685,  0.9476,  0.0127,  0.0208,  0.0796,
         0.8053,  0.5473,  0.1916,  0.0258,  0.0923,  0.8975,  0.0671,
         0.9287,  0.0808,  0.9683,  0.1321,  0.9393,  0.9254,  0.9786,
         0.5151,  0.0243,  0.1156,  0.8311,  0.9977,  0.1656,  0.9225,
         0.8833,  0.0817,  0.0695,  0.7884,  0.2730,  0.6284,  0.8914,
         0.4888,  0.1254,  0.1703,  0.1700,  0.2147,  0.0332,  0.4761,
         0.1341,  0.9975,  0.1740,  0.2825,  0.8969,  0.3300,  0.0425,
         0.1627,  0.1478,  0.6846,  0.0944,  0.1224,  0.8115,  0.7135,
         0.1801,  0.8563,  0.2942,  0.9881,  0.9573,  0.0652,  0.0708,
         0.6873,  0.8669,  0.9942,  0.0712,  0.2603,  0.0357,  0.6164,
         0.9913,  0.5810,  0.0548,  0.7178,  0.8307,  0.7926,  0.0129,
         0.9836,  0.8007,  0.8299,  0.8258,  0.7630,  0.9482,  0.9183,
         0.3229,  0.7997,  0.0418,  0.9078,  0.0732,  0.1509,  0.9870,
         0.1798,  0.7832,  0.0141,  0.9741,  0.3881,  0.9989,  0.2482,
         0.2550,  0.9638,  0.9574,  0.7308,  0.9600,  0.0955,  0.0906,
         0.2402,  0.9328,  0.7281,  0.0367,  0.7405,  0.5757,  0.3012,
         0.5925,  0.1584,  0.0508,  0.8601,  0.1271,  0.9098,  0.3093,
         0.9595,  0.3371,  0.7731,  0.1717,  0.2698,  0.9657,  0.9539,
         0.9489,  0.8560,  0.1811,  0.8343,  0.7662,  0.8595,  0.5292,
         0.9314,  0.6103,  0.3404,  0.5962,  0.1471,  0.5502,  0.8490,
         0.1304,  0.0253,  0.9926,  0.0129,  0.0252,  0.8691,  0.7048,
         0.9841,  0.9383,  0.0740,  0.6659,  0.9200,  0.9508,  0.0296,
         0.1102,  0.0738,  0.7360,  0.9486,  0.0534,  0.0718,  0.7375,
         0.1047,  0.9138,  0.9384,  0.3511,  0.5942,  0.3663,  0.5216,
         0.0483,  0.7851,  0.8947,  0.0339,  0.9752,  0.8348,  0.0673,
         0.0874,  0.0201,  0.9626,  0.9567,  0.3703,  0.0164,  0.7828,
         0.1453,  0.7340,  0.0136,  0.1093,  0.8596,  0.6284,  0.0346,
         0.9975,  0.9599,  0.6607,  0.0246,  0.0122,  0.8634,  0.9227,
         0.1413,  0.6738,  0.0623,  0.9578,  0.0329,  0.8985,  0.9692,
         0.0290,  0.8750,  0.6162,  0.2186,  0.0178,  0.3047,  0.3783,
         0.9574,  0.8361,  0.9575,  0.4019,  0.6005,  0.9073,  0.8540,
         0.9995,  0.9976,  0.3006,  0.0289,  0.8706,  0.9863,  0.2208,
         0.0508,  0.8453,  0.9993,  0.0671,  0.2575,  0.8740,  0.0648,
         0.9120,  0.8245,  0.0554,  0.1889,  0.1760,  0.9220,  0.0724,
         0.9034,  0.8147,  0.3984,  0.0679,  0.9752,  0.9840,  0.9776,
         0.9470,  0.9940,  0.0342,  0.0280,  0.9571,  0.1669,  0.5168,
         0.9993,  0.8297,  0.5727,  0.1356,  0.8243,  0.9435,  0.9201,
         0.0279,  0.0138,  0.9515,  0.7859,  0.9802,  0.8449,  0.9572,
         0.9223,  0.1312,  0.0770,  0.2525,  0.0272,  0.5742,  0.9615,
         0.0999,  0.4341,  0.9176,  0.0748,  0.3868,  0.0675,  0.1405,
         0.9295,  0.9938,  0.9632,  0.4601,  0.2295,  0.4191,  0.3669,
         0.9701,  0.9635,  0.9504,  0.0226,  0.9839,  0.9655,  0.9909,
         0.9007], device='cuda:0')
tensor(0.3364, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9415,  0.0280,  0.5771,  0.9927,  0.9728,  0.8908,  0.0159,
         0.8148,  0.9419,  0.8323,  0.4932,  0.1642,  0.1619,  0.9425,
         0.0523,  0.0858,  0.2018,  0.7061,  0.0150,  0.7624,  0.8617,
         0.0473,  0.9559,  0.9581,  0.1535,  0.6084,  0.9106,  0.8979,
         0.5759,  0.0409,  0.9675,  0.9620,  0.3665,  0.5250,  0.6880,
         0.6621,  0.6720,  0.9198,  0.9348,  0.2874,  0.0485,  0.1240,
         0.9964,  0.3513,  0.0771,  0.9284,  0.7540,  0.9322,  0.9143,
         0.9106,  0.9991,  0.3048,  0.0523,  0.9706,  0.0087,  0.9054,
         0.1226,  0.2655,  0.0856,  0.0236,  0.8830,  0.0541,  0.6690,
         0.9064,  0.3272,  0.0491,  0.7811,  0.9372,  0.7282,  0.1954,
         0.9243,  0.9505,  0.0749,  0.0532,  0.0435,  0.7125,  0.1130,
         0.8459,  0.3751,  0.9552,  0.2688,  0.7000,  0.9988,  0.0328,
         0.7111,  0.9970,  0.7978,  0.0386,  0.9174,  0.0769,  0.0859,
         0.0604,  0.1735,  0.5426,  0.9953,  0.0174,  0.7388,  0.7831,
         0.0642,  0.1403,  0.0666,  0.8652,  0.0241,  0.9946,  0.3354,
         0.9611,  0.0544,  0.6977,  0.3826,  0.8816,  0.0936,  0.9591,
         0.0313,  0.9405,  0.0555,  0.9982,  0.0451,  0.7388,  0.0088,
         0.9198,  0.8875,  0.9069,  0.0426,  0.8415,  0.2513,  0.7847,
         0.2702,  0.5928,  0.0652,  0.0309,  0.9602,  0.3733,  0.7220,
         0.0384,  0.9887,  0.4754,  0.9205,  0.0962,  0.9066,  0.9605,
         0.9701,  0.8832,  0.9873,  0.9985,  0.8899,  0.1724,  0.3399,
         0.0515,  0.3132,  0.9407,  0.0350,  0.8834,  0.8182,  0.0809,
         0.3899,  0.9903,  0.9673,  0.1025,  0.0211,  0.9440,  0.9286,
         0.7008,  0.6437,  0.9700,  0.0875,  0.0056,  0.0273,  0.1799,
         0.4618,  0.9635,  0.9521,  0.9160,  0.1069,  0.9126,  0.9399,
         0.9103,  0.0486,  0.1215,  0.8049,  0.9183,  0.9869,  0.7273,
         0.0220,  0.9769,  0.3442,  0.2229,  0.5396,  0.0736,  0.1170,
         0.3032,  0.9880,  0.0354,  0.3230,  0.2481,  0.0706,  0.0533,
         0.4583,  0.9589,  0.9929,  0.9225,  0.0076,  0.9736,  0.9549,
         0.1844,  0.0918,  0.8849,  0.7199,  0.0626,  0.1415,  0.9500,
         0.4371,  0.1992,  0.9702,  0.7564,  0.3594,  0.8043,  0.3824,
         0.9512,  0.8985,  0.8516,  0.2853,  0.8331,  0.8194,  0.3595,
         0.2840,  0.9666,  0.8948,  0.7993,  0.8884,  0.3512,  0.0857,
         0.4391,  0.9752,  0.8611,  0.8615,  0.4632,  0.9238,  0.1895,
         0.9651,  0.2320,  0.9249,  0.1360,  0.4875,  0.7646,  0.7860,
         0.9583,  0.9743,  0.9734,  0.8881,  0.0115,  0.6997,  0.8863,
         0.6234,  0.6337,  0.9785,  0.9918,  0.9800,  0.0240,  0.9056,
         0.0792,  0.9974,  0.1348,  0.9127,  0.9998,  0.1519,  0.9746,
         0.9445,  0.9791,  0.9876,  0.0996,  0.3569,  0.5666,  0.2933,
         0.0429,  0.0108,  0.9559,  0.9265,  0.9903,  0.8966,  0.8753,
         0.1223,  0.8566,  0.7434,  0.0917,  0.6361,  0.6254,  0.1002,
         0.0645,  0.1556,  0.7121,  0.0243,  0.2557,  0.3963,  0.9267,
         0.0770,  0.8414,  0.8478,  0.7725,  0.7448,  0.9678,  0.1882,
         0.0099,  0.9463,  0.9947,  0.4225,  0.3159,  0.8732,  0.6393,
         0.3235,  0.6760,  0.7301,  0.9296,  0.8450,  0.9063,  0.0424,
         0.0788,  0.1860,  0.4705,  0.8924,  0.9909,  0.9110,  0.8510,
         0.9227,  0.8677,  0.8441,  0.6997,  0.7142,  0.0281,  0.9123,
         0.9511,  0.9673,  0.0216,  0.0264,  0.9363,  0.5883,  0.1133,
         0.9901,  0.9653,  0.6367,  0.0159,  0.4120,  0.0074,  0.8271,
         0.9428,  0.9797,  0.4584,  0.8899,  0.6429,  0.1628,  0.0777,
         0.9785,  0.3463,  0.2234,  0.9503,  0.0037,  0.9084,  0.8644,
         0.1556,  0.8142,  0.3502,  0.9158,  0.0050,  0.8977,  0.1275,
         0.9019,  0.8755,  0.9964,  0.2359,  0.9790,  0.9038,  0.9285,
         0.8148,  0.5311,  0.1950,  0.0907,  0.1608,  0.9404,  0.8110,
         0.9938,  0.1481,  0.0165,  0.2037,  0.0527,  0.9906,  0.3043,
         0.0240,  0.5264,  0.4932,  0.9169,  0.9747,  0.9903,  0.8524,
         0.8245,  0.9585,  0.0691,  0.1533,  0.1440,  0.8807,  0.2840,
         0.1551,  0.9425,  0.0054,  0.9371,  0.2850,  0.7883,  0.2652,
         0.0245,  0.9833,  0.9925,  0.0906,  0.9735,  0.8913,  0.9352,
         0.9357,  0.5568,  0.9787,  0.3915,  0.6170,  0.0362,  0.9842,
         0.9484,  0.6121,  0.0644,  0.5376,  0.1725,  0.9542,  0.0134,
         0.9796,  0.2526,  0.9854,  0.0151,  0.4771,  0.9247,  0.1522,
         0.6127,  0.0256,  0.9609,  0.9865,  0.2030,  0.0493,  0.7974,
         0.8106,  0.8357,  0.5093,  0.0183,  0.1135,  0.0034,  0.9701,
         0.0755,  0.8026,  0.0715,  0.0892,  0.6137,  0.2811,  0.2036,
         0.9887,  0.0035,  0.8748,  0.1013,  0.9374,  0.9783,  0.9967,
         0.9047,  0.6104,  0.0454,  0.5442,  0.0961,  0.2250,  0.0347,
         0.2349,  0.3133,  0.0614,  0.8557,  0.0514,  0.9553,  0.9840,
         0.0041,  0.1180,  0.9212,  0.9840,  0.9250,  0.8230,  0.9365,
         0.9919,  0.6820,  0.5534,  0.8938,  0.8422,  0.0322,  0.9094,
         0.1412,  0.0634,  0.9868,  0.7795,  0.0365,  0.9982,  0.2294,
         0.9634,  0.0129,  0.0705,  0.1400,  0.0199,  0.9590,  0.0700,
         0.9113,  0.9979,  0.9588,  0.9007,  0.2709,  0.8974,  0.6169,
         0.0896], device='cuda:0')
tensor(0.3964, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7443,  0.0826,  0.9368,  0.9080,  0.1442,  0.0957,  0.6915,
         0.1887,  0.4778,  0.9658,  0.0710,  0.9301,  0.2605,  0.0520,
         0.9261,  0.0132,  0.1118,  0.6489,  0.9854,  0.0129,  0.9784,
         0.0236,  0.9573,  0.0360,  0.0381,  0.8448,  0.9813,  0.0427,
         0.9997,  0.9360,  0.0166,  0.1651,  0.1571,  0.1927,  0.9635,
         0.9873,  0.9721,  0.0068,  0.6114,  0.9768,  0.9077,  0.0929,
         0.0685,  0.9495,  0.9637,  0.9393,  0.8659,  0.8750,  0.0892,
         0.9937,  0.9541,  0.0309,  0.4146,  0.9460,  0.0699,  0.9150,
         0.7946,  0.2982,  0.0226,  0.1783,  0.0143,  0.9279,  0.0082,
         0.0906,  0.0597,  0.0104,  0.6880,  0.9990,  0.5554,  0.9438,
         0.9999,  0.1241,  0.3799,  0.0024,  0.9889,  0.0703,  0.9109,
         0.0391,  0.1104,  0.8614,  0.5422,  0.0305,  0.9751,  0.0009,
         0.8308,  0.9999,  0.0631,  0.9989,  0.4788,  0.0053,  0.1594,
         0.0569,  0.8442,  0.0224,  0.9692,  0.0691,  0.9388,  0.2598,
         0.9894,  0.9832,  0.6202,  0.0438,  0.5070,  0.0197,  0.0357,
         0.3693,  0.3233,  0.5476,  0.0954,  0.2199,  0.2656,  0.1602,
         0.9657,  0.8092,  0.0092,  0.9717,  0.2903,  0.2875,  0.9694,
         0.1207,  0.9982,  0.0628,  0.9908,  0.9242,  0.0724,  0.7522,
         0.0697,  0.0422,  0.6265,  0.0561,  0.9631,  0.9224,  0.0635,
         0.1211,  0.8877,  0.9593,  0.9763,  0.7694,  0.0338,  0.9744,
         0.9985,  0.8346,  0.1000,  0.1006,  0.8409,  0.1144,  0.2743,
         0.9418,  0.0328,  0.9684,  0.0110,  0.5938,  0.9705,  0.5439,
         0.0471,  0.0137,  0.0259,  0.8011,  0.5694,  0.4836,  0.1499,
         0.0951,  0.8077,  0.8313,  0.2256,  0.1952,  0.9739,  0.0527,
         0.7239,  0.1467,  0.1300,  0.0293,  0.8973,  0.7650,  0.3430,
         0.3968,  0.9769,  0.9515,  0.7655,  0.1107,  0.8574,  0.1108,
         0.1875,  0.0312,  0.4057,  0.5585,  0.0596,  0.0276,  0.0570,
         0.0336,  0.4041,  0.1814,  0.1546,  0.0254,  0.9696,  0.0245,
         0.8593,  0.8254,  0.0406,  0.1482,  0.2080,  0.0244,  0.0485,
         0.1983,  0.1051,  0.9996,  0.6770,  0.9386,  0.9855,  0.8890,
         0.0269,  0.9281,  0.2125,  0.0710,  0.0364,  0.0014,  0.6771,
         0.0544,  0.1069,  0.9817,  0.1327,  0.5849,  0.9545,  0.0497,
         0.0028,  0.9051,  0.0454,  0.9122,  0.1380,  0.9631,  0.9133,
         0.0762,  0.9565,  0.9685,  0.9076,  0.6425,  0.6979,  0.9181,
         0.0482,  0.3951,  0.9956,  0.1255,  0.7323,  0.9164,  0.0198,
         0.8606,  0.0050,  0.7819,  0.0174,  0.6684,  0.3742,  0.2864,
         0.1424,  0.8393,  0.1174,  0.9201,  0.7342,  0.0510,  0.1229,
         0.1832,  0.8031,  0.7228,  0.1381,  0.0464,  0.9756,  0.9910,
         0.6173,  0.8088,  0.9812,  0.0238,  0.2335,  0.0172,  0.0004,
         0.9941,  0.9734,  0.9424,  0.1820,  0.1613,  0.5749,  0.0403,
         0.0060,  0.3727,  0.0524,  0.4980,  0.0638,  0.7799,  0.1616,
         0.0565,  0.1609,  0.7656,  0.9007,  0.0075,  0.1872,  0.0107,
         0.8844,  0.0357,  0.5963,  0.2539,  0.7424,  0.8009,  0.5400,
         0.1420,  0.0694,  0.2925,  0.8893,  0.0046,  0.0061,  0.9358,
         0.0156,  0.0353,  0.2675,  0.1395,  0.8131,  0.1057,  0.9543,
         0.9781,  0.0841,  0.3702,  0.8550,  0.7448,  0.0209,  0.9946,
         0.1669,  0.9858,  0.7369,  0.9826,  0.8592,  0.7751,  0.9987,
         0.9962,  0.3099,  0.5655,  0.9417,  0.9589,  0.4663,  0.0721,
         0.0606,  0.6389,  0.9352,  0.0145,  0.0115,  0.2617,  0.9465,
         0.0590,  0.0300,  0.0094,  0.1535,  0.9174,  0.9737,  0.0148,
         0.1654,  0.9098,  0.8208,  0.0621,  0.0979,  0.0071,  0.9363,
         0.0343,  0.5882,  0.3044,  0.0923,  0.0274,  0.9550,  0.1860,
         0.7671,  0.1507,  0.8304,  0.7319,  0.9687,  0.0149,  0.0035,
         0.0136,  0.8098,  0.0195,  0.4156,  0.1482,  0.4887,  0.9664,
         0.3748,  0.0224,  0.9759,  0.1231,  0.9353,  0.0953,  0.9005,
         0.0186,  0.0392,  0.9114,  0.1235,  0.4304,  0.0548,  0.0119,
         0.1199,  0.8331,  0.7675,  0.9541,  0.1198,  0.8467,  0.9459,
         0.9371,  0.8513,  0.0450,  0.8268,  0.8837,  0.0204,  0.9963,
         0.8867,  0.0167,  0.8735,  0.0207,  0.6755,  0.9756,  0.2060,
         0.0596,  0.9419,  0.9573,  0.1077,  0.0647,  0.0585,  0.1987,
         0.3636,  0.7473,  0.1243,  0.9823,  0.1138,  0.0012,  0.4967,
         0.0284,  0.7722,  0.7790,  0.2629,  0.6667,  0.3703,  0.9614,
         0.9993,  0.0556,  0.9187,  0.0914,  0.0115,  0.1528,  0.0433,
         0.0309,  0.0305,  0.0750,  0.9799,  0.9264,  0.0760,  0.0138,
         0.0344,  0.4813,  0.9345,  0.0850,  0.0152,  0.0360,  0.9202,
         0.0283,  0.3131,  0.5456,  0.0372,  0.0436,  0.0280,  0.3215,
         0.7859,  0.0082,  0.8698,  0.0359,  0.5455,  0.0565,  0.0268,
         0.8413,  0.9953,  0.7456,  0.6634,  0.0383,  0.0066,  0.0222,
         0.8801,  0.9802,  0.0757,  0.8536,  0.0201,  0.5586,  0.0330,
         0.2119,  0.0200,  0.2813,  0.9226,  0.0456,  0.5488,  0.0435,
         0.0809,  0.9994,  0.1282,  0.9278,  0.0100,  0.8864,  0.0967,
         0.2863,  0.9796,  0.8712,  0.9591,  0.0691,  0.0066,  0.1508,
         0.9435,  0.0260,  0.1713,  0.8949,  0.3361,  0.8708,  0.6307,
         0.0302], device='cuda:0')
tensor(0.2828, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9359,  0.0489,  0.9917,  0.8884,  0.0160,  0.7722,  0.9319,
         0.4218,  0.9973,  0.0084,  0.6009,  0.0060,  0.1350,  0.8490,
         0.0298,  0.9246,  0.5605,  0.1513,  0.0419,  0.7951,  0.0311,
         0.9483,  0.7005,  0.0394,  0.3574,  0.1067,  0.0116,  0.9676,
         0.1403,  0.2290,  0.1259,  0.9704,  0.0240,  0.9796,  0.9902,
         0.1293,  0.0361,  0.9989,  0.0089,  0.0127,  0.0096,  0.1158,
         0.9541,  0.0492,  0.0006,  0.9992,  0.9208,  0.2604,  0.9540,
         0.8340,  0.5575,  0.0811,  0.2870,  0.1431,  0.0706,  0.2333,
         0.8968,  0.1108,  0.0361,  0.0445,  0.9223,  0.0656,  0.4746,
         0.6929,  0.0148,  0.0194,  0.9375,  0.0126,  0.0227,  0.9123,
         0.6948,  0.5330,  0.9539,  0.9637,  0.0586,  0.0388,  0.0047,
         0.0126,  0.3604,  0.0057,  0.9821,  0.0247,  0.8924,  0.0513,
         0.0093,  0.0993,  0.0065,  0.7336,  0.0128,  0.8801,  0.1803,
         0.0882,  0.9022,  0.8380,  0.9153,  0.0767,  0.0679,  0.1426,
         0.0247,  0.8713,  0.0263,  0.0897,  0.3712,  0.0073,  0.9853,
         0.1301,  0.1549,  0.0249,  0.3634,  0.8094,  0.1413,  0.1226,
         0.0899,  0.0034,  0.0820,  0.7792,  0.8360,  0.0839,  0.6431,
         0.2283,  0.3127,  0.9903,  0.9887,  0.0194,  0.0441,  0.1326,
         0.2532,  0.0033,  0.0196,  0.0334,  0.1168,  0.7330,  0.0317,
         0.4871,  0.8992,  0.8592,  0.1656,  0.0165,  0.9093,  0.5129,
         0.3908,  0.6905,  0.6395,  0.0284,  0.7896,  0.1582,  0.8937,
         0.9834,  0.9436,  0.9718,  0.1717,  0.3420,  0.2445,  0.3479,
         0.0249,  0.0348,  0.3765,  0.1291,  0.0282,  0.1365,  0.1981,
         0.2304,  0.9800,  0.0342,  0.0052,  0.9711,  0.7495,  0.0630,
         0.9169,  0.4473,  0.0224,  0.1301,  0.1537,  0.8117,  0.5773,
         0.9162,  0.3369,  0.0092,  0.0484,  0.1048,  0.4166,  0.1977,
         0.0008,  0.9153,  0.6038,  0.6131,  0.8948,  0.0043,  0.2254,
         0.9821,  0.0549,  0.0256,  0.0983,  0.0913,  0.0232,  0.0653,
         0.0650,  0.3000,  0.0456,  0.0468,  0.0311,  0.9970,  0.0765,
         0.2390,  0.3398,  0.2114,  0.3244,  0.0572,  0.6650,  0.8407,
         0.2704,  0.0775,  0.0187,  0.9855,  0.7510,  0.5870,  0.0188,
         0.8682,  0.7879,  0.4985,  0.0291,  0.0032,  0.7373,  0.0455,
         0.2708,  0.3189,  0.6520,  0.0495,  0.1568,  0.0112,  0.7572,
         0.1572,  0.9708,  0.8221,  0.0124,  0.0892,  0.3683,  0.9884,
         0.9777,  0.9514,  0.0293,  0.2082,  0.3851,  0.9305,  0.1085,
         0.0289,  0.0147,  0.0114,  0.9995,  0.0483,  0.0353,  0.8916,
         0.2309,  0.8244,  0.0176,  0.1719,  0.1028,  0.8204,  0.0320,
         0.1008,  0.9201,  0.0576,  0.8315,  0.8816,  0.0037,  0.9527,
         0.0886,  0.1247,  0.4030,  0.0073,  0.9484,  0.9304,  0.5671,
         0.1706,  0.0426,  0.9826,  0.0729,  0.3940,  0.0823,  0.0083,
         0.0469,  0.9824,  0.9320,  0.2319,  0.6942,  0.1085,  0.8233,
         0.9186,  0.1381,  0.8393,  0.0353,  0.0842,  0.0457,  0.0823,
         0.9667,  0.0066,  0.0178,  0.1835,  0.5486,  0.0193,  0.9439,
         0.0461,  0.1130,  0.0436,  0.0498,  0.6341,  0.0379,  0.9497,
         0.0252,  0.0932,  0.0456,  0.6023,  0.8929,  0.1017,  0.1675,
         0.6840,  0.0292,  0.0628,  0.9421,  0.1109,  0.7602,  0.0341,
         0.0161,  0.9717,  0.0134,  0.0464,  0.9378,  0.8604,  0.0026,
         0.9389,  0.0023,  0.9847,  0.0197,  0.0612,  0.0977,  0.3192,
         0.4847,  0.7926,  0.9009,  0.0742,  0.8246,  0.0862,  0.9232,
         0.9290,  0.0355,  0.9872,  0.8542,  0.7790,  0.0460,  0.0320,
         0.0381,  0.0830,  0.9412,  0.1023,  0.3935,  0.0824,  0.0882,
         0.4857,  0.9840,  0.5928,  0.3061,  0.0027,  0.1203,  0.0269,
         0.7694,  0.0023,  0.0087,  0.6537,  0.0104,  0.7040,  0.8263,
         0.0833,  0.3750,  0.5790,  0.9937,  0.0077,  0.4549,  0.9456,
         0.0220,  0.0465,  0.0114,  0.9317,  0.7852,  0.0028,  0.0078,
         0.8966,  0.1027,  0.0297,  0.1660,  0.0087,  0.3206,  0.7900,
         0.9773,  0.0086,  0.2579,  0.1261,  0.9660,  0.8374,  0.0417,
         0.0180,  0.9415,  0.0132,  0.6477,  0.0724,  0.9661,  0.9825,
         0.8472,  0.9755,  0.1531,  0.9714,  0.0315,  0.0136,  0.0601,
         0.0165,  0.7708,  0.2943,  0.6890,  0.0067,  0.7710,  0.0195,
         0.9878,  0.9028,  0.0041,  0.0033,  0.9898,  0.0072,  0.9686,
         0.0319,  0.0535,  0.4449,  0.8909,  0.9305,  0.9847,  0.0892,
         0.9442,  0.6234,  0.0926,  0.9702,  0.7787,  0.1490,  0.8948,
         0.0406,  0.0243,  0.0224,  0.0245,  0.0923,  0.9098,  0.7857,
         0.9476,  0.3584,  0.9607,  0.6121,  0.8935,  0.8583,  0.8978,
         0.7620,  0.2452,  0.5023,  0.0287,  0.0218,  0.9751,  0.9562,
         0.7455,  0.5086,  0.9352,  0.1849,  0.9913,  0.1927,  0.9393,
         0.0524,  0.8427,  0.1316,  0.0128,  0.0504,  0.0134,  0.0213,
         0.8737,  0.9977,  0.0083,  0.9845,  0.1233,  0.9690,  0.7436,
         0.9843,  0.0269,  0.0320,  0.0373,  0.6572,  0.0307,  0.0827,
         0.9997,  0.0516,  0.9531,  0.0156,  0.0140,  0.5221,  0.1038,
         0.0994,  0.9194,  0.0624,  0.8970,  0.8823,  0.0453,  0.9610,
         0.7464,  0.9441,  0.0229,  0.9271,  0.0361,  0.9042,  0.8275,
         0.7889], device='cuda:0')
tensor(0.3424, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2971,  0.9543,  0.9559,  0.0358,  0.0404,  0.0671,  0.0186,
         0.9897,  0.0765,  0.0380,  0.9673,  0.9692,  0.9926,  0.9474,
         0.0118,  0.9505,  0.8541,  0.0634,  0.4155,  0.1948,  0.1921,
         0.6610,  0.0273,  0.0683,  0.0221,  0.9871,  0.4793,  0.2059,
         0.8870,  0.4167,  0.6981,  0.3502,  0.9980,  0.0026,  0.5377,
         0.9923,  0.0021,  0.9071,  0.0351,  0.7945,  0.1516,  0.0782,
         0.0236,  0.8442,  0.0906,  0.0642,  0.0200,  0.0178,  0.0385,
         0.0676,  0.0028,  0.0604,  0.0624,  0.2304,  0.8524,  0.5683,
         0.7978,  0.8226,  0.9541,  0.3222,  0.9328,  0.7433,  0.4903,
         0.8206,  0.0830,  0.9022,  0.0091,  0.2015,  0.2644,  0.9943,
         0.1288,  0.0901,  0.1400,  0.0068,  0.0620,  0.6788,  0.8058,
         0.0129,  0.0482,  0.9530,  0.5137,  0.4969,  0.9802,  0.1796,
         0.1438,  0.9551,  0.0420,  0.6326,  0.0173,  0.9705,  0.0102,
         0.9271,  0.2984,  0.0111,  0.0840,  0.0044,  0.1799,  0.2447,
         0.7114,  0.9431,  0.9667,  0.0346,  0.0194,  0.5029,  0.0820,
         0.6911,  0.0250,  0.9614,  0.0630,  0.0376,  0.9688,  0.2035,
         0.1712,  0.8486,  0.0163,  0.9115,  0.0136,  0.2281,  0.9704,
         0.9811,  0.6026,  0.6613,  0.0173,  0.9051,  0.9164,  0.0143,
         0.7675,  0.9287,  0.9723,  0.4670,  0.2416,  0.0384,  0.0821,
         0.9751,  0.8377,  0.4037,  0.9715,  0.0323,  0.3598,  0.5085,
         0.0256,  0.7084,  0.8400,  0.0015,  0.9848,  0.0333,  0.8316,
         0.0731,  0.0884,  0.0318,  0.0765,  0.0022,  0.0286,  0.0675,
         0.4681,  0.9523,  0.7258,  0.1089,  0.8712,  0.9305,  0.0597,
         0.1103,  0.6564,  0.3154,  0.4510,  0.8103,  0.0804,  0.0931,
         0.0649,  0.0076,  0.2797,  0.0022,  0.8805,  0.8694,  0.0732,
         0.2882,  0.2106,  0.6381,  0.2864,  0.0021,  0.0582,  0.1329,
         0.0012,  0.0034,  0.0124,  0.0116,  0.0181,  0.0254,  0.6588,
         0.0105,  0.3687,  0.5300,  0.0277,  0.9413,  0.9494,  0.9051,
         0.0320,  0.0060,  0.1366,  0.0479,  0.0293,  0.7758,  0.9703,
         0.0488,  0.0382,  0.9680,  0.0181,  0.0913,  0.0240,  0.0120,
         0.0411,  0.0415,  0.0838,  0.0400,  0.0806,  0.0135,  0.8108,
         0.4215,  0.8815,  0.0520,  0.0350,  0.0725,  0.4902,  0.9339,
         0.0714,  0.9679,  0.1273,  0.9432,  0.0499,  0.4806,  0.7316,
         0.8841,  0.0164,  0.9809,  0.0549,  0.1194,  0.0351,  0.0318,
         0.0225,  0.0812,  0.0535,  0.1288,  0.2161,  0.2046,  0.9148,
         0.0115,  0.0255,  0.4489,  0.0057,  0.0521,  0.7659,  0.9223,
         0.9474,  0.9418,  0.9618,  0.0978,  0.6823,  0.0128,  0.2632,
         0.0483,  0.0130,  0.8833,  0.8116,  0.0358,  0.9401,  0.4091,
         0.0052,  0.3045,  0.0594,  0.0033,  0.0457,  0.9180,  0.0117,
         0.0286,  0.5691,  0.0293,  0.0049,  0.2570,  0.0790,  0.1579,
         0.5411,  0.0575,  0.7122,  0.0351,  0.7644,  0.0554,  0.0509,
         0.9241,  0.1925,  0.5706,  0.0133,  0.0939,  0.7937,  0.9535,
         0.8884,  0.0130,  0.3390,  0.6477,  0.8181,  0.0242,  0.1428,
         0.0560,  0.0777,  0.0476,  0.1446,  0.0417,  0.0280,  0.0106,
         0.9154,  0.0832,  0.0796,  0.3516,  0.0169,  0.1533,  0.0964,
         0.0082,  0.0040,  0.2016,  0.1527,  0.0207,  0.9183,  0.3910,
         0.1044,  0.8976,  0.1310,  0.3263,  0.1158,  0.9648,  0.0056,
         0.0668,  0.0250,  0.0110,  0.7852,  0.9816,  0.5001,  0.9510,
         0.0124,  0.0329,  0.8730,  0.0239,  0.2140,  0.7246,  0.1437,
         0.0555,  0.1604,  0.4977,  0.0431,  0.8250,  0.0762,  0.0068,
         0.3891,  0.5956,  0.9124,  0.9677,  0.9726,  0.7394,  0.9185,
         0.0340,  0.9416,  0.9989,  0.0794,  0.6700,  0.0009,  0.0316,
         0.0962,  0.0018,  0.0082,  0.9321,  0.9392,  0.3029,  0.9379,
         0.7924,  0.3443,  0.0164,  0.4388,  0.9257,  0.2046,  0.9887,
         0.0075,  0.0241,  0.9355,  0.9509,  0.8897,  0.9149,  0.0025,
         0.0072,  0.1036,  0.8361,  0.0666,  0.8987,  0.0450,  0.9128,
         0.0402,  0.0237,  0.0191,  0.9809,  0.8747,  0.2723,  0.9427,
         0.0220,  0.8867,  0.0052,  0.0761,  0.3022,  0.2698,  0.8618,
         0.3336,  0.5324,  0.1095,  0.8119,  0.1219,  0.9503,  0.9522,
         0.8818,  0.9044,  0.3737,  0.7645,  0.8285,  0.0336,  0.9957,
         0.0258,  0.1075,  0.7371,  0.7181,  0.0365,  0.9377,  0.8668,
         0.0054,  0.0233,  0.8822,  0.2296,  0.0308,  0.0111,  0.3961,
         0.0275,  0.0468,  0.0141,  0.7191,  0.0250,  0.8819,  0.0028,
         0.1265,  0.0733,  0.0254,  0.5948,  0.9715,  0.8589,  0.7593,
         0.9522,  0.1041,  0.8171,  0.1589,  0.0612,  0.0052,  0.2476,
         0.0212,  0.0734,  0.5462,  0.0809,  0.3678,  0.7741,  0.0440,
         0.0675,  0.9094,  0.0263,  0.0331,  0.9713,  0.5966,  0.0634,
         0.0914,  0.0516,  0.9682,  0.0098,  0.0391,  0.2226,  0.0055,
         0.6379,  0.5791,  0.0053,  0.2582,  0.0121,  0.0090,  0.0651,
         0.0447,  0.0261,  0.0222,  0.7981,  0.0540,  0.1383,  0.0054,
         0.0214,  0.0970,  0.8706,  0.9180,  0.9733,  0.2335,  0.9173,
         0.9798,  0.9500,  0.0423,  0.9998,  0.0590,  0.0506,  0.9915,
         0.0919,  0.7303,  0.0038,  0.7636,  0.5961,  0.2253,  0.1768,
         0.0548], device='cuda:0')
tensor(0.4053, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9589,  0.4876,  0.0586,  0.9212,  0.0011,  0.8164,  0.9615,
         0.2247,  0.2223,  0.0595,  0.2126,  0.1001,  0.5736,  0.0293,
         0.4628,  0.8641,  0.0630,  0.0969,  0.9403,  0.3654,  0.9261,
         0.1745,  0.0759,  0.8915,  0.0184,  0.8327,  0.0438,  0.0707,
         0.9462,  0.8199,  0.1687,  0.0139,  0.3950,  0.5453,  0.8435,
         0.7576,  0.0537,  0.2094,  0.0684,  0.3096,  0.8745,  0.4956,
         0.5856,  0.9755,  0.0401,  0.0963,  0.8364,  0.0562,  0.0501,
         0.0771,  0.0285,  0.4985,  0.6589,  0.1184,  0.8306,  0.8979,
         0.9558,  0.6431,  0.0705,  0.3140,  0.0156,  0.9518,  0.0683,
         0.9883,  0.0567,  0.7685,  0.0213,  0.9678,  0.2987,  0.9294,
         0.4689,  0.7035,  0.0319,  0.0084,  0.8664,  0.0873,  0.0096,
         0.9348,  0.0731,  0.7449,  0.5119,  0.9687,  0.8467,  0.1653,
         0.4199,  0.9704,  0.8445,  0.9445,  0.0016,  0.3225,  0.9888,
         0.9749,  0.7846,  0.0529,  0.1820,  0.7856,  0.9639,  0.4085,
         0.9906,  0.8679,  0.0780,  0.5973,  0.8107,  0.0621,  0.3478,
         0.0186,  0.6848,  0.0120,  0.0933,  0.2545,  0.0132,  0.9503,
         0.4965,  0.0988,  0.0068,  0.8176,  0.7171,  0.0421,  0.9238,
         0.8272,  0.8269,  0.8685,  0.9561,  0.0514,  0.0301,  0.9540,
         0.0100,  0.2738,  0.8806,  0.8149,  0.0133,  0.7642,  0.7788,
         0.1302,  0.4742,  0.4476,  0.0715,  0.0213,  0.0206,  0.9166,
         0.9351,  0.0768,  0.0189,  0.5450,  0.0503,  0.0339,  0.0637,
         0.0325,  0.0723,  0.0089,  0.9756,  0.0456,  0.0096,  0.6438,
         0.9985,  0.0464,  0.0883,  0.0166,  0.0347,  0.3911,  0.2017,
         0.1157,  0.0037,  0.6665,  0.3038,  0.7669,  0.0908,  0.9818,
         0.0734,  0.0740,  0.9827,  0.0186,  0.0090,  0.0115,  0.5571,
         0.0121,  0.0132,  0.2335,  0.9386,  0.9609,  0.2456,  0.8759,
         0.9649,  0.1852,  0.0837,  0.8499,  0.6072,  0.1039,  0.3199,
         0.7287,  0.9373,  0.9862,  0.6094,  0.5246,  0.6485,  0.0083,
         0.3694,  0.9466,  0.6523,  0.0300,  0.0414,  0.9142,  0.9945,
         0.1481,  0.8229,  0.1203,  0.9457,  0.1079,  0.8695,  0.9927,
         0.0160,  0.6958,  0.2653,  0.9453,  0.6409,  0.9391,  0.5979,
         0.0156,  0.0926,  0.2106,  0.3110,  0.9178,  0.0118,  0.0350,
         0.3072,  0.9143,  0.0427,  0.4452,  0.0848,  0.9998,  0.0061,
         0.1220,  0.8220,  0.9997,  0.0975,  0.3554,  0.0761,  0.1098,
         0.7791,  0.1599,  0.0377,  0.9979,  0.0213,  0.0339,  0.6629,
         0.2987,  0.3077,  0.2207,  0.6442,  0.8478,  0.2921,  0.0562,
         0.5648,  0.1358,  0.9970,  0.9590,  0.0758,  0.9469,  0.2875,
         0.0740,  0.8725,  0.9961,  0.5184,  0.6082,  0.8978,  0.0035,
         0.9264,  0.2978,  0.0219,  0.1791,  0.1808,  0.8525,  0.9513,
         0.0117,  0.9372,  0.2710,  0.0528,  0.5848,  0.1129,  0.9077,
         0.6177,  0.0391,  0.9573,  0.1944,  0.8750,  0.9353,  0.2590,
         0.6632,  0.0785,  0.9276,  0.1068,  0.4978,  0.1054,  0.0709,
         0.9769,  0.1292,  0.1784,  0.2725,  0.9665,  0.4926,  0.9711,
         0.1036,  0.0215,  0.9602,  0.0393,  0.4564,  0.1723,  0.3046,
         0.9613,  0.0395,  0.1262,  0.0192,  0.0205,  0.8280,  0.8316,
         0.9131,  0.2088,  0.9994,  0.9415,  0.7932,  0.0318,  0.0781,
         0.5829,  0.9603,  0.0136,  0.7838,  0.3692,  0.7407,  0.9520,
         0.0288,  0.9808,  0.0388,  0.2045,  0.6207,  0.4006,  0.0099,
         0.7743,  0.9388,  0.0143,  0.8976,  0.0041,  0.7956,  0.5743,
         0.0449,  0.5946,  0.9631,  0.9962,  0.0420,  0.9794,  0.3417,
         0.2942,  0.1263,  0.3978,  0.4398,  0.0674,  0.0193,  0.0765,
         0.8998,  0.9361,  0.0313,  0.1984,  0.0133,  0.0408,  0.0974,
         0.0073,  0.8680,  0.9671,  0.0711,  0.9930,  0.1100,  0.6693,
         0.1909,  0.0482,  0.6381,  0.0035,  0.1208,  0.0567,  0.0451,
         0.5692,  0.0031,  0.9130,  0.9948,  0.8547,  0.0518,  0.9853,
         0.9872,  0.8831,  0.0104,  0.1594,  0.7592,  0.8855,  0.4900,
         0.0462,  0.0054,  0.9161,  0.9314,  0.9942,  0.9276,  0.0159,
         0.6017,  0.3495,  0.3398,  0.7774,  0.8794,  0.9355,  0.7453,
         0.9394,  0.5842,  0.6113,  0.7791,  0.1071,  0.6617,  0.9063,
         0.9958,  0.9531,  0.1236,  0.9984,  0.6926,  0.9882,  0.0746,
         0.7072,  0.7351,  0.2315,  0.6879,  0.9380,  0.8813,  0.8235,
         0.9491,  0.0253,  0.0220,  0.0100,  0.6463,  0.1186,  0.0049,
         0.8265,  0.9608,  0.0196,  0.9073,  0.9447,  0.3620,  0.8507,
         0.2302,  0.8018,  0.7779,  0.9299,  0.0143,  0.6036,  0.9011,
         0.2052,  0.0124,  0.9260,  0.8883,  0.0035,  0.0482,  0.0439,
         0.9327,  0.9088,  0.1061,  0.0037,  0.1119,  0.0494,  0.9115,
         0.9742,  0.9678,  0.1517,  0.7956,  0.0283,  0.0128,  0.9268,
         0.9463,  0.8516,  0.7934,  0.0130,  0.0639,  0.0245,  0.7813,
         0.3340,  0.0988,  0.3840,  0.1677,  0.0104,  0.2006,  0.9432,
         0.8943,  0.8330,  0.6733,  0.1644,  0.9577,  0.1134,  0.0400,
         0.7913,  0.8094,  0.0260,  0.9978,  0.8769,  0.9631,  0.5431,
         0.0598,  0.1576,  0.0315,  0.0567,  0.0544,  0.0600,  0.8618,
         0.9504,  0.0824,  0.0045,  0.0373,  0.9589,  0.2910,  0.1387,
         0.6904], device='cuda:0')
tensor(0.3124, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2304,  0.2504,  0.9978,  0.3992,  0.5916,  0.9979,  0.9681,
         0.0054,  0.8812,  0.1093,  0.4611,  0.0180,  0.9866,  0.3636,
         0.9541,  0.1057,  0.1435,  0.1633,  0.7466,  0.1455,  0.9575,
         0.8161,  0.9740,  0.0576,  0.8497,  0.0116,  0.5536,  0.0430,
         0.3490,  0.6690,  0.0608,  0.1621,  0.3309,  0.9846,  0.0033,
         0.0428,  0.0278,  0.7389,  0.8769,  0.8748,  0.5658,  0.3147,
         0.2710,  0.4887,  0.7377,  0.0864,  0.0196,  0.0474,  0.1981,
         0.8975,  0.0457,  0.3233,  0.8580,  0.0554,  0.0562,  0.7492,
         0.1064,  0.6107,  0.0950,  0.8282,  0.2233,  0.8877,  0.9869,
         0.9050,  0.0449,  0.8330,  0.1787,  0.1848,  0.8602,  0.4548,
         0.0333,  0.3093,  0.9756,  0.0391,  0.8871,  0.9263,  0.2251,
         0.2048,  0.5140,  0.6855,  0.6882,  0.1981,  0.8975,  0.0431,
         0.2915,  0.1974,  0.0237,  0.8559,  0.8607,  0.9656,  0.9337,
         0.7899,  0.8687,  0.9995,  0.9972,  0.4937,  0.2453,  0.1774,
         0.1959,  0.9496,  0.0231,  0.0092,  0.9293,  0.1166,  0.1374,
         0.9771,  0.0142,  0.9520,  0.0230,  0.6112,  0.0445,  0.9062,
         0.0363,  0.9427,  0.6094,  0.1718,  0.1589,  0.5073,  0.6984,
         0.9005,  0.0971,  0.4657,  0.9729,  0.6818,  0.8855,  0.0465,
         0.2183,  0.0033,  0.8166,  0.7301,  0.8638,  0.0294,  0.1213,
         0.9395,  0.7409,  0.1397,  0.9812,  0.2789,  0.9494,  0.0866,
         0.1564,  0.0134,  0.8158,  0.8947,  0.1968,  0.5478,  0.2634,
         0.0338,  0.1799,  0.9818,  0.0317,  0.9312,  0.6262,  0.0295,
         0.0464,  0.4196,  0.9911,  0.9738,  0.1164,  0.4094,  0.9666,
         0.8018,  0.7498,  0.9490,  0.9375,  0.0545,  0.9952,  0.0955,
         0.8802,  0.3896,  0.8951,  0.8105,  0.6437,  0.5474,  0.8360,
         0.9052,  0.8066,  0.9261,  0.3098,  0.0768,  0.0086,  0.1589,
         0.5044,  0.8217,  0.9384,  0.8650,  0.9048,  0.9659,  0.9646,
         0.7292,  0.1924,  0.6673,  0.0733,  0.7431,  0.4780,  0.0410,
         0.0138,  0.5672,  0.0190,  0.2265,  0.9732,  0.4740,  0.5259,
         0.9836,  0.1121,  0.2280,  0.5267,  0.7859,  0.2772,  0.0863,
         0.8867,  0.4066,  0.8061,  0.0204,  0.0866,  0.9784,  0.8598,
         0.8639,  0.7033,  0.8696,  0.0416,  0.2561,  0.0505,  0.8328,
         0.8427,  0.8761,  0.1103,  0.9658,  0.9991,  0.9691,  0.9398,
         0.1125,  0.6446,  0.7136,  0.1673,  0.9357,  0.1545,  0.7191,
         0.2873,  0.9481,  0.3198,  0.8853,  0.9337,  0.6022,  0.8140,
         0.7708,  0.9708,  0.7413,  0.8778,  0.5026,  0.9929,  0.2394,
         0.0050,  0.5611,  0.0752,  0.9255,  0.3487,  0.8480,  0.0113,
         0.9716,  0.3070,  0.1299,  0.9019,  0.7314,  0.0966,  0.0639,
         0.9400,  0.0321,  0.9571,  0.2861,  0.1631,  0.2699,  0.0688,
         0.2990,  0.9722,  0.6656,  0.8950,  0.0812,  0.2141,  0.1053,
         0.7065,  0.9976,  0.6972,  0.9092,  0.8611,  0.8924,  0.0735,
         0.1373,  0.1173,  0.4049,  0.0115,  0.0595,  0.1697,  0.5783,
         0.8448,  0.7037,  0.9356,  0.2397,  0.9738,  0.5044,  0.9803,
         0.0298,  0.1248,  0.3278,  0.0492,  0.0132,  0.9397,  0.0466,
         0.9995,  0.6272,  0.7038,  0.9980,  0.8617,  0.2833,  0.1493,
         0.7883,  0.4480,  0.5576,  0.9843,  0.8108,  0.3797,  0.9339,
         0.1203,  0.9815,  0.8834,  0.1608,  0.2379,  0.1223,  0.1832,
         0.9782,  0.0081,  0.0662,  0.1030,  0.7664,  0.0484,  0.7255,
         0.0055,  0.0621,  0.7797,  0.2027,  0.8736,  0.2221,  0.9995,
         0.0548,  0.9990,  0.9471,  0.4178,  0.0375,  0.0821,  0.3564,
         0.0748,  0.5076,  0.0927,  0.0438,  0.7761,  0.1751,  0.9086,
         0.7962,  0.6521,  0.4452,  0.3322,  0.7841,  0.0670,  0.4708,
         0.8159,  0.0873,  0.6928,  0.8989,  0.0130,  0.2388,  0.0627,
         0.3175,  0.0384,  0.0496,  0.9782,  0.1568,  0.7268,  0.7253,
         0.9907,  0.7107,  0.0688,  0.1963,  0.9396,  0.5738,  0.0385,
         0.8056,  0.1380,  0.0411,  0.7279,  0.1977,  0.2940,  0.8375,
         0.8144,  0.7795,  0.9230,  0.0033,  0.4359,  0.0721,  0.9778,
         0.1010,  0.9493,  0.4596,  0.9060,  0.0812,  0.0242,  0.8995,
         0.0232,  0.5078,  0.0370,  0.1295,  0.7796,  0.9504,  0.9958,
         0.9150,  0.1510,  0.7896,  0.2500,  0.9531,  0.0257,  0.0415,
         0.9336,  0.5191,  0.0051,  0.9798,  0.8762,  0.0458,  0.9930,
         0.3159,  0.0600,  0.9574,  0.9654,  0.1042,  0.0604,  0.8973,
         0.8137,  0.6081,  0.9346,  0.0715,  0.6034,  0.4327,  0.4038,
         0.8867,  0.9122,  0.6883,  0.3906,  0.0296,  0.3854,  0.0318,
         0.0754,  0.9020,  0.2776,  0.9361,  0.0860,  0.9582,  0.1992,
         0.8751,  0.8963,  0.9236,  0.9913,  0.2277,  0.0060,  0.9539,
         0.0393,  0.7700,  0.6562,  0.7845,  0.2658,  0.7830,  0.9282,
         0.8047,  0.0072,  0.9828,  0.0117,  0.0948,  0.7163,  0.1734,
         0.0148,  0.9545,  0.6862,  0.3369,  0.9871,  0.7409,  0.2232,
         0.9396,  0.2367,  0.8352,  0.9327,  0.0030,  0.3016,  0.9819,
         0.9701,  0.9944,  0.7806,  0.0702,  0.8712,  0.8740,  0.9824,
         0.3789,  0.0687,  0.0856,  0.6764,  0.4027,  0.8698,  0.9261,
         0.9911,  0.7191,  0.9201,  0.9592,  0.9450,  0.1305,  0.9703,
         0.7231], device='cuda:0')
tensor(0.2950, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7982,  0.5811,  0.8780,  0.9840,  0.8800,  0.9273,  0.9957,
         0.1747,  0.9619,  0.9919,  0.9610,  0.8505,  0.2283,  0.9155,
         0.3599,  0.2153,  0.2704,  0.9999,  0.1256,  0.0669,  0.0027,
         0.4915,  0.0602,  0.2920,  0.4769,  0.1739,  0.4968,  0.6532,
         0.9794,  0.7877,  0.2047,  0.1017,  0.9352,  0.7204,  0.9563,
         0.9665,  0.3530,  0.1220,  0.0660,  0.2295,  0.9707,  0.0287,
         0.9330,  0.1494,  0.2393,  0.1871,  0.8651,  0.6545,  0.9985,
         0.1303,  0.9905,  0.9765,  0.0493,  0.1678,  0.0761,  0.9352,
         0.9662,  0.9750,  0.1609,  0.8131,  0.0494,  0.9306,  0.0170,
         0.9871,  0.5879,  0.5968,  0.0388,  0.9386,  0.9099,  0.7816,
         0.9660,  0.9994,  0.9788,  0.1575,  0.9225,  0.8837,  0.1057,
         0.2121,  0.8800,  0.8383,  0.9377,  0.4193,  0.9127,  0.9702,
         0.8668,  0.0676,  0.9705,  0.0374,  0.1892,  0.1664,  0.2013,
         0.0228,  0.9786,  0.1361,  0.9919,  0.4666,  0.9675,  0.8168,
         0.9125,  0.4569,  0.8559,  0.0971,  0.8906,  0.0441,  0.9153,
         0.9371,  0.8079,  0.8230,  0.4548,  0.8157,  0.3136,  0.9735,
         0.2240,  0.0958,  0.9033,  0.9465,  0.4241,  0.3278,  0.9531,
         0.0632,  0.9069,  0.4073,  0.9569,  0.0248,  0.1305,  0.9020,
         0.7240,  0.9254,  0.2075,  0.4575,  0.9900,  0.0968,  0.2012,
         0.6043,  0.9423,  0.2322,  0.8861,  0.9713,  0.9533,  0.9508,
         0.8961,  0.8924,  0.0617,  0.1414,  0.0378,  0.1761,  0.9347,
         0.9142,  0.7707,  0.1667,  0.9960,  0.9950,  0.9982,  0.8973,
         0.1473,  0.9590,  0.9801,  0.7065,  0.7585,  0.8415,  0.9502,
         0.5260,  0.1699,  0.9024,  0.0364,  0.4099,  0.2488,  0.0072,
         0.5671,  0.5298,  0.7704,  0.9549,  0.2220,  0.9444,  0.0785,
         0.0677,  0.0942,  0.9769,  0.3800,  0.9238,  0.9741,  0.1325,
         0.6867,  0.9753,  0.4321,  0.8583,  0.1399,  0.8059,  0.9618,
         0.2755,  0.0795,  0.9277,  0.0908,  0.6960,  0.9048,  0.9604,
         0.0592,  0.9517,  0.5851,  0.0200,  0.3192,  0.0762,  0.6062,
         0.8417,  0.9146,  0.9973,  0.6694,  0.5401,  0.8919,  0.1402,
         0.0553,  0.9977,  0.1473,  0.9381,  0.8412,  0.0064,  0.3838,
         0.8394,  0.9947,  0.5955,  0.2071,  0.1197,  0.9401,  0.0468,
         0.9931,  0.9308,  0.9889,  0.8361,  0.0301,  0.9101,  0.3255,
         0.9934,  0.9337,  0.9524,  0.5487,  0.9537,  0.2789,  0.0720,
         0.1930,  0.9740,  0.0732,  0.5809,  0.0097,  0.2917,  0.2476,
         0.9348,  0.0300,  0.1357,  0.9855,  0.9554,  0.1636,  0.2134,
         0.7988,  0.9989,  0.3006,  0.1093,  0.6041,  0.0119,  0.1557,
         0.3933,  0.5310,  0.0186,  0.3589,  0.9061,  0.0955,  0.9927,
         0.0103,  0.9719,  0.9601,  0.2817,  0.1867,  0.6641,  0.7822,
         0.9454,  0.1842,  0.9357,  0.9429,  0.9111,  0.9383,  0.0454,
         0.5969,  0.0027,  0.9497,  0.0572,  0.8855,  0.9688,  0.9918,
         0.0635,  0.9736,  0.0940,  0.6639,  0.0147,  0.8942,  0.3411,
         0.9182,  0.2480,  0.8788,  0.9422,  0.8421,  0.2706,  0.5240,
         0.7925,  0.2699,  0.8937,  0.3573,  0.9967,  0.0095,  0.5054,
         0.0306,  0.9482,  0.9095,  0.4799,  0.5179,  0.5817,  0.8479,
         0.3024,  0.9423,  0.6470,  0.2001,  0.6221,  0.7279,  0.1776,
         0.9680,  0.0576,  0.7759,  0.9541,  0.9796,  0.4695,  0.9329,
         0.9713,  0.8645,  0.4375,  0.1631,  0.9765,  0.0285,  0.2099,
         0.8859,  0.1744,  0.5280,  0.9560,  0.8789,  0.6077,  0.2158,
         0.0560,  0.4231,  0.6030,  0.9693,  0.1049,  0.9552,  0.6049,
         0.5158,  0.5844,  0.8934,  0.9456,  0.0102,  0.9828,  0.6590,
         0.0478,  0.9874,  0.1356,  0.1257,  0.9977,  0.1423,  0.8638,
         0.1602,  0.9534,  0.6639,  0.5767,  0.9604,  0.0849,  0.9611,
         0.6585,  0.0689,  0.5295,  0.0891,  0.8860,  0.1752,  0.7690,
         0.9465,  0.5157,  0.4954,  0.2330,  0.7829,  0.1623,  0.6223,
         0.6942,  0.6220,  0.9652,  0.0113,  0.3097,  0.9638,  0.0141,
         0.9549,  0.9538,  0.8720,  0.9496,  0.2107,  0.2074,  0.8312,
         0.0739,  0.9093,  0.3299,  0.0239,  0.2906,  0.1639,  0.9556,
         0.9959,  0.9342,  0.0481,  0.8690,  0.7520,  0.2242,  0.0104,
         0.9449,  0.8466,  0.7514,  0.2345,  0.9034,  0.1495,  0.9555,
         0.7774,  0.0861,  0.1258,  0.8649,  0.6485,  0.1381,  0.0123,
         0.3314,  0.9077,  0.6389,  0.9249,  0.3629,  0.0777,  0.2325,
         0.9361,  0.9944,  0.8928,  0.0088,  0.0201,  0.7975,  0.2751,
         0.1677,  0.9810,  0.1984,  0.7645,  0.3823,  0.4474,  0.1808,
         0.9557,  0.7800,  0.4033,  0.0305,  0.0037,  0.5498,  0.8858,
         0.8014,  0.1045,  0.9790,  0.9034,  0.0255,  0.9755,  0.0118,
         0.0021,  0.9574,  0.8000,  0.9809,  0.9081,  0.0909,  0.6329,
         0.2547,  0.5899,  0.7687,  0.4653,  0.5699,  0.9704,  0.6973,
         0.1926,  0.9554,  0.9402,  0.8033,  0.9248,  0.9622,  0.9722,
         0.9815,  0.9385,  0.2083,  0.9853,  0.1578,  0.2063,  0.8194,
         0.7657,  0.9385,  0.7121,  0.7088,  0.1486,  0.1471,  0.7859,
         0.9978,  0.8773,  0.6796,  0.9342,  0.3349,  0.7092,  0.8733,
         0.9268,  0.5175,  0.9877,  0.1566,  0.1682,  0.7940,  0.9496,
         0.1493], device='cuda:0')
tensor(0.3305, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9604,  0.8806,  0.1427,  0.9372,  0.9404,  0.2538,  0.1942,
         0.0447,  0.2305,  0.9019,  0.5648,  0.0981,  0.0808,  0.9232,
         0.9823,  0.9767,  0.9776,  0.2096,  0.6082,  0.8282,  0.6199,
         0.1175,  0.7059,  0.9296,  0.0797,  0.2572,  0.9368,  0.1968,
         0.9888,  0.8253,  0.8658,  0.6209,  0.9502,  0.9570,  0.6804,
         0.4361,  0.9208,  0.7900,  0.3167,  0.9691,  0.9662,  0.1922,
         0.9412,  0.2005,  0.8549,  0.1524,  0.1459,  0.9181,  0.5671,
         0.1582,  0.8927,  0.9305,  0.1190,  0.8732,  0.0016,  0.0749,
         0.9792,  0.9204,  0.1662,  0.0172,  0.9630,  0.9769,  0.5080,
         0.1376,  0.2861,  0.9481,  0.9039,  0.0924,  0.9104,  0.1348,
         0.8009,  0.9430,  0.5998,  0.1592,  0.9810,  0.2966,  0.7697,
         0.9776,  0.0549,  0.6298,  0.7579,  0.0836,  0.9182,  0.6109,
         0.0206,  0.8692,  0.9713,  0.3127,  0.6365,  0.9708,  0.9781,
         0.9478,  0.9893,  0.9172,  0.9309,  0.0414,  0.9504,  0.1131,
         0.9283,  0.1459,  0.0768,  0.2622,  0.7772,  0.8269,  0.7457,
         0.9723,  0.9353,  0.5580,  0.1330,  0.0288,  0.1389,  0.9874,
         0.1405,  0.9549,  0.9429,  0.9731,  0.6894,  0.0784,  0.6918,
         0.8987,  0.3544,  0.9753,  0.9322,  0.1834,  0.1176,  0.9997,
         0.1738,  0.7802,  0.8206,  0.0048,  0.9962,  0.9053,  0.7246,
         0.3383,  0.8868,  0.9700,  0.9111,  0.2148,  0.2274,  0.6033,
         0.9762,  0.9560,  0.2821,  0.4101,  0.9368,  0.9694,  0.7049,
         0.9654,  0.2741,  0.8745,  0.0699,  0.6933,  0.2868,  0.9722,
         0.9349,  0.9208,  0.0287,  0.9800,  0.9738,  0.3291,  0.4269,
         0.9705,  0.0421,  0.9740,  0.9904,  0.9601,  0.9802,  0.9454,
         0.1516,  0.9456,  0.4876,  0.5652,  0.9882,  0.9912,  0.8703,
         0.5867,  0.4102,  0.0847,  0.8337,  0.9772,  0.9347,  0.7481,
         0.9390,  0.6224,  0.4176,  0.8297,  0.5668,  0.8618,  0.0343,
         0.9330,  0.6474,  0.7276,  0.8243,  0.0405,  0.9687,  0.9527,
         0.0692,  0.1593,  0.4402,  0.9557,  0.8441,  0.8860,  0.7891,
         0.9316,  0.9965,  0.9377,  0.9321,  0.1501,  0.9443,  0.3220,
         0.9473,  0.9572,  0.8115,  0.1334,  0.9805,  0.9004,  0.4037,
         0.1522,  0.8225,  0.8130,  0.9586,  0.1549,  0.9414,  0.0550,
         0.8323,  0.1040,  0.6929,  0.1744,  0.9170,  0.4380,  0.9112,
         0.0492,  0.9399,  0.9993,  0.1939,  0.9912,  0.2137,  0.0261,
         0.9542,  0.4763,  0.9699,  0.9650,  0.9974,  0.9938,  0.5358,
         0.2302,  0.8560,  0.2426,  0.9395,  0.9997,  0.3611,  0.9642,
         0.0818,  0.9527,  0.4865,  0.7892,  0.0338,  0.8214,  0.9428,
         0.9479,  0.6638,  0.7326,  0.0479,  0.9449,  0.3131,  0.0279,
         0.9431,  0.0808,  0.0525,  0.3102,  0.1792,  0.3975,  0.1177,
         0.9754,  0.9076,  0.9540,  0.2292,  0.9002,  0.9754,  0.9613,
         0.5133,  0.6862,  0.0150,  0.7424,  0.9787,  0.9803,  0.8237,
         0.7567,  0.9579,  0.8320,  0.5568,  0.9493,  0.1224,  0.3888,
         0.5801,  0.1605,  0.1914,  0.7865,  0.8864,  0.1243,  0.1401,
         0.9349,  0.5621,  0.5462,  0.0853,  0.9670,  0.8086,  0.9716,
         0.9512,  0.9370,  0.9832,  0.9738,  0.7911,  0.1162,  0.9138,
         0.0037,  0.9625,  0.8717,  0.1373,  0.9545,  0.9731,  0.6461,
         0.1563,  0.0241,  0.9668,  0.5977,  0.1197,  0.9156,  0.0865,
         0.9533,  0.9897,  0.8024,  0.0092,  0.6943,  0.8778,  0.1973,
         0.0010,  0.3533,  0.9237,  0.2516,  0.9913,  0.3584,  0.6608,
         0.8477,  0.9710,  0.8627,  0.1079,  0.0468,  0.9599,  0.5355,
         0.9784,  0.9739,  0.9797,  0.9164,  0.4433,  0.1203,  0.1919,
         0.9623,  0.9883,  0.9184,  0.0118,  0.8106,  0.9692,  0.0020,
         0.1455,  0.9234,  0.9294,  0.0285,  0.7742,  0.9642,  0.8695,
         0.9367,  0.8903,  0.1522,  0.9908,  0.0578,  0.9095,  0.1314,
         0.4371,  0.9082,  0.4287,  0.0172,  0.7845,  0.8810,  0.1333,
         0.9199,  0.9984,  0.0103,  0.1826,  0.2412,  0.1998,  0.0430,
         0.0271,  0.1521,  0.8935,  0.9688,  0.2480,  0.3780,  0.3413,
         0.3642,  0.9869,  0.1965,  0.9580,  0.8477,  0.4667,  0.0670,
         0.7526,  0.8792,  0.8772,  0.8357,  0.9962,  0.0540,  0.1876,
         0.1752,  0.9556,  0.9372,  0.2749,  0.1291,  0.1705,  0.0045,
         0.4030,  0.1072,  0.4107,  0.2454,  0.9515,  0.4433,  0.7937,
         0.0407,  0.1475,  0.3856,  0.0183,  0.6532,  0.3605,  0.9159,
         0.4896,  0.5402,  0.9485,  0.1676,  0.9968,  0.8720,  0.9876,
         0.0663,  0.0539,  0.9566,  0.8415,  0.9245,  0.9015,  0.0580,
         0.9728,  0.5925,  0.9860,  0.0912,  0.0722,  0.9893,  0.9487,
         0.9975,  0.0313,  0.0376,  0.7007,  0.5527,  0.1293,  0.9400,
         0.0341,  0.1894,  0.1638,  0.8940,  0.9443,  0.7187,  0.9681,
         0.8513,  0.0538,  0.0927,  0.9507,  0.9423,  0.0458,  0.8724,
         0.3069,  0.9987,  0.9570,  0.5889,  0.0637,  0.5182,  0.7081,
         0.9394,  0.5951,  0.8130,  0.8102,  0.9568,  0.1334,  0.9868,
         0.9889,  0.9535,  0.0103,  0.9687,  0.3675,  0.7051,  0.9253,
         0.9816,  0.9902,  0.7076,  0.9877,  0.1855,  0.9914,  0.9751,
         0.2289,  0.0759,  0.0960,  0.1125,  0.9499,  0.0084,  0.0164,
         0.9389], device='cuda:0')
tensor(0.3602, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0133,  0.0354,  0.0693,  0.0798,  0.8494,  0.9656,  0.8197,
         0.9751,  0.9482,  0.1048,  0.0748,  0.2780,  0.8029,  0.0050,
         0.9298,  0.6626,  0.0497,  0.9590,  0.5622,  0.9170,  0.0545,
         0.1233,  0.9618,  0.0534,  0.9964,  0.9589,  0.1972,  0.8764,
         0.2460,  0.9201,  0.3676,  0.1454,  0.4042,  0.0565,  0.8256,
         0.9967,  0.9319,  0.6612,  0.0279,  0.9429,  0.9235,  0.0624,
         0.9439,  0.8802,  0.6317,  0.2086,  0.9578,  0.9956,  0.8820,
         0.0395,  0.0107,  0.0155,  0.3889,  0.8709,  0.9496,  0.0362,
         0.8252,  0.9201,  0.0052,  0.7570,  0.0243,  0.9356,  0.9140,
         0.0571,  0.0273,  0.6047,  0.9505,  0.0903,  0.9509,  0.0433,
         0.7372,  0.0059,  0.5611,  0.9919,  0.9756,  0.0917,  0.9052,
         0.9037,  0.7940,  0.8820,  0.9736,  0.9150,  0.9575,  0.8406,
         0.9360,  0.9904,  0.0298,  0.3317,  0.9217,  0.0156,  0.0565,
         0.3619,  0.9553,  0.8098,  0.3322,  0.1081,  0.1402,  0.9404,
         0.9468,  0.2345,  0.0063,  0.0255,  0.2845,  0.0987,  0.0586,
         0.9118,  0.9670,  0.8206,  0.5819,  0.9292,  0.9534,  0.1533,
         0.8471,  0.0987,  0.9078,  0.3863,  0.9089,  0.9524,  0.2521,
         0.2969,  0.9574,  0.7606,  0.9639,  0.9106,  0.0364,  0.8691,
         0.8343,  0.9308,  0.0022,  0.2274,  0.5603,  0.9438,  0.1196,
         0.2508,  0.9676,  0.9925,  0.1151,  0.7016,  0.9705,  0.8564,
         0.0939,  0.3384,  0.6469,  0.7299,  0.9374,  0.1334,  0.0317,
         0.1121,  0.8847,  0.4487,  0.7959,  0.0638,  0.5758,  0.9562,
         0.0173,  0.9883,  0.0069,  0.1790,  0.9976,  0.9206,  0.8404,
         0.3687,  0.8289,  0.9846,  0.8857,  0.7949,  0.0134,  0.0233,
         0.9169,  0.9067,  0.7970,  0.4161,  0.9424,  0.1512,  0.2337,
         0.8927,  0.9795,  0.1736,  0.9523,  0.6343,  0.5614,  0.9814,
         0.9520,  0.9109,  0.1229,  0.2189,  0.3473,  0.9770,  0.9576,
         0.8353,  0.0768,  0.8682,  0.1839,  0.5260,  0.9744,  0.5315,
         0.1540,  0.6554,  0.9241,  0.9974,  0.0933,  0.9893,  0.0186,
         0.1685,  0.7873,  0.8703,  0.9750,  0.1635,  0.1463,  0.0498,
         0.9685,  0.9622,  0.9694,  0.8791,  0.9044,  0.9646,  0.9433,
         0.8554,  0.5619,  0.0194,  0.8252,  0.8024,  0.9665,  0.0587,
         0.9619,  0.9214,  0.9807,  0.9402,  0.8467,  0.9987,  0.9967,
         0.9251,  0.0270,  0.9783,  0.4328,  0.9472,  0.8883,  0.0063,
         0.9657,  0.0891,  0.9962,  0.2423,  0.8182,  0.3928,  0.8482,
         0.9166,  0.1676,  0.8613,  0.6375,  0.0143,  0.6051,  0.0791,
         0.0577,  0.9612,  0.3443,  0.6303,  0.9597,  0.8844,  0.3374,
         0.9676,  0.0220,  0.9273,  0.9275,  0.8710,  0.9576,  0.9484,
         0.9269,  0.9574,  0.9372,  0.1435,  0.9179,  0.9683,  0.8630,
         0.6561,  0.1068,  0.7085,  0.0835,  0.1879,  0.0380,  0.8212,
         0.2363,  0.9383,  0.8839,  0.1376,  0.0157,  0.9532,  0.1044,
         0.0059,  0.0588,  0.3857,  0.9900,  0.0355,  0.5505,  0.9799,
         0.8809,  0.6901,  0.9374,  0.9676,  0.0786,  0.0233,  0.9665,
         0.0654,  0.5230,  0.8750,  0.8419,  0.9912,  0.4143,  0.0102,
         0.9663,  0.0849,  0.9450,  0.9315,  0.9521,  0.1493,  0.9120,
         0.9828,  0.9027,  0.0409,  0.8771,  0.5136,  0.0041,  0.9456,
         0.9985,  0.7022,  0.9380,  0.7035,  0.9750,  0.9822,  0.9781,
         0.0422,  0.0891,  0.9845,  0.7468,  0.9619,  0.9805,  0.2626,
         0.9896,  0.9227,  0.1558,  0.0632,  0.0917,  0.8068,  0.3817,
         0.8677,  0.5719,  0.4208,  0.7867,  0.9240,  0.9575,  0.8468,
         0.9440,  0.9212,  0.0422,  0.7085,  0.9535,  0.7475,  0.2968,
         0.3993,  0.1461,  0.1290,  0.8951,  0.7406,  0.9821,  0.8369,
         0.4848,  0.6621,  0.9682,  0.8671,  0.6749,  0.9188,  0.9722,
         0.9634,  0.0307,  0.9105,  0.3149,  0.2860,  0.6388,  0.7049,
         0.1133,  0.8955,  0.0081,  0.8058,  0.9826,  0.1481,  0.2502,
         0.9832,  0.1066,  0.9960,  0.1543,  0.0050,  0.9635,  0.3509,
         0.1947,  0.0517,  0.2598,  0.1983,  0.0168,  0.9846,  0.7586,
         0.0205,  0.9352,  0.1344,  0.0687,  0.0325,  0.2272,  0.2118,
         0.0187,  0.9576,  0.0531,  0.8450,  0.9658,  0.7143,  0.9691,
         0.0345,  0.9824,  0.5913,  0.2791,  0.9809,  0.2811,  0.0129,
         0.0671,  0.4712,  0.7947,  0.9853,  0.3054,  0.9658,  0.0134,
         0.9183,  0.9256,  0.9285,  0.2312,  0.9310,  0.9400,  0.0333,
         0.9504,  0.8512,  0.8522,  0.7983,  0.9686,  0.7090,  0.9154,
         0.0714,  0.5290,  0.2238,  0.6606,  0.9568,  0.3444,  0.9369,
         0.9643,  0.9284,  0.3681,  0.0182,  0.1269,  0.8966,  0.9940,
         0.8923,  0.9303,  0.6805,  0.1707,  0.7037,  0.4352,  0.9887,
         0.8885,  0.8330,  0.9017,  0.9481,  0.1042,  0.3500,  0.9677,
         0.0905,  0.7673,  0.0085,  0.9222,  0.9620,  0.5873,  0.7839,
         0.9647,  0.4759,  0.4711,  0.3496,  0.9485,  0.9106,  0.1818,
         0.9665,  0.0214,  0.5697,  0.6278,  0.3275,  0.4934,  0.1231,
         0.9651,  0.0404,  0.9554,  0.7159,  0.0705,  0.2873,  0.1998,
         0.0518,  0.8948,  0.0621,  0.0930,  0.7690,  0.1464,  0.3015,
         0.8607,  0.8507,  0.5459,  0.2741,  0.9338,  0.9851,  0.0320,
         0.6764], device='cuda:0')
tensor(0.3686, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0220,  0.9508,  0.8219,  0.4814,  0.0620,  0.0135,  0.0224,
         0.9494,  0.6218,  0.0254,  0.4121,  0.6180,  0.5184,  0.8528,
         0.2141,  0.2179,  0.0603,  0.0212,  0.1189,  0.0832,  0.7316,
         0.0363,  0.9965,  0.9228,  0.0288,  0.0654,  0.0448,  0.1301,
         0.9791,  0.1134,  0.1695,  0.0072,  0.0975,  0.0018,  0.2404,
         0.9336,  0.0304,  0.9276,  0.9096,  0.9740,  0.7087,  0.0759,
         0.7738,  0.1180,  0.9381,  0.3817,  0.1561,  0.5904,  0.7629,
         0.6923,  0.6182,  0.1190,  0.6654,  0.8467,  0.1584,  0.9612,
         0.7866,  0.4913,  0.9531,  0.1089,  0.1716,  0.1859,  0.2542,
         0.8913,  0.9158,  0.9023,  0.9881,  0.0565,  0.0202,  0.9723,
         0.0360,  0.0306,  0.8435,  0.0273,  0.0896,  0.6559,  0.9182,
         0.4958,  0.9564,  0.0052,  0.0091,  0.7722,  0.9392,  0.8308,
         0.9644,  0.3426,  0.9325,  0.9128,  0.1637,  0.9517,  0.3076,
         0.9319,  0.8517,  0.1205,  0.3563,  0.1245,  0.7469,  0.9605,
         0.1723,  0.8989,  0.3134,  0.1931,  0.2323,  0.5674,  0.1081,
         0.9479,  0.9753,  0.5200,  0.0499,  0.9371,  0.0067,  0.7426,
         0.3147,  0.9663,  0.0281,  0.9154,  0.9818,  0.5687,  0.0530,
         0.7938,  0.0267,  0.8156,  0.7007,  0.9985,  0.9903,  0.9146,
         0.8296,  0.0165,  0.0795,  0.8581,  0.9961,  0.9761,  0.1958,
         0.4927,  0.1423,  0.0572,  0.9420,  0.2521,  0.0486,  0.6508,
         0.0725,  0.8371,  0.3407,  0.1193,  0.9307,  0.3738,  0.5196,
         0.1045,  0.6708,  0.0065,  0.0223,  0.9787,  0.8215,  0.0271,
         0.9479,  0.9691,  0.1383,  0.2452,  0.0196,  0.0417,  0.0614,
         0.0701,  0.8973,  0.1451,  0.0088,  0.9578,  0.0576,  0.1805,
         0.0065,  0.0518,  0.0829,  0.9160,  0.7481,  0.3020,  0.4319,
         0.3505,  0.8892,  0.4500,  0.9449,  0.9459,  0.0209,  0.0241,
         0.5757,  0.0079,  0.7615,  0.9873,  0.3742,  0.1725,  0.8770,
         0.9738,  0.2362,  0.0067,  0.8815,  0.8727,  0.0206,  0.1142,
         0.7003,  0.7800,  0.6836,  0.4499,  0.9859,  0.5504,  0.8925,
         0.9492,  0.4800,  0.6640,  0.9991,  0.8112,  0.9470,  0.8281,
         0.7356,  0.7470,  0.0409,  0.9746,  0.0898,  0.9493,  0.2641,
         0.0736,  0.0482,  0.9937,  0.9872,  0.1320,  0.9848,  0.0436,
         0.9231,  0.7933,  0.9012,  0.7526,  0.8827,  0.0553,  0.9037,
         0.0130,  0.2039,  0.9160,  0.1579,  0.2511,  0.0071,  0.3844,
         0.9995,  0.9212,  0.2186,  0.9348,  0.8826,  0.3449,  0.5566,
         0.5155,  0.9100,  0.8341,  0.8325,  0.1362,  0.1969,  0.0999,
         0.8107,  0.0732,  0.0747,  0.8493,  0.4659,  0.9323,  0.5629,
         0.7490,  0.0685,  0.9089,  0.9043,  0.9679,  0.1847,  0.9599,
         0.9688,  0.9813,  0.0239,  0.8159,  0.0722,  0.9022,  0.9967,
         0.9375,  0.9867,  0.2091,  0.7169,  0.8579,  0.0499,  0.0442,
         0.2472,  0.0407,  0.0056,  0.8444,  0.4189,  0.9513,  0.0308,
         0.1930,  0.9728,  0.3329,  0.8800,  0.1579,  0.0775,  0.8450,
         0.6414,  0.0118,  0.1094,  0.0814,  0.0148,  0.1675,  0.0190,
         0.0179,  0.0335,  0.7211,  0.9231,  0.8883,  0.7579,  0.8870,
         0.7314,  0.7282,  0.9927,  0.2686,  0.2072,  0.9516,  0.8134,
         0.0585,  0.0048,  0.2670,  0.5403,  0.0703,  0.9572,  0.8483,
         0.9182,  0.4611,  0.7716,  0.8861,  0.9367,  0.0024,  0.2019,
         0.8704,  0.9994,  0.9185,  0.8467,  0.9479,  0.9083,  0.8074,
         0.8555,  0.9068,  0.7247,  0.0939,  0.1448,  0.0018,  0.0310,
         0.9520,  0.1014,  0.0071,  0.9367,  0.9813,  0.3527,  0.1313,
         0.3389,  0.0541,  0.1534,  0.9379,  0.9273,  0.7135,  0.8499,
         0.9029,  0.9585,  0.9754,  0.2044,  0.5613,  0.1048,  0.8199,
         0.0253,  0.3366,  0.9421,  0.7932,  0.4193,  0.2741,  0.9567,
         0.7050,  0.0477,  0.8766,  0.0915,  0.9820,  0.5737,  0.5718,
         0.1054,  0.9509,  0.8647,  0.8936,  0.7985,  0.4304,  0.9547,
         0.9569,  0.8397,  0.2575,  0.0164,  0.0498,  0.7670,  0.2156,
         0.9893,  0.0701,  0.0427,  0.8236,  0.9002,  0.3191,  0.8926,
         0.1353,  0.0132,  0.0944,  0.9451,  0.0878,  0.1440,  0.0282,
         0.9087,  0.9134,  0.0281,  0.9933,  0.0610,  0.9509,  0.0704,
         0.3706,  0.0236,  0.0376,  0.0646,  0.0080,  0.2546,  0.4521,
         0.0935,  0.1258,  0.8939,  0.9883], device='cuda:0')
tensor(0.3324, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 7, BCELoss: 0.35757303967767834
tensor([ 0.3999,  0.9820,  0.1123,  0.9377,  0.8161,  0.0902,  0.0171,
         0.9960,  0.3522,  0.7422,  0.0315,  0.6260,  0.3216,  0.1869,
         0.0233,  0.8410,  0.0801,  0.1696,  0.0576,  0.0187,  0.1831,
         0.9489,  0.1032,  0.9336,  0.0761,  0.3507,  0.8290,  0.9939,
         0.8388,  0.5151,  0.9567,  0.9782,  0.7597,  0.4176,  0.0748,
         0.0312,  0.8911,  0.8755,  0.0315,  0.0073,  0.3788,  0.7708,
         0.0015,  0.0047,  0.5205,  0.1652,  0.6718,  0.6472,  0.8815,
         0.0539,  0.0555,  0.0516,  0.7993,  0.8682,  0.0736,  0.1352,
         0.9756,  0.8034,  0.7833,  0.9768,  0.3289,  0.7620,  0.8881,
         0.0224,  0.6067,  0.1714,  0.9673,  0.6267,  0.9521,  0.5116,
         0.0483,  0.8329,  0.0293,  0.0103,  0.9991,  0.9913,  0.0610,
         0.1074,  0.0262,  0.0531,  0.1328,  0.9650,  0.8400,  0.0285,
         0.1999,  0.6797,  0.0165,  0.8940,  0.9087,  0.0667,  0.0921,
         0.1086,  0.2378,  0.0500,  0.7297,  0.8156,  0.9378,  0.9776,
         0.0651,  0.0179,  0.3299,  0.0358,  0.1044,  0.9683,  0.6922,
         0.9461,  0.1766,  0.0886,  0.0564,  0.0720,  0.8956,  0.6532,
         0.7786,  0.6470,  0.9127,  0.0483,  0.0379,  0.9939,  0.8464,
         0.8450,  0.5501,  0.9912,  0.4021,  0.0286,  0.0027,  0.2741,
         0.7339,  0.0487,  0.3545,  0.4192,  0.8755,  0.2334,  0.8415,
         0.0385,  0.0071,  0.9823,  0.0790,  0.2422,  0.8680,  0.3811,
         0.0568,  0.1237,  0.8643,  0.5374,  0.5691,  0.2696,  0.0346,
         0.5013,  0.0126,  0.0098,  0.7994,  0.1212,  0.4256,  0.2038,
         0.0804,  0.0621,  0.9778,  0.3042,  0.1111,  0.7910,  0.9800,
         0.9705,  0.5045,  0.6004,  0.8262,  0.1587,  0.2441,  0.9109,
         0.9235,  0.1327,  0.6796,  0.6855,  0.8152,  0.8924,  0.0099,
         0.9202,  0.4414,  0.9178,  0.6788,  0.0285,  0.0553,  0.4488,
         0.9923,  0.9784,  0.9421,  0.0175,  0.9608,  0.9925,  0.1577,
         0.0383,  0.4985,  0.3246,  0.4876,  0.9542,  0.0462,  0.4529,
         0.8035,  0.7589,  0.0279,  0.7006,  0.2995,  0.0664,  0.4887,
         0.8919,  0.0855,  0.8640,  0.6041,  0.0958,  0.8698,  0.9216,
         0.3643,  0.4266,  0.0072,  0.1250,  0.1897,  0.4593,  0.9985,
         0.0577,  0.6821,  0.3587,  0.0437,  0.9693,  0.9801,  0.4306,
         0.0061,  0.9367,  0.0542,  0.8677,  0.7842,  0.8861,  0.9948,
         0.8754,  0.6162,  0.8416,  0.0120,  0.1082,  0.9562,  0.4895,
         0.8330,  0.0410,  0.1367,  0.7829,  0.4836,  0.0417,  0.8313,
         0.9239,  0.0333,  0.0112,  0.8050,  0.9850,  0.1148,  0.9870,
         0.0484,  0.0600,  0.6410,  0.0190,  0.8457,  0.7134,  0.8416,
         0.8921,  0.0106,  0.9791,  0.9333,  0.9348,  0.3290,  0.0731,
         0.9852,  0.0409,  0.2762,  0.1351,  0.0835,  0.0636,  0.0243,
         0.1081,  0.9477,  0.9253,  0.3328,  0.4114,  0.3121,  0.8708,
         0.8083,  0.0437,  0.9298,  0.6478,  0.1474,  0.0207,  0.5539,
         0.1362,  0.1923,  0.9050,  0.2342,  0.1728,  0.8580,  0.1010,
         0.9410,  0.0250,  0.9975,  0.7636,  0.7968,  0.1364,  0.7472,
         0.5077,  0.7945,  0.9143,  0.5791,  0.9644,  0.0249,  0.0536,
         0.2032,  0.8929,  0.1524,  0.1984,  0.9693,  0.9192,  0.3263,
         0.0051,  0.9378,  0.8029,  0.0337,  0.9971,  0.0089,  0.7590,
         0.9250,  0.5130,  0.1508,  0.6283,  0.6338,  0.1026,  0.0345,
         0.9239,  0.4445,  0.0367,  0.0119,  0.1743,  0.0198,  0.5887,
         0.0274,  0.0211,  0.1700,  0.6729,  0.4955,  0.1012,  0.1257,
         0.0097,  0.8929,  0.8812,  0.9403,  0.0220,  0.9148,  0.3591,
         0.3287,  0.7791,  0.8216,  0.7708,  0.0486,  0.3169,  0.7316,
         0.9108,  0.0848,  0.8000,  0.4581,  0.7561,  0.0051,  0.0296,
         0.0012,  0.0605,  0.9950,  0.2983,  0.2832,  0.1284,  0.0204,
         0.1349,  0.0467,  0.4517,  0.0797,  0.0845,  0.1982,  0.8106,
         0.7559,  0.9449,  0.2180,  0.1325,  0.3359,  0.6689,  0.9942,
         0.0669,  0.2547,  0.9984,  0.1677,  0.8229,  0.7997,  0.6315,
         0.0391,  0.0706,  0.8808,  0.2056,  0.1209,  0.0132,  0.9104,
         0.2896,  0.8193,  0.0369,  0.8965,  0.1349,  0.0097,  0.9822,
         0.1107,  0.0620,  0.0968,  0.9022,  0.0333,  0.9660,  0.0222,
         0.5874,  0.4650,  0.3645,  0.9659,  0.0156,  0.0569,  0.3113,
         0.9392,  0.9394,  0.7916,  0.5160,  0.9874,  0.0767,  0.2822,
         0.0320,  0.8917,  0.1481,  0.8448,  0.1074,  0.1800,  0.0061,
         0.5225,  0.3479,  0.9072,  0.5023,  0.0870,  0.8356,  0.9472,
         0.1370,  0.9891,  0.9361,  0.7409,  0.2094,  0.8874,  0.0308,
         0.0371,  0.8630,  0.8666,  0.6810,  0.7935,  0.2985,  0.0423,
         0.4180,  0.3991,  0.9978,  0.9273,  0.0780,  0.6746,  0.7527,
         0.9147,  0.3660,  0.1092,  0.0379,  0.1383,  0.2326,  0.2008,
         0.5913,  0.5541,  0.1068,  0.0399,  0.0226,  0.1025,  0.2299,
         0.4469,  0.0763,  0.9207,  0.9844,  0.1599,  0.7997,  0.0337,
         0.0925,  0.8959,  0.0415,  0.9514,  0.3398,  0.0824,  0.1656,
         0.5694,  0.8358,  0.6026,  0.8775,  0.7848,  0.1962,  0.0283,
         0.0311,  0.4135,  0.0543,  0.2110,  0.0830,  0.3395,  0.0313,
         0.8335,  0.6921,  0.8919,  0.4854,  0.9307,  0.9519,  0.9100,
         0.0174], device='cuda:0')
tensor(0.3523, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0179,  0.0460,  0.0836,  0.5065,  0.0288,  0.7458,  0.9539,
         0.9178,  0.9807,  0.0129,  0.2107,  0.7434,  0.7832,  0.7851,
         0.7213,  0.0586,  0.5068,  0.4765,  0.0990,  0.0228,  0.2931,
         0.8266,  0.8784,  0.3466,  0.0289,  0.1131,  0.4043,  0.7914,
         0.6188,  0.4980,  0.7989,  0.0533,  0.9281,  0.7970,  0.0827,
         0.2507,  0.9614,  0.0036,  0.3082,  0.3388,  0.4980,  0.0345,
         0.1044,  0.3505,  0.0537,  0.0648,  0.3609,  0.0604,  0.8809,
         0.0355,  0.0523,  0.5553,  0.7823,  0.9509,  0.9251,  0.3121,
         0.1631,  0.0598,  0.6867,  0.9788,  0.1095,  0.8915,  0.9380,
         0.5428,  0.0194,  0.7327,  0.0403,  0.9922,  0.5771,  0.0213,
         0.0261,  0.6544,  0.0324,  0.9520,  0.3412,  0.0016,  0.4309,
         0.0274,  0.0506,  0.9706,  0.8779,  0.0504,  0.0705,  0.0141,
         0.5048,  0.0219,  0.1196,  0.2194,  0.9446,  0.8345,  0.0250,
         0.1611,  0.1518,  0.1453,  0.0315,  0.9416,  0.0202,  0.1285,
         0.6056,  0.0851,  0.9387,  0.2661,  0.0501,  0.9850,  0.0259,
         0.0170,  0.0351,  0.8322,  0.1058,  0.8427,  0.0265,  0.0876,
         0.1630,  0.9702,  0.6095,  0.9142,  0.8415,  0.7082,  0.5399,
         0.1006,  0.7405,  0.0088,  0.4902,  0.1307,  0.6303,  0.1034,
         0.8079,  0.1597,  0.4059,  0.0659,  0.0078,  0.6822,  0.8027,
         0.9771,  0.8127,  0.8831,  0.0190,  0.0339,  0.0919,  0.9660,
         0.0191,  0.0455,  0.1496,  0.0928,  0.4766,  0.0374,  0.0646,
         0.9363,  0.0021,  0.1112,  0.9165,  0.0586,  0.0444,  0.0971,
         0.0433,  0.8201,  0.3797,  0.0908,  0.7562,  0.8420,  0.1169,
         0.9271,  0.0559,  0.8552,  0.8944,  0.9495,  0.5876,  0.0386,
         0.5428,  0.9061,  0.7834,  0.1469,  0.0212,  0.0191,  0.3812,
         0.4852,  0.0056,  0.0258,  0.7529,  0.5410,  0.1701,  0.0314,
         0.2879,  0.7725,  0.0125,  0.4578,  0.1789,  0.8314,  0.1896,
         0.0691,  0.0025,  0.8849,  0.5414,  0.0021,  0.0925,  0.1694,
         0.8255,  0.9386,  0.0049,  0.0465,  0.0255,  0.2712,  0.2652,
         0.7674,  0.0243,  0.6880,  0.7496,  0.9407,  0.0055,  0.2408,
         0.9014,  0.7659,  0.8878,  0.0120,  0.2246,  0.8353,  0.0194,
         0.0267,  0.5053,  0.0253,  0.0163,  0.0536,  0.0516,  0.1923,
         0.0898,  0.9162,  0.1891,  0.7029,  0.3569,  0.1102,  0.0858,
         0.3716,  0.6566,  0.0645,  0.9577,  0.7058,  0.9966,  0.1788,
         0.9024,  0.0241,  0.0200,  0.9273,  0.0250,  0.5724,  0.1417,
         0.4578,  0.5449,  0.0122,  0.9199,  0.8906,  0.8288,  0.0851,
         0.1775,  0.0240,  0.2107,  0.9485,  0.9465,  0.9754,  0.0904,
         0.7285,  0.2540,  0.0307,  0.8970,  0.1623,  0.9802,  0.2068,
         0.3916,  0.4946,  0.6059,  0.7215,  0.1050,  0.8434,  0.3584,
         0.1174,  0.8908,  0.9301,  0.1465,  0.0461,  0.9011,  0.9288,
         0.9934,  0.0292,  0.0195,  0.3116,  0.3113,  0.0400,  0.0099,
         0.9077,  0.0058,  0.7837,  0.7398,  0.0453,  0.6959,  0.0537,
         0.0347,  0.0212,  0.1359,  0.8689,  0.1659,  0.6125,  0.0399,
         0.6188,  0.0135,  0.9911,  0.0163,  0.0744,  0.9106,  0.9559,
         0.0452,  0.0322,  0.8109,  0.6143,  0.3176,  0.0027,  0.5968,
         0.9035,  0.0162,  0.4047,  0.4433,  0.1033,  0.0242,  0.8042,
         0.0798,  0.2155,  0.0769,  0.1856,  0.8787,  0.3221,  0.8790,
         0.6468,  0.0735,  0.9904,  0.0117,  0.0041,  0.8805,  0.3858,
         0.8760,  0.1528,  0.9971,  0.1635,  0.5980,  0.0716,  0.7830,
         0.8039,  0.5656,  0.0381,  0.0322,  0.9636,  0.0270,  0.8203,
         0.1794,  0.9985,  0.3828,  0.0432,  0.0344,  0.0196,  0.8246,
         0.2305,  0.8049,  0.1412,  0.0181,  0.0007,  0.8547,  0.2163,
         0.0890,  0.1364,  0.0605,  0.2026,  0.1779,  0.7565,  0.8962,
         0.9863,  0.1059,  0.6534,  0.6330,  0.1331,  0.0259,  0.0460,
         0.7071,  0.9962,  0.0437,  0.8599,  0.9951,  0.9741,  0.0008,
         0.7764,  0.5223,  0.7621,  0.9238,  0.0602,  0.0373,  0.9963,
         0.8379,  0.0155,  0.1322,  0.6472,  0.4379,  0.4890,  0.0838,
         0.1308,  0.5412,  0.0713,  0.0599,  0.7503,  0.1718,  0.4147,
         0.4820,  0.6065,  0.0156,  0.8835,  0.0158,  0.4724,  0.0187,
         0.0265,  0.8530,  0.8172,  0.2502,  0.0626,  0.9752,  0.2685,
         0.9519,  0.0290,  0.0513,  0.6358,  0.1575,  0.9472,  0.9898,
         0.7214,  0.7928,  0.9878,  0.1738,  0.6126,  0.8779,  0.0174,
         0.6954,  0.1254,  0.0620,  0.0646,  0.8179,  0.2676,  0.8984,
         0.1374,  0.9369,  0.8827,  0.5737,  0.1517,  0.0582,  0.0341,
         0.0452,  0.4701,  0.9697,  0.8952,  0.9674,  0.7958,  0.7497,
         0.9032,  0.8330,  0.7524,  0.1441,  0.9597,  0.0229,  0.7027,
         0.9772,  0.2003,  0.1397,  0.0418,  0.0933,  0.4453,  0.4384,
         0.1573,  0.3295,  0.5156,  0.8543,  0.0585,  0.9885,  0.0159,
         0.3116,  0.6902,  0.8765,  0.0087,  0.1786,  0.9793,  0.2277,
         0.0089,  0.0318,  0.0016,  0.8394,  0.1327,  0.2209,  0.0664,
         0.0547,  0.2035,  0.0793,  0.0925,  0.9296,  0.0207,  0.9079,
         0.9636,  0.0518,  0.6702,  0.8697,  0.7216,  0.7557,  0.9810,
         0.4653,  0.9061,  0.0350,  0.8452,  0.5117,  0.1739,  0.8289,
         0.0080], device='cuda:0')
tensor(0.3393, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8133,  0.1150,  0.0646,  0.6076,  0.9426,  0.0866,  0.1651,
         0.5556,  0.0398,  0.2073,  0.9757,  0.9840,  0.8020,  0.9796,
         0.0315,  0.9486,  0.0999,  0.6744,  0.9401,  0.1266,  0.0256,
         0.4130,  0.8815,  0.9771,  0.2974,  0.3202,  0.0412,  0.8069,
         0.0037,  0.1312,  0.0499,  0.7577,  0.0100,  0.0264,  0.9982,
         0.8024,  0.0366,  0.5398,  0.3044,  0.6022,  0.0509,  0.4279,
         0.1338,  0.2335,  0.7090,  0.9790,  0.6112,  0.2889,  0.4605,
         0.9331,  0.8526,  0.3988,  0.1029,  0.0863,  0.0289,  0.9005,
         0.5868,  0.1418,  0.0140,  0.7876,  0.5501,  0.8431,  0.1428,
         0.1274,  0.2430,  0.8083,  0.8340,  0.0018,  0.9113,  0.0208,
         0.9144,  0.9023,  0.1667,  0.0896,  0.9631,  0.9792,  0.0742,
         0.0718,  0.4980,  0.0410,  0.9669,  0.0321,  0.7157,  0.9099,
         0.9327,  0.1104,  0.0327,  0.0679,  0.1283,  0.9685,  0.7416,
         0.9512,  0.0083,  0.1291,  0.6318,  0.5261,  0.0724,  0.6798,
         0.9461,  0.5611,  0.6868,  0.9773,  0.0061,  0.0127,  0.0140,
         0.8512,  0.9631,  0.5157,  0.9441,  0.6062,  0.0585,  0.3906,
         0.6412,  0.9090,  0.0209,  0.9750,  0.8007,  0.1575,  0.0752,
         0.0691,  0.7545,  0.3456,  0.4881,  0.9541,  0.7272,  0.9151,
         0.9217,  0.1445,  0.0718,  0.0466,  0.9247,  0.0357,  0.7566,
         0.5206,  0.7953,  0.7835,  0.0799,  0.0161,  0.8713,  0.1934,
         0.7123,  0.9226,  0.9267,  0.8874,  0.5086,  0.1212,  0.0931,
         0.6348,  0.0046,  0.0013,  0.9277,  0.0514,  0.0494,  0.3839,
         0.0210,  0.3928,  0.0143,  0.3092,  0.1048,  0.0379,  0.7407,
         0.0436,  0.0554,  0.8280,  0.3477,  0.4759,  0.8099,  0.6510,
         0.9630,  0.0053,  0.9242,  0.6177,  0.4664,  0.8232,  0.0924,
         0.2517,  0.0292,  0.8739,  0.0959,  0.9603,  0.8581,  0.7427,
         0.8757,  0.7824,  0.9982,  0.0795,  0.4992,  0.0662,  0.3259,
         0.8600,  0.8922,  0.1736,  0.7659,  0.0071,  0.9443,  0.8886,
         0.1226,  0.8874,  0.0311,  0.0155,  0.9529,  0.1365,  0.0145,
         0.0060,  0.6780,  0.0393,  0.7903,  0.0434,  0.4935,  0.0238,
         0.0241,  0.0695,  0.0359,  0.7880,  0.4081,  0.0531,  0.8248,
         0.4026,  0.1182,  0.1674,  0.1983,  0.9680,  0.0020,  0.8006,
         0.6278,  0.7731,  0.9311,  0.9039,  0.2471,  0.0635,  0.9987,
         0.9085,  0.9651,  0.1586,  0.0052,  0.7957,  0.2515,  0.0104,
         0.1113,  0.0181,  0.8132,  0.0065,  0.4186,  0.7996,  0.0218,
         0.8871,  0.7388,  0.0256,  0.7053,  0.8310,  0.9105,  0.0637,
         0.7889,  0.0257,  0.0631,  0.0993,  0.9407,  0.2380,  0.0173,
         0.4861,  0.0088,  0.7578,  0.8729,  0.8841,  0.9653,  0.7134,
         0.0308,  0.1029,  0.0277,  0.4425,  0.9465,  0.0453,  0.9559,
         0.9233,  0.2608,  0.0044,  0.8402,  0.3605,  0.1418,  0.1298,
         0.0826,  0.0055,  0.0113,  0.6376,  0.9580,  0.9520,  0.1149,
         0.4469,  0.0254,  0.0194,  0.1123,  0.7775,  0.6409,  0.0547,
         0.9456,  0.0650,  0.7864,  0.7988,  0.7646,  0.9382,  0.2122,
         0.0432,  0.5795,  0.9040,  0.6982,  0.8818,  0.4401,  0.8677,
         0.7516,  0.6387,  0.6552,  0.0239,  0.1271,  0.0387,  0.0491,
         0.6642,  0.9556,  0.1145,  0.0754,  0.0445,  0.0755,  0.6849,
         0.2582,  0.1931,  0.5869,  0.9509,  0.0901,  0.0204,  0.9572,
         0.0647,  0.8339,  0.7294,  0.7812,  0.1211,  0.9293,  0.6692,
         0.1081,  0.1549,  0.0327,  0.2872,  0.8712,  0.0494,  0.0338,
         0.2073,  0.9445,  0.1091,  0.1790,  0.0184,  0.1258,  0.1207,
         0.3810,  0.8729,  0.9418,  0.0406,  0.2395,  0.8821,  0.1161,
         0.0859,  0.1728,  0.0109,  0.9539,  0.1135,  0.0530,  0.9463,
         0.9381,  0.9950,  0.1436,  0.0855,  0.1635,  0.6681,  0.1298,
         0.7307,  0.9498,  0.0083,  0.7291,  0.1132,  0.0424,  0.8459,
         0.1295,  0.0341,  0.0370,  0.2632,  0.0469,  0.1072,  0.9584,
         0.9145,  0.9691,  0.0459,  0.8814,  0.4572,  0.1845,  0.9578,
         0.6548,  0.3167,  0.9652,  0.0362,  0.0475,  0.9090,  0.0706,
         0.9365,  0.0023,  0.0185,  0.8265,  0.0088,  0.8541,  0.6283,
         0.0231,  0.9409,  0.4078,  0.0233,  0.0190,  0.7440,  0.9386,
         0.8425,  0.0473,  0.8127,  0.9847,  0.1805,  0.6713,  0.0372,
         0.0090,  0.0608,  0.0413,  0.3875,  0.9586,  0.2044,  0.9537,
         0.8768,  0.1154,  0.3108,  0.0373,  0.9562,  0.9206,  0.5223,
         0.9392,  0.2517,  0.1263,  0.1981,  0.4027,  0.0966,  0.7716,
         0.7240,  0.0749,  0.1372,  0.4265,  0.0450,  0.6795,  0.0490,
         0.3514,  0.0212,  0.7530,  0.2132,  0.0347,  0.3256,  0.0214,
         0.8654,  0.3942,  0.1186,  0.0098,  0.1942,  0.1134,  0.0162,
         0.9852,  0.0835,  0.5719,  0.6575,  0.5404,  0.0286,  0.3366,
         0.0242,  0.7691,  0.0394,  0.1324,  0.9554,  0.2162,  0.0055,
         0.0252,  0.8932,  0.9452,  0.0888,  0.8633,  0.9129,  0.3599,
         0.7395,  0.0997,  0.1688,  0.0463,  0.0282,  0.9775,  0.8356,
         0.8556,  0.9474,  0.9402,  0.0801,  0.1390,  0.8483,  0.0586,
         0.0018,  0.0479,  0.6550,  0.7262,  0.0062,  0.0954,  0.6025,
         0.1289,  0.1042,  0.8347,  0.0492,  0.5174,  0.9624,  0.9731,
         0.0536], device='cuda:0')
tensor(0.3179, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0793,  0.1670,  0.0657,  0.9534,  0.0122,  0.0358,  0.9383,
         0.0193,  0.1002,  0.0994,  0.0134,  0.1470,  0.1296,  0.8119,
         0.0392,  0.0336,  0.7483,  0.0165,  0.4524,  0.0410,  0.6074,
         0.0215,  0.0365,  0.6927,  0.9164,  0.9602,  0.9491,  0.8551,
         0.9651,  0.0887,  0.9446,  0.0092,  0.7963,  0.0028,  0.9019,
         0.0478,  0.9317,  0.3313,  0.1261,  0.9273,  0.0400,  0.2722,
         0.8660,  0.0134,  0.1243,  0.0588,  0.1534,  0.7415,  0.0407,
         0.8527,  0.0693,  0.8252,  0.9518,  0.6828,  0.8435,  0.2461,
         0.2164,  0.1102,  0.4198,  0.0361,  0.0330,  0.9422,  0.9211,
         0.9149,  0.1013,  0.9472,  0.2179,  0.9375,  0.0013,  0.5163,
         0.8453,  0.0837,  0.9148,  0.8868,  0.0051,  0.6047,  0.0708,
         0.8050,  0.1936,  0.3365,  0.1073,  0.1675,  0.0133,  0.1054,
         0.0240,  0.5296,  0.9275,  0.9466,  0.0153,  0.5373,  0.6573,
         0.3881,  0.4169,  0.9306,  0.9030,  0.8835,  0.3182,  0.6791,
         0.1306,  0.8546,  0.8612,  0.9958,  0.1410,  0.8177,  0.5839,
         0.0049,  0.1562,  0.8934,  0.8413,  0.0414,  0.0851,  0.0676,
         0.0701,  0.3008,  0.0466,  0.9281,  0.0034,  0.9213,  0.0016,
         0.7457,  0.9965,  0.2593,  0.0447,  0.0514,  0.0661,  0.0275,
         0.0588,  0.8899,  0.8193,  0.0812,  0.1646,  0.9102,  0.7971,
         0.9180,  0.0830,  0.0009,  0.2626,  0.9802,  0.0386,  0.2313,
         0.9333,  0.0787,  0.0639,  0.0263,  0.8455,  0.4249,  0.1485,
         0.9774,  0.7816,  0.1115,  0.0163,  0.6107,  0.0379,  0.0113,
         0.4711,  0.0945,  0.8199,  0.1023,  0.7119,  0.0225,  0.1302,
         0.3110,  0.9875,  0.9309,  0.0302,  0.8921,  0.0098,  0.8172,
         0.0556,  0.9058,  0.8766,  0.8281,  0.3792,  0.4876,  0.0271,
         0.8930,  0.0930,  0.3852,  0.0018,  0.7072,  0.6575,  0.0145,
         0.6719,  0.8962,  0.9284,  0.9243,  0.1195,  0.1511,  0.2461,
         0.9351,  0.8539,  0.2090,  0.9385,  0.0144,  0.0053,  0.0716,
         0.8188,  0.9974,  0.7648,  0.4458,  0.3629,  0.9073,  0.7808,
         0.9640,  0.9508,  0.4586,  0.5680,  0.9107,  0.9406,  0.7566,
         0.6101,  0.9577,  0.0920,  0.9398,  0.7846,  0.9558,  0.9593,
         0.1320,  0.0184,  0.0742,  0.8024,  0.0057,  0.3802,  0.0580,
         0.6417,  0.1473,  0.1337,  0.8833,  0.0170,  0.1757,  0.0562,
         0.9642,  0.0091,  0.0455,  0.9647,  0.1796,  0.0107,  0.6287,
         0.0657,  0.0892,  0.0250,  0.5504,  0.9628,  0.8381,  0.1036,
         0.8256,  0.0520,  0.2197,  0.0070,  0.8422,  0.4621,  0.2340,
         0.9548,  0.7993,  0.9014,  0.0033,  0.3927,  0.9620,  0.3615,
         0.9461,  0.6639,  0.0080,  0.7798,  0.0082,  0.9291,  0.8576,
         0.0188,  0.4190,  0.0363,  0.0410,  0.6002,  0.9519,  0.7356,
         0.2889,  0.7966,  0.9745,  0.5389,  0.9284,  0.9648,  0.2209,
         0.0820,  0.9194,  0.0488,  0.8338,  0.4831,  0.8961,  0.6926,
         0.0409,  0.0375,  0.9735,  0.2095,  0.9598,  0.2390,  0.0210,
         0.1675,  0.9773,  0.5166,  0.8648,  0.0411,  0.9087,  0.0387,
         0.2181,  0.2120,  0.9716,  0.9832,  0.0455,  0.9575,  0.7973,
         0.0780,  0.9794,  0.9218,  0.8571,  0.0443,  0.9650,  0.8397,
         0.7091,  0.0423,  0.9447,  0.0159,  0.9308,  0.9883,  0.9035,
         0.4952,  0.1413,  0.3218,  0.0110,  0.6630,  0.2958,  0.1173,
         0.0493,  0.3708,  0.7966,  0.9160,  0.3160,  0.0110,  0.0678,
         0.0033,  0.9442,  0.0940,  0.1666,  0.0530,  0.0206,  0.5099,
         0.0097,  0.9496,  0.1771,  0.9991,  0.5583,  0.1668,  0.5604,
         0.6568,  0.7200,  0.6899,  0.8521,  0.1599,  0.8530,  0.8379,
         0.8860,  0.0781,  0.9191,  0.0982,  0.6333,  0.9536,  0.8542,
         0.8524,  0.0863,  0.0400,  0.5336,  0.3174,  0.1795,  0.9337,
         0.2885,  0.5487,  0.3094,  0.9939,  0.5176,  0.0047,  0.0393,
         0.9065,  0.3687,  0.0035,  0.9985,  0.4253,  0.3256,  0.4952,
         0.1446,  0.7465,  0.4040,  0.9229,  0.7790,  0.4893,  0.3496,
         0.2609,  0.6171,  0.6285,  0.4267,  0.6834,  0.0903,  0.0399,
         0.1921,  0.9118,  0.9845,  0.6490,  0.7380,  0.6612,  0.0429,
         0.4141,  0.4762,  0.6796,  0.8932,  0.0870,  0.4459,  0.0016,
         0.2735,  0.4948,  0.9527,  0.9555,  0.9436,  0.9543,  0.6880,
         0.1014,  0.2105,  0.9499,  0.9572,  0.0443,  0.0273,  0.5676,
         0.0513,  0.8797,  0.9703,  0.1981,  0.1832,  0.0144,  0.0105,
         0.9274,  0.0170,  0.9243,  0.0023,  0.3084,  0.5917,  0.2222,
         0.4573,  0.1121,  0.8754,  0.9808,  0.2421,  0.0599,  0.0095,
         0.9865,  0.8351,  0.7657,  0.0541,  0.0918,  0.8962,  0.8360,
         0.1186,  0.4889,  0.0398,  0.0462,  0.0700,  0.9232,  0.0061,
         0.7157,  0.8202,  0.1619,  0.4508,  0.0397,  0.2640,  0.9102,
         0.6986,  0.0220,  0.1084,  0.8183,  0.0195,  0.1311,  0.0096,
         0.0533,  0.8674,  0.0352,  0.1131,  0.0483,  0.9417,  0.9384,
         0.1723,  0.2318,  0.1331,  0.8828,  0.3708,  0.8145,  0.0322,
         0.8095,  0.7917,  0.9369,  0.0815,  0.2663,  0.9567,  0.8550,
         0.9288,  0.5335,  0.1065,  0.2641,  0.9772,  0.0492,  0.9469,
         0.0290,  0.6460,  0.3845,  0.1004,  0.0192,  0.0115,  0.8928,
         0.9092], device='cuda:0')
tensor(0.3411, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9495,  0.8502,  0.1551,  0.8304,  0.2459,  0.5113,  0.1324,
         0.1970,  0.0174,  0.2816,  0.9249,  0.9397,  0.7598,  0.0514,
         0.0266,  0.0789,  0.0608,  0.9392,  0.1677,  0.9023,  0.9320,
         0.0312,  0.0348,  0.8929,  0.2170,  0.8970,  0.7163,  0.7487,
         0.0512,  0.7621,  0.4538,  0.9571,  0.9598,  0.9583,  0.5852,
         0.7957,  0.7436,  0.9185,  0.6019,  0.2434,  0.9200,  0.5965,
         0.1307,  0.1474,  0.8869,  0.9885,  0.1134,  0.0897,  0.8838,
         0.8537,  0.9264,  0.0270,  0.0170,  0.8217,  0.1279,  0.0238,
         0.2844,  0.9271,  0.6439,  0.1138,  0.9313,  0.9427,  0.8462,
         0.7541,  0.0070,  0.4767,  0.4698,  0.8145,  0.0805,  0.2858,
         0.0265,  0.8900,  0.2554,  0.9917,  0.9746,  0.3012,  0.9965,
         0.8960,  0.9392,  0.0377,  0.9787,  0.9740,  0.7477,  0.0319,
         0.9674,  0.8286,  0.0131,  0.6378,  0.6084,  0.9027,  0.0329,
         0.3160,  0.8957,  0.0155,  0.1098,  0.3336,  0.5173,  0.1545,
         0.9645,  0.8388,  0.1626,  0.0460,  0.9823,  0.2438,  0.0226,
         0.9460,  0.0983,  0.6407,  0.8124,  0.6275,  0.8161,  0.9592,
         0.9714,  0.8317,  0.2138,  0.2038,  0.9112,  0.0182,  0.9129,
         0.0321,  0.7450,  0.0308,  0.9567,  0.8723,  0.4218,  0.7019,
         0.5748,  0.2850,  0.0167,  0.0236,  0.2036,  0.0710,  0.0135,
         0.0922,  0.2356,  0.1527,  0.0335,  0.1318,  0.8875,  0.0696,
         0.0107,  0.7889,  0.1149,  0.9275,  0.0076,  0.0081,  0.8282,
         0.7427,  0.2843,  0.1146,  0.0487,  0.8777,  0.8754,  0.7402,
         0.7674,  0.0926,  0.9558,  0.7980,  0.2303,  0.9003,  0.3774,
         0.5665,  0.9610,  0.0299,  0.0342,  0.0942,  0.7480,  0.0880,
         0.0065,  0.8094,  0.9534,  0.0212,  0.0355,  0.5956,  0.0856,
         0.4862,  0.8141,  0.9487,  0.0291,  0.0188,  0.8886,  0.2589,
         0.9534,  0.8537,  0.1383,  0.6029,  0.0179,  0.9317,  0.9493,
         0.0227,  0.9407,  0.0098,  0.7404,  0.3559,  0.6617,  0.6012,
         0.0564,  0.8341,  0.9894,  0.9188,  0.1913,  0.1438,  0.8305,
         0.8456,  0.5847,  0.0458,  0.9588,  0.1433,  0.8592,  0.0236,
         0.1140,  0.0262,  0.5752,  0.9235,  0.9294,  0.0541,  0.1379,
         0.0913,  0.5557,  0.1732,  0.0821,  0.0457,  0.0549,  0.4893,
         0.7869,  0.4458,  0.9089,  0.7565,  0.6938,  0.7522,  0.0507,
         0.9228,  0.1789,  0.3787,  0.7693,  0.0681,  0.0785,  0.0305,
         0.9329,  0.1363,  0.1059,  0.9545,  0.8035,  0.9457,  0.1604,
         0.0760,  0.7782,  0.0381,  0.0903,  0.8120,  0.8936,  0.8815,
         0.7072,  0.0063,  0.9546,  0.2838,  0.0832,  0.7058,  0.9288,
         0.9193,  0.0528,  0.8878,  0.7905,  0.8749,  0.8171,  0.9978,
         0.4139,  0.0123,  0.9281,  0.0202,  0.1311,  0.8108,  0.0040,
         0.0432,  0.7974,  0.3142,  0.0185,  0.9791,  0.0989,  0.8678,
         0.0883,  0.9570,  0.9622,  0.0375,  0.8443,  0.0472,  0.0894,
         0.0510,  0.0895,  0.8835,  0.8717,  0.8863,  0.0416,  0.1876,
         0.2117,  0.8904,  0.0818,  0.0408,  0.0301,  0.7461,  0.9165,
         0.0494,  0.9172,  0.9733,  0.9566,  0.0705,  0.9562,  0.4639,
         0.8769,  0.8168,  0.0187,  0.8906,  0.2042,  0.0654,  0.2755,
         0.6827,  0.0298,  0.8590,  0.2672,  0.0571,  0.4985,  0.9969,
         0.9123,  0.0250,  0.9237,  0.0063,  0.3133,  0.1978,  0.6817,
         0.9587,  0.6535,  0.7290,  0.6502,  0.6372,  0.7362,  0.5353,
         0.8261,  0.7916,  0.0461,  0.0347,  0.8892,  0.9949,  0.3095,
         0.9979,  0.0234,  0.7767,  0.4648,  0.9508,  0.1332,  0.9429,
         0.9989,  0.2221,  0.2926,  0.8362,  0.8536,  0.9278,  0.9556,
         0.8152,  0.8914,  0.2670,  0.0450,  0.9606,  0.8059,  0.0826,
         0.9801,  0.9813,  0.7515,  0.8837,  0.0462,  0.9649,  0.2637,
         0.1269,  0.0079,  0.9754,  0.1485,  0.1514,  0.3023,  0.0931,
         0.0215,  0.0807,  0.1751,  0.2506,  0.3469,  0.2770,  0.5858,
         0.9304,  0.9787,  0.9388,  0.0136,  0.4196,  0.9307,  0.4075,
         0.8598,  0.6803,  0.8987,  0.3274,  0.2347,  0.7693,  0.0895,
         0.9523,  0.0062,  0.2839,  0.9073,  0.0053,  0.7904,  0.0714,
         0.0231,  0.9311,  0.1694,  0.1777,  0.0415,  0.3257,  0.4241,
         0.0180,  0.9184,  0.8668,  0.0483,  0.3449,  0.0736,  0.2908,
         0.1594,  0.1584,  0.0659,  0.2994,  0.0335,  0.0082,  0.8429,
         0.0622,  0.0220,  0.0481,  0.8558,  0.1705,  0.9488,  0.0311,
         0.0725,  0.4817,  0.6181,  0.6313,  0.0956,  0.8168,  0.9869,
         0.1574,  0.1724,  0.2340,  0.0875,  0.8559,  0.8470,  0.9960,
         0.8566,  0.9301,  0.9462,  0.1511,  0.7911,  0.8006,  0.9155,
         0.5510,  0.4451,  0.0421,  0.9349,  0.1234,  0.4859,  0.8142,
         0.0463,  0.1138,  0.2701,  0.9247,  0.9493,  0.1272,  0.8864,
         0.1918,  0.7748,  0.5035,  0.6902,  0.2266,  0.9027,  0.2643,
         0.9079,  0.0835,  0.0261,  0.2664,  0.9253,  0.8859,  0.0112,
         0.6310,  0.0516,  0.4534,  0.8631,  0.8547,  0.8682,  0.7942,
         0.8820,  0.9710,  0.1020,  0.1785,  0.8944,  0.0685,  0.1759,
         0.1632,  0.9122,  0.0333,  0.1359,  0.9223,  0.6248,  0.9992,
         0.8711,  0.0215,  0.1175,  0.2364,  0.9156,  0.0141,  0.9708,
         0.1874], device='cuda:0')
tensor(0.3177, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1387,  0.8129,  0.0242,  0.8484,  0.9984,  0.9965,  0.3444,
         0.7016,  0.9322,  0.8070,  0.7508,  0.2486,  0.8959,  0.8570,
         0.9116,  0.9500,  0.6730,  0.9253,  0.9130,  0.9371,  0.0318,
         0.0096,  0.1895,  0.0567,  0.0020,  0.2870,  0.6126,  0.8936,
         0.9703,  0.9318,  0.7967,  0.9010,  0.3259,  0.0532,  0.1608,
         0.8505,  0.0198,  0.9332,  0.2916,  0.0625,  0.8294,  0.1991,
         0.4645,  0.9548,  0.1278,  0.9076,  0.8644,  0.9235,  0.5067,
         0.6719,  0.0845,  0.6802,  0.0176,  0.4183,  0.1258,  0.1557,
         0.0703,  0.8461,  0.5347,  0.9920,  0.9326,  0.9694,  0.8751,
         0.9160,  0.7814,  0.8435,  0.4938,  0.0225,  0.1147,  0.3894,
         0.8363,  0.6653,  0.7984,  0.8412,  0.2142,  0.8784,  0.8888,
         0.0516,  0.8984,  0.8543,  0.0450,  0.0171,  0.8729,  0.9557,
         0.0803,  0.0121,  0.2438,  0.9601,  0.9140,  0.0179,  0.6105,
         0.9894,  0.1231,  0.1095,  0.0847,  0.2111,  0.0145,  0.9787,
         0.6221,  0.8573,  0.0299,  0.0555,  0.2288,  0.9942,  0.2495,
         0.9627,  0.9081,  0.3195,  0.8947,  0.0192,  0.8896,  0.7428,
         0.1204,  0.9221,  0.0110,  0.8993,  0.2266,  0.3334,  0.3803,
         0.0307,  0.9941,  0.2242,  0.6027,  0.8199,  0.8760,  0.9980,
         0.4046,  0.9133,  0.0742,  0.9170,  0.9721,  0.1813,  0.9625,
         0.9807,  0.0242,  0.1628,  0.8908,  0.0416,  0.7614,  0.0830,
         0.0915,  0.9580,  0.0226,  0.8986,  0.0034,  0.9053,  0.2365,
         0.9086,  0.0304,  0.0212,  0.0567,  0.3799,  0.4506,  0.1950,
         0.2103,  0.9120,  0.0832,  0.5200,  0.9446,  0.9990,  0.8190,
         0.9471,  0.6689,  0.1821,  0.1961,  0.0606,  0.0887,  0.9164,
         0.0725,  0.0401,  0.4596,  0.9509,  0.9966,  0.7680,  0.1653,
         0.8863,  0.9075,  0.9252,  0.0441,  0.2810,  0.7780,  0.0216,
         0.5857,  0.9162,  0.6824,  0.8886,  0.9901,  0.9042,  0.5832,
         0.5159,  0.9832,  0.9473,  0.1191,  0.0488,  0.0381,  0.9702,
         0.9687,  0.9571,  0.0685,  0.9990,  0.0246,  0.5694,  0.8242,
         0.9842,  0.1998,  0.3076,  0.2325,  0.0524,  0.0339,  0.0852,
         0.9169,  0.0075,  0.0481,  0.0235,  0.6236,  0.2135,  0.9905,
         0.9344,  0.1511,  0.1730,  0.9667,  0.0037,  0.9579,  0.0925,
         0.0105,  0.0027,  0.1316,  0.7796,  0.1596,  0.8220,  0.0376,
         0.0145,  0.9550,  0.9173,  0.6943,  0.6959,  0.0704,  0.2917,
         0.8631,  0.0551,  0.0820,  0.0637,  0.9716,  0.5036,  0.1628,
         0.5442,  0.3081,  0.9754,  0.9845,  0.5347,  0.1792,  0.1901,
         0.0767,  0.8913,  0.9616,  0.7771,  0.9325,  0.1996,  0.1103,
         0.0952,  0.7248,  0.9419,  0.8321,  0.9220,  0.3334,  0.0028,
         0.8796,  0.6431,  0.2123,  0.5299,  0.0664,  0.0443,  0.4820,
         0.9623,  0.9022,  0.9398,  0.3674,  0.6803,  0.1279,  0.7419,
         0.1425,  0.0236,  0.9071,  0.0626,  0.9584,  0.9170,  0.9486,
         0.0606,  0.5376,  0.2224,  0.8729,  0.7927,  0.9730,  0.9147,
         0.0721,  0.9622,  0.8949,  0.6905,  0.9942,  0.0258,  0.1265,
         0.9818,  0.1361,  0.7985,  0.0528,  0.6275,  0.8905,  0.9813,
         0.0897,  0.9079,  0.9197,  0.2483,  0.0984,  0.9724,  0.4110,
         0.8421,  0.8762,  0.1739,  0.8362,  0.9191,  0.9553,  0.0237,
         0.6591,  0.7370,  0.1562,  0.9519,  0.9590,  0.8019,  0.5637,
         0.1530,  0.2775,  0.6581,  0.0733,  0.9297,  0.8662,  0.0015,
         0.9495,  0.8485,  0.0569,  0.9782,  0.9975,  0.9251,  0.0825,
         0.0688,  0.8087,  0.0239,  0.8754,  0.5198,  0.8130,  0.1171,
         0.8023,  0.8341,  0.9806,  0.9174,  0.8970,  0.8132,  0.2608,
         0.7779,  0.0993,  0.1403,  0.0015,  0.9646,  0.1185,  0.9298,
         0.9462,  0.1873,  0.0813,  0.0744,  0.9757,  0.9176,  0.8797,
         0.7068,  0.9383,  0.7892,  0.6069,  0.0554,  0.0113,  0.2713,
         0.1788,  0.8471,  0.9718,  0.2434,  0.0132,  0.0780,  0.9897,
         0.7301,  0.0583,  0.7870,  0.9763,  0.4045,  0.9802,  0.8678,
         0.0115,  0.2422,  0.9213,  0.7310,  0.7505,  0.0200,  0.1699,
         0.9828,  0.9241,  0.0259,  0.6468,  0.0429,  0.5497,  0.9305,
         0.0247,  0.9035,  0.3659,  0.8819,  0.7650,  0.9493,  0.0366,
         0.5610,  0.0083,  0.9106,  0.5547,  0.2801,  0.9003,  0.0457,
         0.1628,  0.0209,  0.0181,  0.2048,  0.9096,  0.0011,  0.9178,
         0.3011,  0.3286,  0.9083,  0.7400,  0.0143,  0.6370,  0.2102,
         0.9155,  0.0436,  0.6026,  0.9598,  0.9890,  0.8785,  0.0820,
         0.1871,  0.9802,  0.6665,  0.1444,  0.1155,  0.0215,  0.8025,
         0.9663,  0.6160,  0.0327,  0.0524,  0.3531,  0.8354,  0.1985,
         0.9387,  0.0174,  0.7486,  0.1575,  0.9704,  0.6144,  0.9965,
         0.0995,  0.7458,  0.9378,  0.6449,  0.9439,  0.9053,  0.3597,
         0.9785,  0.0561,  0.9625,  0.1358,  0.2198,  0.4592,  0.0390,
         0.9175,  0.9916,  0.9757,  0.0291,  0.9326,  0.7739,  0.4352,
         0.2004,  0.0054,  0.6902,  0.8562,  0.3220,  0.9641,  0.7644,
         0.0222,  0.9138,  0.2376,  0.0639,  0.1993,  0.7589,  0.2386,
         0.9358,  0.8356,  0.0160,  0.8501,  0.3835,  0.0089,  0.7096,
         0.9704,  0.7351,  0.1438,  0.0432,  0.9311,  0.0251,  0.8750,
         0.0445], device='cuda:0')
tensor(0.3440, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9591,  0.0808,  0.0544,  0.0171,  0.0562,  0.1809,  0.1698,
         0.9463,  0.9075,  0.0523,  0.6162,  0.9373,  0.2834,  0.1721,
         0.9403,  0.9127,  0.0521,  0.8870,  0.0574,  0.9986,  0.1956,
         0.8004,  0.9981,  0.0591,  0.5004,  0.0212,  0.9954,  0.9317,
         0.8867,  0.0670,  0.1185,  0.1493,  0.0481,  0.9408,  0.0709,
         0.6337,  0.2268,  0.0728,  0.9339,  0.4265,  0.0206,  0.0262,
         0.0267,  0.2331,  0.9885,  0.3991,  0.8530,  0.9376,  0.8622,
         0.2070,  0.1916,  0.8299,  0.1226,  0.8253,  0.0212,  0.2948,
         0.9371,  0.8117,  0.0150,  0.0299,  0.7620,  0.0753,  0.8958,
         0.0359,  0.3896,  0.7197,  0.9258,  0.0272,  0.9624,  0.8557,
         0.6028,  0.0036,  0.1114,  0.2079,  0.8471,  0.3672,  0.2574,
         0.8733,  0.9641,  0.0136,  0.8666,  0.9936,  0.4600,  0.9426,
         0.0062,  0.9923,  0.9325,  0.3347,  0.0085,  0.0425,  0.9316,
         0.9739,  0.6946,  0.9390,  0.3105,  0.9403,  0.9519,  0.1763,
         0.9209,  0.8520,  0.9953,  0.0268,  0.6262,  0.2736,  0.2468,
         0.9308,  0.9012,  0.9669,  0.9998,  0.4841,  0.9769,  0.9601,
         0.0722,  0.0761,  0.1867,  0.0974,  0.1237,  0.4983,  0.9790,
         0.9475,  0.9599,  0.9580,  0.0394,  0.9688,  0.8263,  0.9881,
         0.1308,  0.1034,  0.3773,  0.8305,  0.3098,  0.0514,  0.0430,
         0.8797,  0.6202,  0.0351,  0.8462,  0.7507,  0.6629,  0.4380,
         0.1097,  0.9947,  0.0815,  0.0234,  0.8263,  0.6247,  0.0810,
         0.3816,  0.0054,  0.7313,  0.1360,  0.6049,  0.1087,  0.9396,
         0.9406,  0.2102,  0.0848,  0.9633,  0.9503,  0.7006,  0.9547,
         0.8724,  0.9742,  0.2599,  0.1201,  0.0387,  0.4669,  0.8622,
         0.8283,  0.5196,  0.0710,  0.1801,  0.9182,  0.1740,  0.1232,
         0.3421,  0.0438,  0.4002,  0.1136,  0.1728,  0.9623,  0.0515,
         0.0046,  0.8416,  0.0489,  0.1042,  0.8620,  0.3154,  0.9729,
         0.0186,  0.0846,  0.7658,  0.7204,  0.1345,  0.7724,  0.8606,
         0.8111,  0.7774,  0.1383,  0.7011,  0.7040,  0.9344,  0.9675,
         0.0482,  0.0501,  0.7973,  0.9809,  0.0730,  0.5366,  0.8180,
         0.0316,  0.0288,  0.0392,  0.0161,  0.8953,  0.6607,  0.0830,
         0.0032,  0.7685,  0.9642,  0.2268,  0.8772,  0.9342,  0.8204,
         0.2501,  0.7653,  0.6659,  0.1705,  0.6866,  0.0231,  0.1268,
         0.0363,  0.1117,  0.9690,  0.9367,  0.6784,  0.0805,  0.8171,
         0.8452,  0.8293,  0.9936,  0.9939,  0.3884,  0.0984,  0.0593,
         0.0295,  0.0273,  0.6077,  0.7370,  0.9177,  0.0194,  0.9640,
         0.9002,  0.2223,  0.9315,  0.9165,  0.2774,  0.2702,  0.9134,
         0.9429,  0.9797,  0.6944,  0.6426,  0.8941,  0.1309,  0.9444,
         0.9060,  0.9755,  0.4478,  0.7974,  0.0901,  0.8726,  0.4746,
         0.6502,  0.1006,  0.9526,  0.8338,  0.6005,  0.0658,  0.9706,
         0.8579,  0.9477,  0.0298,  0.9484,  0.7358,  0.0306,  0.9171,
         0.0214,  0.9280,  0.0281,  0.4412,  0.9272,  0.9367,  0.8980,
         0.7840,  0.9318,  0.7431,  0.0342,  0.9973,  0.0343,  0.3267,
         0.8729,  0.9240,  0.8940,  0.8675,  0.0405,  0.0694,  0.0320,
         0.9593,  0.9188,  0.9594,  0.0081,  0.9957,  0.1211,  0.9164,
         0.0894,  0.0465,  0.8726,  0.1112,  0.5065,  0.0714,  0.1703,
         0.7595,  0.3265,  0.0296,  0.0560,  0.9316,  0.9126,  0.5281,
         0.0795,  0.8831,  0.9163,  0.4042,  0.0039,  0.9194,  0.6807,
         0.9679,  0.7185,  0.0982,  0.7940,  0.7366,  0.5247,  0.9833,
         0.1031,  0.1634,  0.4982,  0.0248,  0.0838,  0.0881,  0.9604,
         0.7613,  0.9511,  0.9450,  0.8797,  0.9269,  0.5867,  0.9787,
         0.0559,  0.3060,  0.8594,  0.9689,  0.4843,  0.9442,  0.8931,
         0.9747,  0.9085,  0.9020,  0.8105,  0.9010,  0.7004,  0.6915,
         0.8075,  0.0073,  0.9616,  0.0207,  0.9649,  0.0430,  0.8728,
         0.1315,  0.9991,  0.2098,  0.9748,  0.0488,  0.9845,  0.9979,
         0.9044,  0.9541,  0.7550,  0.6452,  0.1480,  0.3934,  0.0440,
         0.0493,  0.7917,  0.7224,  0.6767,  0.9881,  0.1533,  0.0310,
         0.6580,  0.8964,  0.1933,  0.8672,  0.9290,  0.8873,  0.9300,
         0.9545,  0.8800,  0.9436,  0.8573,  0.8819,  0.1253,  0.4616,
         0.9890,  0.9599,  0.9326,  0.9674,  0.1249,  0.9698,  0.9819,
         0.9637,  0.8286,  0.7172,  0.9428,  0.6678,  0.0147,  0.1576,
         0.8185,  0.8775,  0.3642,  0.8604,  0.9417,  0.9598,  0.8603,
         0.8204,  0.3540,  0.5991,  0.8647,  0.0586,  0.0594,  0.0314,
         0.2126,  0.1469,  0.8513,  0.1681,  0.9948,  0.7657,  0.1533,
         0.9952,  0.0172,  0.0461,  0.0272,  0.6060,  0.9667,  0.4851,
         0.8832,  0.9419,  0.9593,  0.1050,  0.9727,  0.9153,  0.9033,
         0.2085,  0.4358,  0.9646,  0.1521,  0.9698,  0.0397,  0.0084,
         0.8840,  0.9843,  0.9979,  0.7758,  0.2184,  0.0296,  0.1483,
         0.9809,  0.1154,  0.6649,  0.9759,  0.4252,  0.1513,  0.0198,
         0.3484,  0.1105,  0.3542,  0.3516,  0.5295,  0.9118,  0.9182,
         0.8799,  0.0312,  0.1404,  0.7476,  0.9505,  0.6972,  0.9153,
         0.9702,  0.0318,  0.8732,  0.1302,  0.2283,  0.8238,  0.1329,
         0.0104,  0.1529,  0.0035,  0.9136,  0.8588,  0.9962,  0.2292,
         0.9246], device='cuda:0')
tensor(0.3444, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9530,  0.8946,  0.8635,  0.8367,  0.8731,  0.5251,  0.9739,
         0.4284,  0.1144,  0.2022,  0.9807,  0.8147,  0.0793,  0.6736,
         0.4190,  0.4891,  0.9019,  0.6259,  0.9737,  0.5743,  0.9589,
         0.0035,  0.3220,  0.0295,  0.9845,  0.9854,  0.9058,  0.8951,
         0.8405,  0.0946,  0.0879,  0.9418,  0.0049,  0.9946,  0.1511,
         0.8230,  0.0170,  0.9007,  0.8872,  0.9601,  0.0318,  0.9629,
         0.9336,  0.9567,  0.6928,  0.2313,  0.5959,  0.9823,  0.3137,
         0.9710,  0.0973,  0.2069,  0.1718,  0.1121,  0.1366,  0.9581,
         0.9689,  0.0438,  0.8630,  0.9255,  0.9438,  0.4382,  0.0088,
         0.7543,  0.9071,  0.1774,  0.6834,  0.5907,  0.0848,  0.0584,
         0.0233,  0.7592,  0.3123,  0.1103,  0.0229,  0.6898,  0.9344,
         0.8007,  0.0087,  0.0939,  0.9402,  0.1208,  0.9760,  0.0123,
         0.8283,  0.0041,  0.8787,  0.0334,  0.7103,  0.9821,  0.0413,
         0.8711,  0.5652,  0.1311,  0.9587,  0.6150,  0.6504,  0.9625,
         0.0634,  0.7283,  0.7809,  0.0298,  0.0084,  0.8103,  0.0884,
         0.0223,  0.9775,  0.9631,  0.0301,  0.0961,  0.7141,  0.9751,
         0.1898,  0.0019,  0.0538,  0.2876,  0.9029,  0.1192,  0.9211,
         0.9996,  0.1084,  0.9412,  0.0261,  0.8255,  0.7815,  0.0352,
         0.0373,  0.9257,  0.0257,  0.0175,  0.9549,  0.7926,  0.0062,
         0.9792,  0.0614,  0.9440,  0.1989,  0.7930,  0.0219,  0.7992,
         0.8834,  0.4564,  0.0037,  0.9879,  0.1218,  0.1848,  0.9521,
         0.0908,  0.1145,  0.9421,  0.0494,  0.9018,  0.4938,  0.0608,
         0.9102,  0.7882,  0.0139,  0.1079,  0.5721,  0.9871,  0.9457,
         0.0640,  0.0117,  0.0013,  0.0429,  0.9981,  0.9924,  0.8204,
         0.0438,  0.7452,  0.8740,  0.8709,  0.0459,  0.0214,  0.9412,
         0.9445,  0.0279,  0.0512,  0.0108,  0.2740,  0.6770,  0.0060,
         0.0564,  0.1302,  0.8287,  0.1658,  0.6929,  0.8212,  0.0023,
         0.0012,  0.8527,  0.9712,  0.9379,  0.8838,  0.9022,  0.0215,
         0.7507,  0.5511,  0.4508,  0.6552,  0.0108,  0.2049,  0.8802,
         0.1144,  0.9953,  0.9095,  0.7717,  0.9797,  0.8196,  0.0626,
         0.9669,  0.9318,  0.9769,  0.9661,  0.9552,  0.0335,  0.5015,
         0.1796,  0.0143,  0.8015,  0.9174,  0.0824,  0.8082,  0.4271,
         0.4210,  0.8566,  0.0736,  0.9111,  0.8365,  0.0722,  0.9277,
         0.9194,  0.9814,  0.3202,  0.0132,  0.6403,  0.9329,  0.1028,
         0.0020,  0.5634,  0.9564,  0.8564,  0.1048,  0.9048,  0.8509,
         0.1743,  0.9269,  0.8678,  0.3516,  0.1051,  0.7119,  0.0193,
         0.4771,  0.5080,  0.9089,  0.8908,  0.5060,  0.3800,  0.0064,
         0.1305,  0.8905,  0.9736,  0.1120,  0.0697,  0.1008,  0.0827,
         0.0084,  0.8219,  0.9134,  0.1634,  0.0339,  0.9170,  0.0105,
         0.1599,  0.0154,  0.9495,  0.8627,  0.0056,  0.9131,  0.0609,
         0.0458,  0.2132,  0.4584,  0.9028,  0.9768,  0.4843,  0.8584,
         0.7775,  0.9539,  0.5635,  0.2063,  0.0396,  0.8884,  0.9009,
         0.9662,  0.1045,  0.8555,  0.8850,  0.0124,  0.9706,  0.0607,
         0.0542,  0.9298,  0.0127,  0.7344,  0.0288,  0.9600,  0.0019,
         0.1325,  0.9283,  0.0945,  0.1159,  0.1003,  0.0455,  0.8744,
         0.0272,  0.0874,  0.0204,  0.0035,  0.0476,  0.1313,  0.9281,
         0.8187,  0.0194,  0.8634,  0.0728,  0.8806,  0.8635,  0.4602,
         0.9125,  0.1665,  0.9976,  0.7013,  0.0505,  0.2714,  0.9347,
         0.4165,  0.0330,  0.9157,  0.9631,  0.0623,  0.0970,  0.9770,
         0.9133,  0.9288,  0.9950,  0.9920,  0.6086,  0.2288,  0.3867,
         0.2031,  0.0932,  0.9712,  0.0765,  0.0312,  0.8312,  0.0217,
         0.0816,  0.9668,  0.2519,  0.1759,  0.7054,  0.0155,  0.9740,
         0.0151,  0.0747,  0.9613,  0.9439,  0.0747,  0.9363,  0.0524,
         0.0013,  0.2810,  0.9331,  0.0036,  0.0666,  0.9430,  0.7300,
         0.2042,  0.8776,  0.9251,  0.8369,  0.8718,  0.9715,  0.1650,
         0.0624,  0.2250,  0.9813,  0.3364,  0.9574,  0.8178,  0.4728,
         0.9817,  0.7492,  0.0033,  0.1152,  0.1284,  0.9757,  0.9385,
         0.0841,  0.8558,  0.3240,  0.9370,  0.0354,  0.0826,  0.0092,
         0.5756,  0.0058,  0.8436,  0.0162,  0.0196,  0.6260,  0.6422,
         0.9740,  0.0712,  0.3012,  0.9984,  0.0047,  0.0723,  0.8179,
         0.0201,  0.2157,  0.7034,  0.1438,  0.6317,  0.3920,  0.0421,
         0.9451,  0.0081,  0.0628,  0.7359,  0.2523,  0.9490,  0.0144,
         0.9408,  0.0393,  0.7086,  0.9527,  0.9250,  0.9763,  0.0168,
         0.0175,  0.8790,  0.1569,  0.8751,  0.7504,  0.7808,  0.9870,
         0.1295,  0.9421,  0.7862,  0.7210,  0.9660,  0.7153,  0.6227,
         0.9547,  0.9615,  0.2404,  0.0422,  0.2833,  0.9217,  0.1742,
         0.0493,  0.2427,  0.0287,  0.0852,  0.2336,  0.6997,  0.7910,
         0.0321,  0.0930,  0.9343,  0.0117,  0.0541,  0.9850,  0.0391,
         0.9331,  0.0100,  0.2646,  0.2533,  0.8553,  0.1386,  0.7192,
         0.2547,  0.9211,  0.0755,  0.9446,  0.0477,  0.7483,  0.7609,
         0.3426,  0.6906,  0.9816,  0.1108,  0.9452,  0.9353,  0.1431,
         0.2844,  0.0301,  0.9390,  0.8626,  0.9734,  0.5624,  0.1173,
         0.3083,  0.9801,  0.8459,  0.8240,  0.9598,  0.9709,  0.8751,
         0.0181], device='cuda:0')
tensor(0.2888, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9754,  0.0332,  0.8123,  0.9255,  0.9096,  0.9061,  0.8670,
         0.3973,  0.0142,  0.8616,  0.0960,  0.9906,  0.9447,  0.1545,
         0.9634,  0.0377,  0.1668,  0.1761,  0.7713,  0.8561,  0.0556,
         0.9964,  0.0606,  0.4659,  0.5091,  0.3436,  0.4748,  0.0853,
         0.0717,  0.9766,  0.0585,  0.9372,  0.8392,  0.3524,  0.0339,
         0.0050,  0.0236,  0.0089,  0.0988,  0.9894,  0.0106,  0.0180,
         0.5831,  0.5991,  0.7702,  0.9832,  0.9577,  0.5759,  0.3524,
         0.0307,  0.9276,  0.0045,  0.2388,  0.1980,  0.9944,  0.7041,
         0.0318,  0.0984,  0.7640,  0.9475,  0.8572,  0.5449,  0.7512,
         0.2067,  0.9544,  0.9611,  0.0034,  0.9418,  0.8202,  0.6791,
         0.4347,  0.9212,  0.0105,  0.9231,  0.9879,  0.9807,  0.1098,
         0.8563,  0.3728,  0.1395,  0.8987,  0.8762,  0.8449,  0.0461,
         0.0752,  0.9432,  0.0053,  0.8369,  0.1547,  0.0586,  0.0151,
         0.2167,  0.8569,  0.6725,  0.0522,  0.9528,  0.0965,  0.6318,
         0.3467,  0.9342,  0.1379,  0.9732,  0.0014,  0.0079,  0.1034,
         0.9900,  0.0661,  0.7073,  0.5524,  0.4244,  0.3599,  0.7572,
         0.8684,  0.9497,  0.5885,  0.8440,  0.0449,  0.8558,  0.9365,
         0.2995,  0.9271,  0.8804,  0.0410,  0.9236,  0.8618,  0.1665,
         0.9761,  0.6306,  0.9970,  0.8847,  0.7028,  0.9478,  0.6250,
         0.1181,  0.0330,  0.9885,  0.9137,  0.9113,  0.7634,  0.0641,
         0.8675,  0.0484,  0.1163,  0.0804,  0.8405,  0.0084,  0.9537,
         0.9086,  0.8930,  0.8436,  0.9981,  0.9867,  0.9087,  0.6927,
         0.6975,  0.9481,  0.0234,  0.0899,  0.0120,  0.8955,  0.0025,
         0.0712,  0.8113,  0.1447,  0.0104,  0.9285,  0.7041,  0.1363,
         0.9652,  0.0076,  0.7678,  0.8626,  0.9611,  0.1207,  0.8610,
         0.7496,  0.9097,  0.2761,  0.9656,  0.9278,  0.0273,  0.0417,
         0.4925,  0.0525,  0.1480,  0.8680,  0.9057,  0.6424,  0.6938,
         0.9521,  0.7424,  0.8890,  0.0255,  0.8889,  0.1114,  0.8458,
         0.0294,  0.8800,  0.9011,  0.1487,  0.7887,  0.0024,  0.0047,
         0.0302,  0.1335,  0.5724,  0.0827,  0.8428,  0.9176,  0.7180,
         0.8074,  0.9254,  0.0049,  0.8723,  0.5481,  0.1735,  0.0472,
         0.9871,  0.4827,  0.6807,  0.8504,  0.0690,  0.9449,  0.7149,
         0.9644,  0.8170,  0.7563,  0.0092,  0.9769,  0.3432,  0.0205,
         0.9659,  0.8872,  0.9845,  0.0050,  0.2615,  0.6735,  0.1315,
         0.9332,  0.2424,  0.8269,  0.9721,  0.2536,  0.9742,  0.2142,
         0.9793,  0.0285,  0.0371,  0.0691,  0.9824,  0.8688,  0.2318,
         0.7276,  0.8182,  0.0355,  0.9186,  0.0207,  0.8345,  0.9762,
         0.8267,  0.0859,  0.3170,  0.4438,  0.1339,  0.8929,  0.1244,
         0.8749,  0.0163,  0.1632,  0.0202,  0.0196,  0.0030,  0.9573,
         0.7984,  0.8194,  0.0813,  0.0222,  0.0258,  0.1420,  0.0176,
         0.0967,  0.2776,  0.8811,  0.4262,  0.0289,  0.0113,  0.6353,
         0.4357,  0.8834,  0.2934,  0.0225,  0.4073,  0.5205,  0.0494,
         0.9518,  0.9341,  0.0345,  0.8892,  0.0772,  0.0053,  0.0279,
         0.5255,  0.0452,  0.9587,  0.9989,  0.0115,  0.1963,  0.0161,
         0.4445,  0.7231,  0.0252,  0.7630,  0.1146,  0.0204,  0.0242,
         0.8818,  0.6261,  0.0647,  0.9373,  0.8222,  0.1609,  0.6983,
         0.0358,  0.0852,  0.9269,  0.9269,  0.0108,  0.7908,  0.0101,
         0.0338,  0.0386,  0.0623,  0.5025,  0.1343,  0.7449,  0.0429,
         0.0458,  0.8528,  0.1572,  0.0958,  0.9833,  0.8130,  0.0586,
         0.8730,  0.0809,  0.8438,  0.7706,  0.9792,  0.1181,  0.7220,
         0.4983,  0.0658,  0.8017,  0.6118,  0.6888,  0.9590,  0.4683,
         0.9235,  0.9593,  0.9931,  0.8934,  0.9513,  0.8827,  0.8638,
         0.8799,  0.8318,  0.9236,  0.9361,  0.7756,  0.6630,  0.3581,
         0.0505,  0.3303,  0.8779,  0.1094,  0.9706,  0.7134,  0.4068,
         0.0397,  0.7180,  0.0627,  0.9920,  0.9723,  0.8615,  0.8940,
         0.9869,  0.5058,  0.9258,  0.1376,  0.9680,  0.0381,  0.8161,
         0.1074,  0.9913,  0.8944,  0.8961,  0.9643,  0.0022,  0.0613,
         0.7555,  0.9168,  0.3237,  0.8752,  0.7924,  0.9191,  0.3830,
         0.0762,  0.9164,  0.6501,  0.0313,  0.9411,  0.0039,  0.9319,
         0.0231,  0.8406,  0.8688,  0.7686,  0.0909,  0.0553,  0.7247,
         0.5720,  0.2481,  0.5848,  0.8662,  0.9418,  0.0106,  0.4742,
         0.0157,  0.7107,  0.1591,  0.1516,  0.6468,  0.9152,  0.9475,
         0.8830,  0.0886,  0.9472,  0.9631,  0.1888,  0.9497,  0.7080,
         0.5748,  0.0102,  0.1428,  0.9146,  0.0773,  0.8322,  0.8630,
         0.8814,  0.7983,  0.6797,  0.0358,  0.9019,  0.0518,  0.5026,
         0.3125,  0.3229,  0.9732,  0.8946,  0.6009,  0.9838,  0.9632,
         0.8208,  0.6421,  0.6218,  0.6854,  0.8371,  0.9746,  0.9323,
         0.7483,  0.0735,  0.2102,  0.8126,  0.3020,  0.8487,  0.1201,
         0.0074,  0.3724,  0.8104,  0.8025,  0.2756,  0.2629,  0.8716,
         0.9961,  0.7833,  0.5562,  0.0342,  0.1115,  0.2336,  0.9550,
         0.9948,  0.1646,  0.9319,  0.4478,  0.4598,  0.1142,  0.9919,
         0.0183,  0.4679,  0.0309,  0.3034,  0.0279,  0.0152,  0.1471,
         0.7752,  0.2455,  0.0475,  0.1168,  0.5883,  0.9376,  0.9473,
         0.9139], device='cuda:0')
tensor(0.3372, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7192,  0.0755,  0.9359,  0.9444,  0.7024,  0.8051,  0.1432,
         0.2175,  0.1823,  0.9949,  0.9988,  0.0318,  0.9532,  0.9555,
         0.8763,  0.0393,  0.0093,  0.7799,  0.0011,  0.5153,  0.0925,
         0.0101,  0.7863,  0.1003,  0.0790,  0.9233,  0.4543,  0.8588,
         0.9802,  0.0132,  0.4173,  0.2126,  0.0039,  0.1373,  0.3633,
         0.0424,  0.9495,  0.0484,  0.0395,  0.6075,  0.0159,  0.9886,
         0.0257,  0.0045,  0.9062,  0.9582,  0.9111,  0.5144,  0.9445,
         0.7486,  0.3878,  0.8150,  0.6139,  0.2348,  0.6601,  0.9064,
         0.5896,  0.0021,  0.5292,  0.6937,  0.0273,  0.9022,  0.0083,
         0.8591,  0.0258,  0.8828,  0.0621,  0.8627,  0.2702,  0.5416,
         0.8459,  0.4004,  0.0233,  0.8650,  0.9078,  0.0236,  0.9089,
         0.1561,  0.0044,  0.6904,  0.8596,  0.1525,  0.2548,  0.8498,
         0.7352,  0.6065,  0.0641,  0.1981,  0.9308,  0.9806,  0.8500,
         0.3449,  0.7015,  0.2433,  0.0404,  0.9512,  0.9065,  0.0323,
         0.9764,  0.9351,  0.0037,  0.1192,  0.8379,  0.6417,  0.7952,
         0.9613,  0.1161,  0.7269,  0.9033,  0.0210,  0.8082,  0.9199,
         0.8324,  0.9221,  0.5782,  0.9197,  0.8446,  0.9993,  0.0626,
         0.0675,  0.0519,  0.1556,  0.9066,  0.9982,  0.0201,  0.0646,
         0.2791,  0.8622,  0.0511,  0.0291,  0.8543,  0.2816,  0.8985,
         0.9834,  0.0748,  0.9319,  0.0800,  0.9984,  0.0208,  0.9913,
         0.8162,  0.9640,  0.8520,  0.4660,  0.0394,  0.9420,  0.6736,
         0.9222,  0.0210,  0.9045,  0.0519,  0.1506,  0.1704,  0.9903,
         0.0610,  0.0637,  0.8110,  0.0094,  0.9022,  0.9990,  0.4181,
         0.9697,  0.0043,  0.0381,  0.0221,  0.0572,  0.0586,  0.0055,
         0.9895,  0.9992,  0.7980,  0.0395,  0.4384,  0.9794,  0.0102,
         0.1086,  0.8369,  0.0876,  0.8962,  0.0218,  0.9562,  0.2028,
         0.9982,  0.0068,  0.0646,  0.9387,  0.0026,  0.9190,  0.9447,
         0.9660,  0.0381,  0.2758,  0.8004,  0.0381,  0.0015,  0.2673,
         0.9884,  0.0598,  0.8708,  0.0055,  0.1158,  0.9182,  0.0589,
         0.0302,  0.9816,  0.4645,  0.9397,  0.0065,  0.8371,  0.9780,
         0.9932,  0.3550,  0.3306,  0.0123,  0.9256,  0.4082,  0.1013,
         0.1016,  0.0815,  0.9780,  0.9480,  0.8801,  0.0317,  0.0214,
         0.0159,  0.3891,  0.0011,  0.7239,  0.4138,  0.7299,  0.1154,
         0.8640,  0.9669,  0.9095,  0.8282,  0.1407,  0.8200,  0.6975,
         0.9600,  0.8952,  0.6039,  0.0638,  0.8240,  0.0198,  0.2328,
         0.8368,  0.9990,  0.8525,  0.8407,  0.7744,  0.5625,  0.6725,
         0.0913,  0.0353,  0.1736,  0.9839,  0.1171,  0.9222,  0.6014,
         0.9741,  0.0122,  0.6097,  0.7202,  0.9211,  0.9911,  0.3070,
         0.9965,  0.7668,  0.0840,  0.0165,  0.7861,  0.9187,  0.1115,
         0.5340,  0.9185,  0.9830,  0.0378,  0.9570,  0.0264,  0.9419,
         0.9648,  0.0247,  0.9884,  0.9991,  0.9978,  0.9428,  0.0447,
         0.9069,  0.0563,  0.9852,  0.9271,  0.9200,  0.1143,  0.0397,
         0.8096,  0.0469,  0.0888,  0.1292,  0.8449,  0.8036,  0.0754,
         0.0138,  0.0188,  0.9984,  0.3401,  0.5947,  0.0086,  0.2731,
         0.9564,  0.2832,  0.7782,  0.8768,  0.1772,  0.0704,  0.7700,
         0.0892,  0.9498,  0.9047,  0.2602,  0.5125,  0.0630,  0.0110,
         0.6795,  0.1001,  0.0969,  0.0776,  0.0107,  0.1287,  0.6045,
         0.7980,  0.1561,  0.0087,  0.8109,  0.6116,  0.6581,  0.8848,
         0.9575,  0.7753,  0.0978,  0.6372,  0.9952,  0.0748,  0.0032,
         0.0060,  0.0093,  0.0470,  0.0726,  0.8210,  0.0030,  0.9071,
         0.7773,  0.6410,  0.9115,  0.9671,  0.9829,  0.6774,  0.9688,
         0.0064,  0.8871,  0.9233,  0.9424,  0.3419,  0.5422,  0.0037,
         0.0448,  0.7817,  0.1853,  0.6787,  0.2360,  0.0054,  0.0027,
         0.0091,  0.5673,  0.0839,  0.1968,  0.0149,  0.1407,  0.8998,
         0.9437,  0.0204,  0.2645,  0.9115,  0.8899,  0.9043,  0.4254,
         0.1119,  0.0042,  0.9650,  0.4490,  0.2498,  0.6895,  0.0177,
         0.8383,  0.1005,  0.8872,  0.9406,  0.0479,  0.9711,  0.8498,
         0.9829,  0.8458,  0.9388,  0.9792,  0.9314,  0.7332,  0.8979,
         0.0162,  0.8036,  0.0025,  0.2407,  0.8633,  0.4719,  0.7802,
         0.2326,  0.9809,  0.4535,  0.0037,  0.1190,  0.1357,  0.5985,
         0.8599,  0.1805,  0.1815,  0.0428,  0.8206,  0.0395,  0.8124,
         0.0042,  0.9911,  0.3959,  0.9519,  0.0091,  0.0134,  0.7591,
         0.4875,  0.9344,  0.7276,  0.9855,  0.8452,  0.9347,  0.0041,
         0.0378,  0.8554,  0.0715,  0.9509,  0.9899,  0.5384,  0.8562,
         0.4878,  0.8811,  0.0694,  0.2115,  0.9524,  0.3888,  0.8115,
         0.9571,  0.0185,  0.0603,  0.8235,  0.1943,  0.1675,  0.0240,
         0.0335,  0.9651,  0.8670,  0.0588,  0.9720,  0.8467,  0.8029,
         0.8733,  0.0089,  0.8687,  0.9419,  0.2692,  0.9572,  0.5346,
         0.5840,  0.0808,  0.1209,  0.9323,  0.9479,  0.4997,  0.3600,
         0.9536,  0.9350,  0.7266,  0.9863,  0.9576,  0.0279,  0.9368,
         0.9799,  0.9009,  0.8946,  0.9599,  0.3307,  0.9857,  0.1160,
         0.0008,  0.2313,  0.7881,  0.0161,  0.9585,  0.0401,  0.0256,
         0.9991,  0.0061,  0.1525,  0.8056,  0.9320,  0.2724,  0.9677,
         0.8240], device='cuda:0')
tensor(0.3188, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2555,  0.8292,  0.1569,  0.8746,  0.4659,  0.9060,  0.8081,
         0.1383,  0.0118,  0.8783,  0.2426,  0.0814,  0.8828,  0.0712,
         0.0148,  0.0571,  0.9976,  0.9555,  0.9912,  0.3026,  0.9237,
         0.8533,  0.8204,  0.5249,  0.0172,  0.9276,  0.0156,  0.6329,
         0.0288,  0.0933,  0.0057,  0.9258,  0.8106,  0.2345,  0.9353,
         0.0002,  0.8905,  0.6626,  0.2577,  0.7785,  0.9487,  0.1597,
         0.6913,  0.1506,  0.9122,  0.8220,  0.0220,  0.9492,  0.0019,
         0.0851,  0.0332,  0.8951,  0.5562,  0.2744,  0.0845,  0.1090,
         0.0342,  0.0309,  0.3620,  0.6155,  0.4756,  0.9651,  0.0456,
         0.0043,  0.9781,  0.3323,  0.9542,  0.8063,  0.9498,  0.0183,
         0.9829,  0.9342,  0.0172,  0.0840,  0.0027,  0.1088,  0.9667,
         0.9132,  0.0467,  0.9388,  0.1523,  0.5417,  0.0227,  0.0866,
         0.9005,  0.1128,  0.7955,  0.1191,  0.0158,  0.9868,  0.2808,
         0.8661,  0.9544,  0.2306,  0.0198,  0.1011,  0.9033,  0.0968,
         0.0163,  0.2911,  0.9721,  0.1721,  0.0088,  0.0965,  0.6945,
         0.9645,  0.0329,  0.1018,  0.4107,  0.1489,  0.0307,  0.1549,
         0.0735,  0.0020,  0.9604,  0.1274,  0.0078,  0.1456,  0.8964,
         0.8670,  0.9974,  0.1204,  0.9769,  0.7133,  0.0117,  0.0064,
         0.7591,  0.0308,  0.0070,  0.9514,  0.0264,  0.9224,  0.8882,
         0.4535,  0.8582,  0.9977,  0.7838,  0.7623,  0.8779,  0.8936,
         0.4096,  0.9758,  0.0009,  0.0644,  0.8965,  0.8276,  0.8860,
         0.9659,  0.3998,  0.5408,  0.0084,  0.9125,  0.8944,  0.0035,
         0.2347,  0.0113,  0.0900,  0.0163,  0.8350,  0.7013,  0.9440,
         0.7922,  0.8107,  0.9996,  0.0197,  0.7005,  0.0148,  0.6037,
         0.3024,  0.4491,  0.5748,  0.0416,  0.3863,  0.5706,  0.9668,
         0.7941,  0.2508,  0.9651,  0.6401,  0.0436,  0.0023,  0.9495,
         0.0199,  0.8424,  0.0048,  0.1536,  0.4958,  0.9271,  0.2540,
         0.4726,  0.0512,  0.9656,  0.9738,  0.7170,  0.0220,  0.8960,
         0.0153,  0.9980,  0.2734,  0.0377,  0.0634,  0.2857,  0.9229,
         0.9369,  0.9228,  0.6496,  0.0084,  0.9740,  0.7098,  0.9041,
         0.5576,  0.8986,  0.0547,  0.4192,  0.0615,  0.0106,  0.0062,
         0.0152,  0.0915,  0.7587,  0.0148,  0.9174,  0.8734,  0.0785,
         0.5976,  0.8665,  0.8872,  0.8093,  0.0162,  0.1710,  0.0085,
         0.0097,  0.8536,  0.8963,  0.2157,  0.0259,  0.9445,  0.0093,
         0.0631,  0.7001,  0.4605,  0.1443,  0.0144,  0.0749,  0.0349,
         0.0123,  0.7587,  0.3260,  0.0018,  0.0717,  0.9243,  0.7631,
         0.5434,  0.7467,  0.9445,  0.0121,  0.8609,  0.9810,  0.1623,
         0.0032,  0.0097,  0.8298,  0.0952,  0.1008,  0.8686,  0.0274,
         0.4054,  0.1163,  0.9573,  0.0418,  0.0146,  0.9711,  0.1210,
         0.7135,  0.8890,  0.9137,  0.0022,  0.0227,  0.0752,  0.0065,
         0.4623,  0.1174,  0.0122,  0.5688,  0.8778,  0.9760,  0.9322,
         0.0818,  0.0868,  0.0944,  0.0806,  0.9399,  0.7814,  0.8280,
         0.0826,  0.9505,  0.0517,  0.0837,  0.9405,  0.6153,  0.5048,
         0.6898,  0.0121,  0.1579,  0.9531,  0.9381,  0.9034,  0.1669,
         0.0297,  0.7647,  0.0784,  0.7456,  0.0346,  0.5322,  0.0785,
         0.9609,  0.9836,  0.9817,  0.2000,  0.9642,  0.0006,  0.0135,
         0.9469,  0.0095,  0.0008,  0.0528,  0.5255,  0.2778,  0.0344,
         0.7100,  0.0147,  0.2696,  0.0035,  0.1454,  0.9688,  0.0040,
         0.5271,  0.0126,  0.9953,  0.2769,  0.0464,  0.0019,  0.8983,
         0.0433,  0.0334,  0.9101,  0.8273,  0.9363,  0.0131,  0.8415,
         0.0259,  0.2264,  0.1531,  0.5084,  0.0772,  0.9672,  0.0376,
         0.8695,  0.1423,  0.0226,  0.8086,  0.0248,  0.0273,  0.1130,
         0.1380,  0.5901,  0.8760,  0.0131,  0.0254,  0.9611,  0.7538,
         0.0248,  0.4080,  0.9312,  0.8223,  0.8928,  0.0077,  0.6920,
         0.0348,  0.8568,  0.8240,  0.1038,  0.0129,  0.9242,  0.8240,
         0.0017,  0.6392,  0.0068,  0.0547,  0.0021,  0.8904,  0.9530,
         0.7759,  0.5457,  0.0224,  0.2068,  0.9994,  0.9350,  0.9808,
         0.8420,  0.9562,  0.8867,  0.0115,  0.0052,  0.8678,  0.5326,
         0.3571,  0.6829,  0.9673,  0.9206,  0.0535,  0.0177,  0.0123,
         0.1147,  0.0144,  0.0040,  0.0014,  0.0665,  0.0030,  0.9711,
         0.9944,  0.8910,  0.0193,  0.0604,  0.9644,  0.7189,  0.8863,
         0.9949,  0.8801,  0.0437,  0.7213,  0.0038,  0.7647,  0.0148,
         0.0152,  0.0404,  0.0562,  0.6131,  0.0047,  0.0109,  0.1128,
         0.8593,  0.0019,  0.0236,  0.0170,  0.5994,  0.0470,  0.7312,
         0.9123,  0.9192,  0.0894,  0.3638,  0.9665,  0.0620,  0.0297,
         0.9239,  0.0481,  0.1181,  0.8928,  0.7351,  0.0025,  0.9765,
         0.8470,  0.0113,  0.9122,  0.2750,  0.8604,  0.0025,  0.0079,
         0.0373,  0.1718,  0.9997,  0.0267,  0.9519,  0.0009,  0.0117,
         0.0483,  0.0066,  0.9323,  0.9451,  0.1542,  0.8306,  0.0456,
         0.0284,  0.0182,  0.4366,  0.8276,  0.0164,  0.8903,  0.4826,
         0.0580,  0.9672,  0.0060,  0.5192,  0.0296,  0.0756,  0.8963,
         0.2457,  0.0207,  0.9608,  0.0351,  0.7667,  0.9013,  0.2716,
         0.8941,  0.0814,  0.3990,  0.9955,  0.1523,  0.0041,  0.2766,
         0.8402], device='cuda:0')
tensor(0.3068, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7853,  0.5333,  0.0163,  0.0770,  0.9499,  0.9585,  0.0995,
         0.9362,  0.7874,  0.9874,  0.0208,  0.7177,  0.7720,  0.0298,
         0.3174,  0.9055,  0.0543,  0.0072,  0.0032,  0.1007,  0.9149,
         0.0598,  0.9487,  0.8281,  0.0232,  0.9942,  0.8593,  0.0586,
         0.2187,  0.9040,  0.0640,  0.9941,  0.0256,  0.0573,  0.9057,
         0.2686,  0.0121,  0.8789,  0.8931,  0.2241,  0.9962,  0.0076,
         0.0282,  0.0618,  0.9993,  0.6288,  0.6733,  0.0284,  0.0604,
         0.9161,  0.9885,  0.7259,  0.6962,  0.0884,  0.0266,  0.9414,
         0.8033,  0.0279,  0.9305,  0.0930,  0.0408,  0.3167,  0.1554,
         0.0943,  0.8722,  0.0163,  0.3116,  0.9384,  0.9837,  0.0301,
         0.9381,  0.9451,  0.0959,  0.9737,  0.0028,  0.9494,  0.5297,
         0.8580,  0.0362,  0.9958,  0.1957,  0.0046,  0.1468,  0.2689,
         0.0529,  0.2897,  0.0320,  0.0019,  0.3943,  0.7958,  0.9761,
         0.7785,  0.3633,  0.7290,  0.0098,  0.9869,  0.6894,  0.9707,
         0.7080,  0.0328,  0.9978,  0.8191,  0.5711,  0.0006,  0.9265,
         0.0420,  0.0008,  0.0108,  0.7446,  0.9086,  0.0155,  0.0036,
         0.9784,  0.0673,  0.0370,  0.0434,  0.8729,  0.9722,  0.1200,
         0.0678,  0.0393,  0.7456,  0.7305,  0.8811,  0.7526,  0.9124,
         0.9842,  0.0442,  0.8129,  0.0109,  0.8770,  0.0570,  0.0424,
         0.8875,  0.0933,  0.4449,  0.0422,  0.0237,  0.0395,  0.2106,
         0.8517,  0.9733,  0.1103,  0.0370,  0.4021,  0.9929,  0.1012,
         0.9833,  0.1741,  0.0345,  0.0239,  0.3865,  0.0213,  0.0246,
         0.9496,  0.9672,  0.9005,  0.0037,  0.9641,  0.0039,  0.0589,
         0.6419,  0.9264,  0.0022,  0.9246,  0.8792,  0.0089,  0.0218,
         0.0007,  0.9648,  0.8687,  0.9074,  0.1793,  0.2962,  0.9477,
         0.2566,  0.9973,  0.0950,  0.9993,  0.5564,  0.9471,  0.9526,
         0.9764,  0.0509,  0.9766,  0.0011,  0.9966,  0.9766,  0.8636,
         0.4124,  0.0594,  0.2339,  0.0995,  0.0861,  0.5554,  0.0171,
         0.8091,  0.6724,  0.9259,  0.7241,  0.0065,  0.0998,  0.2341,
         0.8866,  0.0384,  0.8724,  0.0135,  0.1875,  0.2739,  0.1984,
         0.9741,  0.6099,  0.0250,  0.8233,  0.0037,  0.0331,  0.0199,
         0.9436,  0.0261,  0.0029,  0.0204,  0.4627,  0.8984,  0.8846,
         0.8793,  0.2825,  0.0223,  0.9542,  0.9381,  0.3691,  0.0274,
         0.9981,  0.9625,  0.9605,  0.9498,  0.2808,  0.9466,  0.0706,
         0.9865,  0.1567,  0.0418,  0.0060,  0.0250,  0.9874,  0.7990,
         0.0039,  0.0706,  0.5042,  0.8703,  0.1475,  0.8730,  0.0621,
         0.9357,  0.7610,  0.8441,  0.0040,  0.0037,  0.9345,  0.0305,
         0.4511,  0.0055,  0.9816,  0.0549,  0.8828,  0.7760,  0.8330,
         0.8776,  0.8635,  0.8383,  0.0158,  0.4521,  0.1380,  0.0082,
         0.0063,  0.9247,  0.2627,  0.9252,  0.0509,  0.3907,  0.8960,
         0.0824,  0.0056,  0.0041,  0.8573,  0.0343,  0.9969,  0.5918,
         0.0562,  0.5623,  0.0284,  0.0203,  0.9560,  0.8607,  0.0447,
         0.6811,  0.0248,  0.9914,  0.4258,  0.6909,  0.8366,  0.0161,
         0.0403,  0.0534,  0.8051,  0.8813,  0.6553,  0.6542,  0.0078,
         0.0121,  0.0531,  0.9490,  0.7605,  0.0719,  0.1527,  0.9740,
         0.0174,  0.9919,  0.9324,  0.6307,  0.9386,  0.5420,  0.0858,
         0.0071,  0.0160,  0.7382,  0.8419,  0.0143,  0.0220,  0.0024,
         0.8173,  0.5867,  0.4144,  0.1000,  0.2136,  0.8356,  0.0050,
         0.2234,  0.7514,  0.5818,  0.6505,  0.9630,  0.8593,  0.0340,
         0.8488,  0.9580,  0.0043,  0.2442,  0.9703,  0.0755,  0.0013,
         0.5147,  0.9277,  0.1179,  0.8490,  0.6429,  0.6921,  0.7377,
         0.0337,  0.4584,  0.5445,  0.8421,  0.9691,  0.0190,  0.0069,
         0.0221,  0.0211,  0.5587,  0.9065,  0.4340,  0.0305,  0.0328,
         0.5791,  0.0082,  0.0017,  0.6168,  0.8123,  0.0079,  0.1796,
         0.8478,  0.0509,  0.8864,  0.9617,  0.0583,  0.1679,  0.4196,
         0.0024,  0.3457,  0.7287,  0.0533,  0.9322,  0.9025,  0.8884,
         0.8860,  0.9391,  0.8013,  0.6274,  0.1124,  0.7679,  0.0870,
         0.3176,  0.0775,  0.0099,  0.1153,  0.8635,  0.1388,  0.8744,
         0.9390,  0.2269,  0.3591,  0.0454,  0.9861,  0.6729,  0.0696,
         0.0037,  0.2745,  0.0262,  0.9601,  0.0089,  0.0789,  0.0062,
         0.7715,  0.0376,  0.6399,  0.0043,  0.9994,  0.9926,  0.9752,
         0.3246,  0.9838,  0.9293,  0.9552,  0.9345,  0.0570,  0.9046,
         0.0578,  0.0996,  0.9925,  0.5485,  0.9099,  0.8065,  0.0038,
         0.4725,  0.8607,  0.0011,  0.5800,  0.9589,  0.9653,  0.0110,
         0.8624,  0.1218,  0.1742,  0.9402,  0.0008,  0.9007,  0.0012,
         0.9637,  0.0220,  0.8996,  0.5155,  0.0035,  0.7979,  0.8134,
         0.0088,  0.0252,  0.2291,  0.7514,  0.1696,  0.0245,  0.0817,
         0.1271,  0.9381,  0.8323,  0.0512,  0.0367,  0.0135,  0.9196,
         0.0292,  0.5703,  0.9558,  0.0301,  0.8807,  0.8946,  0.8455,
         0.3438,  0.6460,  0.0442,  0.4877,  0.5981,  0.8787,  0.1201,
         0.9025,  0.0077,  0.9538,  0.0749,  0.3160,  0.5404,  0.8813,
         0.7467,  0.2921,  0.7065,  0.1325,  0.9334,  0.6047,  0.2511,
         0.0298,  0.0117,  0.0203,  0.6627,  0.0095,  0.8627,  0.0670,
         0.0873], device='cuda:0')
tensor(0.3271, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9475,  0.1355,  0.9495,  0.9648,  0.8021,  0.7477,  0.0303,
         0.3958,  0.0757,  0.0226,  0.1245,  0.7530,  0.9357,  0.1114,
         0.2558,  0.0440,  0.0453,  0.0134,  0.9601,  0.9942,  0.8338,
         0.9806,  0.0035,  0.0111,  0.3048,  0.9590,  0.7099,  0.9258,
         0.8414,  0.2024,  0.5757,  0.0894,  0.0141,  0.0316,  0.7993,
         0.1374,  0.9967,  0.4562,  0.1886,  0.8956,  0.8671,  0.8966,
         0.9813,  0.0237,  0.4792,  0.8879,  0.0607,  0.8864,  0.0489,
         0.1314,  0.0108,  0.8710,  0.9171,  0.7962,  0.2039,  0.8037,
         0.0459,  0.0376,  0.6728,  0.0517,  0.9805,  0.7909,  0.7595,
         0.0310,  0.7329,  0.0334,  0.9438,  0.1158,  0.0773,  0.8963,
         0.0949,  0.1146,  0.1528,  0.0369,  0.8158,  0.8698,  0.0093,
         0.6457,  0.6169,  0.2091,  0.3607,  0.4473,  0.8352,  0.9194,
         0.1218,  0.8854,  0.0437,  0.9490,  0.2581,  0.7581,  0.0173,
         0.2986,  0.1018,  0.0262,  0.1021,  0.9452,  0.0430,  0.9663,
         0.2342,  0.0376,  0.3413,  0.2518,  0.8320,  0.0038,  0.9529,
         0.9263,  0.4541,  0.1096,  0.4379,  0.0312,  0.2023,  0.9272,
         0.0509,  0.8078,  0.5705,  0.6849,  0.2085,  0.2185,  0.5623,
         0.0545,  0.9938,  0.5122,  0.7156,  0.9896,  0.7933,  0.0589,
         0.0282,  0.0841,  0.4611,  0.0719,  0.7565,  0.2081,  0.8736,
         0.0640,  0.7020,  0.9980,  0.8600,  0.0094,  0.0313,  0.9143,
         0.5407,  0.4583,  0.0111,  0.0229,  0.9788,  0.8457,  0.0315,
         0.0516,  0.0209,  0.6485,  0.3965,  0.1375,  0.9854,  0.6305,
         0.0089,  0.0593,  0.5854,  0.0366,  0.9476,  0.9898,  0.0071,
         0.0689,  0.1482,  0.0178,  0.0217,  0.9644,  0.0325,  0.9174,
         0.1596,  0.9132,  0.0878,  0.9758,  0.4494,  0.4220,  0.3828,
         0.0948,  0.3859,  0.3945,  0.9994,  0.7451,  0.2317,  0.0044,
         0.9513,  0.4742,  0.9739,  0.3408,  0.9693,  0.9077,  0.9301,
         0.0049,  0.9128,  0.2485,  0.4739,  0.7808,  0.9095,  0.5508,
         0.0214,  0.7773,  0.0669,  0.7200,  0.9837,  0.1084,  0.7270,
         0.7800,  0.4342,  0.6161,  0.5402,  0.0079,  0.9141,  0.9725,
         0.9107,  0.9959,  0.8849,  0.0524,  0.8875,  0.0490,  0.8849,
         0.2323,  0.0013,  0.0898,  0.7292,  0.9630,  0.1556,  0.2632,
         0.9350,  0.0394,  0.2641,  0.1110,  0.8235,  0.9971,  0.6537,
         0.1029,  0.0371,  0.0154,  0.4786,  0.5786,  0.6973,  0.9746,
         0.2330,  0.0633,  0.9657,  0.8416,  0.1712,  0.8864,  0.7534,
         0.0599,  0.0024,  0.9596,  0.9122,  0.8547,  0.8915,  0.1844,
         0.0131,  0.0890,  0.1302,  0.8535,  0.3124,  0.0113,  0.9654,
         0.5616,  0.3581,  0.8348,  0.6775,  0.6898,  0.0175,  0.8842,
         0.7981,  0.5443,  0.0934,  0.8555,  0.3984,  0.9530,  0.9830,
         0.0495,  0.7356,  0.8470,  0.6810,  0.3642,  0.0067,  0.9822,
         0.8257,  0.0145,  0.4609,  0.8918,  0.0271,  0.6159,  0.9250,
         0.0201,  0.7274,  0.0866,  0.7847,  0.9057,  0.2029,  0.9550,
         0.8259,  0.0121,  0.0811,  0.9519,  0.9881,  0.0200,  0.7438,
         0.2240,  0.0412,  0.0916,  0.1400,  0.3072,  0.5053,  0.4683,
         0.0220,  0.8449,  0.0212,  0.6446,  0.6935,  0.4892,  0.0364,
         0.7385,  0.8108,  0.0617,  0.1462,  0.5656,  0.8516,  0.3979,
         0.1314,  0.8682,  0.0125,  0.1587,  0.7814,  0.0627,  0.1025,
         0.6172,  0.8448,  0.0266,  0.9141,  0.4387,  0.7506,  0.9746,
         0.0059,  0.0192,  0.8484,  0.8366,  0.0819,  0.0670,  0.9009,
         0.9010,  0.6717,  0.0601,  0.1078,  0.5106,  0.0046,  0.0084,
         0.4169,  0.8205,  0.1524,  0.0784,  0.1543,  0.9856,  0.2652,
         0.9980,  0.2444,  0.5361,  0.3053,  0.0146,  0.9561,  0.0672,
         0.5391,  0.5919,  0.7832,  0.6393,  0.0063,  0.8909,  0.9556,
         0.9207,  0.0766,  0.2524,  0.0186,  0.9258,  0.0948,  0.9968,
         0.9688,  0.6947,  0.0596,  0.0265,  0.1236,  0.0090,  0.7685,
         0.9627,  0.8133,  0.0171,  0.3183,  0.6582,  0.4193,  0.9714,
         0.2178,  0.8808,  0.8599,  0.7024,  0.0440,  0.0087,  0.7457,
         0.0016,  0.2465,  0.9747,  0.9054,  0.9953,  0.1064,  0.0793,
         0.5267,  0.1288,  0.3433,  0.3076,  0.5708,  0.9794,  0.0209,
         0.9139,  0.8327,  0.8338,  0.0331,  0.5077,  0.9559,  0.4616,
         0.0066,  0.3219,  0.0120,  0.4552,  0.5256,  0.8246,  0.2047,
         0.9735,  0.9814,  0.9020,  0.3781,  0.4163,  0.1792,  0.1454,
         0.0345,  0.4307,  0.0113,  0.4617,  0.0617,  0.0353,  0.7071,
         0.8358,  0.0796,  0.4014,  0.8530,  0.9782,  0.0188,  0.2848,
         0.0934,  0.9996,  0.1649,  0.5495,  0.2571,  0.0399,  0.1914,
         0.1578,  0.8464,  0.8340,  0.0793,  0.0653,  0.0014,  0.6188,
         0.9623,  0.1727,  0.9774,  0.9777,  0.8409,  0.9860,  0.2049,
         0.8236,  0.0367,  0.0400,  0.6727,  0.9815,  0.2776,  0.6353,
         0.9238,  0.9511,  0.1871,  0.0121,  0.9801,  0.9939,  0.9154,
         0.1064,  0.5858,  0.0431,  0.8727,  0.6743,  0.4982,  0.9934,
         0.0010,  0.9793,  0.0015,  0.0065,  0.0577,  0.9819,  0.7991,
         0.1527,  0.0416,  0.9458,  0.8278,  0.2322,  0.8026,  0.2234,
         0.5034,  0.6715,  0.9214,  0.9923,  0.0190,  0.3550,  0.6509,
         0.2205], device='cuda:0')
tensor(0.3526, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1506,  0.0270,  0.0978,  0.5325,  0.5567,  0.0594,  0.9181,
         0.0048,  0.8641,  0.9517,  0.8028,  0.4417,  0.0461,  0.5122,
         0.2236,  0.0769,  0.4066,  0.2473,  0.9643,  0.4048,  0.8444,
         0.0356,  0.1549,  0.0205,  0.0006,  0.7356,  0.0980,  0.8727,
         0.0513,  0.0176,  0.0668,  0.5913,  0.9083,  0.8912,  0.6740,
         0.0238,  0.8383,  0.5415,  0.1521,  0.2221,  0.8164,  0.9993,
         0.8405,  0.6131,  0.1204,  0.7038,  0.8461,  0.5093,  0.0280,
         0.8962,  0.1682,  0.0310,  0.0407,  0.0506,  0.2081,  0.5632,
         0.9480,  0.4807,  0.6882,  0.9725,  0.1336,  0.0824,  0.0203,
         0.9119,  0.8589,  0.9488,  0.9502,  0.6613,  0.9915,  0.9122,
         0.0125,  0.0696,  0.0209,  0.5704,  0.0266,  0.5302,  0.5677,
         0.0063,  0.2608,  0.1619,  0.0029,  0.0459,  0.9408,  0.0049,
         0.8888,  0.8382,  0.1296,  0.8288,  0.9717,  0.9041,  0.9173,
         0.2765,  0.2280,  0.3296,  0.0229,  0.6624,  0.1519,  0.9765,
         0.9292,  0.1248,  0.1313,  0.3622,  0.9772,  0.0053,  0.5449,
         0.9048,  0.0368,  0.0226,  0.8649,  0.0122,  0.9845,  0.3343,
         0.2185,  0.0160,  0.7792,  0.2288,  0.4118,  0.0347,  0.1563,
         0.1688,  0.9666,  0.0019,  0.8529,  0.0200,  0.0213,  0.1711,
         0.9293,  0.4503,  0.9427,  0.0875,  0.5951,  0.8995,  0.6489,
         0.1367,  0.9301,  0.0877,  0.5870,  0.9204,  0.0297,  0.9588,
         0.1358,  0.0627,  0.8170,  0.8853,  0.0293,  0.3627,  0.8321,
         0.2654,  0.3285,  0.3714,  0.7258,  0.0657,  0.0482,  0.9949,
         0.0694,  0.7707,  0.9946,  0.2554,  0.1040,  0.0089,  0.0827,
         0.8185,  0.3681,  0.6921,  0.7867,  0.0240,  0.3473,  0.1979,
         0.9499,  0.4891,  0.6171,  0.8153,  0.8781,  0.2940,  0.1437,
         0.3021,  0.7370,  0.0477,  0.0467,  0.8991,  0.4821,  0.2144,
         0.3490,  0.0974,  0.9576,  0.8954,  0.8630,  0.3693,  0.3541,
         0.9908,  0.0050,  0.6264,  0.7687,  0.0257,  0.9298,  0.9808,
         0.6853,  0.1045,  0.6116,  0.1091,  0.7984,  0.9795,  0.2209,
         0.0296,  0.0139,  0.7899,  0.0610,  0.1024,  0.6430,  0.9812,
         0.9812,  0.3482,  0.8091,  0.8523,  0.7730,  0.9174,  0.0744,
         0.9475,  0.3684,  0.0717,  0.2109,  0.0018,  0.2930,  0.0565,
         0.0963,  0.8326,  0.3192,  0.9590,  0.3073,  0.8967,  0.9396,
         0.9077,  0.0125,  0.8669,  0.0189,  0.9578,  0.3682,  0.9288,
         0.8787,  0.0943,  0.8617,  0.1754,  0.0048,  0.8688,  0.1748,
         0.9083,  0.1650,  0.7082,  0.9163,  0.8455,  0.0720,  0.6402,
         0.0833,  0.7363,  0.9541,  0.8373,  0.1348,  0.9319,  0.9403,
         0.0364,  0.5477,  0.8930,  0.0471,  0.0169,  0.7252,  0.4964,
         0.7435,  0.8282,  0.9268,  0.2090,  0.9329,  0.1119,  0.0392,
         0.0515,  0.3529,  0.1026,  0.9038,  0.1233,  0.0744,  0.9677,
         0.6555,  0.8497,  0.7384,  0.9530,  0.0034,  0.1070,  0.8199,
         0.5737,  0.9840,  0.7446,  0.6460,  0.0177,  0.8952,  0.0204,
         0.7583,  0.0707,  0.9823,  0.0111,  0.0680,  0.3385,  0.8151,
         0.9750,  0.8545,  0.8439,  0.9103,  0.1764,  0.0437,  0.1918,
         0.7514,  0.7278,  0.1034,  0.2193,  0.1696,  0.9349,  0.0032,
         0.9820,  0.0728,  0.9744,  0.3012,  0.0544,  0.0103,  0.8353,
         0.6410,  0.4009,  0.4774,  0.7717,  0.1174,  0.0128,  0.5914,
         0.2866,  0.9870,  0.0833,  0.9987,  0.9969,  0.7978,  0.9985,
         0.9541,  0.8969,  0.0301,  0.9437,  0.9916,  0.9219,  0.8390,
         0.7271,  0.7822,  0.0033,  0.9258,  0.1845,  0.3568,  0.9032,
         0.6908,  0.2385,  0.8013,  0.9876,  0.5148,  0.6166,  0.5944,
         0.5147,  0.0215,  0.9847,  0.0985,  0.1550,  0.0791,  0.9352,
         0.8500,  0.0461,  0.2585,  0.9676,  0.9867,  0.8701,  0.7155,
         0.9332,  0.8479,  0.8160,  0.7595,  0.1957,  0.1856,  0.8560,
         0.4213,  0.0057,  0.1052,  0.8346,  0.4923,  0.0037,  0.9105,
         0.0107,  0.0758,  0.9691,  0.3708,  0.6661,  0.1033,  0.7159,
         0.0272,  0.0309,  0.3585,  0.1281,  0.1116,  0.0063,  0.9080,
         0.7112,  0.2256,  0.9564,  0.1711,  0.3057,  0.7014,  0.9796,
         0.0220,  0.5295,  0.9158,  0.4202,  0.0038,  0.0356,  0.8443,
         0.9112,  0.7899,  0.0865,  0.0439,  0.9743,  0.1841,  0.0225,
         0.0759,  0.0066,  0.9365,  0.8208,  0.9533,  0.9319,  0.0014,
         0.0184,  0.7401,  0.0569,  0.2052,  0.1436,  0.0051,  0.0130,
         0.8862,  0.3163,  0.9450,  0.7799,  0.2411,  0.0841,  0.1875,
         0.0082,  0.3945,  0.0212,  0.1341,  0.8824,  0.9735,  0.4485,
         0.8977,  0.8798,  0.0076,  0.0305,  0.7810,  0.0317,  0.1532,
         0.0614,  0.5605,  0.9799,  0.9628,  0.0080,  0.9432,  0.8525,
         0.0110,  0.6075,  0.9951,  0.2913,  0.9911,  0.9329,  0.9408,
         0.0024,  0.9008,  0.4414,  0.9088,  0.9223,  0.8647,  0.8834,
         0.0017,  0.9953,  0.0089,  0.8480,  0.8975,  0.7526,  0.1171,
         0.4714,  0.9491,  0.3745,  0.9588,  0.9902,  0.3764,  0.8265,
         0.0023,  0.9356,  0.7264,  0.2447,  0.9534,  0.0709,  0.0494,
         0.3791,  0.9702,  0.1032,  0.5779,  0.1897,  0.0118,  0.0898,
         0.0260,  0.6814,  0.0107,  0.0055,  0.7901,  0.4382,  0.2174,
         0.9706], device='cuda:0')
tensor(0.2810, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0428,  0.9545,  0.7561,  0.0136,  0.9673,  0.0157,  0.0218,
         0.0083,  0.9980,  0.1053,  0.6579,  0.0536,  0.3583,  0.9708,
         0.7783,  0.2365,  0.9653,  0.9649,  0.1792,  0.1024,  0.6371,
         0.6340,  0.1079,  0.8144,  0.0262,  0.0142,  0.8050,  0.1241,
         0.4299,  0.8819,  0.7240,  0.9369,  0.9697,  0.8495,  0.0164,
         0.1195,  0.5784,  0.1145,  0.0855,  0.9211,  0.1056,  0.0289,
         0.6731,  0.0942,  0.9860,  0.0752,  0.7975,  0.0592,  0.9677,
         0.2757,  0.9841,  0.7373,  0.8040,  0.0861,  0.4682,  0.0192,
         0.9693,  0.0880,  0.9330,  0.8310,  0.9196,  0.9407,  0.8642,
         0.9734,  0.9708,  0.9754,  0.4434,  0.7314,  0.9175,  0.9480,
         0.0102,  0.9697,  0.8687,  0.3981,  0.9302,  0.1204,  0.0117,
         0.1046,  0.3212,  0.9108,  0.2042,  0.0685,  0.9503,  0.3786,
         0.2311,  0.8731,  0.9224,  0.1276,  0.9615,  0.9341,  0.0244,
         0.6440,  0.1096,  0.6539,  0.0991,  0.8535,  0.4004,  0.7617,
         0.8015,  0.8566,  0.9659,  0.9852,  0.9688,  0.8966,  0.9801,
         0.9689,  0.9492,  0.2627,  0.9639,  0.0363,  0.8389,  0.0135,
         0.1149,  0.9315,  0.3870,  0.0333,  0.8408,  0.5899,  0.0816,
         0.2472,  0.9862,  0.9596,  0.7476,  0.2732,  0.9394,  0.5203,
         0.8940,  0.0070,  0.9289,  0.0518,  0.5995,  0.0835,  0.0867,
         0.0533,  0.9460,  0.9257,  0.0407,  0.9506,  0.0828,  0.8610,
         0.2579,  0.8998,  0.3306,  0.6930,  0.8126,  0.2714,  0.8815,
         0.9627,  0.1195,  0.6031,  0.4749,  0.9416,  0.0761,  0.8290,
         0.9142,  0.0997,  0.0739,  0.0121,  0.9650,  0.8657,  0.0023,
         0.0531,  0.0603,  0.7948,  0.0301,  0.0186,  0.9355,  0.1173,
         0.9984,  0.8887,  0.1462,  0.2388,  0.8331,  0.0497,  0.6660,
         0.9984,  0.8009,  0.9688,  0.6834,  0.4907,  0.2672,  0.9336,
         0.9512,  0.9299,  0.7678,  0.4477,  0.0151,  0.0694,  0.0174,
         0.9076,  0.9449,  0.0061,  0.5316,  0.9772,  0.0147,  0.8065,
         0.1452,  0.3468,  0.0134,  0.8601,  0.2980,  0.9157,  0.0658,
         0.9924,  0.9310,  0.0033,  0.9731,  0.1328,  0.9776,  0.1507,
         0.6246,  0.3648,  0.2801,  0.2007,  0.0390,  0.5974,  0.9080,
         0.2476,  0.5023,  0.9578,  0.4698,  0.9294,  0.9213,  0.8704,
         0.0608,  0.9740,  0.9275,  0.0512,  0.0668,  0.9041,  0.9977,
         0.9227,  0.0318,  0.9343,  0.9158,  0.9348,  0.8069,  0.0817,
         0.8758,  0.8707,  0.9592,  0.9446,  0.9305,  0.9992,  0.0202,
         0.1054,  0.1624,  0.9973,  0.9421,  0.9979,  0.8167,  0.5373,
         0.0651,  0.8618,  0.7864,  0.9674,  0.9235,  0.3755,  0.9503,
         0.9598,  0.9759,  0.3847,  0.3611,  0.6464,  0.9725,  0.0314,
         0.0405,  0.9794,  0.8560,  0.9816,  0.7890,  0.9156,  0.2049,
         0.8673,  0.9074,  0.9504,  0.9346,  0.5298,  0.7680,  0.7412,
         0.0909,  0.8305,  0.9975,  0.9093,  0.1651,  0.9178,  0.9856,
         0.9799,  0.8963,  0.9358,  0.1128,  0.1054,  0.0801,  0.0683,
         0.9861,  0.9639,  0.0502,  0.3654,  0.7679,  0.2771,  0.0883,
         0.0694,  0.9719,  0.0152,  0.0229,  0.8970,  0.2056,  0.9959,
         0.0536,  0.9161,  0.7136,  0.6443,  0.0146,  0.0579,  0.1047,
         0.0741,  0.5236,  0.7971,  0.8401,  0.8921,  0.4529,  0.9017,
         0.8207,  0.8272,  0.2806,  0.2276,  0.0178,  0.0026,  0.5734,
         0.0944,  0.5195,  0.9261,  0.3188,  0.2167,  0.9398,  0.4207,
         0.2018,  0.1600,  0.0092,  0.0138,  0.6430,  0.2917,  0.0578,
         0.3471,  0.8888,  0.9734,  0.0879,  0.0370,  0.6258,  0.8979,
         0.1884,  0.0092,  0.2284,  0.0618,  0.0920,  0.7731,  0.1129,
         0.9695,  0.1220,  0.0776,  0.3642,  0.9578,  0.8022,  0.7430,
         0.9095,  0.2423,  0.0437,  0.6859,  0.3028,  0.9240,  0.6181,
         0.0167,  0.1764,  0.0302,  0.9737,  0.7508,  0.5443,  0.9620,
         0.8728,  0.0819,  0.2040,  0.0008,  0.0159,  0.5010,  0.0380,
         0.1525,  0.8863,  0.5887,  0.0937,  0.1449,  0.6677,  0.1915,
         0.1472,  0.8007,  0.9279,  0.0804,  0.0462,  0.0683,  0.0076,
         0.9620,  0.8779,  0.4999,  0.9847,  0.0468,  0.0099,  0.8857,
         0.8901,  0.4248,  0.8572,  0.0448,  0.0723,  0.4143,  0.9077,
         0.1755,  0.1996,  0.4203,  0.0649,  0.9854,  0.1413,  0.9856,
         0.9583,  0.9693,  0.0762,  0.9636,  0.9610,  0.6011,  0.9701,
         0.8773,  0.0239,  0.1026,  0.0975,  0.0922,  0.0259,  0.9679,
         0.8979,  0.8246,  0.2321,  0.9039,  0.5510,  0.9606,  0.1221,
         0.8354,  0.6363,  0.9200,  0.6194,  0.9670,  0.0134,  0.9596,
         0.5870,  0.1011,  0.8032,  0.7187,  0.9697,  0.0555,  0.0915,
         0.0833,  0.9193,  0.9259,  0.0180,  0.9640,  0.1733,  0.1647,
         0.4040,  0.0028,  0.9626,  0.0144,  0.9705,  0.7922,  0.9094,
         0.0223,  0.5941,  0.4484,  0.5925,  0.7735,  0.9984,  0.0372,
         0.0963,  0.0622,  0.1436,  0.9974,  0.0679,  0.0770,  0.9391,
         0.3357,  0.5300,  0.7002,  0.4427,  0.0028,  0.0041,  0.9971,
         0.0432,  0.0036,  0.3936,  0.5427,  0.9863,  0.9530,  0.8722,
         0.0493,  0.7104,  0.0915,  0.9165,  0.9452,  0.7671,  0.8371,
         0.7934,  0.7518,  0.9338,  0.4930,  0.9953,  0.0122,  0.4735,
         0.9965], device='cuda:0')
tensor(0.3189, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0754,  0.9509,  0.9745,  0.2175,  0.0632,  0.9334,  0.9944,
         0.1544,  0.9785,  0.8456,  0.9135,  0.0522,  0.0449,  0.4428,
         0.1225,  0.0467,  0.9786,  0.9791,  0.1709,  0.2079,  0.0343,
         0.9975,  0.9993,  0.2133,  0.0265,  0.0131,  0.0483,  0.7955,
         0.9045,  0.9674,  0.0245,  0.1631,  0.0928,  0.9617,  0.7513,
         0.1157,  0.1004,  0.1595,  0.5924,  0.9219,  0.2928,  0.2399,
         0.2059,  0.3914,  0.1088,  0.8885,  0.9261,  0.9968,  0.9712,
         0.0141,  0.3874,  0.2122,  0.8850,  0.0209,  0.0776,  0.0754,
         0.5476,  0.5397,  0.2448,  0.3192,  0.0318,  0.1380,  0.0049,
         0.8116,  0.9931,  0.9666,  0.9064,  0.4655,  0.0109,  0.0035,
         0.7783,  0.9197,  0.0189,  0.0555,  0.9436,  0.0133,  0.4935,
         0.2438,  0.0293,  0.8983,  0.9451,  0.3996,  0.9356,  0.2626,
         0.0057,  0.9814,  0.0049,  0.9210,  0.0087,  0.8525,  0.9563,
         0.9985,  0.4141,  0.4129,  0.0156,  0.6003,  0.7166,  0.7458,
         0.9456,  0.0403,  0.0006,  0.9176,  0.9409,  0.7180,  0.1748,
         0.0329,  0.5865,  0.1780,  0.3391,  0.2976,  0.9642,  0.1094,
         0.0180,  0.1848,  0.3059,  0.0384,  0.8933,  0.1736,  0.3805,
         0.6163,  0.5366,  0.0892,  0.9898,  0.9165,  0.6337,  0.5448,
         0.9219,  0.0118,  0.7899,  0.8372,  0.2565,  0.2482,  0.2208,
         0.0263,  0.5844,  0.0362,  0.8369,  0.9438,  0.1388,  0.0318,
         0.8812,  0.9276,  0.4988,  0.2498,  0.5492,  0.2564,  0.9002,
         0.7134,  0.0041,  0.6385,  0.9881,  0.5779,  0.4236,  0.8727,
         0.0145,  0.7737,  0.0007,  0.7513,  0.6195,  0.9640,  0.0512,
         0.9546,  0.3286,  0.9922,  0.0458,  0.0057,  0.0866,  0.5948,
         0.4257,  0.9986,  0.8539,  0.8165,  0.9529,  0.1239,  0.7851,
         0.0066,  0.1407,  0.6932,  0.0326,  0.7664,  0.0047,  0.5466,
         0.9996,  0.3804,  0.5743,  0.9105,  0.8826,  0.4111,  0.8878,
         0.6503,  0.8470,  0.2609,  0.1296,  0.9399,  0.3885,  0.9988,
         0.0311,  0.2516,  0.3321,  0.8819,  0.9840,  0.1608,  0.9930,
         0.0458,  0.0301,  0.9166,  0.0192,  0.2221,  0.2335,  0.0264,
         0.3349,  0.9220,  0.0083,  0.9579,  0.9615,  0.1904,  0.8465,
         0.2228,  0.0224,  0.9144,  0.9158,  0.2788,  0.9045,  0.9662,
         0.9800,  0.0122,  0.9201,  0.9590,  0.9606,  0.8934,  0.9275,
         0.0181,  0.0398,  0.0089,  0.0167,  0.3222,  0.0052,  0.0197,
         0.8762,  0.3168,  0.0803,  0.1096,  0.9680,  0.0076,  0.7781,
         0.5236,  0.9900,  0.1267,  0.2262,  0.9769,  0.1754,  0.9714,
         0.4079,  0.8893,  0.9940,  0.7074,  0.8283,  0.0153,  0.3651,
         0.9657,  0.9118,  0.5697,  0.1704,  0.0736,  0.8834,  0.0181,
         0.8646,  0.8510,  0.9781,  0.8697,  0.9285,  0.1659,  0.3048,
         0.9859,  0.8705,  0.0074,  0.0479,  0.1241,  0.8187,  0.3151,
         0.0084,  0.7741,  0.8103,  0.4584,  0.9774,  0.8843,  0.4164,
         0.0038,  0.4153,  0.0244,  0.0672,  0.1304,  0.0204,  0.9676,
         0.1129,  0.1535,  0.9865,  0.9377,  0.9296,  0.9697,  0.6413,
         0.7921,  0.0992,  0.9045,  0.9693,  0.9564,  0.9824,  0.7240,
         0.9241,  0.0037,  0.4133,  0.6990,  0.9841,  0.5504,  0.9620,
         0.1851,  0.8037,  0.0706,  0.4778,  0.7240,  0.9628,  0.0436,
         0.8525,  0.1771,  0.1685,  0.0128,  0.1252,  0.0796,  0.8726,
         0.9535,  0.6848,  0.6541,  0.9053,  0.1018,  0.0684,  0.0091,
         0.1439,  0.0042,  0.9246,  0.9115,  0.9977,  0.0436,  0.8589,
         0.9862,  0.5949,  0.9287,  0.8972,  0.6000,  0.6103,  0.1511,
         0.9534,  0.4454,  0.9515,  0.9749,  0.0080,  0.8572,  0.8420,
         0.4235,  0.8650,  0.0926,  0.3748,  0.3401,  0.8845,  0.0037,
         0.0475,  0.0801,  0.4212,  0.6620,  0.8612,  0.2779,  0.0756,
         0.1991,  0.0569,  0.1848,  0.9082,  0.9496,  0.9045,  0.0067,
         0.7857,  0.9997,  0.0615,  0.0320,  0.5499,  0.5720,  0.9886,
         0.3449,  0.9230,  0.1541,  0.4801,  0.2777,  0.9414,  0.9480,
         0.2130,  0.8501,  0.1291,  0.7430,  0.0247,  0.2234,  0.9022,
         0.9757,  0.8201,  0.2381,  0.3004,  0.0156,  0.6415,  0.0120,
         0.9679,  0.7574,  0.9776,  0.7917,  0.2118,  0.2310,  0.8602,
         0.0560,  0.9415,  0.9798,  0.3557,  0.4761,  0.9783,  0.0153,
         0.4384,  0.5616,  0.9959,  0.0119,  0.6891,  0.0251,  0.5370,
         0.0193,  0.8943,  0.0798,  0.9322,  0.1168,  0.0560,  0.0291,
         0.3023,  0.5055,  0.4533,  0.9708,  0.8335,  0.3108,  0.9026,
         0.9783,  0.0010,  0.9451,  0.1356,  0.9839,  0.9623,  0.4089,
         0.0133,  0.9563,  0.1550,  0.4437,  0.0773,  0.9163,  0.9341,
         0.9158,  0.8820,  0.6555,  0.0534,  0.0100,  0.9552,  0.6089,
         0.6685,  0.0495,  0.2689,  0.0508,  0.0118,  0.8339,  0.8786,
         0.0279,  0.0532,  0.1600,  0.9542,  0.9908,  0.0183,  0.1046,
         0.0015,  0.9871,  0.4101,  0.8194,  0.2398,  0.0072,  0.0300,
         0.0474,  0.0334,  0.0170,  0.0187,  0.0563,  0.1174,  0.3379,
         0.9910,  0.9994,  0.8950,  0.0378,  0.4357,  0.0057,  0.0013,
         0.0016,  0.0317,  0.8311,  0.0874,  0.7365,  0.2512,  0.0024,
         0.0352,  0.8585,  0.8347,  0.7312,  0.6771,  0.9466,  0.8861,
         0.0363], device='cuda:0')
tensor(0.2996, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9231,  0.9444,  0.9511,  0.9561,  0.2069,  0.7637,  0.0032,
         0.0479,  0.3238,  0.9963,  0.6054,  0.1195,  0.9089,  0.0042,
         0.3561,  0.9190,  0.8198,  0.9534,  0.9320,  0.4149,  0.9291,
         0.0868,  0.9488,  0.0200,  0.7346,  0.8640,  0.9675,  0.5495,
         0.0427,  0.7592,  0.9919,  0.7846,  0.3794,  0.9139,  0.9398,
         0.7549,  0.0329,  0.0520,  0.5144,  0.2615,  0.4856,  0.0340,
         0.0128,  0.9075,  0.0157,  0.3200,  0.5067,  0.9646,  0.9900,
         0.0020,  0.8353,  0.0395,  0.6432,  0.9905,  0.0148,  0.0082,
         0.4878,  0.9086,  0.0715,  0.0331,  0.0242,  0.9472,  0.1756,
         0.6959,  0.5156,  0.9939,  0.9966,  0.9554,  0.0242,  0.6973,
         0.0555,  0.0013,  0.9414,  0.9503,  0.9787,  0.9562,  0.7200,
         0.0087,  0.0492,  0.0146,  0.9792,  0.9646,  0.0548,  0.0311,
         0.1064,  0.7639,  0.0036,  0.9826,  0.7857,  0.9289,  0.9223,
         0.8943,  0.4534,  0.9322,  0.5538,  0.0050,  0.0491,  0.9707,
         0.9410,  0.4415,  0.9737,  0.0022,  0.1285,  0.9722,  0.7589,
         0.9928,  0.8276,  0.0243,  0.9271,  0.6962,  0.9405,  0.0278,
         0.0252,  0.0698,  0.7964,  0.1297,  0.8252,  0.3180,  0.9470,
         0.4284,  0.8867,  0.9885,  0.0277,  0.0859,  0.0107,  0.3535,
         0.9063,  0.7595,  0.8213,  0.8752,  0.9351,  0.9330,  0.4584,
         0.4172,  0.9585,  0.9521,  0.7795,  0.0555,  0.0200,  0.9771,
         0.3218,  0.0075,  0.0426,  0.9590,  0.3055,  0.7392,  0.0756,
         0.8837,  0.8438,  0.0372,  0.1408,  0.1061,  0.9247,  0.2062,
         0.0076,  0.9089,  0.9359,  0.1070,  0.9276,  0.8874,  0.0718,
         0.8684,  0.9989,  0.9774,  0.0122,  0.1605,  0.1128,  0.0006,
         0.3204,  0.9685,  0.4668,  0.9303,  0.0459,  0.0965,  0.1663,
         0.0006,  0.0962,  0.0265,  0.2301,  0.1325,  0.9408,  0.0171,
         0.0054,  0.6608,  0.4020,  0.9543,  0.9460,  0.0260,  0.9499,
         0.7982,  0.9771,  0.6177,  0.9769,  0.9912,  0.0066,  0.9551,
         0.0356,  0.0657,  0.0186,  0.0310,  0.0033,  0.8600,  0.9772,
         0.0139,  0.8625,  0.8680,  0.9801,  0.5555,  0.0012,  0.9443,
         0.9258,  0.7029,  0.0361,  0.9744,  0.8208,  0.8805,  0.5099,
         0.0523,  0.8963,  0.1249,  0.0150,  0.9832,  0.8747,  0.9552,
         0.1257,  0.6685,  0.9819,  0.1404,  0.0017,  0.2869,  0.5564,
         0.0910,  0.1829,  0.6311,  0.8526,  0.2066,  0.2641,  0.9931,
         0.0494,  0.5480,  0.8625,  0.8976,  0.9765,  0.8094,  0.9490,
         0.8428,  0.9298,  0.1113,  0.3058,  0.9557,  0.9401,  0.0183,
         0.8885,  0.9853,  0.1754,  0.0412,  0.0096,  0.9054,  0.6424,
         0.8157,  0.9788,  0.2445,  0.0583,  0.9406,  0.0080,  0.0739,
         0.0051,  0.8869,  0.9532,  0.9602,  0.9923,  0.4624,  0.9974,
         0.9715,  0.0948,  0.0193,  0.9216,  0.8231,  0.9440,  0.9874,
         0.1348,  0.9966,  0.0822,  0.2636,  0.8887,  0.9482,  0.5981,
         0.0214,  0.9980,  0.2122,  0.1724,  0.0248,  0.4382,  0.0145,
         0.9499,  0.3326,  0.9953,  0.2250,  0.0017,  0.9154,  0.5529,
         0.8669,  0.9749,  0.0192,  0.0063,  0.6727,  0.9877,  0.9822,
         0.5998,  0.6906,  0.9551,  0.9462,  0.9591,  0.1511,  0.9907,
         0.5709,  0.4780,  0.6245,  0.7006,  0.9700,  0.6819,  0.9840,
         0.5686,  0.3132,  0.0177,  0.7334,  0.0077,  0.9639,  0.9723,
         0.9759,  0.9393,  0.0280,  0.9210,  0.0378,  0.0075,  0.1685,
         0.0258,  0.0314,  0.0816,  0.0188,  0.7255,  0.7651,  0.0358,
         0.5621,  0.9884,  0.0630,  0.0583,  0.1389,  0.4509,  0.9969,
         0.4428,  0.8622,  0.3796,  0.9988,  0.8604,  0.8086,  0.9713,
         0.0172,  0.0543,  0.3133,  0.1285,  0.4438,  0.0368,  0.1453,
         0.0017,  0.8112,  0.3913,  0.9857,  0.6812,  0.0782,  0.0557,
         0.8298,  0.0233,  0.5410,  0.9443,  0.9064,  0.9603,  0.3156,
         0.0321,  0.5836,  0.9661,  0.2430,  0.0085,  0.9879,  0.7542,
         0.9757,  0.0292,  0.0126,  0.7042,  0.1001,  0.1526,  0.9497,
         0.7523,  0.6452,  0.8928,  0.5975,  0.0027,  0.0549,  0.9498,
         0.0502,  0.6213,  0.7144,  0.1575,  0.9660,  0.0074,  0.1519,
         0.9869,  0.0067,  0.0421,  0.8109,  0.1261,  0.7157,  0.8507,
         0.9994,  0.9177,  0.8375,  0.2983,  0.2511,  0.0084,  0.0427,
         0.9775,  0.2138,  0.0137,  0.9283,  0.7668,  0.9762,  0.0362,
         0.8886,  0.0909,  0.0124,  0.7883,  0.0485,  0.9761,  0.0371,
         0.0261,  0.9550,  0.9990,  0.0056,  0.9873,  0.3870,  0.9398,
         0.9747,  0.0050,  0.9014,  0.7373,  0.0692,  0.9492,  0.9642,
         0.8760,  0.0284,  0.8197,  0.2573,  0.0853,  0.2572,  0.8857,
         0.8754,  0.5406,  0.9839,  0.8302,  0.0232,  0.0137,  0.9329,
         0.1033,  0.8627,  0.0195,  0.7725,  0.9507,  0.8744,  0.0027,
         0.9093,  0.0813,  0.7187,  0.8700,  0.1927,  0.0907,  0.8191,
         0.9910,  0.0050,  0.9495,  0.7613,  0.8565,  0.8348,  0.9832,
         0.9674,  0.9859,  0.8533,  0.4243,  0.5180,  0.6163,  0.0331,
         0.9656,  0.0362,  0.6666,  0.1263,  0.4156,  0.9998,  0.9901,
         0.9680,  0.8391,  0.2614,  0.0241,  0.2335,  0.9681,  0.0619,
         0.7092,  0.7855,  0.8093,  0.9584,  0.8849,  0.9538,  0.8000,
         0.8178], device='cuda:0')
tensor(0.3551, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0398,  0.9879,  0.0648,  0.8437,  0.2079,  0.0632,  0.9612,
         0.0029,  0.9714,  0.0274,  0.1157,  0.9551,  0.0048,  0.0245,
         0.9248,  0.7238,  0.0928,  0.9727,  0.9141,  0.9595,  0.1389,
         0.0281,  0.0063,  0.9696,  0.4949,  0.9832,  0.1703,  0.5732,
         0.0105,  0.0312,  0.0088,  0.0443,  0.0060,  0.1380,  0.8615,
         0.0009,  0.0047,  0.0327,  0.1222,  0.0009,  0.9915,  0.0021,
         0.1390,  0.0382,  0.9038,  0.9410,  0.0257,  0.9670,  0.0866,
         0.1324,  0.0023,  0.9526,  0.4294,  0.3482,  0.0073,  0.0055,
         0.1005,  0.2246,  0.8135,  0.9920,  0.0559,  0.0269,  0.7244,
         0.0245,  0.2258,  0.0126,  0.9715,  0.9672,  0.9401,  0.7291,
         0.9807,  0.0016,  0.5664,  0.0028,  0.1704,  0.2635,  0.9531,
         0.0050,  0.1201,  0.0108,  0.2772,  0.9558,  0.0011,  0.8438,
         0.8985,  0.0142,  0.9783,  0.9333,  0.9925,  0.9519,  0.0143,
         0.2985,  0.0133,  0.0009,  0.9652,  0.7152,  0.7281,  0.0297,
         0.2830,  0.9107,  0.0005,  0.0225,  0.2449,  0.9445,  0.0742,
         0.7761,  0.0033,  0.0066,  0.0296,  0.0486,  0.9404,  0.5798,
         0.0727,  0.1925,  0.6791,  0.9473,  0.3737,  0.8875,  0.1086,
         0.8206,  0.2187,  0.0054,  0.8331,  0.0027,  0.8284,  0.0034,
         0.1274,  0.2091,  0.8898,  0.9493,  0.0419,  0.9518,  0.1047,
         0.9448,  0.0279,  0.9319,  0.0120,  0.0603,  0.9641,  0.0011,
         0.5594,  0.0614,  0.3748,  0.0920,  0.9877,  0.1086,  0.0047,
         0.0269,  0.0413,  0.9898,  0.3665,  0.9770,  0.5968,  0.0458,
         0.8459,  0.0451,  0.8027,  0.0245,  0.0766,  0.0109,  0.9455,
         0.0651,  0.9180,  0.0426,  0.0146,  0.8476,  0.0844,  0.0839,
         0.0431,  0.9912,  0.0137,  0.1597,  0.5954,  0.0196,  0.0025,
         0.9917,  0.9376,  0.1537,  0.9491,  0.0297,  0.8424,  0.8941,
         0.0148,  0.0072,  0.7129,  0.0622,  0.0010,  0.5537,  0.2716,
         0.9942,  0.9970,  0.0487,  0.0001,  0.4628,  0.0094,  0.7714,
         0.9500,  0.0021,  0.0723,  0.2961,  0.0112,  0.0173,  0.7624,
         0.2948,  0.9989,  0.7543,  0.6774,  0.0082,  0.0079,  0.1984,
         0.8317,  0.0022,  0.9644,  0.8581,  0.9222,  0.5933,  0.0004,
         0.9983,  0.9515,  0.2018,  0.0093,  0.0691,  0.0079,  0.0472,
         0.1969,  0.9921,  0.7236,  0.8659,  0.9800,  0.9993,  0.0387,
         0.0035,  0.3232,  0.0530,  0.8711,  0.7743,  0.9716,  0.0009,
         0.5549,  0.9480,  0.2277,  0.1895,  0.4785,  0.5539,  0.0434,
         0.0079,  0.0609,  0.7020,  0.0972,  0.0124,  0.7127,  0.4101,
         0.0095,  0.0261,  0.9797,  0.0045,  0.8356,  0.0008,  0.9893,
         0.9624,  0.9180,  0.0477,  0.4003,  0.9643,  0.3635,  0.9105,
         0.0056,  0.0330,  0.3685,  0.0412,  0.9406,  0.1772,  0.0067,
         0.1295,  0.0374,  0.0103,  0.0515,  0.0031,  0.2528,  0.9781,
         0.3973,  0.0331,  0.6456,  0.1785,  0.8368,  0.6840,  0.5440,
         0.9901,  0.0202,  0.8708,  0.3122,  0.9671,  0.0525,  0.1120,
         0.0328,  0.0073,  0.2516,  0.9902,  0.0552,  0.0310,  0.7862,
         0.0171,  0.9585,  0.0495,  0.0440,  0.0164,  0.0423,  0.3883,
         0.0011,  0.9718,  0.3690,  0.9133,  0.9634,  0.0108,  0.6105,
         0.0312,  0.9061,  0.9314,  0.0047,  0.3914,  0.9440,  0.0323,
         0.9498,  0.9572,  0.0297,  0.9568,  0.9291,  0.9779,  0.6228,
         0.9485,  0.9995,  0.9021,  0.8904,  0.9992,  0.8380,  0.9280,
         0.9308,  0.2674,  0.0398,  0.9330,  0.0010,  0.9970,  0.8480,
         0.0492,  0.0163,  0.8764,  0.9990,  0.9598,  0.9740,  0.0005,
         0.4538,  0.0008,  0.8567,  0.9676,  0.9721,  0.8804,  0.0731,
         0.0093,  0.5822,  0.0130,  0.8528,  0.7770,  0.0145,  0.0010,
         0.0220,  0.2423,  0.2416,  0.9462,  0.0939,  0.8632,  0.0196,
         0.9270,  0.9745,  0.0321,  0.0011,  0.3550,  0.0305,  0.9667,
         0.8400,  0.8837,  0.9199,  0.0054,  0.3283,  0.0782,  0.0189,
         0.9764,  0.0252,  0.5610,  0.8549,  0.0337,  0.0122,  0.5422,
         0.9658,  0.9943,  0.0959,  0.9753,  0.8658,  0.9989,  0.2922,
         0.0045,  0.9500,  0.9618,  0.9471,  0.9445,  0.0287,  0.0021,
         0.9066,  0.0972,  0.9057,  0.0343,  0.8142,  0.0173,  0.0440,
         0.9817,  0.9203,  0.1163,  0.0263,  0.0449,  0.9017,  0.0574,
         0.2052,  0.8290,  0.0008,  0.9287,  0.9994,  0.1212,  0.9662,
         0.9667,  0.9800,  0.0024,  0.9996,  0.9554,  0.9525,  0.0797,
         0.0028,  0.0037,  0.9010,  0.0412,  0.9275,  0.0968,  0.0597,
         0.8062,  0.9728,  0.8605,  0.0065,  0.0040,  0.0217,  0.9898,
         0.8399,  0.8546,  0.0018,  0.0171,  0.0325,  0.9227,  0.4529,
         0.1271,  0.9852,  0.9658,  0.9736,  0.0211,  0.9664,  0.6520,
         0.9430,  0.0721,  0.9981,  0.0762,  0.0071,  0.9460,  0.7376,
         0.0435,  0.7911,  0.5794,  0.8400,  0.8383,  0.0267,  0.9097,
         0.9311,  0.1813,  0.9346,  0.0491,  0.0343,  0.8520,  0.9275,
         0.1226,  0.9287,  0.9460,  0.9283,  0.2464,  0.0467,  0.6141,
         0.2583,  0.0715,  0.1542,  0.1709,  0.9916,  0.0014,  0.9025,
         0.5272,  0.9897,  0.9547,  0.1736,  0.3708,  0.0012,  0.0207,
         0.0213,  0.9860,  0.9427,  0.0571,  0.9927,  0.0498,  0.5473,
         0.7088], device='cuda:0')
tensor(0.3054, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0110,  0.7312,  0.8722,  0.5474,  0.1881,  0.9802,  0.8779,
         0.1166,  0.0948,  0.1771,  0.9305,  0.8597,  0.7459,  0.9539,
         0.7586,  0.9723,  0.9803,  0.0078,  0.5251,  0.5823,  0.0068,
         0.9791,  0.9398,  0.6904,  0.0222,  0.0553,  0.0101,  0.8315,
         0.6118,  0.8976,  0.0153,  0.9611,  0.9538,  0.1506,  0.9214,
         0.9626,  0.9863,  0.0389,  0.0083,  0.0174,  0.0201,  0.3505,
         0.2818,  0.0059,  0.9778,  0.9060,  0.9173,  0.7868,  0.9989,
         0.4951,  0.8802,  0.1661,  0.9015,  0.8988,  0.0348,  0.9071,
         0.8564,  0.7146,  0.9797,  0.0156,  0.9557,  0.0282,  0.0882,
         0.0057,  0.6670,  0.8813,  0.0239,  0.3865,  0.8575,  0.0325,
         0.8559,  0.0617,  0.0120,  0.0193,  0.0970,  0.0647,  0.0086,
         0.7085,  0.6402,  0.0926,  0.9575,  0.6143,  0.9694,  0.0056,
         0.8553,  0.9621,  0.4119,  0.0365,  0.1210,  0.9293,  0.0008,
         0.0005,  0.1440,  0.9352,  0.0528,  0.1083,  0.8886,  0.8004,
         0.7515,  0.0404,  0.0491,  0.9674,  0.9411,  0.0255,  0.7267,
         0.0107,  0.6266,  0.9090,  0.0078,  0.9744,  0.9925,  0.9343,
         0.0611,  0.0180,  0.0527,  0.9375,  0.9304,  0.9984,  0.9446,
         0.0012,  0.1635,  0.9102,  0.2795,  0.0621,  0.9546,  0.0109,
         0.7079,  0.9234,  0.9874,  0.2279,  0.9981,  0.9644,  0.5171,
         0.9741,  0.6118,  0.0014,  0.2696,  0.0735,  0.9776,  0.0070,
         0.0299,  0.0773,  0.1835,  0.0865,  0.8123,  0.0110,  0.0279,
         0.3304,  0.4094,  0.0581,  0.8241,  0.9766,  0.9611,  0.6434,
         0.8783,  0.6718,  0.0470,  0.9499,  0.9103,  0.2125,  0.9997,
         0.9447,  0.0109,  0.0206,  0.6250,  0.1846,  0.9568,  0.8562,
         0.7313,  0.0035,  0.9559,  0.1283,  0.8927,  0.1055,  0.3772,
         0.2663,  0.1450,  0.0007,  0.9782,  0.9467,  0.0081,  0.0444,
         0.9007,  0.0908,  0.4426,  0.9813,  0.1524,  0.9712,  0.0487,
         0.0007,  0.0552,  0.2975,  0.9635,  0.8885,  0.7320,  0.7123,
         0.0039,  0.0252,  0.4729,  0.2184,  0.0257,  0.0710,  0.8168,
         0.0064,  0.7985,  0.8112,  0.1338,  0.8302,  0.0480,  0.1314,
         0.9279,  0.0064,  0.0300,  0.2663,  0.9749,  0.7125,  0.0371,
         0.0981,  0.0060,  0.0938,  0.8387,  0.0372,  0.0242,  0.0531,
         0.7019,  0.0068,  0.8612,  0.0281,  0.1405,  0.7423,  0.9336,
         0.0045,  0.0244,  0.1262,  0.9933,  0.0341,  0.4529,  0.9671,
         0.9368,  0.0620,  0.8033,  0.0065,  0.8530,  0.4057,  0.9036,
         0.0733,  0.0280,  0.5386,  0.0549,  0.1596,  0.0637,  0.9850,
         0.9777,  0.2218,  0.2295,  0.0055,  0.8288,  0.7121,  0.4212,
         0.4169,  0.4418,  0.9515,  0.6467,  0.0212,  0.7128,  0.7481,
         0.4191,  0.9874,  0.7335,  0.1068,  0.0254,  0.0268,  0.0058,
         0.0279,  0.0216,  0.2608,  0.0078,  0.0608,  0.1446,  0.0038,
         0.9203,  0.9665,  0.0209,  0.5308,  0.7538,  0.0755,  0.4577,
         0.9645,  0.0390,  0.0922,  0.2238,  0.9961,  0.8756,  0.9362,
         0.7274,  0.5398,  0.2417,  0.0410,  0.9408,  0.0269,  0.3131,
         0.1392,  0.9255,  0.0066,  0.0323,  0.0083,  0.2935,  0.7562,
         0.0988,  0.0149,  0.7848,  0.7070,  0.7739,  0.0249,  0.7191,
         0.8722,  0.2875,  0.2682,  0.0655,  0.9983,  0.9590,  0.9169,
         0.8400,  0.0323,  0.9104,  0.0437,  0.9510,  0.0238,  0.0736,
         0.9712,  0.2971,  0.9443,  0.9336,  0.0136,  0.5828,  0.0352,
         0.0367,  0.7270,  0.0143,  0.9803,  0.2264,  0.2162,  0.9466,
         0.7859,  0.3656,  0.9808,  0.1010,  0.7838,  0.2561,  0.1189,
         0.8980,  0.1187,  0.0834,  0.9965,  0.7801,  0.2773,  0.1580,
         0.9675,  0.7927,  0.0593,  0.9753,  0.8988,  0.2037,  0.6235,
         0.8517,  0.0369,  0.9240,  0.8228,  0.0010,  0.0022,  0.0303,
         0.0263,  0.8813,  0.8647,  0.9394,  0.9512,  0.9591,  0.8598,
         0.1213,  0.9462,  0.8630,  0.2456,  0.2657,  0.0381,  0.0847,
         0.0056,  0.6379,  0.9310,  0.0553,  0.0081,  0.8751,  0.9128,
         0.0377,  0.6177,  0.9388,  0.9638,  0.9870,  0.8308,  0.0955,
         0.0308,  0.8578,  0.0955,  0.0977,  0.0334,  0.9326,  0.0018,
         0.9501,  0.0254,  0.0495,  0.9717,  0.0808,  0.0241,  0.0087,
         0.9556,  0.0091,  0.1921,  0.0184,  0.0738,  0.9964,  0.1232,
         0.0219,  0.9314,  0.0942,  0.0056,  0.3382,  0.0369,  0.9275,
         0.0203,  0.9579,  0.0215,  0.0153,  0.3183,  0.9542,  0.1106,
         0.9663,  0.9172,  0.0023,  0.0663,  0.8190,  0.0345,  0.1517,
         0.1413,  0.0066,  0.9681,  0.9989,  0.3904,  0.2693,  0.1759,
         0.9560,  0.0035,  0.9873,  0.0479,  0.9516,  0.9755,  0.9455,
         0.9713,  0.9398,  0.0316,  0.8699,  0.9899,  0.0112,  0.9442,
         0.9095,  0.2501,  0.3234,  0.9860,  0.8965,  0.0346,  0.9342,
         0.0674,  0.0269,  0.9285,  0.9899,  0.3824,  0.0741,  0.0082,
         0.0562,  0.9989,  0.9179,  0.0097,  0.9164,  0.1259,  0.9787,
         0.2231,  0.9690,  0.4506,  0.8626,  0.9800,  0.9994,  0.8035,
         0.0034,  0.9860,  0.9648,  0.0337,  0.0359,  0.7669,  0.0472,
         0.0011,  0.1340,  0.0806,  0.0313,  0.4825,  0.0469,  0.8717,
         0.8982,  0.1645,  0.0901,  0.0144,  0.3131,  0.1215,  0.0065,
         0.0071], device='cuda:0')
tensor(0.2873, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1210,  0.0520,  0.1901,  0.8254,  0.3301,  0.0025,  0.0192,
         0.0932,  0.0261,  0.0288,  0.8793,  0.8104,  0.7938,  0.0273,
         0.9950,  0.9622,  0.9684,  0.0126,  0.9358,  0.2284,  0.9299,
         0.1158,  0.9556,  0.8512,  0.4524,  0.3702,  0.9978,  0.5111,
         0.3758,  0.8945,  0.3790,  0.7622,  0.8893,  0.8914,  0.8656,
         0.1727,  0.7517,  0.9754,  0.0283,  0.0109,  0.2032,  0.0573,
         0.8169,  0.8652,  0.6546,  0.1825,  0.7299,  0.1088,  0.8969,
         0.0375,  0.9747,  0.9385,  0.9842,  0.7858,  0.9966,  0.0147,
         0.8364,  0.1523,  0.9994,  0.0865,  0.9833,  0.0373,  0.7845,
         0.1179,  0.9509,  0.9885,  0.5234,  0.9697,  0.2215,  0.0763,
         0.0822,  0.8375,  0.1784,  0.2893,  0.6242,  0.2737,  0.9383,
         0.4015,  0.9347,  0.0520,  0.0086,  0.0239,  0.0224,  0.1491,
         0.0551,  0.4935,  0.9322,  0.1227,  0.4755,  0.7648,  0.3371,
         0.1872,  0.1387,  0.0393,  0.1053,  0.9249,  0.9568,  0.7797,
         0.1674,  0.9522,  0.8596,  0.2118,  0.0484,  0.9987,  0.7178,
         0.5634,  0.8008,  0.3082,  0.8801,  0.0119,  0.8842,  0.3524,
         0.2276,  0.9646,  0.7317,  0.7152,  0.2571,  0.1029,  0.2003,
         0.0186,  0.0661,  0.9682,  0.2536,  0.6749,  0.9114,  0.8900,
         0.9957,  0.0386,  0.7920,  0.9421,  0.9947,  0.1806,  0.0890,
         0.0403,  0.6912,  0.9409,  0.2272,  0.0579,  0.4603,  0.0195,
         0.1175,  0.9717,  0.0237,  0.4153,  0.9844,  0.1128,  0.0090,
         0.1026,  0.4094,  0.0104,  0.0863,  0.7579,  0.4948,  0.8587,
         0.8456,  0.9583,  0.9572,  0.8830,  0.6519,  0.0155,  0.4858,
         0.0830,  0.6585,  0.3128,  0.0317,  0.9146,  0.0965,  0.9682,
         0.9407,  0.7347,  0.9383,  0.0312,  0.0566,  0.3199,  0.8761,
         0.9347,  0.9387,  0.9624,  0.7798,  0.1309,  0.9214,  0.4529,
         0.2884,  0.0311,  0.8515,  0.0513,  0.9101,  0.0592,  0.2043,
         0.2359,  0.5840,  0.0592,  0.8172,  0.1997,  0.9139,  0.9690,
         0.0684,  0.0178,  0.9252,  0.9050,  0.8557,  0.9142,  0.9233,
         0.8450,  0.0997,  0.9607,  0.0340,  0.9492,  0.4961,  0.9060,
         0.2031,  0.0400,  0.7442,  0.8241,  0.3537,  0.0968,  0.3985,
         0.8832,  0.7071,  0.9012,  0.5723,  0.0164,  0.8479,  0.8096,
         0.6819,  0.0322,  0.0069,  0.0707,  0.7078,  0.0144,  0.9458,
         0.0782,  0.0037,  0.7206,  0.1711,  0.9437,  0.7774,  0.1363,
         0.9462,  0.0525,  0.3666,  0.9208,  0.8172,  0.9887,  0.9252,
         0.8959,  0.9348,  0.9359,  0.4088,  0.8038,  0.9967,  0.0232,
         0.9744,  0.9714,  0.8535,  0.0118,  0.9944,  0.1085,  0.0589,
         0.3749,  0.0234,  0.8973,  0.9984,  0.0357,  0.9816,  0.8645,
         0.9690,  0.9648,  0.7508,  0.9634,  0.1948,  0.2381,  0.9791,
         0.9841,  0.1747,  0.0867,  0.9942,  0.9670,  0.3058,  0.9564,
         0.6954,  0.1139,  0.8830,  0.9385,  0.9949,  0.0945,  0.9895,
         0.9929,  0.0449,  0.0700,  0.9541,  0.9711,  0.4191,  0.9137,
         0.9939,  0.9260,  0.9940,  0.9428,  0.0400,  0.7492,  0.9601,
         0.8940,  0.8300,  0.1316,  0.0861,  0.9756,  0.9684,  0.3048,
         0.0360,  0.0327,  0.9172,  0.0434,  0.7315,  0.9693,  0.9633,
         0.6917,  0.8477,  0.9662,  0.2351,  0.2619,  0.7777,  0.0684,
         0.6775,  0.8847,  0.9869,  0.3601,  0.3655,  0.5128,  0.0730,
         0.9438,  0.9072,  0.2333,  0.0293,  0.2581,  0.9447,  0.6485,
         0.0215,  0.0731,  0.9969,  0.8461,  0.9131,  0.3771,  0.0469,
         0.0172,  0.9846,  0.9275,  0.0038,  0.3274,  0.1487,  0.8746,
         0.9330,  0.1543,  0.9277,  0.5418,  0.0410,  0.5624,  0.9704,
         0.1695,  0.0059,  0.0393,  0.5735,  0.6839,  0.4885,  0.0138,
         0.0414,  0.0002,  0.2883,  0.1600,  0.1028,  0.9730,  0.8744,
         0.0860,  0.9797,  0.0751,  0.9645,  0.1666,  0.9993,  0.1751,
         0.0063,  0.0272,  0.1102,  0.9119,  0.7394,  0.0816,  0.8887,
         0.9357,  0.8292,  0.0219,  0.9649,  0.7897,  0.0008,  0.1132,
         0.9726,  0.9772,  0.5634,  0.3846,  0.9844,  0.4888,  0.7524,
         0.9441,  0.9838,  0.9986,  0.7351,  0.7422,  0.9750,  0.0447,
         0.9135,  0.9260,  0.8046,  0.3940,  0.1871,  0.4106,  0.9954,
         0.3109,  0.3037,  0.1279,  0.8924,  0.1414,  0.2677,  0.9396,
         0.0144,  0.8900,  0.3701,  0.9032,  0.0550,  0.3408,  0.8168,
         0.0143,  0.4017,  0.6491,  0.0227,  0.9346,  0.1096,  0.9962,
         0.0611,  0.7344,  0.5266,  0.9293,  0.8409,  0.9090,  0.2247,
         0.9855,  0.2482,  0.1270,  0.9266,  0.0059,  0.1960,  0.5023,
         0.1280,  0.9813,  0.1432,  0.1211,  0.6574,  0.0516,  0.0682,
         0.8786,  0.8395,  0.9771,  0.0692,  0.0036,  0.7680,  0.0970,
         0.0411,  0.0094,  0.0733,  0.0347,  0.8184,  0.8000,  0.0347,
         0.2656,  0.3148,  0.0824,  0.9033,  0.7603,  0.0583,  0.9167,
         0.9858,  0.0613,  0.0196,  0.0412,  0.7065,  0.7053,  0.0144,
         0.9743,  0.8931,  0.4612,  0.8106,  0.9895,  0.0131,  0.0324,
         0.0678,  0.0848,  0.0083,  0.0840,  0.8847,  0.9814,  0.6759,
         0.7110,  0.0440,  0.0133,  0.6802,  0.0518,  0.3078,  0.9810,
         0.9824,  0.9244,  0.7251,  0.9448,  0.2121,  0.2093,  0.0614,
         0.9553], device='cuda:0')
tensor(0.3039, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3213,  0.0830,  0.5246,  0.0482,  0.0507,  0.0122,  0.0011,
         0.1816,  0.9092,  0.1475,  0.3372,  0.9903,  0.0177,  0.9545,
         0.1079,  0.1562,  0.8557,  0.0251,  0.9990,  0.1078,  0.0540,
         0.9880,  0.2588,  0.0053,  0.0188,  0.8117,  0.0257,  0.6473,
         0.3215,  0.8932,  0.0793,  0.3568,  0.9206,  0.9050,  0.0961,
         0.1385,  0.0224,  0.0980,  0.8940,  0.9318,  0.9248,  0.9488,
         0.8717,  0.0042,  0.0608,  0.7554,  0.9693,  0.8283,  0.9677,
         0.9283,  0.3960,  0.9985,  0.7846,  0.0559,  0.9385,  0.8676,
         0.9902,  0.9214,  0.8926,  0.9901,  0.0339,  0.5366,  0.9565,
         0.0844,  0.9345,  0.9609,  0.0064,  0.6588,  0.9955,  0.1687,
         0.8087,  0.9696,  0.8812,  0.9552,  0.8996,  0.7202,  0.8379,
         0.1063,  0.8759,  0.9868,  0.9886,  0.1088,  0.0650,  0.9425,
         0.1677,  0.0867,  0.0043,  0.0587,  0.1755,  0.1251,  0.6707,
         0.0480,  0.9918,  0.1490,  0.2078,  0.2032,  0.8686,  0.0992,
         0.2315,  0.0580,  0.7153,  0.9871,  0.3784,  0.2147,  0.0454,
         0.8086,  0.0086,  0.1509,  0.5343,  0.9078,  0.9298,  0.9743,
         0.9543,  0.0252,  0.9569,  0.9490,  0.9771,  0.1090,  0.0884,
         0.9116,  0.0807,  0.3379,  0.2864,  0.9931,  0.6462,  0.9795,
         0.9843,  0.6128,  0.8233,  0.0891,  0.6936,  0.9927,  0.9929,
         0.1690,  0.8196,  0.2610,  0.0504,  0.0371,  0.9519,  0.6889,
         0.9780,  0.6160,  0.4914,  0.9197,  0.6300,  0.8992,  0.1243,
         0.3215,  0.0835,  0.8365,  0.7902,  0.8617,  0.0819,  0.9795,
         0.6456,  0.9995,  0.0016,  0.2310,  0.0914,  0.9344,  0.9582,
         0.6224,  0.9063,  0.9471,  0.2991,  0.1283,  0.2113,  0.9133,
         0.0166,  0.0581,  0.9273,  0.9789,  0.1210,  0.0945,  0.1989,
         0.0646,  0.0534,  0.9361,  0.5416,  0.0130,  0.8946,  0.8574,
         0.0434,  0.1459,  0.6452,  0.8772,  0.0610,  0.8853,  0.9410,
         0.0178,  0.9691,  0.4423,  0.3514,  0.0173,  0.6052,  0.0091,
         0.9797,  0.7946,  0.0352,  0.0702,  0.8487,  0.5068,  0.0917,
         0.2285,  0.7945,  0.0066,  0.0143,  0.7426,  0.8410,  0.8995,
         0.2581,  0.0204,  0.9195,  0.2396,  0.1781,  0.4129,  0.8392,
         0.0057,  0.9145,  0.2627,  0.9806,  0.0356,  0.0296,  0.6200,
         0.6109,  0.8980,  0.4541,  0.9041,  0.9708,  0.1570,  0.1242,
         0.1506,  0.9197,  0.7961,  0.4361,  0.3422,  0.9174,  0.1702,
         0.0165,  0.5085,  0.9610,  0.0586,  0.0572,  0.9438,  0.4100,
         0.8987,  0.9958,  0.8493,  0.0865,  0.5032,  0.0103,  0.9422,
         0.0488,  0.0758,  0.0702,  0.3322,  0.7666,  0.9059,  0.9334,
         0.0327,  0.0616,  0.1444,  0.1285,  0.2795,  0.8084,  0.9561,
         0.6488,  0.1700,  0.8620,  0.7188,  0.0171,  0.3805,  0.5030,
         0.2043,  0.0634,  0.9919,  0.9332,  0.8709,  0.1260,  0.0587,
         0.7570,  0.8623,  0.9340,  0.9624,  0.3491,  0.0044,  0.6223,
         0.0679,  0.6953,  0.8675,  0.9554,  0.9444,  0.1232,  0.8923,
         0.9852,  0.0490,  0.7879,  0.0505,  0.0428,  0.9577,  0.8663,
         0.9318,  0.9781,  0.1180,  0.9906,  0.3714,  0.1099,  0.9851,
         0.0049,  0.0889,  0.6912,  0.9197,  0.0011,  0.9350,  0.0030,
         0.3270,  0.8874,  0.0474,  0.9136,  0.0249,  0.1222,  0.8319,
         0.7630,  0.9119,  0.0832,  0.0066,  0.1699,  0.4327,  0.0245,
         0.1175,  0.6997,  0.0175,  0.9847,  0.9786,  0.8758,  0.9204,
         0.0780,  0.3928,  0.0117,  0.4176,  0.7445,  0.3299,  0.2600,
         0.9020,  0.9268,  0.3019,  0.8887,  0.8401,  0.1849,  0.9734,
         0.0970,  0.9653,  0.9731,  0.9351,  0.9803,  0.3578,  0.7124,
         0.9281,  0.1808,  0.4173,  0.9488,  0.9261,  0.9808,  0.0014,
         0.9543,  0.3922,  0.0185,  0.9805,  0.3028,  0.1719,  0.9153,
         0.9096,  0.9829,  0.9894,  0.9193,  0.9816,  0.4099,  0.2905,
         0.9302,  0.9316,  0.0308,  0.2629,  0.9973,  0.9969,  0.0200,
         0.2999,  0.9616,  0.9682,  0.3342,  0.9738,  0.9132,  0.9513,
         0.5159,  0.0811,  0.3196,  0.2817,  0.0436,  0.1653,  0.9188,
         0.9600,  0.2519,  0.0904,  0.9468,  0.5505,  0.6768,  0.9311,
         0.1004,  0.0656,  0.9857,  0.3056,  0.9690,  0.9605,  0.1114,
         0.4294,  0.0859,  0.9992,  0.2803,  0.9656,  0.9367,  0.1240,
         0.9930,  0.0101,  0.0302,  0.9786,  0.0057,  0.9930,  0.9732,
         0.1971,  0.0693,  0.9787,  0.7425,  0.1550,  0.5656,  0.3443,
         0.0416,  0.1075,  0.0394,  0.3042,  0.9204,  0.2492,  0.9493,
         0.0350,  0.9251,  0.0442,  0.9388,  0.9561,  0.8169,  0.1328,
         0.1099,  0.2598,  0.4620,  0.9899,  0.9485,  0.1081,  0.9181,
         0.9175,  0.2103,  0.8951,  0.1886,  0.1656,  0.9909,  0.0135,
         0.1556,  0.9722,  0.4529,  0.9123,  0.1829,  0.0023,  0.9607,
         0.9608,  0.8606,  0.9655,  0.7092,  0.8535,  0.9980,  0.0366,
         0.0111,  0.3064,  0.0953,  0.9586,  0.0038,  0.4331,  0.0863,
         0.3525,  0.8919,  0.8468,  0.9887,  0.7041,  0.7467,  0.0540,
         0.0468,  0.0262,  0.2251,  0.0889,  0.0269,  0.9398,  0.9520,
         0.0147,  0.9779,  0.9637,  0.0790,  0.2680,  0.9468,  0.0444,
         0.0415,  0.7588,  0.9411,  0.9727,  0.9210,  0.0534,  0.7989,
         0.1703], device='cuda:0')
tensor(0.3059, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9339,  0.1061,  0.1420,  0.0817,  0.0337,  0.9228,  0.4522,
         0.9524,  0.0271,  0.2463,  0.1265,  0.8829,  0.9332,  0.9336,
         0.0826,  0.2266,  0.1844,  0.3280,  0.1922,  0.9863,  0.8634,
         0.9741,  0.6645,  0.9695,  0.0054,  0.5974,  0.1160,  0.6584,
         0.9000,  0.8164,  0.7855,  0.1420,  0.0803,  0.5948,  0.0379,
         0.8829,  0.9379,  0.1674,  0.9942,  0.5349,  0.0656,  0.8676,
         0.0940,  0.0163,  0.9869,  0.0495,  0.8433,  0.3169,  0.8635,
         0.0603,  0.9773,  0.0737,  0.1656,  0.1748,  0.9989,  0.9755,
         0.1047,  0.1710,  0.9300,  0.1380,  0.8793,  0.1798,  0.9012,
         0.9424,  0.8209,  0.0410,  0.1117,  0.2090,  0.9060,  0.0079,
         0.7689,  0.0286,  0.3813,  0.0534,  0.9490,  0.0798,  0.1595,
         0.6098,  0.0320,  0.6024,  0.0517,  0.9689,  0.9369,  0.0088,
         0.2600,  0.6324,  0.8091,  0.0253,  0.6884,  0.3091,  0.1858,
         0.9615,  0.0175,  0.0739,  0.4794,  0.0094,  0.8525,  0.0892,
         0.8283,  0.4024,  0.8755,  0.1655,  0.1496,  0.9818,  0.9666,
         0.0446,  0.1179,  0.8616,  0.3826,  0.6751,  0.9775,  0.9956,
         0.9657,  0.1309,  0.0534,  0.0537,  0.9577,  0.7914,  0.0102,
         0.9306,  0.8913,  0.3566,  0.2111,  0.9687,  0.0107,  0.2648,
         0.0871,  0.9418,  0.8599,  0.9014,  0.8882,  0.9320,  0.0535,
         0.8442,  0.9323,  0.9780,  0.9087,  0.4771,  0.8056,  0.0862,
         0.0775,  0.8937,  0.0017,  0.2996,  0.0296,  0.9659,  0.9734,
         0.0088,  0.9622,  0.0283,  0.9935,  0.9357,  0.7516,  0.3473,
         0.9805,  0.9913,  0.3924,  0.0131,  0.9796,  0.2447,  0.9511,
         0.0820,  0.3089,  0.5256,  0.9083,  0.0638,  0.3840,  0.1652,
         0.9736,  0.9592,  0.1267,  0.9340,  0.5721,  0.1544,  0.9532,
         0.8526,  0.2778,  0.0926,  0.8265,  0.0482,  0.8949,  0.9084,
         0.4255,  0.8261,  0.9551,  0.4938,  0.9973,  0.8759,  0.0909,
         0.1852,  0.0155,  0.9282,  0.9379,  0.1599,  0.9983,  0.8426,
         0.1764,  0.9433,  0.8971,  0.5524,  0.9851,  0.9208,  0.2443,
         0.1677,  0.0066,  0.9341,  0.3372,  0.0733,  0.9796,  0.9426,
         0.0254,  0.9538,  0.0572,  0.0371,  0.1816,  0.5471,  0.4615,
         0.4126,  0.1357,  0.0937,  0.0325,  0.9198,  0.8631,  0.0982,
         0.0105,  0.0081,  0.9996,  0.0789,  0.1309,  0.9258,  0.9820,
         0.0596,  0.2337,  0.9409,  0.9640,  0.4863,  0.9623,  0.5412,
         0.8787,  0.8581,  0.0022,  0.5527,  0.0895,  0.9780,  0.7846,
         0.1153,  0.0596,  0.9913,  0.0934,  0.9643,  0.0341,  0.9979,
         0.1478,  0.4020,  0.9703,  0.7910,  0.9373,  0.2806,  0.3005,
         0.9333,  0.8830,  0.9987,  0.0759,  0.3105,  0.0035,  0.1412,
         0.9819,  0.4028,  0.0413,  0.4463,  0.9731,  0.4826,  0.9835,
         0.7983,  0.6041,  0.1131,  0.8059,  0.9051,  0.9562,  0.9018,
         0.9880,  0.1075,  0.8940,  0.9938,  0.9659,  0.2084,  0.3333,
         0.9193,  0.2767,  0.6635,  0.9730,  0.4340,  0.0636,  0.3004,
         0.0113,  0.5908,  0.3534,  0.3094,  0.3200,  0.9781,  0.7670,
         0.8244,  0.8955,  0.5888,  0.2259,  0.7755,  0.5092,  0.9734,
         0.9831,  0.9646,  0.4172,  0.0031,  0.0473,  0.9766,  0.2424,
         0.2955,  0.9138,  0.9878,  0.2034,  0.3634,  0.8880,  0.0242,
         0.0293,  0.3809,  0.3761,  0.6465,  0.9778,  0.8337,  0.9620,
         0.9897,  0.9726,  0.9444,  0.0035,  0.9701,  0.7720,  0.5733,
         0.0443,  0.3796,  0.9518,  0.9967,  0.1427,  0.1023,  0.0813,
         0.2198,  0.9723,  0.3266,  0.2406,  0.4848,  0.6217,  0.1886,
         0.9279,  0.9729,  0.9408,  0.0180,  0.0323,  0.4509,  0.9029,
         0.3782,  0.6749,  0.1804,  0.8100,  0.9381,  0.7259,  0.8692,
         0.2333,  0.0516,  0.4804,  0.1250,  0.8105,  0.9803,  0.0359,
         0.5918,  0.0238,  0.6927,  0.9988,  0.9323,  0.8835,  0.6335,
         0.9608,  0.1716,  0.0123,  0.1010,  0.8351,  0.0109,  0.7509,
         0.9895,  0.9696,  0.9578,  0.9375,  0.0963,  0.8339,  0.0159,
         0.6675,  0.5042,  0.1295,  0.8921,  0.9852,  0.8425,  0.0529,
         0.9598,  0.7603,  0.9405,  0.9644,  0.8925,  0.0297,  0.3623,
         0.0327,  0.0591,  0.9722,  0.4432,  0.9804,  0.9000,  0.9406,
         0.0170,  0.9967,  0.0580,  0.6498,  0.9056,  0.9548,  0.7370,
         0.0436,  0.9596,  0.2010,  0.6476,  0.9956,  0.0188,  0.0445,
         0.1816,  0.0114,  0.0906,  0.2409,  0.0525,  0.9985,  0.0541,
         0.0910,  0.7528,  0.2825,  0.0503,  0.5242,  0.9062,  0.0222,
         0.0285,  0.9968,  0.2591,  0.5043,  0.9407,  0.9664,  0.5913,
         0.0657,  0.5871,  0.8964,  0.0527,  0.9371,  0.6304,  0.0058,
         0.0252,  0.0899,  0.9736,  0.1153,  0.9652,  0.2479,  0.0084,
         0.9751,  0.2137,  0.9805,  0.0528,  0.2027,  0.8610,  0.7119,
         0.9561,  0.6560,  0.0738,  0.9805,  0.7414,  0.0293,  0.0857,
         0.1285,  0.5252,  0.9345,  0.9696,  0.4082,  0.8823,  0.7719,
         0.9996,  0.9512,  0.9955,  0.8646,  0.0520,  0.0190,  0.4355,
         0.9267,  0.9812,  0.9563,  0.9419,  0.5132,  0.9785,  0.0097,
         0.6722,  0.0818,  0.9312,  0.0347,  0.0358,  0.7939,  0.1255,
         0.2651,  0.9273,  0.3843,  0.9636,  0.8328,  0.0254,  0.0274,
         0.8531], device='cuda:0')
tensor(0.3182, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0874,  0.8247,  0.2866,  0.9976,  0.1336,  0.0126,  0.0939,
         0.4318,  0.9982,  0.0910,  0.8869,  0.2456,  0.0856,  0.8416,
         0.2478,  0.4715,  0.3534,  0.9998,  0.7477,  0.2055,  0.9078,
         0.2845,  0.0413,  0.9538,  0.8887,  0.0313,  0.1790,  0.2222,
         0.0568,  0.8250,  0.5758,  0.9188,  0.1771,  0.6501,  0.1316,
         0.9941,  0.8103,  0.7361,  0.2906,  0.0144,  0.4169,  0.9445,
         0.7263,  0.9583,  0.0085,  0.9061,  0.9904,  0.1058,  0.9868,
         0.5527,  0.8789,  0.5538,  0.3955,  0.0460,  0.0186,  0.1925,
         0.9972,  0.0307,  0.9510,  0.0510,  0.0923,  0.6328,  0.5053,
         0.1244,  0.4883,  0.5580,  0.9561,  0.3035,  0.2007,  0.4091,
         0.1425,  0.8612,  0.1414,  0.0917,  0.6697,  0.2235,  0.2381,
         0.0201,  0.4742,  0.8538,  0.2133,  0.7281,  0.0774,  0.1380,
         0.0440,  0.2119,  0.8621,  0.2109,  0.4216,  0.0463,  0.9841,
         0.1708,  0.9632,  0.0205,  0.0887,  0.8377,  0.0711,  0.9632,
         0.3638,  0.9825,  0.7566,  0.8474,  0.9850,  0.0735,  0.0537,
         0.0151,  0.0349,  0.9472,  0.0037,  0.0705,  0.8172,  0.7152,
         0.4588,  0.1440,  0.9703,  0.9098,  0.9406,  0.3848,  0.7755,
         0.9201,  0.5163,  0.1407,  0.8649,  0.1913,  0.5301,  0.1224,
         0.6478,  0.0312,  0.8678,  0.7782,  0.9808,  0.2110,  0.2225,
         0.0467,  0.0334,  0.9174,  0.9390,  0.0421,  0.9896,  0.0152,
         0.0177,  0.0702,  0.6929,  0.9866,  0.8865,  0.8946,  0.9547,
         0.9691,  0.9193,  0.0674,  0.9801,  0.8460,  0.2104,  0.4464,
         0.7995,  0.1230,  0.0478,  0.3593,  0.4650,  0.0524,  0.6531,
         0.8912,  0.0333,  0.3770,  0.3325,  0.9756,  0.3242,  0.9830,
         0.3116,  0.9840,  0.8572,  0.9770,  0.2271,  0.0404,  0.9364,
         0.9523,  0.9989,  0.7290,  0.2415,  0.0854,  0.9152,  0.5431,
         0.6701,  0.6614,  0.0926,  0.9155,  0.5880,  0.0316,  0.9568,
         0.0543,  0.9604,  0.1104,  0.0345,  0.9890,  0.0128,  0.1990,
         0.9459,  0.9228,  0.8124,  0.8961,  0.6653,  0.1532,  0.0250,
         0.0165,  0.1951,  0.0568,  0.1615,  0.9450,  0.1980,  0.5874,
         0.9649,  0.2509,  0.8631,  0.7704,  0.6394,  0.0192,  0.9340,
         0.0245,  0.7049,  0.9320,  0.9805,  0.0460,  0.0862,  0.6732,
         0.5626,  0.7113,  0.6872,  0.9991,  0.1868,  0.1010,  0.9636,
         0.1960,  0.3834,  0.0087,  0.1279,  0.7215,  0.0537,  0.6129,
         0.0274,  0.3305,  0.2250,  0.2977,  0.6782,  0.0934,  0.9460,
         0.8524,  0.3820,  0.2543,  0.6910,  0.9415,  0.9735,  0.0867,
         0.0237,  0.5705,  0.0996,  0.0174,  0.3296,  0.9403,  0.0189,
         0.5810,  0.1322,  0.8878,  0.4803,  0.8908,  0.2032,  0.0457,
         0.0330,  0.0535,  0.1778,  0.2311,  0.9171,  0.3350,  0.3570,
         0.2401,  0.7548,  0.8014,  0.8318,  0.8964,  0.4389,  0.0008,
         0.9432,  0.9497,  0.9484,  0.9479,  0.5736,  0.1216,  0.0675,
         0.8439,  0.0135,  0.6864,  0.9953,  0.9792,  0.3297,  0.0194,
         0.1300,  0.9369,  0.0612,  0.1815,  0.4983,  0.9543,  0.9857,
         0.6104,  0.8546,  0.3235,  0.3647,  0.0793,  0.4929,  0.4631,
         0.8946,  0.3603,  0.6922,  0.9471,  0.0748,  0.8983,  0.2558,
         0.8928,  0.5548,  0.0032,  0.9992,  0.1546,  0.7052,  0.2510,
         0.9829,  0.0020,  0.9776,  0.2632,  0.0067,  0.3741,  0.4972,
         0.8429,  0.8820,  0.5562,  0.6639,  0.9578,  0.7231,  0.1422,
         0.1168,  0.2628,  0.0240,  0.9014,  0.8305,  0.6525,  0.2516,
         0.2347,  0.3481,  0.1595,  0.1683,  0.7110,  0.9122,  0.2150,
         0.0527,  0.7751,  0.9786,  0.0860,  0.8508,  0.1062,  0.9960,
         0.6059,  0.1233,  0.8862,  0.8679,  0.0207,  0.2856,  0.9493,
         0.2688,  0.9927,  0.8808,  0.8649,  0.0073,  0.9591,  0.3246,
         0.9439,  0.4597,  0.1893,  0.0891,  0.9189,  0.4046,  0.9027,
         0.1748,  0.0114,  0.1598,  0.3677,  0.8503,  0.7118,  0.9822,
         0.9763,  0.9995,  0.0165,  0.4901,  0.9248,  0.0412,  0.0224,
         0.6391,  0.1031,  0.0914,  0.4838,  0.9709,  0.9802,  0.9759,
         0.2778,  0.7835,  0.0312,  0.9905,  0.4911,  0.9917,  0.0607,
         0.3391,  0.7418,  0.9310,  0.9654,  0.7491,  0.0401,  0.1189,
         0.7566,  0.8113,  0.1609,  0.3504,  0.3842,  0.0064,  0.1175,
         0.8655,  0.0161,  0.2638,  0.8943,  0.6892,  0.0408,  0.4679,
         0.2069,  0.9973,  0.0816,  0.1240,  0.1105,  0.2226,  0.8069,
         0.0478,  0.1234,  0.9038,  0.0484,  0.8767,  0.0055,  0.9759,
         0.9736,  0.5256,  0.8313,  0.9639,  0.3577,  0.9789,  0.9269,
         0.9276,  0.9217,  0.9557,  0.2004,  0.2833,  0.0090,  0.9059,
         0.9920,  0.0669,  0.8610,  0.5610,  0.9578,  0.9764,  0.5760,
         0.1476,  0.8051,  0.6606,  0.9498,  0.9619,  0.9346,  0.8725,
         0.0557,  0.8360,  0.9363,  0.8042,  0.0532,  0.3408,  0.1773,
         0.9742,  0.3876,  0.4266,  0.2901,  0.1704,  0.1531,  0.7316,
         0.0676,  0.2727,  0.0276,  0.9897,  0.0160,  0.0129,  0.2735,
         0.8542,  0.0530,  0.9545,  0.9903,  0.3038,  0.1811,  0.8920,
         0.9501,  0.9835,  0.1098,  0.3325,  0.1992,  0.9441,  0.8451,
         0.6644,  0.9969,  0.5714,  0.9600,  0.0926,  0.9828,  0.8917,
         0.8547], device='cuda:0')
tensor(0.3126, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2642,  0.3570,  0.9448,  0.5818,  0.2187,  0.0412,  0.8920,
         0.7011,  0.9956,  0.8280,  0.2121,  0.8082,  0.0239,  0.9739,
         0.6651,  0.9583,  0.5689,  0.0165,  0.5852,  0.3593,  0.0075,
         0.1555,  0.9579,  0.0218,  0.0357,  0.3608,  0.0160,  0.9621,
         0.0529,  0.0123,  0.1025,  0.9641,  0.1406,  0.9789,  0.0723,
         0.9704,  0.9926,  0.9200,  0.9941,  0.9455,  0.4133,  0.0106,
         0.9868,  0.4525,  0.8932,  0.4628,  0.1434,  0.0100,  0.6388,
         0.0763,  0.3238,  0.3090,  0.1588,  0.9258,  0.1741,  0.6793,
         0.9878,  0.2459,  0.6600,  0.8531,  0.1031,  0.0538,  0.1722,
         0.8669,  0.0052,  0.3454,  0.9972,  0.0173,  0.0256,  0.9380,
         0.9648,  0.8468,  0.1973,  0.5648,  0.2607,  0.9475,  0.9361,
         0.7071,  0.9654,  0.2439,  0.2665,  0.9238,  0.2562,  0.0640,
         0.2283,  0.7505,  0.9543,  0.0134,  0.3101,  0.7042,  0.9498,
         0.3895,  0.9536,  0.8789,  0.7870,  0.9582,  0.5377,  0.1313,
         0.9259,  0.2988,  0.0766,  0.4477,  0.9598,  0.0077,  0.0848,
         0.0240,  0.0022,  0.3628,  0.8875,  0.0531,  0.7836,  0.8446,
         0.1658,  0.8116,  0.8777,  0.4545,  0.9607,  0.1823,  0.5880,
         0.9644,  0.0937,  0.9384,  0.9088,  0.8106,  0.8370,  0.2102,
         0.6172,  0.9544,  0.0185,  0.9688,  0.4885,  0.9877,  0.9754,
         0.4018,  0.1058,  0.8589,  0.2572,  0.5049,  0.9830,  0.0887,
         0.0615,  0.0077,  0.9961,  0.6047,  0.1374,  0.8204,  0.0325,
         0.4662,  0.6469,  0.2498,  0.1215,  0.0276,  0.5113,  0.9979,
         0.1028,  0.1008,  0.2140,  0.6598,  0.0263,  0.9956,  0.9337,
         0.7539,  0.0831,  0.7369,  0.9978,  0.0403,  0.9155,  0.2092,
         0.7358,  0.9787,  0.4435,  0.9859,  0.5545,  0.2646,  0.8416,
         0.9866,  0.1335,  0.9719,  0.3466,  0.4513,  0.9176,  0.9763,
         0.2247,  0.0082,  0.8796,  0.0105,  0.3937,  0.9895,  0.6386,
         0.4888,  0.8295,  0.5693,  0.7886,  0.1009,  0.5710,  0.0411,
         0.9378,  0.9101,  0.1768,  0.2017,  0.9369,  0.8336,  0.4401,
         0.3793,  0.3010,  0.8712,  0.2061,  0.9584,  0.0185,  0.0678,
         0.1006,  0.0101,  0.9558,  0.0057,  0.7554,  0.9535,  0.1016,
         0.9347,  0.9635,  0.0702,  0.8849,  0.0135,  0.9333,  0.9475,
         0.6925,  0.1450,  0.0710,  0.1115,  0.5250,  0.9199,  0.3935,
         0.6337,  0.0706,  0.6837,  0.1064,  0.0705,  0.2020,  0.8233,
         0.9132,  0.9811,  0.7434,  0.2456,  0.9915,  0.9454,  0.0958,
         0.9351,  0.0034,  0.4330,  0.9268,  0.2349,  0.2950,  0.0697,
         0.9019,  0.0572,  0.1808,  0.9202,  0.4090,  0.1276,  0.9069,
         0.7336,  0.3347,  0.0984,  0.6850,  0.9012,  0.9613,  0.4161,
         0.1426,  0.6536,  0.8998,  0.9055,  0.9326,  0.9780,  0.9557,
         0.0549,  0.1525,  0.4974,  0.3262,  0.0383,  0.0409,  0.8400,
         0.1151,  0.9462,  0.7550,  0.1283,  0.9031,  0.2215,  0.9789,
         0.0778,  0.8016,  0.0399,  0.9288,  0.6614,  0.7947,  0.0427,
         0.2019,  0.6971,  0.8994,  0.1944,  0.9955,  0.0989,  0.8623,
         0.9341,  0.9800,  0.9960,  0.0109,  0.3662,  0.9519,  0.9909,
         0.4975,  0.8731,  0.8641,  0.9937,  0.1939,  0.2979,  0.1782,
         0.8135,  0.9212,  0.0995,  0.0503,  0.9559,  0.9176,  0.0385,
         0.0256,  0.5622,  0.1704,  0.7854,  0.2784,  0.9641,  0.0044,
         0.1108,  0.8252,  0.2275,  0.1458,  0.8720,  0.3479,  0.2468,
         0.5229,  0.0814,  0.0611,  0.1045,  0.2022,  0.8850,  0.0433,
         0.0934,  0.7884,  0.2258,  0.8207,  0.6041,  0.9016,  0.1564,
         0.7055,  0.9090,  0.9874,  0.9075,  0.0352,  0.9147,  0.8871,
         0.6898,  0.9403,  0.9164,  0.1164,  0.9727,  0.1217,  0.9624,
         0.9584,  0.6496,  0.3090,  0.3061,  0.9292,  0.1921,  0.0864,
         0.0543,  0.0369,  0.7698,  0.8703,  0.0694,  0.0166,  0.9893,
         0.0107,  0.0539,  0.6535,  0.8339,  0.5179,  0.7707,  0.1959,
         0.7655,  0.4198,  0.0702,  0.4793,  0.2859,  0.8458,  0.9814,
         0.3256,  0.0086,  0.9637,  0.9992,  0.0984,  0.4570,  0.7712,
         0.8237,  0.6408,  0.9719,  0.0011,  0.6724,  0.0583,  0.9566,
         0.3298,  0.0827,  0.0945,  0.9917,  0.1090,  0.9654,  0.8993,
         0.1551,  0.7491,  0.5900,  0.9585,  0.1570,  0.9569,  0.0107,
         0.1916,  0.6751,  0.0388,  0.9798,  0.1079,  0.1769,  0.1033,
         0.7256,  0.0430,  0.7306,  0.0439,  0.0135,  0.9115,  0.0309,
         0.9688,  0.9014,  0.9427,  0.7724,  0.9781,  0.0269,  0.8449,
         0.9485,  0.5752,  0.1036,  0.9778,  0.9872,  0.1771,  0.5779,
         0.7295,  0.9459,  0.8431,  0.0813,  0.0044,  0.0661,  0.8246,
         0.1677,  0.8019,  0.0498,  0.7403,  0.3565,  0.5692,  0.2257,
         0.8747,  0.9673,  0.9763,  0.3748,  0.8235,  0.9467,  0.3160,
         0.2679,  0.8239,  0.7882,  0.1230,  0.0831,  0.9502,  0.3380,
         0.6850,  0.1896,  0.8192,  0.0413,  0.8588,  0.0227,  0.3331,
         0.7009,  0.9433,  0.0422,  0.9656,  0.9301,  0.9239,  0.5710,
         0.0790,  0.9772,  0.8627,  0.9696,  0.1009,  0.2962,  0.0588,
         0.9682,  0.1048,  0.0125,  0.9933,  0.4949,  0.1955,  0.0478,
         0.0387,  0.9059,  0.1309,  0.0241,  0.0290,  0.9330,  0.0416,
         0.9801], device='cuda:0')
tensor(0.2783, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1814,  0.2329,  0.7404,  0.5701,  0.9429,  0.0980,  0.0289,
         0.9124,  0.0091,  0.0259,  0.4249,  0.2420,  0.5096,  0.2871,
         0.0609,  0.2589,  0.8833,  0.1051,  0.3741,  0.6078,  0.6188,
         0.0019,  0.9044,  0.8247,  0.3675,  0.9700,  0.9368,  0.9607,
         0.1672,  0.7045,  0.1020,  0.8922,  0.2134,  0.0948,  0.9267,
         0.9595,  0.1633,  0.7713,  0.6187,  0.1651,  0.1467,  0.1608,
         0.8932,  0.1214,  0.0103,  0.0024,  0.6095,  0.8645,  0.9252,
         0.1656,  0.0013,  0.6763,  0.4583,  0.9116,  0.0465,  0.2924,
         0.9446,  0.9534,  0.9160,  0.1232,  0.0739,  0.9733,  0.8836,
         0.8440,  0.1188,  0.7094,  0.3240,  0.8401,  0.2195,  0.6339,
         0.9516,  0.9348,  0.7765,  0.1273,  0.0231,  0.7908,  0.3680,
         0.8483,  0.9091,  0.0746,  0.9669,  0.8649,  0.0928,  0.1944,
         0.0069,  0.1728,  0.1936,  0.0664,  0.2423,  0.7795,  0.9863,
         0.2758,  0.9503,  0.2646,  0.4957,  0.0394,  0.9180,  0.0064,
         0.0942,  0.0718,  0.4708,  0.8358,  0.0286,  0.9655,  0.2247,
         0.9534,  0.9750,  0.9948,  0.7300,  0.1520,  0.3175,  0.9946,
         0.0041,  0.9291,  0.9590,  0.6824,  0.0902,  0.0666,  0.8487,
         0.9537,  0.9570,  0.0481,  0.9466,  0.0257,  0.0234,  0.0334,
         0.9577,  0.9688,  0.6167,  0.0349,  0.8385,  0.9572,  0.3117,
         0.0012,  0.9928,  0.0760,  0.3818,  0.0028,  0.2018,  0.2770,
         0.8404,  0.0900,  0.5647,  0.5337,  0.0026,  0.1053,  0.8399,
         0.9660,  0.1400,  0.7474,  0.9291,  0.0010,  0.9099,  0.9359,
         0.8896,  0.3717,  0.3200,  0.0739,  0.6953,  0.9484,  0.2041,
         0.8167,  0.5694,  0.0341,  0.5693,  0.8919,  0.9219,  0.1432,
         0.0146,  0.0173,  0.0021,  0.8822,  0.9095,  0.9114,  0.0042,
         0.0271,  0.0088,  0.9150,  0.6154,  0.0817,  0.1773,  0.0081,
         0.1829,  0.8520,  0.9752,  0.7947,  0.4504,  0.4370,  0.9985,
         0.2620,  0.8520,  0.7917,  0.0302,  0.0168,  0.0084,  0.9603,
         0.5551,  0.7509,  0.9350,  0.1940,  0.5721,  0.2486,  0.2667,
         0.8224,  0.0389,  0.2888,  0.7901,  0.9614,  0.9879,  0.0477,
         0.0142,  0.0093,  0.3188,  0.2033,  0.1804,  0.0059,  0.1764,
         0.8524,  0.9740,  0.0034,  0.9862,  0.9386,  0.9597,  0.0614,
         0.0274,  0.9826,  0.5629,  0.1147,  0.9121,  0.9783,  0.3619,
         0.9640,  0.4838,  0.1935,  0.6503,  0.4292,  0.2555,  0.9694,
         0.6238,  0.9653,  0.1023,  0.0257,  0.0283,  0.9586,  0.1049,
         0.9989,  0.0443,  0.1203,  0.0364,  0.0012,  0.0864,  0.9343,
         0.2199,  0.1134,  0.9494,  0.1194,  0.6979,  0.8222,  0.8403,
         0.9680,  0.7509,  0.9666,  0.8585,  0.8470,  0.0032,  0.9276,
         0.0111,  0.4245,  0.9993,  0.9652,  0.8361,  0.5645,  0.9963,
         0.1386,  0.9784,  0.8715,  0.9618,  0.2218,  0.3094,  0.3602,
         0.0055,  0.1599,  0.4155,  0.0482,  0.8471,  0.2609,  0.1630,
         0.4954,  0.0875,  0.5982,  0.0272,  0.4169,  0.9790,  0.2822,
         0.1532,  0.3740,  0.0177,  0.3542,  0.0678,  0.0400,  0.7403,
         0.0452,  0.9736,  0.0751,  0.0265,  0.0795,  0.9153,  0.0036,
         0.0391,  0.9485,  0.6858,  0.9040,  0.9400,  0.0155,  0.0241,
         0.6700,  0.2218,  0.7632,  0.0041,  0.6513,  0.8923,  0.9961,
         0.9064,  0.3530,  0.1020,  0.7529,  0.1411,  0.0203,  0.0066,
         0.9155,  0.1766,  0.9319,  0.9910,  0.9754,  0.8851,  0.0034,
         0.9523,  0.0612,  0.0959,  0.4277,  0.8508,  0.9664,  0.0862,
         0.1201,  0.9926,  0.2369,  0.7675,  0.0064,  0.9119,  0.0665,
         0.1241,  0.0109,  0.9274,  0.2549,  0.8758,  0.0815,  0.7758,
         0.6564,  0.0980,  0.7573,  0.0098,  0.6566,  0.8021,  0.2093,
         0.8007,  0.4955,  0.9158,  0.0832,  0.9950,  0.1938,  0.9989,
         0.0636,  0.9763,  0.0537,  0.9890,  0.0762,  0.0278,  0.7324,
         0.1850,  0.9007,  0.9078,  0.3148,  0.6007,  0.1363,  0.0045,
         0.0502,  0.0265,  0.9657,  0.0797,  0.9849,  0.1778,  0.0474,
         0.1651,  0.7171,  0.2091,  0.9530,  0.8653,  0.9916,  0.0106,
         0.8309,  0.1828,  0.9002,  0.1404,  0.9750,  0.9578,  0.0396,
         0.6500,  0.8932,  0.0342,  0.2436,  0.1085,  0.0528,  0.1732,
         0.0816,  0.9940,  0.9691,  0.8914,  0.1350,  0.9843,  0.5951,
         0.3873,  0.6366,  0.0134,  0.0336,  0.0493,  0.9769,  0.8271,
         0.9541,  0.9164,  0.8101,  0.0099,  0.0174,  0.0030,  0.3778,
         0.0205,  0.9167,  0.6888,  0.0365,  0.8622,  0.9038,  0.3501,
         0.7921,  0.8326,  0.5623,  0.0570,  0.0868,  0.9114,  0.0890,
         0.9976,  0.4621,  0.8042,  0.2487,  0.0094,  0.8562,  0.2653,
         0.1536,  0.9619,  0.3427,  0.9059,  0.9714,  0.0789,  0.9649,
         0.6905,  0.3263,  0.0364,  0.8854,  0.9765,  0.2524,  0.9133,
         0.6181,  0.1691,  0.9985,  0.3860,  0.2017,  0.4574,  0.2317,
         0.1036,  0.0416,  0.0676,  0.6848,  0.0485,  0.1732,  0.7042,
         0.0631,  0.2050,  0.1440,  0.8473,  0.8892,  0.0061,  0.0313,
         0.7236,  0.8829,  0.9714,  0.1063,  0.1646,  0.8816,  0.9379,
         0.0253,  0.8476,  0.1227,  0.9732,  0.0483,  0.0467,  0.8866,
         0.4486,  0.9509,  0.8866,  0.8537,  0.0350,  0.9887,  0.3953,
         0.0895], device='cuda:0')
tensor(0.2861, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1495,  0.3581,  0.0611,  0.9888,  0.0272,  0.9573,  0.8538,
         0.9489,  0.5670,  0.0459,  0.0138,  0.0099,  0.9686,  0.6626,
         0.1032,  0.8443,  0.0882,  0.0010,  0.8539,  0.2773,  0.0575,
         0.2538,  0.0026,  0.0036,  0.2895,  0.7288,  0.9808,  0.7494,
         0.0121,  0.8362,  0.2345,  0.2506,  0.1495,  0.1757,  0.0068,
         0.9471,  0.4195,  0.8692,  0.8670,  0.0647,  0.3048,  0.3837,
         0.9710,  0.0525,  0.4836,  0.9226,  0.0625,  0.0039,  0.0552,
         0.5478,  0.9059,  0.8394,  0.0019,  0.0038,  0.9697,  0.2654,
         0.9263,  0.9381,  0.0119,  0.9790,  0.9855,  0.1515,  0.9908,
         0.0769,  0.0137,  0.9048,  0.0018,  0.6801,  0.0038,  0.2765,
         0.3377,  0.0495,  0.9995,  0.7810,  0.9228,  0.0135,  0.9526,
         0.5170,  0.9992,  0.9717,  0.6338,  0.0128,  0.1768,  0.1328,
         0.9364,  0.0821,  0.1119,  0.9910,  0.7961,  0.0493,  0.3708,
         0.0228,  0.2485,  0.0983,  0.9137,  0.0044,  0.2903,  0.9045,
         0.9596,  0.1083,  0.1147,  0.6373,  0.8757,  0.9679,  0.9794,
         0.3056,  0.9005,  0.8367,  0.0264,  0.8720,  0.1627,  0.0028,
         0.0299,  0.0382,  0.1213,  0.9698,  0.7356,  0.9741,  0.0394,
         0.9741,  0.9202,  0.0920,  0.6570,  0.9808,  0.8128,  0.1149,
         0.4026,  0.8589,  0.0565,  0.7381,  0.2250,  0.9889,  0.9733,
         0.3149,  0.0020,  0.0550,  0.8476,  0.9908,  0.9917,  0.7416,
         0.9731,  0.4521,  0.9971,  0.7702,  0.3450,  0.9220,  0.0458,
         0.0080,  0.1791,  0.1512,  0.2136,  0.1722,  0.8529,  0.8597,
         0.2957,  0.0692,  0.0146,  0.9033,  0.8842,  0.0531,  0.8459,
         0.7877,  0.9831,  0.1666,  0.6610,  0.0204,  0.9987,  0.0098,
         0.9182,  0.0078,  0.0577,  0.0031,  0.8430,  0.9811,  0.0728,
         0.0453,  0.9754,  0.9957,  0.9530,  0.9171,  0.9448,  0.9553,
         0.9967,  0.1025,  0.2136,  0.8797,  0.4793,  0.9576,  0.0721,
         0.7791,  0.9372,  0.2183,  0.9718,  0.9677,  0.9338,  0.9230,
         0.1746,  0.0633,  0.2580,  0.0230,  0.0407,  0.0108,  0.3091,
         0.0203,  0.9935,  0.1325,  0.4338,  0.2992,  0.7522,  0.0097,
         0.0043,  0.7531,  0.9513,  0.7225,  0.9871,  0.5845,  0.9633,
         0.9847,  0.0111,  0.0110,  0.5284,  0.9470,  0.8966,  0.9551,
         0.9650,  0.9495,  0.2791,  0.1373,  0.0133,  0.9597,  0.0507,
         0.1636,  0.0130,  0.4400,  0.3926,  0.0093,  0.1134,  0.1311,
         0.6865,  0.8814,  0.9786,  0.9431,  0.8943,  0.0704,  0.9229,
         0.2977,  0.0021,  0.0066,  0.6085,  0.0263,  0.5446,  0.5103,
         0.0268,  0.6144,  0.6743,  0.3335,  0.0658,  0.5229,  0.0083,
         0.0298,  0.1607,  0.4865,  0.0254,  0.1693,  0.1056,  0.0107,
         0.0042,  0.6864,  0.0227,  0.0717,  0.9888,  0.1682,  0.9859,
         0.0718,  0.1254,  0.9089,  0.0851,  0.0877,  0.1543,  0.2400,
         0.9726,  0.9120,  0.9331,  0.8780,  0.4052,  0.4487,  0.9680,
         0.1764,  0.0416,  0.9409,  0.0174,  0.9996,  0.4731,  0.6692,
         0.9771,  0.0930,  0.9863,  0.9878,  0.0041,  0.9368,  0.9321,
         0.9255,  0.9760,  0.0122,  0.0279,  0.0124,  0.1771,  0.4406,
         0.9645,  0.1025,  0.0287,  0.5687,  0.0778,  0.6780,  0.9782,
         0.9735,  0.1057,  0.9994,  0.7714,  0.8784,  0.9989,  0.0209,
         0.1640,  0.9709,  0.4304,  0.8831,  0.6173,  0.9665,  0.7444,
         0.0253,  0.0479,  0.0506,  0.0131,  0.7563,  0.3674,  0.9068,
         0.3530,  0.1602,  0.0027,  0.9664,  0.7718,  0.1013,  0.9573,
         0.1609,  0.0597,  0.9623,  0.8365,  0.9533,  0.0242,  0.0045,
         0.9940,  0.0090,  0.9421,  0.0119,  0.5620,  0.5928,  0.0481,
         0.0982,  0.9516,  0.0579,  0.6926,  0.9747,  0.0223,  0.0819,
         0.9455,  0.9688,  0.8605,  0.1301,  0.3117,  0.0047,  0.3473,
         0.9706,  0.0397,  0.8422,  0.0721,  0.9540,  0.8879,  0.0292,
         0.0574,  0.0108,  0.0105,  0.0705,  0.0712,  0.0028,  0.8147,
         0.5305,  0.1898,  0.4399,  0.3555,  0.9795,  0.0094,  0.9038,
         0.9379,  0.8950,  0.0015,  0.1312,  0.9681,  0.1464,  0.9731,
         0.1323,  0.4530,  0.9341,  0.9795,  0.9268,  0.2127,  0.0226,
         0.9775,  0.0755,  0.6156,  0.1252,  0.9821,  0.9513,  0.9826,
         0.8901,  0.9761,  0.0382,  0.6188,  0.0262,  0.0166,  0.0167,
         0.0790,  0.0998,  0.1428,  0.9255,  0.0968,  0.6136,  0.8573,
         0.9958,  0.0066,  0.0396,  0.0121,  0.0206,  0.9761,  0.0285,
         0.1944,  0.9897,  0.2821,  0.8156,  0.0541,  0.2345,  0.9895,
         0.0114,  0.0082,  0.3910,  0.0105,  0.1395,  0.9178,  0.0438,
         0.2008,  0.0452,  0.0512,  0.6134,  0.3375,  0.2807,  0.0604,
         0.7537,  0.9774,  0.0164,  0.0462,  0.1264,  0.9943,  0.3902,
         0.9271,  0.0347,  0.1278,  0.9964,  0.9761,  0.9835,  0.1832,
         0.0977,  0.8638,  0.0345,  0.0069,  0.0247,  0.0082,  0.9302,
         0.8342,  0.9428,  0.9983,  0.0201,  0.0062,  0.9897,  0.9967,
         0.9964,  0.0200,  0.1145,  0.2420,  0.7810,  0.9089,  0.9757,
         0.9643,  0.9933,  0.2128,  0.2981,  0.0320,  0.3424,  0.5279,
         0.2985,  0.9584,  0.9921,  0.8603,  0.0368,  0.9996,  0.1241,
         0.2758,  0.1344,  0.9575,  0.9114,  0.0118,  0.8432,  0.0917,
         0.3714], device='cuda:0')
tensor(0.2820, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0291,  0.2182,  0.1648,  0.0078,  0.9905,  0.0469,  0.9284,
         0.7713,  0.9656,  0.9699,  0.8615,  0.0288,  0.1550,  0.9326,
         0.0874,  0.1086,  0.0256,  0.0873,  0.9813,  0.9872,  0.4371,
         0.0822,  0.0196,  0.9035,  0.7385,  0.7460,  0.6296,  0.0030,
         0.1202,  0.9839,  0.1885,  0.0262,  0.9519,  0.9539,  0.0010,
         0.0939,  0.8872,  0.0083,  0.9764,  0.9925,  0.0282,  0.0114,
         0.9199,  0.1450,  0.9876,  0.7387,  0.9885,  0.3246,  0.6846,
         0.9995,  0.9951,  0.9862,  0.9363,  0.0506,  0.0009,  0.9719,
         0.8546,  0.9940,  0.9123,  0.5233,  0.1626,  0.9854,  0.0037,
         0.0530,  0.1333,  0.8612,  0.6941,  0.0892,  0.2678,  0.0157,
         0.0477,  0.8607,  0.0502,  0.0453,  0.0134,  0.2565,  0.8274,
         0.9842,  0.5003,  0.0075,  0.1581,  0.9294,  0.6520,  0.0180,
         0.3469,  0.0008,  0.9796,  0.0133,  0.9111,  0.2250,  0.9431,
         0.1864,  0.0707,  0.8658,  0.0171,  0.2153,  0.2747,  0.9852,
         0.8166,  0.0299,  0.0093,  0.8333,  0.1224,  0.9629,  0.6442,
         0.9775,  0.3542,  0.1606,  0.8955,  0.0057,  0.9997,  0.9810,
         0.3843,  0.2435,  0.3179,  0.0743,  0.4702,  0.9707,  0.1913,
         0.0794,  0.9863,  0.5612,  0.5317,  0.1866,  0.9369,  0.9303,
         0.0470,  0.0031,  0.6544,  0.0188,  0.9270,  0.9774,  0.9500,
         0.9760,  0.9426,  0.8591,  0.9999,  0.9829,  0.8909,  0.3777,
         0.9780,  0.8621,  0.0774,  0.9478,  0.9644,  0.1068,  0.0722,
         0.2876,  0.2893,  0.9211,  0.1796,  0.9616,  0.0660,  0.9240,
         0.9850,  0.8678,  0.9957,  0.0594,  0.9765,  0.0091,  0.9734,
         0.0200,  0.9990,  0.0659,  0.8630,  0.0631,  0.0015,  0.0068,
         0.0810,  0.0496,  0.9794,  0.3140,  0.0355,  0.0894,  0.0367,
         0.5895,  0.9646,  0.9293,  0.9822,  0.2796,  0.0018,  0.9793,
         0.9466,  0.0028,  0.9812,  0.0331,  0.9577,  0.0310,  0.9386,
         0.0766,  0.0116,  0.8177,  0.0967,  0.9434,  0.1500,  0.0329,
         0.6866,  0.9637,  0.8907,  0.9290,  0.5177,  0.9796,  0.9456,
         0.0919,  0.9881,  0.9982,  0.0616,  0.7859,  0.7451,  0.9288,
         0.0134,  0.8871,  0.0549,  0.9004,  0.9422,  0.8815,  0.1887,
         0.2207,  0.9759,  0.1542,  0.2005,  0.1291,  0.2175,  0.9250,
         0.9391,  0.0843,  0.8636,  0.7816,  0.0191,  0.8216,  0.0273,
         0.0512,  0.9780,  0.0064,  0.9095,  0.1414,  0.9741,  0.0583,
         0.0742,  0.9250,  0.1034,  0.9893,  0.8779,  0.0261,  0.5287,
         0.0261,  0.1571,  0.0217,  0.8156,  0.0658,  0.6956,  0.1804,
         0.0023,  0.0329,  0.9118,  0.1390,  0.0010,  0.0132,  0.5297,
         0.0531,  0.9935,  0.9744,  0.9685,  0.0457,  0.9300,  0.1898,
         0.9447,  0.9828,  0.7461,  0.9878,  0.3575,  0.6321,  0.3631,
         0.1703,  0.0887,  0.0367,  0.9207,  0.0171,  0.0211,  0.9548,
         0.0146,  0.0355,  0.0641,  0.9983,  0.8367,  0.9617,  0.4314,
         0.7103,  0.9603,  0.0098,  0.0034,  0.0407,  0.9738,  0.9119,
         0.8398,  0.8021,  0.9306,  0.0655,  0.0312,  0.9696,  0.0546,
         0.4652,  0.9332,  0.6205,  0.0019,  0.1060,  0.0083,  0.9234,
         0.0175,  0.6383,  0.3502,  0.0373,  0.9242,  0.1489,  0.1639,
         0.2467,  0.8712,  0.1494,  0.2657,  0.9316,  0.0309,  0.2865,
         0.6193,  0.4769,  0.8952,  0.9184,  0.0743,  0.3007,  0.0913,
         0.9026,  0.0164,  0.9618,  0.9818,  0.0631,  0.0076,  0.8546,
         0.9922,  0.8411,  0.9998,  0.9439,  0.0484,  0.0156,  0.9892,
         0.4411,  0.0740,  0.8468,  0.9592,  0.5169,  0.0082,  0.2330,
         0.9522,  0.9631,  0.0202,  0.1072,  0.0036,  0.0099,  0.0880,
         0.0172,  0.7465,  0.4460,  0.1246,  0.1893,  0.9788,  0.7688,
         0.0049,  0.9211,  0.8947,  0.0536,  0.8710,  0.8146,  0.0889,
         0.2368,  0.4244,  0.0080,  0.9584,  0.0168,  0.9837,  0.9794,
         0.9090,  0.9985,  0.0100,  0.0486,  0.0988,  0.0224,  0.0281,
         0.0008,  0.3269,  0.3063,  0.9920,  0.9928,  0.9412,  0.0223,
         0.2111,  0.9395,  0.0959,  0.0185,  0.0999,  0.9188,  0.9644,
         0.0265,  0.5141,  0.0087,  0.2417,  0.9809,  0.9945,  0.0109,
         0.7552,  0.0284,  0.1717,  0.0437,  0.0121,  0.1691,  0.4006,
         0.4087,  0.9693,  0.9820,  0.9013,  0.6015,  0.0496,  0.9957,
         0.0344,  0.9267,  0.1010,  0.9569,  0.0672,  0.0172,  0.9923,
         0.5565,  0.0856,  0.3271,  0.9814,  0.0092,  0.9541,  0.4409,
         0.9296,  0.9970,  0.9273,  0.9526,  0.1112,  0.3554,  0.9905,
         0.1527,  0.0243,  0.9650,  0.0123,  0.1488,  0.0034,  0.5231,
         0.3246,  0.9468,  0.7873,  0.1542,  0.2319,  0.9973,  0.9680,
         0.9637,  0.0395,  0.0172,  0.0475,  0.8317,  0.9380,  0.9859,
         0.1817,  0.9944,  0.9600,  0.6655,  0.7519,  0.9828,  0.9334,
         0.8317,  0.0557,  0.3120,  0.9965,  0.9495,  0.8822,  0.0649,
         0.5616,  0.0672,  0.9992,  0.9716,  0.0140,  0.9186,  0.0239,
         0.1296,  0.0193,  0.9995,  0.8886,  0.0297,  0.8717,  0.9690,
         0.2058,  0.6436,  0.0748,  0.1855,  0.0388,  0.2307,  0.8488,
         0.7150,  0.1634,  0.0263,  0.1671,  0.2503,  0.0174,  0.0271,
         0.0112,  0.9963,  0.8051,  0.9769,  0.9596,  0.0788,  0.1825,
         0.6458], device='cuda:0')
tensor(0.3183, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8049,  0.9898,  0.0060,  0.7921,  0.9839,  0.9552,  0.9785,
         0.0012,  0.1197,  0.2622,  0.9925,  0.0298,  0.9692,  0.0602,
         0.9623,  0.2119,  0.9909,  0.9847,  0.7372,  0.0313,  0.9639,
         0.9979,  0.7471,  0.0262,  0.0937,  0.0306,  0.6418,  0.9993,
         0.9827,  0.7888,  0.9511,  0.0065,  0.9002,  0.0064,  0.0103,
         0.9492,  0.1662,  0.4135,  0.5327,  0.8436,  0.9620,  0.0644,
         0.2693,  0.0823,  0.7516,  0.0067,  0.0982,  0.6520,  0.8321,
         0.1814,  0.0057,  0.0161,  0.8909,  0.9607,  0.9478,  0.9845,
         0.1219,  0.0955,  0.7236,  0.0026,  0.9278,  0.9622,  0.0452,
         0.1315,  0.2995,  0.9897,  0.9635,  0.1751,  0.0097,  0.1438,
         0.4297,  0.2192,  0.0237,  0.2506,  0.2275,  0.8871,  0.5503,
         0.4033,  0.9900,  0.0557,  0.2419,  0.0130,  0.2640,  0.5147,
         0.2391,  0.0074,  0.9802,  0.6677,  0.0306,  0.0403,  0.5921,
         0.9996,  0.2098,  0.9616,  0.0366,  0.1194,  0.9238,  0.0049,
         0.9945,  0.9338,  0.0029,  0.9614,  0.0265,  0.0369,  0.9787,
         0.9967,  0.0491,  0.9112,  0.9690,  0.5934,  0.9772,  0.0754,
         0.9974,  0.9748,  0.0563,  0.0039,  0.9829,  0.9430,  0.0716,
         0.0534,  0.2801,  0.9992,  0.4922,  0.6185,  0.8993,  0.1151,
         0.1519,  0.0359,  0.8430,  0.0097,  0.5524,  0.9104,  0.9766,
         0.9140,  0.1059,  0.6468,  0.2205,  0.0408,  0.6935,  0.1762,
         0.2143,  0.0696,  0.9319,  0.7026,  0.9796,  0.7417,  0.1375,
         0.9987,  0.0257,  0.0054,  0.1893,  0.7557,  0.7156,  0.2891,
         0.8225,  0.5750,  0.9851,  0.9970,  0.6100,  0.9854,  0.0949,
         0.9976,  0.2080,  0.9800,  0.9284,  0.0609,  0.7767,  0.9891,
         0.5099,  0.9476,  0.9802,  0.9463,  0.0021,  0.9998,  0.0140,
         0.0352,  0.9426,  0.9600,  0.3089,  0.0317,  0.3643,  0.7311,
         0.9997,  0.7368,  0.0192,  0.9702,  0.8192,  0.9946,  0.9345,
         0.9496,  0.9336,  0.9114,  0.4762,  0.9955,  0.9365,  0.9696,
         0.9811,  0.0285,  0.1603,  0.0916,  0.0434,  0.0481,  0.0040,
         0.0731,  0.6400,  0.6984,  0.0360,  0.9188,  0.9922,  0.9977,
         0.3974,  0.4717,  0.9389,  0.0783,  0.9734,  0.1074,  0.0235,
         0.8628,  0.4305,  0.9857,  0.1408,  0.0893,  0.0432,  0.1396,
         0.5614,  0.9720,  0.9653,  0.0813,  0.0085,  0.1914,  0.9929,
         0.9938,  0.9404,  0.7022,  0.6418,  0.1255,  0.1171,  0.9994,
         0.3354,  0.9804,  0.0024,  0.0082,  0.9822,  0.9228,  0.1773,
         0.0145,  0.9457,  0.0836,  0.9830,  0.7194,  0.0399,  0.9967,
         0.0125,  0.9998,  0.9965,  0.9767,  0.0995,  0.5536,  0.7558,
         0.1573,  0.2848,  0.9661,  0.0333,  0.3678,  0.9798,  0.5640,
         0.0957,  0.1788,  0.9811,  0.9964,  0.9725,  0.9877,  0.8443,
         0.9797,  0.9739,  0.1675,  0.3627,  0.2378,  0.9782,  0.9598,
         0.4691,  0.0173,  0.0536,  0.8414,  0.0805,  0.9250,  0.9330,
         0.0151,  0.8882,  0.1034,  0.9761,  0.0838,  0.9825,  0.3685,
         0.9771,  0.9734,  0.9964,  0.2108,  0.7311,  0.0159,  0.2559,
         0.5576,  0.2644,  0.9453,  0.2406,  0.0286,  0.9681,  0.8617,
         0.5986,  0.9762,  0.0256,  0.4485,  0.2110,  0.2701,  0.7403,
         0.1839,  0.9778,  0.0143,  0.0408,  0.0052,  0.9749,  0.9752,
         0.9480,  0.0476,  0.0231,  0.9507,  0.1079,  0.5321,  0.9877,
         0.1732,  0.2209,  0.9084,  0.8759,  0.9477,  0.9620,  0.8513,
         0.8186,  0.0315,  0.9154,  0.9662,  0.9650,  0.1687,  0.4111,
         0.0045,  0.9664,  0.2914,  0.1006,  0.0572,  0.9275,  0.9723,
         0.9106,  0.4546,  0.4231,  0.0563,  0.6933,  0.0322,  0.7812,
         0.1509,  0.9633,  0.0080,  0.9975,  0.9328,  0.9756,  0.9621,
         0.9859,  0.0601,  0.9166,  0.0358,  0.0090,  0.1147,  0.9766,
         0.9873,  0.9175,  0.1191,  0.9786,  0.9549,  0.9167,  0.0096,
         0.0620,  0.9920,  0.0010,  0.0385,  0.9426,  0.9522,  0.9129,
         0.9965,  0.8851,  0.9804,  0.0549,  0.9836,  0.2620,  0.9622,
         0.0986,  0.0368,  0.2488,  0.9349,  0.7170,  0.0591,  0.9625,
         0.9930,  0.8927,  0.5124,  0.5994,  0.0311,  0.9186,  0.0007,
         0.9360,  0.9814,  0.7378,  0.0045,  0.0035,  0.0575,  0.0113,
         0.9469,  0.9813,  0.0217,  0.0207,  0.9729,  0.9999,  0.2958,
         0.2647,  0.1561,  0.9964,  0.3548,  0.0293,  0.9889,  0.9665,
         0.9872,  0.9767,  0.0468,  0.8722,  0.0308,  0.9786,  0.8973,
         0.9825,  0.9647,  0.0187,  0.8905,  0.0605,  0.9728,  0.9863,
         0.9843,  0.5174,  0.1461,  0.0059,  0.9897,  0.9388,  0.1401,
         0.9582,  0.7135,  0.9954,  0.9924,  0.9995,  0.0192,  0.0595,
         0.0124,  0.9746,  0.0057,  0.0179,  0.0700,  0.2173,  0.4391,
         0.2055,  0.5219,  0.9944,  0.0413,  0.0248,  0.5543,  0.9310,
         0.8600,  0.8823,  0.8339,  0.0115,  0.8058,  0.8386,  0.9591,
         0.8885,  0.9606,  0.9842,  0.0070,  0.9742,  0.0333,  0.9862,
         0.1304,  0.0733,  0.0267,  0.2034,  0.0923,  0.0089,  0.9817,
         0.4366,  0.6538,  0.8033,  0.7825,  0.0015,  0.0202,  0.0216,
         0.6802,  0.0013,  0.2012,  0.0258,  0.0073,  0.9859,  0.9951,
         0.9754,  0.2057,  0.2198,  0.7527,  0.9863,  0.0154,  0.9423,
         0.8887], device='cuda:0')
tensor(0.3792, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2977,  0.4657,  0.9548,  0.0522,  0.9656,  0.0186,  0.3390,
         0.1709,  0.0471,  0.2013,  0.7931,  0.0619,  0.8178,  0.9064,
         0.3404,  0.7737,  0.0421,  0.1093,  0.3596,  0.7848,  0.9328,
         0.9937,  0.9582,  0.1680,  0.5791,  0.9564,  0.8653,  0.7456,
         0.0791,  0.9756,  0.2782,  0.9586,  0.2175,  0.9027,  0.3543,
         0.2385,  0.8592,  0.0550,  0.8786,  0.6486,  0.9986,  0.7614,
         0.7934,  0.4734,  0.0263,  0.2366,  0.4691,  0.1047,  0.5793,
         0.0814,  0.0318,  0.0212,  0.0317,  0.0402,  0.0254,  0.2817,
         0.0308,  0.9963,  0.8581,  0.0677,  0.9792,  0.5175,  0.5416,
         0.9991,  0.9901,  0.7641,  0.9817,  0.4710,  0.7116,  0.9177,
         0.2169,  0.9980,  0.0585,  0.8869,  0.6757,  0.6960,  0.1364,
         0.1779,  0.8090,  0.3762,  0.8134,  0.0137,  0.0064,  0.5733,
         0.0009,  0.9487,  0.2385,  0.7100,  0.9619,  0.1499,  0.4891,
         0.1785,  0.7629,  0.9660,  0.1142,  0.9740,  0.9675,  0.9719,
         0.8792,  0.8084,  0.4348,  0.9815,  0.0036,  0.9998,  0.0368,
         0.9670,  0.8749,  0.0348,  0.0080,  0.8787,  0.4518,  0.9633,
         0.0321,  0.0050,  0.9998,  0.9463,  0.7397,  0.6669,  0.0519,
         0.1469,  0.0636,  0.0783,  0.9987,  0.8658,  0.9578,  0.9755,
         0.0294,  0.9682,  0.8044,  0.9376,  0.1705,  0.0279,  0.3224,
         0.0635,  0.0179,  0.0122,  0.0168,  0.1929,  0.1594,  0.0638,
         0.1700,  0.0359,  0.1569,  0.9976,  0.1529,  0.9213,  0.6994,
         0.8801,  0.4900,  0.6476,  0.2675,  0.9871,  0.3566,  0.0749,
         0.2307,  0.2953,  0.8966,  0.0055,  0.9788,  0.6511,  0.6948,
         0.7336,  0.0227,  0.1369,  0.8957,  0.0142,  0.6939,  0.0225,
         0.0661,  0.5412,  0.4192,  0.9580,  0.1186,  0.0045,  0.0547,
         0.9697,  0.2737,  0.0031,  0.2323,  0.0418,  0.0751,  0.0308,
         0.1769,  0.0061,  0.9934,  0.9815,  0.9908,  0.9404,  0.2018,
         0.9662,  0.9832,  0.8872,  0.0502,  0.9145,  0.1801,  0.0639,
         0.9956,  0.0132,  0.9307,  0.8000,  0.9141,  0.2479,  0.9640,
         0.9784,  0.5641,  0.9951,  0.2053,  0.2429,  0.0201,  0.8764,
         0.0096,  0.1287,  0.9001,  0.4358,  0.0173,  0.0200,  0.0547,
         0.2088,  0.8636,  0.0555,  0.0920,  0.2196,  0.9636,  0.1700,
         0.0028,  0.9883,  0.1635,  0.1089,  0.0450,  0.0569,  0.0858,
         0.1248,  0.2180,  0.0222,  0.9190,  0.6680,  0.7752,  0.8949,
         0.8844,  0.6272,  0.7912,  0.3343,  0.8660,  0.9697,  0.9800,
         0.2652,  0.0236,  0.8633,  0.8645,  0.1383,  0.9867,  0.7393,
         0.9246,  0.5853,  0.9950,  0.9354,  0.0135,  0.1545,  0.9166,
         0.9500,  0.1414,  0.3243,  0.9906,  0.9528,  0.1798,  0.0913,
         0.9584,  0.2986,  0.0260,  0.5580,  0.0528,  0.1797,  0.2081,
         0.9448,  0.2622,  0.8536,  0.0617,  0.7868,  0.9650,  0.1687,
         0.0360,  0.9861,  0.8111,  0.0139,  0.7523,  0.0926,  0.0035,
         0.0070,  0.6185,  0.0703,  0.9734,  0.8955,  0.2467,  0.2494,
         0.9511,  0.0258,  0.7578,  0.6232,  0.9697,  0.0524,  0.9188,
         0.0213,  0.7875,  0.1652,  0.9397,  0.5989,  0.1409,  0.7680,
         0.7463,  0.7186,  0.6186,  0.0437,  0.9995,  0.1573,  0.1203,
         0.9416,  0.6269,  0.9995,  0.8247,  0.0013,  0.0263,  0.0483,
         0.9207,  0.0321,  0.8404,  0.4499,  0.0797,  0.9389,  0.0098,
         0.9203,  0.9344,  0.1602,  0.4192,  0.9913,  0.7865,  0.7755,
         0.1339,  0.0127,  0.0813,  0.0022,  0.8900,  0.4155,  0.9520,
         0.2048,  0.3094,  0.1334,  0.7270,  0.7874,  0.7437,  0.0500,
         0.9893,  0.8890,  0.9789,  0.9408,  0.7702,  0.9602,  0.9236,
         0.7255,  0.0173,  0.0853,  0.9889,  0.0452,  0.1524,  0.0383,
         0.0184,  0.1929,  0.9028,  0.5781,  0.7168,  0.9897,  0.9344,
         0.9575,  0.0021,  0.9614,  0.9822,  0.8925,  0.4645,  0.1015,
         0.1750,  0.9693,  0.8341,  0.7588,  0.9851,  0.1502,  0.9883,
         0.9849,  0.0898,  0.6212,  0.0769,  0.9072,  0.9910,  0.0546,
         0.8305,  0.9698,  0.0505,  0.0797,  0.1003,  0.2451,  0.1120,
         0.9314,  0.3852,  0.3105,  0.0036,  0.2649,  0.9788,  0.0431,
         0.0480,  0.0058,  0.9937,  0.3465,  0.1153,  0.2122,  0.8978,
         0.9812,  0.2710,  0.0007,  0.9241,  0.9537,  0.0659,  0.9638,
         0.9826,  0.9783,  0.0335,  0.8534,  0.8916,  0.9641,  0.7729,
         0.0274,  0.8012,  0.8973,  0.9335,  0.2429,  0.9010,  0.5852,
         0.4699,  0.0318,  0.3700,  0.9823,  0.3716,  0.6972,  0.9519,
         0.0415,  0.9975,  0.9351,  0.2947,  0.9850,  0.0631,  0.1724,
         0.3888,  0.7506,  0.9969,  0.0142,  0.9942,  0.0541,  0.9980,
         0.0729,  0.9774,  0.0141,  0.9147,  0.7732,  0.1397,  0.9563,
         0.0497,  0.0957,  0.9472,  0.4338,  0.3487,  0.9986,  0.7359,
         0.1249,  0.6774,  0.1999,  0.2748,  0.3860,  0.9995,  0.4810,
         0.0756,  0.6519,  0.9430,  0.9450,  0.7003,  0.1153,  0.9737,
         0.9752,  0.4347,  0.8852,  0.9138,  0.0019,  0.0086,  0.1230,
         0.0011,  0.0162,  0.6820,  0.2118,  0.9335,  0.8399,  0.4797,
         0.0299,  0.2173,  0.1700,  0.4116,  0.7819,  0.9125,  0.8413,
         0.0265,  0.9770,  0.2630,  0.0842,  0.3695,  0.1700,  0.1454,
         0.0364], device='cuda:0')
tensor(0.2903, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7719,  0.3574,  0.9594,  0.9352,  0.9516,  0.9796,  0.9511,
         0.7429,  0.1380,  0.0581,  0.4411,  0.0555,  0.9405,  0.9776,
         0.9927,  0.0484,  0.9421,  0.0020,  0.2440,  0.9652,  0.8776,
         0.2113,  0.1262,  0.9157,  0.1584,  0.4035,  0.0846,  0.9577,
         0.9706,  0.7160,  0.2057,  0.9932,  0.1888,  0.8830,  0.0064,
         0.0777,  0.2244,  0.6479,  0.1181,  0.9983,  0.8899,  0.0569,
         0.9996,  0.0016,  0.5473,  0.9290,  0.8937,  0.0416,  0.4360,
         0.1024,  0.4105,  0.0258,  0.0109,  0.8538,  0.0048,  0.3448,
         0.6916,  0.9656,  0.0177,  0.0616,  0.0672,  0.1945,  0.9608,
         0.0363,  0.0313,  0.5404,  0.5756,  0.0013,  0.8273,  0.0381,
         0.9544,  0.5804,  0.0391,  0.9987,  0.9836,  0.1963,  0.9850,
         0.1055,  0.9216,  0.1255,  0.8993,  0.9876,  0.9566,  0.0049,
         0.9989,  0.9227,  0.1069,  0.0030,  0.3953,  0.4483,  0.9690,
         0.8693,  0.9301,  0.1549,  0.9887,  0.8295,  0.4459,  0.6472,
         0.0036,  0.9518,  0.2991,  0.9990,  0.1129,  0.9903,  0.9033,
         0.0293,  0.9792,  0.9858,  0.9639,  0.1362,  0.0342,  0.8313,
         0.7310,  0.0345,  0.7117,  0.0064,  0.5817,  0.9410,  0.9920,
         0.9561,  0.9557,  0.4064,  0.9442,  0.9887,  0.7441,  0.9972,
         0.9121,  0.8718,  0.0290,  0.0973,  0.2936,  0.4287,  0.9946,
         0.9370,  0.2126,  0.9488,  0.0084,  0.9717,  0.9269,  0.6144,
         0.9924,  0.0958,  0.1580,  0.0933,  0.9295,  0.9732,  0.1707,
         0.0947,  0.0174,  0.5030,  0.1022,  0.1727,  0.8997,  0.8633,
         0.0332,  0.0258,  0.0800,  0.9470,  0.2444,  0.0591,  0.0202,
         0.9573,  0.7749,  0.5077,  0.2212,  0.4196,  0.1384,  0.9965,
         0.9642,  0.3631,  0.0071,  0.0558,  0.0845,  0.1343,  0.0067,
         0.7086,  0.7580,  0.9813,  0.5319,  0.6981,  0.9476,  0.2388,
         0.9023,  0.9808,  0.1453,  0.1958,  0.2742,  0.9761,  0.0173,
         0.8751,  0.9795,  0.9697,  0.9808,  0.9675,  0.9622,  0.0197,
         0.0151,  0.6944,  0.8615,  0.9674,  0.0779,  0.0299,  0.7450,
         0.9929,  0.3583,  0.1430,  0.9356,  0.9794,  0.7994,  0.5060,
         0.9549,  0.7695,  0.9098,  0.0359,  0.7671,  0.7426,  0.8901,
         0.9666,  0.2081,  0.9947,  0.0435,  0.0138,  0.0289,  0.0426,
         0.9224,  0.0376,  0.1096,  0.9546,  0.0405,  0.9917,  0.1169,
         0.8100,  0.4228,  0.6800,  0.7853,  0.9485,  0.4898,  0.0029,
         0.0613,  0.2252,  0.7255,  0.8377,  0.7778,  0.9436,  0.0266,
         0.1241,  0.0654,  0.9184,  0.7360,  0.9499,  0.9814,  0.1238,
         0.8586,  0.9856,  0.9607,  0.9647,  0.9657,  0.1943,  0.9970,
         0.0117,  0.7405,  0.0067,  0.9917,  0.1637,  0.9481,  0.9654,
         0.9715,  0.6045,  0.9735,  0.1392,  0.0099,  0.0225,  0.4758,
         0.8076,  0.3263,  0.9713,  0.9912,  0.9728,  0.2268,  0.0779,
         0.3817,  0.9402,  0.8624,  0.8711,  0.1441,  0.8866,  0.9678,
         0.0116,  0.8326,  0.9904,  0.3826,  0.9852,  0.0106,  0.0054,
         0.0056,  0.2278,  0.1965,  0.0452,  0.9548,  0.0622,  0.8907,
         0.6324,  0.0806,  0.0462,  0.9520,  0.9845,  0.0138,  0.8965,
         0.9856,  0.9398,  0.0292,  0.9629,  0.6860,  0.9751,  0.9937,
         0.1824,  0.1858,  0.0537,  0.9905,  0.5847,  0.0658,  0.9102,
         0.9370,  0.7608,  0.0065,  0.9911,  0.8737,  0.0382,  0.8845,
         0.2534,  0.1482,  0.8645,  0.7738,  0.7978,  0.1157,  0.0240,
         0.1573,  0.3147,  0.0225,  0.0568,  0.1662,  0.0397,  0.0667,
         0.8835,  0.0182,  0.1533,  0.3341,  0.0257,  0.9799,  0.7111,
         0.0106,  0.0088,  0.8343,  0.1619,  0.0892,  0.0369,  0.9504,
         0.0404,  0.7278,  0.8058,  0.9861,  0.7977,  0.2319,  0.2298,
         0.1033,  0.9435,  0.9573,  0.5568,  0.6878,  0.2925,  0.0081,
         0.5779,  0.9844,  0.1970,  0.8096,  0.9681,  0.3525,  0.7599,
         0.8841,  0.1376,  0.9099,  0.0371,  0.0178,  0.0345,  0.9895,
         0.9194,  0.9884,  0.8462,  0.9302,  0.1305,  0.9748,  0.7833,
         0.1680,  0.8606,  0.3506,  0.0120,  0.2952,  0.4440,  0.8854,
         0.8229,  0.0747,  0.8449,  0.9908,  0.7815,  0.0093,  0.7195,
         0.9621,  0.0313,  0.0861,  0.9710,  0.7499,  0.0191,  0.2820,
         0.9580,  0.8891,  0.8827,  0.9964,  0.8586,  0.9538,  0.9350,
         0.0968,  0.9475,  0.9801,  0.9102,  0.9048,  0.9046,  0.0357,
         0.0499,  0.8334,  0.6503,  0.9257,  0.0634,  0.4963,  0.8357,
         0.9915,  0.6254,  0.9719,  0.7798,  0.9877,  0.1841,  0.6961,
         0.0123,  0.8828,  0.5304,  0.5325,  0.8026,  0.0301,  0.5003,
         0.0413,  0.1116,  0.0248,  0.1265,  0.0027,  0.9563,  0.0179,
         0.8994,  0.0068,  0.9503,  0.8369,  0.1112,  0.0290,  0.2237,
         0.5062,  0.9830,  0.9667,  0.0064,  0.8095,  0.0660,  0.5519,
         0.6968,  0.3560,  0.4798,  0.0775,  0.9996,  0.1181,  0.8420,
         0.9677,  0.9997,  0.9193,  0.9526,  0.9797,  0.0989,  0.4119,
         0.9300,  0.0309,  0.9846,  0.7117,  0.2110,  0.9936,  0.7727,
         0.1453,  0.1662,  0.0946,  0.1050,  0.9564,  0.0039,  0.4667,
         0.8758,  0.9558,  0.9627,  0.9758,  0.4619,  0.0633,  0.0055,
         0.9672,  0.0881,  0.1034,  0.9731,  0.0115,  0.9219,  0.9568,
         0.9258], device='cuda:0')
tensor(0.2583, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3042,  0.8271,  0.0255,  0.9904,  0.9125,  0.7614,  0.9308,
         0.6737,  0.9935,  0.0701,  0.0353,  0.7705,  0.7691,  0.1769,
         0.8879,  0.0271,  0.9905,  0.9882,  0.0540,  0.9800,  0.0104,
         0.0030,  0.0226,  0.0095,  0.4165,  0.9346,  0.7253,  0.3982,
         0.8144,  0.9607,  0.9304,  0.2012,  0.0043,  0.3217,  0.9414,
         0.3993,  0.1443,  0.4369,  0.8519,  0.2924,  0.5944,  0.2379,
         0.0341,  0.3470,  0.9764,  0.0884,  0.9201,  0.9042,  0.1487,
         0.6156,  0.9005,  0.8949,  0.9781,  0.0455,  0.1735,  0.2692,
         0.1093,  0.0733,  0.8162,  0.8972,  0.9588,  0.9583,  0.1158,
         0.7309,  0.9164,  0.9297,  0.9022,  0.9269,  0.5006,  0.5081,
         0.9485,  0.9444,  0.1900,  0.0339,  0.2722,  0.8580,  0.9852,
         0.4519,  0.9450,  0.9629,  0.0080,  0.9779,  0.1910,  0.0246,
         0.8645,  0.0401,  0.0789,  0.1222,  0.0461,  0.9598,  0.1472,
         0.0074,  0.0525,  0.9882,  0.8935,  0.0256,  0.4677,  0.1319,
         0.0218,  0.2526,  0.1898,  0.5317,  0.9387,  0.5722,  0.8548,
         0.2988,  0.0052,  0.8892,  0.0282,  0.0083,  0.9557,  0.9363,
         0.8280,  0.5743,  0.8907,  0.1228,  0.9224,  0.0021,  0.0785,
         0.1576,  0.8613,  0.8811,  0.1898,  0.9611,  0.9251,  0.0239,
         0.0948,  0.9388,  0.0093,  0.0531,  0.3291,  0.1704,  0.0411,
         0.4804,  0.9619,  0.0176,  0.9438,  0.1718,  0.1205,  0.2336,
         0.3706,  0.2152,  0.4248,  0.0715,  0.0440,  0.0100,  0.8133,
         0.8178,  0.0398,  0.0070,  0.1234,  0.9347,  0.8994,  0.0029,
         0.0023,  0.9558,  0.0399,  0.0980,  0.0448,  0.9876,  0.8427,
         0.8614,  0.0668,  0.9694,  0.8260,  0.8361,  0.0254,  0.9802,
         0.6613,  0.9604,  0.9698,  0.0046,  0.8750,  0.6983,  0.9167,
         0.9531,  0.9422,  0.8699,  0.0004,  0.0580,  0.2554,  0.1484,
         0.1521,  0.6391,  0.7366,  0.7702,  0.9908,  0.9669,  0.0717,
         0.9647,  0.2450,  0.0858,  0.1623,  0.8310,  0.9557,  0.8091,
         0.1546,  0.8126,  0.7279,  0.0161,  0.0058,  0.8955,  0.1903,
         0.3271,  0.9826,  0.8058,  0.9252,  0.9568,  0.0393,  0.0632,
         0.1176,  0.9988,  0.0098,  0.1268,  0.7239,  0.8575,  0.1011,
         0.8670,  0.0314,  0.1637,  0.9669,  0.0125,  0.1642,  0.7642,
         0.5964,  0.0162,  0.5994,  0.0408,  0.7711,  0.0711,  0.1343,
         0.1210,  0.2676,  0.5236,  0.0684,  0.1246,  0.0124,  0.3785,
         0.7187,  0.0243,  0.9500,  0.0948,  0.5742,  0.2612,  0.3993,
         0.4161,  0.3582,  0.1205,  0.6902,  0.8809,  0.3178,  0.1600,
         0.2120,  0.0634,  0.0966,  0.9694,  0.9633,  0.9357,  0.0177,
         0.3707,  0.0376,  0.8605,  0.8276,  0.4883,  0.1331,  0.1022,
         0.8746,  0.4135,  0.0476,  0.0417,  0.2252,  0.1818,  0.0598,
         0.6453,  0.1098,  0.6015,  0.9402,  0.0352,  0.9917,  0.0308,
         0.6305,  0.9466,  0.7678,  0.8373,  0.4014,  0.0228,  0.7969,
         0.0547,  0.0498,  0.9542,  0.7178,  0.5559,  0.5680,  0.0007,
         0.0089,  0.7501,  0.9784,  0.1547,  0.0050,  0.9221,  0.9486,
         0.7074,  0.1040,  0.2369,  0.0282,  0.4197,  0.0596,  0.9440,
         0.2271,  0.8385,  0.9289,  0.0265,  0.1342,  0.9333,  0.0136,
         0.1442,  0.9447,  0.2172,  0.0040,  0.7206,  0.9968,  0.2014,
         0.9735,  0.3201,  0.0433,  0.0025,  0.4789,  0.0342,  0.0207,
         0.1901,  0.8607,  0.9749,  0.4844,  0.6720,  0.3092,  0.1425,
         0.0500,  0.1419,  0.8380,  0.6811,  0.9977,  0.3048,  0.9582,
         0.0068,  0.1738,  0.6183,  0.1119,  0.9725,  0.0528,  0.4310,
         0.0393,  0.5700,  0.9552,  0.9560,  0.9184,  0.0685,  0.8379,
         0.7725,  0.0542,  0.2159,  0.2416,  0.7903,  0.9182,  0.5618,
         0.9959,  0.9987,  0.0031,  0.8055,  0.0190,  0.0372,  0.9935,
         0.8674,  0.6607,  0.7437,  0.6813,  0.9296,  0.1528,  0.4959,
         0.0925,  0.0095,  0.7117,  0.1282,  0.9814,  0.1606,  0.0180,
         0.7195,  0.7766,  0.0599,  0.4898,  0.5646,  0.4900,  0.0576,
         0.9596,  0.1289,  0.1240,  0.0105,  0.7845,  0.9044,  0.7775,
         0.8858,  0.9294,  0.0164,  0.0230,  0.0012,  0.9692,  0.0658,
         0.4832,  0.0063,  0.2611,  0.0166,  0.0073,  0.9729,  0.2246,
         0.7988,  0.0028,  0.9939,  0.1086,  0.1821,  0.7002,  0.5982,
         0.6674,  0.0402,  0.0426,  0.9360,  0.1613,  0.9304,  0.9392,
         0.0194,  0.9949,  0.9000,  0.8681,  0.8221,  0.0044,  0.3657,
         0.9430,  0.9067,  0.9365,  0.5061,  0.2033,  0.6476,  0.5701,
         0.9676,  0.0238,  0.9592,  0.9247,  0.0824,  0.3942,  0.4089,
         0.0879,  0.9856,  0.0103,  0.4509,  0.0157,  0.0056,  0.0247,
         0.6610,  0.8178,  0.0004,  0.9075,  0.9596,  0.0260,  0.3217,
         0.9916,  0.0668,  0.9551,  0.1485,  0.8745,  0.9303,  0.0475,
         0.9900,  0.2461,  0.6997,  0.5524,  0.9207,  0.0072,  0.0354,
         0.8969,  0.7219,  0.1786,  0.9821,  0.0146,  0.0993,  0.2622,
         0.9680,  0.2089,  0.9988,  0.9690,  0.8326,  0.5413,  0.9251,
         0.0260,  0.9973,  0.1225,  0.0376,  0.0235,  0.9615,  0.1733,
         0.5507,  0.8016,  0.5621,  0.6694,  0.0335,  0.3831,  0.1110,
         0.9335,  0.6476,  0.0049,  0.3853,  0.5704,  0.9198,  0.0770,
         0.8319], device='cuda:0')
tensor(0.2824, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8704,  0.0607,  0.5308,  0.0891,  0.0161,  0.9283,  0.0295,
         0.0420,  0.0026,  0.9220,  0.0548,  0.9763,  0.9819,  0.9513,
         0.2209,  0.1083,  0.3235,  0.1865,  0.9648,  0.0890,  0.9191,
         0.3431,  0.0409,  0.0076,  0.8295,  0.2380,  0.9608,  0.9583,
         0.9530,  0.2924,  0.3659,  0.9266,  0.9700,  0.4758,  0.0108,
         0.9470,  0.6594,  0.0897,  0.7968,  0.0678,  0.9684,  0.0038,
         0.0068,  0.9862,  0.8364,  0.0033,  0.2810,  0.1370,  0.0671,
         0.9183,  0.9777,  0.9264,  0.2226,  0.1714,  0.8417,  0.9207,
         0.0329,  0.8531,  0.9814,  0.9650,  0.0089,  0.0394,  0.7743,
         0.0139,  0.3115,  0.0305,  0.7500,  0.6621,  0.9779,  0.6074,
         0.8958,  0.9112,  0.9331,  0.4286,  0.7727,  0.1993,  0.7175,
         0.0334,  0.0117,  0.9387,  0.3671,  0.0010,  0.9954,  0.9426,
         0.0050,  0.8772,  0.0313,  0.7424,  0.5726,  0.1944,  0.0855,
         0.6936,  0.2304,  0.9830,  0.9635,  0.0239,  0.8581,  0.9581,
         0.9892,  0.9998,  0.0826,  0.0057,  0.2917,  0.1807,  0.0205,
         0.9151,  0.9112,  0.1674,  0.9726,  0.8661,  0.0345,  0.0581,
         0.9062,  0.3945,  0.8730,  0.8311,  0.9777,  0.8579,  0.7061,
         0.2135,  0.0598,  0.0621,  0.9989,  0.8328,  0.6682,  0.9131,
         0.9041,  0.5844,  0.9363,  0.3058,  0.0022,  0.1539,  0.0276,
         0.1655,  0.9736,  0.0455,  0.8544,  0.9354,  0.7344,  0.0255,
         0.4758,  0.7574,  0.9612,  0.5484,  0.1183,  0.2116,  0.9049,
         0.0156,  0.9707,  0.0698,  0.0500,  0.9160,  0.9468,  0.0171,
         0.6765,  0.0128,  0.8647,  0.8480,  0.1142,  0.6138,  0.8063,
         0.0966,  0.0917,  0.9428,  0.7743,  0.7016,  0.5491,  0.9219,
         0.0935,  0.0541,  0.9142,  0.0418,  0.7091,  0.8515,  0.0498,
         0.0765,  0.0159,  0.7552,  0.1732,  0.0997,  0.2158,  0.0128,
         0.8001,  0.0095,  0.9394,  0.9862,  0.0071,  0.0113,  0.1686,
         0.1551,  0.0055,  0.7612,  0.1111,  0.1340,  0.7543,  0.7594,
         0.4571,  0.9009,  0.6040,  0.0014,  0.6974,  0.9466,  0.9776,
         0.9833,  0.3661,  0.8902,  0.0115,  0.0025,  0.8781,  0.4770,
         0.0048,  0.1323,  0.9085,  0.2378,  0.3259,  0.0097,  0.9421,
         0.5607,  0.9055,  0.0135,  0.6968,  0.0331,  0.7846,  0.8986,
         0.9758,  0.0230,  0.0208,  0.0637,  0.0035,  0.0827,  0.9180,
         0.9585,  0.9544,  0.3155,  0.0111,  0.0695,  0.3021,  0.0180,
         0.0038,  0.0415,  0.1317,  0.2393,  0.8576,  0.0135,  0.1198,
         0.8814,  0.5911,  0.8862,  0.9615,  0.0495,  0.0930,  0.9801,
         0.0379,  0.9677,  0.0809,  0.0594,  0.0184,  0.8774,  0.7479,
         0.1485,  0.7047,  0.9224,  0.0657,  0.0784,  0.0216,  0.2881,
         0.9237,  0.1250,  0.5709,  0.0088,  0.9794,  0.8810,  0.0341,
         0.7719,  0.4433,  0.6582,  0.6573,  0.0141,  0.8814,  0.0179,
         0.0035,  0.9826,  0.8417,  0.0373,  0.0128,  0.0012,  0.1708,
         0.9367,  0.9294,  0.0034,  0.8187,  0.8000,  0.9035,  0.9452,
         0.9435,  0.0023,  0.5098,  0.6491,  0.9295,  0.0252,  0.0197,
         0.3128,  0.0246,  0.8687,  0.9432,  0.0299,  0.6737,  0.7792,
         0.0203,  0.1266,  0.2156,  0.9788,  0.1233,  0.8273,  0.7153,
         0.8875,  0.9400,  0.9664,  0.9904,  0.2116,  0.8800,  0.0041,
         0.6371,  0.0851,  0.2058,  0.9379,  0.0799,  0.9106,  0.6293,
         0.0280,  0.1018,  0.9778,  0.0014,  0.0225,  0.0923,  0.0405,
         0.7487,  0.0100,  0.0243,  0.0648,  0.9397,  0.7136,  0.8608,
         0.9648,  0.3505,  0.1028,  0.4287,  0.9575,  0.3170,  0.7210,
         0.3065,  0.0823,  0.0105,  0.6022,  0.9546,  0.8747,  0.0419,
         0.7752,  0.9375,  0.8250,  0.9796,  0.1669,  0.8497,  0.0292,
         0.0057,  0.7099,  0.0572,  0.3859,  0.3202,  0.8211,  0.9970,
         0.0094,  0.0541,  0.0377,  0.1122,  0.8628,  0.8800,  0.8952,
         0.9990,  0.3086,  0.8162,  0.8913,  0.8081,  0.0282,  0.0432,
         0.1312,  0.6657,  0.1193,  0.2082,  0.0499,  0.2165,  0.8328,
         0.5372,  0.5411,  0.0505,  0.0716,  0.0876,  0.0411,  0.0257,
         0.7731,  0.9332,  0.9177,  0.9526,  0.0486,  0.9352,  0.9015,
         0.0251,  0.9390,  0.9893,  0.3269,  0.9715,  0.0214,  0.0230,
         0.1000,  0.8676,  0.7948,  0.1066,  0.9975,  0.9050,  0.1623,
         0.3704,  0.7972,  0.0086,  0.3777,  0.1231,  0.0599,  0.9503,
         0.0610,  0.0356,  0.0170,  0.2619,  0.0456,  0.0022,  0.9595,
         0.9136,  0.3732,  0.9537,  0.0099,  0.0114,  0.9210,  0.0007,
         0.4895,  0.0070,  0.6403,  0.6682,  0.9160,  0.7950,  0.9165,
         0.9820,  0.0160,  0.9718,  0.2197,  0.3310,  0.3674,  0.9445,
         0.9597,  0.0024,  0.2461,  0.7921,  0.2552,  0.8323,  0.9154,
         0.0585,  0.9233,  0.3084,  0.8035,  0.0532,  0.2550,  0.3271,
         0.9235,  0.7312,  0.0836,  0.9316,  0.5186,  0.9600,  0.7386,
         0.1303,  0.8844,  0.8582,  0.0105,  0.0018,  0.9874,  0.0015,
         0.0525,  0.8360,  0.9918,  0.9797,  0.0723,  0.4681,  0.3863,
         0.8352,  0.0051,  0.9882,  0.5339,  0.4781,  0.0605,  0.1436,
         0.5415,  0.7210,  0.9121,  0.9347,  0.0121,  0.0112,  0.6964,
         0.0007,  0.7449,  0.2110,  0.9984,  0.0163,  0.1917,  0.0557,
         0.7166], device='cuda:0')
tensor(0.2882, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9210,  0.8492,  0.3503,  0.4099,  0.3545,  0.9868,  0.5032,
         0.9996,  0.8618,  0.0591,  0.7552,  0.3925,  0.0021,  0.0183,
         0.8343,  0.0832,  0.0375,  0.0030,  0.3132,  0.7323,  0.0309,
         0.0176,  0.1166,  0.9395,  0.0113,  0.1772,  0.9997,  0.4464,
         0.0147,  0.0474,  0.0106,  0.0231,  0.0017,  0.9699,  0.0536,
         0.6543,  0.8035,  0.0979,  0.4686,  0.0103,  0.0998,  0.0228,
         0.1705,  0.0915,  0.9736,  0.1064,  0.6604,  0.6572,  0.3422,
         0.8767,  0.7891,  0.9901,  0.9446,  0.9060,  0.1280,  0.5114,
         0.3274,  0.9199,  0.0773,  0.9640,  0.0523,  0.0761,  0.0395,
         0.5797,  0.8642,  0.7892,  0.9351,  0.2211,  0.8680,  0.9044,
         0.9859,  0.8123,  0.2021,  0.0088,  0.4972,  0.5234,  0.8491,
         0.1111,  0.9946,  0.9880,  0.8116,  0.0069,  0.1436,  0.5824,
         0.0010,  0.0448,  0.2057,  0.6217,  0.9227,  0.0044,  0.9283,
         0.0618,  0.5158,  0.0053,  0.6270,  0.9041,  0.0098,  0.0356,
         0.2285,  0.1801,  0.2999,  0.0172,  0.2543,  0.7462,  0.1657,
         0.7632,  0.0477,  0.8908,  0.0115,  0.4222,  0.8138,  0.8293,
         0.9157,  0.7459,  0.9975,  0.4295,  0.3829,  0.1190,  0.0140,
         0.0842,  0.0442,  0.8814,  0.9378,  0.9622,  0.9945,  0.9965,
         0.0392,  0.2182,  0.0007,  0.6543,  0.0029,  0.5975,  0.9919,
         0.2261,  0.0230,  0.7709,  0.0025,  0.1115,  0.9766,  0.4783,
         0.9444,  0.0496,  0.1120,  0.0008,  0.9885,  0.0016,  0.9476,
         0.9125,  0.0295,  0.8662,  0.9349,  0.9916,  0.8900,  0.9701,
         0.0138,  0.0042,  0.8685,  0.8729,  0.9682,  0.9994,  0.0690,
         0.9404,  0.3125,  0.0227,  0.4224,  0.1081,  0.0757,  0.9288,
         0.0004,  0.0643,  0.9667,  0.8027,  0.9549,  0.8785,  0.1374,
         0.0019,  0.9606,  0.0086,  0.9664,  0.9729,  0.4106,  0.0873,
         0.9889,  0.4260,  0.7278,  0.9041,  0.9748,  0.1047,  0.0987,
         0.7841,  0.0916,  0.0148,  0.5452,  0.0068,  0.4997,  0.1041,
         0.0051,  0.0306,  0.8570,  0.6004,  0.0089,  0.0397,  0.0087,
         0.0011,  0.0090,  0.7278,  0.9802,  0.5763,  0.0309,  0.9986,
         0.9857,  0.9833,  0.0306,  0.0239,  0.0250,  0.7502,  0.9381,
         0.1459,  0.9632,  0.9752,  0.9115,  0.9630,  0.0240,  0.9510,
         0.6652,  0.8987,  0.9707,  0.9262,  0.0243,  0.8079,  0.1218,
         0.6073,  0.0534,  0.1503,  0.5184,  0.7807,  0.0043,  0.0717,
         0.2783,  0.0620,  0.8368,  0.1255,  0.0259,  0.4318,  0.3253,
         0.1462,  0.8928,  0.0086,  0.0272,  0.0100,  0.0012,  0.9325,
         0.0261,  0.0280,  0.7596,  0.1140,  0.5807,  0.8825,  0.7571,
         0.8947,  0.7950,  0.9570,  0.1636,  0.0279,  0.0071,  0.9321,
         0.0009,  0.1315,  0.0327,  0.2513,  0.0406,  0.0088,  0.0161,
         0.9416,  0.1840,  0.0160,  0.9685,  0.7671,  0.0173,  0.8346,
         0.6647,  0.9971,  0.5029,  0.0167,  0.0523,  0.9104,  0.8573,
         0.0320,  0.8166,  0.8658,  0.8197,  0.9495,  0.9271,  0.9886,
         0.8803,  0.0108,  0.1692,  0.4751,  0.0145,  0.0863,  0.9217,
         0.9837,  0.0431,  0.9692,  0.9440,  0.6774,  0.2936,  0.0855,
         0.9658,  0.0111,  0.9718,  0.4570,  0.0029,  0.0265,  0.6644,
         0.1617,  0.6697,  0.0004,  0.0015,  0.5212,  0.2984,  0.3868,
         0.0474,  0.9874,  0.0082,  0.9248,  0.9883,  0.9348,  0.0627,
         0.9537,  0.1878,  0.0379,  0.9571,  0.0255,  0.2165,  0.0060,
         0.5994,  0.7306,  0.0089,  0.4372,  0.3418,  0.8574,  0.0350,
         0.1596,  0.0234,  0.0120,  0.7461,  0.8067,  0.9107,  0.0667,
         0.9899,  0.9991,  0.7278,  0.0007,  0.0153,  0.6634,  0.0006,
         0.5513,  0.8863,  0.9263,  0.9757,  0.0025,  0.9186,  0.8872,
         0.7941,  0.8957,  0.9838,  0.1518,  0.1191,  0.7974,  0.9983,
         0.3121,  0.0067,  0.8659,  0.0042,  0.4089,  0.9702,  0.0419,
         0.2097,  0.9497,  0.9128,  0.4968,  0.9646,  0.0385,  0.9928,
         0.9477,  0.0579,  0.1375,  0.3885,  0.5270,  0.0004,  0.9683,
         0.8236,  0.0227,  0.0040,  0.0159,  0.6164,  0.4572,  0.0086,
         0.9378,  0.1748,  0.9987,  0.9606,  0.4976,  0.7780,  0.0266,
         0.2364,  0.9880,  0.0075,  0.0566,  0.1222,  0.9771,  0.4362,
         0.2263,  0.8939,  0.7073,  0.8815,  0.0862,  0.9214,  0.0913,
         0.8042,  0.0013,  0.4515,  0.1074,  0.4134,  0.9407,  0.7215,
         0.6888,  0.0226,  0.0624,  0.0090,  0.8008,  0.9131,  0.0017,
         0.4443,  0.0350,  0.0046,  0.1171,  0.8440,  0.0006,  0.7668,
         0.9168,  0.9628,  0.9683,  0.0092,  0.9834,  0.0569,  0.9862,
         0.0107,  0.9684,  0.0912,  0.4708,  0.1079,  0.8077,  0.9724,
         0.0192,  0.0128,  0.0354,  0.0012,  0.8630,  0.9046,  0.4569,
         0.1963,  0.6334,  0.9982,  0.0395,  0.4389,  0.0633,  0.2467,
         0.1931,  0.4025,  0.9249,  0.1368,  0.9484,  0.8475,  0.7203,
         0.9592,  0.7947,  0.7923,  0.9833,  0.8968,  0.9873,  0.0776,
         0.9648,  0.0062,  0.0052,  0.9366,  0.5985,  0.8625,  0.0037,
         0.0250,  0.0283,  0.9444,  0.5243,  0.9557,  0.9425,  0.6162,
         0.2521,  0.9661,  0.8857,  0.2869,  0.9402,  0.6973,  0.0061,
         0.8729,  0.0013,  0.9071,  0.9565,  0.0085,  0.0173,  0.8437,
         0.0888], device='cuda:0')
tensor(0.3181, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0239,  0.1774,  0.0097,  0.1395,  0.0476,  0.3940,  0.5537,
         0.4584,  0.9883,  0.7001,  0.0079,  0.0084,  0.0958,  0.0079,
         0.0101,  0.9510,  0.9891,  0.3952,  0.0326,  0.0114,  0.1233,
         0.9246,  0.1951,  0.5158,  0.9662,  0.0096,  0.7768,  0.0114,
         0.2026,  0.7595,  0.8506,  0.9872,  0.9871,  0.4307,  0.7931,
         0.0190,  0.9418,  0.0278,  0.0475,  0.9112,  0.7668,  0.1304,
         0.8716,  0.7113,  0.0043,  0.9823,  0.9532,  0.0004,  0.0077,
         0.8276,  0.0140,  0.9603,  0.0071,  0.8302,  0.8759,  0.7853,
         0.6483,  0.9949,  0.4880,  0.0634,  0.9775,  0.0099,  0.8946,
         0.2437,  0.0916,  0.0042,  0.6031,  0.0496,  0.0087,  0.0822,
         0.9307,  0.0569,  0.1340,  0.4242,  0.1239,  0.9718,  0.9054,
         0.0066,  0.5637,  0.3882,  0.8426,  0.0359,  0.9285,  0.0056,
         0.1311,  0.0501,  0.0970,  0.7378,  0.8333,  0.9627,  0.5710,
         0.5488,  0.0479,  0.9763,  0.4703,  0.9666,  0.3168,  0.0856,
         0.0873,  0.9811,  0.0104,  0.9015,  0.2717,  0.0140,  0.2528,
         0.9231,  0.2238,  0.0142,  0.0451,  0.9025,  0.5496,  0.3717,
         0.0061,  0.0700,  0.2181,  0.8461,  0.0149,  0.1362,  0.5272,
         0.5231,  0.7377,  0.8794,  0.2210,  0.9081,  0.1998,  0.1664,
         0.2840,  0.9386,  0.0491,  0.1211,  0.8245,  0.8901,  0.0055,
         0.9626,  0.9643,  0.0272,  0.0482,  0.0106,  0.9847,  0.3778,
         0.1480,  0.0194,  0.8965,  0.8088,  0.9656,  0.9602,  0.6688,
         0.2576,  0.8879,  0.9236,  0.9800,  0.0101,  0.0014,  0.9751,
         0.9921,  0.9869,  0.2806,  0.1881,  0.1402,  0.9369,  0.9917,
         0.8522,  0.6125,  0.4033,  0.0046,  0.3042,  0.8663,  0.8591,
         0.5107,  0.9531,  0.0179,  0.0155,  0.5207,  0.0192,  0.9039,
         0.0591,  0.5064,  0.9034,  0.9810,  0.0128,  0.9742,  0.7726,
         0.9518,  0.9924,  0.7928,  0.4341,  0.1064,  0.1519,  0.2816,
         0.8032,  0.9886,  0.1637,  0.6911,  0.0366,  0.0263,  0.4380,
         0.0610,  0.9942,  0.0059,  0.8190,  0.0133,  0.6041,  0.8454,
         0.9405,  0.9880,  0.0076,  0.0043,  0.4371,  0.0279,  0.9671,
         0.5873,  0.1346,  0.0226,  0.3005,  0.7947,  0.9989,  0.9780,
         0.9682,  0.9929,  0.3854,  0.1308,  0.1150,  0.9023,  0.0654,
         0.0063,  0.9355,  0.9450,  0.2423,  0.4358,  0.7721,  0.8994,
         0.0110,  0.9446,  0.9222,  0.0850,  0.0178,  0.9852,  0.0004,
         0.5469,  0.0025,  0.5945,  0.7852,  0.9988,  0.8983,  0.6241,
         0.0155,  0.2445,  0.3565,  0.1825,  0.7904,  0.8780,  0.0150,
         0.8597,  0.9828,  0.9746,  0.9082,  0.0775,  0.9302,  0.7370,
         0.0049,  0.1067,  0.9929,  0.2112,  0.9244,  0.7910,  0.8115,
         0.0175,  0.4499,  0.9374,  0.7113,  0.0319,  0.0096,  0.3468,
         0.9915,  0.4144,  0.9286,  0.5936,  0.3306,  0.9687,  0.1806,
         0.0131,  0.0916,  0.8806,  0.0409,  0.9930,  0.7668,  0.0070,
         0.0013,  0.0741,  0.9998,  0.0092,  0.0300,  0.1141,  0.9859,
         0.1244,  0.6219,  0.0026,  0.0025,  0.9466,  0.0423,  0.0855,
         0.0073,  0.7324,  0.2159,  0.7507,  0.9793,  0.9584,  0.0094,
         0.9593,  0.8995,  0.5654,  0.7765,  0.0293,  0.0231,  0.0571,
         0.8441,  0.6481,  0.9813,  0.2051,  0.0128,  0.8926,  0.0085,
         0.4008,  0.1239,  0.7997,  0.2959,  0.2173,  0.0089,  0.9434,
         0.1682,  0.3978,  0.1207,  0.9816,  0.1947,  0.0106,  0.0146,
         0.0054,  0.0076,  0.2514,  0.0252,  0.1795,  0.2476,  0.9496,
         0.9653,  0.0205,  0.0340,  0.9012,  0.9368,  0.9765,  0.6726,
         0.0311,  0.0137,  0.4051,  0.0391,  0.9206,  0.8890,  0.4217,
         0.1337,  0.9391,  0.2953,  0.9638,  0.0105,  0.9230,  0.4303,
         0.1956,  0.0331,  0.9392,  0.9285,  0.7956,  0.0018,  0.9931,
         0.9667,  0.1824,  0.9785,  0.2331,  0.0288,  0.8801,  0.9668,
         0.0072,  0.8051,  0.0443,  0.9729,  0.2494,  0.9538,  0.0049,
         0.0513,  0.7194,  0.9527,  0.9697,  0.2238,  0.2158,  0.0438,
         0.7138,  0.9449,  0.1993,  0.3871,  0.0138,  0.9285,  0.0766,
         0.9887,  0.9302,  0.0391,  0.9229,  0.0409,  0.3324,  0.9472,
         0.0225,  0.8720,  0.0764,  0.0009,  0.8787,  0.8030,  0.0274,
         0.8837,  0.9815,  0.7129,  0.0267,  0.0031,  0.0081,  0.8768,
         0.0084,  0.5232,  0.0482,  0.1460,  0.6473,  0.0054,  0.0421,
         0.9834,  0.8766,  0.8586,  0.8305,  0.8747,  0.8941,  0.2198,
         0.4572,  0.1724,  0.0839,  0.9604,  0.7429,  0.0071,  0.9705,
         0.0152,  0.0191,  0.0817,  0.9930,  0.9400,  0.3578,  0.9902,
         0.2052,  0.0966,  0.0048,  0.6447,  0.9992,  0.3513,  0.2898,
         0.3382,  0.0010,  0.9938,  0.6905,  0.2081,  0.8899,  0.3109,
         0.0308,  0.0022,  0.0133,  0.7245,  0.8867,  0.9689,  0.9508,
         0.7363,  0.9460,  0.0167,  0.2341,  0.0037,  0.9032,  0.9057,
         0.8490,  0.9612,  0.0842,  0.0102,  0.8081,  0.2169,  0.0077,
         0.4900,  0.8380,  0.9801,  0.0367,  0.6987,  0.9363,  0.0555,
         0.0294,  0.8834,  0.9851,  0.0446,  0.1101,  0.9505,  0.9463,
         0.6323,  0.0918,  0.9156,  0.9823,  0.9730,  0.7713,  0.1936,
         0.9919,  0.9833,  0.8462,  0.0377,  0.0557,  0.7659,  0.6974,
         0.1550], device='cuda:0')
tensor(0.3118, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0076,  0.9257,  0.0118,  0.5541,  0.5546,  0.7756,  0.0040,
         0.3279,  0.7803,  0.9409,  0.8749,  0.0241,  0.0116,  0.9101,
         0.0118,  0.2804,  0.1940,  0.9514,  0.0172,  0.2958,  0.9794,
         0.4205,  0.1794,  0.0756,  0.9882,  0.9973,  0.9471,  0.4355,
         0.9691,  0.0025,  0.0407,  0.9055,  0.9049,  0.4019,  0.2565,
         0.3572,  0.2489,  0.9418,  0.0556,  0.0635,  0.9279,  0.9683,
         0.2748,  0.4505,  0.0234,  0.0523,  0.4005,  0.0392,  0.5516,
         0.0539,  0.9797,  0.0489,  0.0781,  0.0122,  0.0124,  0.0444,
         0.1631,  0.0476,  0.9991,  0.0339,  0.7639,  0.9980,  0.9865,
         0.9514,  0.4522,  0.0327,  0.0591,  0.8033,  0.0040,  0.8536,
         0.4328,  0.0132,  0.6859,  0.4685,  0.9117,  0.9424,  0.7045,
         0.0239,  0.7970,  0.9872,  0.7092,  0.6310,  0.9555,  0.4227,
         0.0981,  0.0752,  0.5406,  0.7398,  0.4625,  0.9705,  0.0284,
         0.9890,  0.0218,  0.7267,  0.0864,  0.1306,  0.8500,  0.9430,
         0.1573,  0.3320,  0.0934,  0.0158,  0.0131,  0.1075,  0.0412,
         0.9902,  0.9733,  0.0223,  0.9829,  0.9279,  0.9191,  0.8526,
         0.9599,  0.0117,  0.9084,  0.0466,  0.9713,  0.9343,  0.9870,
         0.1928,  0.0682,  0.6628,  0.0089,  0.7660,  0.0706,  0.0609,
         0.9342,  0.9351,  0.0802,  0.0393,  0.0098,  0.9996,  0.0259,
         0.7539,  0.9733,  0.0354,  0.9743,  0.2530,  0.9592,  0.9890,
         0.0810,  0.9331,  0.5193,  0.8688,  0.8201,  0.0364,  0.0596,
         0.2474,  0.9036,  0.0329,  0.7871,  0.3039,  0.8032,  0.9947,
         0.2667,  0.9197,  0.8945,  0.0010,  0.9911,  0.7828,  0.8915,
         0.1070,  0.6314,  0.0522,  0.0056,  0.6620,  0.1215,  0.0117,
         0.5167,  0.9513,  0.1032,  0.0260,  0.2365,  0.6604,  0.3537,
         0.6277,  0.1992,  0.7864,  0.0206,  0.1267,  0.0128,  0.7267,
         0.9984,  0.9410,  0.2286,  0.9045,  0.0832,  0.9525,  0.9512,
         0.7159,  0.1239,  0.4370,  0.0185,  0.2964,  0.0171,  0.0713,
         0.3008,  0.0780,  0.0477,  0.0170,  0.2498,  0.9669,  0.8658,
         0.9989,  0.0797,  0.4100,  0.9330,  0.9246,  0.9401,  0.0748,
         0.9794,  0.8777,  0.8494,  0.2845,  0.0364,  0.9706,  0.8359,
         0.0044,  0.0039,  0.0717,  0.0878,  0.9632,  0.0030,  0.0204,
         0.0523,  0.1999,  0.9944,  0.8294,  0.8633,  0.8818,  0.0057,
         0.7907,  0.0002,  0.0870,  0.9783,  0.5077,  0.9630,  0.8405,
         0.6989,  0.0287,  0.8691,  0.0032,  0.1438,  0.0459,  0.0341,
         0.5794,  0.9965,  0.1874,  0.9144,  0.0044,  0.4590,  0.0412,
         0.6912,  0.2329,  0.0159,  0.9371,  0.6821,  0.9644,  0.9618,
         0.9345,  0.0180,  0.4591,  0.0459,  0.4017,  0.0055,  0.9689,
         0.0057,  0.0107,  0.5120,  0.9744,  0.0259,  0.0897,  0.9508,
         0.0082,  0.9983,  0.0869,  0.5316,  0.0107,  0.9978,  0.0028,
         0.0148,  0.0394,  0.5619,  0.9638,  0.0052,  0.1672,  0.9377,
         0.9072,  0.9486,  0.0348,  0.9259,  0.0098,  0.0841,  0.6175,
         0.3125,  0.0204,  0.0390,  0.0042,  0.8912,  0.9900,  0.0057,
         0.7628,  0.9711,  0.9402,  0.9663,  0.1177,  0.7697,  0.7788,
         0.0877,  0.0233,  0.0058,  0.7119,  0.8682,  0.9231,  0.8974,
         0.3954,  0.8406,  0.9840,  0.9896,  0.9670,  0.0575,  0.9553,
         0.1225,  0.9357,  0.0287,  0.1048,  0.0251,  0.0725,  0.8077,
         0.1198,  0.2481,  0.9615,  0.0007,  0.8716,  0.9332,  0.9992,
         0.9701,  0.0446,  0.2574,  0.0557,  0.9957,  0.1257,  0.0373,
         0.7964,  0.9844,  0.0939,  0.0931,  0.9993,  0.8586,  0.1556,
         0.0066,  0.0329,  0.6662,  0.7979,  0.7123,  0.1261,  0.1881,
         0.1320,  0.6069,  0.8359,  0.0104,  0.9434,  0.1782,  0.8824,
         0.0017,  0.9745,  0.9730,  0.8246,  0.9397,  0.0402,  0.0465,
         0.1461,  0.9021,  0.9274,  0.7078,  0.7162,  0.9831,  0.7065,
         0.0208,  0.8301,  0.6928,  0.0948,  0.3289,  0.8880,  0.0375,
         0.3590,  0.7759,  0.7713,  0.7308,  0.0096,  0.9753,  0.1800,
         0.4779,  0.1278,  0.9904,  0.1506,  0.1021,  0.9365,  0.9211,
         0.1360,  0.9657,  0.0951,  0.0703,  0.9941,  0.8709,  0.7440,
         0.3609,  0.9722,  0.0014,  0.1557,  0.0494,  0.2539,  0.1513,
         0.7624,  0.0171,  0.9143,  0.0457,  0.9618,  0.3097,  0.0990,
         0.1748,  0.4961,  0.9938,  0.8017,  0.8901,  0.9002,  0.9516,
         0.1579,  0.9744,  0.1083,  0.6275,  0.6427,  0.7260,  0.0066,
         0.1893,  0.9258,  0.9400,  0.4277,  0.0683,  0.9680,  0.0123,
         0.1116,  0.6030,  0.9859,  0.9996,  0.3401,  0.9799,  0.5536,
         0.0612,  0.8562,  0.0017,  0.0603,  0.9746,  0.8221,  0.0225,
         0.7455,  0.0479,  0.8827,  0.1637,  0.8979,  0.1166,  0.1351,
         0.9931,  0.0641,  0.8496,  0.0714,  0.0976,  0.3290,  0.7138,
         0.1206,  0.1763,  0.7817,  0.4902,  0.9775,  0.9025,  0.9440,
         0.2452,  0.7149,  0.0650,  0.4287,  0.0830,  0.0878,  0.0199,
         0.9669,  0.1446,  0.0532,  0.0043,  0.6509,  0.2447,  0.0225,
         0.0600,  0.9655,  0.8423,  0.9728,  0.0517,  0.0125,  0.0146,
         0.0744,  0.4801,  0.7935,  0.0611,  0.8347,  0.8151,  0.6820,
         0.3875,  0.0162,  0.1482,  0.0425,  0.3702,  0.9540,  0.8975,
         0.9349], device='cuda:0')
tensor(0.2580, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7320,  0.0583,  0.1429,  0.0697,  0.9937,  0.0877,  0.9467,
         0.9594,  0.9979,  0.5990,  0.0969,  0.9991,  0.9893,  0.0633,
         0.0473,  0.0053,  0.9115,  0.0084,  0.9320,  0.0800,  0.9975,
         0.0782,  0.5671,  0.3284,  0.9974,  0.9228,  0.0420,  0.0124,
         0.9987,  0.1807,  0.8340,  0.4067,  0.7164,  0.7839,  0.4325,
         0.0695,  0.6145,  0.9813,  0.9643,  0.9401,  0.9496,  0.1787,
         0.8289,  0.3940,  0.2837,  0.0261,  0.0054,  0.0354,  0.0049,
         0.0018,  0.0391,  0.9784,  0.7131,  0.8627,  0.0195,  0.1789,
         0.9944,  0.7601,  0.9088,  0.1514,  0.3899,  0.9244,  0.0110,
         0.2560,  0.7722,  0.9424,  0.0496,  0.0144,  0.0048,  0.0023,
         0.2791,  0.0322,  0.7837,  0.5288,  0.0872,  0.2120,  0.4842,
         0.8144,  0.1012,  0.1624,  0.9424,  0.1090,  0.0526,  0.9704,
         0.9952,  0.0789,  0.0878,  0.1160,  0.8477,  0.1479,  0.5459,
         0.5489,  0.2701,  0.0285,  0.9912,  0.9327,  0.0176,  0.0066,
         0.0232,  0.0513,  0.9660,  0.8253,  0.1301,  0.9204,  0.9761,
         0.4503,  0.7494,  0.9910,  0.9709,  0.1538,  0.8152,  0.9896,
         0.0011,  0.9711,  0.2957,  0.3180,  0.3284,  0.6331,  0.5431,
         0.7094,  0.1081,  0.9469,  0.8441,  0.5027,  0.9522,  0.9546,
         0.5673,  0.9677,  0.0012,  0.8243,  0.9046,  0.9281,  0.9106,
         0.8410,  0.8316,  0.9909,  0.7978,  0.2224,  0.0765,  0.9987,
         0.9297,  0.6503,  0.9200,  0.9142,  0.9468,  0.2459,  0.9935,
         0.4243,  0.8428,  0.8844,  0.2758,  0.0198,  0.9916,  0.0833,
         0.9458,  0.9445,  0.0930,  0.9671,  0.8452,  0.8831,  0.1184,
         0.5170,  0.0297,  0.9366,  0.3879,  0.8442,  0.9984,  0.1880,
         0.4454,  0.1136,  0.6452,  0.0755,  0.3531,  0.0077,  0.0060,
         0.9284,  0.8109,  0.9341,  0.9682,  0.9948,  0.0179,  0.7641,
         0.8809,  0.0416,  0.1391,  0.8958,  0.7748,  0.0876,  0.5837,
         0.8583,  0.0021,  0.9976,  0.0051,  0.8777,  0.0006,  0.4115,
         0.0244,  0.8861,  0.1054,  0.0212,  0.1362,  0.0487,  0.6774,
         0.9978,  0.8871,  0.1278,  0.9685,  0.0570,  0.0128,  0.1568,
         0.0909,  0.9948,  0.1403,  0.1462,  0.7708,  0.8137,  0.2630,
         0.8976,  0.2474,  0.8790,  0.6426,  0.8456,  0.9537,  0.0261,
         0.7358,  0.7674,  0.8681,  0.8618,  0.9989,  0.0013,  0.0818,
         0.9437,  0.9670,  0.2844,  0.5988,  0.9479,  0.0035,  0.5672,
         0.0573,  0.8905,  0.6326,  0.0966,  0.9626,  0.1012,  0.9981,
         0.9807,  0.0196,  0.8344,  0.1610,  0.5012,  0.2588,  0.9575,
         0.7689,  0.9878,  0.0170,  0.9941,  0.0173,  0.9508,  0.9721,
         0.9978,  0.9566,  0.4538,  0.0805,  0.0696,  0.8920,  0.1006,
         0.8698,  0.9176,  0.8269,  0.9378,  0.8627,  0.2711,  0.0739,
         0.9875,  0.9315,  0.0748,  0.9899,  0.9624,  0.4883,  0.9694,
         0.8238,  0.0197,  0.0352,  0.7916,  0.1405,  0.9472,  0.9751,
         0.2096,  0.3473,  0.6714,  0.0103,  0.8267,  0.1077,  0.5025,
         0.9023,  0.0753,  0.8787,  0.3286,  0.8727,  0.2287,  0.0066,
         0.0345,  0.7405,  0.1453,  0.3175,  0.9643,  0.1907,  0.7817,
         0.0656,  0.9724,  0.9517,  0.9908,  0.1346,  0.1337,  0.0633,
         0.9458,  0.9601,  0.1350,  0.2371,  0.9924,  0.9764,  0.2652,
         0.9918,  0.9144,  0.8702,  0.7707,  0.4845,  0.7144,  0.9996,
         0.5549,  0.8710,  0.9838,  0.0168,  0.0207,  0.9783,  0.0899,
         0.8722,  0.7156,  0.5619,  0.9632,  0.9763,  0.0898,  0.8777,
         0.0974,  0.9965,  0.7214,  0.8275,  0.9212,  0.7305,  0.0028,
         0.1674,  0.0199,  0.2593,  0.9582,  0.2477,  0.7437,  0.2740,
         0.9036,  0.6897,  0.9111,  0.9618,  0.0750,  0.8235,  0.6217,
         0.7264,  0.7952,  0.1098,  0.9901,  0.9782,  0.0118,  0.9758,
         0.8163,  0.9562,  0.4654,  0.0485,  0.4312,  0.9556,  0.9997,
         0.0226,  0.8947,  0.0710,  0.1096,  0.1012,  0.8702,  0.9978,
         0.1458,  0.9083,  0.0799,  0.0388,  0.5969,  0.5678,  0.9342,
         0.0030,  0.6347,  0.0200,  0.8536,  0.6861,  0.0841,  0.9820,
         0.0069,  0.3748,  0.0849,  0.6907,  0.0765,  0.6338,  0.8698,
         0.0020,  0.7659,  0.0020,  0.4580,  0.9624,  0.9864,  0.9485,
         0.0084,  0.2587,  0.1095,  0.9904,  0.9206,  0.9553,  0.0589,
         0.1016,  0.9280,  0.7797,  0.0813,  0.9745,  0.9993,  0.0276,
         0.8378,  0.9369,  0.8509,  0.1458,  0.8569,  0.9284,  0.1851,
         0.9714,  0.3512,  0.1982,  0.8280,  0.0011,  0.8978,  0.9846,
         0.6755,  0.2421,  0.0206,  0.9446,  0.9779,  0.9335,  0.5879,
         0.6366,  0.9942,  0.9998,  0.3046,  0.9496,  0.1671,  0.9443,
         0.3561,  0.0403,  0.0130,  0.9601,  0.5860,  0.9459,  0.3365,
         0.0669,  0.8310,  0.0832,  0.1744,  0.0035,  0.7546,  0.9181,
         0.9533,  0.0036,  0.2019,  0.3191,  0.0360,  0.1362,  0.1242,
         0.1037,  0.5189,  0.9664,  0.8230,  0.6341,  0.1847,  0.9680,
         0.0568,  0.2310,  0.9444,  0.0983,  0.3609,  0.0049,  0.9436,
         0.9894,  0.4158,  0.0561,  0.0261,  0.1450,  0.0035,  0.0352,
         0.0425,  0.5990,  0.6053,  0.5926,  0.9389,  0.0850,  0.0747,
         0.2360,  0.9721,  0.9728,  0.9510,  0.4185,  0.8388,  0.0168,
         0.0864], device='cuda:0')
tensor(0.3148, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1028,  0.9721,  0.9890,  0.9501,  0.0020,  0.0105,  0.0565,
         0.9720,  0.9168,  0.9667,  0.5979,  0.8802,  0.9701,  0.6363,
         0.7955,  0.0549,  0.8514,  0.6976,  0.0182,  0.7171,  0.9023,
         0.9576,  0.1402,  0.7528,  0.9857,  0.9518,  0.1492,  0.8458,
         0.9703,  0.8704,  0.2378,  0.0046,  0.9648,  0.9146,  0.0893,
         0.0687,  0.0199,  0.1943,  0.0954,  0.9548,  0.0070,  0.0595,
         0.4894,  0.9659,  0.8712,  0.9872,  0.1266,  0.1240,  0.0968,
         0.9443,  0.2089,  0.9995,  0.4975,  0.0105,  0.1311,  0.1405,
         0.9860,  0.7595,  0.1617,  0.1437,  0.9655,  0.9930,  0.2415,
         0.1663,  0.1133,  0.0949,  0.7950,  0.5081,  0.9885,  0.9995,
         0.3812,  0.0109,  0.2411,  0.9991,  0.9172,  0.9596,  0.0537,
         0.0235,  0.2100,  0.1155,  0.0115,  0.9420,  0.9082,  0.1036,
         0.7147,  0.1917,  0.0474,  0.9637,  0.0234,  0.0372,  0.9827,
         0.8799,  0.9940,  0.4950,  0.1710,  0.1055,  0.9108,  0.9279,
         0.5894,  0.3273,  0.0498,  0.6063,  0.8860,  0.7240,  0.9945,
         0.5193,  0.7916,  0.0941,  0.9108,  0.2258,  0.0680,  0.3057,
         0.9342,  0.0320,  0.8525,  0.2654,  0.4392,  0.8786,  0.7820,
         0.1638,  0.7400,  0.8749,  0.0393,  0.8478,  0.9361,  0.1366,
         0.5684,  0.1292,  0.9436,  0.4028,  0.3952,  0.0573,  0.9320,
         0.5046,  0.9634,  0.9018,  0.9157,  0.4289,  0.7552,  0.1469,
         0.9740,  0.9685,  0.9896,  0.6815,  0.9113,  0.0161,  0.0438,
         0.9278,  0.0545,  0.2661,  0.9672,  0.9823,  0.9624,  0.0589,
         0.6004,  0.9745,  0.2708,  0.6329,  0.9396,  0.9497,  0.0645,
         0.0633,  0.2797,  0.9636,  0.0127,  0.9888,  0.1534,  0.8082,
         0.4829,  0.9909,  0.6666,  0.0218,  0.0376,  0.9738,  0.0532,
         0.0936,  0.2116,  0.6873,  0.7972,  0.4364,  0.9221,  0.1534,
         0.2357,  0.9990,  0.6459,  0.7092,  0.3481,  0.5594,  0.9782,
         0.0218,  0.9148,  0.6031,  0.9382,  0.0454,  0.3857,  0.8816,
         0.0155,  0.0068,  0.7868,  0.7398,  0.0396,  0.9728,  0.9450,
         0.6799,  0.8031,  0.9634,  0.0714,  0.0927,  0.0017,  0.0210,
         0.0680,  0.4504,  0.9504,  0.1332,  0.2545,  0.9880,  0.9093,
         0.1225,  0.9372,  0.9721,  0.6664,  0.0323,  0.9534,  0.8622,
         0.4962,  0.9407,  0.1859,  0.2454,  0.0254,  0.9720,  0.0391,
         0.9513,  0.9641,  0.6246,  0.8875,  0.8615,  0.4210,  0.7563,
         0.4436,  0.1477,  0.9185,  0.9258,  0.9921,  0.7263,  0.9643,
         0.9818,  0.0345,  0.4668,  0.1097,  0.9697,  0.9593,  0.3367,
         0.0597,  0.7696,  0.1453,  0.3754,  0.8298,  0.0934,  0.2127,
         0.4624,  0.9786,  0.0284,  0.0224,  0.8285,  0.9120,  0.9735,
         0.9477,  0.8676,  0.9395,  0.1357,  0.0332,  0.0156,  0.8620,
         0.9681,  0.7519,  0.0140,  0.3234,  0.9995,  0.9187,  0.0976,
         0.2119,  0.0561,  0.9682,  0.0138,  0.9483,  0.9664,  0.0677,
         0.3191,  0.9361,  0.1251,  0.9765,  0.8438,  0.1682,  0.0425,
         0.0906,  0.8197,  0.3211,  0.8268,  0.9775,  0.0072,  0.6709,
         0.4365,  0.4029,  0.0520,  0.8240,  0.6626,  0.2421,  0.7952,
         0.9561,  0.6253,  0.5130,  0.8914,  0.7613,  0.8968,  0.9123,
         0.0016,  0.9506,  0.0458,  0.7596,  0.9316,  0.6992,  0.2765,
         0.8577,  0.9679,  0.5940,  0.0896,  0.0275,  0.2408,  0.9487,
         0.9907,  0.9600,  0.6232,  0.0073,  0.9754,  0.0473,  0.9254,
         0.8965,  0.3824,  0.7397,  0.9311,  0.1723,  0.9883,  0.4887,
         0.0031,  0.9753,  0.9840,  0.0388,  0.9118,  0.5928,  0.4942,
         0.9789,  0.1178,  0.9062,  0.8813,  0.9963,  0.9604,  0.1216,
         0.7561,  0.8960,  0.3493,  0.0193,  0.0408,  0.9664,  0.2916,
         0.9203,  0.9309,  0.6787,  0.0075,  0.9885,  0.1457,  0.9818,
         0.8909,  0.4644,  0.9106,  0.0491,  0.0226,  0.1151,  0.9638,
         0.0091,  0.7707,  0.6998,  0.9174,  0.6516,  0.8998,  0.1671,
         0.8488,  0.7767,  0.9872,  0.0744,  0.8328,  0.9440,  0.0402,
         0.0718,  0.8304,  0.5645,  0.4742,  0.9023,  0.1205,  0.2922,
         0.8960,  0.5637,  0.9315,  0.9528,  0.7743,  0.4411,  0.4141,
         0.1394,  0.2890,  0.0983,  0.9560,  0.9662,  0.8063,  0.0110,
         0.3127,  0.1043,  0.1108,  0.8320,  0.9857,  0.0063,  0.0812,
         0.9526,  0.3772,  0.0874,  0.9579,  0.8936,  0.6297,  0.0104,
         0.9691,  0.9671,  0.8828,  0.0459,  0.0243,  0.0304,  0.9711,
         0.9226,  0.9496,  0.9963,  0.3177,  0.2521,  0.7677,  0.0924,
         0.0234,  0.6068,  0.1799,  0.5722,  0.9570,  0.7945,  0.0019,
         0.9714,  0.1185,  0.0133,  0.7469,  0.0037,  0.1011,  0.0416,
         0.0666,  0.9588,  0.3301,  0.0054,  0.6665,  0.0235,  0.6086,
         0.2210,  0.0134,  0.4911,  0.0027,  0.3631,  0.4052,  0.2412,
         0.1562,  0.4074,  0.9074,  0.9606,  0.9932,  0.9560,  0.0211,
         0.9021,  0.9646,  0.4080,  0.0040,  0.1783,  0.8514,  0.9710,
         0.9596,  0.9594,  0.1927,  0.3787,  0.9584,  0.8491,  0.8264,
         0.0390,  0.7914,  0.9872,  0.0038,  0.1104,  0.0989,  0.9244,
         0.9885,  0.6854,  0.0311,  0.9839,  0.0905,  0.9332,  0.9047,
         0.7038,  0.9374,  0.1075,  0.0128,  0.9667,  0.8649,  0.0807,
         0.9497], device='cuda:0')
tensor(0.3380, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9774,  0.4577,  0.8712,  0.0108,  0.0146,  0.7228,  0.8996,
         0.0092,  0.8452,  0.6379,  0.2034,  0.6315,  0.7372,  0.9832,
         0.9131,  0.8449,  0.2497,  0.0822,  0.7384,  0.8901,  0.0009,
         0.0901,  0.8619,  0.9502,  0.8467,  0.9065,  0.0405,  0.6532,
         0.0381,  0.0400,  0.5966,  0.6367,  0.0043,  0.5962,  0.0055,
         0.0066,  0.8806,  0.4938,  0.8259,  0.8348,  0.7927,  0.1723,
         0.2129,  0.9316,  0.9212,  0.0187,  0.9899,  0.0111,  0.9439,
         0.1117,  0.0690,  0.9767,  0.5691,  0.9350,  0.0388,  0.1762,
         0.0135,  0.0204,  0.3885,  0.6162,  0.8941,  0.8687,  0.0028,
         0.9739,  0.9996,  0.8278,  0.7093,  0.0177,  0.0350,  0.9360,
         0.4932,  0.9465,  0.9926,  0.9257,  0.9616,  0.1136,  0.8058,
         0.9536,  0.3921,  0.4999,  0.1322,  0.9170,  0.0579,  0.9973,
         0.0012,  0.2870,  0.9189,  0.0762,  0.3973,  0.0060,  0.9626,
         0.6528,  0.0023,  0.1892,  0.7848,  0.3237,  0.0389,  0.0727,
         0.9595,  0.7149,  0.5001,  0.9822,  0.6042,  0.9748,  0.9989,
         0.3918,  0.9307,  0.9866,  0.9861,  0.0728,  0.6473,  0.0443,
         0.5179,  0.9341,  0.2458,  0.5971,  0.8861,  0.7589,  0.0144,
         0.9839,  0.0012,  0.9579,  0.0176,  0.0246,  0.0661,  0.0030,
         0.0057,  0.9428,  0.9667,  0.0879,  0.8482,  0.0114,  0.9710,
         0.4685,  0.0106,  0.0859,  0.1372,  0.0074,  0.1220,  0.9613,
         0.3143,  0.7378,  0.9896,  0.0274,  0.9894,  0.0818,  0.9585,
         0.9059,  0.0498,  0.0779,  0.9609,  0.0666,  0.8622,  0.8485,
         0.9559,  0.9853,  0.0402,  0.9926,  0.6992,  0.9325,  0.8226,
         0.0753,  0.0288,  0.0773,  0.9974,  0.2539,  0.7852,  0.1304,
         0.9941,  0.0024,  0.8637,  0.0396,  0.8988,  0.0842,  0.0177,
         0.9854,  0.0767,  0.8458,  0.8585,  0.0054,  0.1423,  0.8022,
         0.1532,  0.9628,  0.4916,  0.9681,  0.8137,  0.0112,  0.9655,
         0.8535,  0.9199,  0.9324,  0.2146,  0.4918,  0.3386,  0.0048,
         0.0208,  0.7008,  0.9252,  0.9900,  0.9310,  0.7762,  0.2981,
         0.9905,  0.0347,  0.7928,  0.0330,  0.1287,  0.9908,  0.0164,
         0.9776,  0.8573,  0.5547,  0.0741,  0.0216,  0.0395,  0.9500,
         0.9589,  0.7085,  0.0974,  0.9387,  0.3090,  0.5854,  0.9525,
         0.6109,  0.0356,  0.8744,  0.9420,  0.0856,  0.9573,  0.0122,
         0.6033,  0.9826,  0.9144,  0.1979,  0.0119,  0.9348,  0.9993,
         0.9896,  0.1525,  0.0095,  0.8876,  0.1725,  0.9757,  0.9630,
         0.1624,  0.2505,  0.7660,  0.0047,  0.0120,  0.9487,  0.1177,
         0.3262,  0.1497,  0.7846,  0.0817,  0.9549,  0.6386,  0.9342,
         0.6979,  0.4850,  0.9127,  0.4944,  0.9997,  0.5840,  0.9640,
         0.9877,  0.9444,  0.4286,  0.9937,  0.1355,  0.4022,  0.1889,
         0.9563,  0.0859,  0.8710,  0.9610,  0.0025,  0.9791,  0.5663,
         0.9769,  0.8890,  0.0101,  0.9178,  0.9348,  0.2424,  0.9417,
         0.2614,  0.4416,  0.0096,  0.1143,  0.4515,  0.0603,  0.1132,
         0.9448,  0.5601,  0.8628,  0.0750,  0.9114,  0.9999,  0.7961,
         0.9821,  0.9072,  0.0155,  0.9754,  0.0316,  0.2958,  0.9666,
         0.0116,  0.9344,  0.9759,  0.9357,  0.9821,  0.8241,  0.6639,
         0.9046,  0.9967,  0.8603,  0.8157,  0.6835,  0.8457,  0.9902,
         0.0500,  0.0562,  0.6096,  0.9299,  0.9904,  0.9643,  0.2258,
         0.9558,  0.7502,  0.0224,  0.2111,  0.3207,  0.5741,  0.7175,
         0.7346,  0.0226,  0.9836,  0.9647,  0.0162,  0.0291,  0.9997,
         0.9747,  0.0157,  0.8805,  0.2791,  0.0515,  0.3643,  0.9510,
         0.3041,  0.0688,  0.0154,  0.9686,  0.4966,  0.9675,  0.7760,
         0.7611,  0.5362,  0.5345,  0.6809,  0.9586,  0.1150,  0.2505,
         0.4722,  0.0155,  0.1639,  0.0848,  0.9955,  0.0144,  0.9810,
         0.9955,  0.0268,  0.9455,  0.1097,  0.0902,  0.9787,  0.7147,
         0.7289,  0.1072,  0.1476,  0.9847,  0.9956,  0.9997,  0.9932,
         0.0367,  0.9915,  0.0189,  0.1871,  0.8830,  0.0032,  0.9411,
         0.0139,  0.9611,  0.0185,  0.3822,  0.7212,  0.0121,  0.9923,
         0.9943,  0.1495,  0.6840,  0.0302,  0.9987,  0.6599,  0.9747,
         0.0054,  0.0016,  0.9301,  0.0148,  0.0087,  0.0182,  0.8776,
         0.7818,  0.9806,  0.2427,  0.8693,  0.9439,  0.7928,  0.9230,
         0.2714,  0.3068,  0.9124,  0.0519,  0.3288,  0.9593,  0.6868,
         0.9423,  0.7980,  0.9422,  0.0043,  0.1336,  0.5700,  0.9623,
         0.1336,  0.7765,  0.5808,  0.9823,  0.0542,  0.0898,  0.9802,
         0.1711,  0.9805,  0.9789,  0.0134,  0.3192,  0.7388,  0.0414,
         0.9940,  0.0116,  0.0128,  0.4447,  0.6330,  0.0452,  0.6587,
         0.0386,  0.4298,  0.5194,  0.9610,  0.0018,  0.0376,  0.9994,
         0.1250,  0.2427,  0.7549,  0.9307,  0.9323,  0.0712,  0.9375,
         0.7885,  0.0076,  0.8679,  0.0327,  0.1514,  0.0546,  0.1851,
         0.9329,  0.2707,  0.0218,  0.9678,  0.9801,  0.9607,  0.0474,
         0.1474,  0.9652,  0.9133,  0.0376,  0.0077,  0.0091,  0.7473,
         0.0188,  0.7174,  0.9874,  0.9722,  0.1060,  0.8626,  0.9798,
         0.0562,  0.1045,  0.9571,  0.9914,  0.0512,  0.9884,  0.0148,
         0.9136,  0.9048,  0.0187,  0.0914,  0.9758,  0.9959,  0.8967,
         0.0030], device='cuda:0')
tensor(0.3036, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7870,  0.4329,  0.9960,  0.9991,  0.8222,  0.9916,  0.4626,
         0.9934,  0.9614,  0.8854,  0.1352,  0.2404,  0.2205,  0.8632,
         0.4862,  0.5634,  0.9765,  0.0503,  0.7687,  0.4788,  0.9914,
         0.4355,  0.0009,  0.0035,  0.0637,  0.9916,  0.9629,  0.9281,
         0.7015,  0.2838,  0.8742,  0.2756,  0.8670,  0.3940,  0.9913,
         0.9847,  0.9838,  0.7143,  0.0168,  0.6623,  0.9992,  0.9106,
         0.7619,  0.0860,  0.9919,  0.9649,  0.9918,  0.9234,  0.9269,
         0.0043,  0.4573,  0.4543,  0.3579,  0.9560,  0.9777,  0.5089,
         0.5520,  0.0146,  0.2657,  0.9471,  0.6709,  0.0235,  0.9087,
         0.6376,  0.0158,  0.7918,  0.0122,  0.0238,  0.7288,  0.9512,
         0.0013,  0.0137,  0.0016,  0.9559,  0.1384,  0.4148,  0.1988,
         0.9790,  0.9668,  0.5512,  0.0052,  0.9447,  0.6053,  0.9830,
         0.0426,  0.0430,  0.9798,  0.4991,  0.8276,  0.8127,  0.1203,
         0.4893,  0.8966,  0.2680,  0.0016,  0.3401,  0.0140,  0.8115,
         0.0922,  0.9972,  0.0058,  0.9666,  0.4373,  0.0314,  0.3854,
         0.6899,  0.4465,  0.9818,  0.8522,  0.5341,  0.9075,  0.1293,
         0.1579,  0.9194,  0.0172,  0.6761,  0.9769,  0.2220,  0.8715,
         0.9838,  0.4407,  0.7987,  0.0312,  0.9663,  0.8347,  0.0137,
         0.3615,  0.2355,  0.9925,  0.0712,  0.1140,  0.9867,  0.3470,
         0.0359,  0.4604,  0.9059,  0.0860,  0.9370,  0.9938,  0.9172,
         0.3604,  0.2569,  0.5791,  0.8087,  0.4576,  0.9600,  0.0126,
         0.9659,  0.8441,  0.0584,  0.6713,  0.9792,  0.9978,  0.9893,
         0.0448,  0.6906,  0.3957,  0.9091,  0.9896,  0.2593,  0.0053,
         0.9792,  0.2954,  0.0817,  0.1443,  0.9958,  0.5856,  0.9474,
         0.3123,  0.9804,  0.5346,  0.9690,  0.8131,  0.8445,  0.8960,
         0.8592,  0.0549,  0.0588,  0.9766,  0.6280,  0.0060,  0.9467,
         0.1370,  0.0415,  0.9998,  0.9995,  0.0922,  0.8895,  0.9750,
         0.0119,  0.5341,  0.1428,  0.6299,  0.9250,  0.9450,  0.9497,
         0.9817,  0.5069,  0.9855,  0.9833,  0.0084,  0.8920,  0.9991,
         0.3010,  0.3442,  0.7987,  0.0843,  0.0051,  0.9710,  0.9683,
         0.2772,  0.9997,  0.9922,  0.0360,  0.0958,  0.0454,  0.0045,
         0.3088,  0.5468,  0.8848,  0.9330,  0.0089,  0.0150,  0.0614,
         0.8490,  0.5992,  0.0685,  0.0126,  0.0280,  0.9302,  0.0295,
         0.9516,  0.0345,  0.9817,  0.0582,  0.9404,  0.9479,  0.9613,
         0.4076,  0.0296,  0.0431,  0.8089,  0.9967,  0.1048,  0.9436,
         0.9166,  0.0288,  0.0314,  0.7031,  0.1222,  0.4130,  0.8143,
         0.3393,  0.1120,  0.2051,  0.0668,  0.1239,  0.0077,  0.3034,
         0.0583,  0.9989,  0.1050,  0.2090,  0.8903,  0.1374,  0.0166,
         0.0709,  0.0604,  0.7772,  0.0470,  0.0512,  0.7854,  0.3136,
         0.1342,  0.8697,  0.1636,  0.9925,  0.9725,  0.0267,  0.0199,
         0.5553,  0.6132,  0.9930,  0.0601,  0.0966,  0.0164,  0.6121,
         0.9900,  0.3936,  0.0287,  0.6425,  0.7018,  0.4600,  0.0052,
         0.9883,  0.8025,  0.8490,  0.5399,  0.6628,  0.9529,  0.9482,
         0.1982,  0.5766,  0.0113,  0.8933,  0.0374,  0.0600,  0.9911,
         0.0979,  0.7338,  0.0033,  0.9773,  0.1178,  0.9991,  0.2535,
         0.1950,  0.9794,  0.9499,  0.7307,  0.9478,  0.0381,  0.0206,
         0.1116,  0.9194,  0.6553,  0.0178,  0.6708,  0.4113,  0.3797,
         0.3405,  0.0725,  0.0211,  0.3875,  0.0975,  0.9116,  0.2523,
         0.9714,  0.0319,  0.8588,  0.0819,  0.2571,  0.9745,  0.7060,
         0.9619,  0.9115,  0.1137,  0.9040,  0.4392,  0.9012,  0.6808,
         0.9367,  0.4867,  0.4849,  0.6883,  0.0674,  0.3037,  0.7739,
         0.0408,  0.0092,  0.9953,  0.0057,  0.0097,  0.9125,  0.5350,
         0.9834,  0.9604,  0.0589,  0.5479,  0.8621,  0.9671,  0.0075,
         0.0391,  0.0330,  0.4308,  0.9581,  0.0221,  0.0256,  0.5547,
         0.0869,  0.9304,  0.9492,  0.1097,  0.6517,  0.1324,  0.4754,
         0.0159,  0.7217,  0.9046,  0.0331,  0.9721,  0.7081,  0.0381,
         0.0582,  0.0077,  0.9738,  0.9688,  0.1862,  0.0056,  0.3447,
         0.1010,  0.8537,  0.0041,  0.0597,  0.8081,  0.5839,  0.0130,
         0.9983,  0.9671,  0.6666,  0.0432,  0.0041,  0.6794,  0.9338,
         0.0516,  0.2805,  0.0189,  0.9649,  0.0114,  0.8286,  0.9773,
         0.0099,  0.5954,  0.6976,  0.0881,  0.0049,  0.1207,  0.1780,
         0.9722,  0.7023,  0.9665,  0.2201,  0.3989,  0.8430,  0.8488,
         0.9998,  0.9945,  0.1776,  0.0122,  0.8319,  0.9903,  0.1005,
         0.0268,  0.7649,  0.9996,  0.0207,  0.1903,  0.8779,  0.0332,
         0.9221,  0.8060,  0.0382,  0.1153,  0.0919,  0.9421,  0.0350,
         0.7957,  0.7506,  0.1918,  0.0334,  0.9844,  0.9892,  0.9536,
         0.9028,  0.9949,  0.0174,  0.0083,  0.9730,  0.1194,  0.2405,
         0.9997,  0.8560,  0.6441,  0.0806,  0.6933,  0.9694,  0.9217,
         0.0123,  0.0031,  0.9242,  0.7423,  0.9554,  0.8576,  0.9591,
         0.9456,  0.0453,  0.0362,  0.1797,  0.0120,  0.7089,  0.9854,
         0.0568,  0.3432,  0.9182,  0.0474,  0.1792,  0.0200,  0.0505,
         0.9220,  0.9957,  0.9787,  0.2924,  0.2109,  0.2026,  0.3049,
         0.9810,  0.9767,  0.9589,  0.0137,  0.9758,  0.9719,  0.9906,
         0.6246], device='cuda:0')
tensor(0.2982, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9619,  0.0182,  0.6484,  0.9948,  0.9874,  0.9425,  0.0073,
         0.7457,  0.9541,  0.6891,  0.5108,  0.1938,  0.0761,  0.9620,
         0.0305,  0.0578,  0.1179,  0.3791,  0.0050,  0.7797,  0.8849,
         0.0356,  0.9652,  0.9472,  0.0827,  0.7129,  0.8648,  0.9051,
         0.5546,  0.0407,  0.9826,  0.9736,  0.3003,  0.7868,  0.4634,
         0.5187,  0.5262,  0.9626,  0.9631,  0.3068,  0.0390,  0.1084,
         0.9982,  0.2836,  0.0378,  0.9350,  0.6405,  0.9463,  0.9511,
         0.9271,  0.9997,  0.2737,  0.0289,  0.9781,  0.0028,  0.9266,
         0.0999,  0.3042,  0.0492,  0.0153,  0.8743,  0.0442,  0.6586,
         0.9031,  0.2714,  0.0304,  0.7976,  0.9669,  0.7837,  0.1570,
         0.9494,  0.9746,  0.0435,  0.0448,  0.0218,  0.6887,  0.1274,
         0.8502,  0.5591,  0.9707,  0.1807,  0.6231,  0.9996,  0.0110,
         0.5300,  0.9981,  0.7309,  0.0151,  0.9283,  0.0635,  0.1029,
         0.0444,  0.1208,  0.6182,  0.9976,  0.0073,  0.5155,  0.6792,
         0.0347,  0.0794,  0.0406,  0.5200,  0.0176,  0.9975,  0.3237,
         0.9723,  0.0351,  0.4211,  0.4246,  0.8976,  0.0623,  0.9681,
         0.0290,  0.9663,  0.0300,  0.9981,  0.0329,  0.7806,  0.0045,
         0.9355,  0.9220,  0.9089,  0.0343,  0.8619,  0.2896,  0.7674,
         0.1880,  0.5422,  0.0734,  0.0108,  0.9734,  0.3358,  0.6384,
         0.0213,  0.9946,  0.6025,  0.9351,  0.0636,  0.9382,  0.9798,
         0.9566,  0.8198,  0.9893,  0.9987,  0.9360,  0.1801,  0.3043,
         0.0525,  0.1290,  0.9601,  0.0222,  0.8679,  0.8342,  0.0558,
         0.3596,  0.9941,  0.9762,  0.0620,  0.0182,  0.9708,  0.8907,
         0.8288,  0.6313,  0.9708,  0.0423,  0.0024,  0.0113,  0.2383,
         0.3412,  0.9804,  0.9718,  0.9613,  0.0685,  0.9565,  0.9462,
         0.9432,  0.0275,  0.0709,  0.8072,  0.9039,  0.9921,  0.8127,
         0.0082,  0.9846,  0.3574,  0.0994,  0.3235,  0.0658,  0.0671,
         0.2743,  0.9933,  0.0134,  0.4001,  0.3755,  0.0366,  0.0312,
         0.2271,  0.9650,  0.9916,  0.9169,  0.0025,  0.9680,  0.9634,
         0.1615,  0.0637,  0.9209,  0.6263,  0.0377,  0.2311,  0.9742,
         0.3602,  0.0936,  0.9791,  0.6256,  0.2839,  0.8608,  0.2832,
         0.9734,  0.9162,  0.7568,  0.2087,  0.8679,  0.8824,  0.3470,
         0.0929,  0.9785,  0.9174,  0.8632,  0.8964,  0.3957,  0.0484,
         0.3891,  0.9915,  0.7621,  0.8816,  0.4368,  0.8783,  0.1446,
         0.9754,  0.1326,  0.9305,  0.0766,  0.3047,  0.7929,  0.7968,
         0.9669,  0.9851,  0.9871,  0.8386,  0.0041,  0.5317,  0.9161,
         0.6033,  0.3771,  0.9885,  0.9953,  0.9856,  0.0133,  0.9413,
         0.0389,  0.9989,  0.0856,  0.9405,  0.9999,  0.1293,  0.9839,
         0.9248,  0.9015,  0.9948,  0.0656,  0.2594,  0.4960,  0.1456,
         0.0507,  0.0066,  0.9717,  0.8744,  0.9933,  0.9117,  0.9155,
         0.1053,  0.8816,  0.8146,  0.0994,  0.6275,  0.5225,  0.0268,
         0.0220,  0.0885,  0.6418,  0.0174,  0.1652,  0.3356,  0.8809,
         0.0476,  0.8818,  0.8672,  0.7460,  0.7409,  0.9681,  0.1226,
         0.0062,  0.9679,  0.9980,  0.1940,  0.2523,  0.9351,  0.7198,
         0.4341,  0.6380,  0.8727,  0.9580,  0.8975,  0.9303,  0.0311,
         0.0534,  0.1173,  0.5550,  0.8861,  0.9962,  0.9466,  0.8921,
         0.9489,  0.9153,  0.8886,  0.7690,  0.5824,  0.0105,  0.9281,
         0.9457,  0.9741,  0.0083,  0.0149,  0.9558,  0.3922,  0.0987,
         0.9943,  0.9810,  0.6555,  0.0098,  0.2078,  0.0041,  0.8209,
         0.9492,  0.9822,  0.3058,  0.9177,  0.4523,  0.1085,  0.0444,
         0.9867,  0.5331,  0.2832,  0.9645,  0.0019,  0.9340,  0.8731,
         0.1171,  0.8317,  0.1484,  0.9507,  0.0036,  0.8778,  0.1358,
         0.8830,  0.9236,  0.9976,  0.1663,  0.9883,  0.9021,  0.9082,
         0.8292,  0.4063,  0.1183,  0.0478,  0.0932,  0.9520,  0.6747,
         0.9940,  0.1052,  0.0052,  0.2185,  0.0699,  0.9948,  0.2508,
         0.0121,  0.4039,  0.3158,  0.9426,  0.9762,  0.9934,  0.8972,
         0.8746,  0.9706,  0.0499,  0.2013,  0.1886,  0.8896,  0.1141,
         0.1975,  0.9007,  0.0022,  0.9231,  0.2020,  0.7661,  0.2549,
         0.0229,  0.9839,  0.9943,  0.0650,  0.9806,  0.8682,  0.9473,
         0.9429,  0.5719,  0.9866,  0.4040,  0.5859,  0.0164,  0.9878,
         0.9315,  0.7707,  0.0790,  0.4157,  0.0784,  0.9674,  0.0051,
         0.9922,  0.1925,  0.9927,  0.0068,  0.4345,  0.9573,  0.1020,
         0.5225,  0.0539,  0.9754,  0.9920,  0.1867,  0.0197,  0.8487,
         0.8684,  0.9004,  0.5709,  0.0077,  0.1171,  0.0020,  0.9709,
         0.0564,  0.7418,  0.0691,  0.0520,  0.6936,  0.2742,  0.1523,
         0.9940,  0.0013,  0.9060,  0.0689,  0.9489,  0.9252,  0.9989,
         0.9194,  0.7021,  0.0161,  0.2768,  0.0339,  0.1300,  0.0145,
         0.1778,  0.2229,  0.0324,  0.5945,  0.0240,  0.9708,  0.9854,
         0.0019,  0.1395,  0.9296,  0.9925,  0.9473,  0.7031,  0.9575,
         0.9961,  0.6830,  0.2535,  0.9361,  0.8877,  0.0167,  0.8309,
         0.1076,  0.0436,  0.9834,  0.6629,  0.0255,  0.9989,  0.2038,
         0.9760,  0.0060,  0.0362,  0.1079,  0.0115,  0.9773,  0.0479,
         0.9082,  0.9961,  0.9708,  0.8733,  0.1818,  0.9362,  0.5459,
         0.0599], device='cuda:0')
tensor(0.3712, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8290,  0.5059,  0.9222,  0.9244,  0.1493,  0.3030,  0.6961,
         0.1925,  0.7059,  0.9733,  0.1027,  0.9483,  0.6633,  0.0313,
         0.9191,  0.0161,  0.1591,  0.6553,  0.9903,  0.0102,  0.9859,
         0.0219,  0.9303,  0.0323,  0.0306,  0.8512,  0.9900,  0.0272,
         0.9999,  0.9363,  0.0102,  0.8983,  0.3246,  0.1421,  0.9598,
         0.9922,  0.9871,  0.0043,  0.6406,  0.9886,  0.9358,  0.0766,
         0.1076,  0.9567,  0.9809,  0.9314,  0.8841,  0.8774,  0.0688,
         0.9953,  0.9593,  0.0239,  0.4978,  0.9599,  0.0850,  0.8997,
         0.8161,  0.2285,  0.0272,  0.1504,  0.0098,  0.9379,  0.0079,
         0.0840,  0.0416,  0.0103,  0.7553,  0.9992,  0.5882,  0.9552,
         0.9999,  0.1025,  0.4600,  0.0012,  0.9915,  0.1630,  0.9666,
         0.0409,  0.1830,  0.8835,  0.5652,  0.0477,  0.9782,  0.0006,
         0.8674,  1.0000,  0.0655,  0.9995,  0.6167,  0.0030,  0.1190,
         0.0329,  0.8604,  0.0265,  0.9759,  0.0779,  0.9504,  0.2357,
         0.9908,  0.9893,  0.6173,  0.0193,  0.4024,  0.0111,  0.0269,
         0.6244,  0.3353,  0.2990,  0.1492,  0.2986,  0.4321,  0.1077,
         0.9760,  0.8701,  0.0047,  0.9772,  0.2477,  0.2225,  0.9756,
         0.1679,  0.9988,  0.0580,  0.9943,  0.9377,  0.0613,  0.7292,
         0.0594,  0.0531,  0.6597,  0.0569,  0.9777,  0.9393,  0.0544,
         0.1609,  0.9131,  0.9598,  0.9730,  0.6960,  0.0739,  0.9803,
         0.9994,  0.7434,  0.0675,  0.0987,  0.8574,  0.1669,  0.2189,
         0.9664,  0.0230,  0.9824,  0.0081,  0.5949,  0.9786,  0.5125,
         0.0444,  0.0100,  0.0193,  0.8035,  0.6891,  0.4848,  0.1899,
         0.1973,  0.8590,  0.8736,  0.1693,  0.1813,  0.9679,  0.0373,
         0.6992,  0.1506,  0.1994,  0.0998,  0.8815,  0.8725,  0.4147,
         0.5337,  0.9856,  0.9673,  0.6226,  0.2038,  0.8687,  0.1205,
         0.1868,  0.0275,  0.8155,  0.5086,  0.0694,  0.0120,  0.0635,
         0.0225,  0.4663,  0.1335,  0.1669,  0.0148,  0.9772,  0.0159,
         0.8917,  0.8258,  0.0614,  0.4275,  0.3374,  0.0244,  0.0537,
         0.1887,  0.0866,  0.9998,  0.5319,  0.9427,  0.9853,  0.9145,
         0.0190,  0.9423,  0.2744,  0.0703,  0.0282,  0.0008,  0.8193,
         0.0544,  0.1946,  0.9861,  0.2754,  0.3161,  0.9712,  0.0504,
         0.0020,  0.9230,  0.0349,  0.9745,  0.1083,  0.9496,  0.9301,
         0.0683,  0.9713,  0.9814,  0.9333,  0.6513,  0.6945,  0.9469,
         0.0940,  0.3825,  0.9958,  0.2069,  0.9429,  0.9336,  0.1354,
         0.8491,  0.0075,  0.7203,  0.0149,  0.6905,  0.3829,  0.5090,
         0.1496,  0.8489,  0.1818,  0.9394,  0.5739,  0.0551,  0.1629,
         0.1778,  0.8171,  0.7845,  0.4089,  0.0323,  0.9801,  0.9939,
         0.8040,  0.8516,  0.9861,  0.0214,  0.2808,  0.0106,  0.0003,
         0.9958,  0.9872,  0.9584,  0.1738,  0.1549,  0.7040,  0.0436,
         0.0040,  0.4086,  0.1081,  0.5751,  0.0599,  0.8025,  0.5251,
         0.1593,  0.2017,  0.7845,  0.9325,  0.0085,  0.3112,  0.0050,
         0.9199,  0.0438,  0.4962,  0.2115,  0.7816,  0.8369,  0.6401,
         0.2194,  0.0658,  0.3027,  0.9189,  0.0084,  0.0035,  0.9598,
         0.0334,  0.0330,  0.2347,  0.1631,  0.8197,  0.0899,  0.9744,
         0.9881,  0.1173,  0.7161,  0.8788,  0.7390,  0.0231,  0.9971,
         0.1539,  0.9876,  0.6465,  0.9811,  0.8855,  0.8305,  0.9993,
         0.9984,  0.2930,  0.5255,  0.9509,  0.9746,  0.7542,  0.0730,
         0.0328,  0.7311,  0.9378,  0.0060,  0.0044,  0.2200,  0.9653,
         0.0435,  0.0248,  0.0047,  0.2932,  0.8698,  0.9738,  0.0085,
         0.3494,  0.9334,  0.6778,  0.0497,  0.0700,  0.0035,  0.9618,
         0.0399,  0.4262,  0.4408,  0.1250,  0.0146,  0.9656,  0.1833,
         0.6343,  0.1413,  0.8322,  0.6745,  0.9729,  0.0161,  0.0024,
         0.0068,  0.7314,  0.0819,  0.3417,  0.2389,  0.5206,  0.9705,
         0.3298,  0.0168,  0.9847,  0.1486,  0.9152,  0.0862,  0.9112,
         0.0161,  0.0442,  0.9397,  0.1110,  0.4378,  0.0312,  0.0074,
         0.1227,  0.8759,  0.8020,  0.9558,  0.1712,  0.8902,  0.9670,
         0.9339,  0.8487,  0.0911,  0.7156,  0.8768,  0.0254,  0.9979,
         0.8946,  0.0088,  0.8889,  0.0091,  0.6516,  0.9833,  0.2313,
         0.0831,  0.9845,  0.9662,  0.5618,  0.0629,  0.0868,  0.3327,
         0.5454,  0.7118,  0.2078,  0.9949,  0.1080,  0.0013,  0.5426,
         0.0130,  0.8423,  0.7608,  0.3876,  0.6413,  0.5812,  0.9680,
         0.9996,  0.0480,  0.9468,  0.1015,  0.0145,  0.1396,  0.0414,
         0.0151,  0.0142,  0.1174,  0.9885,  0.9477,  0.0572,  0.0103,
         0.0324,  0.4198,  0.9434,  0.0584,  0.0086,  0.0181,  0.9452,
         0.0183,  0.3353,  0.5624,  0.0378,  0.0398,  0.0387,  0.3088,
         0.8409,  0.0036,  0.9195,  0.0229,  0.4596,  0.0580,  0.0191,
         0.8834,  0.9965,  0.7055,  0.6179,  0.0275,  0.0059,  0.0101,
         0.9197,  0.9829,  0.0641,  0.9215,  0.0215,  0.5479,  0.0158,
         0.2562,  0.0188,  0.2532,  0.9478,  0.0441,  0.7182,  0.0331,
         0.1417,  0.9997,  0.1431,  0.9584,  0.0049,  0.9059,  0.2311,
         0.3467,  0.9839,  0.9108,  0.9724,  0.0957,  0.0032,  0.1080,
         0.9642,  0.0162,  0.4804,  0.9247,  0.2829,  0.8422,  0.5950,
         0.1125], device='cuda:0')
tensor(0.2637, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9339,  0.0744,  0.9956,  0.9115,  0.0150,  0.8170,  0.9412,
         0.5123,  0.9986,  0.0055,  0.8364,  0.0026,  0.2759,  0.9037,
         0.0233,  0.8976,  0.8900,  0.1893,  0.0386,  0.8391,  0.0218,
         0.9694,  0.7607,  0.0320,  0.5521,  0.1844,  0.0094,  0.9726,
         0.1387,  0.4693,  0.1968,  0.9829,  0.0082,  0.9806,  0.9934,
         0.2303,  0.0294,  0.9994,  0.0086,  0.0106,  0.0048,  0.2909,
         0.9634,  0.0672,  0.0004,  0.9996,  0.9346,  0.6696,  0.9664,
         0.9318,  0.6788,  0.1209,  0.3875,  0.1475,  0.0627,  0.4454,
         0.9113,  0.0819,  0.1067,  0.0354,  0.9493,  0.0495,  0.6132,
         0.6915,  0.0266,  0.0157,  0.9550,  0.0083,  0.0139,  0.9632,
         0.9779,  0.7427,  0.9510,  0.9738,  0.2880,  0.0337,  0.0199,
         0.0084,  0.3150,  0.0253,  0.9932,  0.0139,  0.9224,  0.0378,
         0.0035,  0.1183,  0.0077,  0.7926,  0.0071,  0.9387,  0.3319,
         0.0619,  0.9341,  0.8526,  0.9276,  0.0520,  0.0608,  0.4640,
         0.0202,  0.9037,  0.0132,  0.1436,  0.5222,  0.0041,  0.9876,
         0.2153,  0.1313,  0.0354,  0.6088,  0.8434,  0.2337,  0.2906,
         0.1147,  0.0036,  0.2758,  0.7534,  0.9572,  0.1031,  0.8208,
         0.3208,  0.6299,  0.9891,  0.9913,  0.0336,  0.0360,  0.2029,
         0.7161,  0.0018,  0.0206,  0.0181,  0.0966,  0.8845,  0.0658,
         0.7478,  0.8758,  0.8942,  0.3180,  0.0139,  0.9345,  0.5962,
         0.5875,  0.8014,  0.7025,  0.0373,  0.8596,  0.1592,  0.9148,
         0.9926,  0.9439,  0.9720,  0.4767,  0.7712,  0.3002,  0.6302,
         0.0249,  0.0299,  0.3414,  0.2948,  0.0303,  0.1460,  0.1662,
         0.4433,  0.9832,  0.0502,  0.0054,  0.9678,  0.8126,  0.1313,
         0.9361,  0.4923,  0.0089,  0.2898,  0.0980,  0.8680,  0.5604,
         0.9427,  0.3357,  0.0054,  0.4943,  0.1636,  0.4759,  0.3771,
         0.0004,  0.9575,  0.6730,  0.6219,  0.9179,  0.0036,  0.2655,
         0.9897,  0.0474,  0.0194,  0.2798,  0.1939,  0.0340,  0.0530,
         0.0549,  0.6584,  0.0541,  0.0442,  0.0327,  0.9982,  0.0949,
         0.2936,  0.3632,  0.2677,  0.4384,  0.0506,  0.6742,  0.8865,
         0.4454,  0.0928,  0.0525,  0.9857,  0.8598,  0.6665,  0.0111,
         0.8716,  0.8519,  0.4459,  0.0185,  0.0015,  0.8947,  0.0332,
         0.4448,  0.3301,  0.5265,  0.0666,  0.4051,  0.0126,  0.8323,
         0.3682,  0.9808,  0.8257,  0.0115,  0.0926,  0.6468,  0.9895,
         0.9838,  0.9629,  0.0250,  0.3138,  0.6150,  0.9281,  0.1425,
         0.0274,  0.0115,  0.0264,  0.9999,  0.0428,  0.0332,  0.9093,
         0.4643,  0.8747,  0.0082,  0.1367,  0.1376,  0.8495,  0.0199,
         0.1908,  0.9350,  0.0595,  0.8534,  0.9176,  0.0019,  0.9497,
         0.0611,  0.1102,  0.4425,  0.0030,  0.9673,  0.9472,  0.6735,
         0.3136,  0.0358,  0.9876,  0.2974,  0.4256,  0.0961,  0.0051,
         0.0399,  0.9868,  0.9407,  0.8321,  0.6945,  0.1164,  0.9003,
         0.9469,  0.4419,  0.8645,  0.0202,  0.0860,  0.0482,  0.4400,
         0.9564,  0.0052,  0.0101,  0.4806,  0.5151,  0.0126,  0.9450,
         0.0340,  0.1493,  0.0189,  0.0243,  0.7144,  0.0519,  0.9662,
         0.0150,  0.1072,  0.0308,  0.6515,  0.8694,  0.0647,  0.1864,
         0.6724,  0.0229,  0.0543,  0.9584,  0.2086,  0.8538,  0.0277,
         0.0109,  0.9777,  0.0217,  0.0449,  0.9471,  0.8985,  0.0016,
         0.9289,  0.0015,  0.9871,  0.0099,  0.0432,  0.1056,  0.3742,
         0.6263,  0.8282,  0.9189,  0.1556,  0.8140,  0.1386,  0.9062,
         0.9411,  0.0315,  0.9895,  0.9151,  0.7909,  0.0804,  0.0492,
         0.0426,  0.0529,  0.9544,  0.1253,  0.4186,  0.0732,  0.0394,
         0.5024,  0.9885,  0.7007,  0.2463,  0.0030,  0.1180,  0.0865,
         0.8294,  0.0015,  0.0099,  0.8318,  0.0081,  0.7036,  0.9083,
         0.1004,  0.4374,  0.5419,  0.9951,  0.0040,  0.6357,  0.9637,
         0.0333,  0.0227,  0.0064,  0.9439,  0.8150,  0.0011,  0.0041,
         0.9218,  0.1603,  0.0122,  0.2171,  0.0060,  0.4324,  0.7504,
         0.9829,  0.0035,  0.2915,  0.5284,  0.9827,  0.8497,  0.0359,
         0.0126,  0.9642,  0.0078,  0.6975,  0.0669,  0.9827,  0.9867,
         0.7968,  0.9795,  0.4957,  0.9798,  0.0169,  0.0103,  0.0598,
         0.0236,  0.7992,  0.8286,  0.7576,  0.0037,  0.8420,  0.0195,
         0.9816,  0.9098,  0.0055,  0.0031,  0.9913,  0.0057,  0.9747,
         0.0475,  0.0976,  0.4334,  0.9417,  0.9516,  0.9900,  0.1289,
         0.9639,  0.6928,  0.1063,  0.9961,  0.7472,  0.2770,  0.9261,
         0.0199,  0.0363,  0.0102,  0.0166,  0.1045,  0.9154,  0.7870,
         0.9170,  0.4904,  0.9783,  0.6999,  0.9172,  0.8804,  0.8973,
         0.6379,  0.1860,  0.5327,  0.0357,  0.0108,  0.9813,  0.9644,
         0.6945,  0.5204,  0.9457,  0.2069,  0.9974,  0.2976,  0.9468,
         0.0438,  0.8927,  0.4782,  0.0075,  0.0399,  0.0086,  0.0134,
         0.9037,  0.9984,  0.0039,  0.9877,  0.1505,  0.9748,  0.6904,
         0.9893,  0.0220,  0.0270,  0.0231,  0.6345,  0.0155,  0.0655,
         0.9998,  0.1000,  0.9532,  0.0204,  0.0257,  0.8438,  0.1101,
         0.2306,  0.9380,  0.0785,  0.8704,  0.8893,  0.0488,  0.9654,
         0.7929,  0.9540,  0.0227,  0.9423,  0.0386,  0.9332,  0.8626,
         0.7630], device='cuda:0')
tensor(0.2923, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3880,  0.9445,  0.9658,  0.0120,  0.0138,  0.0909,  0.0053,
         0.9889,  0.0449,  0.0313,  0.9683,  0.9703,  0.9953,  0.9477,
         0.0059,  0.9849,  0.9131,  0.0346,  0.4542,  0.1276,  0.3860,
         0.7307,  0.0178,  0.0420,  0.0123,  0.9916,  0.5558,  0.2992,
         0.9050,  0.5388,  0.6736,  0.5389,  0.9988,  0.0014,  0.5718,
         0.9950,  0.0016,  0.9045,  0.0413,  0.8581,  0.1110,  0.0674,
         0.0074,  0.8781,  0.0641,  0.0481,  0.0177,  0.0091,  0.0199,
         0.0586,  0.0017,  0.0844,  0.0755,  0.3622,  0.8928,  0.6753,
         0.8085,  0.8220,  0.9643,  0.5892,  0.9483,  0.7992,  0.3380,
         0.8571,  0.0695,  0.9011,  0.0053,  0.1129,  0.6614,  0.9962,
         0.1059,  0.1131,  0.2835,  0.0049,  0.0327,  0.7338,  0.8938,
         0.0116,  0.0258,  0.9618,  0.6736,  0.5317,  0.9846,  0.3484,
         0.1201,  0.9575,  0.0388,  0.5210,  0.0091,  0.9462,  0.0047,
         0.9307,  0.6602,  0.0075,  0.1678,  0.0022,  0.2199,  0.3805,
         0.8033,  0.9548,  0.9653,  0.0181,  0.0088,  0.5814,  0.0555,
         0.8467,  0.0151,  0.9723,  0.0432,  0.0714,  0.9672,  0.3227,
         0.1431,  0.8024,  0.0063,  0.9108,  0.0104,  0.4778,  0.9712,
         0.9847,  0.6945,  0.8523,  0.0078,  0.8425,  0.9228,  0.0055,
         0.6943,  0.9204,  0.9790,  0.8701,  0.2302,  0.0412,  0.0474,
         0.9777,  0.8938,  0.5463,  0.9809,  0.0125,  0.1241,  0.5605,
         0.0157,  0.6632,  0.8452,  0.0006,  0.9860,  0.0188,  0.8614,
         0.0824,  0.1299,  0.0428,  0.0676,  0.0009,  0.0104,  0.0421,
         0.6807,  0.9708,  0.7376,  0.1484,  0.7638,  0.9279,  0.0538,
         0.0567,  0.5051,  0.4749,  0.5467,  0.8358,  0.1297,  0.1649,
         0.0921,  0.0109,  0.2075,  0.0009,  0.8916,  0.8035,  0.0651,
         0.3181,  0.1496,  0.6756,  0.1385,  0.0032,  0.0424,  0.0665,
         0.0006,  0.0032,  0.0050,  0.0077,  0.0117,  0.0185,  0.6037,
         0.0061,  0.4738,  0.3731,  0.0276,  0.9470,  0.9340,  0.9057,
         0.0285,  0.0041,  0.1436,  0.0195,  0.0278,  0.7842,  0.9713,
         0.0287,  0.0229,  0.9755,  0.0136,  0.4969,  0.0140,  0.0093,
         0.0599,  0.0361,  0.0698,  0.0401,  0.0444,  0.0102,  0.8141,
         0.2788,  0.9672,  0.0269,  0.0245,  0.0607,  0.6444,  0.9571,
         0.1763,  0.9728,  0.0601,  0.9466,  0.0715,  0.7259,  0.8505,
         0.9085,  0.0097,  0.9752,  0.0719,  0.0343,  0.0399,  0.0432,
         0.0265,  0.0769,  0.0411,  0.0996,  0.2199,  0.1827,  0.9035,
         0.0051,  0.0107,  0.4705,  0.0037,  0.0210,  0.6670,  0.9277,
         0.9554,  0.9505,  0.9713,  0.1312,  0.9087,  0.0064,  0.4045,
         0.0264,  0.0053,  0.8971,  0.7636,  0.0261,  0.9444,  0.8123,
         0.0038,  0.2518,  0.0351,  0.0021,  0.0561,  0.9168,  0.0111,
         0.0301,  0.8583,  0.0149,  0.0027,  0.2212,  0.0954,  0.0832,
         0.3327,  0.0307,  0.9314,  0.0195,  0.8756,  0.0369,  0.0595,
         0.9339,  0.3506,  0.4717,  0.0054,  0.1619,  0.8410,  0.9619,
         0.9112,  0.0066,  0.3394,  0.6678,  0.8580,  0.0084,  0.1413,
         0.0722,  0.1110,  0.0397,  0.2336,  0.0226,  0.0200,  0.0039,
         0.9427,  0.0399,  0.0554,  0.2965,  0.0050,  0.3103,  0.1107,
         0.0034,  0.0020,  0.2727,  0.0786,  0.0237,  0.9396,  0.4911,
         0.1089,  0.9148,  0.0705,  0.2562,  0.1114,  0.9697,  0.0041,
         0.0690,  0.0091,  0.0045,  0.8177,  0.9854,  0.6105,  0.9530,
         0.0143,  0.0175,  0.8192,  0.0087,  0.2281,  0.7692,  0.1158,
         0.0548,  0.3518,  0.5574,  0.0348,  0.7021,  0.0227,  0.0049,
         0.3900,  0.6127,  0.9317,  0.9723,  0.9786,  0.7146,  0.9303,
         0.0211,  0.9336,  0.9992,  0.0914,  0.6769,  0.0007,  0.0560,
         0.1543,  0.0013,  0.0035,  0.9293,  0.9736,  0.5032,  0.8985,
         0.8487,  0.4729,  0.0209,  0.7035,  0.9078,  0.3479,  0.9975,
         0.0053,  0.0322,  0.9278,  0.9640,  0.8986,  0.9321,  0.0013,
         0.0032,  0.1046,  0.8395,  0.0424,  0.9089,  0.0556,  0.9629,
         0.0921,  0.0103,  0.0108,  0.9852,  0.9065,  0.3204,  0.9494,
         0.0108,  0.8750,  0.0055,  0.0358,  0.2329,  0.3309,  0.8981,
         0.3821,  0.6583,  0.0780,  0.6101,  0.1612,  0.9122,  0.9556,
         0.8964,  0.8934,  0.3143,  0.7619,  0.9823,  0.0160,  0.9972,
         0.0106,  0.0428,  0.6900,  0.6773,  0.1787,  0.9462,  0.8879,
         0.0065,  0.0147,  0.8998,  0.5306,  0.0218,  0.0051,  0.5398,
         0.0652,  0.0498,  0.0103,  0.9059,  0.0662,  0.9105,  0.0019,
         0.0754,  0.0349,  0.0201,  0.5400,  0.9872,  0.8757,  0.7871,
         0.9565,  0.1175,  0.8439,  0.1524,  0.0375,  0.0020,  0.2365,
         0.0246,  0.0596,  0.7825,  0.0534,  0.4258,  0.7978,  0.0838,
         0.0392,  0.8919,  0.0099,  0.0165,  0.9665,  0.6022,  0.0359,
         0.0850,  0.0655,  0.9778,  0.0062,  0.0333,  0.2413,  0.0019,
         0.6150,  0.7910,  0.0028,  0.1192,  0.0060,  0.0044,  0.0719,
         0.0669,  0.0211,  0.0284,  0.7779,  0.0381,  0.1367,  0.0036,
         0.0097,  0.2081,  0.8531,  0.9089,  0.9833,  0.2148,  0.9330,
         0.9806,  0.9438,  0.0183,  0.9999,  0.0197,  0.0633,  0.9934,
         0.0749,  0.6642,  0.0022,  0.8258,  0.5858,  0.4333,  0.1702,
         0.0429], device='cuda:0')
tensor(0.3703, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9670,  0.4851,  0.0710,  0.9223,  0.0005,  0.8539,  0.9630,
         0.1922,  0.1627,  0.0423,  0.1183,  0.1808,  0.5065,  0.0179,
         0.3934,  0.8720,  0.0517,  0.0520,  0.9502,  0.2772,  0.9252,
         0.1018,  0.0352,  0.9054,  0.0100,  0.7088,  0.0303,  0.0787,
         0.9565,  0.8365,  0.3380,  0.0074,  0.4306,  0.6066,  0.8784,
         0.6879,  0.0305,  0.3386,  0.0335,  0.2951,  0.8721,  0.5647,
         0.5372,  0.9797,  0.0347,  0.0744,  0.8498,  0.0760,  0.0450,
         0.0662,  0.0152,  0.5686,  0.4410,  0.0655,  0.8625,  0.9235,
         0.9510,  0.5965,  0.0738,  0.3510,  0.0081,  0.9531,  0.0313,
         0.9890,  0.0332,  0.7615,  0.0081,  0.9754,  0.3421,  0.9387,
         0.4348,  0.4800,  0.0226,  0.0028,  0.8598,  0.0988,  0.0062,
         0.9824,  0.0315,  0.7807,  0.6828,  0.9622,  0.8557,  0.1935,
         0.3217,  0.9731,  0.9557,  0.9505,  0.0009,  0.3289,  0.9906,
         0.9772,  0.7834,  0.0429,  0.1246,  0.7842,  0.9606,  0.4568,
         0.9890,  0.8946,  0.0369,  0.6047,  0.6742,  0.0548,  0.6077,
         0.0071,  0.5592,  0.0075,  0.0378,  0.5261,  0.0099,  0.9519,
         0.3942,  0.0704,  0.0032,  0.7548,  0.7774,  0.0220,  0.8921,
         0.8095,  0.7894,  0.8037,  0.9605,  0.0397,  0.0132,  0.9567,
         0.0047,  0.3476,  0.9058,  0.8846,  0.0076,  0.7270,  0.7288,
         0.0625,  0.6821,  0.3870,  0.0241,  0.0177,  0.0088,  0.9385,
         0.9233,  0.0362,  0.0160,  0.7679,  0.0479,  0.0342,  0.0471,
         0.0141,  0.0383,  0.0050,  0.9752,  0.0235,  0.0069,  0.2818,
         0.9991,  0.0242,  0.1110,  0.0106,  0.0185,  0.5145,  0.2663,
         0.1146,  0.0016,  0.6855,  0.2061,  0.8122,  0.0642,  0.9774,
         0.0417,  0.0635,  0.9855,  0.0109,  0.0079,  0.0059,  0.7960,
         0.0080,  0.0133,  0.2560,  0.9443,  0.9681,  0.1222,  0.8742,
         0.9728,  0.1628,  0.0924,  0.8801,  0.6525,  0.1485,  0.3606,
         0.7628,  0.9257,  0.9838,  0.7211,  0.5784,  0.7763,  0.0058,
         0.2945,  0.9475,  0.5987,  0.0237,  0.0524,  0.9265,  0.9968,
         0.1790,  0.8618,  0.2298,  0.9382,  0.0800,  0.8331,  0.9937,
         0.0086,  0.6561,  0.1603,  0.9628,  0.6423,  0.9482,  0.6855,
         0.0071,  0.1322,  0.2525,  0.3110,  0.8949,  0.0046,  0.0249,
         0.2567,  0.9304,  0.0292,  0.3691,  0.0769,  0.9999,  0.0027,
         0.0907,  0.6731,  0.9998,  0.0482,  0.3927,  0.0388,  0.0946,
         0.6705,  0.1493,  0.0209,  0.9989,  0.0333,  0.0303,  0.6724,
         0.2628,  0.1824,  0.1477,  0.6212,  0.8386,  0.3130,  0.0380,
         0.4707,  0.1070,  0.9973,  0.9470,  0.0874,  0.9215,  0.3421,
         0.0524,  0.8215,  0.9970,  0.7035,  0.5531,  0.8857,  0.0017,
         0.8793,  0.3740,  0.0123,  0.1450,  0.0955,  0.7881,  0.9551,
         0.0055,  0.9326,  0.3387,  0.0393,  0.5802,  0.1220,  0.8991,
         0.5537,  0.0290,  0.9551,  0.2388,  0.9614,  0.9410,  0.2128,
         0.7331,  0.0638,  0.9173,  0.2372,  0.4863,  0.0700,  0.0890,
         0.9743,  0.1647,  0.1789,  0.2433,  0.9674,  0.6072,  0.9770,
         0.0465,  0.0116,  0.9683,  0.0182,  0.4634,  0.2022,  0.1679,
         0.9708,  0.0559,  0.0717,  0.0078,  0.0061,  0.7135,  0.8219,
         0.9064,  0.2335,  0.9996,  0.9386,  0.7846,  0.0243,  0.0377,
         0.6165,  0.9522,  0.0057,  0.5500,  0.3551,  0.7754,  0.9474,
         0.0191,  0.9869,  0.0293,  0.1934,  0.7296,  0.3993,  0.0076,
         0.7892,  0.9532,  0.0207,  0.9144,  0.0020,  0.8145,  0.5968,
         0.0289,  0.4834,  0.9462,  0.9963,  0.0724,  0.9825,  0.4845,
         0.2043,  0.1487,  0.2300,  0.4736,  0.0358,  0.0159,  0.0811,
         0.8657,  0.9286,  0.0160,  0.1456,  0.0057,  0.0331,  0.0903,
         0.0047,  0.8849,  0.9719,  0.0739,  0.9925,  0.0810,  0.6072,
         0.2642,  0.0492,  0.6253,  0.0024,  0.1287,  0.0471,  0.0285,
         0.4608,  0.0016,  0.9156,  0.9969,  0.7947,  0.0278,  0.9885,
         0.9909,  0.9169,  0.0087,  0.2576,  0.8711,  0.7820,  0.5717,
         0.0461,  0.0024,  0.9633,  0.9457,  0.9960,  0.9325,  0.0094,
         0.6333,  0.3538,  0.2851,  0.8363,  0.9008,  0.9105,  0.7655,
         0.9423,  0.3814,  0.6085,  0.8183,  0.1165,  0.7884,  0.9026,
         0.9962,  0.9427,  0.1378,  0.9989,  0.6752,  0.9910,  0.0823,
         0.7582,  0.7619,  0.2397,  0.6641,  0.8696,  0.9029,  0.8696,
         0.9562,  0.0078,  0.0181,  0.0066,  0.4875,  0.0583,  0.0025,
         0.8905,  0.9617,  0.0196,  0.9128,  0.9484,  0.3900,  0.9107,
         0.1549,  0.8967,  0.7558,  0.9389,  0.0112,  0.6384,  0.9176,
         0.3550,  0.0060,  0.9083,  0.8707,  0.0029,  0.0300,  0.0199,
         0.9332,  0.8882,  0.0553,  0.0022,  0.3607,  0.0300,  0.8955,
         0.9746,  0.9628,  0.1665,  0.7622,  0.0143,  0.0061,  0.9340,
         0.9445,  0.8694,  0.7958,  0.0074,  0.0393,  0.0150,  0.7339,
         0.3354,  0.1342,  0.2869,  0.3328,  0.0047,  0.2453,  0.9591,
         0.7885,  0.8205,  0.7610,  0.1367,  0.9490,  0.0828,  0.0285,
         0.8547,  0.7878,  0.0113,  0.9989,  0.8775,  0.9664,  0.5648,
         0.0364,  0.0880,  0.0161,  0.0475,  0.0441,  0.0427,  0.8739,
         0.9638,  0.0857,  0.0027,  0.0288,  0.9625,  0.3275,  0.1172,
         0.6446], device='cuda:0')
tensor(0.2838, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1670,  0.3142,  0.9982,  0.3093,  0.3807,  0.9985,  0.9740,
         0.0026,  0.8804,  0.0543,  0.5936,  0.0087,  0.9873,  0.2382,
         0.9573,  0.1255,  0.0953,  0.3060,  0.7053,  0.2045,  0.9531,
         0.7937,  0.9738,  0.0311,  0.8458,  0.0051,  0.5988,  0.0326,
         0.2553,  0.6464,  0.0599,  0.1676,  0.5057,  0.9826,  0.0020,
         0.0347,  0.0354,  0.7254,  0.8941,  0.7849,  0.6396,  0.3080,
         0.3811,  0.4012,  0.7404,  0.0655,  0.0085,  0.0290,  0.1958,
         0.9254,  0.0501,  0.1719,  0.8396,  0.0353,  0.0383,  0.7386,
         0.1420,  0.6164,  0.0748,  0.8447,  0.2022,  0.8934,  0.9861,
         0.8679,  0.0314,  0.7675,  0.1374,  0.1246,  0.8547,  0.4721,
         0.0190,  0.2865,  0.9759,  0.0291,  0.9044,  0.9254,  0.1014,
         0.1432,  0.3940,  0.7820,  0.7235,  0.1507,  0.9112,  0.0185,
         0.2410,  0.4036,  0.0082,  0.7848,  0.8645,  0.9514,  0.9309,
         0.7999,  0.8602,  0.9997,  0.9975,  0.4344,  0.1893,  0.1032,
         0.1645,  0.9503,  0.0121,  0.0030,  0.9287,  0.0904,  0.0593,
         0.9846,  0.0062,  0.9575,  0.0138,  0.8249,  0.0245,  0.9141,
         0.0467,  0.9344,  0.5670,  0.1356,  0.1824,  0.5103,  0.6737,
         0.9144,  0.0665,  0.5299,  0.9672,  0.6485,  0.9399,  0.0324,
         0.5470,  0.0013,  0.7620,  0.7801,  0.7759,  0.0124,  0.0898,
         0.9092,  0.7311,  0.1975,  0.9811,  0.1484,  0.9507,  0.0571,
         0.1348,  0.0058,  0.8322,  0.8723,  0.3079,  0.5791,  0.1928,
         0.0174,  0.1034,  0.9840,  0.0154,  0.9010,  0.4699,  0.0161,
         0.0198,  0.3698,  0.9909,  0.9725,  0.0858,  0.3392,  0.9683,
         0.8748,  0.6821,  0.9566,  0.9370,  0.0657,  0.9965,  0.0754,
         0.8492,  0.3700,  0.8939,  0.8572,  0.6183,  0.6216,  0.9189,
         0.9266,  0.6770,  0.9056,  0.1970,  0.0666,  0.0050,  0.1773,
         0.6152,  0.8474,  0.9308,  0.8777,  0.9186,  0.9325,  0.9669,
         0.6409,  0.1679,  0.6352,  0.0360,  0.8073,  0.5515,  0.0310,
         0.0139,  0.6313,  0.0056,  0.1534,  0.9714,  0.5229,  0.3895,
         0.9849,  0.0874,  0.2192,  0.4879,  0.7030,  0.3386,  0.0331,
         0.9130,  0.3982,  0.8148,  0.0105,  0.0925,  0.9742,  0.8851,
         0.8971,  0.7984,  0.8827,  0.0289,  0.1728,  0.0263,  0.8426,
         0.8556,  0.8667,  0.1111,  0.9711,  0.9993,  0.9725,  0.9366,
         0.1575,  0.7020,  0.5672,  0.1400,  0.9113,  0.1494,  0.7310,
         0.3509,  0.9431,  0.2447,  0.8436,  0.9521,  0.4990,  0.8258,
         0.7796,  0.9742,  0.7112,  0.8329,  0.2753,  0.9927,  0.2032,
         0.0042,  0.4806,  0.0470,  0.9359,  0.2366,  0.8701,  0.0086,
         0.9616,  0.3588,  0.0820,  0.9146,  0.7270,  0.0879,  0.0331,
         0.9040,  0.0182,  0.9618,  0.3179,  0.2161,  0.2407,  0.0644,
         0.3699,  0.9807,  0.7513,  0.9161,  0.0343,  0.1590,  0.0820,
         0.6914,  0.9988,  0.7083,  0.9453,  0.8555,  0.8707,  0.0902,
         0.1286,  0.0827,  0.3738,  0.0078,  0.0297,  0.1161,  0.5324,
         0.8554,  0.8657,  0.9444,  0.2331,  0.9482,  0.5229,  0.9774,
         0.0218,  0.0973,  0.1991,  0.0320,  0.0075,  0.9024,  0.0366,
         0.9996,  0.6430,  0.7416,  0.9985,  0.8475,  0.2962,  0.0985,
         0.7638,  0.3983,  0.6007,  0.9886,  0.8311,  0.2352,  0.8999,
         0.0557,  0.9827,  0.8931,  0.1344,  0.4007,  0.0639,  0.1849,
         0.9767,  0.0058,  0.0300,  0.0799,  0.8283,  0.0218,  0.7750,
         0.0022,  0.0422,  0.7674,  0.1330,  0.7904,  0.1543,  0.9994,
         0.0218,  0.9994,  0.9541,  0.4920,  0.0292,  0.0525,  0.3782,
         0.0380,  0.3891,  0.0682,  0.0415,  0.8300,  0.1556,  0.9261,
         0.7961,  0.6176,  0.4948,  0.2752,  0.7697,  0.0341,  0.5928,
         0.8455,  0.0454,  0.6077,  0.8884,  0.0072,  0.2491,  0.0516,
         0.1526,  0.0506,  0.0280,  0.9787,  0.1252,  0.2220,  0.6395,
         0.9916,  0.7107,  0.0415,  0.1629,  0.9755,  0.5815,  0.0285,
         0.8107,  0.1339,  0.0258,  0.7790,  0.2332,  0.3801,  0.8664,
         0.7923,  0.7959,  0.9300,  0.0013,  0.4310,  0.0400,  0.9664,
         0.0729,  0.9488,  0.2324,  0.9144,  0.0515,  0.0115,  0.8938,
         0.0174,  0.3725,  0.0182,  0.1514,  0.6819,  0.9512,  0.9971,
         0.9127,  0.1685,  0.8001,  0.1220,  0.9659,  0.0176,  0.0275,
         0.9477,  0.6512,  0.0033,  0.9779,  0.8858,  0.0776,  0.9941,
         0.2954,  0.0889,  0.9597,  0.9723,  0.1086,  0.0289,  0.8926,
         0.7769,  0.7021,  0.9507,  0.0409,  0.6478,  0.3512,  0.4437,
         0.8732,  0.9160,  0.6410,  0.3657,  0.0190,  0.3629,  0.0161,
         0.0539,  0.9104,  0.2718,  0.9476,  0.0517,  0.9671,  0.1020,
         0.8582,  0.9166,  0.9378,  0.9926,  0.2450,  0.0027,  0.9575,
         0.0423,  0.8117,  0.6436,  0.6124,  0.3497,  0.8337,  0.9431,
         0.8087,  0.0043,  0.9727,  0.0062,  0.0818,  0.7602,  0.1297,
         0.0079,  0.9638,  0.7224,  0.2121,  0.9874,  0.7445,  0.1822,
         0.9453,  0.1863,  0.8398,  0.9346,  0.0012,  0.4144,  0.9810,
         0.9710,  0.9936,  0.7163,  0.0726,  0.8894,  0.8928,  0.9839,
         0.2559,  0.0444,  0.1206,  0.6376,  0.3631,  0.9136,  0.9010,
         0.9916,  0.7388,  0.9373,  0.9566,  0.9438,  0.0779,  0.9703,
         0.7386], device='cuda:0')
tensor(0.2663, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6587,  0.5905,  0.8893,  0.9882,  0.9137,  0.9237,  0.9976,
         0.1859,  0.9698,  0.9915,  0.9546,  0.8769,  0.2848,  0.9456,
         0.2775,  0.1397,  0.1428,  0.9999,  0.0481,  0.0426,  0.0009,
         0.2468,  0.0373,  0.2015,  0.4605,  0.1421,  0.4908,  0.4773,
         0.9756,  0.7741,  0.1299,  0.1858,  0.9101,  0.8063,  0.9600,
         0.9685,  0.3186,  0.1076,  0.0634,  0.1714,  0.9686,  0.0128,
         0.9441,  0.0606,  0.1462,  0.2197,  0.8572,  0.6504,  0.9990,
         0.1319,  0.9936,  0.9807,  0.0327,  0.1840,  0.0380,  0.9393,
         0.9685,  0.9719,  0.1057,  0.8335,  0.0370,  0.9424,  0.0073,
         0.9926,  0.5551,  0.6537,  0.0138,  0.9476,  0.9335,  0.4927,
         0.9713,  0.9996,  0.9822,  0.0918,  0.9407,  0.9136,  0.0793,
         0.1018,  0.8382,  0.8707,  0.9382,  0.5020,  0.9409,  0.9726,
         0.8929,  0.0353,  0.9701,  0.0200,  0.2184,  0.0751,  0.3805,
         0.0071,  0.9802,  0.1182,  0.9878,  0.3304,  0.9713,  0.8316,
         0.9241,  0.3685,  0.8870,  0.0454,  0.9154,  0.0170,  0.8783,
         0.9558,  0.8627,  0.8337,  0.3811,  0.7286,  0.2484,  0.9780,
         0.2602,  0.0770,  0.9481,  0.9363,  0.3355,  0.2186,  0.9419,
         0.0277,  0.9251,  0.2665,  0.9625,  0.0129,  0.0492,  0.9109,
         0.5449,  0.9284,  0.1435,  0.5244,  0.9935,  0.1072,  0.1679,
         0.4879,  0.9596,  0.2145,  0.9112,  0.9683,  0.9393,  0.9505,
         0.8993,  0.9076,  0.0365,  0.1206,  0.0128,  0.1217,  0.9179,
         0.9235,  0.7982,  0.3299,  0.9963,  0.9966,  0.9990,  0.9284,
         0.0805,  0.9695,  0.9811,  0.7174,  0.8283,  0.8942,  0.9516,
         0.6341,  0.1064,  0.8942,  0.0267,  0.4749,  0.2949,  0.0032,
         0.5131,  0.2306,  0.5728,  0.9541,  0.1197,  0.9570,  0.0309,
         0.0236,  0.0477,  0.9819,  0.2293,  0.9346,  0.9804,  0.1119,
         0.7421,  0.9791,  0.3116,  0.8720,  0.0777,  0.7953,  0.9570,
         0.2134,  0.0471,  0.9499,  0.0637,  0.6658,  0.9340,  0.9644,
         0.0491,  0.9563,  0.3623,  0.0121,  0.1087,  0.0314,  0.5803,
         0.8754,  0.9110,  0.9983,  0.6661,  0.4567,  0.7968,  0.0755,
         0.0180,  0.9976,  0.0486,  0.9349,  0.8185,  0.0029,  0.3536,
         0.8644,  0.9941,  0.5938,  0.1924,  0.0962,  0.9359,  0.0531,
         0.9936,  0.9362,  0.9888,  0.8326,  0.0063,  0.9407,  0.4622,
         0.9938,  0.9433,  0.9593,  0.5308,  0.9553,  0.1868,  0.0383,
         0.2186,  0.9780,  0.0424,  0.4043,  0.0055,  0.2326,  0.1186,
         0.9117,  0.0175,  0.0786,  0.9845,  0.9504,  0.1126,  0.0870,
         0.7696,  0.9992,  0.2166,  0.0746,  0.4635,  0.0056,  0.1012,
         0.4111,  0.5668,  0.0096,  0.3671,  0.8891,  0.0873,  0.9936,
         0.0040,  0.9738,  0.9504,  0.3478,  0.1993,  0.7627,  0.8127,
         0.9578,  0.0768,  0.9382,  0.9299,  0.8710,  0.9523,  0.0283,
         0.6622,  0.0020,  0.9436,  0.0228,  0.8851,  0.9516,  0.9933,
         0.0387,  0.9744,  0.0785,  0.7117,  0.0056,  0.8926,  0.2859,
         0.9457,  0.1552,  0.8997,  0.9414,  0.8312,  0.2957,  0.4473,
         0.7937,  0.2267,  0.9219,  0.2904,  0.9980,  0.0052,  0.5561,
         0.0118,  0.9537,  0.9349,  0.2364,  0.3136,  0.6012,  0.9002,
         0.3122,  0.9576,  0.5111,  0.1350,  0.8528,  0.4013,  0.0972,
         0.9717,  0.0361,  0.8178,  0.9460,  0.9860,  0.3268,  0.9526,
         0.9737,  0.8675,  0.4348,  0.1019,  0.9793,  0.0108,  0.1708,
         0.8812,  0.1022,  0.8951,  0.9569,  0.8618,  0.3672,  0.2607,
         0.0592,  0.3955,  0.4945,  0.9744,  0.0643,  0.9668,  0.6664,
         0.5354,  0.6558,  0.8987,  0.9251,  0.0040,  0.9877,  0.4435,
         0.0238,  0.9883,  0.0446,  0.0565,  0.9980,  0.0999,  0.8599,
         0.0896,  0.9637,  0.6635,  0.4172,  0.9624,  0.0603,  0.9643,
         0.7269,  0.0622,  0.5642,  0.0386,  0.9148,  0.0977,  0.7574,
         0.9502,  0.2991,  0.2756,  0.1919,  0.7700,  0.1251,  0.6986,
         0.7119,  0.4688,  0.9674,  0.0045,  0.2258,  0.9454,  0.0057,
         0.9613,  0.9560,  0.8827,  0.9623,  0.2754,  0.1022,  0.8588,
         0.0417,  0.9088,  0.4130,  0.0193,  0.2007,  0.0870,  0.9677,
         0.9974,  0.9205,  0.0259,  0.8987,  0.7877,  0.1887,  0.0046,
         0.9586,  0.8802,  0.8459,  0.1990,  0.9351,  0.2671,  0.9152,
         0.8729,  0.0422,  0.1106,  0.8095,  0.5599,  0.0506,  0.0051,
         0.2724,  0.9202,  0.6211,  0.9440,  0.3348,  0.0308,  0.1288,
         0.8961,  0.9957,  0.8920,  0.0037,  0.0085,  0.6722,  0.1567,
         0.0758,  0.9815,  0.1112,  0.7555,  0.2804,  0.3110,  0.1246,
         0.9610,  0.8573,  0.6277,  0.0163,  0.0012,  0.5254,  0.9190,
         0.7569,  0.0630,  0.9819,  0.9173,  0.0115,  0.9712,  0.0071,
         0.0011,  0.9720,  0.8231,  0.9777,  0.9488,  0.0630,  0.7070,
         0.2232,  0.4530,  0.8221,  0.5149,  0.5806,  0.9756,  0.7584,
         0.2991,  0.9515,  0.9560,  0.7490,  0.9329,  0.9706,  0.9698,
         0.9829,  0.9461,  0.0755,  0.9885,  0.1135,  0.2426,  0.8522,
         0.6425,  0.9768,  0.5625,  0.7627,  0.0814,  0.1161,  0.8025,
         0.9988,  0.8710,  0.6462,  0.9520,  0.3557,  0.6891,  0.9166,
         0.9419,  0.3678,  0.9932,  0.1290,  0.1018,  0.8331,  0.9441,
         0.0569], device='cuda:0')
tensor(0.3040, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9513,  0.9191,  0.0875,  0.9418,  0.9473,  0.1641,  0.1173,
         0.0175,  0.0941,  0.9043,  0.5257,  0.0519,  0.0279,  0.9307,
         0.9866,  0.9800,  0.9824,  0.0832,  0.7447,  0.7120,  0.5203,
         0.0782,  0.8088,  0.9467,  0.0719,  0.0937,  0.9498,  0.1488,
         0.9922,  0.8323,  0.7691,  0.5322,  0.9527,  0.9672,  0.7849,
         0.2177,  0.9194,  0.2923,  0.0625,  0.9751,  0.9610,  0.0931,
         0.9405,  0.0832,  0.9218,  0.0790,  0.0885,  0.9429,  0.5920,
         0.0913,  0.9016,  0.9476,  0.0547,  0.7483,  0.0007,  0.0302,
         0.9825,  0.9307,  0.0586,  0.0044,  0.9692,  0.9832,  0.3218,
         0.0607,  0.0998,  0.9592,  0.9420,  0.0356,  0.9015,  0.0906,
         0.7838,  0.9395,  0.4690,  0.0708,  0.9827,  0.1997,  0.7279,
         0.9821,  0.0245,  0.6155,  0.4497,  0.0295,  0.9466,  0.6050,
         0.0083,  0.8083,  0.9813,  0.2065,  0.6347,  0.9774,  0.9832,
         0.9559,  0.9909,  0.9268,  0.9457,  0.0301,  0.9697,  0.0811,
         0.9103,  0.0709,  0.0217,  0.1394,  0.7957,  0.8912,  0.7145,
         0.9787,  0.9403,  0.6312,  0.0352,  0.0106,  0.0733,  0.9874,
         0.0428,  0.9718,  0.9561,  0.9764,  0.5639,  0.0337,  0.6846,
         0.9094,  0.2139,  0.9681,  0.9382,  0.0559,  0.0763,  0.9998,
         0.0639,  0.8173,  0.4619,  0.0020,  0.9972,  0.8173,  0.7332,
         0.2861,  0.8506,  0.9773,  0.9209,  0.1036,  0.0967,  0.4663,
         0.9810,  0.9572,  0.2145,  0.4151,  0.8854,  0.9774,  0.6511,
         0.9759,  0.1145,  0.8658,  0.0231,  0.7575,  0.1922,  0.9638,
         0.9383,  0.9344,  0.0066,  0.9827,  0.9789,  0.0828,  0.4292,
         0.9733,  0.0234,  0.9807,  0.9934,  0.9727,  0.9684,  0.9362,
         0.0494,  0.9506,  0.3109,  0.6398,  0.9911,  0.9943,  0.9118,
         0.4556,  0.2737,  0.0410,  0.7974,  0.9716,  0.9550,  0.6028,
         0.9584,  0.4269,  0.2743,  0.7565,  0.4476,  0.8920,  0.0201,
         0.9455,  0.6605,  0.5835,  0.8135,  0.0121,  0.9767,  0.9601,
         0.0281,  0.0536,  0.4451,  0.9630,  0.8862,  0.8986,  0.7478,
         0.9524,  0.9983,  0.9516,  0.9348,  0.1045,  0.9431,  0.2422,
         0.9267,  0.9647,  0.7923,  0.0483,  0.9845,  0.9229,  0.2475,
         0.0729,  0.8960,  0.7318,  0.9673,  0.2847,  0.9516,  0.0171,
         0.8563,  0.0952,  0.6955,  0.1047,  0.9241,  0.2673,  0.8865,
         0.0151,  0.9537,  0.9996,  0.0922,  0.9929,  0.1880,  0.0180,
         0.9573,  0.3812,  0.9644,  0.9767,  0.9972,  0.9937,  0.4538,
         0.1279,  0.8517,  0.1883,  0.9451,  0.9998,  0.2579,  0.9769,
         0.0240,  0.9662,  0.4505,  0.7730,  0.0229,  0.8102,  0.9545,
         0.9455,  0.7714,  0.6615,  0.0255,  0.9466,  0.2654,  0.0126,
         0.9555,  0.0279,  0.0134,  0.1682,  0.0828,  0.5991,  0.0502,
         0.9790,  0.9326,  0.9354,  0.2015,  0.9178,  0.9692,  0.9722,
         0.7245,  0.6789,  0.0067,  0.5869,  0.9834,  0.9846,  0.8667,
         0.8194,  0.9550,  0.8814,  0.5394,  0.9506,  0.0612,  0.5373,
         0.6801,  0.0882,  0.2174,  0.8559,  0.9122,  0.0766,  0.0341,
         0.9504,  0.3257,  0.4547,  0.0695,  0.9712,  0.6573,  0.9733,
         0.9593,  0.9451,  0.9867,  0.9736,  0.7965,  0.0450,  0.9255,
         0.0020,  0.9746,  0.8822,  0.1158,  0.9551,  0.9768,  0.4249,
         0.0575,  0.0177,  0.9725,  0.4499,  0.0784,  0.8744,  0.0634,
         0.9693,  0.9909,  0.8092,  0.0038,  0.6361,  0.7207,  0.0905,
         0.0004,  0.4897,  0.9496,  0.0973,  0.9895,  0.1720,  0.7498,
         0.6392,  0.9790,  0.8451,  0.0364,  0.0223,  0.9688,  0.2897,
         0.9806,  0.9789,  0.9813,  0.8681,  0.4592,  0.0855,  0.0786,
         0.9694,  0.9912,  0.9176,  0.0067,  0.8188,  0.9744,  0.0009,
         0.0807,  0.9463,  0.9490,  0.0084,  0.5157,  0.9698,  0.8941,
         0.9260,  0.9173,  0.0688,  0.9910,  0.0227,  0.9167,  0.0571,
         0.2475,  0.9132,  0.3059,  0.0064,  0.4743,  0.8888,  0.1336,
         0.9068,  0.9983,  0.0048,  0.1829,  0.0876,  0.0953,  0.0120,
         0.0116,  0.0771,  0.9263,  0.9756,  0.2569,  0.7902,  0.2141,
         0.2584,  0.9885,  0.1118,  0.9597,  0.8739,  0.3333,  0.0212,
         0.7621,  0.8996,  0.9167,  0.8691,  0.9973,  0.0357,  0.0956,
         0.1008,  0.9429,  0.9080,  0.1814,  0.1152,  0.1585,  0.0014,
         0.1665,  0.0312,  0.3148,  0.0778,  0.9590,  0.1984,  0.7247,
         0.0255,  0.0470,  0.2677,  0.0035,  0.7586,  0.1944,  0.9227,
         0.3312,  0.4246,  0.9634,  0.1866,  0.9976,  0.8628,  0.9940,
         0.0262,  0.0197,  0.9404,  0.8629,  0.9343,  0.9300,  0.0216,
         0.9794,  0.2630,  0.9874,  0.0286,  0.0789,  0.9942,  0.9384,
         0.9985,  0.0100,  0.0162,  0.7438,  0.2060,  0.0970,  0.9512,
         0.0135,  0.2251,  0.0961,  0.9117,  0.9517,  0.6172,  0.9729,
         0.8678,  0.0250,  0.0456,  0.9556,  0.9597,  0.0342,  0.8317,
         0.1209,  0.9992,  0.9679,  0.6761,  0.0369,  0.7147,  0.6562,
         0.9153,  0.4293,  0.8182,  0.8283,  0.9560,  0.0666,  0.9866,
         0.9892,  0.9493,  0.0032,  0.9728,  0.3630,  0.7196,  0.9373,
         0.9877,  0.9909,  0.7157,  0.9896,  0.1189,  0.9916,  0.9816,
         0.0885,  0.0276,  0.0311,  0.0615,  0.9548,  0.0030,  0.0048,
         0.9261], device='cuda:0')
tensor(0.3227, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0047,  0.0169,  0.0324,  0.0746,  0.8831,  0.9620,  0.7891,
         0.9814,  0.8581,  0.0784,  0.0250,  0.1071,  0.7672,  0.0016,
         0.9466,  0.4318,  0.0248,  0.9518,  0.2336,  0.9096,  0.0156,
         0.0775,  0.9626,  0.0300,  0.9972,  0.9199,  0.0677,  0.8882,
         0.0956,  0.8808,  0.1170,  0.0673,  0.3562,  0.0132,  0.2673,
         0.9974,  0.9075,  0.7885,  0.0067,  0.9574,  0.9241,  0.0271,
         0.9278,  0.8760,  0.4395,  0.0421,  0.9601,  0.9956,  0.8858,
         0.0122,  0.0043,  0.0098,  0.2360,  0.8882,  0.9599,  0.0122,
         0.8240,  0.9259,  0.0021,  0.7552,  0.0082,  0.9265,  0.9291,
         0.0149,  0.0192,  0.5495,  0.9527,  0.0248,  0.9640,  0.0161,
         0.7895,  0.0024,  0.1370,  0.9931,  0.9256,  0.0049,  0.9148,
         0.9341,  0.6102,  0.8999,  0.9793,  0.8921,  0.9727,  0.8572,
         0.9273,  0.9928,  0.0215,  0.3135,  0.9433,  0.0126,  0.0220,
         0.1597,  0.9618,  0.7987,  0.1964,  0.0914,  0.0398,  0.9509,
         0.9340,  0.1867,  0.0027,  0.0065,  0.2862,  0.0421,  0.0267,
         0.9244,  0.9707,  0.7721,  0.1631,  0.9393,  0.9226,  0.0183,
         0.8337,  0.0319,  0.8578,  0.2378,  0.9288,  0.9595,  0.0829,
         0.2364,  0.9464,  0.7807,  0.9716,  0.9165,  0.0114,  0.6459,
         0.6277,  0.9473,  0.0010,  0.1039,  0.5123,  0.9159,  0.0550,
         0.1382,  0.9690,  0.9935,  0.0643,  0.5656,  0.9769,  0.2638,
         0.0410,  0.1296,  0.5293,  0.7251,  0.7902,  0.0716,  0.0090,
         0.0336,  0.8912,  0.4028,  0.3076,  0.0271,  0.6327,  0.9581,
         0.0074,  0.9897,  0.0024,  0.1477,  0.9984,  0.8886,  0.8669,
         0.2793,  0.8229,  0.9869,  0.9097,  0.8375,  0.0045,  0.0067,
         0.8913,  0.7529,  0.7980,  0.1761,  0.9612,  0.0677,  0.1913,
         0.8778,  0.9788,  0.0962,  0.9569,  0.6834,  0.4566,  0.9815,
         0.9576,  0.9244,  0.0441,  0.1421,  0.1761,  0.9752,  0.9580,
         0.8447,  0.0239,  0.8527,  0.0446,  0.4394,  0.9764,  0.3778,
         0.0709,  0.6310,  0.9303,  0.9978,  0.0492,  0.9887,  0.0066,
         0.0679,  0.7107,  0.8491,  0.9810,  0.0841,  0.0848,  0.0170,
         0.9689,  0.9665,  0.9725,  0.9039,  0.9176,  0.9735,  0.9588,
         0.7738,  0.4774,  0.0061,  0.9255,  0.7925,  0.9699,  0.0202,
         0.9651,  0.9200,  0.9841,  0.9672,  0.7196,  0.9992,  0.9981,
         0.9172,  0.0056,  0.9803,  0.2398,  0.9569,  0.9208,  0.0025,
         0.9724,  0.0454,  0.9973,  0.0654,  0.8690,  0.3572,  0.8288,
         0.8088,  0.0332,  0.8544,  0.5357,  0.0038,  0.3912,  0.0292,
         0.0298,  0.9721,  0.2946,  0.4769,  0.9636,  0.6596,  0.2921,
         0.9765,  0.0068,  0.9293,  0.9393,  0.8996,  0.9372,  0.9573,
         0.8083,  0.9671,  0.9570,  0.1332,  0.9341,  0.9750,  0.8970,
         0.7087,  0.0642,  0.7891,  0.0576,  0.0786,  0.0111,  0.8660,
         0.0866,  0.9553,  0.9121,  0.0523,  0.0100,  0.9553,  0.0457,
         0.0029,  0.0155,  0.2658,  0.9904,  0.0232,  0.3726,  0.9840,
         0.9191,  0.6736,  0.9296,  0.9750,  0.0392,  0.0084,  0.9718,
         0.0162,  0.6877,  0.8299,  0.8027,  0.9295,  0.2903,  0.0035,
         0.9681,  0.0267,  0.9379,  0.9492,  0.9552,  0.0369,  0.9158,
         0.9849,  0.9098,  0.0161,  0.9006,  0.3896,  0.0019,  0.8814,
         0.9992,  0.7872,  0.9555,  0.5789,  0.9752,  0.9850,  0.9649,
         0.0273,  0.0351,  0.9832,  0.5510,  0.9663,  0.9820,  0.1834,
         0.9606,  0.9331,  0.0557,  0.0308,  0.0528,  0.8358,  0.3402,
         0.9096,  0.4976,  0.3326,  0.8383,  0.9216,  0.9484,  0.8583,
         0.9469,  0.8922,  0.0330,  0.5048,  0.9551,  0.7276,  0.1983,
         0.1556,  0.1904,  0.0206,  0.9063,  0.7527,  0.9842,  0.8718,
         0.5814,  0.7621,  0.9725,  0.8232,  0.4822,  0.9303,  0.9772,
         0.9776,  0.0231,  0.9235,  0.3417,  0.2892,  0.7009,  0.5613,
         0.0603,  0.8915,  0.0068,  0.8392,  0.9847,  0.0711,  0.0431,
         0.9839,  0.0540,  0.9971,  0.0390,  0.0021,  0.9652,  0.0776,
         0.0623,  0.0153,  0.3017,  0.2351,  0.0057,  0.9833,  0.7565,
         0.0063,  0.9431,  0.0734,  0.0284,  0.0165,  0.0778,  0.2330,
         0.0062,  0.9751,  0.0214,  0.7781,  0.9732,  0.5953,  0.9610,
         0.0123,  0.9842,  0.6424,  0.1692,  0.9831,  0.2118,  0.0044,
         0.0287,  0.4330,  0.8362,  0.9892,  0.0790,  0.9405,  0.0048,
         0.9104,  0.8809,  0.9144,  0.0972,  0.9236,  0.9416,  0.0098,
         0.9536,  0.8693,  0.8567,  0.8107,  0.9634,  0.6457,  0.9361,
         0.0450,  0.1148,  0.1045,  0.4753,  0.9574,  0.2069,  0.9509,
         0.9589,  0.9469,  0.0274,  0.0047,  0.0435,  0.9099,  0.9958,
         0.9114,  0.9544,  0.7684,  0.0374,  0.5901,  0.2925,  0.9928,
         0.9058,  0.8529,  0.9091,  0.9570,  0.0382,  0.4558,  0.9108,
         0.0420,  0.7987,  0.0031,  0.9398,  0.9687,  0.4861,  0.7816,
         0.9749,  0.5132,  0.4391,  0.1287,  0.9502,  0.9230,  0.1488,
         0.9451,  0.0071,  0.5236,  0.3386,  0.3062,  0.4668,  0.0421,
         0.9711,  0.0115,  0.9629,  0.6407,  0.0363,  0.2051,  0.1099,
         0.0164,  0.8383,  0.0226,  0.0282,  0.2839,  0.0507,  0.1794,
         0.8422,  0.8283,  0.2439,  0.1729,  0.8977,  0.9901,  0.0080,
         0.6975], device='cuda:0')
tensor(0.3071, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0041,  0.9502,  0.7257,  0.1503,  0.0265,  0.0056,  0.0104,
         0.9535,  0.3909,  0.0078,  0.2934,  0.2269,  0.4503,  0.8850,
         0.0448,  0.0868,  0.0384,  0.0067,  0.0979,  0.0176,  0.7088,
         0.0081,  0.9950,  0.8554,  0.0082,  0.0325,  0.0217,  0.0808,
         0.9793,  0.0282,  0.0613,  0.0023,  0.0370,  0.0007,  0.0927,
         0.9302,  0.0078,  0.9263,  0.8493,  0.9768,  0.7755,  0.0189,
         0.6886,  0.0394,  0.9416,  0.3458,  0.1192,  0.6231,  0.5232,
         0.7339,  0.2683,  0.0266,  0.6762,  0.7990,  0.0502,  0.9722,
         0.7967,  0.3181,  0.9526,  0.0436,  0.0506,  0.0751,  0.2899,
         0.8450,  0.9233,  0.5956,  0.9937,  0.0170,  0.0070,  0.9723,
         0.0208,  0.0082,  0.7815,  0.0086,  0.0340,  0.5977,  0.9212,
         0.4714,  0.9679,  0.0013,  0.0018,  0.5767,  0.9381,  0.0883,
         0.9221,  0.1162,  0.9670,  0.9299,  0.0953,  0.9512,  0.1104,
         0.9447,  0.8591,  0.0516,  0.1881,  0.0335,  0.6296,  0.9595,
         0.1043,  0.8869,  0.1048,  0.0799,  0.0779,  0.2656,  0.0424,
         0.9415,  0.9785,  0.1719,  0.0170,  0.9332,  0.0024,  0.7129,
         0.0725,  0.9704,  0.0084,  0.9270,  0.9823,  0.4635,  0.0259,
         0.8293,  0.0086,  0.7688,  0.7662,  0.9984,  0.9924,  0.9153,
         0.7560,  0.0058,  0.0440,  0.7435,  0.9972,  0.9805,  0.0865,
         0.3965,  0.0581,  0.0148,  0.9270,  0.0965,  0.0245,  0.4683,
         0.0290,  0.7843,  0.2032,  0.0455,  0.8755,  0.1646,  0.4148,
         0.0404,  0.5786,  0.0018,  0.0076,  0.9821,  0.7174,  0.0087,
         0.9373,  0.9712,  0.1437,  0.2161,  0.0063,  0.0221,  0.0151,
         0.0281,  0.8767,  0.0490,  0.0044,  0.9523,  0.0322,  0.1220,
         0.0022,  0.0116,  0.0505,  0.9342,  0.7251,  0.1662,  0.3756,
         0.3676,  0.8982,  0.4551,  0.9305,  0.9422,  0.0047,  0.0072,
         0.2962,  0.0021,  0.7412,  0.9896,  0.2057,  0.0468,  0.8219,
         0.9791,  0.1020,  0.0024,  0.9182,  0.8758,  0.0083,  0.0526,
         0.7279,  0.8085,  0.7168,  0.4719,  0.9859,  0.6335,  0.9136,
         0.9547,  0.3850,  0.5597,  0.9993,  0.8127,  0.9554,  0.8364,
         0.8200,  0.7080,  0.0106,  0.9766,  0.0290,  0.9525,  0.2894,
         0.0379,  0.0233,  0.9949,  0.9823,  0.0613,  0.9704,  0.0102,
         0.8485,  0.1900,  0.8989,  0.6467,  0.8909,  0.0207,  0.9247,
         0.0028,  0.0623,  0.9099,  0.0510,  0.0569,  0.0017,  0.1886,
         0.9997,  0.9186,  0.0473,  0.9383,  0.8216,  0.5068,  0.5980,
         0.6181,  0.9173,  0.8167,  0.8055,  0.0264,  0.0820,  0.0566,
         0.8392,  0.0188,  0.0311,  0.8716,  0.4677,  0.9307,  0.2851,
         0.8392,  0.0318,  0.9160,  0.9625,  0.9734,  0.1278,  0.9447,
         0.9689,  0.9795,  0.0073,  0.8083,  0.0367,  0.8804,  0.9977,
         0.9455,  0.9871,  0.0809,  0.6677,  0.8490,  0.0142,  0.0178,
         0.2835,  0.0190,  0.0027,  0.8156,  0.3621,  0.9377,  0.0110,
         0.0684,  0.9785,  0.0758,  0.8983,  0.1121,  0.0227,  0.8643,
         0.3755,  0.0036,  0.0336,  0.0317,  0.0043,  0.0325,  0.0050,
         0.0078,  0.0131,  0.7404,  0.9246,  0.8792,  0.8148,  0.8814,
         0.7300,  0.8144,  0.9938,  0.1001,  0.0722,  0.9385,  0.6212,
         0.0221,  0.0015,  0.1357,  0.3225,  0.0302,  0.9626,  0.8658,
         0.9240,  0.1826,  0.7914,  0.8568,  0.9443,  0.0007,  0.0523,
         0.8405,  0.9997,  0.8906,  0.8535,  0.8952,  0.8891,  0.7916,
         0.8683,  0.2176,  0.7105,  0.0225,  0.0557,  0.0008,  0.0232,
         0.9603,  0.0657,  0.0022,  0.8848,  0.9857,  0.2545,  0.0723,
         0.0934,  0.0330,  0.0429,  0.9026,  0.9442,  0.7933,  0.8597,
         0.8964,  0.9491,  0.9779,  0.1110,  0.5945,  0.0263,  0.5209,
         0.0096,  0.0694,  0.9487,  0.4815,  0.1438,  0.1296,  0.9634,
         0.5944,  0.0149,  0.8554,  0.0314,  0.9863,  0.6587,  0.3787,
         0.0219,  0.9582,  0.4102,  0.9259,  0.8060,  0.3730,  0.9547,
         0.9631,  0.8592,  0.0764,  0.0063,  0.0123,  0.7159,  0.1609,
         0.9835,  0.0303,  0.0262,  0.8516,  0.9223,  0.3043,  0.8797,
         0.0481,  0.0078,  0.0390,  0.6638,  0.0239,  0.0796,  0.0119,
         0.8785,  0.9297,  0.0091,  0.9951,  0.0153,  0.9537,  0.0442,
         0.4712,  0.0095,  0.0100,  0.0176,  0.0033,  0.2639,  0.2388,
         0.0328,  0.1132,  0.8982,  0.9921], device='cuda:0')
tensor(0.3115, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 8, BCELoss: 0.31172787109199834
tensor([ 0.3779,  0.9871,  0.0572,  0.9305,  0.7106,  0.0544,  0.0095,
         0.9970,  0.1971,  0.7146,  0.0175,  0.7010,  0.4668,  0.1628,
         0.0129,  0.8381,  0.0529,  0.0999,  0.0265,  0.0074,  0.1311,
         0.9179,  0.0440,  0.9307,  0.0298,  0.2824,  0.8120,  0.9944,
         0.6732,  0.5211,  0.9487,  0.9824,  0.7655,  0.3622,  0.0558,
         0.0148,  0.8305,  0.8552,  0.0197,  0.0033,  0.3502,  0.7856,
         0.0007,  0.0020,  0.4774,  0.1139,  0.6414,  0.7552,  0.8751,
         0.0263,  0.0334,  0.0301,  0.7739,  0.9044,  0.1265,  0.1315,
         0.9858,  0.8060,  0.8451,  0.9791,  0.3487,  0.7869,  0.8992,
         0.0117,  0.4169,  0.1590,  0.9519,  0.6697,  0.9568,  0.5374,
         0.0197,  0.7932,  0.0147,  0.0038,  0.9993,  0.9944,  0.0362,
         0.0629,  0.0088,  0.0207,  0.2411,  0.9638,  0.8780,  0.0165,
         0.1238,  0.5612,  0.0063,  0.8978,  0.9363,  0.0180,  0.0648,
         0.0634,  0.1553,  0.0260,  0.7957,  0.8632,  0.9399,  0.9771,
         0.0293,  0.0107,  0.2753,  0.0218,  0.0540,  0.9747,  0.6688,
         0.9559,  0.0761,  0.0627,  0.0349,  0.0504,  0.9039,  0.5601,
         0.7690,  0.6973,  0.9246,  0.0201,  0.0209,  0.9948,  0.8303,
         0.8035,  0.5574,  0.9938,  0.1568,  0.0331,  0.0014,  0.3436,
         0.5785,  0.0192,  0.3389,  0.4669,  0.8787,  0.1361,  0.8564,
         0.0155,  0.0032,  0.9847,  0.0658,  0.1746,  0.7620,  0.2695,
         0.0320,  0.0713,  0.8660,  0.4599,  0.6993,  0.2759,  0.0148,
         0.6933,  0.0060,  0.0054,  0.7783,  0.0572,  0.2185,  0.2383,
         0.0473,  0.0418,  0.9817,  0.2571,  0.1177,  0.8201,  0.9875,
         0.9714,  0.4733,  0.5883,  0.8132,  0.0798,  0.2001,  0.8992,
         0.9153,  0.1125,  0.6771,  0.6964,  0.7843,  0.8837,  0.0064,
         0.5845,  0.4533,  0.9210,  0.6660,  0.0205,  0.0512,  0.4164,
         0.9954,  0.9659,  0.9441,  0.0071,  0.9715,  0.9961,  0.1244,
         0.0157,  0.5420,  0.3185,  0.3930,  0.9545,  0.0369,  0.4281,
         0.5642,  0.8288,  0.0093,  0.7525,  0.1159,  0.0270,  0.1876,
         0.8920,  0.0357,  0.8649,  0.6257,  0.0421,  0.8778,  0.9202,
         0.2323,  0.3175,  0.0036,  0.0846,  0.0880,  0.2051,  0.9991,
         0.0282,  0.5253,  0.3008,  0.0209,  0.9731,  0.9749,  0.5238,
         0.0019,  0.9463,  0.0516,  0.8350,  0.7025,  0.8887,  0.9959,
         0.9025,  0.5466,  0.7987,  0.0053,  0.1335,  0.9591,  0.4755,
         0.8526,  0.0334,  0.1099,  0.7386,  0.5572,  0.0138,  0.5920,
         0.9178,  0.0182,  0.0046,  0.8504,  0.9858,  0.1087,  0.9923,
         0.0207,  0.0243,  0.4397,  0.0077,  0.8456,  0.6950,  0.8376,
         0.8985,  0.0045,  0.9832,  0.8534,  0.9362,  0.2318,  0.0486,
         0.9859,  0.0283,  0.1933,  0.0829,  0.0529,  0.0322,  0.0076,
         0.1002,  0.9523,  0.9355,  0.2549,  0.3810,  0.3561,  0.8670,
         0.8177,  0.0205,  0.9233,  0.6048,  0.0841,  0.0102,  0.3447,
         0.1035,  0.1139,  0.8950,  0.1621,  0.2870,  0.7770,  0.0528,
         0.9449,  0.0073,  0.9981,  0.7626,  0.8058,  0.1096,  0.6684,
         0.4029,  0.8070,  0.8828,  0.5386,  0.9602,  0.0152,  0.0172,
         0.2322,  0.8663,  0.2372,  0.0812,  0.9684,  0.9353,  0.4037,
         0.0031,  0.9362,  0.8376,  0.0156,  0.9981,  0.0042,  0.7392,
         0.9337,  0.5301,  0.1144,  0.4788,  0.4252,  0.0858,  0.0147,
         0.9240,  0.5330,  0.0152,  0.0084,  0.1213,  0.0063,  0.4263,
         0.0231,  0.0117,  0.1149,  0.6334,  0.5229,  0.0374,  0.0834,
         0.0033,  0.8937,  0.8731,  0.9437,  0.0111,  0.9220,  0.2915,
         0.2927,  0.6526,  0.5263,  0.8030,  0.0171,  0.4866,  0.6177,
         0.9224,  0.0374,  0.7656,  0.3704,  0.7142,  0.0031,  0.0191,
         0.0007,  0.0575,  0.9962,  0.3264,  0.3100,  0.1228,  0.0094,
         0.0760,  0.0297,  0.4435,  0.0424,  0.0313,  0.1549,  0.8813,
         0.8127,  0.9573,  0.1613,  0.0771,  0.2291,  0.6219,  0.9958,
         0.0399,  0.3378,  0.9987,  0.1637,  0.7365,  0.7840,  0.5985,
         0.0347,  0.0991,  0.8996,  0.0666,  0.0956,  0.0065,  0.9211,
         0.4345,  0.6926,  0.0184,  0.7953,  0.1921,  0.0038,  0.9777,
         0.0758,  0.0246,  0.0445,  0.8977,  0.0130,  0.9736,  0.0214,
         0.5597,  0.6915,  0.6351,  0.9610,  0.0053,  0.0331,  0.2483,
         0.9263,  0.9327,  0.7927,  0.3742,  0.9895,  0.0651,  0.2289,
         0.0238,  0.8917,  0.1691,  0.8037,  0.0527,  0.1417,  0.0032,
         0.4972,  0.1244,  0.8692,  0.6097,  0.0771,  0.8230,  0.8756,
         0.0623,  0.9926,  0.9425,  0.6839,  0.1496,  0.8993,  0.0247,
         0.0263,  0.8659,  0.8765,  0.6729,  0.8054,  0.1891,  0.0253,
         0.4184,  0.5327,  0.9986,  0.9351,  0.0582,  0.6153,  0.7614,
         0.9153,  0.2313,  0.0758,  0.0208,  0.0661,  0.2175,  0.1752,
         0.5676,  0.5028,  0.0866,  0.0236,  0.0106,  0.0522,  0.1354,
         0.4621,  0.0508,  0.9133,  0.9812,  0.1122,  0.8265,  0.0239,
         0.0613,  0.8553,  0.0235,  0.9295,  0.1951,  0.0627,  0.1374,
         0.6185,  0.8591,  0.7411,  0.8793,  0.7888,  0.1422,  0.0159,
         0.0160,  0.3394,  0.0434,  0.1840,  0.0276,  0.2459,  0.0313,
         0.8523,  0.6983,  0.8881,  0.6090,  0.9312,  0.9645,  0.9242,
         0.0109], device='cuda:0')
tensor(0.3292, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0230,  0.0883,  0.1036,  0.6504,  0.0351,  0.7373,  0.9543,
         0.9298,  0.9865,  0.0083,  0.2243,  0.8154,  0.7624,  0.8159,
         0.7178,  0.0483,  0.5059,  0.5907,  0.0975,  0.0267,  0.3401,
         0.8243,  0.8926,  0.2919,  0.0307,  0.1923,  0.5799,  0.8192,
         0.5739,  0.6085,  0.7951,  0.0724,  0.9472,  0.7984,  0.0664,
         0.3686,  0.9610,  0.0025,  0.3421,  0.2527,  0.6426,  0.0219,
         0.1380,  0.3246,  0.0616,  0.0489,  0.2415,  0.0393,  0.9155,
         0.0436,  0.0371,  0.6916,  0.8397,  0.9623,  0.9223,  0.3703,
         0.1685,  0.0430,  0.6954,  0.9835,  0.0734,  0.9126,  0.9463,
         0.4726,  0.0131,  0.7710,  0.0354,  0.9947,  0.7256,  0.0174,
         0.0177,  0.6749,  0.0284,  0.9566,  0.4349,  0.0011,  0.5082,
         0.0251,  0.0769,  0.9746,  0.8938,  0.0754,  0.0574,  0.0144,
         0.6316,  0.0177,  0.0843,  0.2369,  0.9420,  0.8573,  0.0295,
         0.1611,  0.1962,  0.0956,  0.0350,  0.9545,  0.0182,  0.1777,
         0.5665,  0.0720,  0.9368,  0.3562,  0.0431,  0.9925,  0.0177,
         0.0283,  0.0289,  0.8600,  0.0989,  0.9043,  0.0293,  0.0884,
         0.1724,  0.9721,  0.6329,  0.9314,  0.8376,  0.7474,  0.5891,
         0.1228,  0.7447,  0.0076,  0.5628,  0.1146,  0.6641,  0.0924,
         0.8328,  0.1996,  0.4558,  0.0484,  0.0088,  0.6434,  0.8657,
         0.9792,  0.8231,  0.8751,  0.0177,  0.0370,  0.1649,  0.9684,
         0.0162,  0.0751,  0.1731,  0.0652,  0.6269,  0.0413,  0.0644,
         0.9464,  0.0025,  0.1425,  0.9391,  0.0459,  0.0359,  0.0882,
         0.0335,  0.8534,  0.4902,  0.1184,  0.7482,  0.8502,  0.1172,
         0.9338,  0.0827,  0.8512,  0.9108,  0.9660,  0.6280,  0.0281,
         0.5346,  0.9144,  0.8286,  0.1320,  0.0163,  0.0154,  0.5813,
         0.6143,  0.0041,  0.0190,  0.7567,  0.6902,  0.3214,  0.0429,
         0.2641,  0.7229,  0.0135,  0.4906,  0.1715,  0.8309,  0.3158,
         0.1568,  0.0022,  0.8649,  0.5810,  0.0016,  0.0611,  0.1271,
         0.8648,  0.9387,  0.0029,  0.0621,  0.0173,  0.4550,  0.2544,
         0.7795,  0.0148,  0.6536,  0.8047,  0.9461,  0.0047,  0.5749,
         0.9114,  0.8678,  0.9165,  0.0171,  0.3161,  0.8988,  0.0126,
         0.0194,  0.6332,  0.0162,  0.0103,  0.0586,  0.1079,  0.2015,
         0.0820,  0.9297,  0.1891,  0.7367,  0.4268,  0.1184,  0.0778,
         0.6481,  0.8117,  0.0458,  0.9634,  0.7438,  0.9980,  0.6462,
         0.8950,  0.0284,  0.0189,  0.9199,  0.0544,  0.6623,  0.1224,
         0.5452,  0.7947,  0.0073,  0.9290,  0.9429,  0.8601,  0.1390,
         0.1008,  0.0171,  0.3113,  0.9586,  0.9536,  0.9772,  0.0797,
         0.6500,  0.2057,  0.0484,  0.9054,  0.1460,  0.9841,  0.1995,
         0.7213,  0.7687,  0.6985,  0.7768,  0.1053,  0.8736,  0.5778,
         0.0895,  0.9022,  0.9338,  0.0989,  0.0401,  0.9083,  0.9336,
         0.9966,  0.0316,  0.0156,  0.2088,  0.2676,  0.1497,  0.0065,
         0.9183,  0.0062,  0.6976,  0.6985,  0.0286,  0.6760,  0.0317,
         0.0410,  0.0221,  0.1654,  0.8875,  0.1439,  0.6570,  0.0636,
         0.6016,  0.0162,  0.9952,  0.0097,  0.1336,  0.9273,  0.9627,
         0.0876,  0.0509,  0.8039,  0.6747,  0.4509,  0.0027,  0.6291,
         0.9065,  0.0103,  0.5287,  0.6483,  0.0897,  0.0316,  0.9364,
         0.0769,  0.3209,  0.0767,  0.1809,  0.8830,  0.3574,  0.8819,
         0.8557,  0.0637,  0.9956,  0.0090,  0.0036,  0.8689,  0.5820,
         0.8790,  0.2290,  0.9984,  0.2717,  0.5631,  0.0941,  0.8879,
         0.8131,  0.5917,  0.0431,  0.0258,  0.9742,  0.0225,  0.8495,
         0.1256,  0.9991,  0.6022,  0.0433,  0.0299,  0.0141,  0.8994,
         0.2349,  0.8034,  0.1834,  0.0117,  0.0004,  0.8756,  0.2439,
         0.1237,  0.1437,  0.0623,  0.1948,  0.1346,  0.8014,  0.8800,
         0.9864,  0.1216,  0.8183,  0.6494,  0.1337,  0.0222,  0.0346,
         0.7804,  0.9981,  0.0538,  0.8674,  0.9979,  0.9887,  0.0004,
         0.7884,  0.5661,  0.9059,  0.9201,  0.0637,  0.0442,  0.9975,
         0.8494,  0.0148,  0.1771,  0.7798,  0.5912,  0.5348,  0.2273,
         0.1517,  0.6241,  0.0921,  0.0403,  0.7175,  0.1622,  0.4610,
         0.5809,  0.7567,  0.0104,  0.9152,  0.0104,  0.5398,  0.0143,
         0.0250,  0.9463,  0.8202,  0.3198,  0.0693,  0.9786,  0.4050,
         0.9559,  0.0192,  0.0624,  0.5906,  0.1727,  0.9546,  0.9925,
         0.7224,  0.7579,  0.9890,  0.2257,  0.6622,  0.9106,  0.0199,
         0.8258,  0.0958,  0.0602,  0.0543,  0.8070,  0.2587,  0.8812,
         0.1289,  0.9381,  0.9029,  0.6277,  0.1394,  0.0641,  0.0257,
         0.0587,  0.4844,  0.9700,  0.9036,  0.9737,  0.8269,  0.7408,
         0.9221,  0.8440,  0.7999,  0.1778,  0.9743,  0.0134,  0.7416,
         0.9798,  0.2024,  0.1038,  0.0419,  0.1151,  0.2717,  0.4809,
         0.1960,  0.3345,  0.4988,  0.8799,  0.0451,  0.9927,  0.0135,
         0.2536,  0.7398,  0.8869,  0.0089,  0.3732,  0.9875,  0.2872,
         0.0066,  0.0263,  0.0010,  0.8512,  0.1927,  0.2856,  0.0577,
         0.0518,  0.2468,  0.0580,  0.0957,  0.9434,  0.0208,  0.9285,
         0.9766,  0.0427,  0.6095,  0.8643,  0.7384,  0.8478,  0.9835,
         0.5671,  0.9249,  0.0265,  0.8723,  0.5749,  0.4830,  0.8825,
         0.0065], device='cuda:0')
tensor(0.2977, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7994,  0.1168,  0.0792,  0.7209,  0.9637,  0.2254,  0.1652,
         0.6467,  0.0520,  0.3257,  0.9876,  0.9935,  0.8384,  0.9862,
         0.0378,  0.9630,  0.1980,  0.7435,  0.9580,  0.2618,  0.0532,
         0.5859,  0.8989,  0.9801,  0.3183,  0.6673,  0.0362,  0.8517,
         0.0039,  0.2437,  0.0905,  0.8054,  0.0116,  0.0476,  0.9992,
         0.8584,  0.0437,  0.6825,  0.6649,  0.7224,  0.0414,  0.5100,
         0.2765,  0.5010,  0.7530,  0.9892,  0.6807,  0.3421,  0.5914,
         0.9499,  0.8916,  0.6723,  0.2298,  0.0683,  0.0367,  0.9287,
         0.6311,  0.2687,  0.0175,  0.7820,  0.6801,  0.9024,  0.1799,
         0.1228,  0.2619,  0.8288,  0.8660,  0.0019,  0.9357,  0.0128,
         0.9496,  0.9374,  0.2997,  0.0931,  0.9767,  0.9846,  0.1065,
         0.0690,  0.6812,  0.0655,  0.9786,  0.0367,  0.7045,  0.9123,
         0.9487,  0.1102,  0.0401,  0.0752,  0.3680,  0.9750,  0.8007,
         0.9624,  0.0078,  0.1508,  0.6766,  0.6247,  0.2017,  0.7687,
         0.9673,  0.7569,  0.7552,  0.9824,  0.0047,  0.0092,  0.0144,
         0.8457,  0.9606,  0.6308,  0.9492,  0.7642,  0.0681,  0.7082,
         0.7608,  0.9492,  0.0247,  0.9808,  0.7669,  0.3485,  0.1803,
         0.1119,  0.9067,  0.4824,  0.6086,  0.9730,  0.7616,  0.9317,
         0.9342,  0.1237,  0.0982,  0.0733,  0.9548,  0.0302,  0.7684,
         0.5305,  0.8389,  0.8236,  0.0808,  0.0138,  0.9001,  0.2878,
         0.7667,  0.9481,  0.9464,  0.8924,  0.7488,  0.1112,  0.0752,
         0.7537,  0.0057,  0.0012,  0.9716,  0.0782,  0.0700,  0.5519,
         0.0156,  0.7738,  0.0148,  0.4335,  0.2401,  0.0305,  0.8092,
         0.0455,  0.0555,  0.7869,  0.6324,  0.6206,  0.8171,  0.8170,
         0.9758,  0.0063,  0.9328,  0.8032,  0.4424,  0.9067,  0.1088,
         0.4035,  0.1345,  0.9214,  0.0880,  0.9721,  0.8898,  0.7734,
         0.9019,  0.8326,  0.9992,  0.0938,  0.5494,  0.0627,  0.4828,
         0.9175,  0.9262,  0.1674,  0.8315,  0.0072,  0.9553,  0.9100,
         0.1479,  0.9176,  0.0670,  0.0278,  0.9665,  0.1723,  0.0159,
         0.0056,  0.8237,  0.0488,  0.8190,  0.0858,  0.8015,  0.0145,
         0.0353,  0.0966,  0.0353,  0.8084,  0.5475,  0.0823,  0.8526,
         0.3998,  0.1580,  0.1955,  0.3964,  0.9809,  0.0021,  0.8175,
         0.6981,  0.8133,  0.9514,  0.9281,  0.3918,  0.0602,  0.9993,
         0.9228,  0.9754,  0.2673,  0.0067,  0.8112,  0.2920,  0.0082,
         0.0903,  0.0233,  0.8640,  0.0053,  0.5961,  0.8874,  0.0336,
         0.9137,  0.8015,  0.0575,  0.7774,  0.8524,  0.9337,  0.0581,
         0.7763,  0.0251,  0.0760,  0.2594,  0.9628,  0.3658,  0.0126,
         0.7415,  0.0091,  0.7859,  0.9155,  0.8924,  0.9745,  0.8001,
         0.0324,  0.0964,  0.0392,  0.4894,  0.9632,  0.0715,  0.9648,
         0.9474,  0.3060,  0.0028,  0.8808,  0.4654,  0.2298,  0.1548,
         0.0702,  0.0042,  0.0107,  0.7922,  0.9694,  0.9665,  0.3189,
         0.3510,  0.0319,  0.0360,  0.1570,  0.9487,  0.7185,  0.0507,
         0.9569,  0.2890,  0.8647,  0.8364,  0.8091,  0.9362,  0.2718,
         0.0531,  0.8185,  0.9255,  0.7765,  0.9455,  0.6987,  0.9137,
         0.8113,  0.8071,  0.6682,  0.0721,  0.1584,  0.0357,  0.0450,
         0.5822,  0.9632,  0.2214,  0.1390,  0.0814,  0.2148,  0.7697,
         0.3109,  0.1865,  0.6290,  0.9641,  0.1048,  0.0172,  0.9637,
         0.0741,  0.9421,  0.7963,  0.8764,  0.1504,  0.9432,  0.7575,
         0.1904,  0.2261,  0.0316,  0.5578,  0.9314,  0.0713,  0.0442,
         0.3139,  0.9403,  0.1565,  0.4105,  0.0410,  0.1842,  0.1131,
         0.5786,  0.9076,  0.9588,  0.0550,  0.4997,  0.9180,  0.1859,
         0.1758,  0.1302,  0.0109,  0.9615,  0.1459,  0.0721,  0.9567,
         0.9483,  0.9961,  0.1936,  0.0701,  0.2199,  0.7334,  0.1660,
         0.7676,  0.9625,  0.0146,  0.8791,  0.1994,  0.0436,  0.8980,
         0.3079,  0.0394,  0.0637,  0.5122,  0.0542,  0.1823,  0.9749,
         0.9445,  0.9766,  0.1000,  0.9205,  0.7240,  0.2066,  0.9629,
         0.6285,  0.5114,  0.9720,  0.0348,  0.0437,  0.9442,  0.0801,
         0.9550,  0.0021,  0.0224,  0.8494,  0.0125,  0.8236,  0.7921,
         0.0250,  0.9564,  0.4427,  0.0357,  0.0282,  0.8254,  0.9437,
         0.9008,  0.1347,  0.8412,  0.9887,  0.4028,  0.7290,  0.0384,
         0.0080,  0.0664,  0.0310,  0.6136,  0.9673,  0.2818,  0.9565,
         0.8765,  0.1598,  0.4229,  0.0334,  0.9753,  0.9224,  0.5800,
         0.9580,  0.3331,  0.1134,  0.2526,  0.3445,  0.1129,  0.7725,
         0.6906,  0.4559,  0.3415,  0.5741,  0.0712,  0.7491,  0.0735,
         0.5524,  0.0181,  0.7175,  0.2757,  0.0515,  0.5389,  0.0132,
         0.8807,  0.4972,  0.1730,  0.0090,  0.3827,  0.0939,  0.0269,
         0.9922,  0.0932,  0.7712,  0.6939,  0.6352,  0.0280,  0.2878,
         0.0393,  0.7891,  0.0466,  0.1330,  0.9736,  0.3645,  0.0061,
         0.0314,  0.9346,  0.9638,  0.1016,  0.9075,  0.9523,  0.7255,
         0.7862,  0.1220,  0.3103,  0.0548,  0.0411,  0.9868,  0.8751,
         0.8960,  0.9613,  0.9596,  0.1160,  0.2367,  0.9156,  0.0493,
         0.0017,  0.0792,  0.6702,  0.7536,  0.0071,  0.1500,  0.7073,
         0.1938,  0.1959,  0.8594,  0.0881,  0.6754,  0.9722,  0.9838,
         0.2691], device='cuda:0')
tensor(0.2883, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1334,  0.1536,  0.0900,  0.9684,  0.0086,  0.0275,  0.9566,
         0.0147,  0.1215,  0.1362,  0.0155,  0.2133,  0.1397,  0.8630,
         0.0394,  0.0273,  0.8449,  0.0153,  0.7922,  0.0514,  0.6294,
         0.0241,  0.0792,  0.7340,  0.9233,  0.9788,  0.9723,  0.9007,
         0.9824,  0.1916,  0.9633,  0.0080,  0.8198,  0.0031,  0.9005,
         0.0521,  0.9478,  0.3464,  0.1457,  0.9428,  0.0524,  0.4346,
         0.9033,  0.0094,  0.1131,  0.1121,  0.1731,  0.8216,  0.0397,
         0.8485,  0.0929,  0.8571,  0.9713,  0.7373,  0.8530,  0.3184,
         0.3248,  0.2145,  0.5163,  0.0366,  0.0263,  0.9671,  0.9697,
         0.9492,  0.2246,  0.9647,  0.2628,  0.9561,  0.0010,  0.4827,
         0.9435,  0.1092,  0.9406,  0.9603,  0.0041,  0.7751,  0.0463,
         0.9162,  0.2266,  0.7163,  0.1085,  0.2212,  0.0127,  0.1332,
         0.0351,  0.6682,  0.9493,  0.9636,  0.0094,  0.7628,  0.7229,
         0.8596,  0.5850,  0.9621,  0.9573,  0.9288,  0.3722,  0.7911,
         0.1987,  0.8953,  0.9228,  0.9985,  0.2180,  0.8648,  0.8000,
         0.0035,  0.2079,  0.9195,  0.9088,  0.0416,  0.2238,  0.0524,
         0.0990,  0.3353,  0.0508,  0.9400,  0.0044,  0.9400,  0.0010,
         0.8241,  0.9986,  0.2169,  0.0521,  0.0412,  0.2236,  0.0400,
         0.4809,  0.9327,  0.8787,  0.1044,  0.1780,  0.9499,  0.8753,
         0.9515,  0.1173,  0.0011,  0.3846,  0.9893,  0.0326,  0.5759,
         0.9684,  0.0969,  0.0738,  0.0280,  0.8820,  0.6265,  0.2140,
         0.9847,  0.8301,  0.2479,  0.0209,  0.6529,  0.0389,  0.0143,
         0.5559,  0.0960,  0.9208,  0.0922,  0.7446,  0.0131,  0.1441,
         0.3011,  0.9935,  0.9576,  0.0340,  0.9326,  0.0105,  0.8735,
         0.0615,  0.9154,  0.9082,  0.8478,  0.6822,  0.5049,  0.0279,
         0.9307,  0.0918,  0.4784,  0.0011,  0.6754,  0.6672,  0.0144,
         0.7573,  0.9361,  0.9605,  0.9457,  0.1075,  0.2251,  0.3026,
         0.9595,  0.8817,  0.4150,  0.9593,  0.0186,  0.0042,  0.0497,
         0.8902,  0.9989,  0.8949,  0.6020,  0.4354,  0.9296,  0.7903,
         0.9836,  0.9710,  0.5219,  0.8083,  0.9426,  0.9573,  0.7004,
         0.6246,  0.9803,  0.2680,  0.9654,  0.8813,  0.9742,  0.9715,
         0.1779,  0.0237,  0.1068,  0.9067,  0.0079,  0.6235,  0.0507,
         0.6550,  0.1191,  0.1228,  0.9172,  0.0121,  0.4425,  0.0737,
         0.9762,  0.0099,  0.0441,  0.9766,  0.2639,  0.0108,  0.6273,
         0.0670,  0.1988,  0.0187,  0.7006,  0.9681,  0.9040,  0.1811,
         0.8428,  0.0485,  0.3339,  0.0073,  0.8927,  0.7939,  0.4013,
         0.9709,  0.8727,  0.9335,  0.0026,  0.4777,  0.9782,  0.5973,
         0.9739,  0.7951,  0.0062,  0.8101,  0.0062,  0.9511,  0.9418,
         0.0116,  0.5802,  0.0429,  0.0668,  0.8015,  0.9664,  0.9073,
         0.2860,  0.8721,  0.9865,  0.5527,  0.9522,  0.9802,  0.4306,
         0.1140,  0.9492,  0.0440,  0.8820,  0.5588,  0.9240,  0.8040,
         0.0569,  0.0373,  0.9843,  0.2838,  0.9726,  0.2502,  0.0239,
         0.2248,  0.9845,  0.5759,  0.9292,  0.0347,  0.9380,  0.0285,
         0.2926,  0.3998,  0.9808,  0.9876,  0.0308,  0.9698,  0.8742,
         0.1763,  0.9883,  0.9544,  0.8817,  0.0519,  0.9743,  0.8856,
         0.8022,  0.0809,  0.9567,  0.0078,  0.9554,  0.9975,  0.9473,
         0.5881,  0.1829,  0.3131,  0.0093,  0.7236,  0.3662,  0.1418,
         0.0330,  0.5381,  0.8162,  0.9424,  0.4648,  0.0101,  0.0984,
         0.0088,  0.9620,  0.1547,  0.2254,  0.0522,  0.0208,  0.7179,
         0.0175,  0.9608,  0.2585,  0.9997,  0.5976,  0.2050,  0.5865,
         0.6620,  0.6834,  0.7825,  0.8892,  0.2283,  0.8880,  0.8827,
         0.9342,  0.1013,  0.9387,  0.1418,  0.8924,  0.9754,  0.8862,
         0.8780,  0.0881,  0.0435,  0.7067,  0.6330,  0.3525,  0.9549,
         0.4147,  0.5988,  0.8864,  0.9974,  0.5620,  0.0048,  0.0412,
         0.9277,  0.4393,  0.0029,  0.9993,  0.4867,  0.3989,  0.6690,
         0.1221,  0.8351,  0.4820,  0.9595,  0.8375,  0.6215,  0.4907,
         0.2803,  0.8530,  0.7067,  0.5977,  0.7795,  0.0794,  0.0234,
         0.1814,  0.9314,  0.9907,  0.7644,  0.9492,  0.7310,  0.0769,
         0.6695,  0.4667,  0.6590,  0.9195,  0.1125,  0.3544,  0.0013,
         0.3775,  0.6753,  0.9713,  0.9698,  0.9681,  0.9751,  0.7955,
         0.3248,  0.3776,  0.9625,  0.9895,  0.0455,  0.0377,  0.7782,
         0.0575,  0.9146,  0.9829,  0.3182,  0.2148,  0.0125,  0.0162,
         0.9486,  0.0157,  0.9462,  0.0018,  0.3637,  0.6989,  0.4145,
         0.5394,  0.1486,  0.9111,  0.9861,  0.3725,  0.0861,  0.0073,
         0.9919,  0.8492,  0.8095,  0.0398,  0.0957,  0.9092,  0.8574,
         0.1811,  0.5328,  0.0556,  0.0519,  0.0594,  0.9547,  0.0064,
         0.7945,  0.8862,  0.2910,  0.5603,  0.0280,  0.3564,  0.9396,
         0.6213,  0.0179,  0.1298,  0.8120,  0.0223,  0.1413,  0.0187,
         0.0714,  0.9161,  0.0197,  0.1741,  0.0490,  0.9511,  0.9700,
         0.2082,  0.2421,  0.2227,  0.9378,  0.5981,  0.8794,  0.0439,
         0.8799,  0.8250,  0.9550,  0.0815,  0.2266,  0.9766,  0.9156,
         0.9472,  0.6769,  0.1212,  0.4910,  0.9857,  0.0894,  0.9678,
         0.0324,  0.8215,  0.6498,  0.1706,  0.0228,  0.0147,  0.9536,
         0.9425], device='cuda:0')
tensor(0.3137, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9704,  0.9129,  0.1361,  0.9082,  0.3247,  0.5974,  0.1149,
         0.1715,  0.0083,  0.2101,  0.9492,  0.9593,  0.8464,  0.0355,
         0.0250,  0.0635,  0.0248,  0.9738,  0.3629,  0.9390,  0.9646,
         0.0185,  0.0226,  0.9324,  0.2382,  0.9336,  0.7527,  0.8489,
         0.0761,  0.9117,  0.6028,  0.9822,  0.9815,  0.9754,  0.5507,
         0.8070,  0.7613,  0.9510,  0.6974,  0.2729,  0.9534,  0.7262,
         0.0673,  0.4172,  0.9306,  0.9955,  0.0635,  0.0778,  0.9483,
         0.9144,  0.9553,  0.0131,  0.0179,  0.8801,  0.0852,  0.0134,
         0.1078,  0.9606,  0.7949,  0.0879,  0.9703,  0.9694,  0.9281,
         0.8647,  0.0042,  0.4397,  0.4709,  0.9061,  0.0871,  0.1466,
         0.0187,  0.9510,  0.5868,  0.9982,  0.9877,  0.2195,  0.9980,
         0.9277,  0.9631,  0.0177,  0.9874,  0.9866,  0.8001,  0.0199,
         0.9844,  0.9162,  0.0090,  0.6502,  0.5092,  0.9443,  0.0232,
         0.4712,  0.9392,  0.0123,  0.1018,  0.3242,  0.3073,  0.1576,
         0.9820,  0.9515,  0.1482,  0.0604,  0.9908,  0.1584,  0.0141,
         0.9665,  0.0720,  0.9010,  0.9066,  0.6975,  0.8769,  0.9788,
         0.9861,  0.9084,  0.2365,  0.1996,  0.9623,  0.0116,  0.9475,
         0.0185,  0.7833,  0.0362,  0.9729,  0.9397,  0.4174,  0.8202,
         0.6653,  0.4456,  0.0140,  0.0099,  0.1518,  0.0515,  0.0086,
         0.0382,  0.4388,  0.0564,  0.0228,  0.1167,  0.9038,  0.0364,
         0.0070,  0.8503,  0.2428,  0.9449,  0.0068,  0.0063,  0.8938,
         0.7963,  0.2847,  0.1623,  0.0663,  0.9108,  0.9292,  0.8206,
         0.8953,  0.0765,  0.9829,  0.9175,  0.1514,  0.9378,  0.5126,
         0.7481,  0.9762,  0.0136,  0.0349,  0.0694,  0.8199,  0.0792,
         0.0040,  0.8636,  0.9734,  0.0131,  0.0384,  0.5263,  0.0874,
         0.6303,  0.8585,  0.9752,  0.0133,  0.0114,  0.9211,  0.2420,
         0.9789,  0.8952,  0.1541,  0.6580,  0.0096,  0.9573,  0.9688,
         0.0127,  0.9715,  0.0056,  0.8882,  0.4642,  0.7269,  0.7648,
         0.0420,  0.9045,  0.9949,  0.9534,  0.2416,  0.1144,  0.8313,
         0.8802,  0.5978,  0.0214,  0.9854,  0.0649,  0.9253,  0.0140,
         0.1371,  0.0160,  0.7702,  0.9628,  0.9503,  0.0317,  0.0992,
         0.1607,  0.7942,  0.2052,  0.0717,  0.0294,  0.0373,  0.6535,
         0.8384,  0.2724,  0.9469,  0.8454,  0.7704,  0.8247,  0.0412,
         0.9448,  0.1217,  0.4458,  0.8380,  0.0617,  0.0479,  0.0147,
         0.9567,  0.1028,  0.2379,  0.9861,  0.8963,  0.9619,  0.1092,
         0.0518,  0.8256,  0.0175,  0.0921,  0.8800,  0.9244,  0.9078,
         0.8525,  0.0035,  0.9615,  0.3363,  0.0929,  0.6311,  0.9609,
         0.9572,  0.0343,  0.9378,  0.8376,  0.9455,  0.8915,  0.9989,
         0.5288,  0.0080,  0.9551,  0.0124,  0.0795,  0.7803,  0.0031,
         0.0339,  0.9014,  0.1760,  0.0375,  0.9957,  0.0991,  0.9013,
         0.0778,  0.9811,  0.9777,  0.0200,  0.9076,  0.0379,  0.0791,
         0.0368,  0.0453,  0.9480,  0.9280,  0.8942,  0.0192,  0.1597,
         0.2656,  0.9263,  0.0647,  0.0386,  0.0183,  0.8673,  0.9575,
         0.0482,  0.9477,  0.9890,  0.9799,  0.0505,  0.9748,  0.4993,
         0.9461,  0.8538,  0.0111,  0.9261,  0.3523,  0.0644,  0.3809,
         0.6523,  0.0363,  0.9186,  0.2704,  0.0372,  0.5464,  0.9990,
         0.9409,  0.0135,  0.9672,  0.0032,  0.5454,  0.1560,  0.7816,
         0.9700,  0.7960,  0.8200,  0.5176,  0.7743,  0.8949,  0.6027,
         0.8654,  0.8497,  0.0327,  0.0256,  0.9382,  0.9978,  0.2574,
         0.9993,  0.0122,  0.7827,  0.5393,  0.9712,  0.1136,  0.9664,
         0.9995,  0.0829,  0.2447,  0.9105,  0.8951,  0.9516,  0.9738,
         0.8756,  0.9364,  0.4981,  0.0329,  0.9778,  0.8688,  0.0386,
         0.9879,  0.9905,  0.8634,  0.9282,  0.0213,  0.9816,  0.2167,
         0.1229,  0.0040,  0.9867,  0.1159,  0.2241,  0.2214,  0.0858,
         0.0103,  0.0470,  0.3006,  0.4755,  0.2695,  0.2515,  0.5727,
         0.9441,  0.9929,  0.9699,  0.0074,  0.4877,  0.9540,  0.6234,
         0.8833,  0.8471,  0.9447,  0.4104,  0.1598,  0.7169,  0.0475,
         0.9718,  0.0026,  0.3901,  0.9416,  0.0034,  0.8148,  0.0537,
         0.0105,  0.9662,  0.1433,  0.1887,  0.0615,  0.2514,  0.4186,
         0.0137,  0.9517,  0.9036,  0.0203,  0.2852,  0.0645,  0.4454,
         0.3047,  0.1260,  0.1458,  0.4761,  0.0181,  0.0058,  0.9159,
         0.0276,  0.0321,  0.0424,  0.9274,  0.1843,  0.9767,  0.0334,
         0.0465,  0.6774,  0.6859,  0.8559,  0.0589,  0.8951,  0.9957,
         0.1941,  0.2744,  0.1321,  0.0698,  0.8633,  0.9054,  0.9985,
         0.9293,  0.9666,  0.9676,  0.0809,  0.7396,  0.8321,  0.9447,
         0.6719,  0.5642,  0.0251,  0.9674,  0.4639,  0.7514,  0.8698,
         0.0568,  0.0754,  0.1978,  0.9648,  0.9711,  0.0855,  0.8905,
         0.1392,  0.8919,  0.6307,  0.9097,  0.2510,  0.9481,  0.4452,
         0.9448,  0.0590,  0.0127,  0.2330,  0.9522,  0.9000,  0.0098,
         0.6924,  0.0539,  0.5309,  0.9239,  0.9558,  0.9317,  0.8900,
         0.9285,  0.9854,  0.0976,  0.1369,  0.9533,  0.0325,  0.2024,
         0.2747,  0.9451,  0.0354,  0.1101,  0.9698,  0.7553,  0.9996,
         0.9265,  0.0086,  0.0876,  0.3462,  0.9363,  0.0092,  0.9830,
         0.1373], device='cuda:0')
tensor(0.2900, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2300,  0.9045,  0.0082,  0.8496,  0.9993,  0.9982,  0.1312,
         0.6168,  0.9667,  0.8389,  0.0755,  0.1147,  0.9348,  0.8868,
         0.9530,  0.9737,  0.5179,  0.9294,  0.9569,  0.8897,  0.0064,
         0.0036,  0.2010,  0.0256,  0.0007,  0.0489,  0.6923,  0.9324,
         0.9843,  0.9475,  0.8768,  0.9429,  0.4960,  0.0192,  0.1990,
         0.8944,  0.0049,  0.9554,  0.2959,  0.0229,  0.8892,  0.1432,
         0.1943,  0.9815,  0.0588,  0.9448,  0.9127,  0.9585,  0.2776,
         0.6580,  0.0840,  0.8365,  0.0067,  0.5191,  0.0828,  0.0749,
         0.0152,  0.7693,  0.3724,  0.9966,  0.9574,  0.9774,  0.9396,
         0.9462,  0.8666,  0.3602,  0.4292,  0.0090,  0.0409,  0.2684,
         0.8994,  0.7739,  0.8495,  0.8932,  0.0626,  0.8988,  0.9280,
         0.0197,  0.9303,  0.8924,  0.0226,  0.0045,  0.9267,  0.9775,
         0.0300,  0.0046,  0.1285,  0.9796,  0.9021,  0.0072,  0.5747,
         0.9960,  0.0430,  0.0967,  0.0605,  0.0968,  0.0078,  0.9861,
         0.8472,  0.9268,  0.0123,  0.0503,  0.1047,  0.9967,  0.0870,
         0.9772,  0.9599,  0.2227,  0.9300,  0.0088,  0.9175,  0.7811,
         0.2443,  0.9511,  0.0097,  0.9117,  0.1398,  0.1278,  0.3973,
         0.0116,  0.9978,  0.2009,  0.7144,  0.8463,  0.9233,  0.9988,
         0.6213,  0.9498,  0.0410,  0.9560,  0.9832,  0.4313,  0.9797,
         0.9912,  0.0077,  0.0800,  0.9223,  0.0128,  0.6119,  0.0255,
         0.0217,  0.9778,  0.0067,  0.9382,  0.0028,  0.9370,  0.1991,
         0.9269,  0.0074,  0.0088,  0.0635,  0.3371,  0.6639,  0.1408,
         0.0679,  0.9504,  0.0501,  0.5261,  0.9674,  0.9996,  0.8834,
         0.9619,  0.7799,  0.1357,  0.1191,  0.0226,  0.0634,  0.8811,
         0.0272,  0.0165,  0.5498,  0.9710,  0.9981,  0.8493,  0.1242,
         0.9559,  0.9659,  0.9504,  0.0125,  0.1775,  0.9008,  0.0090,
         0.6375,  0.9574,  0.7652,  0.9548,  0.9942,  0.9598,  0.5159,
         0.2952,  0.9896,  0.9645,  0.0711,  0.0150,  0.0114,  0.9729,
         0.9838,  0.9821,  0.0263,  0.9995,  0.0115,  0.6442,  0.8209,
         0.9938,  0.0737,  0.0919,  0.1214,  0.0419,  0.0185,  0.0210,
         0.9465,  0.0030,  0.0665,  0.0069,  0.7645,  0.0991,  0.9963,
         0.9674,  0.0441,  0.0688,  0.9783,  0.0011,  0.9757,  0.0888,
         0.0050,  0.0010,  0.0685,  0.8397,  0.0631,  0.8580,  0.0088,
         0.0047,  0.9716,  0.9543,  0.4068,  0.7171,  0.1141,  0.0693,
         0.8859,  0.0175,  0.0312,  0.0307,  0.9840,  0.6580,  0.1181,
         0.5461,  0.1003,  0.9872,  0.9922,  0.2891,  0.1000,  0.0743,
         0.0452,  0.9481,  0.9756,  0.8538,  0.9606,  0.1920,  0.0428,
         0.0418,  0.7785,  0.9677,  0.8595,  0.7962,  0.0605,  0.0013,
         0.9415,  0.5016,  0.0666,  0.6665,  0.0412,  0.0315,  0.8134,
         0.9820,  0.8957,  0.9719,  0.1413,  0.8264,  0.0676,  0.8703,
         0.0919,  0.0280,  0.9459,  0.0362,  0.9837,  0.9557,  0.9703,
         0.0209,  0.6498,  0.0913,  0.8873,  0.7667,  0.9851,  0.9613,
         0.0349,  0.9743,  0.9315,  0.8302,  0.9969,  0.0088,  0.0603,
         0.9922,  0.0818,  0.8452,  0.0271,  0.6412,  0.9406,  0.9891,
         0.0277,  0.9491,  0.9381,  0.1022,  0.0253,  0.9844,  0.4856,
         0.7537,  0.9286,  0.2328,  0.9243,  0.6859,  0.9559,  0.0123,
         0.6922,  0.8069,  0.1031,  0.9770,  0.9790,  0.8932,  0.4404,
         0.0475,  0.1357,  0.2004,  0.0239,  0.9478,  0.8797,  0.0005,
         0.9567,  0.9070,  0.0223,  0.9888,  0.9990,  0.9434,  0.0325,
         0.0244,  0.9079,  0.0242,  0.9196,  0.5567,  0.2637,  0.0444,
         0.8486,  0.9289,  0.9905,  0.3287,  0.9386,  0.9162,  0.1648,
         0.8404,  0.0431,  0.0488,  0.0006,  0.9839,  0.0534,  0.9573,
         0.9676,  0.1510,  0.0223,  0.0400,  0.9883,  0.9519,  0.9169,
         0.5395,  0.9765,  0.8758,  0.2377,  0.0177,  0.0069,  0.2767,
         0.0422,  0.9123,  0.9864,  0.1924,  0.0044,  0.0410,  0.9951,
         0.7987,  0.0293,  0.2493,  0.9893,  0.5048,  0.9918,  0.9420,
         0.0048,  0.1853,  0.9413,  0.8271,  0.8586,  0.0103,  0.1401,
         0.9910,  0.9584,  0.0093,  0.6781,  0.0117,  0.6696,  0.9606,
         0.0125,  0.9383,  0.0782,  0.9264,  0.8866,  0.9727,  0.0157,
         0.1853,  0.0039,  0.9548,  0.5720,  0.3456,  0.9545,  0.0157,
         0.0777,  0.0123,  0.0053,  0.0922,  0.9429,  0.0006,  0.9497,
         0.1590,  0.2671,  0.9504,  0.2948,  0.0058,  0.5178,  0.0563,
         0.9583,  0.0219,  0.7146,  0.9780,  0.9963,  0.9291,  0.0211,
         0.0782,  0.9869,  0.7144,  0.1407,  0.0565,  0.0100,  0.1034,
         0.9833,  0.5312,  0.0128,  0.0136,  0.3356,  0.9119,  0.0972,
         0.9665,  0.0131,  0.6055,  0.1776,  0.9908,  0.6055,  0.9977,
         0.0598,  0.4842,  0.9671,  0.3052,  0.9656,  0.9530,  0.1429,
         0.9834,  0.0503,  0.9619,  0.2597,  0.1150,  0.4860,  0.0135,
         0.9352,  0.9975,  0.9859,  0.0089,  0.9697,  0.8018,  0.2850,
         0.2300,  0.0021,  0.7891,  0.9262,  0.1123,  0.9838,  0.8426,
         0.0081,  0.9299,  0.3394,  0.0196,  0.1457,  0.8257,  0.2150,
         0.9563,  0.8588,  0.0055,  0.7199,  0.2247,  0.0049,  0.6411,
         0.9824,  0.8415,  0.0691,  0.0173,  0.9521,  0.0164,  0.9080,
         0.0128], device='cuda:0')
tensor(0.3428, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9732,  0.0454,  0.0302,  0.0067,  0.0400,  0.1165,  0.1057,
         0.9550,  0.9114,  0.0661,  0.7327,  0.9532,  0.2275,  0.1033,
         0.9592,  0.9241,  0.0207,  0.8563,  0.0427,  0.9991,  0.1778,
         0.8072,  0.9993,  0.0310,  0.5034,  0.0087,  0.9972,  0.9480,
         0.9080,  0.0300,  0.1139,  0.0730,  0.0618,  0.9551,  0.0377,
         0.4791,  0.3152,  0.0237,  0.9610,  0.2459,  0.0086,  0.0164,
         0.0171,  0.1431,  0.9848,  0.1318,  0.8779,  0.9274,  0.8768,
         0.1211,  0.1281,  0.8838,  0.0933,  0.8237,  0.0123,  0.1728,
         0.9563,  0.8036,  0.0095,  0.0128,  0.8066,  0.0469,  0.9335,
         0.0183,  0.1921,  0.6054,  0.9377,  0.0100,  0.9623,  0.8859,
         0.4992,  0.0038,  0.0603,  0.1692,  0.6001,  0.2744,  0.1552,
         0.9071,  0.9687,  0.0055,  0.8960,  0.9956,  0.1984,  0.7934,
         0.0055,  0.9963,  0.9505,  0.2590,  0.0038,  0.0228,  0.9344,
         0.9834,  0.5632,  0.9600,  0.1632,  0.9638,  0.9859,  0.0827,
         0.9470,  0.9056,  0.9976,  0.0268,  0.6263,  0.3947,  0.2584,
         0.9521,  0.9142,  0.9785,  0.9999,  0.4464,  0.9872,  0.9743,
         0.0418,  0.0287,  0.1214,  0.0278,  0.0696,  0.3033,  0.9849,
         0.9457,  0.9709,  0.9643,  0.0213,  0.9808,  0.8308,  0.9916,
         0.0920,  0.0340,  0.5309,  0.8218,  0.2639,  0.0586,  0.0432,
         0.9226,  0.5599,  0.0249,  0.8669,  0.3355,  0.7534,  0.2622,
         0.1021,  0.9977,  0.0344,  0.0155,  0.8473,  0.3537,  0.0490,
         0.1983,  0.0035,  0.7145,  0.1100,  0.6929,  0.0794,  0.9572,
         0.9501,  0.1032,  0.0346,  0.9711,  0.9638,  0.4689,  0.9650,
         0.8998,  0.9840,  0.2846,  0.0629,  0.0342,  0.4675,  0.8753,
         0.8758,  0.5179,  0.0604,  0.0922,  0.9335,  0.1789,  0.1372,
         0.2943,  0.0170,  0.1327,  0.0610,  0.0577,  0.9760,  0.0216,
         0.0015,  0.8510,  0.0263,  0.0530,  0.9002,  0.1928,  0.9823,
         0.0086,  0.0471,  0.5422,  0.7668,  0.0860,  0.6607,  0.7549,
         0.8540,  0.0845,  0.1336,  0.6304,  0.5732,  0.9350,  0.9752,
         0.0195,  0.0252,  0.8103,  0.9888,  0.0880,  0.5443,  0.9027,
         0.0128,  0.0142,  0.0209,  0.0070,  0.9213,  0.6124,  0.0725,
         0.0013,  0.7890,  0.9763,  0.1143,  0.8849,  0.9625,  0.8333,
         0.0375,  0.8396,  0.5764,  0.1408,  0.5263,  0.0159,  0.0990,
         0.0194,  0.0987,  0.9798,  0.9590,  0.7142,  0.0335,  0.8327,
         0.8857,  0.1039,  0.9961,  0.9973,  0.3559,  0.0421,  0.0315,
         0.0151,  0.0129,  0.1041,  0.6839,  0.9368,  0.0194,  0.9732,
         0.8740,  0.1931,  0.9564,  0.9386,  0.1199,  0.2026,  0.9439,
         0.9587,  0.9884,  0.7120,  0.6754,  0.9338,  0.0629,  0.9621,
         0.9335,  0.9829,  0.3919,  0.6219,  0.0490,  0.8717,  0.4621,
         0.6788,  0.0916,  0.9601,  0.8277,  0.6422,  0.0523,  0.9814,
         0.8393,  0.9521,  0.0166,  0.9486,  0.7880,  0.0143,  0.8524,
         0.0129,  0.9524,  0.0199,  0.5538,  0.9378,  0.9561,  0.9087,
         0.4838,  0.9534,  0.7637,  0.0133,  0.9987,  0.0159,  0.2199,
         0.9059,  0.9533,  0.9146,  0.8705,  0.0281,  0.0369,  0.0272,
         0.9692,  0.9365,  0.2688,  0.0037,  0.9614,  0.0637,  0.9146,
         0.0733,  0.0624,  0.8741,  0.0300,  0.3383,  0.0581,  0.2918,
         0.5797,  0.2416,  0.0162,  0.0334,  0.9487,  0.8658,  0.5145,
         0.0384,  0.9142,  0.9358,  0.4086,  0.0025,  0.9396,  0.7325,
         0.9711,  0.8310,  0.0375,  0.7622,  0.5649,  0.6941,  0.9908,
         0.1298,  0.1968,  0.4033,  0.0132,  0.0363,  0.0560,  0.9793,
         0.8109,  0.9570,  0.9596,  0.9139,  0.9409,  0.4381,  0.9875,
         0.0271,  0.1376,  0.8318,  0.9790,  0.2931,  0.9653,  0.8717,
         0.9836,  0.9239,  0.8572,  0.8384,  0.9448,  0.4443,  0.6620,
         0.5875,  0.0049,  0.9727,  0.0142,  0.9690,  0.0226,  0.8015,
         0.2086,  0.9995,  0.1119,  0.9790,  0.0220,  0.9895,  0.9988,
         0.9528,  0.9658,  0.7788,  0.5894,  0.0769,  0.3081,  0.0187,
         0.0292,  0.8549,  0.7021,  0.3798,  0.9921,  0.0775,  0.0267,
         0.6531,  0.8999,  0.0983,  0.8329,  0.9559,  0.9056,  0.9481,
         0.9703,  0.8894,  0.9606,  0.8647,  0.8019,  0.0917,  0.2815,
         0.9933,  0.9738,  0.9522,  0.9742,  0.1707,  0.9786,  0.9868,
         0.9748,  0.7562,  0.6887,  0.9608,  0.6450,  0.0089,  0.0820,
         0.8446,  0.8587,  0.0387,  0.9248,  0.9158,  0.9756,  0.8966,
         0.7976,  0.1425,  0.5809,  0.8733,  0.0452,  0.0424,  0.0209,
         0.1002,  0.2169,  0.8992,  0.1669,  0.9970,  0.8214,  0.0530,
         0.9974,  0.0081,  0.0230,  0.0127,  0.3782,  0.9628,  0.2225,
         0.8920,  0.9597,  0.9768,  0.0486,  0.9818,  0.9372,  0.9237,
         0.2302,  0.2382,  0.9762,  0.0931,  0.9807,  0.0143,  0.0040,
         0.5718,  0.9887,  0.9985,  0.7125,  0.1638,  0.0185,  0.0655,
         0.9868,  0.1456,  0.7400,  0.9820,  0.4382,  0.0706,  0.0089,
         0.2765,  0.0485,  0.2412,  0.2000,  0.4426,  0.9051,  0.9293,
         0.8401,  0.0039,  0.0978,  0.6634,  0.9690,  0.6995,  0.9239,
         0.9548,  0.0146,  0.8826,  0.0964,  0.1635,  0.8481,  0.0811,
         0.0051,  0.1252,  0.0014,  0.9077,  0.8813,  0.9968,  0.1712,
         0.9139], device='cuda:0')
tensor(0.3221, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9568,  0.8940,  0.8798,  0.8607,  0.8843,  0.5593,  0.9745,
         0.4742,  0.1186,  0.1968,  0.9824,  0.7391,  0.0748,  0.6355,
         0.4138,  0.4227,  0.9365,  0.7106,  0.9803,  0.5547,  0.9708,
         0.0027,  0.2436,  0.0203,  0.9878,  0.9880,  0.9026,  0.9049,
         0.8491,  0.0605,  0.1472,  0.9451,  0.0030,  0.9967,  0.1418,
         0.7236,  0.0183,  0.9004,  0.8944,  0.9732,  0.0260,  0.9778,
         0.9200,  0.9637,  0.7251,  0.2622,  0.4977,  0.9874,  0.3627,
         0.9744,  0.0909,  0.2104,  0.2251,  0.0961,  0.0868,  0.9699,
         0.9726,  0.0400,  0.8639,  0.9368,  0.9278,  0.4279,  0.0091,
         0.7603,  0.9131,  0.2076,  0.7824,  0.6428,  0.0660,  0.0440,
         0.0241,  0.8437,  0.2602,  0.1163,  0.0349,  0.6457,  0.9439,
         0.8246,  0.0080,  0.1077,  0.9421,  0.0960,  0.9887,  0.0153,
         0.8658,  0.0037,  0.9195,  0.0415,  0.7458,  0.9827,  0.0420,
         0.8705,  0.4627,  0.0868,  0.9674,  0.5932,  0.6711,  0.9763,
         0.0539,  0.6363,  0.7295,  0.0242,  0.0059,  0.8815,  0.0890,
         0.0169,  0.9778,  0.9679,  0.0332,  0.0893,  0.7025,  0.9748,
         0.3619,  0.0016,  0.0660,  0.2940,  0.9139,  0.2158,  0.9398,
         0.9997,  0.0717,  0.9402,  0.0160,  0.8202,  0.6997,  0.0361,
         0.0557,  0.9219,  0.0382,  0.0128,  0.9743,  0.8052,  0.0057,
         0.9849,  0.0736,  0.9481,  0.1999,  0.7790,  0.0188,  0.7745,
         0.9013,  0.2838,  0.0027,  0.9889,  0.0803,  0.1238,  0.9595,
         0.1493,  0.0960,  0.9487,  0.0425,  0.8898,  0.4135,  0.0541,
         0.8164,  0.8010,  0.0130,  0.1113,  0.4605,  0.9918,  0.9544,
         0.0482,  0.0142,  0.0009,  0.0386,  0.9992,  0.9940,  0.8589,
         0.0205,  0.5601,  0.8771,  0.8509,  0.0424,  0.0212,  0.9428,
         0.9573,  0.0184,  0.0473,  0.0110,  0.2572,  0.5825,  0.0065,
         0.0450,  0.1124,  0.6812,  0.2100,  0.6991,  0.8783,  0.0019,
         0.0007,  0.8606,  0.9727,  0.9472,  0.8966,  0.9192,  0.0221,
         0.6849,  0.6297,  0.4742,  0.5654,  0.0086,  0.7319,  0.8732,
         0.0900,  0.9967,  0.8924,  0.7463,  0.9808,  0.8352,  0.0565,
         0.9793,  0.8897,  0.9814,  0.9701,  0.9441,  0.0384,  0.3777,
         0.2364,  0.0126,  0.7684,  0.9351,  0.0736,  0.7998,  0.6153,
         0.4639,  0.8094,  0.0750,  0.8779,  0.8063,  0.0775,  0.9493,
         0.9185,  0.9862,  0.4108,  0.0178,  0.7570,  0.9463,  0.1008,
         0.0015,  0.7555,  0.9560,  0.9079,  0.0974,  0.8806,  0.8009,
         0.6495,  0.9326,  0.8254,  0.5406,  0.0915,  0.7644,  0.0176,
         0.4396,  0.5275,  0.9145,  0.8989,  0.5634,  0.3127,  0.0067,
         0.1176,  0.8844,  0.9818,  0.1069,  0.0744,  0.1446,  0.0623,
         0.0053,  0.7641,  0.9443,  0.2774,  0.0261,  0.8778,  0.0097,
         0.1886,  0.0122,  0.9379,  0.8885,  0.0073,  0.9311,  0.0482,
         0.0801,  0.2751,  0.4008,  0.9180,  0.9763,  0.4242,  0.8788,
         0.7845,  0.9553,  0.5150,  0.2370,  0.0150,  0.8940,  0.9054,
         0.9695,  0.1603,  0.8746,  0.9052,  0.0096,  0.9781,  0.0517,
         0.0412,  0.9196,  0.0129,  0.7616,  0.0189,  0.9772,  0.0015,
         0.1322,  0.9317,  0.0701,  0.0521,  0.1056,  0.0603,  0.8924,
         0.0310,  0.1215,  0.0139,  0.0025,  0.0430,  0.1581,  0.9461,
         0.8032,  0.0204,  0.8492,  0.0559,  0.9008,  0.9064,  0.3905,
         0.9207,  0.2009,  0.9983,  0.6147,  0.0380,  0.2577,  0.9407,
         0.4473,  0.0320,  0.8344,  0.9663,  0.0779,  0.0772,  0.9831,
         0.9242,  0.9263,  0.9974,  0.9937,  0.8395,  0.2315,  0.4926,
         0.0815,  0.1037,  0.9670,  0.0816,  0.0268,  0.8083,  0.0190,
         0.0876,  0.9733,  0.3151,  0.1565,  0.7817,  0.0133,  0.9776,
         0.0125,  0.0714,  0.9583,  0.9603,  0.0665,  0.9422,  0.0438,
         0.0010,  0.2680,  0.9398,  0.0028,  0.0593,  0.9479,  0.6811,
         0.2140,  0.8937,  0.9217,  0.8563,  0.8949,  0.9850,  0.1437,
         0.0630,  0.1278,  0.9821,  0.2873,  0.9523,  0.7696,  0.3085,
         0.9836,  0.7188,  0.0024,  0.0988,  0.0942,  0.9810,  0.9402,
         0.0835,  0.8791,  0.6343,  0.9275,  0.0381,  0.0885,  0.0061,
         0.5550,  0.0048,  0.7323,  0.0203,  0.0223,  0.5229,  0.6965,
         0.9784,  0.1215,  0.3978,  0.9990,  0.0051,  0.0592,  0.8033,
         0.0201,  0.1727,  0.7705,  0.1144,  0.4526,  0.4164,  0.0467,
         0.9594,  0.0063,  0.0689,  0.7776,  0.2823,  0.9552,  0.0143,
         0.9381,  0.0479,  0.6997,  0.9529,  0.9329,  0.9790,  0.0130,
         0.0183,  0.9029,  0.1686,  0.8806,  0.8159,  0.8038,  0.9861,
         0.1259,  0.9503,  0.8164,  0.6235,  0.9753,  0.8784,  0.5944,
         0.9650,  0.9553,  0.2480,  0.0394,  0.2777,  0.9238,  0.1299,
         0.0492,  0.2356,  0.0253,  0.0700,  0.2136,  0.7825,  0.7205,
         0.0299,  0.0584,  0.9296,  0.0066,  0.0398,  0.9893,  0.0296,
         0.8283,  0.0076,  0.2037,  0.5607,  0.9020,  0.1131,  0.5826,
         0.1939,  0.9304,  0.0867,  0.9574,  0.0273,  0.7071,  0.6988,
         0.2597,  0.6152,  0.9845,  0.1115,  0.9594,  0.9474,  0.1901,
         0.2753,  0.0212,  0.9467,  0.8741,  0.9772,  0.6335,  0.1319,
         0.2802,  0.9856,  0.8474,  0.8534,  0.9671,  0.9764,  0.8669,
         0.0199], device='cuda:0')
tensor(0.2692, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9751,  0.0344,  0.7562,  0.9297,  0.9040,  0.8571,  0.8846,
         0.5846,  0.0245,  0.8376,  0.0907,  0.9921,  0.9401,  0.2930,
         0.9499,  0.0330,  0.3082,  0.1977,  0.7595,  0.8440,  0.0584,
         0.9979,  0.0605,  0.5099,  0.5449,  0.4743,  0.2296,  0.1256,
         0.1367,  0.9783,  0.0666,  0.9267,  0.8206,  0.3243,  0.0227,
         0.0058,  0.0270,  0.0085,  0.1307,  0.9857,  0.0176,  0.0241,
         0.5149,  0.6886,  0.6797,  0.9849,  0.9570,  0.4042,  0.2142,
         0.0362,  0.9274,  0.0036,  0.3997,  0.2450,  0.9963,  0.6835,
         0.0355,  0.1198,  0.7687,  0.9834,  0.8410,  0.6155,  0.7241,
         0.2498,  0.9582,  0.9509,  0.0034,  0.9468,  0.8027,  0.7577,
         0.7429,  0.9126,  0.0115,  0.9208,  0.9922,  0.9798,  0.0375,
         0.8167,  0.5166,  0.1994,  0.8638,  0.8841,  0.8572,  0.0679,
         0.1036,  0.9479,  0.0053,  0.7695,  0.1063,  0.0710,  0.0172,
         0.2765,  0.8604,  0.6002,  0.1590,  0.9584,  0.0810,  0.5033,
         0.3788,  0.9400,  0.1162,  0.9787,  0.0013,  0.0095,  0.1304,
         0.9914,  0.0732,  0.6555,  0.6261,  0.5422,  0.3424,  0.7472,
         0.9167,  0.9538,  0.4695,  0.8961,  0.0435,  0.8630,  0.9389,
         0.5852,  0.9325,  0.8536,  0.0370,  0.9278,  0.8216,  0.4356,
         0.9756,  0.4484,  0.9980,  0.8717,  0.5209,  0.9490,  0.7278,
         0.1355,  0.0342,  0.9882,  0.8998,  0.9152,  0.6766,  0.0555,
         0.8382,  0.0680,  0.1535,  0.1043,  0.7560,  0.0116,  0.9616,
         0.9043,  0.8948,  0.8131,  0.9988,  0.9876,  0.9135,  0.6510,
         0.4814,  0.9561,  0.0242,  0.0981,  0.0064,  0.8502,  0.0021,
         0.1091,  0.7183,  0.1824,  0.0107,  0.9193,  0.7959,  0.1694,
         0.9707,  0.0076,  0.7859,  0.8819,  0.9606,  0.1479,  0.8037,
         0.7224,  0.8818,  0.3678,  0.9678,  0.9137,  0.0275,  0.0476,
         0.5196,  0.0631,  0.1968,  0.8139,  0.9000,  0.6513,  0.7539,
         0.9523,  0.6645,  0.8853,  0.0275,  0.8961,  0.1152,  0.8314,
         0.0366,  0.8901,  0.8938,  0.1862,  0.9103,  0.0020,  0.0035,
         0.0473,  0.1604,  0.6061,  0.2654,  0.8467,  0.9218,  0.8368,
         0.7887,  0.9216,  0.0041,  0.8531,  0.5079,  0.1568,  0.0618,
         0.9895,  0.5446,  0.6501,  0.9375,  0.1638,  0.9485,  0.7759,
         0.9604,  0.7850,  0.7481,  0.0087,  0.9721,  0.2955,  0.0242,
         0.9717,  0.8863,  0.9884,  0.0068,  0.2062,  0.5270,  0.3074,
         0.8952,  0.3674,  0.6737,  0.9743,  0.3531,  0.9730,  0.2979,
         0.9814,  0.0400,  0.0246,  0.1122,  0.9826,  0.8593,  0.2484,
         0.7357,  0.8063,  0.0479,  0.9155,  0.0356,  0.8448,  0.9770,
         0.8518,  0.1255,  0.3009,  0.4132,  0.1481,  0.8931,  0.2001,
         0.8535,  0.0217,  0.1202,  0.0329,  0.0344,  0.0041,  0.9544,
         0.8027,  0.8340,  0.0954,  0.0328,  0.0258,  0.1332,  0.0282,
         0.3037,  0.2367,  0.8608,  0.3747,  0.0374,  0.0122,  0.5499,
         0.4613,  0.8520,  0.2921,  0.0223,  0.4913,  0.7927,  0.0706,
         0.9622,  0.9209,  0.0395,  0.8468,  0.1098,  0.0076,  0.0312,
         0.3593,  0.0477,  0.9553,  0.9989,  0.0104,  0.2956,  0.0134,
         0.3054,  0.6289,  0.0219,  0.7018,  0.1636,  0.0201,  0.0308,
         0.9018,  0.5289,  0.0327,  0.9509,  0.8642,  0.1892,  0.6457,
         0.0342,  0.0815,  0.9247,  0.9356,  0.0140,  0.8031,  0.0122,
         0.0372,  0.0479,  0.1001,  0.5487,  0.1744,  0.8311,  0.0686,
         0.0619,  0.8254,  0.2172,  0.0941,  0.9859,  0.7687,  0.0674,
         0.8700,  0.2893,  0.8426,  0.6406,  0.9835,  0.1097,  0.7489,
         0.7783,  0.0973,  0.7379,  0.6477,  0.5855,  0.9614,  0.4226,
         0.9281,  0.9610,  0.9948,  0.8346,  0.9480,  0.8780,  0.8616,
         0.8538,  0.7872,  0.8859,  0.9440,  0.6659,  0.3643,  0.3153,
         0.0650,  0.4302,  0.8776,  0.1130,  0.9697,  0.6321,  0.4609,
         0.0592,  0.6579,  0.0674,  0.9929,  0.9726,  0.8663,  0.8892,
         0.9866,  0.4386,  0.9235,  0.0941,  0.9760,  0.0381,  0.8286,
         0.1125,  0.9926,  0.8725,  0.8555,  0.9606,  0.0024,  0.0969,
         0.7745,  0.9194,  0.1889,  0.6963,  0.6752,  0.9216,  0.6248,
         0.1485,  0.9000,  0.5973,  0.0386,  0.9502,  0.0038,  0.9174,
         0.0348,  0.8452,  0.8776,  0.7406,  0.1033,  0.0754,  0.6718,
         0.5528,  0.2111,  0.6297,  0.8783,  0.9457,  0.0147,  0.6182,
         0.0255,  0.6150,  0.2109,  0.1779,  0.5835,  0.8846,  0.9524,
         0.8443,  0.2212,  0.9379,  0.9388,  0.1967,  0.9595,  0.7463,
         0.4566,  0.0124,  0.2782,  0.9115,  0.1471,  0.7880,  0.8637,
         0.9264,  0.7520,  0.7640,  0.0430,  0.8940,  0.0735,  0.4458,
         0.5156,  0.3988,  0.9751,  0.8749,  0.5620,  0.9841,  0.9665,
         0.7944,  0.5915,  0.6900,  0.6682,  0.7845,  0.9770,  0.9381,
         0.7379,  0.0888,  0.2295,  0.8085,  0.3287,  0.8629,  0.1293,
         0.0076,  0.2988,  0.9125,  0.7842,  0.1852,  0.2838,  0.6495,
         0.9983,  0.7832,  0.4903,  0.0290,  0.0902,  0.3190,  0.9547,
         0.9958,  0.1772,  0.9342,  0.7248,  0.3147,  0.2214,  0.9915,
         0.0286,  0.3817,  0.0417,  0.3535,  0.0248,  0.0130,  0.2064,
         0.7700,  0.2784,  0.0335,  0.1344,  0.6234,  0.9456,  0.9436,
         0.9095], device='cuda:0')
tensor(0.3202, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7316,  0.0941,  0.9352,  0.9368,  0.7644,  0.7655,  0.2852,
         0.2624,  0.3007,  0.9967,  0.9991,  0.0787,  0.9510,  0.9512,
         0.8887,  0.1201,  0.0106,  0.7729,  0.0009,  0.5999,  0.0981,
         0.0097,  0.7483,  0.1589,  0.1921,  0.9420,  0.5160,  0.8799,
         0.9833,  0.0107,  0.6142,  0.2256,  0.0032,  0.2014,  0.2745,
         0.0523,  0.9473,  0.0412,  0.0696,  0.4160,  0.0121,  0.9900,
         0.0359,  0.0035,  0.9125,  0.9634,  0.9202,  0.7713,  0.9428,
         0.7722,  0.4682,  0.7472,  0.5156,  0.2522,  0.6522,  0.9041,
         0.5819,  0.0038,  0.5944,  0.7032,  0.0217,  0.9360,  0.0093,
         0.8337,  0.0483,  0.8822,  0.0597,  0.8836,  0.2912,  0.5508,
         0.8525,  0.3967,  0.0225,  0.8725,  0.8658,  0.0175,  0.9167,
         0.2109,  0.0054,  0.6418,  0.8629,  0.1884,  0.5593,  0.8539,
         0.7324,  0.6132,  0.1455,  0.3377,  0.9429,  0.9870,  0.8656,
         0.3171,  0.7133,  0.2658,  0.0548,  0.9230,  0.9144,  0.0291,
         0.9823,  0.9354,  0.0038,  0.2953,  0.8375,  0.6908,  0.9308,
         0.9563,  0.1497,  0.7208,  0.8970,  0.0218,  0.8053,  0.9301,
         0.8197,  0.9065,  0.6897,  0.8876,  0.7785,  0.9995,  0.1270,
         0.0906,  0.0542,  0.3066,  0.9187,  0.9988,  0.0176,  0.0626,
         0.4706,  0.8532,  0.0712,  0.0204,  0.8192,  0.3637,  0.9062,
         0.9865,  0.0820,  0.9371,  0.0960,  0.9987,  0.0242,  0.9939,
         0.8679,  0.9625,  0.7810,  0.3865,  0.0560,  0.9423,  0.6863,
         0.9146,  0.0166,  0.9134,  0.0746,  0.1467,  0.1750,  0.9928,
         0.0624,  0.0440,  0.7691,  0.0123,  0.8873,  0.9992,  0.4955,
         0.9616,  0.0044,  0.0456,  0.0308,  0.0894,  0.0609,  0.0047,
         0.9918,  0.9995,  0.8697,  0.0391,  0.5487,  0.9743,  0.0141,
         0.1560,  0.7532,  0.1286,  0.9082,  0.0186,  0.9667,  0.2404,
         0.9986,  0.0121,  0.0799,  0.9380,  0.0037,  0.9187,  0.9459,
         0.9733,  0.0536,  0.3249,  0.7835,  0.0327,  0.0028,  0.3460,
         0.9904,  0.0704,  0.8507,  0.0077,  0.2030,  0.9253,  0.1242,
         0.0299,  0.9864,  0.4543,  0.9713,  0.0075,  0.8301,  0.9798,
         0.9956,  0.3743,  0.3582,  0.0092,  0.9184,  0.5030,  0.0885,
         0.1779,  0.0962,  0.9776,  0.9444,  0.8892,  0.0302,  0.0224,
         0.0225,  0.3559,  0.0011,  0.8200,  0.3455,  0.7481,  0.1827,
         0.8847,  0.9658,  0.8966,  0.8197,  0.2613,  0.8220,  0.6805,
         0.9643,  0.8571,  0.5457,  0.0818,  0.8013,  0.0255,  0.3473,
         0.8061,  0.9994,  0.8569,  0.8495,  0.8388,  0.5640,  0.3601,
         0.1584,  0.0302,  0.2548,  0.9836,  0.2003,  0.9050,  0.6103,
         0.9824,  0.0132,  0.6170,  0.7218,  0.9105,  0.9897,  0.3333,
         0.9971,  0.7789,  0.1932,  0.0145,  0.7718,  0.9297,  0.1980,
         0.6428,  0.9353,  0.9707,  0.0492,  0.9533,  0.0242,  0.9314,
         0.9805,  0.0310,  0.9903,  0.9994,  0.9982,  0.9578,  0.0757,
         0.9140,  0.0844,  0.9867,  0.9264,  0.9036,  0.0993,  0.0508,
         0.7896,  0.0421,  0.1460,  0.3249,  0.8348,  0.7820,  0.1552,
         0.0144,  0.0263,  0.9989,  0.6554,  0.5588,  0.0067,  0.2605,
         0.9545,  0.6057,  0.7496,  0.9025,  0.1647,  0.0540,  0.7026,
         0.2037,  0.9496,  0.9022,  0.4512,  0.7307,  0.1690,  0.0136,
         0.7246,  0.0965,  0.1811,  0.1297,  0.0322,  0.1959,  0.7036,
         0.7601,  0.2058,  0.0099,  0.7628,  0.6091,  0.5180,  0.8019,
         0.9608,  0.7665,  0.1393,  0.5682,  0.9958,  0.0534,  0.0034,
         0.0067,  0.0104,  0.0390,  0.1686,  0.8054,  0.0026,  0.8661,
         0.8071,  0.6180,  0.9312,  0.9700,  0.9834,  0.6898,  0.9698,
         0.0070,  0.8032,  0.9294,  0.9506,  0.4718,  0.5527,  0.0047,
         0.0781,  0.7259,  0.3869,  0.6261,  0.4255,  0.0056,  0.0031,
         0.0110,  0.6933,  0.0856,  0.3285,  0.0155,  0.3692,  0.8949,
         0.9558,  0.0281,  0.3994,  0.9130,  0.8616,  0.9039,  0.6297,
         0.1466,  0.0055,  0.9647,  0.3547,  0.3766,  0.7093,  0.0193,
         0.8491,  0.2124,  0.8731,  0.9351,  0.0597,  0.9730,  0.7972,
         0.9823,  0.8681,  0.9451,  0.9700,  0.9318,  0.7371,  0.9122,
         0.0201,  0.7899,  0.0038,  0.3304,  0.7721,  0.3571,  0.7617,
         0.1520,  0.9840,  0.4138,  0.0063,  0.0939,  0.2905,  0.6601,
         0.8834,  0.3002,  0.1525,  0.0661,  0.7974,  0.0513,  0.8174,
         0.0050,  0.9930,  0.4184,  0.9567,  0.0066,  0.0170,  0.8279,
         0.6942,  0.9420,  0.7225,  0.9888,  0.7902,  0.9148,  0.0038,
         0.0390,  0.8647,  0.1097,  0.9423,  0.9925,  0.5536,  0.8703,
         0.4807,  0.8824,  0.0506,  0.2658,  0.9603,  0.4444,  0.8288,
         0.9353,  0.0232,  0.1112,  0.8257,  0.1171,  0.2096,  0.0290,
         0.0464,  0.9695,  0.8645,  0.0740,  0.9695,  0.8279,  0.7452,
         0.8821,  0.0129,  0.8855,  0.9437,  0.2514,  0.9463,  0.4189,
         0.6356,  0.1459,  0.2239,  0.9148,  0.9519,  0.5021,  0.4329,
         0.9589,  0.9423,  0.7341,  0.9888,  0.9608,  0.0407,  0.9376,
         0.9844,  0.9148,  0.9103,  0.9624,  0.4175,  0.9893,  0.2175,
         0.0007,  0.3351,  0.8408,  0.0160,  0.9574,  0.0625,  0.0332,
         0.9994,  0.0061,  0.3116,  0.8199,  0.9409,  0.2425,  0.9666,
         0.8026], device='cuda:0')
tensor(0.3034, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1747,  0.7927,  0.1346,  0.9052,  0.4920,  0.9253,  0.7401,
         0.0750,  0.0121,  0.8899,  0.4112,  0.0770,  0.8867,  0.0526,
         0.0113,  0.0455,  0.9977,  0.9616,  0.9921,  0.5780,  0.9433,
         0.8883,  0.8807,  0.4757,  0.0172,  0.9167,  0.0111,  0.6516,
         0.0270,  0.1051,  0.0052,  0.9220,  0.8611,  0.2981,  0.9458,
         0.0001,  0.8930,  0.6620,  0.2733,  0.7902,  0.9629,  0.1550,
         0.7016,  0.1424,  0.9121,  0.8556,  0.0201,  0.9511,  0.0014,
         0.0370,  0.0246,  0.9109,  0.6176,  0.2985,  0.0714,  0.0928,
         0.0320,  0.0226,  0.4782,  0.5386,  0.5477,  0.9660,  0.0371,
         0.0050,  0.9830,  0.3096,  0.9628,  0.8321,  0.9606,  0.0219,
         0.9870,  0.9257,  0.0178,  0.1025,  0.0018,  0.0704,  0.9723,
         0.9204,  0.0519,  0.9283,  0.1374,  0.5371,  0.0130,  0.0547,
         0.9305,  0.1095,  0.8110,  0.1045,  0.0109,  0.9902,  0.3818,
         0.8912,  0.9659,  0.2314,  0.0139,  0.1051,  0.9229,  0.1325,
         0.0137,  0.2548,  0.9812,  0.1208,  0.0055,  0.0580,  0.6368,
         0.9753,  0.0234,  0.0823,  0.4897,  0.1447,  0.0222,  0.1495,
         0.0663,  0.0016,  0.9689,  0.0932,  0.0057,  0.0873,  0.9025,
         0.8720,  0.9982,  0.0922,  0.9810,  0.6023,  0.0068,  0.0055,
         0.8624,  0.0372,  0.0046,  0.9573,  0.0219,  0.9273,  0.8988,
         0.4968,  0.8718,  0.9957,  0.7336,  0.7235,  0.8912,  0.8775,
         0.6700,  0.9766,  0.0005,  0.0567,  0.9093,  0.7672,  0.8702,
         0.9674,  0.4068,  0.5586,  0.0070,  0.9414,  0.8943,  0.0033,
         0.2556,  0.0103,  0.0843,  0.0114,  0.8556,  0.6936,  0.9517,
         0.7999,  0.7765,  0.9998,  0.0128,  0.7604,  0.0116,  0.5938,
         0.2747,  0.3956,  0.5746,  0.0310,  0.3881,  0.5342,  0.9742,
         0.8283,  0.1999,  0.9677,  0.7648,  0.0305,  0.0015,  0.9607,
         0.0127,  0.8572,  0.0040,  0.2274,  0.5612,  0.9483,  0.1846,
         0.5036,  0.0662,  0.9741,  0.9766,  0.7917,  0.0141,  0.9062,
         0.0150,  0.9984,  0.3417,  0.0263,  0.0560,  0.2587,  0.9057,
         0.9503,  0.9363,  0.8096,  0.0050,  0.9750,  0.7485,  0.8952,
         0.6215,  0.9005,  0.0507,  0.4576,  0.0505,  0.0066,  0.0042,
         0.0128,  0.0848,  0.8117,  0.0122,  0.9294,  0.8832,  0.0594,
         0.6663,  0.8346,  0.9133,  0.7958,  0.0146,  0.1495,  0.0059,
         0.0087,  0.8775,  0.9034,  0.2006,  0.0142,  0.8547,  0.0096,
         0.0460,  0.6801,  0.4422,  0.2180,  0.0135,  0.2797,  0.0316,
         0.0081,  0.7281,  0.3704,  0.0012,  0.0954,  0.9248,  0.7727,
         0.5921,  0.7985,  0.9396,  0.0159,  0.8481,  0.9819,  0.2222,
         0.0022,  0.0058,  0.7966,  0.0758,  0.0847,  0.8413,  0.0203,
         0.4446,  0.0990,  0.9658,  0.0327,  0.0139,  0.9724,  0.1247,
         0.7859,  0.9307,  0.9409,  0.0017,  0.0165,  0.0526,  0.0049,
         0.4966,  0.0567,  0.0091,  0.5652,  0.8871,  0.9854,  0.9547,
         0.0597,  0.1105,  0.1678,  0.0809,  0.9492,  0.7738,  0.8561,
         0.0994,  0.9599,  0.0487,  0.0528,  0.9536,  0.4326,  0.3927,
         0.7176,  0.0108,  0.1581,  0.9671,  0.9364,  0.9229,  0.2060,
         0.0167,  0.7153,  0.0598,  0.7398,  0.0353,  0.4216,  0.0718,
         0.9564,  0.9867,  0.9846,  0.1938,  0.9677,  0.0006,  0.0094,
         0.9463,  0.0069,  0.0007,  0.0317,  0.4075,  0.3421,  0.0247,
         0.7632,  0.0112,  0.2318,  0.0019,  0.2005,  0.9759,  0.0042,
         0.6073,  0.0079,  0.9966,  0.2259,  0.0653,  0.0011,  0.9012,
         0.0323,  0.0190,  0.8986,  0.8483,  0.9549,  0.0121,  0.8217,
         0.0228,  0.1914,  0.1792,  0.5196,  0.1156,  0.9776,  0.0259,
         0.8707,  0.1190,  0.0249,  0.8363,  0.0166,  0.0249,  0.1073,
         0.1924,  0.6053,  0.8803,  0.0083,  0.0172,  0.9703,  0.7661,
         0.0170,  0.5211,  0.9411,  0.8391,  0.9290,  0.0058,  0.7388,
         0.0307,  0.8580,  0.8500,  0.0796,  0.0111,  0.9201,  0.9156,
         0.0012,  0.6247,  0.0049,  0.0512,  0.0014,  0.7458,  0.9656,
         0.8101,  0.6431,  0.0121,  0.1883,  0.9996,  0.9310,  0.9842,
         0.8311,  0.9724,  0.8762,  0.0117,  0.0041,  0.8840,  0.4379,
         0.3410,  0.7041,  0.9813,  0.9380,  0.0378,  0.0182,  0.0068,
         0.1988,  0.0099,  0.0028,  0.0012,  0.1355,  0.0019,  0.9747,
         0.9958,  0.8982,  0.0205,  0.0537,  0.9636,  0.7653,  0.8833,
         0.9960,  0.8975,  0.0304,  0.6654,  0.0036,  0.6695,  0.0267,
         0.0095,  0.0286,  0.0455,  0.5799,  0.0041,  0.0090,  0.1647,
         0.8983,  0.0020,  0.0223,  0.0212,  0.5819,  0.0371,  0.8034,
         0.9238,  0.9070,  0.0918,  0.5835,  0.9750,  0.0396,  0.0206,
         0.9192,  0.0406,  0.1728,  0.8967,  0.7106,  0.0022,  0.9816,
         0.8631,  0.0087,  0.8909,  0.2408,  0.8907,  0.0017,  0.0053,
         0.0286,  0.8457,  0.9999,  0.0228,  0.9693,  0.0006,  0.0081,
         0.0362,  0.0049,  0.9413,  0.9569,  0.1653,  0.8742,  0.0313,
         0.0208,  0.0118,  0.4294,  0.8749,  0.0121,  0.8938,  0.3696,
         0.0393,  0.9740,  0.0063,  0.4927,  0.0230,  0.0474,  0.9183,
         0.3789,  0.0134,  0.9757,  0.0377,  0.7774,  0.9173,  0.2355,
         0.9206,  0.0542,  0.2758,  0.9967,  0.1307,  0.0030,  0.3041,
         0.8669], device='cuda:0')
tensor(0.2809, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7781,  0.3517,  0.0073,  0.0277,  0.9679,  0.9724,  0.0850,
         0.9515,  0.7692,  0.9930,  0.0119,  0.7728,  0.8436,  0.0140,
         0.2571,  0.9430,  0.0338,  0.0029,  0.0012,  0.0507,  0.9286,
         0.0207,  0.9630,  0.8883,  0.0123,  0.9968,  0.8985,  0.0519,
         0.2729,  0.9313,  0.0381,  0.9964,  0.0080,  0.0235,  0.9234,
         0.1139,  0.0049,  0.9113,  0.7165,  0.2281,  0.9958,  0.0044,
         0.0197,  0.0154,  0.9997,  0.7127,  0.6994,  0.0082,  0.0254,
         0.9391,  0.9933,  0.4149,  0.7715,  0.0364,  0.0146,  0.9548,
         0.8656,  0.0104,  0.9440,  0.0345,  0.0135,  0.1976,  0.0945,
         0.0571,  0.9271,  0.0108,  0.4350,  0.9523,  0.9893,  0.0118,
         0.9556,  0.9476,  0.0420,  0.9834,  0.0014,  0.9670,  0.3422,
         0.8084,  0.0130,  0.9962,  0.0878,  0.0020,  0.2523,  0.2750,
         0.0358,  0.1090,  0.0139,  0.0007,  0.0523,  0.8264,  0.9821,
         0.5829,  0.3430,  0.8038,  0.0042,  0.9895,  0.6068,  0.9790,
         0.7868,  0.0187,  0.9983,  0.8751,  0.5898,  0.0003,  0.9433,
         0.0248,  0.0005,  0.0054,  0.5360,  0.9330,  0.0071,  0.0017,
         0.9875,  0.0235,  0.0137,  0.0126,  0.9056,  0.9839,  0.0380,
         0.0408,  0.0137,  0.7485,  0.7255,  0.9225,  0.7058,  0.9274,
         0.9905,  0.0150,  0.8160,  0.0064,  0.9157,  0.0201,  0.0127,
         0.8606,  0.0409,  0.4770,  0.0116,  0.0087,  0.0167,  0.1469,
         0.8901,  0.9789,  0.0521,  0.0353,  0.4068,  0.9955,  0.0931,
         0.9890,  0.0585,  0.0113,  0.0197,  0.4419,  0.0082,  0.0134,
         0.9644,  0.9857,  0.9018,  0.0014,  0.9794,  0.0023,  0.0219,
         0.7312,  0.9482,  0.0007,  0.9476,  0.8953,  0.0048,  0.0165,
         0.0004,  0.9767,  0.9119,  0.9283,  0.0965,  0.0881,  0.9646,
         0.2395,  0.9899,  0.0562,  0.9997,  0.4721,  0.9638,  0.9583,
         0.9749,  0.0248,  0.9794,  0.0008,  0.9983,  0.9880,  0.8776,
         0.3344,  0.0359,  0.1956,  0.0655,  0.0428,  0.3417,  0.0103,
         0.8288,  0.7398,  0.9483,  0.8252,  0.0031,  0.0512,  0.2024,
         0.6453,  0.0243,  0.8722,  0.0053,  0.0089,  0.3541,  0.2320,
         0.9819,  0.7989,  0.0092,  0.7184,  0.0019,  0.0166,  0.0045,
         0.8572,  0.0126,  0.0019,  0.0115,  0.3741,  0.9012,  0.9045,
         0.9162,  0.4445,  0.0066,  0.9696,  0.9576,  0.3388,  0.0111,
         0.9987,  0.9760,  0.9749,  0.9727,  0.3117,  0.9535,  0.0281,
         0.9903,  0.1300,  0.0105,  0.0030,  0.0148,  0.9943,  0.8276,
         0.0017,  0.0594,  0.4457,  0.8675,  0.1825,  0.3901,  0.0301,
         0.9594,  0.8108,  0.8597,  0.0034,  0.0018,  0.9583,  0.0108,
         0.3796,  0.0017,  0.9898,  0.0194,  0.9140,  0.8093,  0.7359,
         0.2765,  0.9048,  0.8228,  0.0064,  0.5365,  0.0829,  0.0030,
         0.0027,  0.9113,  0.3264,  0.8938,  0.0146,  0.0942,  0.9374,
         0.0705,  0.0025,  0.0015,  0.8940,  0.0099,  0.9983,  0.6285,
         0.0274,  0.3368,  0.0127,  0.0041,  0.9775,  0.8184,  0.0225,
         0.7246,  0.0080,  0.9948,  0.3814,  0.6186,  0.8509,  0.0055,
         0.0199,  0.0310,  0.8603,  0.9179,  0.7683,  0.6300,  0.0042,
         0.0051,  0.0139,  0.9620,  0.7748,  0.0406,  0.0856,  0.9853,
         0.0076,  0.9928,  0.8426,  0.2472,  0.9504,  0.2468,  0.0475,
         0.0023,  0.0065,  0.7237,  0.8794,  0.0074,  0.0063,  0.0013,
         0.8433,  0.6038,  0.3467,  0.0622,  0.1088,  0.8898,  0.0028,
         0.1331,  0.8067,  0.4509,  0.2793,  0.9708,  0.8597,  0.0121,
         0.8878,  0.9766,  0.0019,  0.1465,  0.9808,  0.0653,  0.0006,
         0.5908,  0.9378,  0.0672,  0.7344,  0.6119,  0.6834,  0.7415,
         0.0134,  0.2638,  0.4912,  0.8464,  0.9785,  0.0058,  0.0023,
         0.0091,  0.0076,  0.5007,  0.9315,  0.8957,  0.0116,  0.0139,
         0.5749,  0.0036,  0.0008,  0.6678,  0.8550,  0.0042,  0.1003,
         0.8613,  0.0415,  0.9025,  0.9748,  0.0139,  0.1353,  0.4213,
         0.0011,  0.3323,  0.7598,  0.0110,  0.9627,  0.9354,  0.8858,
         0.9291,  0.9629,  0.7583,  0.7344,  0.0837,  0.7929,  0.0396,
         0.3058,  0.0146,  0.0056,  0.0748,  0.8781,  0.0489,  0.9163,
         0.9540,  0.1351,  0.3057,  0.0140,  0.9892,  0.6436,  0.0321,
         0.0015,  0.2821,  0.0117,  0.9711,  0.0037,  0.0428,  0.0036,
         0.8430,  0.0173,  0.6997,  0.0024,  0.9997,  0.9957,  0.9842,
         0.4030,  0.9863,  0.9461,  0.9481,  0.9521,  0.0421,  0.8874,
         0.0294,  0.0487,  0.9959,  0.5458,  0.9267,  0.8146,  0.0013,
         0.5319,  0.8475,  0.0004,  0.2764,  0.9752,  0.9749,  0.0042,
         0.8238,  0.0328,  0.0880,  0.9293,  0.0004,  0.9341,  0.0005,
         0.9743,  0.0205,  0.9321,  0.3962,  0.0018,  0.8427,  0.8343,
         0.0050,  0.0089,  0.1720,  0.7463,  0.0678,  0.0119,  0.0653,
         0.0678,  0.9698,  0.8768,  0.0377,  0.0246,  0.0058,  0.9432,
         0.0157,  0.5863,  0.9677,  0.0100,  0.9059,  0.9075,  0.8621,
         0.4632,  0.6197,  0.0239,  0.4917,  0.5064,  0.8941,  0.0820,
         0.9161,  0.0025,  0.9656,  0.0747,  0.3404,  0.5670,  0.8939,
         0.7516,  0.1418,  0.6742,  0.0573,  0.9465,  0.6470,  0.2867,
         0.0060,  0.0053,  0.0068,  0.6218,  0.0054,  0.8877,  0.0250,
         0.0394], device='cuda:0')
tensor(0.3116, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9735,  0.0388,  0.9690,  0.9811,  0.8657,  0.8151,  0.0113,
         0.4830,  0.0227,  0.0102,  0.1174,  0.9188,  0.9583,  0.0276,
         0.2443,  0.0240,  0.0082,  0.0069,  0.9823,  0.9973,  0.8460,
         0.9883,  0.0024,  0.0075,  0.1329,  0.9713,  0.7549,  0.9605,
         0.9108,  0.1608,  0.6739,  0.0306,  0.0075,  0.0107,  0.8816,
         0.0446,  0.9986,  0.6224,  0.0236,  0.9379,  0.8917,  0.9405,
         0.9900,  0.0097,  0.2951,  0.9296,  0.0094,  0.9281,  0.0187,
         0.0664,  0.0043,  0.9177,  0.9438,  0.6824,  0.1424,  0.8091,
         0.0327,  0.0480,  0.5444,  0.0438,  0.9471,  0.7304,  0.8165,
         0.0121,  0.6735,  0.0128,  0.9595,  0.0321,  0.0341,  0.9262,
         0.0318,  0.0539,  0.1333,  0.0125,  0.8330,  0.8898,  0.0036,
         0.7066,  0.6703,  0.0644,  0.3218,  0.5510,  0.9135,  0.9534,
         0.1196,  0.9343,  0.0280,  0.9717,  0.0961,  0.8296,  0.0117,
         0.1741,  0.0530,  0.0134,  0.0334,  0.9670,  0.0198,  0.9856,
         0.5657,  0.0141,  0.4652,  0.3787,  0.8373,  0.0023,  0.9767,
         0.9017,  0.6475,  0.0601,  0.4690,  0.0134,  0.1127,  0.9585,
         0.0226,  0.8977,  0.6417,  0.7701,  0.1274,  0.1263,  0.7251,
         0.0256,  0.9969,  0.5958,  0.8223,  0.9929,  0.4828,  0.0294,
         0.0117,  0.0359,  0.0867,  0.0321,  0.8172,  0.0888,  0.9158,
         0.0177,  0.7624,  0.9984,  0.7406,  0.0046,  0.0173,  0.9301,
         0.6517,  0.1983,  0.0034,  0.0103,  0.9869,  0.8840,  0.0123,
         0.0240,  0.0074,  0.6867,  0.1430,  0.0730,  0.9931,  0.7662,
         0.0036,  0.0277,  0.7048,  0.0203,  0.9524,  0.9941,  0.0030,
         0.0279,  0.0578,  0.0065,  0.0076,  0.9765,  0.0161,  0.9474,
         0.1475,  0.9445,  0.0347,  0.9897,  0.5093,  0.4466,  0.1452,
         0.0484,  0.2105,  0.1755,  0.9998,  0.8461,  0.0861,  0.0020,
         0.9729,  0.7180,  0.9790,  0.2704,  0.9835,  0.9315,  0.9633,
         0.0027,  0.9457,  0.4730,  0.3695,  0.8322,  0.9493,  0.6629,
         0.0111,  0.7524,  0.0331,  0.8229,  0.9894,  0.0495,  0.8443,
         0.8448,  0.5020,  0.5499,  0.4892,  0.0030,  0.9330,  0.9840,
         0.9323,  0.9977,  0.9236,  0.0220,  0.9101,  0.0124,  0.9050,
         0.1255,  0.0005,  0.0995,  0.1096,  0.9755,  0.0859,  0.0866,
         0.9634,  0.0230,  0.1298,  0.0704,  0.8654,  0.9943,  0.3025,
         0.0279,  0.0163,  0.0062,  0.1634,  0.5157,  0.7216,  0.9842,
         0.1306,  0.0169,  0.9793,  0.9014,  0.0945,  0.9148,  0.6578,
         0.0179,  0.0010,  0.9796,  0.9486,  0.9005,  0.9256,  0.0939,
         0.0050,  0.0360,  0.0891,  0.8857,  0.1626,  0.0048,  0.9818,
         0.2492,  0.4275,  0.8509,  0.7198,  0.0571,  0.0070,  0.9389,
         0.8373,  0.6275,  0.0535,  0.9107,  0.5007,  0.9786,  0.9891,
         0.0255,  0.7103,  0.8736,  0.7582,  0.3087,  0.0022,  0.9895,
         0.7839,  0.0060,  0.3735,  0.9067,  0.0124,  0.6655,  0.9598,
         0.0066,  0.8077,  0.0370,  0.8572,  0.9427,  0.1639,  0.9768,
         0.8900,  0.0042,  0.0363,  0.9745,  0.9917,  0.0146,  0.8180,
         0.2980,  0.0173,  0.0508,  0.0579,  0.0492,  0.4449,  0.5495,
         0.0094,  0.8689,  0.0092,  0.7693,  0.7236,  0.2452,  0.0142,
         0.7597,  0.8826,  0.0219,  0.1312,  0.7044,  0.8820,  0.4395,
         0.0741,  0.9008,  0.0049,  0.0566,  0.8823,  0.0400,  0.1366,
         0.3889,  0.9058,  0.0079,  0.9486,  0.3551,  0.6669,  0.9885,
         0.0034,  0.0076,  0.9157,  0.8326,  0.0346,  0.0391,  0.9407,
         0.8682,  0.6027,  0.1056,  0.1200,  0.1881,  0.0017,  0.0037,
         0.1761,  0.8359,  0.0920,  0.0257,  0.1420,  0.9926,  0.1457,
         0.9992,  0.0593,  0.4912,  0.1564,  0.0075,  0.9767,  0.0559,
         0.1589,  0.7006,  0.7503,  0.6937,  0.0039,  0.8855,  0.9434,
         0.9549,  0.0497,  0.0874,  0.0072,  0.9579,  0.0357,  0.9983,
         0.9712,  0.8257,  0.0238,  0.0123,  0.0583,  0.0037,  0.8215,
         0.9746,  0.8845,  0.0099,  0.2608,  0.7875,  0.5478,  0.9799,
         0.1980,  0.8525,  0.9161,  0.6707,  0.0104,  0.0047,  0.8496,
         0.0006,  0.2374,  0.9864,  0.9316,  0.9984,  0.0433,  0.0486,
         0.6557,  0.0878,  0.2566,  0.3366,  0.6500,  0.9870,  0.0098,
         0.9598,  0.8991,  0.8995,  0.0114,  0.1816,  0.9750,  0.7693,
         0.0036,  0.1094,  0.0055,  0.3593,  0.5195,  0.8674,  0.1491,
         0.8717,  0.9918,  0.9478,  0.4488,  0.2900,  0.0469,  0.0863,
         0.0211,  0.4969,  0.0065,  0.3563,  0.0313,  0.0130,  0.6245,
         0.8819,  0.0249,  0.2494,  0.8709,  0.9818,  0.0126,  0.2206,
         0.0499,  0.9998,  0.1987,  0.6404,  0.1479,  0.0114,  0.0437,
         0.0929,  0.8749,  0.8753,  0.0111,  0.0306,  0.0008,  0.5446,
         0.9802,  0.0871,  0.9881,  0.9884,  0.8826,  0.9924,  0.0595,
         0.8564,  0.0205,  0.0135,  0.4648,  0.9932,  0.0688,  0.8247,
         0.9476,  0.9676,  0.1257,  0.0067,  0.9886,  0.9970,  0.9455,
         0.1177,  0.2063,  0.0138,  0.8922,  0.8028,  0.4798,  0.9965,
         0.0004,  0.9886,  0.0008,  0.0036,  0.0727,  0.9896,  0.8761,
         0.0581,  0.0200,  0.9638,  0.8887,  0.2009,  0.8563,  0.1693,
         0.3291,  0.0417,  0.9476,  0.9963,  0.0079,  0.3188,  0.7920,
         0.0208], device='cuda:0')
tensor(0.3462, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2335,  0.0249,  0.1407,  0.6887,  0.6639,  0.0555,  0.9660,
         0.0062,  0.9196,  0.9749,  0.8833,  0.6436,  0.0505,  0.6061,
         0.1910,  0.0636,  0.6042,  0.3714,  0.9787,  0.3897,  0.9089,
         0.0520,  0.1648,  0.0282,  0.0006,  0.8361,  0.0951,  0.9354,
         0.0877,  0.0184,  0.0696,  0.7509,  0.9164,  0.9723,  0.7883,
         0.0374,  0.8907,  0.6069,  0.1370,  0.2404,  0.8695,  0.9996,
         0.9057,  0.6301,  0.1282,  0.7956,  0.8934,  0.6172,  0.0348,
         0.9242,  0.2402,  0.0216,  0.0382,  0.0465,  0.2346,  0.7214,
         0.9752,  0.7475,  0.8271,  0.9881,  0.1187,  0.0720,  0.0158,
         0.9503,  0.9089,  0.9789,  0.9723,  0.7322,  0.9952,  0.9567,
         0.0193,  0.0868,  0.0281,  0.7107,  0.0344,  0.5061,  0.6679,
         0.0038,  0.2180,  0.1908,  0.0041,  0.0312,  0.9755,  0.0040,
         0.9359,  0.9069,  0.1460,  0.9182,  0.9883,  0.9568,  0.9593,
         0.3434,  0.3319,  0.3803,  0.0193,  0.6757,  0.1515,  0.9906,
         0.9669,  0.1168,  0.1149,  0.4867,  0.9914,  0.0061,  0.6797,
         0.9525,  0.0293,  0.0244,  0.9207,  0.0181,  0.9926,  0.2950,
         0.2260,  0.0163,  0.8979,  0.3995,  0.4009,  0.0200,  0.1702,
         0.1956,  0.9835,  0.0019,  0.8959,  0.0186,  0.0217,  0.1817,
         0.9695,  0.5635,  0.9612,  0.0829,  0.5950,  0.9466,  0.8256,
         0.1379,  0.9674,  0.1024,  0.8274,  0.9497,  0.0333,  0.9794,
         0.2627,  0.0555,  0.8917,  0.9343,  0.0356,  0.2891,  0.9030,
         0.5813,  0.3311,  0.4593,  0.8824,  0.0460,  0.0606,  0.9977,
         0.1131,  0.8680,  0.9979,  0.2026,  0.1012,  0.0076,  0.0755,
         0.8724,  0.4755,  0.6547,  0.8305,  0.0374,  0.5938,  0.2958,
         0.9815,  0.7767,  0.7409,  0.9085,  0.9238,  0.5620,  0.1728,
         0.2738,  0.8170,  0.0456,  0.0415,  0.9557,  0.5050,  0.2323,
         0.2401,  0.1032,  0.9692,  0.9401,  0.9221,  0.3532,  0.2815,
         0.9961,  0.0030,  0.8325,  0.7946,  0.0202,  0.9532,  0.9911,
         0.7440,  0.0870,  0.6551,  0.0956,  0.8457,  0.9908,  0.1937,
         0.0321,  0.0155,  0.8785,  0.0670,  0.1144,  0.7372,  0.9922,
         0.9903,  0.4605,  0.9205,  0.9208,  0.8371,  0.9530,  0.0543,
         0.9739,  0.3149,  0.0785,  0.2366,  0.0010,  0.2505,  0.0513,
         0.0875,  0.8475,  0.2447,  0.9712,  0.3003,  0.9535,  0.9648,
         0.9579,  0.0160,  0.9313,  0.0218,  0.9850,  0.5191,  0.9624,
         0.9003,  0.0923,  0.9210,  0.1967,  0.0065,  0.9113,  0.2034,
         0.9398,  0.1369,  0.6890,  0.9538,  0.9065,  0.0626,  0.6792,
         0.0856,  0.7280,  0.9734,  0.8513,  0.1360,  0.9588,  0.9745,
         0.0336,  0.5763,  0.9462,  0.0575,  0.0266,  0.8202,  0.6248,
         0.8449,  0.8828,  0.9602,  0.2187,  0.9712,  0.0899,  0.0468,
         0.0547,  0.5319,  0.1044,  0.9543,  0.1150,  0.0474,  0.9841,
         0.6847,  0.9053,  0.8418,  0.9752,  0.0033,  0.0986,  0.9315,
         0.5655,  0.9920,  0.8499,  0.8149,  0.0115,  0.9475,  0.0202,
         0.8548,  0.0715,  0.9938,  0.0109,  0.0564,  0.2785,  0.8131,
         0.9836,  0.8939,  0.8316,  0.9508,  0.2591,  0.0372,  0.2044,
         0.8310,  0.7886,  0.1118,  0.1937,  0.1650,  0.9753,  0.0028,
         0.9922,  0.0528,  0.9885,  0.3423,  0.0616,  0.0227,  0.9089,
         0.7803,  0.4589,  0.5450,  0.7644,  0.1337,  0.0182,  0.6302,
         0.3694,  0.9950,  0.0845,  0.9995,  0.9987,  0.8804,  0.9994,
         0.9749,  0.9525,  0.0293,  0.9734,  0.9961,  0.9595,  0.9249,
         0.8366,  0.8895,  0.0037,  0.9642,  0.1975,  0.6591,  0.9488,
         0.8425,  0.2699,  0.8256,  0.9945,  0.4919,  0.7299,  0.6322,
         0.7074,  0.0221,  0.9917,  0.0999,  0.1575,  0.1214,  0.9688,
         0.9151,  0.0720,  0.2865,  0.9834,  0.9947,  0.9380,  0.7986,
         0.9628,  0.8600,  0.8966,  0.8629,  0.2622,  0.1915,  0.9462,
         0.5228,  0.0055,  0.1167,  0.9021,  0.5382,  0.0054,  0.9451,
         0.0102,  0.0554,  0.9858,  0.3750,  0.7557,  0.0803,  0.8422,
         0.0330,  0.0198,  0.6603,  0.1974,  0.0988,  0.0047,  0.9554,
         0.7558,  0.1669,  0.9769,  0.2833,  0.3811,  0.7626,  0.9920,
         0.0202,  0.6235,  0.9517,  0.8267,  0.0051,  0.0289,  0.9422,
         0.9470,  0.8758,  0.0825,  0.0873,  0.9916,  0.1406,  0.0218,
         0.0737,  0.0098,  0.9587,  0.8962,  0.9717,  0.9623,  0.0008,
         0.0185,  0.8777,  0.0559,  0.3204,  0.2092,  0.0053,  0.0126,
         0.9375,  0.3121,  0.9680,  0.8942,  0.2448,  0.2408,  0.2206,
         0.0090,  0.4522,  0.0143,  0.2440,  0.9363,  0.9895,  0.7122,
         0.9414,  0.9041,  0.0120,  0.0291,  0.8575,  0.0366,  0.1612,
         0.0350,  0.6961,  0.9919,  0.9772,  0.0085,  0.9704,  0.9032,
         0.0118,  0.8657,  0.9974,  0.2405,  0.9958,  0.9764,  0.9716,
         0.0021,  0.9428,  0.6060,  0.9613,  0.9525,  0.8959,  0.9207,
         0.0015,  0.9977,  0.0087,  0.9176,  0.9198,  0.8648,  0.1407,
         0.6142,  0.9671,  0.5459,  0.9775,  0.9959,  0.6925,  0.9042,
         0.0031,  0.9683,  0.8487,  0.3002,  0.9782,  0.0738,  0.0419,
         0.4804,  0.9863,  0.0995,  0.5051,  0.1338,  0.0114,  0.0710,
         0.0226,  0.7617,  0.0145,  0.0045,  0.8676,  0.6113,  0.3677,
         0.9900], device='cuda:0')
tensor(0.2809, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0906,  0.9744,  0.8181,  0.0368,  0.9878,  0.0340,  0.0391,
         0.0158,  0.9989,  0.1366,  0.7108,  0.0928,  0.3461,  0.9870,
         0.7995,  0.2856,  0.9742,  0.9760,  0.2475,  0.2158,  0.6942,
         0.7159,  0.1895,  0.9215,  0.0231,  0.0262,  0.8590,  0.1611,
         0.4544,  0.9145,  0.8019,  0.9618,  0.9782,  0.8692,  0.0287,
         0.1787,  0.7807,  0.2595,  0.1375,  0.9458,  0.1587,  0.0938,
         0.7065,  0.1809,  0.9913,  0.1077,  0.8774,  0.1016,  0.9825,
         0.4720,  0.9906,  0.7785,  0.8498,  0.1119,  0.7141,  0.0589,
         0.9846,  0.2120,  0.9560,  0.8855,  0.9441,  0.9696,  0.8997,
         0.9799,  0.9820,  0.9823,  0.4478,  0.7300,  0.9543,  0.9745,
         0.0145,  0.9805,  0.9003,  0.4761,  0.9460,  0.2077,  0.0265,
         0.1148,  0.4156,  0.9437,  0.3315,  0.0734,  0.9742,  0.4296,
         0.2698,  0.8982,  0.9382,  0.1820,  0.9734,  0.9560,  0.0381,
         0.7262,  0.1674,  0.6897,  0.1491,  0.9028,  0.5288,  0.7634,
         0.8659,  0.9142,  0.9837,  0.9925,  0.9825,  0.9331,  0.9909,
         0.9787,  0.9668,  0.3850,  0.9785,  0.0470,  0.8387,  0.0294,
         0.2044,  0.9413,  0.4570,  0.0844,  0.7960,  0.7213,  0.1534,
         0.3123,  0.9922,  0.9755,  0.6963,  0.2515,  0.9640,  0.6449,
         0.9301,  0.0156,  0.9630,  0.0993,  0.6787,  0.1661,  0.1458,
         0.1226,  0.9574,  0.9402,  0.0520,  0.9738,  0.2163,  0.8835,
         0.3472,  0.9414,  0.3752,  0.7481,  0.8607,  0.2893,  0.9387,
         0.9757,  0.2117,  0.6626,  0.4939,  0.9737,  0.1619,  0.8807,
         0.9536,  0.1918,  0.1060,  0.0224,  0.9808,  0.9067,  0.0048,
         0.1303,  0.0958,  0.8500,  0.0692,  0.0427,  0.9671,  0.1820,
         0.9994,  0.9367,  0.2606,  0.4602,  0.8681,  0.0897,  0.6833,
         0.9991,  0.8896,  0.9802,  0.7662,  0.6095,  0.2409,  0.9602,
         0.9776,  0.9646,  0.8244,  0.4555,  0.0257,  0.1113,  0.0351,
         0.9291,  0.9702,  0.0143,  0.6021,  0.9845,  0.0224,  0.8735,
         0.3505,  0.4867,  0.0370,  0.8964,  0.4558,  0.9383,  0.1062,
         0.9954,  0.9661,  0.0118,  0.9809,  0.1914,  0.9891,  0.3172,
         0.6294,  0.5987,  0.4394,  0.1789,  0.0808,  0.6607,  0.9388,
         0.4399,  0.4622,  0.9731,  0.5428,  0.9345,  0.9482,  0.9107,
         0.0971,  0.9879,  0.9581,  0.0690,  0.1249,  0.9283,  0.9985,
         0.9416,  0.0496,  0.9547,  0.9291,  0.9578,  0.8316,  0.1295,
         0.9063,  0.8527,  0.9649,  0.9678,  0.9498,  0.9996,  0.0409,
         0.1396,  0.3239,  0.9989,  0.9586,  0.9990,  0.9132,  0.5374,
         0.2601,  0.9026,  0.9150,  0.9783,  0.9734,  0.4794,  0.9750,
         0.9680,  0.9819,  0.3971,  0.3037,  0.7538,  0.9816,  0.0681,
         0.0647,  0.9854,  0.9190,  0.9928,  0.8555,  0.9386,  0.3002,
         0.9038,  0.9494,  0.9761,  0.9464,  0.6479,  0.7397,  0.7169,
         0.1118,  0.8703,  0.9986,  0.9151,  0.1735,  0.9622,  0.9917,
         0.9866,  0.9337,  0.9588,  0.1825,  0.3411,  0.0957,  0.0823,
         0.9921,  0.9797,  0.1025,  0.3976,  0.8322,  0.5657,  0.1676,
         0.0783,  0.9791,  0.0397,  0.0396,  0.9242,  0.2784,  0.9985,
         0.1545,  0.9397,  0.8224,  0.6766,  0.0364,  0.1153,  0.1631,
         0.1013,  0.6537,  0.8491,  0.8780,  0.9140,  0.5389,  0.9447,
         0.9054,  0.8543,  0.4630,  0.4587,  0.0402,  0.0027,  0.5469,
         0.1206,  0.6361,  0.9533,  0.4737,  0.4760,  0.9618,  0.5358,
         0.2698,  0.2852,  0.0156,  0.0246,  0.5560,  0.3541,  0.0851,
         0.7024,  0.9296,  0.9733,  0.1172,  0.0705,  0.6657,  0.8988,
         0.2441,  0.0210,  0.4979,  0.1303,  0.1394,  0.8746,  0.3078,
         0.9818,  0.1672,  0.0960,  0.4082,  0.9786,  0.7718,  0.7967,
         0.9392,  0.3877,  0.0696,  0.7822,  0.4085,  0.9600,  0.7037,
         0.0404,  0.1403,  0.0312,  0.9918,  0.8199,  0.7276,  0.9749,
         0.9189,  0.1326,  0.3038,  0.0020,  0.0265,  0.7756,  0.0640,
         0.2522,  0.8671,  0.6461,  0.2244,  0.2717,  0.7752,  0.1723,
         0.2266,  0.8952,  0.9471,  0.1618,  0.0608,  0.0968,  0.0216,
         0.9786,  0.9150,  0.6683,  0.9890,  0.0815,  0.0239,  0.9047,
         0.9273,  0.6104,  0.8943,  0.1047,  0.1530,  0.6102,  0.9414,
         0.2373,  0.2809,  0.3975,  0.1084,  0.9890,  0.1755,  0.9931,
         0.9690,  0.9810,  0.1290,  0.9765,  0.9868,  0.6269,  0.9788,
         0.9123,  0.0825,  0.1679,  0.1683,  0.1679,  0.0436,  0.9860,
         0.9382,  0.8902,  0.3430,  0.9398,  0.7301,  0.9774,  0.1845,
         0.8788,  0.6936,  0.9427,  0.6648,  0.9803,  0.0226,  0.9745,
         0.6536,  0.1259,  0.8448,  0.7897,  0.9881,  0.0720,  0.1088,
         0.1567,  0.8952,  0.9487,  0.0332,  0.9675,  0.2971,  0.1453,
         0.4441,  0.0048,  0.9760,  0.0230,  0.9846,  0.8626,  0.9399,
         0.0431,  0.6090,  0.5629,  0.7398,  0.7900,  0.9994,  0.0560,
         0.1512,  0.1115,  0.2345,  0.9989,  0.1391,  0.1617,  0.9570,
         0.4388,  0.7770,  0.7763,  0.5114,  0.0073,  0.0057,  0.9986,
         0.0441,  0.0065,  0.4073,  0.7715,  0.9931,  0.9777,  0.8768,
         0.1292,  0.8168,  0.1345,  0.9572,  0.9640,  0.8614,  0.8729,
         0.8456,  0.7804,  0.9677,  0.5569,  0.9963,  0.0257,  0.6086,
         0.9981], device='cuda:0')
tensor(0.3244, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2246,  0.9657,  0.9707,  0.2791,  0.1069,  0.9463,  0.9964,
         0.3708,  0.9765,  0.8491,  0.9246,  0.1540,  0.0962,  0.4316,
         0.1817,  0.0990,  0.9836,  0.9795,  0.1841,  0.5059,  0.0579,
         0.9986,  0.9996,  0.3185,  0.0985,  0.0360,  0.1080,  0.7784,
         0.9302,  0.9754,  0.0886,  0.3000,  0.2319,  0.9653,  0.7756,
         0.3810,  0.1903,  0.1964,  0.5666,  0.9201,  0.7082,  0.3352,
         0.1636,  0.4969,  0.1748,  0.9528,  0.9484,  0.9977,  0.9792,
         0.0409,  0.5699,  0.2875,  0.8735,  0.0435,  0.1466,  0.1625,
         0.4870,  0.5049,  0.4894,  0.2391,  0.0872,  0.3414,  0.0118,
         0.7880,  0.9956,  0.9734,  0.9203,  0.4824,  0.0360,  0.0281,
         0.7829,  0.9284,  0.0467,  0.1501,  0.9397,  0.0313,  0.4938,
         0.3128,  0.1321,  0.9043,  0.9607,  0.5798,  0.9415,  0.5353,
         0.0264,  0.9863,  0.0126,  0.9364,  0.0436,  0.8147,  0.9633,
         0.9991,  0.2790,  0.5555,  0.0379,  0.6783,  0.4707,  0.6305,
         0.9685,  0.0675,  0.0012,  0.9066,  0.9592,  0.6927,  0.4196,
         0.0812,  0.5906,  0.2529,  0.4838,  0.4463,  0.9780,  0.2582,
         0.0500,  0.3368,  0.5491,  0.1106,  0.8979,  0.4276,  0.4708,
         0.5904,  0.5602,  0.1882,  0.9936,  0.9270,  0.6913,  0.6072,
         0.8984,  0.0282,  0.7509,  0.8498,  0.3411,  0.4904,  0.2143,
         0.0375,  0.5307,  0.1353,  0.8501,  0.9555,  0.1598,  0.1199,
         0.8830,  0.9166,  0.5107,  0.2285,  0.5988,  0.5254,  0.9139,
         0.6544,  0.0186,  0.4732,  0.9891,  0.6571,  0.3675,  0.8571,
         0.0559,  0.8040,  0.0026,  0.7796,  0.6504,  0.9772,  0.1775,
         0.9430,  0.4739,  0.9952,  0.0838,  0.0206,  0.1575,  0.3694,
         0.3998,  0.9993,  0.8456,  0.6935,  0.9620,  0.2340,  0.7644,
         0.0072,  0.3048,  0.5363,  0.1789,  0.7927,  0.0204,  0.7362,
         0.9998,  0.7767,  0.5422,  0.9409,  0.8784,  0.7405,  0.9490,
         0.6043,  0.8443,  0.3736,  0.1991,  0.9388,  0.7994,  0.9994,
         0.1236,  0.2844,  0.3976,  0.8608,  0.9861,  0.1621,  0.9966,
         0.0843,  0.0633,  0.9165,  0.0522,  0.4159,  0.3982,  0.0986,
         0.4317,  0.9080,  0.0274,  0.9739,  0.9706,  0.2060,  0.8348,
         0.3620,  0.0589,  0.9229,  0.9490,  0.3121,  0.8921,  0.9707,
         0.9818,  0.0608,  0.9352,  0.9715,  0.9727,  0.9067,  0.9326,
         0.0412,  0.0911,  0.0346,  0.0495,  0.2737,  0.0244,  0.0732,
         0.8609,  0.3192,  0.1418,  0.2212,  0.9765,  0.0072,  0.8505,
         0.5891,  0.9927,  0.1108,  0.4551,  0.9791,  0.2549,  0.9773,
         0.4178,  0.8989,  0.9951,  0.7458,  0.9336,  0.0350,  0.3945,
         0.9728,  0.9244,  0.6212,  0.2568,  0.2483,  0.9290,  0.0491,
         0.8539,  0.8029,  0.9883,  0.8828,  0.9400,  0.4131,  0.4049,
         0.9890,  0.8802,  0.0102,  0.1176,  0.2525,  0.8388,  0.2269,
         0.0188,  0.7643,  0.8254,  0.4632,  0.9785,  0.8990,  0.4917,
         0.0157,  0.3952,  0.0892,  0.0839,  0.3249,  0.0742,  0.9748,
         0.1348,  0.2026,  0.9859,  0.9434,  0.9220,  0.9690,  0.6996,
         0.7806,  0.1548,  0.9051,  0.9740,  0.9672,  0.9880,  0.7362,
         0.9355,  0.0078,  0.5634,  0.6100,  0.9883,  0.5066,  0.9773,
         0.2683,  0.7651,  0.1527,  0.4349,  0.6753,  0.9706,  0.1560,
         0.8279,  0.2176,  0.4171,  0.0397,  0.3320,  0.1481,  0.9235,
         0.9658,  0.7253,  0.5537,  0.9042,  0.1718,  0.1302,  0.0322,
         0.2341,  0.0095,  0.9165,  0.9365,  0.9985,  0.0868,  0.8402,
         0.9906,  0.6022,  0.9418,  0.8963,  0.6801,  0.4190,  0.2881,
         0.9707,  0.4137,  0.9646,  0.9767,  0.0231,  0.8747,  0.7436,
         0.2245,  0.8877,  0.2276,  0.3643,  0.6486,  0.8450,  0.0166,
         0.1177,  0.2092,  0.3862,  0.6151,  0.8771,  0.4696,  0.0362,
         0.2996,  0.2017,  0.2400,  0.9307,  0.9333,  0.8945,  0.0217,
         0.7018,  0.9998,  0.1760,  0.0664,  0.5820,  0.6537,  0.9925,
         0.3383,  0.9390,  0.3102,  0.6204,  0.6290,  0.9553,  0.9642,
         0.3839,  0.8566,  0.3531,  0.7581,  0.0516,  0.4813,  0.9084,
         0.9830,  0.9099,  0.4583,  0.7430,  0.0276,  0.4387,  0.0352,
         0.9770,  0.7484,  0.9845,  0.9117,  0.2810,  0.2993,  0.8490,
         0.0473,  0.9557,  0.9780,  0.3363,  0.6414,  0.9835,  0.0773,
         0.4508,  0.5759,  0.9970,  0.0272,  0.8076,  0.0681,  0.5385,
         0.0618,  0.9150,  0.1952,  0.9048,  0.2773,  0.1034,  0.0675,
         0.4266,  0.4426,  0.3775,  0.9807,  0.8807,  0.4130,  0.9262,
         0.9844,  0.0041,  0.9696,  0.2737,  0.9838,  0.9767,  0.6172,
         0.0463,  0.9718,  0.2434,  0.5351,  0.0750,  0.9039,  0.9440,
         0.9493,  0.8725,  0.7788,  0.0923,  0.0314,  0.9699,  0.6576,
         0.5877,  0.1580,  0.3444,  0.1055,  0.0341,  0.8609,  0.8672,
         0.1063,  0.1865,  0.2388,  0.9636,  0.9943,  0.0437,  0.2171,
         0.0080,  0.9907,  0.3720,  0.7824,  0.2894,  0.0245,  0.0568,
         0.1261,  0.1283,  0.0461,  0.0417,  0.1917,  0.2936,  0.4244,
         0.9944,  0.9998,  0.8995,  0.0863,  0.6702,  0.0133,  0.0049,
         0.0086,  0.0691,  0.8070,  0.1587,  0.6355,  0.4234,  0.0046,
         0.1085,  0.7512,  0.8806,  0.7556,  0.8075,  0.9305,  0.9264,
         0.0340], device='cuda:0')
tensor(0.3004, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9243,  0.9260,  0.9549,  0.9466,  0.0733,  0.6045,  0.0116,
         0.1024,  0.0954,  0.9968,  0.8123,  0.1215,  0.8946,  0.0087,
         0.2533,  0.8946,  0.7938,  0.9406,  0.7971,  0.5889,  0.9063,
         0.2770,  0.9438,  0.0321,  0.4893,  0.8502,  0.9594,  0.5636,
         0.0454,  0.6326,  0.9863,  0.7609,  0.4587,  0.8594,  0.9332,
         0.8198,  0.1680,  0.1125,  0.2969,  0.4222,  0.7253,  0.1256,
         0.0166,  0.8633,  0.0582,  0.5124,  0.4467,  0.9647,  0.9939,
         0.0026,  0.8517,  0.0897,  0.7728,  0.9934,  0.0959,  0.0352,
         0.2381,  0.8949,  0.1248,  0.0922,  0.0649,  0.9116,  0.2828,
         0.6522,  0.3771,  0.9933,  0.9904,  0.9641,  0.0602,  0.9141,
         0.1604,  0.0027,  0.9504,  0.9768,  0.9817,  0.9664,  0.5487,
         0.0750,  0.3759,  0.0452,  0.9827,  0.9624,  0.0803,  0.0872,
         0.2536,  0.7804,  0.0134,  0.9828,  0.7147,  0.9015,  0.8848,
         0.8851,  0.1820,  0.8994,  0.7019,  0.0492,  0.1559,  0.9715,
         0.9782,  0.2637,  0.9767,  0.0120,  0.0996,  0.9727,  0.7845,
         0.9953,  0.4377,  0.0935,  0.9153,  0.5336,  0.9302,  0.0784,
         0.0922,  0.2761,  0.5012,  0.1511,  0.8408,  0.2051,  0.9396,
         0.3341,  0.8714,  0.9925,  0.0154,  0.2235,  0.0288,  0.2005,
         0.9136,  0.7530,  0.6113,  0.8517,  0.9268,  0.9007,  0.6307,
         0.7028,  0.9612,  0.9590,  0.8559,  0.0980,  0.0631,  0.9700,
         0.4405,  0.0334,  0.0622,  0.9615,  0.2022,  0.4716,  0.1383,
         0.8366,  0.8571,  0.2030,  0.1624,  0.2135,  0.7801,  0.2964,
         0.0361,  0.9045,  0.9195,  0.2885,  0.9281,  0.8572,  0.1006,
         0.6893,  0.9994,  0.9793,  0.0432,  0.3783,  0.2279,  0.0017,
         0.4994,  0.9691,  0.4404,  0.9031,  0.1124,  0.1793,  0.3866,
         0.0022,  0.2155,  0.1108,  0.2787,  0.2267,  0.9435,  0.0536,
         0.0474,  0.6639,  0.6290,  0.9389,  0.9396,  0.0882,  0.9464,
         0.3505,  0.9835,  0.4342,  0.9840,  0.9933,  0.0093,  0.9437,
         0.0919,  0.2442,  0.0870,  0.0790,  0.0302,  0.7780,  0.9618,
         0.0615,  0.9136,  0.7567,  0.9866,  0.6379,  0.0030,  0.9430,
         0.9090,  0.6663,  0.1734,  0.9738,  0.8117,  0.8553,  0.8565,
         0.2505,  0.8646,  0.2731,  0.0529,  0.9783,  0.9241,  0.9581,
         0.2723,  0.7111,  0.9776,  0.3850,  0.0082,  0.4945,  0.4725,
         0.2233,  0.3608,  0.5416,  0.8592,  0.4809,  0.4572,  0.9946,
         0.1761,  0.3879,  0.8255,  0.6343,  0.9441,  0.7019,  0.9412,
         0.8885,  0.9319,  0.3070,  0.2977,  0.9276,  0.9570,  0.0585,
         0.8308,  0.9876,  0.2465,  0.1019,  0.0331,  0.9001,  0.7747,
         0.6349,  0.9758,  0.4065,  0.1280,  0.9026,  0.0356,  0.1951,
         0.0289,  0.8885,  0.9688,  0.9591,  0.9810,  0.2724,  0.9957,
         0.9699,  0.2256,  0.0592,  0.9223,  0.7994,  0.9444,  0.9899,
         0.3109,  0.9973,  0.2208,  0.6496,  0.8696,  0.9532,  0.7238,
         0.0990,  0.9958,  0.3841,  0.2392,  0.0692,  0.2465,  0.0712,
         0.9588,  0.5221,  0.9959,  0.5584,  0.0052,  0.9092,  0.4108,
         0.8122,  0.9711,  0.0608,  0.0258,  0.5863,  0.9900,  0.9818,
         0.5133,  0.6082,  0.9272,  0.9402,  0.9671,  0.1719,  0.9927,
         0.5165,  0.5490,  0.4029,  0.4485,  0.9775,  0.7125,  0.9884,
         0.6129,  0.2705,  0.0911,  0.6063,  0.0538,  0.9661,  0.9612,
         0.9737,  0.9460,  0.1101,  0.8673,  0.0572,  0.0294,  0.4100,
         0.0730,  0.0938,  0.1876,  0.0589,  0.8302,  0.6561,  0.0990,
         0.6147,  0.9898,  0.1338,  0.1251,  0.1446,  0.3546,  0.9983,
         0.3414,  0.8268,  0.4017,  0.9985,  0.7453,  0.6009,  0.9475,
         0.1207,  0.1290,  0.3559,  0.2129,  0.4183,  0.1046,  0.2375,
         0.0045,  0.8381,  0.3415,  0.9893,  0.5324,  0.1716,  0.1142,
         0.7132,  0.1219,  0.4295,  0.9529,  0.8679,  0.9625,  0.2387,
         0.1287,  0.6567,  0.9651,  0.6421,  0.0936,  0.9886,  0.4097,
         0.9800,  0.1130,  0.0453,  0.6372,  0.1146,  0.6020,  0.9032,
         0.6719,  0.5850,  0.8040,  0.5515,  0.0276,  0.1266,  0.9108,
         0.1663,  0.5453,  0.5484,  0.3441,  0.9568,  0.0285,  0.2514,
         0.9809,  0.0277,  0.1483,  0.7516,  0.1713,  0.6214,  0.8906,
         0.9995,  0.8931,  0.8395,  0.3232,  0.4630,  0.0451,  0.0851,
         0.9828,  0.1726,  0.0635,  0.8591,  0.7269,  0.9694,  0.0976,
         0.7728,  0.1746,  0.0180,  0.7610,  0.0473,  0.9836,  0.1197,
         0.0945,  0.9628,  0.9993,  0.0271,  0.9871,  0.3974,  0.9318,
         0.9711,  0.0147,  0.8253,  0.5366,  0.1776,  0.9432,  0.8669,
         0.8326,  0.0815,  0.7263,  0.2594,  0.1714,  0.6057,  0.8568,
         0.8402,  0.2829,  0.9863,  0.7528,  0.0928,  0.0329,  0.9453,
         0.2142,  0.8435,  0.0515,  0.7830,  0.9489,  0.8100,  0.0177,
         0.8762,  0.1795,  0.8309,  0.8414,  0.4100,  0.4202,  0.7295,
         0.9868,  0.0344,  0.9300,  0.7415,  0.7736,  0.6298,  0.9842,
         0.9584,  0.9895,  0.8502,  0.2755,  0.4145,  0.5705,  0.1202,
         0.9618,  0.1815,  0.4690,  0.1995,  0.5648,  0.9998,  0.9967,
         0.9763,  0.7212,  0.2034,  0.0252,  0.3974,  0.9762,  0.1960,
         0.4097,  0.5826,  0.7635,  0.9450,  0.8503,  0.9627,  0.6653,
         0.4878], device='cuda:0')
tensor(0.3559, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1094,  0.9923,  0.1251,  0.7867,  0.3908,  0.1055,  0.9602,
         0.0191,  0.9772,  0.1286,  0.3219,  0.9525,  0.0334,  0.0681,
         0.8191,  0.9086,  0.2568,  0.9800,  0.8630,  0.9601,  0.3305,
         0.0630,  0.0442,  0.9720,  0.4944,  0.9891,  0.2607,  0.6145,
         0.0274,  0.0688,  0.0482,  0.0666,  0.0375,  0.1537,  0.5861,
         0.0097,  0.0180,  0.0957,  0.4182,  0.0094,  0.9950,  0.0201,
         0.1908,  0.1555,  0.8902,  0.9583,  0.1392,  0.9702,  0.2768,
         0.2372,  0.0277,  0.9577,  0.6759,  0.4351,  0.0651,  0.0446,
         0.2814,  0.2409,  0.8608,  0.9942,  0.0717,  0.0614,  0.6826,
         0.2585,  0.2300,  0.0792,  0.9782,  0.9738,  0.9546,  0.7441,
         0.9839,  0.0086,  0.5049,  0.0174,  0.3734,  0.1793,  0.9576,
         0.0344,  0.4488,  0.0521,  0.3211,  0.9592,  0.0085,  0.9304,
         0.8829,  0.1373,  0.9723,  0.9139,  0.9940,  0.9420,  0.0407,
         0.6791,  0.0130,  0.0029,  0.9399,  0.2627,  0.6584,  0.0742,
         0.1968,  0.8913,  0.0015,  0.0925,  0.2983,  0.9171,  0.0846,
         0.6518,  0.0256,  0.0903,  0.0740,  0.1780,  0.9383,  0.4389,
         0.4378,  0.3323,  0.5737,  0.6564,  0.1868,  0.9066,  0.3727,
         0.7858,  0.0746,  0.0117,  0.8446,  0.0261,  0.8059,  0.0298,
         0.2679,  0.4182,  0.8703,  0.8617,  0.0894,  0.9528,  0.3175,
         0.9494,  0.1030,  0.9350,  0.0789,  0.1323,  0.8997,  0.0064,
         0.5233,  0.1500,  0.5205,  0.3693,  0.9913,  0.1988,  0.0290,
         0.1607,  0.1610,  0.9938,  0.4984,  0.9791,  0.4167,  0.2085,
         0.8112,  0.0812,  0.7601,  0.1133,  0.1246,  0.0361,  0.9496,
         0.2823,  0.8761,  0.1960,  0.0985,  0.8727,  0.5937,  0.1963,
         0.2580,  0.9956,  0.0933,  0.3793,  0.3745,  0.0908,  0.0416,
         0.9940,  0.9495,  0.1090,  0.9493,  0.0939,  0.7349,  0.8693,
         0.1933,  0.1193,  0.6599,  0.1922,  0.0119,  0.4981,  0.7035,
         0.9943,  0.9976,  0.0469,  0.0006,  0.5008,  0.0590,  0.7261,
         0.9597,  0.0079,  0.0983,  0.4549,  0.0860,  0.1525,  0.9362,
         0.3403,  0.9991,  0.7546,  0.9959,  0.0313,  0.0284,  0.2717,
         0.7099,  0.0074,  0.9565,  0.8391,  0.9030,  0.5995,  0.0051,
         0.9987,  0.9603,  0.4453,  0.1057,  0.1323,  0.0480,  0.0924,
         0.1981,  0.9945,  0.7157,  0.8811,  0.9840,  0.9990,  0.1113,
         0.0116,  0.5337,  0.0966,  0.7921,  0.6579,  0.9769,  0.0131,
         0.5176,  0.9583,  0.2434,  0.3438,  0.5771,  0.5287,  0.1006,
         0.0245,  0.0894,  0.5837,  0.1409,  0.0477,  0.6642,  0.3353,
         0.0385,  0.1906,  0.9854,  0.0442,  0.8226,  0.0020,  0.9938,
         0.9862,  0.9145,  0.2408,  0.5089,  0.9612,  0.2468,  0.8918,
         0.0416,  0.1399,  0.3545,  0.0988,  0.9047,  0.1724,  0.0328,
         0.4504,  0.2241,  0.0773,  0.2216,  0.0222,  0.2217,  0.9859,
         0.3307,  0.1164,  0.9732,  0.4792,  0.8610,  0.6099,  0.3237,
         0.9943,  0.0657,  0.8676,  0.6354,  0.9805,  0.1829,  0.2076,
         0.0873,  0.0214,  0.2007,  0.9859,  0.1732,  0.1736,  0.7147,
         0.1834,  0.9713,  0.3861,  0.0644,  0.0335,  0.1183,  0.3237,
         0.0156,  0.9768,  0.4313,  0.9053,  0.9794,  0.0614,  0.3485,
         0.0799,  0.9089,  0.8820,  0.0241,  0.3364,  0.9444,  0.0772,
         0.9548,  0.9533,  0.1314,  0.9456,  0.9069,  0.9791,  0.8571,
         0.9442,  0.9995,  0.8807,  0.8376,  0.9996,  0.8223,  0.9209,
         0.9495,  0.3266,  0.1972,  0.9247,  0.0092,  0.9981,  0.8352,
         0.1894,  0.1156,  0.5260,  0.9989,  0.9598,  0.9712,  0.0055,
         0.4221,  0.0059,  0.8477,  0.9665,  0.9817,  0.9556,  0.1234,
         0.0557,  0.6815,  0.0308,  0.9147,  0.4906,  0.0894,  0.0078,
         0.0758,  0.3567,  0.1632,  0.9617,  0.2281,  0.9066,  0.1507,
         0.9403,  0.9741,  0.0970,  0.0040,  0.3947,  0.1252,  0.9680,
         0.6094,  0.7994,  0.9350,  0.0372,  0.2737,  0.0393,  0.0859,
         0.9652,  0.0647,  0.3448,  0.7387,  0.1289,  0.0451,  0.4060,
         0.9579,  0.9932,  0.1303,  0.9780,  0.7856,  0.9992,  0.7114,
         0.0693,  0.9541,  0.9584,  0.9545,  0.9296,  0.0586,  0.0121,
         0.9145,  0.1440,  0.8169,  0.1262,  0.7626,  0.1023,  0.0720,
         0.9863,  0.9100,  0.4392,  0.1122,  0.0661,  0.9189,  0.0936,
         0.1796,  0.6775,  0.0062,  0.9281,  0.9996,  0.2944,  0.9794,
         0.9788,  0.9859,  0.0140,  0.9997,  0.9653,  0.9554,  0.1323,
         0.0275,  0.0259,  0.5156,  0.1376,  0.9297,  0.1865,  0.0940,
         0.6320,  0.9786,  0.7034,  0.0439,  0.0321,  0.0851,  0.9947,
         0.8240,  0.7259,  0.0183,  0.0685,  0.0512,  0.9152,  0.2121,
         0.1385,  0.9866,  0.9749,  0.9815,  0.0880,  0.9732,  0.7238,
         0.9476,  0.1929,  0.9971,  0.1603,  0.0604,  0.9563,  0.5621,
         0.0919,  0.8339,  0.4938,  0.8229,  0.7992,  0.1680,  0.9010,
         0.9506,  0.5160,  0.9128,  0.0703,  0.0986,  0.8107,  0.9298,
         0.1633,  0.9416,  0.9479,  0.8442,  0.2187,  0.0693,  0.7974,
         0.6953,  0.1944,  0.4168,  0.3864,  0.9937,  0.0050,  0.9108,
         0.3823,  0.9926,  0.9547,  0.1641,  0.4279,  0.0072,  0.0846,
         0.0495,  0.9791,  0.9477,  0.0932,  0.9957,  0.2001,  0.4780,
         0.7601], device='cuda:0')
tensor(0.2794, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0520,  0.8330,  0.9224,  0.4718,  0.1624,  0.9891,  0.7539,
         0.3392,  0.0673,  0.1286,  0.9366,  0.9025,  0.7321,  0.8853,
         0.6429,  0.9821,  0.9909,  0.0088,  0.3229,  0.6221,  0.0167,
         0.9915,  0.9054,  0.3572,  0.0216,  0.1281,  0.0326,  0.7958,
         0.4931,  0.8774,  0.0249,  0.9523,  0.9711,  0.2707,  0.9578,
         0.8626,  0.9193,  0.0652,  0.0219,  0.0338,  0.0404,  0.3862,
         0.2669,  0.0127,  0.9844,  0.4781,  0.9499,  0.7297,  0.9992,
         0.3676,  0.8477,  0.1625,  0.9372,  0.9109,  0.0835,  0.9237,
         0.9154,  0.6849,  0.9865,  0.0360,  0.9606,  0.0636,  0.0821,
         0.0112,  0.3760,  0.9351,  0.0338,  0.2124,  0.8907,  0.0721,
         0.8397,  0.0716,  0.0242,  0.0157,  0.0918,  0.1220,  0.0208,
         0.6967,  0.4308,  0.0786,  0.9774,  0.2401,  0.9531,  0.0221,
         0.7513,  0.9818,  0.4690,  0.0525,  0.1970,  0.9259,  0.0017,
         0.0013,  0.1600,  0.9664,  0.0531,  0.0892,  0.8589,  0.8829,
         0.6798,  0.0499,  0.1830,  0.9714,  0.9660,  0.0194,  0.6129,
         0.0157,  0.3074,  0.8298,  0.0246,  0.9863,  0.9962,  0.9608,
         0.1045,  0.0355,  0.0727,  0.9631,  0.9662,  0.9993,  0.9710,
         0.0069,  0.1939,  0.8616,  0.2004,  0.0775,  0.9595,  0.0392,
         0.2340,  0.9022,  0.9945,  0.2700,  0.9988,  0.9812,  0.3495,
         0.9889,  0.4931,  0.0021,  0.2845,  0.0887,  0.9885,  0.0255,
         0.0453,  0.0244,  0.2115,  0.0990,  0.8678,  0.0301,  0.0498,
         0.3629,  0.2538,  0.1634,  0.6333,  0.9798,  0.9763,  0.2511,
         0.8846,  0.3876,  0.0787,  0.9732,  0.8797,  0.2673,  0.9999,
         0.9684,  0.0411,  0.0379,  0.2348,  0.2362,  0.9749,  0.6611,
         0.6294,  0.0122,  0.9762,  0.1305,  0.8925,  0.1459,  0.3604,
         0.2792,  0.1412,  0.0014,  0.9862,  0.9546,  0.0155,  0.0470,
         0.8026,  0.1961,  0.2734,  0.9921,  0.1172,  0.9849,  0.0818,
         0.0034,  0.0342,  0.3478,  0.9784,  0.8852,  0.5358,  0.7381,
         0.0106,  0.0657,  0.2805,  0.1523,  0.0850,  0.0626,  0.7749,
         0.0248,  0.4512,  0.7223,  0.1764,  0.7426,  0.1681,  0.1436,
         0.9484,  0.0242,  0.0715,  0.2003,  0.9644,  0.6286,  0.0669,
         0.0760,  0.0284,  0.0962,  0.8980,  0.0740,  0.0414,  0.0614,
         0.6351,  0.0095,  0.9029,  0.0608,  0.1342,  0.4557,  0.9520,
         0.0163,  0.0710,  0.1552,  0.9974,  0.0854,  0.3530,  0.8439,
         0.9629,  0.0960,  0.8777,  0.0322,  0.9023,  0.3106,  0.8455,
         0.0485,  0.0637,  0.4938,  0.0775,  0.1383,  0.0884,  0.9820,
         0.9865,  0.2105,  0.4351,  0.0196,  0.8971,  0.4848,  0.3786,
         0.2888,  0.5423,  0.9485,  0.5285,  0.0617,  0.7392,  0.7381,
         0.4920,  0.9937,  0.6649,  0.2205,  0.0438,  0.0369,  0.0176,
         0.0285,  0.0287,  0.2090,  0.0165,  0.0838,  0.1871,  0.0143,
         0.8563,  0.9752,  0.0317,  0.2044,  0.8259,  0.0397,  0.1766,
         0.9675,  0.0790,  0.1671,  0.1856,  0.9968,  0.8138,  0.9518,
         0.2560,  0.4654,  0.1593,  0.0915,  0.9544,  0.0283,  0.2070,
         0.1666,  0.9208,  0.0099,  0.0490,  0.0176,  0.3520,  0.4298,
         0.1959,  0.0110,  0.7631,  0.3782,  0.8440,  0.0437,  0.7853,
         0.8042,  0.2082,  0.2864,  0.0343,  0.9992,  0.9536,  0.9362,
         0.8163,  0.0654,  0.9295,  0.0542,  0.9627,  0.0125,  0.0943,
         0.9720,  0.2223,  0.9433,  0.9434,  0.0401,  0.4720,  0.0532,
         0.0753,  0.8218,  0.0372,  0.9860,  0.1303,  0.1944,  0.9153,
         0.8321,  0.1613,  0.9908,  0.1432,  0.7389,  0.2796,  0.1423,
         0.9341,  0.1256,  0.0736,  0.9980,  0.8236,  0.5210,  0.1957,
         0.9769,  0.8538,  0.0826,  0.9886,  0.9319,  0.2262,  0.7125,
         0.8952,  0.1187,  0.9598,  0.7906,  0.0018,  0.0076,  0.0318,
         0.0657,  0.7561,  0.8582,  0.9522,  0.9766,  0.9766,  0.8415,
         0.1207,  0.9693,  0.7934,  0.1749,  0.2214,  0.0340,  0.0561,
         0.0091,  0.4108,  0.7911,  0.1038,  0.0202,  0.9105,  0.9187,
         0.0716,  0.4355,  0.9325,  0.9804,  0.9907,  0.8898,  0.0767,
         0.0820,  0.7727,  0.0738,  0.1950,  0.0409,  0.9492,  0.0088,
         0.9155,  0.0348,  0.0913,  0.9597,  0.1327,  0.0689,  0.0339,
         0.9643,  0.0337,  0.1152,  0.0572,  0.0850,  0.9979,  0.1134,
         0.0476,  0.7956,  0.0899,  0.0356,  0.2173,  0.0859,  0.9501,
         0.0788,  0.8406,  0.0409,  0.0504,  0.0483,  0.9727,  0.1009,
         0.9837,  0.9561,  0.0039,  0.0386,  0.9160,  0.0568,  0.1094,
         0.1386,  0.0227,  0.9593,  0.9995,  0.2133,  0.2802,  0.0978,
         0.9804,  0.0175,  0.9943,  0.0774,  0.9780,  0.9904,  0.9673,
         0.9884,  0.9589,  0.0841,  0.8969,  0.9938,  0.0564,  0.9556,
         0.9028,  0.2014,  0.2595,  0.9769,  0.8417,  0.0289,  0.9589,
         0.0798,  0.0541,  0.9739,  0.9952,  0.4550,  0.1126,  0.0139,
         0.1301,  0.9997,  0.9433,  0.0161,  0.8714,  0.1614,  0.9836,
         0.2084,  0.9810,  0.3937,  0.8954,  0.9900,  0.9998,  0.8600,
         0.0172,  0.9892,  0.7954,  0.0763,  0.0669,  0.2216,  0.0551,
         0.0061,  0.2001,  0.0987,  0.0615,  0.4836,  0.0491,  0.8807,
         0.9317,  0.0649,  0.1538,  0.0652,  0.2246,  0.1793,  0.0124,
         0.0369], device='cuda:0')
tensor(0.2952, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1391,  0.0180,  0.1361,  0.9137,  0.2108,  0.0020,  0.0241,
         0.0909,  0.0264,  0.0295,  0.9641,  0.7737,  0.6696,  0.0312,
         0.9988,  0.9892,  0.9908,  0.0148,  0.9915,  0.1274,  0.9692,
         0.1268,  0.9718,  0.9545,  0.1371,  0.2077,  0.9993,  0.6760,
         0.1728,  0.9191,  0.1993,  0.3090,  0.4293,  0.7674,  0.3755,
         0.0840,  0.9258,  0.9941,  0.0233,  0.0086,  0.0996,  0.0654,
         0.8959,  0.7796,  0.3911,  0.0729,  0.9295,  0.0681,  0.9211,
         0.0231,  0.9961,  0.3901,  0.9964,  0.3277,  0.9991,  0.0390,
         0.8763,  0.0424,  0.9998,  0.0728,  0.9913,  0.0628,  0.4471,
         0.0598,  0.9861,  0.9973,  0.4451,  0.8623,  0.1330,  0.0675,
         0.0426,  0.9576,  0.1531,  0.2162,  0.8320,  0.1051,  0.9880,
         0.2366,  0.7064,  0.0294,  0.0062,  0.0191,  0.0148,  0.0867,
         0.0481,  0.4374,  0.9708,  0.1043,  0.2645,  0.4622,  0.1404,
         0.0604,  0.1224,  0.0159,  0.0547,  0.9700,  0.9901,  0.9343,
         0.0862,  0.9912,  0.8153,  0.1059,  0.0717,  0.9996,  0.8175,
         0.3908,  0.9048,  0.2930,  0.9588,  0.0184,  0.9541,  0.2202,
         0.1426,  0.8033,  0.8446,  0.4828,  0.1798,  0.1017,  0.8634,
         0.0286,  0.0473,  0.9918,  0.1120,  0.9003,  0.9715,  0.9522,
         0.9985,  0.0364,  0.9085,  0.9773,  0.9981,  0.0910,  0.0631,
         0.0560,  0.4000,  0.9849,  0.0733,  0.0577,  0.2263,  0.0295,
         0.0761,  0.9917,  0.0357,  0.4342,  0.9960,  0.0666,  0.0122,
         0.3302,  0.3564,  0.0209,  0.0657,  0.7737,  0.1254,  0.9597,
         0.9661,  0.9872,  0.9864,  0.5099,  0.8595,  0.0201,  0.7857,
         0.0674,  0.0875,  0.0648,  0.0305,  0.9674,  0.0809,  0.9763,
         0.9797,  0.9034,  0.9750,  0.0239,  0.0564,  0.1783,  0.9458,
         0.9765,  0.9761,  0.9881,  0.9216,  0.0855,  0.8936,  0.3023,
         0.6138,  0.0342,  0.8855,  0.0324,  0.9674,  0.0308,  0.1520,
         0.1240,  0.2665,  0.0464,  0.9143,  0.0826,  0.9745,  0.9927,
         0.0565,  0.0292,  0.9745,  0.8556,  0.9309,  0.9744,  0.9766,
         0.9516,  0.1146,  0.9920,  0.0342,  0.9846,  0.2990,  0.7153,
         0.1777,  0.0297,  0.2494,  0.9499,  0.7242,  0.0594,  0.1303,
         0.9365,  0.7214,  0.4655,  0.2442,  0.0200,  0.9329,  0.2991,
         0.5768,  0.0331,  0.0111,  0.0507,  0.9282,  0.0063,  0.9825,
         0.0786,  0.0018,  0.8098,  0.0697,  0.9425,  0.6115,  0.0660,
         0.9494,  0.0455,  0.1792,  0.9755,  0.9646,  0.9982,  0.9775,
         0.9381,  0.9757,  0.9614,  0.0913,  0.9383,  0.9994,  0.0217,
         0.9959,  0.9921,  0.9474,  0.0123,  0.9951,  0.0498,  0.0506,
         0.2190,  0.0173,  0.9713,  0.9997,  0.0383,  0.9952,  0.9632,
         0.9876,  0.9889,  0.8647,  0.9729,  0.1352,  0.3165,  0.9946,
         0.9903,  0.1106,  0.0780,  0.9978,  0.9900,  0.1786,  0.9786,
         0.9645,  0.0631,  0.9291,  0.9429,  0.9986,  0.0753,  0.9959,
         0.9976,  0.0311,  0.0642,  0.9871,  0.9915,  0.1922,  0.9653,
         0.9987,  0.9761,  0.9941,  0.9803,  0.0503,  0.9405,  0.9888,
         0.7619,  0.5673,  0.0374,  0.0654,  0.9945,  0.9936,  0.2673,
         0.0164,  0.0263,  0.9845,  0.0374,  0.8639,  0.9866,  0.9886,
         0.6783,  0.9294,  0.9876,  0.0770,  0.2664,  0.8921,  0.0384,
         0.6185,  0.6827,  0.9970,  0.6340,  0.3041,  0.1699,  0.0523,
         0.9801,  0.9497,  0.0920,  0.0364,  0.1316,  0.9806,  0.5388,
         0.0209,  0.0433,  0.9990,  0.9546,  0.5718,  0.1620,  0.0102,
         0.0100,  0.9959,  0.6714,  0.0105,  0.0885,  0.0670,  0.9232,
         0.9765,  0.0958,  0.7637,  0.1061,  0.0506,  0.3419,  0.9892,
         0.0596,  0.0072,  0.0396,  0.5111,  0.2849,  0.4204,  0.0172,
         0.0396,  0.0004,  0.2387,  0.0965,  0.0881,  0.9908,  0.9618,
         0.0378,  0.9950,  0.0497,  0.9881,  0.1239,  0.9998,  0.1378,
         0.0072,  0.0356,  0.0485,  0.9728,  0.8948,  0.1082,  0.9604,
         0.9211,  0.9329,  0.0172,  0.9810,  0.9297,  0.0008,  0.6944,
         0.9899,  0.9931,  0.0900,  0.2905,  0.9970,  0.2717,  0.9072,
         0.7572,  0.9908,  0.9997,  0.4905,  0.9169,  0.9819,  0.0639,
         0.9598,  0.8614,  0.9428,  0.2269,  0.1164,  0.3290,  0.9798,
         0.2526,  0.1340,  0.1011,  0.9709,  0.0943,  0.0841,  0.9884,
         0.0181,  0.9424,  0.1639,  0.9653,  0.0388,  0.4536,  0.9151,
         0.0106,  0.3073,  0.6728,  0.0187,  0.9796,  0.0557,  0.9988,
         0.0469,  0.8405,  0.2611,  0.9582,  0.2410,  0.9716,  0.1255,
         0.9973,  0.1456,  0.0944,  0.9830,  0.4647,  0.1570,  0.1899,
         0.0582,  0.9934,  0.1006,  0.1042,  0.7088,  0.0423,  0.0564,
         0.8987,  0.9276,  0.9940,  0.0536,  0.0032,  0.2269,  0.0880,
         0.0397,  0.0094,  0.0477,  0.0264,  0.7261,  0.1158,  0.0335,
         0.2187,  0.1785,  0.0820,  0.9428,  0.3442,  0.0301,  0.7678,
         0.9966,  0.0266,  0.0092,  0.0474,  0.6017,  0.8631,  0.0252,
         0.9828,  0.5319,  0.2032,  0.9309,  0.9967,  0.0212,  0.0422,
         0.0501,  0.0584,  0.0257,  0.0841,  0.8614,  0.9912,  0.8559,
         0.7313,  0.0364,  0.0054,  0.8419,  0.0458,  0.1646,  0.9954,
         0.9952,  0.9201,  0.3791,  0.9803,  0.0976,  0.1182,  0.0491,
         0.9870], device='cuda:0')
tensor(0.3259, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1687,  0.0577,  0.3057,  0.0372,  0.0306,  0.0114,  0.0009,
         0.1317,  0.9720,  0.0761,  0.1106,  0.9985,  0.0318,  0.9849,
         0.0576,  0.0952,  0.9716,  0.0279,  0.9998,  0.4870,  0.0356,
         0.9974,  0.1673,  0.0050,  0.0131,  0.9526,  0.0262,  0.8419,
         0.3045,  0.9875,  0.0543,  0.1303,  0.9738,  0.9770,  0.0718,
         0.1105,  0.0154,  0.0886,  0.9675,  0.9704,  0.9822,  0.9762,
         0.7194,  0.0025,  0.0365,  0.7722,  0.9819,  0.9457,  0.9930,
         0.9759,  0.2679,  0.9995,  0.6024,  0.0253,  0.9819,  0.9403,
         0.9958,  0.9743,  0.9614,  0.9979,  0.0350,  0.4383,  0.9834,
         0.0479,  0.9774,  0.9939,  0.0055,  0.7156,  0.9988,  0.1163,
         0.9707,  0.9864,  0.9543,  0.9866,  0.9749,  0.8229,  0.8139,
         0.0607,  0.9531,  0.9947,  0.9959,  0.0848,  0.0481,  0.9812,
         0.1020,  0.0322,  0.0061,  0.0504,  0.0720,  0.0472,  0.5275,
         0.0459,  0.9971,  0.1035,  0.0968,  0.1823,  0.9035,  0.0456,
         0.1160,  0.0566,  0.8865,  0.9956,  0.2860,  0.1005,  0.0524,
         0.7695,  0.0110,  0.0739,  0.2588,  0.9403,  0.9355,  0.9936,
         0.9917,  0.0156,  0.9867,  0.9858,  0.9927,  0.0836,  0.0672,
         0.9810,  0.0411,  0.2191,  0.1517,  0.9976,  0.8993,  0.9937,
         0.9962,  0.6738,  0.9512,  0.0642,  0.5647,  0.9986,  0.9977,
         0.1146,  0.9588,  0.4191,  0.0333,  0.0317,  0.9853,  0.6223,
         0.9930,  0.2481,  0.9495,  0.9863,  0.2974,  0.9679,  0.0700,
         0.9128,  0.0581,  0.9366,  0.9410,  0.9237,  0.1974,  0.9947,
         0.5010,  0.9999,  0.0009,  0.2203,  0.0524,  0.9405,  0.9913,
         0.8543,  0.9215,  0.9763,  0.1463,  0.0886,  0.0579,  0.9771,
         0.0162,  0.0315,  0.9400,  0.9951,  0.0954,  0.0703,  0.2378,
         0.0430,  0.0454,  0.9769,  0.4015,  0.0118,  0.9698,  0.9170,
         0.0333,  0.1051,  0.0988,  0.9655,  0.0559,  0.9635,  0.9861,
         0.0264,  0.9941,  0.3373,  0.2879,  0.0156,  0.5341,  0.0102,
         0.9936,  0.3826,  0.0266,  0.0521,  0.8610,  0.1053,  0.0627,
         0.1125,  0.6365,  0.0034,  0.0143,  0.6102,  0.9715,  0.8416,
         0.3684,  0.0170,  0.9813,  0.1171,  0.1351,  0.4207,  0.9636,
         0.0037,  0.9700,  0.1208,  0.9962,  0.0400,  0.0252,  0.8173,
         0.2835,  0.9518,  0.2487,  0.5891,  0.9909,  0.1326,  0.1031,
         0.0579,  0.9237,  0.6948,  0.9128,  0.3367,  0.9816,  0.1492,
         0.0169,  0.3537,  0.9941,  0.0568,  0.0412,  0.9814,  0.1689,
         0.9664,  0.9993,  0.8640,  0.0640,  0.1989,  0.0068,  0.9870,
         0.0400,  0.0550,  0.0471,  0.1693,  0.7796,  0.9551,  0.9853,
         0.0301,  0.0412,  0.1577,  0.0680,  0.1172,  0.9548,  0.9842,
         0.9221,  0.0729,  0.9087,  0.6359,  0.0076,  0.1974,  0.4608,
         0.1546,  0.0982,  0.9973,  0.9747,  0.9692,  0.0788,  0.0442,
         0.9195,  0.7932,  0.9731,  0.9805,  0.1647,  0.0080,  0.4009,
         0.0285,  0.3924,  0.9352,  0.9901,  0.9648,  0.0902,  0.9317,
         0.9953,  0.0157,  0.7115,  0.0391,  0.0232,  0.9871,  0.9495,
         0.9650,  0.9938,  0.0777,  0.9966,  0.3149,  0.0316,  0.9955,
         0.0066,  0.0588,  0.6999,  0.4794,  0.0010,  0.9913,  0.0032,
         0.1500,  0.9555,  0.0547,  0.9742,  0.0194,  0.0913,  0.9561,
         0.8351,  0.9631,  0.0688,  0.0078,  0.7674,  0.4511,  0.0184,
         0.0741,  0.1871,  0.0214,  0.9947,  0.9642,  0.9790,  0.9671,
         0.0289,  0.1785,  0.0105,  0.2677,  0.7836,  0.1739,  0.1394,
         0.9589,  0.9635,  0.7676,  0.9660,  0.9376,  0.1272,  0.9950,
         0.0690,  0.9838,  0.9856,  0.9753,  0.9947,  0.1947,  0.8581,
         0.9764,  0.0802,  0.3031,  0.9648,  0.9443,  0.9917,  0.0028,
         0.9871,  0.2560,  0.0289,  0.9893,  0.2226,  0.1082,  0.9867,
         0.9373,  0.9939,  0.9959,  0.9808,  0.9883,  0.2833,  0.1394,
         0.9876,  0.6927,  0.0232,  0.1652,  0.9994,  0.9990,  0.0224,
         0.1901,  0.9851,  0.9928,  0.1539,  0.9912,  0.9692,  0.9486,
         0.3516,  0.0403,  0.2237,  0.1662,  0.0489,  0.0919,  0.9753,
         0.9816,  0.1532,  0.0641,  0.9876,  0.6074,  0.9123,  0.9569,
         0.0781,  0.0338,  0.9961,  0.0884,  0.9885,  0.9920,  0.0229,
         0.3614,  0.0877,  0.9996,  0.0833,  0.9930,  0.9722,  0.0823,
         0.9984,  0.0064,  0.0367,  0.9939,  0.0063,  0.9987,  0.9930,
         0.1335,  0.0177,  0.9922,  0.7503,  0.0537,  0.8407,  0.2221,
         0.0375,  0.0720,  0.0413,  0.1494,  0.9756,  0.1795,  0.9918,
         0.0152,  0.9751,  0.0351,  0.9707,  0.9879,  0.9316,  0.0806,
         0.0480,  0.1746,  0.9167,  0.9972,  0.9844,  0.0520,  0.9741,
         0.9713,  0.0688,  0.9664,  0.0784,  0.0852,  0.9976,  0.0181,
         0.1026,  0.9988,  0.7769,  0.9735,  0.1578,  0.0029,  0.9881,
         0.9920,  0.9541,  0.9902,  0.6962,  0.9397,  0.9990,  0.0356,
         0.0094,  0.7374,  0.0647,  0.9855,  0.0038,  0.2486,  0.0500,
         0.1148,  0.9662,  0.9513,  0.9962,  0.9135,  0.6253,  0.0410,
         0.0345,  0.0331,  0.2046,  0.0235,  0.0227,  0.9812,  0.9899,
         0.0053,  0.9960,  0.9873,  0.0695,  0.2368,  0.9252,  0.0388,
         0.0346,  0.8184,  0.9738,  0.9976,  0.9913,  0.0283,  0.9360,
         0.1030], device='cuda:0')
tensor(0.3210, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9742,  0.0698,  0.1008,  0.0189,  0.0560,  0.9501,  0.7082,
         0.9770,  0.0276,  0.1147,  0.1021,  0.9279,  0.7550,  0.9542,
         0.0529,  0.5566,  0.1531,  0.2694,  0.1159,  0.9950,  0.7795,
         0.9839,  0.8459,  0.9835,  0.0059,  0.5314,  0.0722,  0.7220,
         0.9557,  0.9045,  0.8867,  0.1019,  0.0615,  0.7961,  0.0269,
         0.9760,  0.9682,  0.1045,  0.9972,  0.3874,  0.0349,  0.9262,
         0.0598,  0.0125,  0.9936,  0.0278,  0.9213,  0.2188,  0.9369,
         0.0400,  0.9889,  0.0408,  0.1136,  0.2210,  0.9996,  0.9893,
         0.0699,  0.1690,  0.9125,  0.0801,  0.7148,  0.1381,  0.8288,
         0.9672,  0.6831,  0.0296,  0.1112,  0.2996,  0.9543,  0.0059,
         0.5180,  0.0226,  0.3864,  0.0332,  0.9722,  0.0594,  0.0868,
         0.5532,  0.0371,  0.7702,  0.0277,  0.9867,  0.9697,  0.0076,
         0.1596,  0.8026,  0.9627,  0.0179,  0.8584,  0.1213,  0.2007,
         0.9771,  0.0073,  0.0629,  0.2309,  0.0100,  0.9557,  0.0636,
         0.9082,  0.6958,  0.8902,  0.1335,  0.0969,  0.9913,  0.9801,
         0.0340,  0.0815,  0.9187,  0.2218,  0.2138,  0.9892,  0.9738,
         0.9689,  0.0906,  0.0568,  0.0458,  0.9772,  0.9282,  0.0053,
         0.9663,  0.9524,  0.2649,  0.1538,  0.9857,  0.0097,  0.1386,
         0.0843,  0.9744,  0.9366,  0.9610,  0.9456,  0.9684,  0.0327,
         0.9125,  0.9712,  0.9899,  0.9548,  0.2682,  0.7681,  0.0608,
         0.0432,  0.9596,  0.0014,  0.2288,  0.0293,  0.9810,  0.9806,
         0.0063,  0.9860,  0.0158,  0.9968,  0.9726,  0.6637,  0.3267,
         0.9891,  0.9882,  0.1968,  0.0130,  0.9953,  0.2094,  0.9752,
         0.0579,  0.2727,  0.2615,  0.9411,  0.0603,  0.2460,  0.1232,
         0.9820,  0.9695,  0.1034,  0.9690,  0.7430,  0.1252,  0.9716,
         0.9002,  0.1865,  0.0699,  0.9534,  0.0392,  0.9438,  0.9341,
         0.0643,  0.9097,  0.9693,  0.3324,  0.9987,  0.9270,  0.0329,
         0.0636,  0.0193,  0.8383,  0.9238,  0.0827,  0.9992,  0.9209,
         0.1865,  0.9553,  0.9511,  0.4325,  0.9963,  0.9397,  0.1565,
         0.1262,  0.0053,  0.9723,  0.2590,  0.0577,  0.9791,  0.9695,
         0.0203,  0.9760,  0.0411,  0.0278,  0.1536,  0.3288,  0.4427,
         0.2981,  0.0817,  0.0637,  0.0222,  0.9794,  0.8493,  0.0621,
         0.0135,  0.0066,  0.9998,  0.0451,  0.1038,  0.9579,  0.9885,
         0.2817,  0.1913,  0.9622,  0.9819,  0.6770,  0.9814,  0.4655,
         0.9570,  0.8882,  0.0015,  0.3202,  0.0721,  0.9923,  0.8969,
         0.0846,  0.0395,  0.9949,  0.0677,  0.9757,  0.0223,  0.9993,
         0.0944,  0.2887,  0.9869,  0.5552,  0.9756,  0.4249,  0.2295,
         0.9709,  0.8959,  0.9995,  0.0531,  0.2187,  0.0026,  0.1045,
         0.9802,  0.4453,  0.0388,  0.1640,  0.9883,  0.3404,  0.9917,
         0.5684,  0.4913,  0.0865,  0.9444,  0.9622,  0.9775,  0.9334,
         0.9954,  0.0755,  0.9440,  0.9968,  0.9820,  0.1501,  0.1749,
         0.9564,  0.1581,  0.8181,  0.9884,  0.5155,  0.0442,  0.3688,
         0.0056,  0.9699,  0.1982,  0.2366,  0.2743,  0.9892,  0.8636,
         0.9096,  0.9442,  0.6104,  0.1594,  0.8961,  0.3710,  0.9893,
         0.9929,  0.9823,  0.2841,  0.0019,  0.0781,  0.9921,  0.0799,
         0.1695,  0.9539,  0.9941,  0.1303,  0.3926,  0.9814,  0.0174,
         0.0207,  0.2506,  0.3952,  0.8769,  0.9902,  0.9015,  0.9884,
         0.9953,  0.9871,  0.9756,  0.0023,  0.9843,  0.6054,  0.4141,
         0.0367,  0.1827,  0.9853,  0.9977,  0.0990,  0.0788,  0.0621,
         0.0721,  0.9846,  0.2681,  0.0770,  0.5924,  0.3595,  0.1222,
         0.9642,  0.9714,  0.9700,  0.0150,  0.0258,  0.7732,  0.9454,
         0.2192,  0.8293,  0.1750,  0.9456,  0.9671,  0.2964,  0.9188,
         0.1867,  0.0404,  0.4575,  0.0528,  0.8538,  0.9890,  0.0334,
         0.6708,  0.0250,  0.6008,  0.9995,  0.9105,  0.9433,  0.5107,
         0.9785,  0.1267,  0.0100,  0.0664,  0.8011,  0.0128,  0.7395,
         0.9946,  0.9857,  0.9817,  0.9583,  0.0657,  0.9383,  0.0156,
         0.8642,  0.4689,  0.0984,  0.7777,  0.9889,  0.9208,  0.0419,
         0.9780,  0.8052,  0.9766,  0.9808,  0.9304,  0.0074,  0.1795,
         0.0301,  0.0562,  0.9858,  0.6178,  0.9771,  0.5975,  0.9752,
         0.0226,  0.9983,  0.0481,  0.9083,  0.9625,  0.9506,  0.7943,
         0.0379,  0.9785,  0.1615,  0.6217,  0.9977,  0.0192,  0.0312,
         0.0630,  0.0044,  0.0493,  0.0903,  0.0458,  0.9993,  0.0427,
         0.0850,  0.8030,  0.0992,  0.0480,  0.4395,  0.9409,  0.0217,
         0.0208,  0.9987,  0.1779,  0.7021,  0.9709,  0.9866,  0.5882,
         0.0328,  0.8161,  0.9525,  0.0317,  0.9715,  0.4548,  0.0031,
         0.0133,  0.0668,  0.9868,  0.0989,  0.9839,  0.1263,  0.0088,
         0.9889,  0.1511,  0.9887,  0.0437,  0.1027,  0.9286,  0.7061,
         0.9801,  0.7757,  0.0819,  0.9945,  0.7729,  0.0230,  0.0913,
         0.0752,  0.2039,  0.9631,  0.9864,  0.2935,  0.9606,  0.5487,
         0.9998,  0.9833,  0.9978,  0.8410,  0.0457,  0.0174,  0.5346,
         0.9674,  0.9903,  0.9750,  0.9722,  0.7701,  0.9888,  0.0066,
         0.8762,  0.0458,  0.9586,  0.0224,  0.0275,  0.8646,  0.0734,
         0.3180,  0.9793,  0.3217,  0.9845,  0.9281,  0.0109,  0.0215,
         0.9214], device='cuda:0')
tensor(0.3100, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0711,  0.8310,  0.1900,  0.9975,  0.1015,  0.0210,  0.0729,
         0.2558,  0.9981,  0.0954,  0.9068,  0.1895,  0.0723,  0.5403,
         0.1778,  0.3144,  0.2976,  0.9997,  0.6833,  0.1947,  0.8834,
         0.1568,  0.0409,  0.9583,  0.8951,  0.0408,  0.1258,  0.1504,
         0.0758,  0.7300,  0.6035,  0.9198,  0.1285,  0.7492,  0.1548,
         0.9934,  0.8200,  0.6191,  0.2190,  0.0207,  0.2532,  0.9472,
         0.7111,  0.9618,  0.0054,  0.9073,  0.9865,  0.1114,  0.9892,
         0.5986,  0.8712,  0.5124,  0.3892,  0.0557,  0.0154,  0.1833,
         0.9973,  0.0215,  0.9504,  0.0389,  0.0624,  0.3538,  0.5829,
         0.1464,  0.3936,  0.5456,  0.9620,  0.3251,  0.1927,  0.3332,
         0.1088,  0.8346,  0.1105,  0.0771,  0.6726,  0.1634,  0.2463,
         0.0267,  0.4556,  0.8263,  0.2258,  0.7414,  0.0491,  0.1400,
         0.0407,  0.1983,  0.8965,  0.1870,  0.2974,  0.0584,  0.9851,
         0.1427,  0.9532,  0.0336,  0.0848,  0.8478,  0.0650,  0.9605,
         0.2121,  0.9806,  0.7872,  0.8271,  0.9868,  0.0763,  0.0687,
         0.0126,  0.0371,  0.9425,  0.0055,  0.0536,  0.8078,  0.7757,
         0.3979,  0.1068,  0.9633,  0.8970,  0.9280,  0.3529,  0.5786,
         0.8823,  0.4307,  0.1549,  0.8229,  0.2179,  0.4012,  0.1199,
         0.6255,  0.0404,  0.7953,  0.6642,  0.9787,  0.2064,  0.1935,
         0.0358,  0.0383,  0.9235,  0.9205,  0.0467,  0.9893,  0.0117,
         0.0219,  0.0669,  0.7191,  0.9844,  0.8945,  0.9119,  0.9567,
         0.9713,  0.9288,  0.0813,  0.9712,  0.8042,  0.1864,  0.6109,
         0.7342,  0.2403,  0.0387,  0.2640,  0.3747,  0.0436,  0.6719,
         0.9004,  0.0361,  0.2694,  0.2645,  0.9677,  0.3592,  0.9741,
         0.2119,  0.9818,  0.8530,  0.9697,  0.2882,  0.0425,  0.9469,
         0.9562,  0.9987,  0.7503,  0.1737,  0.1037,  0.8950,  0.4599,
         0.6428,  0.4538,  0.0912,  0.9294,  0.4740,  0.0345,  0.9521,
         0.0458,  0.9428,  0.1212,  0.0232,  0.9885,  0.0126,  0.1922,
         0.9420,  0.9209,  0.8424,  0.9221,  0.6592,  0.1218,  0.0245,
         0.0193,  0.1659,  0.0428,  0.1510,  0.9486,  0.1264,  0.5167,
         0.9607,  0.2451,  0.8907,  0.8139,  0.6492,  0.0193,  0.9339,
         0.0221,  0.5560,  0.9295,  0.9751,  0.0370,  0.0644,  0.6498,
         0.6581,  0.5601,  0.5967,  0.9991,  0.1257,  0.0866,  0.9604,
         0.1760,  0.2612,  0.0099,  0.1136,  0.5069,  0.0501,  0.5154,
         0.0378,  0.2790,  0.1636,  0.2752,  0.5988,  0.0671,  0.9578,
         0.9035,  0.2413,  0.2341,  0.6120,  0.9297,  0.9625,  0.0896,
         0.0323,  0.3994,  0.0885,  0.0064,  0.2710,  0.9368,  0.0196,
         0.5633,  0.1166,  0.8850,  0.4716,  0.9015,  0.2362,  0.0334,
         0.0400,  0.0553,  0.1530,  0.2030,  0.9102,  0.3199,  0.3743,
         0.2200,  0.7437,  0.8422,  0.7401,  0.9246,  0.4859,  0.0013,
         0.9168,  0.9575,  0.9448,  0.9514,  0.5818,  0.1172,  0.0599,
         0.6778,  0.0155,  0.7168,  0.9948,  0.9799,  0.2866,  0.0155,
         0.1103,  0.9382,  0.0650,  0.1204,  0.4948,  0.9598,  0.9822,
         0.5375,  0.8294,  0.2874,  0.3401,  0.0566,  0.3916,  0.3599,
         0.8849,  0.2845,  0.6443,  0.9486,  0.0716,  0.8920,  0.2234,
         0.8573,  0.5020,  0.0033,  0.9991,  0.1204,  0.6601,  0.2269,
         0.9805,  0.0017,  0.9800,  0.2105,  0.0080,  0.4494,  0.6306,
         0.7960,  0.8881,  0.4418,  0.6135,  0.9501,  0.7888,  0.0992,
         0.1119,  0.3566,  0.0121,  0.9116,  0.8617,  0.6342,  0.1896,
         0.1101,  0.3343,  0.1631,  0.1661,  0.7555,  0.9425,  0.1904,
         0.0465,  0.7837,  0.9720,  0.0766,  0.8678,  0.0797,  0.9957,
         0.6266,  0.1281,  0.8971,  0.8641,  0.0227,  0.2746,  0.9486,
         0.2337,  0.9899,  0.8689,  0.7805,  0.0074,  0.9641,  0.1473,
         0.9393,  0.5311,  0.1778,  0.0725,  0.9168,  0.2925,  0.9064,
         0.1676,  0.0080,  0.1660,  0.3344,  0.7720,  0.6755,  0.9754,
         0.9717,  0.9996,  0.0176,  0.5178,  0.9251,  0.0352,  0.0240,
         0.6385,  0.0882,  0.0503,  0.4936,  0.9631,  0.9787,  0.9807,
         0.1897,  0.8697,  0.0377,  0.9844,  0.5422,  0.9922,  0.0402,
         0.1724,  0.8476,  0.9384,  0.9359,  0.6513,  0.0232,  0.0990,
         0.7657,  0.8337,  0.0766,  0.2317,  0.2959,  0.0071,  0.1481,
         0.8968,  0.0106,  0.2843,  0.8881,  0.5744,  0.0426,  0.5247,
         0.1506,  0.9970,  0.0396,  0.1162,  0.0953,  0.1472,  0.7972,
         0.0317,  0.1022,  0.8904,  0.0559,  0.8570,  0.0059,  0.9683,
         0.9692,  0.5742,  0.7825,  0.9509,  0.2833,  0.9773,  0.9099,
         0.8135,  0.8908,  0.9610,  0.1721,  0.2957,  0.0128,  0.9135,
         0.9911,  0.0853,  0.9144,  0.5731,  0.9546,  0.9662,  0.6021,
         0.1025,  0.7660,  0.5671,  0.9413,  0.9560,  0.9428,  0.8169,
         0.0484,  0.8432,  0.9419,  0.8112,  0.0435,  0.3543,  0.1961,
         0.9749,  0.4770,  0.4473,  0.2855,  0.1272,  0.1583,  0.4729,
         0.0455,  0.2433,  0.0243,  0.9855,  0.0089,  0.0149,  0.1808,
         0.8418,  0.0464,  0.9620,  0.9886,  0.2356,  0.1816,  0.8854,
         0.9421,  0.9811,  0.0942,  0.2146,  0.1701,  0.9304,  0.8855,
         0.6742,  0.9956,  0.5956,  0.9605,  0.0872,  0.9794,  0.8812,
         0.8163], device='cuda:0')
tensor(0.2949, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2478,  0.3816,  0.8856,  0.6440,  0.2480,  0.0420,  0.8422,
         0.7343,  0.9907,  0.6805,  0.1289,  0.4702,  0.0336,  0.9722,
         0.5184,  0.9151,  0.5635,  0.0137,  0.5101,  0.2521,  0.0067,
         0.1738,  0.9326,  0.0318,  0.0620,  0.3094,  0.0252,  0.9114,
         0.0430,  0.0428,  0.1170,  0.9324,  0.1681,  0.9479,  0.0760,
         0.9741,  0.9921,  0.9007,  0.9908,  0.8944,  0.4659,  0.0129,
         0.9537,  0.4010,  0.8106,  0.4530,  0.2258,  0.0090,  0.7901,
         0.0934,  0.3937,  0.4322,  0.2105,  0.8365,  0.2282,  0.7257,
         0.9692,  0.4045,  0.7039,  0.8782,  0.1417,  0.0896,  0.1891,
         0.7441,  0.0056,  0.4313,  0.9956,  0.0268,  0.0285,  0.8771,
         0.9288,  0.8025,  0.3221,  0.4705,  0.2390,  0.9407,  0.8684,
         0.6414,  0.9195,  0.3142,  0.2874,  0.8852,  0.2574,  0.0787,
         0.2814,  0.7087,  0.8643,  0.0181,  0.3250,  0.4256,  0.8722,
         0.3320,  0.9169,  0.7688,  0.6466,  0.9203,  0.5048,  0.1696,
         0.8847,  0.3398,  0.1173,  0.6489,  0.9298,  0.0109,  0.1142,
         0.0292,  0.0029,  0.3729,  0.8208,  0.0606,  0.7477,  0.6513,
         0.2044,  0.6803,  0.8013,  0.4629,  0.9051,  0.1946,  0.6444,
         0.9753,  0.0899,  0.8645,  0.7827,  0.7539,  0.6948,  0.3334,
         0.6524,  0.9222,  0.0314,  0.9580,  0.5004,  0.9770,  0.9476,
         0.4520,  0.1095,  0.5594,  0.3924,  0.6143,  0.9653,  0.0809,
         0.0659,  0.0107,  0.9888,  0.5939,  0.1161,  0.7175,  0.0392,
         0.4183,  0.6417,  0.2314,  0.1280,  0.0351,  0.5245,  0.9969,
         0.1012,  0.0927,  0.2894,  0.6906,  0.0410,  0.9877,  0.9000,
         0.7775,  0.1188,  0.6920,  0.9883,  0.0673,  0.9167,  0.2252,
         0.6337,  0.9664,  0.4283,  0.9725,  0.6884,  0.2568,  0.8781,
         0.9667,  0.1359,  0.9670,  0.3869,  0.2578,  0.8743,  0.9426,
         0.2836,  0.0088,  0.7996,  0.0118,  0.5132,  0.9775,  0.6430,
         0.4964,  0.7190,  0.4962,  0.7907,  0.1180,  0.3760,  0.0393,
         0.8738,  0.7664,  0.1461,  0.1974,  0.8931,  0.5405,  0.4260,
         0.3793,  0.4873,  0.8729,  0.2794,  0.9410,  0.0104,  0.0936,
         0.1354,  0.0240,  0.9447,  0.0097,  0.6813,  0.9708,  0.1671,
         0.9058,  0.9413,  0.0842,  0.8974,  0.0191,  0.8798,  0.8935,
         0.6826,  0.1652,  0.0866,  0.1504,  0.5030,  0.7959,  0.5733,
         0.6523,  0.1042,  0.4722,  0.1383,  0.0666,  0.3331,  0.8341,
         0.8457,  0.9709,  0.6484,  0.2122,  0.9868,  0.9040,  0.1191,
         0.8915,  0.0044,  0.1842,  0.8519,  0.2653,  0.2748,  0.0758,
         0.8943,  0.0782,  0.2271,  0.8737,  0.4054,  0.1551,  0.8228,
         0.6086,  0.3536,  0.1015,  0.5719,  0.8111,  0.9286,  0.5313,
         0.1996,  0.7223,  0.8943,  0.8880,  0.8559,  0.9509,  0.9004,
         0.0642,  0.1528,  0.5431,  0.4573,  0.0535,  0.0829,  0.7531,
         0.1316,  0.9131,  0.6588,  0.0963,  0.8618,  0.3302,  0.9646,
         0.0757,  0.5599,  0.0524,  0.8787,  0.4308,  0.5985,  0.0790,
         0.2641,  0.5977,  0.9003,  0.1984,  0.9886,  0.1740,  0.7079,
         0.8900,  0.9529,  0.9908,  0.0179,  0.5411,  0.9224,  0.9820,
         0.3882,  0.6776,  0.7950,  0.9824,  0.3053,  0.2665,  0.1954,
         0.7722,  0.8538,  0.1122,  0.0681,  0.9170,  0.8592,  0.0546,
         0.0352,  0.5322,  0.1925,  0.8534,  0.3211,  0.9508,  0.0063,
         0.1367,  0.7790,  0.4190,  0.2141,  0.9009,  0.5076,  0.2988,
         0.5126,  0.0651,  0.0711,  0.1385,  0.1956,  0.7764,  0.0509,
         0.0939,  0.6515,  0.2196,  0.7206,  0.5533,  0.8904,  0.1737,
         0.5820,  0.8675,  0.9586,  0.8638,  0.0534,  0.8932,  0.7778,
         0.6814,  0.9168,  0.8536,  0.1537,  0.9313,  0.1622,  0.8919,
         0.9049,  0.6876,  0.3353,  0.3855,  0.9000,  0.1873,  0.1175,
         0.0770,  0.0506,  0.7389,  0.8646,  0.0901,  0.0199,  0.9799,
         0.0095,  0.0727,  0.5019,  0.8334,  0.7401,  0.5881,  0.2835,
         0.7291,  0.6124,  0.0721,  0.5497,  0.2765,  0.7843,  0.9706,
         0.3419,  0.0091,  0.9432,  0.9979,  0.1352,  0.4116,  0.7481,
         0.6493,  0.6651,  0.9084,  0.0013,  0.7094,  0.0559,  0.9163,
         0.3944,  0.1284,  0.1556,  0.9811,  0.1107,  0.9523,  0.7296,
         0.1847,  0.6993,  0.4433,  0.8992,  0.1283,  0.9216,  0.0094,
         0.1748,  0.7290,  0.0432,  0.9716,  0.1480,  0.2114,  0.1563,
         0.6059,  0.0639,  0.5752,  0.0472,  0.0190,  0.8730,  0.0339,
         0.9519,  0.8693,  0.9607,  0.7838,  0.9418,  0.0314,  0.8027,
         0.8630,  0.3114,  0.1369,  0.9652,  0.9704,  0.1487,  0.5670,
         0.5870,  0.8838,  0.7292,  0.0453,  0.0083,  0.0775,  0.7967,
         0.1465,  0.7727,  0.0571,  0.7439,  0.4586,  0.5769,  0.2964,
         0.8225,  0.9444,  0.9610,  0.2831,  0.7479,  0.9604,  0.4570,
         0.2503,  0.8152,  0.6937,  0.1561,  0.0716,  0.9455,  0.3485,
         0.5079,  0.2188,  0.6701,  0.0789,  0.8316,  0.0427,  0.4465,
         0.6500,  0.8887,  0.0662,  0.9433,  0.8608,  0.8366,  0.4586,
         0.0801,  0.9611,  0.7674,  0.9519,  0.1354,  0.3052,  0.0956,
         0.9569,  0.1728,  0.0172,  0.9914,  0.4071,  0.2534,  0.0666,
         0.0502,  0.8947,  0.1384,  0.0258,  0.0253,  0.8392,  0.0563,
         0.9682], device='cuda:0')
tensor(0.2981, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3344,  0.3990,  0.7574,  0.6340,  0.8711,  0.1956,  0.0452,
         0.7199,  0.0113,  0.0414,  0.4962,  0.2331,  0.6661,  0.4587,
         0.1287,  0.3050,  0.8729,  0.1830,  0.4435,  0.5327,  0.7475,
         0.0023,  0.7601,  0.7923,  0.5498,  0.9135,  0.8681,  0.9085,
         0.4443,  0.3669,  0.2304,  0.8754,  0.2348,  0.1104,  0.8554,
         0.8997,  0.3131,  0.6914,  0.3142,  0.2632,  0.2535,  0.2988,
         0.6599,  0.1694,  0.0055,  0.0034,  0.7893,  0.6933,  0.8253,
         0.2069,  0.0022,  0.6613,  0.5241,  0.8618,  0.0805,  0.3797,
         0.8416,  0.9125,  0.8899,  0.1652,  0.1521,  0.7856,  0.7320,
         0.7430,  0.1879,  0.8029,  0.4508,  0.5861,  0.2874,  0.4495,
         0.8903,  0.9043,  0.5447,  0.1749,  0.0420,  0.5740,  0.5587,
         0.4646,  0.8281,  0.1364,  0.8936,  0.7114,  0.1611,  0.2905,
         0.0127,  0.2625,  0.2826,  0.1676,  0.4378,  0.7319,  0.9824,
         0.3364,  0.8716,  0.2894,  0.6006,  0.0431,  0.8552,  0.0090,
         0.0757,  0.1382,  0.3955,  0.7820,  0.0415,  0.9174,  0.2389,
         0.8440,  0.9177,  0.9860,  0.5844,  0.2779,  0.5162,  0.9873,
         0.0101,  0.8605,  0.8285,  0.4326,  0.1651,  0.1289,  0.8494,
         0.8781,  0.9550,  0.0797,  0.8699,  0.0569,  0.0332,  0.0511,
         0.8751,  0.9439,  0.6807,  0.0740,  0.8208,  0.8266,  0.5551,
         0.0038,  0.9938,  0.1067,  0.4563,  0.0020,  0.2984,  0.2008,
         0.6314,  0.1150,  0.6390,  0.5605,  0.0028,  0.1427,  0.5339,
         0.8735,  0.2437,  0.8284,  0.8506,  0.0014,  0.7373,  0.8922,
         0.7300,  0.4591,  0.3490,  0.1679,  0.6401,  0.8857,  0.3064,
         0.6102,  0.7570,  0.0854,  0.6377,  0.6494,  0.8670,  0.2465,
         0.0196,  0.0385,  0.0044,  0.8343,  0.7821,  0.8458,  0.0055,
         0.0549,  0.0213,  0.8412,  0.6495,  0.0931,  0.2577,  0.0081,
         0.2780,  0.6785,  0.9350,  0.7477,  0.5838,  0.5155,  0.9950,
         0.2635,  0.6897,  0.7151,  0.0502,  0.0274,  0.0108,  0.9304,
         0.4267,  0.6718,  0.8609,  0.1625,  0.5138,  0.2504,  0.2594,
         0.7223,  0.0878,  0.5122,  0.7033,  0.8140,  0.9471,  0.0675,
         0.0166,  0.0130,  0.5233,  0.3003,  0.3031,  0.0100,  0.2244,
         0.7302,  0.9212,  0.0061,  0.9529,  0.8527,  0.9064,  0.0818,
         0.0447,  0.9644,  0.6675,  0.1582,  0.8092,  0.9414,  0.3158,
         0.9249,  0.6201,  0.2391,  0.6149,  0.3835,  0.3944,  0.9287,
         0.2829,  0.8921,  0.1489,  0.0375,  0.0308,  0.8760,  0.2175,
         0.9950,  0.1149,  0.1676,  0.0417,  0.0020,  0.1819,  0.8804,
         0.4833,  0.1613,  0.8437,  0.2949,  0.5731,  0.8015,  0.6609,
         0.9045,  0.6249,  0.9165,  0.8273,  0.6653,  0.0042,  0.8917,
         0.0373,  0.4081,  0.9977,  0.8705,  0.5921,  0.4212,  0.9803,
         0.1920,  0.9445,  0.7436,  0.9268,  0.3368,  0.5501,  0.4004,
         0.0129,  0.2500,  0.3042,  0.0748,  0.6990,  0.4369,  0.2973,
         0.6575,  0.1037,  0.7006,  0.0506,  0.7081,  0.9491,  0.1631,
         0.2254,  0.6690,  0.0358,  0.4371,  0.1499,  0.0744,  0.6913,
         0.0894,  0.9198,  0.1129,  0.0468,  0.1415,  0.8564,  0.0070,
         0.0767,  0.9236,  0.7558,  0.6451,  0.9177,  0.0392,  0.0406,
         0.5594,  0.3116,  0.8701,  0.0065,  0.6566,  0.7343,  0.9940,
         0.8135,  0.7021,  0.1836,  0.6960,  0.2481,  0.0438,  0.0125,
         0.8935,  0.3059,  0.8890,  0.9641,  0.9125,  0.7455,  0.0050,
         0.7894,  0.1112,  0.1454,  0.2142,  0.6357,  0.9046,  0.1504,
         0.2028,  0.9679,  0.3273,  0.7914,  0.0116,  0.8259,  0.1443,
         0.1605,  0.0261,  0.9002,  0.2614,  0.8364,  0.1736,  0.7270,
         0.5732,  0.1360,  0.7483,  0.0289,  0.5608,  0.6273,  0.3151,
         0.7052,  0.7085,  0.8816,  0.0925,  0.9871,  0.3703,  0.9972,
         0.0914,  0.9574,  0.1012,  0.9739,  0.1270,  0.0412,  0.6537,
         0.2674,  0.8610,  0.8200,  0.4616,  0.7398,  0.2832,  0.0101,
         0.0884,  0.0516,  0.9123,  0.0967,  0.9661,  0.3954,  0.0969,
         0.2170,  0.5118,  0.1913,  0.9235,  0.7729,  0.9847,  0.0212,
         0.6901,  0.3299,  0.8749,  0.1622,  0.9364,  0.8838,  0.0612,
         0.7262,  0.9325,  0.0442,  0.3375,  0.1541,  0.1057,  0.3179,
         0.1675,  0.9731,  0.8772,  0.7769,  0.3021,  0.9513,  0.5095,
         0.5186,  0.3528,  0.0273,  0.0770,  0.0918,  0.9146,  0.7276,
         0.9240,  0.8461,  0.4527,  0.0139,  0.0270,  0.0049,  0.4569,
         0.0297,  0.8214,  0.4710,  0.0480,  0.6989,  0.8871,  0.3546,
         0.7581,  0.8281,  0.5842,  0.1172,  0.1403,  0.8026,  0.1399,
         0.9867,  0.5637,  0.8036,  0.2151,  0.0127,  0.8266,  0.4033,
         0.1509,  0.8985,  0.4516,  0.8771,  0.9131,  0.1393,  0.9560,
         0.6367,  0.4312,  0.0350,  0.7393,  0.9525,  0.2847,  0.8339,
         0.6438,  0.2919,  0.9951,  0.3419,  0.3366,  0.5676,  0.3121,
         0.1678,  0.0614,  0.1155,  0.5169,  0.0901,  0.1864,  0.7755,
         0.0875,  0.3053,  0.2185,  0.8894,  0.8290,  0.0094,  0.0589,
         0.5077,  0.8822,  0.9068,  0.1794,  0.3064,  0.9049,  0.8617,
         0.0509,  0.6588,  0.1960,  0.9309,  0.0838,  0.0668,  0.6810,
         0.6186,  0.8491,  0.8495,  0.7664,  0.0534,  0.9746,  0.4823,
         0.1296], device='cuda:0')
tensor(0.3275, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1786,  0.6261,  0.1581,  0.9602,  0.0601,  0.8521,  0.8318,
         0.8460,  0.8010,  0.1167,  0.0340,  0.0411,  0.8976,  0.7131,
         0.1698,  0.8272,  0.2177,  0.0026,  0.6277,  0.4536,  0.1529,
         0.5004,  0.0038,  0.0068,  0.5567,  0.7918,  0.9281,  0.2960,
         0.0362,  0.4367,  0.2933,  0.2855,  0.2598,  0.2931,  0.0139,
         0.9825,  0.5620,  0.6234,  0.5793,  0.1293,  0.2895,  0.3932,
         0.9140,  0.1129,  0.7328,  0.6415,  0.1215,  0.0032,  0.0981,
         0.6712,  0.7954,  0.8621,  0.0043,  0.0059,  0.9364,  0.3565,
         0.8033,  0.9019,  0.0209,  0.9145,  0.9692,  0.2315,  0.9787,
         0.2067,  0.0154,  0.7727,  0.0027,  0.7051,  0.0062,  0.4284,
         0.1283,  0.1131,  0.9980,  0.6172,  0.7235,  0.0336,  0.8396,
         0.6942,  0.9946,  0.8371,  0.3273,  0.0293,  0.4287,  0.2387,
         0.8644,  0.2153,  0.2371,  0.9506,  0.7314,  0.1265,  0.7169,
         0.0306,  0.4292,  0.1561,  0.8420,  0.0117,  0.5290,  0.8093,
         0.8416,  0.2083,  0.2504,  0.3670,  0.6100,  0.9260,  0.9474,
         0.2801,  0.6960,  0.9188,  0.0475,  0.5419,  0.2498,  0.0061,
         0.0882,  0.0641,  0.3548,  0.9181,  0.3620,  0.9351,  0.0909,
         0.8964,  0.8010,  0.1587,  0.5780,  0.9521,  0.5647,  0.2266,
         0.5410,  0.7472,  0.1061,  0.4852,  0.3118,  0.9380,  0.8213,
         0.5912,  0.0030,  0.0689,  0.8066,  0.8981,  0.9683,  0.8089,
         0.9076,  0.3962,  0.9808,  0.5486,  0.5307,  0.8249,  0.1095,
         0.0179,  0.2767,  0.3838,  0.5075,  0.3658,  0.7188,  0.6944,
         0.5416,  0.1463,  0.0387,  0.7010,  0.8246,  0.1977,  0.8686,
         0.6644,  0.8907,  0.2940,  0.7040,  0.0707,  0.9959,  0.0262,
         0.7444,  0.0152,  0.0859,  0.0065,  0.7872,  0.9234,  0.1201,
         0.0668,  0.9282,  0.9773,  0.7449,  0.7549,  0.8404,  0.8673,
         0.9809,  0.3829,  0.7881,  0.8917,  0.5010,  0.8760,  0.0904,
         0.4577,  0.8280,  0.3115,  0.9037,  0.8564,  0.7037,  0.8591,
         0.3174,  0.1152,  0.5396,  0.0462,  0.0637,  0.0218,  0.2522,
         0.0398,  0.9889,  0.1831,  0.7998,  0.5597,  0.5784,  0.0180,
         0.0106,  0.6241,  0.7793,  0.5752,  0.9444,  0.7406,  0.8906,
         0.8940,  0.0288,  0.0230,  0.4824,  0.8680,  0.8258,  0.9322,
         0.6719,  0.9060,  0.4551,  0.2218,  0.0358,  0.8609,  0.1107,
         0.1849,  0.0392,  0.2649,  0.5984,  0.0210,  0.2189,  0.2282,
         0.5226,  0.6003,  0.8562,  0.7527,  0.9703,  0.1174,  0.7960,
         0.4735,  0.0062,  0.0107,  0.5304,  0.0931,  0.5995,  0.4880,
         0.0258,  0.2848,  0.4692,  0.5435,  0.1243,  0.5991,  0.0081,
         0.0784,  0.3269,  0.7312,  0.0448,  0.3754,  0.1766,  0.0186,
         0.0113,  0.6601,  0.0496,  0.2021,  0.9218,  0.5465,  0.9700,
         0.1266,  0.1298,  0.8571,  0.1276,  0.1438,  0.3571,  0.6743,
         0.9440,  0.8131,  0.8591,  0.6667,  0.4645,  0.6618,  0.8111,
         0.5625,  0.1265,  0.8349,  0.0450,  0.9975,  0.4834,  0.8278,
         0.8409,  0.1370,  0.9626,  0.9388,  0.0084,  0.6933,  0.7707,
         0.7145,  0.8630,  0.0181,  0.0785,  0.0608,  0.3716,  0.4916,
         0.8776,  0.2891,  0.0475,  0.5784,  0.1448,  0.7441,  0.9082,
         0.9043,  0.1037,  0.9928,  0.5115,  0.6963,  0.9945,  0.0497,
         0.2852,  0.8239,  0.6415,  0.9003,  0.6718,  0.8917,  0.5996,
         0.0846,  0.0943,  0.1479,  0.0199,  0.5740,  0.4259,  0.8170,
         0.2771,  0.2025,  0.0088,  0.9327,  0.5120,  0.1820,  0.8523,
         0.3443,  0.1013,  0.6251,  0.7229,  0.8680,  0.0736,  0.0070,
         0.9573,  0.0148,  0.6938,  0.0272,  0.7501,  0.6732,  0.1080,
         0.1625,  0.8238,  0.1616,  0.6639,  0.9853,  0.0426,  0.1877,
         0.8609,  0.8704,  0.9622,  0.3714,  0.5054,  0.0065,  0.3204,
         0.9567,  0.1418,  0.7946,  0.1267,  0.8523,  0.6361,  0.0693,
         0.0717,  0.0257,  0.0286,  0.1681,  0.0913,  0.0065,  0.8100,
         0.4440,  0.3056,  0.2781,  0.4950,  0.9466,  0.0323,  0.7392,
         0.8732,  0.7751,  0.0021,  0.2496,  0.8637,  0.3068,  0.8933,
         0.2193,  0.6693,  0.7017,  0.9184,  0.8567,  0.5454,  0.0752,
         0.9380,  0.1041,  0.8750,  0.1207,  0.9354,  0.8820,  0.9374,
         0.7067,  0.9225,  0.0730,  0.7973,  0.0463,  0.0295,  0.0309,
         0.2395,  0.1703,  0.1421,  0.8285,  0.2064,  0.5217,  0.6446,
         0.9904,  0.0174,  0.0612,  0.0324,  0.0322,  0.9326,  0.0689,
         0.3383,  0.9917,  0.5055,  0.8487,  0.1479,  0.7922,  0.9266,
         0.0253,  0.0153,  0.7135,  0.0200,  0.3952,  0.7888,  0.0843,
         0.3357,  0.1246,  0.0490,  0.6991,  0.4837,  0.5937,  0.0800,
         0.3665,  0.8627,  0.0299,  0.1187,  0.3214,  0.9757,  0.5647,
         0.7552,  0.0796,  0.2753,  0.9655,  0.9261,  0.9585,  0.4203,
         0.3549,  0.5432,  0.0693,  0.0207,  0.0574,  0.0182,  0.7688,
         0.6659,  0.8521,  0.9911,  0.0479,  0.0184,  0.9602,  0.9809,
         0.9838,  0.0393,  0.1963,  0.5022,  0.4529,  0.6019,  0.9112,
         0.8160,  0.9755,  0.5487,  0.3982,  0.0971,  0.6409,  0.7970,
         0.3533,  0.8616,  0.9627,  0.8880,  0.0813,  0.9981,  0.3164,
         0.4584,  0.2883,  0.7777,  0.8504,  0.0253,  0.8694,  0.4840,
         0.5792], device='cuda:0')
tensor(0.3141, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0528,  0.2519,  0.3706,  0.0146,  0.9242,  0.0583,  0.8947,
         0.4059,  0.9092,  0.9220,  0.6653,  0.0472,  0.1758,  0.9116,
         0.1126,  0.1828,  0.0374,  0.1967,  0.9226,  0.9140,  0.6547,
         0.1444,  0.0338,  0.8172,  0.3398,  0.6038,  0.2520,  0.0065,
         0.2045,  0.9255,  0.2713,  0.0379,  0.7294,  0.8509,  0.0016,
         0.1248,  0.8061,  0.0186,  0.9307,  0.9728,  0.0516,  0.0225,
         0.9898,  0.3192,  0.8856,  0.6658,  0.9405,  0.4962,  0.7116,
         0.9985,  0.9768,  0.9443,  0.7841,  0.0850,  0.0013,  0.9166,
         0.6482,  0.9873,  0.6728,  0.4328,  0.4182,  0.9468,  0.0051,
         0.0780,  0.2843,  0.9270,  0.3112,  0.1843,  0.2979,  0.0236,
         0.0690,  0.5913,  0.0745,  0.1086,  0.0310,  0.1279,  0.5775,
         0.9117,  0.0453,  0.0123,  0.2928,  0.7160,  0.5688,  0.0256,
         0.6863,  0.0017,  0.8760,  0.0390,  0.8217,  0.3903,  0.8603,
         0.3568,  0.1892,  0.7391,  0.0277,  0.3369,  0.5652,  0.9187,
         0.6931,  0.0652,  0.0198,  0.8113,  0.1636,  0.8936,  0.1557,
         0.9628,  0.7132,  0.2896,  0.6047,  0.0106,  0.9955,  0.9047,
         0.7704,  0.2432,  0.3014,  0.1338,  0.7433,  0.9051,  0.2726,
         0.2287,  0.9631,  0.5820,  0.5179,  0.2691,  0.7794,  0.8599,
         0.0826,  0.0066,  0.6427,  0.0322,  0.9158,  0.8456,  0.8527,
         0.9804,  0.8228,  0.6323,  0.9980,  0.9325,  0.8331,  0.6208,
         0.9385,  0.7637,  0.1672,  0.8523,  0.8165,  0.1211,  0.3061,
         0.5464,  0.5597,  0.8375,  0.5132,  0.8765,  0.1256,  0.8647,
         0.7135,  0.6956,  0.9843,  0.0951,  0.9247,  0.0138,  0.8552,
         0.0309,  0.9735,  0.0985,  0.6829,  0.1261,  0.0022,  0.0114,
         0.1215,  0.0938,  0.9029,  0.2694,  0.0581,  0.1361,  0.0599,
         0.8108,  0.8564,  0.8428,  0.9289,  0.4149,  0.0039,  0.9320,
         0.8853,  0.0014,  0.9222,  0.0802,  0.9160,  0.0375,  0.7743,
         0.1919,  0.0168,  0.4083,  0.1906,  0.7896,  0.4796,  0.0535,
         0.7107,  0.8614,  0.5226,  0.8054,  0.3156,  0.9130,  0.8520,
         0.1248,  0.9584,  0.9865,  0.0993,  0.6186,  0.5238,  0.7386,
         0.0231,  0.7363,  0.0458,  0.8426,  0.6647,  0.7748,  0.5367,
         0.3310,  0.4379,  0.1861,  0.3456,  0.0110,  0.3192,  0.7390,
         0.8777,  0.1437,  0.5743,  0.8715,  0.0388,  0.6357,  0.0439,
         0.0802,  0.9407,  0.0097,  0.8436,  0.2722,  0.8916,  0.1362,
         0.1346,  0.9203,  0.1447,  0.9541,  0.4844,  0.0312,  0.6803,
         0.0444,  0.2503,  0.0453,  0.8619,  0.0948,  0.6389,  0.3183,
         0.0033,  0.0386,  0.8903,  0.2111,  0.0021,  0.0254,  0.5659,
         0.0829,  0.9816,  0.8880,  0.9136,  0.0992,  0.8988,  0.2904,
         0.8382,  0.9421,  0.6211,  0.9585,  0.5619,  0.8236,  0.4364,
         0.3169,  0.1750,  0.0445,  0.8918,  0.0429,  0.0359,  0.9522,
         0.0343,  0.0544,  0.2036,  0.9876,  0.7529,  0.8529,  0.4953,
         0.6743,  0.9408,  0.0181,  0.0053,  0.0662,  0.8501,  0.7594,
         0.6296,  0.8795,  0.7397,  0.1114,  0.0598,  0.8357,  0.1688,
         0.5324,  0.6515,  0.6043,  0.0022,  0.1593,  0.0105,  0.8151,
         0.0154,  0.7846,  0.1319,  0.0523,  0.7325,  0.2629,  0.4038,
         0.2939,  0.7688,  0.1686,  0.6826,  0.5943,  0.0382,  0.4923,
         0.3906,  0.2119,  0.7457,  0.6792,  0.1655,  0.3321,  0.1500,
         0.8006,  0.0151,  0.8713,  0.8949,  0.0967,  0.0142,  0.8791,
         0.9437,  0.6143,  0.9991,  0.5866,  0.0759,  0.0193,  0.9878,
         0.5314,  0.3605,  0.7672,  0.8975,  0.6365,  0.0143,  0.3492,
         0.8898,  0.9154,  0.0282,  0.1673,  0.0054,  0.0141,  0.1188,
         0.0253,  0.7187,  0.6268,  0.2413,  0.3871,  0.8683,  0.4569,
         0.0095,  0.7881,  0.9391,  0.0692,  0.9135,  0.5344,  0.1312,
         0.0878,  0.7346,  0.0144,  0.7718,  0.0302,  0.9081,  0.9170,
         0.7361,  0.9930,  0.0208,  0.0935,  0.1463,  0.0444,  0.0756,
         0.0016,  0.2442,  0.4884,  0.9462,  0.9802,  0.9074,  0.0352,
         0.2141,  0.8291,  0.1406,  0.0357,  0.3380,  0.7249,  0.8873,
         0.0318,  0.1252,  0.0086,  0.2823,  0.9325,  0.9747,  0.0226,
         0.7664,  0.0715,  0.2021,  0.0890,  0.0126,  0.3178,  0.6837,
         0.4305,  0.8438,  0.9447,  0.9507,  0.4982,  0.1023,  0.9758,
         0.0640,  0.7135,  0.1200,  0.8723,  0.0607,  0.0411,  0.9408,
         0.7944,  0.1521,  0.6793,  0.9359,  0.0171,  0.8448,  0.1595,
         0.7784,  0.9777,  0.8800,  0.7971,  0.1827,  0.4742,  0.9677,
         0.1543,  0.0419,  0.8879,  0.0235,  0.2225,  0.0045,  0.7939,
         0.4161,  0.8215,  0.7415,  0.2595,  0.2723,  0.9709,  0.8714,
         0.8518,  0.0526,  0.0253,  0.0931,  0.6040,  0.5545,  0.8326,
         0.3802,  0.9635,  0.8883,  0.8568,  0.7126,  0.8538,  0.7480,
         0.6942,  0.1036,  0.4798,  0.9666,  0.8121,  0.9519,  0.1790,
         0.7649,  0.1010,  0.9960,  0.7330,  0.0192,  0.8381,  0.0229,
         0.1632,  0.0282,  0.9969,  0.8953,  0.0612,  0.8291,  0.9066,
         0.4770,  0.7403,  0.0133,  0.2354,  0.0583,  0.4233,  0.8118,
         0.7669,  0.3910,  0.0515,  0.3785,  0.2709,  0.0376,  0.0465,
         0.0197,  0.9775,  0.7571,  0.8919,  0.7524,  0.1071,  0.1779,
         0.5812], device='cuda:0')
tensor(0.3001, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.5675,  0.9485,  0.0072,  0.6340,  0.9489,  0.8833,  0.8209,
         0.0014,  0.1086,  0.2357,  0.9542,  0.0286,  0.9224,  0.0614,
         0.9009,  0.2811,  0.9630,  0.9429,  0.7977,  0.0284,  0.9120,
         0.9936,  0.6379,  0.0412,  0.0882,  0.0259,  0.6543,  0.9964,
         0.9194,  0.5574,  0.9258,  0.0073,  0.6965,  0.0040,  0.0117,
         0.9045,  0.2278,  0.6881,  0.3918,  0.5763,  0.8403,  0.0386,
         0.3589,  0.0909,  0.8420,  0.0082,  0.0816,  0.4954,  0.6432,
         0.0878,  0.0059,  0.0199,  0.7727,  0.7814,  0.7432,  0.9303,
         0.1059,  0.1343,  0.7543,  0.0023,  0.8077,  0.9198,  0.0293,
         0.1623,  0.3147,  0.9195,  0.8885,  0.1874,  0.0096,  0.0848,
         0.4537,  0.2969,  0.0207,  0.1742,  0.1812,  0.8309,  0.5582,
         0.4747,  0.9560,  0.0607,  0.2265,  0.0269,  0.3559,  0.5695,
         0.2578,  0.0071,  0.9519,  0.5799,  0.0299,  0.0728,  0.3624,
         0.9962,  0.0918,  0.8977,  0.0375,  0.1606,  0.9011,  0.0034,
         0.9700,  0.9279,  0.0023,  0.8610,  0.0266,  0.0441,  0.9604,
         0.9742,  0.0308,  0.8280,  0.8909,  0.6080,  0.9159,  0.0913,
         0.9855,  0.8798,  0.0275,  0.0032,  0.9383,  0.8247,  0.0725,
         0.0515,  0.2766,  0.9961,  0.8833,  0.4117,  0.8479,  0.1146,
         0.1175,  0.0483,  0.8251,  0.0121,  0.6739,  0.8326,  0.9549,
         0.8487,  0.0886,  0.6143,  0.2866,  0.0650,  0.5498,  0.1094,
         0.2471,  0.0480,  0.7769,  0.6683,  0.9400,  0.6621,  0.1186,
         0.9894,  0.0207,  0.0054,  0.2357,  0.7792,  0.5449,  0.2649,
         0.6705,  0.4291,  0.9509,  0.9770,  0.4711,  0.9601,  0.1387,
         0.9800,  0.2586,  0.9176,  0.6361,  0.0798,  0.7072,  0.9601,
         0.3596,  0.6987,  0.9611,  0.6391,  0.0014,  0.9990,  0.0114,
         0.0303,  0.9093,  0.7676,  0.3206,  0.0270,  0.2869,  0.6988,
         0.9970,  0.7803,  0.0188,  0.8913,  0.8814,  0.9856,  0.8824,
         0.8990,  0.8391,  0.8077,  0.7161,  0.9900,  0.8664,  0.8818,
         0.9514,  0.0308,  0.1200,  0.1629,  0.0363,  0.0774,  0.0026,
         0.0692,  0.6653,  0.7867,  0.0336,  0.7290,  0.9751,  0.9882,
         0.4410,  0.4011,  0.7952,  0.0929,  0.9459,  0.1615,  0.0222,
         0.7429,  0.2945,  0.9603,  0.0353,  0.0595,  0.0474,  0.1380,
         0.4114,  0.8984,  0.8500,  0.0719,  0.0096,  0.1950,  0.9794,
         0.9754,  0.7070,  0.5384,  0.5056,  0.1453,  0.1203,  0.9972,
         0.3451,  0.9013,  0.0046,  0.0075,  0.9049,  0.7423,  0.1244,
         0.0173,  0.7719,  0.0867,  0.9820,  0.4359,  0.0346,  0.9939,
         0.0130,  0.9993,  0.9645,  0.9241,  0.0936,  0.5071,  0.6710,
         0.1504,  0.4911,  0.9014,  0.0175,  0.2320,  0.8714,  0.6732,
         0.0497,  0.1513,  0.9373,  0.9794,  0.9426,  0.9653,  0.7222,
         0.9372,  0.9310,  0.1298,  0.5575,  0.1377,  0.8945,  0.8299,
         0.2391,  0.0115,  0.0571,  0.6261,  0.0620,  0.8421,  0.8894,
         0.0122,  0.8405,  0.0823,  0.8455,  0.0783,  0.9382,  0.3379,
         0.8900,  0.9091,  0.9879,  0.2307,  0.7509,  0.0282,  0.3535,
         0.7673,  0.2246,  0.8360,  0.1210,  0.0330,  0.9069,  0.8708,
         0.6216,  0.9212,  0.0327,  0.4698,  0.1767,  0.3563,  0.8606,
         0.2541,  0.9456,  0.0097,  0.0424,  0.0038,  0.9084,  0.8848,
         0.8670,  0.0473,  0.0251,  0.7740,  0.0910,  0.3160,  0.9643,
         0.1173,  0.2207,  0.7270,  0.3239,  0.8270,  0.8568,  0.7727,
         0.7638,  0.0374,  0.7340,  0.9093,  0.8955,  0.2128,  0.4492,
         0.0014,  0.7183,  0.3547,  0.1019,  0.0600,  0.8949,  0.9337,
         0.7961,  0.4994,  0.4693,  0.0374,  0.5169,  0.0439,  0.7744,
         0.5038,  0.8969,  0.0074,  0.9779,  0.8207,  0.9349,  0.6586,
         0.9278,  0.0477,  0.6227,  0.0290,  0.0055,  0.1068,  0.9411,
         0.9186,  0.9454,  0.1331,  0.9063,  0.8441,  0.8874,  0.0065,
         0.0580,  0.9778,  0.0009,  0.0355,  0.8762,  0.7871,  0.7954,
         0.9759,  0.8572,  0.9302,  0.0635,  0.9303,  0.3209,  0.8076,
         0.0356,  0.0264,  0.2412,  0.8271,  0.8279,  0.0379,  0.8855,
         0.9613,  0.7978,  0.6069,  0.4179,  0.0283,  0.8941,  0.0007,
         0.7728,  0.9709,  0.5984,  0.0048,  0.0063,  0.0902,  0.0100,
         0.9111,  0.9562,  0.0173,  0.0239,  0.9143,  0.9996,  0.3934,
         0.2083,  0.0932,  0.9888,  0.2520,  0.0240,  0.9219,  0.8934,
         0.9445,  0.9273,  0.0490,  0.7373,  0.0347,  0.9429,  0.7531,
         0.9141,  0.9216,  0.0211,  0.7283,  0.1190,  0.9268,  0.9466,
         0.9572,  0.5343,  0.3039,  0.0046,  0.9193,  0.8740,  0.1391,
         0.9280,  0.0222,  0.9842,  0.9723,  0.9978,  0.0185,  0.0474,
         0.0097,  0.9281,  0.0040,  0.0207,  0.0641,  0.2028,  0.5825,
         0.5706,  0.3522,  0.9765,  0.0196,  0.0196,  0.6695,  0.8738,
         0.6883,  0.8102,  0.9535,  0.0107,  0.4835,  0.6518,  0.9188,
         0.8223,  0.8513,  0.9654,  0.0072,  0.9540,  0.0373,  0.9402,
         0.0833,  0.0898,  0.0299,  0.2567,  0.0727,  0.0064,  0.9237,
         0.4448,  0.4044,  0.4949,  0.7734,  0.0013,  0.0158,  0.0199,
         0.3411,  0.0012,  0.2334,  0.0197,  0.0091,  0.9607,  0.9897,
         0.9119,  0.1454,  0.4080,  0.7906,  0.9024,  0.0144,  0.8453,
         0.7604], device='cuda:0')
tensor(0.3517, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8440,  0.4890,  0.9374,  0.0475,  0.9219,  0.0145,  0.3279,
         0.0879,  0.0173,  0.3541,  0.8794,  0.0221,  0.8589,  0.9300,
         0.3318,  0.3767,  0.0139,  0.0403,  0.1539,  0.7731,  0.9398,
         0.9794,  0.9468,  0.0476,  0.7660,  0.9397,  0.7927,  0.8065,
         0.0377,  0.8592,  0.0678,  0.9407,  0.1262,  0.9122,  0.0748,
         0.3655,  0.9156,  0.0136,  0.9569,  0.3678,  0.9983,  0.8686,
         0.7762,  0.7281,  0.0134,  0.2206,  0.2721,  0.0438,  0.5972,
         0.0304,  0.0111,  0.0179,  0.0094,  0.0287,  0.0100,  0.1341,
         0.0114,  0.9952,  0.4060,  0.0203,  0.9574,  0.1766,  0.2570,
         0.9951,  0.9751,  0.8922,  0.9509,  0.4287,  0.7680,  0.9272,
         0.0949,  0.9950,  0.0331,  0.5930,  0.6818,  0.8053,  0.0754,
         0.0536,  0.9115,  0.2746,  0.4182,  0.0055,  0.0043,  0.5256,
         0.0005,  0.8983,  0.0749,  0.7179,  0.9490,  0.0769,  0.2060,
         0.2480,  0.8468,  0.9352,  0.0664,  0.9577,  0.9306,  0.9301,
         0.8274,  0.8286,  0.6693,  0.9671,  0.0010,  0.9991,  0.0206,
         0.9432,  0.8711,  0.0139,  0.0031,  0.8674,  0.1965,  0.9504,
         0.0197,  0.0036,  0.9995,  0.8974,  0.7867,  0.8239,  0.0195,
         0.1848,  0.0266,  0.0248,  0.9907,  0.7720,  0.9350,  0.9723,
         0.0135,  0.9247,  0.8072,  0.8420,  0.1173,  0.0203,  0.1310,
         0.0144,  0.0151,  0.0072,  0.0151,  0.0926,  0.1800,  0.0303,
         0.0915,  0.0117,  0.0440,  0.9953,  0.0766,  0.8069,  0.6903,
         0.8214,  0.2344,  0.6803,  0.0849,  0.9731,  0.3927,  0.0329,
         0.2129,  0.2686,  0.8897,  0.0035,  0.9661,  0.8593,  0.8327,
         0.8764,  0.0148,  0.2296,  0.8480,  0.0057,  0.6083,  0.0121,
         0.0293,  0.5752,  0.2573,  0.9479,  0.0357,  0.0042,  0.0238,
         0.9376,  0.1119,  0.0024,  0.0891,  0.0222,  0.0306,  0.0153,
         0.2844,  0.0039,  0.9817,  0.9734,  0.9772,  0.8833,  0.1092,
         0.9464,  0.9732,  0.8792,  0.0297,  0.8983,  0.0822,  0.0223,
         0.9906,  0.0099,  0.8605,  0.8895,  0.9013,  0.0801,  0.9606,
         0.9592,  0.4356,  0.9853,  0.0707,  0.0735,  0.0098,  0.9252,
         0.0062,  0.0576,  0.8863,  0.7289,  0.0120,  0.0096,  0.0472,
         0.5718,  0.8780,  0.0271,  0.0961,  0.2054,  0.8849,  0.0431,
         0.0015,  0.9762,  0.2512,  0.1504,  0.0260,  0.0189,  0.0404,
         0.0350,  0.0924,  0.0049,  0.8410,  0.6327,  0.8856,  0.8945,
         0.8457,  0.7798,  0.7928,  0.2472,  0.8674,  0.9483,  0.9396,
         0.3534,  0.0054,  0.8270,  0.8636,  0.0529,  0.9697,  0.6706,
         0.8620,  0.8168,  0.9931,  0.9430,  0.0077,  0.0640,  0.8546,
         0.9376,  0.0845,  0.3378,  0.9820,  0.9426,  0.4942,  0.0565,
         0.9498,  0.1257,  0.0065,  0.1036,  0.1298,  0.1719,  0.0828,
         0.9206,  0.1033,  0.8907,  0.0197,  0.7522,  0.9416,  0.1407,
         0.0140,  0.9902,  0.8699,  0.0071,  0.6818,  0.0330,  0.0025,
         0.0033,  0.4879,  0.0394,  0.9831,  0.8947,  0.0778,  0.1695,
         0.9351,  0.0085,  0.8361,  0.7290,  0.9423,  0.0292,  0.9262,
         0.0086,  0.3488,  0.0725,  0.9188,  0.4778,  0.0212,  0.8216,
         0.8034,  0.7706,  0.3689,  0.0129,  0.9983,  0.0618,  0.0468,
         0.8979,  0.7811,  0.9989,  0.7610,  0.0006,  0.0092,  0.0232,
         0.8678,  0.0113,  0.7325,  0.4116,  0.0658,  0.9418,  0.0044,
         0.8687,  0.8957,  0.0559,  0.2093,  0.9873,  0.8389,  0.8765,
         0.0183,  0.0046,  0.0540,  0.0009,  0.9013,  0.3535,  0.8776,
         0.5379,  0.6443,  0.0473,  0.7109,  0.7314,  0.5462,  0.0221,
         0.9741,  0.8427,  0.9330,  0.9271,  0.7035,  0.8857,  0.8805,
         0.8236,  0.0055,  0.0483,  0.9874,  0.0216,  0.0574,  0.0218,
         0.0065,  0.1711,  0.9009,  0.7812,  0.1918,  0.9718,  0.9262,
         0.9623,  0.0010,  0.8869,  0.9512,  0.8323,  0.2109,  0.0278,
         0.0383,  0.9732,  0.7221,  0.8794,  0.9806,  0.1826,  0.9618,
         0.9762,  0.0647,  0.7869,  0.0398,  0.8505,  0.9815,  0.0237,
         0.3532,  0.9202,  0.0225,  0.0351,  0.0664,  0.0822,  0.0751,
         0.8546,  0.3076,  0.3987,  0.0024,  0.3421,  0.9487,  0.0159,
         0.0141,  0.0020,  0.9806,  0.3534,  0.0616,  0.0896,  0.8977,
         0.9547,  0.1542,  0.0003,  0.9428,  0.9318,  0.0348,  0.9603,
         0.9644,  0.9561,  0.0172,  0.8479,  0.3536,  0.9653,  0.5514,
         0.0292,  0.6968,  0.8875,  0.8562,  0.1078,  0.7438,  0.3456,
         0.7348,  0.0167,  0.6278,  0.9614,  0.1323,  0.6313,  0.9065,
         0.0228,  0.9910,  0.8636,  0.0967,  0.9559,  0.0364,  0.1788,
         0.8862,  0.8507,  0.9941,  0.0160,  0.9818,  0.0478,  0.9845,
         0.0217,  0.9643,  0.0107,  0.8764,  0.7103,  0.7613,  0.9412,
         0.0238,  0.0291,  0.9500,  0.7109,  0.3745,  0.9939,  0.4128,
         0.0689,  0.6578,  0.1684,  0.2500,  0.1054,  0.9988,  0.8760,
         0.1301,  0.6661,  0.9299,  0.7975,  0.9184,  0.1285,  0.9499,
         0.9622,  0.6029,  0.8515,  0.7868,  0.0011,  0.0073,  0.0712,
         0.0004,  0.0059,  0.7104,  0.2787,  0.9400,  0.8721,  0.1160,
         0.0165,  0.0600,  0.1627,  0.5071,  0.7894,  0.9195,  0.8607,
         0.0091,  0.9370,  0.0844,  0.0488,  0.1082,  0.0412,  0.1089,
         0.0116], device='cuda:0')
tensor(0.3070, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8643,  0.2921,  0.9555,  0.9153,  0.9702,  0.9632,  0.9287,
         0.5445,  0.0693,  0.0390,  0.2252,  0.0290,  0.9659,  0.9730,
         0.9902,  0.0263,  0.9428,  0.0011,  0.1730,  0.9594,  0.9017,
         0.3653,  0.5556,  0.9111,  0.0467,  0.8673,  0.0442,  0.9537,
         0.9510,  0.8818,  0.0899,  0.9860,  0.1466,  0.9257,  0.0021,
         0.0344,  0.1890,  0.8365,  0.0888,  0.9978,  0.8591,  0.0210,
         0.9993,  0.0017,  0.1052,  0.9334,  0.9117,  0.0221,  0.0588,
         0.0574,  0.2993,  0.0189,  0.0039,  0.8334,  0.0025,  0.0376,
         0.8003,  0.9330,  0.0055,  0.0348,  0.1954,  0.1099,  0.9613,
         0.0099,  0.0121,  0.2044,  0.8052,  0.0011,  0.9050,  0.0220,
         0.9557,  0.8148,  0.0355,  0.9983,  0.9812,  0.4407,  0.9890,
         0.0757,  0.9167,  0.1906,  0.9123,  0.9793,  0.9432,  0.0026,
         0.9982,  0.9447,  0.0185,  0.0025,  0.5862,  0.0718,  0.9730,
         0.9150,  0.9145,  0.1307,  0.9730,  0.8248,  0.5126,  0.7576,
         0.0013,  0.9454,  0.1426,  0.9979,  0.0432,  0.9686,  0.8305,
         0.0119,  0.9228,  0.9807,  0.9405,  0.3170,  0.0153,  0.8303,
         0.9156,  0.0127,  0.9640,  0.0047,  0.6440,  0.9648,  0.9882,
         0.9541,  0.9514,  0.7841,  0.9331,  0.9779,  0.7073,  0.9952,
         0.9057,  0.8532,  0.0147,  0.0271,  0.8830,  0.4105,  0.9837,
         0.9590,  0.2424,  0.9428,  0.0051,  0.9658,  0.9501,  0.9039,
         0.9892,  0.5384,  0.2278,  0.0501,  0.9103,  0.9681,  0.0602,
         0.0188,  0.0100,  0.1945,  0.0762,  0.7454,  0.9187,  0.8529,
         0.0158,  0.0124,  0.0291,  0.9685,  0.7906,  0.0145,  0.0261,
         0.9552,  0.9101,  0.5376,  0.1083,  0.2133,  0.6745,  0.9928,
         0.9595,  0.2368,  0.0026,  0.0331,  0.0650,  0.0875,  0.0025,
         0.8453,  0.8259,  0.9665,  0.1101,  0.7500,  0.9650,  0.1439,
         0.9315,  0.9801,  0.0566,  0.1772,  0.2393,  0.9715,  0.0178,
         0.8898,  0.9739,  0.9654,  0.9825,  0.9622,  0.9593,  0.0103,
         0.0185,  0.8946,  0.9039,  0.9332,  0.0278,  0.0168,  0.6796,
         0.9933,  0.1433,  0.0392,  0.9279,  0.9852,  0.8586,  0.6156,
         0.9613,  0.8502,  0.9087,  0.0404,  0.8966,  0.8849,  0.9241,
         0.9500,  0.4272,  0.9810,  0.1455,  0.0038,  0.0124,  0.0152,
         0.9374,  0.0420,  0.0894,  0.9275,  0.3429,  0.9828,  0.0305,
         0.7334,  0.4464,  0.8260,  0.4275,  0.9585,  0.4277,  0.0015,
         0.0219,  0.0813,  0.5823,  0.8770,  0.8737,  0.9692,  0.0150,
         0.0604,  0.0307,  0.9313,  0.8651,  0.9773,  0.9825,  0.0602,
         0.8965,  0.9593,  0.9636,  0.9355,  0.9616,  0.0928,  0.9952,
         0.0084,  0.8698,  0.0284,  0.9874,  0.2826,  0.9384,  0.9635,
         0.9649,  0.7648,  0.9615,  0.0986,  0.0037,  0.0149,  0.2953,
         0.9369,  0.1421,  0.9771,  0.9808,  0.9914,  0.0917,  0.1945,
         0.0858,  0.9431,  0.8905,  0.9325,  0.4818,  0.9083,  0.9479,
         0.0083,  0.8372,  0.9826,  0.5514,  0.9982,  0.0054,  0.0022,
         0.0026,  0.2140,  0.0779,  0.0747,  0.9508,  0.1175,  0.9405,
         0.7293,  0.0427,  0.0197,  0.9478,  0.9787,  0.0102,  0.9007,
         0.9365,  0.9346,  0.0154,  0.9781,  0.7317,  0.9354,  0.9933,
         0.1046,  0.0821,  0.0406,  0.9801,  0.7533,  0.0334,  0.8946,
         0.9342,  0.9378,  0.0009,  0.9909,  0.9393,  0.0160,  0.8757,
         0.1711,  0.0881,  0.8830,  0.8197,  0.9113,  0.1617,  0.0091,
         0.0634,  0.1451,  0.0142,  0.0776,  0.1256,  0.3883,  0.0237,
         0.8850,  0.0092,  0.0667,  0.1127,  0.0123,  0.9739,  0.8185,
         0.0065,  0.0084,  0.8834,  0.0668,  0.0153,  0.0092,  0.9602,
         0.0202,  0.8317,  0.8482,  0.9742,  0.9077,  0.6711,  0.3804,
         0.0756,  0.9316,  0.9104,  0.8857,  0.4010,  0.8144,  0.0051,
         0.8325,  0.9889,  0.1006,  0.9264,  0.9523,  0.0716,  0.6968,
         0.9374,  0.0796,  0.9417,  0.0097,  0.0066,  0.0115,  0.9826,
         0.9693,  0.9904,  0.9001,  0.9567,  0.0154,  0.9746,  0.8124,
         0.1864,  0.9180,  0.7500,  0.0083,  0.2746,  0.6389,  0.9128,
         0.8314,  0.0593,  0.8666,  0.9864,  0.9470,  0.0079,  0.8680,
         0.9363,  0.0167,  0.0385,  0.9514,  0.8595,  0.0085,  0.3170,
         0.9550,  0.8925,  0.9030,  0.9959,  0.8748,  0.9310,  0.9182,
         0.0271,  0.9360,  0.9678,  0.9087,  0.9409,  0.8958,  0.0180,
         0.0194,  0.8882,  0.4106,  0.9161,  0.1000,  0.8896,  0.8619,
         0.9813,  0.8626,  0.9601,  0.8206,  0.9864,  0.0312,  0.8872,
         0.0082,  0.9130,  0.5710,  0.7485,  0.7883,  0.0166,  0.6388,
         0.0225,  0.0163,  0.0082,  0.0354,  0.0012,  0.9493,  0.0118,
         0.8829,  0.0027,  0.9525,  0.8591,  0.0311,  0.0078,  0.0863,
         0.6519,  0.9771,  0.9846,  0.0038,  0.8344,  0.0280,  0.5793,
         0.8566,  0.5955,  0.7240,  0.0635,  0.9985,  0.0764,  0.8995,
         0.9384,  0.9996,  0.8759,  0.9405,  0.9675,  0.0947,  0.2064,
         0.9672,  0.0098,  0.9767,  0.8375,  0.7050,  0.9957,  0.8206,
         0.1906,  0.1958,  0.0210,  0.0552,  0.9549,  0.0029,  0.0210,
         0.9291,  0.9422,  0.9730,  0.9721,  0.4840,  0.0375,  0.0018,
         0.9664,  0.0498,  0.0321,  0.9800,  0.0061,  0.9198,  0.9568,
         0.9402], device='cuda:0')
tensor(0.2599, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1365,  0.9086,  0.0094,  0.9894,  0.9245,  0.6446,  0.9897,
         0.7903,  0.9908,  0.2249,  0.0258,  0.8580,  0.8297,  0.0531,
         0.8900,  0.0240,  0.9861,  0.9670,  0.0256,  0.9772,  0.0027,
         0.0014,  0.0111,  0.0054,  0.1160,  0.9574,  0.9293,  0.8218,
         0.8775,  0.9481,  0.9363,  0.0432,  0.0021,  0.5273,  0.9466,
         0.6980,  0.0438,  0.7907,  0.9413,  0.6769,  0.5612,  0.1103,
         0.0171,  0.8676,  0.9715,  0.0598,  0.9322,  0.8934,  0.0731,
         0.9080,  0.9338,  0.9302,  0.9835,  0.0261,  0.0841,  0.3270,
         0.0493,  0.0293,  0.8125,  0.9264,  0.9669,  0.9499,  0.0617,
         0.8232,  0.9408,  0.9477,  0.9350,  0.9444,  0.7622,  0.6849,
         0.9511,  0.9734,  0.5228,  0.0173,  0.4362,  0.9306,  0.9810,
         0.4678,  0.9560,  0.9479,  0.0040,  0.9923,  0.0712,  0.0165,
         0.9041,  0.0177,  0.0275,  0.1179,  0.0308,  0.9579,  0.0655,
         0.0065,  0.0130,  0.9885,  0.8663,  0.0197,  0.6850,  0.0960,
         0.0153,  0.1883,  0.2951,  0.3979,  0.9468,  0.8194,  0.9457,
         0.5386,  0.0022,  0.9057,  0.0220,  0.0073,  0.9599,  0.9690,
         0.9367,  0.8573,  0.9410,  0.0400,  0.9635,  0.0011,  0.7060,
         0.0607,  0.9449,  0.8873,  0.0777,  0.9627,  0.9593,  0.0130,
         0.3531,  0.9480,  0.0057,  0.0131,  0.5354,  0.0666,  0.0052,
         0.3278,  0.9220,  0.0149,  0.9289,  0.1462,  0.0435,  0.5093,
         0.5094,  0.1677,  0.3483,  0.0254,  0.0531,  0.0083,  0.8586,
         0.8700,  0.0109,  0.0045,  0.0551,  0.9458,  0.9150,  0.0019,
         0.0022,  0.9716,  0.0280,  0.0413,  0.0203,  0.9810,  0.8774,
         0.9198,  0.0418,  0.9737,  0.9561,  0.9315,  0.0151,  0.9768,
         0.7612,  0.9493,  0.9781,  0.0050,  0.9114,  0.6289,  0.9190,
         0.9550,  0.9520,  0.8793,  0.0003,  0.0313,  0.0895,  0.0613,
         0.0606,  0.8453,  0.9528,  0.8543,  0.9909,  0.9523,  0.0424,
         0.9611,  0.3914,  0.0472,  0.1058,  0.9120,  0.9554,  0.7101,
         0.1506,  0.8865,  0.5341,  0.0086,  0.0068,  0.9468,  0.3399,
         0.7593,  0.9755,  0.8587,  0.9428,  0.9344,  0.0217,  0.0372,
         0.2262,  0.9969,  0.0061,  0.0276,  0.7093,  0.8850,  0.0586,
         0.9295,  0.0204,  0.0907,  0.9608,  0.0189,  0.0800,  0.8093,
         0.6636,  0.0669,  0.6946,  0.0273,  0.9169,  0.0283,  0.0339,
         0.0586,  0.0951,  0.3946,  0.0459,  0.0373,  0.0028,  0.3736,
         0.8888,  0.0176,  0.9521,  0.0453,  0.6356,  0.4881,  0.4534,
         0.1323,  0.2608,  0.0578,  0.8266,  0.8762,  0.8274,  0.0913,
         0.0371,  0.0373,  0.0482,  0.9694,  0.9525,  0.9643,  0.0130,
         0.7871,  0.0148,  0.8598,  0.8904,  0.2384,  0.1500,  0.0334,
         0.9198,  0.1659,  0.0284,  0.0183,  0.1695,  0.2937,  0.0296,
         0.8773,  0.4986,  0.8213,  0.9012,  0.0146,  0.9908,  0.0178,
         0.7543,  0.9361,  0.8798,  0.9624,  0.2320,  0.0105,  0.9017,
         0.0361,  0.0280,  0.9592,  0.6746,  0.2614,  0.2410,  0.0003,
         0.0056,  0.8390,  0.9748,  0.0925,  0.0043,  0.9562,  0.9802,
         0.8707,  0.3547,  0.1382,  0.0169,  0.5131,  0.0951,  0.9494,
         0.1533,  0.8765,  0.9615,  0.0230,  0.0459,  0.9343,  0.0154,
         0.0622,  0.9681,  0.3351,  0.0020,  0.8797,  0.9948,  0.0851,
         0.9782,  0.2025,  0.0363,  0.0015,  0.9097,  0.0063,  0.0075,
         0.0857,  0.9124,  0.9522,  0.7581,  0.9079,  0.8641,  0.0648,
         0.0222,  0.1460,  0.9337,  0.9219,  0.9962,  0.3818,  0.9707,
         0.0031,  0.1850,  0.7993,  0.0328,  0.9725,  0.0238,  0.3009,
         0.0150,  0.7201,  0.9648,  0.9574,  0.8910,  0.0460,  0.8100,
         0.9171,  0.0302,  0.0382,  0.4724,  0.8713,  0.9153,  0.8213,
         0.9780,  0.9982,  0.0027,  0.8781,  0.0130,  0.0199,  0.9947,
         0.9103,  0.8401,  0.7832,  0.8046,  0.9586,  0.6344,  0.8103,
         0.0244,  0.0081,  0.9070,  0.0244,  0.9871,  0.2000,  0.0085,
         0.9046,  0.9050,  0.0351,  0.7799,  0.9200,  0.7442,  0.0229,
         0.9542,  0.0409,  0.1798,  0.0055,  0.1444,  0.8994,  0.5895,
         0.9402,  0.9458,  0.0117,  0.0150,  0.0007,  0.9767,  0.0420,
         0.6134,  0.0063,  0.3971,  0.0141,  0.0067,  0.9802,  0.6706,
         0.8299,  0.0035,  0.9936,  0.0514,  0.0902,  0.8708,  0.6670,
         0.6609,  0.0075,  0.0308,  0.9442,  0.1314,  0.9239,  0.9492,
         0.0133,  0.9971,  0.9170,  0.9227,  0.9039,  0.0029,  0.1845,
         0.9600,  0.8941,  0.9410,  0.1713,  0.0980,  0.7975,  0.7336,
         0.9507,  0.0806,  0.9894,  0.9459,  0.0499,  0.1647,  0.1813,
         0.0454,  0.9822,  0.0065,  0.6187,  0.0131,  0.0037,  0.0139,
         0.8484,  0.8792,  0.0005,  0.9003,  0.9739,  0.1073,  0.6951,
         0.9871,  0.0379,  0.9593,  0.0533,  0.9174,  0.9346,  0.0255,
         0.9853,  0.1766,  0.6906,  0.2320,  0.9400,  0.0078,  0.0220,
         0.8762,  0.8268,  0.4975,  0.9810,  0.0053,  0.0283,  0.5774,
         0.9690,  0.1002,  0.9987,  0.9744,  0.8722,  0.9036,  0.9287,
         0.0114,  0.9965,  0.0663,  0.0198,  0.0142,  0.9779,  0.0789,
         0.3060,  0.8788,  0.0680,  0.7548,  0.0210,  0.1910,  0.0388,
         0.9177,  0.8373,  0.0037,  0.3585,  0.6947,  0.9257,  0.0539,
         0.8888], device='cuda:0')
tensor(0.3021, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8913,  0.0630,  0.6130,  0.1144,  0.0111,  0.8946,  0.0346,
         0.0424,  0.0038,  0.9444,  0.0569,  0.9871,  0.9808,  0.9451,
         0.2414,  0.0700,  0.3034,  0.1501,  0.9509,  0.0875,  0.9465,
         0.2304,  0.0324,  0.0138,  0.8597,  0.2242,  0.9519,  0.9611,
         0.9581,  0.2640,  0.5024,  0.9005,  0.9677,  0.7302,  0.0302,
         0.9301,  0.7235,  0.0953,  0.8686,  0.0754,  0.9629,  0.0061,
         0.0089,  0.9829,  0.8914,  0.0071,  0.5435,  0.1191,  0.0528,
         0.9594,  0.9655,  0.9188,  0.2445,  0.1570,  0.8465,  0.9431,
         0.0278,  0.8132,  0.9737,  0.9638,  0.0139,  0.0417,  0.8774,
         0.0193,  0.3608,  0.0291,  0.8603,  0.7229,  0.9713,  0.6811,
         0.9142,  0.9220,  0.9501,  0.6773,  0.8240,  0.1855,  0.8995,
         0.0399,  0.0058,  0.9451,  0.4367,  0.0010,  0.9913,  0.9448,
         0.0031,  0.8927,  0.0370,  0.7474,  0.6309,  0.1591,  0.0815,
         0.8268,  0.4034,  0.9729,  0.9457,  0.0295,  0.8655,  0.9263,
         0.9866,  0.9995,  0.0551,  0.0108,  0.3748,  0.1976,  0.0202,
         0.9376,  0.8967,  0.3443,  0.9822,  0.9154,  0.0268,  0.0542,
         0.9182,  0.6072,  0.8998,  0.8830,  0.9810,  0.8514,  0.8098,
         0.1750,  0.1061,  0.0618,  0.9986,  0.8413,  0.8603,  0.9241,
         0.9006,  0.8056,  0.9378,  0.2187,  0.0022,  0.1411,  0.0284,
         0.1520,  0.9626,  0.0403,  0.7883,  0.9487,  0.7952,  0.0211,
         0.5473,  0.8160,  0.9571,  0.5846,  0.1192,  0.2644,  0.9262,
         0.0161,  0.9857,  0.0574,  0.0324,  0.9102,  0.9565,  0.0437,
         0.6786,  0.0228,  0.9292,  0.8002,  0.0870,  0.7270,  0.8712,
         0.1078,  0.0769,  0.9789,  0.9248,  0.7904,  0.6865,  0.9026,
         0.0845,  0.0453,  0.9058,  0.0364,  0.8312,  0.8652,  0.0933,
         0.0721,  0.0298,  0.8498,  0.1491,  0.0822,  0.1087,  0.0163,
         0.8527,  0.0118,  0.9424,  0.9731,  0.0164,  0.0302,  0.1918,
         0.1931,  0.0048,  0.7653,  0.1102,  0.1079,  0.8478,  0.9034,
         0.4645,  0.9408,  0.8266,  0.0022,  0.8022,  0.9252,  0.9792,
         0.9704,  0.3071,  0.9133,  0.0231,  0.0045,  0.8780,  0.5384,
         0.0036,  0.1078,  0.9118,  0.0881,  0.3091,  0.0214,  0.9564,
         0.6260,  0.7942,  0.0142,  0.8267,  0.0431,  0.8186,  0.9137,
         0.9670,  0.0207,  0.0368,  0.0589,  0.0035,  0.0607,  0.9161,
         0.9498,  0.9279,  0.3518,  0.0170,  0.0278,  0.2362,  0.0315,
         0.0041,  0.0421,  0.0995,  0.2664,  0.8691,  0.0223,  0.1341,
         0.9282,  0.7500,  0.9059,  0.9317,  0.0634,  0.0871,  0.9823,
         0.0378,  0.9280,  0.1276,  0.0537,  0.0172,  0.9177,  0.8120,
         0.1202,  0.8143,  0.9422,  0.0852,  0.0687,  0.0405,  0.1938,
         0.9260,  0.1234,  0.4841,  0.0100,  0.9741,  0.8714,  0.0539,
         0.8589,  0.7615,  0.7478,  0.6820,  0.0143,  0.8737,  0.0131,
         0.0078,  0.9715,  0.9192,  0.0646,  0.0115,  0.0011,  0.1554,
         0.9298,  0.9114,  0.0044,  0.8032,  0.8399,  0.9352,  0.9370,
         0.9392,  0.0027,  0.6699,  0.7001,  0.9211,  0.0290,  0.0215,
         0.2802,  0.0385,  0.9352,  0.9512,  0.0332,  0.8486,  0.8315,
         0.0261,  0.0693,  0.3037,  0.9650,  0.0967,  0.7843,  0.7348,
         0.9207,  0.9713,  0.9687,  0.9827,  0.1643,  0.9200,  0.0056,
         0.6453,  0.0957,  0.3504,  0.9472,  0.0955,  0.9505,  0.6425,
         0.0339,  0.1126,  0.9622,  0.0025,  0.0146,  0.1746,  0.0265,
         0.7923,  0.0153,  0.0279,  0.0466,  0.9313,  0.6891,  0.8872,
         0.9758,  0.3845,  0.0795,  0.6613,  0.9514,  0.4489,  0.8624,
         0.2197,  0.0872,  0.0083,  0.7475,  0.9618,  0.8651,  0.0404,
         0.8466,  0.9218,  0.9034,  0.9702,  0.1571,  0.8263,  0.0374,
         0.0110,  0.7754,  0.0792,  0.4560,  0.5126,  0.8900,  0.9963,
         0.0131,  0.0795,  0.0395,  0.1177,  0.8681,  0.9161,  0.8897,
         0.9977,  0.3419,  0.8707,  0.8870,  0.8275,  0.0331,  0.0630,
         0.0731,  0.9206,  0.1078,  0.1305,  0.0562,  0.2171,  0.8976,
         0.4679,  0.6240,  0.0479,  0.0693,  0.0792,  0.0457,  0.0137,
         0.8210,  0.9167,  0.9393,  0.9549,  0.0366,  0.9475,  0.9344,
         0.0291,  0.9464,  0.9833,  0.3388,  0.9560,  0.0280,  0.0355,
         0.0798,  0.8693,  0.8587,  0.0545,  0.9962,  0.9131,  0.1467,
         0.4676,  0.8684,  0.0061,  0.4359,  0.1574,  0.0435,  0.9572,
         0.0692,  0.0355,  0.0160,  0.4191,  0.0320,  0.0060,  0.9588,
         0.9042,  0.6943,  0.9677,  0.0066,  0.0140,  0.9347,  0.0010,
         0.5166,  0.0200,  0.7153,  0.8268,  0.9360,  0.7865,  0.9584,
         0.9864,  0.0165,  0.9751,  0.5123,  0.3549,  0.3455,  0.9156,
         0.9547,  0.0052,  0.1503,  0.8807,  0.2418,  0.8712,  0.9148,
         0.0584,  0.9017,  0.2945,  0.7679,  0.0488,  0.1731,  0.2373,
         0.9101,  0.8632,  0.0584,  0.9604,  0.6627,  0.9538,  0.8222,
         0.1120,  0.8803,  0.8613,  0.0213,  0.0019,  0.9792,  0.0013,
         0.0628,  0.8488,  0.9808,  0.9730,  0.0582,  0.5622,  0.4320,
         0.8727,  0.0100,  0.9854,  0.6250,  0.8497,  0.0854,  0.1043,
         0.7649,  0.8012,  0.9203,  0.9278,  0.0084,  0.0133,  0.7526,
         0.0012,  0.8890,  0.1428,  0.9976,  0.0227,  0.1234,  0.0479,
         0.8152], device='cuda:0')
tensor(0.2661, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8599,  0.8059,  0.4493,  0.4068,  0.3338,  0.9707,  0.3949,
         0.9992,  0.8273,  0.1057,  0.6627,  0.5740,  0.0083,  0.0375,
         0.8492,  0.1770,  0.0638,  0.0101,  0.4550,  0.6112,  0.0674,
         0.0195,  0.1395,  0.8505,  0.0223,  0.1699,  0.9992,  0.4821,
         0.0354,  0.0743,  0.0260,  0.0245,  0.0025,  0.9573,  0.0429,
         0.4647,  0.7709,  0.1355,  0.6300,  0.0395,  0.1617,  0.0553,
         0.1298,  0.0941,  0.9705,  0.0889,  0.8942,  0.6296,  0.3074,
         0.8552,  0.7678,  0.9817,  0.9219,  0.8622,  0.1717,  0.6091,
         0.3673,  0.8990,  0.0750,  0.9312,  0.0584,  0.1197,  0.0833,
         0.7308,  0.7566,  0.7187,  0.9005,  0.2989,  0.8110,  0.9054,
         0.9815,  0.8329,  0.1462,  0.0199,  0.5325,  0.5513,  0.7862,
         0.1021,  0.9896,  0.9943,  0.8752,  0.0086,  0.1919,  0.4491,
         0.0046,  0.0396,  0.3071,  0.7455,  0.8517,  0.0181,  0.8950,
         0.0763,  0.5645,  0.0166,  0.5022,  0.8941,  0.0234,  0.0670,
         0.2575,  0.2506,  0.2959,  0.0330,  0.4055,  0.7325,  0.1886,
         0.6730,  0.0489,  0.8436,  0.0242,  0.4819,  0.6997,  0.7379,
         0.8452,  0.6962,  0.9964,  0.4610,  0.3881,  0.1219,  0.0205,
         0.1418,  0.0573,  0.7752,  0.9083,  0.9517,  0.9875,  0.9881,
         0.0707,  0.1966,  0.0010,  0.6964,  0.0082,  0.5698,  0.9846,
         0.2327,  0.0519,  0.7079,  0.0033,  0.1728,  0.9721,  0.4047,
         0.9037,  0.0543,  0.1941,  0.0009,  0.9741,  0.0049,  0.8939,
         0.8900,  0.0293,  0.7396,  0.9579,  0.9807,  0.8823,  0.9480,
         0.0240,  0.0231,  0.8936,  0.8355,  0.9532,  0.9992,  0.1228,
         0.8966,  0.3717,  0.0304,  0.3666,  0.0639,  0.0997,  0.9109,
         0.0011,  0.0856,  0.9653,  0.7906,  0.9466,  0.8518,  0.1774,
         0.0048,  0.8967,  0.0227,  0.9335,  0.9730,  0.5840,  0.0903,
         0.9726,  0.4178,  0.6280,  0.8915,  0.9439,  0.1508,  0.1673,
         0.6882,  0.1249,  0.0573,  0.3708,  0.0238,  0.4842,  0.0811,
         0.0113,  0.0246,  0.7722,  0.4132,  0.0211,  0.0644,  0.0282,
         0.0025,  0.0206,  0.6629,  0.9529,  0.8189,  0.1123,  0.9982,
         0.9735,  0.9738,  0.0596,  0.0593,  0.0209,  0.6154,  0.9044,
         0.2114,  0.9172,  0.9434,  0.8752,  0.9194,  0.0393,  0.9139,
         0.7125,  0.9117,  0.9394,  0.8645,  0.0560,  0.8794,  0.1413,
         0.6073,  0.0751,  0.2128,  0.4160,  0.7644,  0.0222,  0.1035,
         0.1689,  0.1256,  0.8040,  0.1335,  0.0277,  0.3267,  0.2141,
         0.1517,  0.8321,  0.0152,  0.0422,  0.0242,  0.0025,  0.9109,
         0.0422,  0.0473,  0.7838,  0.1302,  0.5328,  0.8793,  0.8198,
         0.9019,  0.8264,  0.9352,  0.1905,  0.0469,  0.0126,  0.9226,
         0.0039,  0.1368,  0.0483,  0.2509,  0.1176,  0.0249,  0.0281,
         0.9365,  0.1309,  0.0078,  0.9507,  0.8295,  0.0390,  0.8454,
         0.8029,  0.9906,  0.7270,  0.0182,  0.0437,  0.8845,  0.8429,
         0.0988,  0.7320,  0.8461,  0.7515,  0.9536,  0.8851,  0.9804,
         0.8860,  0.0214,  0.2943,  0.4753,  0.0264,  0.1257,  0.9200,
         0.9658,  0.0575,  0.9389,  0.9018,  0.6881,  0.2848,  0.0982,
         0.9536,  0.0185,  0.9774,  0.4820,  0.0033,  0.0476,  0.7008,
         0.2521,  0.6025,  0.0006,  0.0035,  0.5396,  0.2904,  0.5030,
         0.1578,  0.9730,  0.0200,  0.8936,  0.9783,  0.8981,  0.1082,
         0.9289,  0.1588,  0.0712,  0.9355,  0.0463,  0.4836,  0.0145,
         0.5606,  0.7138,  0.0171,  0.4519,  0.4164,  0.8253,  0.0981,
         0.3012,  0.0679,  0.0166,  0.7495,  0.7128,  0.8589,  0.1150,
         0.9847,  0.9974,  0.7298,  0.0012,  0.0178,  0.5851,  0.0011,
         0.5697,  0.8398,  0.9411,  0.9587,  0.0128,  0.9081,  0.8648,
         0.8050,  0.8519,  0.9651,  0.2158,  0.1446,  0.7922,  0.9950,
         0.3497,  0.0143,  0.7862,  0.0216,  0.3707,  0.9665,  0.0402,
         0.3291,  0.9304,  0.8908,  0.4966,  0.9312,  0.0386,  0.9778,
         0.9296,  0.0446,  0.1594,  0.3905,  0.6426,  0.0012,  0.9458,
         0.8644,  0.0189,  0.0036,  0.0241,  0.5857,  0.4037,  0.0245,
         0.9204,  0.3299,  0.9976,  0.9424,  0.2477,  0.7469,  0.0371,
         0.0767,  0.9765,  0.0204,  0.0724,  0.1496,  0.9538,  0.5336,
         0.2464,  0.9281,  0.7618,  0.8288,  0.1567,  0.8845,  0.0914,
         0.7867,  0.0037,  0.3835,  0.8118,  0.3466,  0.9152,  0.7509,
         0.6930,  0.0306,  0.0858,  0.0081,  0.6817,  0.8709,  0.0037,
         0.4010,  0.0401,  0.0097,  0.1566,  0.7424,  0.0010,  0.7627,
         0.9359,  0.9471,  0.9519,  0.0109,  0.9737,  0.0431,  0.9720,
         0.0183,  0.9279,  0.0700,  0.4902,  0.0696,  0.7677,  0.9636,
         0.0315,  0.0291,  0.0398,  0.0013,  0.7956,  0.8920,  0.3907,
         0.1616,  0.6638,  0.9966,  0.0488,  0.3576,  0.0605,  0.2027,
         0.1934,  0.3369,  0.8734,  0.0779,  0.9052,  0.8168,  0.6171,
         0.9386,  0.6702,  0.7778,  0.9841,  0.8338,  0.9760,  0.1294,
         0.9378,  0.0079,  0.0098,  0.9443,  0.6015,  0.8116,  0.0138,
         0.0598,  0.0625,  0.9510,  0.4087,  0.9546,  0.9585,  0.6425,
         0.3778,  0.9401,  0.8388,  0.4228,  0.9159,  0.7796,  0.0073,
         0.8061,  0.0045,  0.9053,  0.9500,  0.0169,  0.0280,  0.8458,
         0.1356], device='cuda:0')
tensor(0.3040, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0645,  0.1980,  0.0277,  0.1187,  0.0500,  0.1866,  0.4977,
         0.5342,  0.9699,  0.6036,  0.0155,  0.0127,  0.0515,  0.0260,
         0.0221,  0.8618,  0.9744,  0.4857,  0.0357,  0.0285,  0.1974,
         0.8865,  0.1332,  0.5400,  0.9034,  0.0355,  0.6011,  0.0440,
         0.2342,  0.4673,  0.7824,  0.9724,  0.9569,  0.5646,  0.8052,
         0.0878,  0.8928,  0.0374,  0.0529,  0.8597,  0.7448,  0.1036,
         0.7710,  0.4762,  0.0138,  0.9741,  0.9164,  0.0006,  0.0292,
         0.6604,  0.0287,  0.9123,  0.0203,  0.7931,  0.7600,  0.7420,
         0.6093,  0.9880,  0.3607,  0.0690,  0.9840,  0.0167,  0.8179,
         0.1660,  0.2179,  0.0097,  0.4846,  0.0784,  0.0436,  0.1998,
         0.8411,  0.1271,  0.2148,  0.5084,  0.2149,  0.9291,  0.8786,
         0.0156,  0.5262,  0.3608,  0.6499,  0.0896,  0.8775,  0.0119,
         0.1035,  0.0997,  0.1156,  0.6821,  0.8542,  0.9165,  0.5148,
         0.3569,  0.0443,  0.9623,  0.3788,  0.9449,  0.3794,  0.0734,
         0.0539,  0.9522,  0.0293,  0.8036,  0.3656,  0.0139,  0.3886,
         0.8314,  0.1600,  0.0232,  0.0683,  0.8219,  0.4823,  0.2392,
         0.0216,  0.0818,  0.1535,  0.5728,  0.0489,  0.2781,  0.4003,
         0.4191,  0.4421,  0.8146,  0.2510,  0.8534,  0.4073,  0.2194,
         0.1235,  0.9297,  0.0429,  0.0853,  0.6925,  0.8954,  0.0189,
         0.9417,  0.9384,  0.0561,  0.1072,  0.0176,  0.9703,  0.5300,
         0.2613,  0.0407,  0.8274,  0.7410,  0.9374,  0.9490,  0.6894,
         0.2551,  0.6854,  0.8381,  0.9784,  0.0208,  0.0035,  0.9666,
         0.9651,  0.9672,  0.3502,  0.1791,  0.2042,  0.8638,  0.9837,
         0.8508,  0.6509,  0.3765,  0.0071,  0.1369,  0.7815,  0.5914,
         0.3724,  0.8864,  0.0531,  0.0418,  0.3403,  0.0366,  0.7886,
         0.1735,  0.5474,  0.7989,  0.9591,  0.0180,  0.9607,  0.6705,
         0.9413,  0.9849,  0.5760,  0.3183,  0.1291,  0.2425,  0.1622,
         0.6612,  0.9768,  0.2563,  0.6747,  0.0844,  0.0437,  0.3670,
         0.0955,  0.9854,  0.0211,  0.4965,  0.0200,  0.3809,  0.8198,
         0.8839,  0.9716,  0.0202,  0.0105,  0.3676,  0.0413,  0.9343,
         0.4101,  0.0432,  0.0756,  0.2162,  0.7068,  0.9972,  0.9576,
         0.9164,  0.9850,  0.4003,  0.2530,  0.1050,  0.8509,  0.2054,
         0.0135,  0.8411,  0.8982,  0.3397,  0.3769,  0.6375,  0.8605,
         0.0154,  0.8570,  0.8595,  0.1223,  0.0276,  0.9647,  0.0014,
         0.5955,  0.0027,  0.5334,  0.5872,  0.9977,  0.8504,  0.3828,
         0.0455,  0.3462,  0.5933,  0.1606,  0.7014,  0.7680,  0.0289,
         0.7539,  0.9703,  0.9301,  0.9363,  0.1122,  0.8830,  0.7692,
         0.0213,  0.0722,  0.9810,  0.1234,  0.9169,  0.5744,  0.7331,
         0.0457,  0.5867,  0.9136,  0.6555,  0.0429,  0.0261,  0.3226,
         0.9873,  0.6059,  0.8830,  0.3577,  0.3986,  0.9580,  0.0866,
         0.0316,  0.0820,  0.8351,  0.0542,  0.9858,  0.6172,  0.0083,
         0.0042,  0.1181,  0.9996,  0.0191,  0.0725,  0.1175,  0.9722,
         0.1175,  0.3954,  0.0063,  0.0090,  0.9626,  0.0586,  0.0951,
         0.0142,  0.6535,  0.1543,  0.6689,  0.9568,  0.8982,  0.0335,
         0.9276,  0.8501,  0.5244,  0.6501,  0.0262,  0.0502,  0.1431,
         0.8655,  0.4592,  0.9400,  0.0698,  0.0286,  0.7925,  0.0073,
         0.1800,  0.0725,  0.9549,  0.4542,  0.2300,  0.0210,  0.8993,
         0.0776,  0.3419,  0.1579,  0.9662,  0.1167,  0.0807,  0.0326,
         0.0155,  0.0350,  0.1489,  0.0236,  0.2795,  0.3357,  0.8945,
         0.9463,  0.0378,  0.0287,  0.8455,  0.8880,  0.9406,  0.4889,
         0.0361,  0.0237,  0.3896,  0.1959,  0.8785,  0.8473,  0.5133,
         0.2290,  0.9184,  0.1963,  0.8952,  0.0387,  0.8848,  0.3546,
         0.2215,  0.0970,  0.9075,  0.8465,  0.6612,  0.0037,  0.9820,
         0.8976,  0.1466,  0.9615,  0.1285,  0.0718,  0.8169,  0.9216,
         0.0140,  0.6652,  0.0917,  0.9712,  0.2453,  0.9076,  0.0019,
         0.0873,  0.7155,  0.9344,  0.9078,  0.3293,  0.1517,  0.1526,
         0.6147,  0.9342,  0.1996,  0.2845,  0.0665,  0.8846,  0.0527,
         0.9771,  0.8639,  0.0380,  0.8438,  0.0958,  0.5331,  0.8841,
         0.0260,  0.5169,  0.0740,  0.0024,  0.8772,  0.7262,  0.0729,
         0.7982,  0.9936,  0.6727,  0.0249,  0.0057,  0.0296,  0.7414,
         0.0139,  0.2798,  0.0513,  0.2417,  0.6093,  0.0158,  0.0388,
         0.9807,  0.7718,  0.8142,  0.7947,  0.8098,  0.6759,  0.4244,
         0.4006,  0.4852,  0.1121,  0.9435,  0.5907,  0.0053,  0.9257,
         0.0132,  0.0270,  0.2123,  0.9794,  0.8585,  0.3012,  0.9847,
         0.1357,  0.1009,  0.0088,  0.5766,  0.9985,  0.2169,  0.2729,
         0.4503,  0.0018,  0.9821,  0.6433,  0.4044,  0.7611,  0.3819,
         0.1044,  0.0015,  0.0151,  0.5650,  0.7646,  0.9250,  0.8946,
         0.7197,  0.9148,  0.0494,  0.1185,  0.0093,  0.8424,  0.7976,
         0.6042,  0.9509,  0.1318,  0.0311,  0.6702,  0.1955,  0.0211,
         0.5625,  0.6657,  0.9515,  0.0634,  0.5553,  0.9341,  0.0863,
         0.1542,  0.7827,  0.9673,  0.1271,  0.1356,  0.9325,  0.8950,
         0.5293,  0.1093,  0.6875,  0.9597,  0.9472,  0.6466,  0.3250,
         0.9879,  0.9572,  0.8293,  0.0662,  0.1283,  0.6598,  0.4241,
         0.2246], device='cuda:0')
tensor(0.3066, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0072,  0.8297,  0.0155,  0.5179,  0.3431,  0.7218,  0.0046,
         0.1546,  0.8097,  0.9150,  0.7602,  0.0250,  0.0173,  0.8700,
         0.0194,  0.1570,  0.2835,  0.9053,  0.0082,  0.3345,  0.9151,
         0.3553,  0.0854,  0.1739,  0.9743,  0.9825,  0.8938,  0.3626,
         0.9490,  0.0022,  0.0469,  0.8369,  0.8755,  0.3266,  0.2391,
         0.1972,  0.1951,  0.9150,  0.0427,  0.0997,  0.9047,  0.9566,
         0.2254,  0.5840,  0.0371,  0.0307,  0.2858,  0.0342,  0.3880,
         0.0959,  0.9620,  0.0474,  0.0892,  0.0250,  0.0147,  0.0331,
         0.1635,  0.0427,  0.9980,  0.0379,  0.6444,  0.9893,  0.9825,
         0.8883,  0.5073,  0.0246,  0.0598,  0.8054,  0.0022,  0.7304,
         0.5061,  0.0310,  0.4833,  0.5974,  0.8356,  0.9173,  0.6064,
         0.0312,  0.6242,  0.9554,  0.7106,  0.3651,  0.9564,  0.2470,
         0.0729,  0.1131,  0.4977,  0.7138,  0.2606,  0.9224,  0.0810,
         0.9735,  0.0418,  0.6958,  0.0794,  0.0869,  0.7188,  0.8987,
         0.1301,  0.2928,  0.1284,  0.0283,  0.0277,  0.1185,  0.0881,
         0.9861,  0.9307,  0.0334,  0.9448,  0.8757,  0.7597,  0.5976,
         0.9458,  0.0327,  0.8222,  0.0351,  0.9608,  0.9040,  0.9706,
         0.1718,  0.0802,  0.5509,  0.0140,  0.7160,  0.0659,  0.0377,
         0.8114,  0.9193,  0.0537,  0.0681,  0.0201,  0.9989,  0.0226,
         0.6421,  0.9511,  0.0331,  0.9457,  0.1245,  0.9093,  0.9753,
         0.0566,  0.8877,  0.4066,  0.8996,  0.7999,  0.0667,  0.0521,
         0.2401,  0.8486,  0.0604,  0.7294,  0.4589,  0.7338,  0.9895,
         0.2880,  0.8437,  0.7698,  0.0019,  0.9771,  0.6270,  0.7717,
         0.1135,  0.3310,  0.0561,  0.0125,  0.4285,  0.0736,  0.0163,
         0.5589,  0.8717,  0.1412,  0.0454,  0.1685,  0.5353,  0.2606,
         0.3929,  0.1802,  0.8106,  0.0314,  0.1585,  0.0215,  0.5055,
         0.9961,  0.8697,  0.1702,  0.9077,  0.0838,  0.8932,  0.9394,
         0.6541,  0.1721,  0.4796,  0.0233,  0.2127,  0.0170,  0.0692,
         0.2861,  0.0528,  0.0431,  0.0326,  0.1784,  0.9519,  0.8859,
         0.9955,  0.0607,  0.3923,  0.9122,  0.8011,  0.8991,  0.1565,
         0.9543,  0.7009,  0.8700,  0.2493,  0.0739,  0.9517,  0.7580,
         0.0063,  0.0039,  0.0510,  0.0778,  0.8789,  0.0054,  0.0610,
         0.0779,  0.2049,  0.9852,  0.7915,  0.8241,  0.8285,  0.0079,
         0.7449,  0.0004,  0.0605,  0.9557,  0.4310,  0.9211,  0.7939,
         0.5653,  0.0365,  0.8100,  0.0030,  0.1527,  0.0527,  0.0907,
         0.6107,  0.9937,  0.0793,  0.8807,  0.0104,  0.2464,  0.0485,
         0.6768,  0.2043,  0.0288,  0.9333,  0.5162,  0.9546,  0.9357,
         0.8756,  0.0282,  0.2700,  0.0605,  0.3750,  0.0111,  0.9353,
         0.0075,  0.0109,  0.5410,  0.9420,  0.0085,  0.0654,  0.8305,
         0.0164,  0.9958,  0.0619,  0.5584,  0.0253,  0.9922,  0.0066,
         0.0149,  0.0751,  0.5580,  0.9302,  0.0049,  0.1558,  0.9336,
         0.8285,  0.9168,  0.0479,  0.8572,  0.0179,  0.0704,  0.4066,
         0.1145,  0.0438,  0.0308,  0.0044,  0.7997,  0.9866,  0.0094,
         0.6048,  0.9163,  0.9278,  0.8979,  0.0755,  0.6217,  0.7818,
         0.1511,  0.0278,  0.0065,  0.3913,  0.7612,  0.9047,  0.8557,
         0.2497,  0.6412,  0.9497,  0.9738,  0.9377,  0.0802,  0.9320,
         0.1873,  0.8715,  0.0164,  0.0905,  0.0331,  0.0706,  0.8936,
         0.1160,  0.3462,  0.8959,  0.0011,  0.8015,  0.7326,  0.9971,
         0.8828,  0.0808,  0.1258,  0.0400,  0.9932,  0.0978,  0.0354,
         0.5464,  0.9645,  0.0716,  0.0404,  0.9984,  0.8535,  0.0884,
         0.0119,  0.0560,  0.7060,  0.4775,  0.4481,  0.0714,  0.1528,
         0.0928,  0.4937,  0.6717,  0.0155,  0.8681,  0.1205,  0.6434,
         0.0019,  0.9496,  0.9442,  0.7600,  0.8980,  0.0542,  0.0883,
         0.1228,  0.8153,  0.8617,  0.3772,  0.5773,  0.9557,  0.5204,
         0.0322,  0.6364,  0.5223,  0.0780,  0.2874,  0.7514,  0.0367,
         0.3091,  0.6959,  0.6477,  0.7241,  0.0116,  0.9545,  0.1080,
         0.2863,  0.2356,  0.9786,  0.1374,  0.0811,  0.8598,  0.9314,
         0.1295,  0.9445,  0.1115,  0.0919,  0.9872,  0.8222,  0.6089,
         0.2450,  0.9589,  0.0038,  0.0702,  0.0382,  0.1969,  0.0812,
         0.7808,  0.0242,  0.8496,  0.0417,  0.9267,  0.2438,  0.1210,
         0.1489,  0.4404,  0.9840,  0.6497,  0.8247,  0.8142,  0.9136,
         0.2075,  0.9257,  0.1949,  0.6580,  0.4305,  0.7713,  0.0139,
         0.1945,  0.7948,  0.9046,  0.4357,  0.0872,  0.9269,  0.0237,
         0.1640,  0.5448,  0.9756,  0.9990,  0.1179,  0.9617,  0.4151,
         0.1377,  0.7157,  0.0021,  0.0676,  0.9324,  0.4561,  0.0335,
         0.5630,  0.0832,  0.8035,  0.2052,  0.7359,  0.0828,  0.0828,
         0.9847,  0.0857,  0.7544,  0.1091,  0.1287,  0.2109,  0.7211,
         0.0907,  0.1070,  0.5377,  0.4437,  0.9559,  0.8427,  0.9104,
         0.2336,  0.7434,  0.0765,  0.4280,  0.0672,  0.1200,  0.0363,
         0.9383,  0.1424,  0.0696,  0.0044,  0.5516,  0.2387,  0.0476,
         0.1063,  0.9364,  0.6077,  0.9656,  0.0837,  0.0136,  0.0266,
         0.0701,  0.4845,  0.7301,  0.0940,  0.8377,  0.7347,  0.5113,
         0.2571,  0.0270,  0.1313,  0.0954,  0.2001,  0.9012,  0.7295,
         0.9115], device='cuda:0')
tensor(0.2769, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6476,  0.0468,  0.1967,  0.0690,  0.9854,  0.1493,  0.9110,
         0.9421,  0.9967,  0.1077,  0.0752,  0.9971,  0.9832,  0.0560,
         0.0613,  0.0046,  0.8583,  0.0062,  0.9179,  0.0810,  0.9957,
         0.0650,  0.4131,  0.3952,  0.9964,  0.7962,  0.0926,  0.0115,
         0.9973,  0.1816,  0.7529,  0.2914,  0.4794,  0.2652,  0.2244,
         0.0566,  0.2888,  0.9752,  0.9319,  0.9103,  0.9187,  0.1192,
         0.6888,  0.2537,  0.2451,  0.0373,  0.0073,  0.0361,  0.0056,
         0.0033,  0.0505,  0.9811,  0.6280,  0.5921,  0.0240,  0.0572,
         0.9477,  0.7562,  0.8737,  0.1858,  0.3273,  0.8538,  0.0223,
         0.2307,  0.7246,  0.9353,  0.0692,  0.0185,  0.0061,  0.0027,
         0.2147,  0.0271,  0.6689,  0.1532,  0.1049,  0.1562,  0.5050,
         0.7278,  0.0761,  0.1863,  0.9110,  0.0688,  0.0942,  0.9491,
         0.9912,  0.0881,  0.1178,  0.1547,  0.5949,  0.1409,  0.3933,
         0.6340,  0.1907,  0.0434,  0.9830,  0.8878,  0.0239,  0.0103,
         0.0321,  0.0431,  0.9361,  0.7777,  0.1723,  0.8845,  0.9633,
         0.3049,  0.7553,  0.9852,  0.9477,  0.1637,  0.7748,  0.9844,
         0.0007,  0.9384,  0.1381,  0.3077,  0.3976,  0.5333,  0.5467,
         0.4697,  0.0823,  0.9349,  0.8423,  0.4754,  0.8863,  0.9151,
         0.4680,  0.9360,  0.0018,  0.4815,  0.8488,  0.9230,  0.9250,
         0.7390,  0.6423,  0.9858,  0.7361,  0.1744,  0.0690,  0.9975,
         0.8361,  0.3108,  0.8415,  0.8791,  0.8975,  0.2377,  0.9563,
         0.2752,  0.7067,  0.8133,  0.3109,  0.0182,  0.9864,  0.0751,
         0.9125,  0.8899,  0.1588,  0.9466,  0.8528,  0.8384,  0.2039,
         0.2993,  0.0390,  0.8850,  0.2588,  0.7897,  0.9973,  0.3081,
         0.3745,  0.1170,  0.3864,  0.0960,  0.2643,  0.0119,  0.0076,
         0.7481,  0.6127,  0.8542,  0.9706,  0.9843,  0.0182,  0.6342,
         0.7505,  0.0622,  0.0455,  0.7820,  0.4998,  0.0775,  0.4808,
         0.7208,  0.0016,  0.9931,  0.0078,  0.7947,  0.0007,  0.3035,
         0.0235,  0.8802,  0.0909,  0.0333,  0.1680,  0.0568,  0.3449,
         0.9944,  0.7770,  0.0753,  0.9294,  0.0225,  0.0065,  0.0756,
         0.0768,  0.9885,  0.1281,  0.1372,  0.7261,  0.7334,  0.2216,
         0.8540,  0.2694,  0.7699,  0.4745,  0.7641,  0.9272,  0.0352,
         0.5726,  0.6436,  0.7701,  0.7128,  0.9961,  0.0015,  0.0850,
         0.8753,  0.8971,  0.1823,  0.6841,  0.8658,  0.0042,  0.5115,
         0.0878,  0.7336,  0.5995,  0.1067,  0.9330,  0.0730,  0.9949,
         0.9770,  0.0281,  0.7361,  0.0794,  0.4774,  0.2071,  0.8598,
         0.8146,  0.9767,  0.0166,  0.9915,  0.0258,  0.9325,  0.9753,
         0.9947,  0.9262,  0.3809,  0.0803,  0.0376,  0.5886,  0.0937,
         0.6632,  0.9315,  0.8392,  0.8848,  0.7755,  0.0938,  0.0998,
         0.9652,  0.8935,  0.0806,  0.9672,  0.9070,  0.2637,  0.9638,
         0.5410,  0.0227,  0.0428,  0.5495,  0.1698,  0.9066,  0.9454,
         0.2167,  0.2727,  0.5934,  0.0165,  0.7477,  0.1134,  0.2408,
         0.7892,  0.0952,  0.8627,  0.1376,  0.8511,  0.2235,  0.0138,
         0.0233,  0.7243,  0.1044,  0.3428,  0.9384,  0.1877,  0.6310,
         0.0428,  0.9567,  0.9189,  0.9895,  0.0631,  0.1080,  0.0396,
         0.9179,  0.9390,  0.1083,  0.2458,  0.9388,  0.9394,  0.2767,
         0.9844,  0.8917,  0.8653,  0.6223,  0.3807,  0.5520,  0.9990,
         0.2624,  0.7585,  0.9579,  0.0219,  0.0267,  0.9294,  0.0476,
         0.7977,  0.6587,  0.2223,  0.9476,  0.9606,  0.0996,  0.8042,
         0.0899,  0.9954,  0.5464,  0.7905,  0.8267,  0.6542,  0.0031,
         0.1539,  0.0425,  0.2392,  0.8680,  0.1841,  0.4468,  0.2928,
         0.8511,  0.6016,  0.8991,  0.9425,  0.1262,  0.7807,  0.6643,
         0.5967,  0.4301,  0.0950,  0.9690,  0.9649,  0.0189,  0.9590,
         0.6516,  0.9367,  0.5205,  0.0549,  0.3072,  0.9240,  0.9994,
         0.0308,  0.8879,  0.1007,  0.1078,  0.1018,  0.8117,  0.9934,
         0.1521,  0.8837,  0.0789,  0.0369,  0.5927,  0.4360,  0.8399,
         0.0047,  0.4376,  0.0587,  0.6193,  0.5377,  0.0718,  0.9757,
         0.0057,  0.1948,  0.0799,  0.6051,  0.0845,  0.4565,  0.7887,
         0.0027,  0.6511,  0.0019,  0.4071,  0.9321,  0.9717,  0.6856,
         0.0172,  0.1501,  0.1459,  0.9713,  0.8664,  0.9353,  0.0518,
         0.0964,  0.9037,  0.4928,  0.0725,  0.9593,  0.9980,  0.0212,
         0.6924,  0.8923,  0.8179,  0.1788,  0.9139,  0.5430,  0.2687,
         0.9786,  0.3128,  0.1080,  0.6075,  0.0016,  0.8578,  0.9699,
         0.5695,  0.2944,  0.0503,  0.9233,  0.9530,  0.8616,  0.3364,
         0.6114,  0.9866,  0.9994,  0.3166,  0.9289,  0.1893,  0.9059,
         0.1618,  0.0576,  0.0096,  0.9400,  0.4527,  0.8926,  0.2000,
         0.0716,  0.7866,  0.0643,  0.1587,  0.0074,  0.7953,  0.8217,
         0.9126,  0.0041,  0.2016,  0.1132,  0.0652,  0.1136,  0.2263,
         0.0859,  0.2210,  0.9590,  0.6896,  0.3256,  0.0823,  0.9490,
         0.0421,  0.1786,  0.8886,  0.1012,  0.2646,  0.0082,  0.9245,
         0.9797,  0.3680,  0.0573,  0.0277,  0.2340,  0.0024,  0.0452,
         0.0394,  0.5854,  0.6659,  0.2309,  0.8923,  0.0643,  0.0558,
         0.1384,  0.9502,  0.9514,  0.9239,  0.3633,  0.6697,  0.0293,
         0.1326], device='cuda:0')
tensor(0.3185, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1478,  0.9422,  0.9753,  0.9277,  0.0039,  0.0088,  0.0486,
         0.9714,  0.8687,  0.9629,  0.5767,  0.8712,  0.9558,  0.7140,
         0.8346,  0.0550,  0.7935,  0.7012,  0.0304,  0.5393,  0.8374,
         0.9225,  0.1401,  0.8109,  0.9772,  0.9239,  0.1277,  0.7705,
         0.9569,  0.8034,  0.2591,  0.0054,  0.9295,  0.9377,  0.1021,
         0.0736,  0.0224,  0.1743,  0.0816,  0.9528,  0.0124,  0.0411,
         0.3899,  0.9384,  0.9072,  0.9835,  0.1836,  0.0933,  0.1116,
         0.9347,  0.1528,  0.9990,  0.6518,  0.0207,  0.1677,  0.1650,
         0.9779,  0.5287,  0.2231,  0.1348,  0.9512,  0.9935,  0.2768,
         0.1380,  0.1152,  0.0970,  0.7183,  0.4285,  0.9891,  0.9989,
         0.1598,  0.0106,  0.2014,  0.9983,  0.8806,  0.9487,  0.0473,
         0.0213,  0.1988,  0.1748,  0.0182,  0.8716,  0.9022,  0.0921,
         0.6584,  0.1910,  0.0179,  0.9553,  0.0389,  0.0362,  0.9727,
         0.8710,  0.9757,  0.4626,  0.0997,  0.1368,  0.9175,  0.8812,
         0.6959,  0.3171,  0.0948,  0.6412,  0.8930,  0.6817,  0.9866,
         0.3195,  0.8317,  0.1903,  0.8764,  0.2674,  0.0614,  0.2322,
         0.8791,  0.0329,  0.8513,  0.3453,  0.3926,  0.8585,  0.8184,
         0.1241,  0.7190,  0.7963,  0.0490,  0.7790,  0.9075,  0.1705,
         0.4811,  0.1114,  0.9375,  0.5043,  0.3108,  0.0725,  0.9079,
         0.4993,  0.9480,  0.8464,  0.8606,  0.3381,  0.7344,  0.1362,
         0.9760,  0.9598,  0.9764,  0.7255,  0.8882,  0.0253,  0.0714,
         0.9051,  0.0790,  0.3019,  0.9111,  0.9660,  0.9419,  0.0763,
         0.8318,  0.9519,  0.2527,  0.4105,  0.9174,  0.9179,  0.0713,
         0.0717,  0.1568,  0.9081,  0.0120,  0.9749,  0.1466,  0.7638,
         0.5059,  0.9877,  0.4009,  0.0275,  0.0328,  0.9552,  0.0644,
         0.1044,  0.2739,  0.6101,  0.8002,  0.4351,  0.8850,  0.1619,
         0.2524,  0.9985,  0.5366,  0.6107,  0.1884,  0.3963,  0.9673,
         0.0302,  0.8988,  0.6506,  0.9597,  0.0353,  0.4822,  0.8593,
         0.0134,  0.0072,  0.7709,  0.7957,  0.0440,  0.9615,  0.9312,
         0.7039,  0.7480,  0.9470,  0.1230,  0.0497,  0.0032,  0.0706,
         0.0761,  0.3072,  0.9128,  0.1011,  0.2386,  0.9804,  0.8693,
         0.1169,  0.8845,  0.9200,  0.6582,  0.0351,  0.9417,  0.6140,
         0.7041,  0.8393,  0.1881,  0.2075,  0.0246,  0.9742,  0.0585,
         0.9199,  0.9429,  0.7843,  0.9238,  0.8427,  0.2787,  0.7861,
         0.3903,  0.1559,  0.8681,  0.8944,  0.9815,  0.7763,  0.9601,
         0.9623,  0.0593,  0.5461,  0.1123,  0.9534,  0.9363,  0.2039,
         0.1097,  0.6314,  0.1360,  0.3884,  0.8064,  0.0873,  0.1391,
         0.3737,  0.9725,  0.0334,  0.0326,  0.8913,  0.8893,  0.9600,
         0.9476,  0.7767,  0.9241,  0.1526,  0.0265,  0.0288,  0.8803,
         0.9774,  0.5040,  0.0216,  0.3359,  0.9993,  0.8745,  0.0742,
         0.1509,  0.0368,  0.9732,  0.0123,  0.9160,  0.9459,  0.0453,
         0.1833,  0.8655,  0.0532,  0.9685,  0.7894,  0.1202,  0.0301,
         0.0645,  0.8606,  0.3347,  0.7727,  0.9597,  0.0154,  0.5507,
         0.4809,  0.5275,  0.0703,  0.6888,  0.5499,  0.2262,  0.6330,
         0.9319,  0.4945,  0.5262,  0.8434,  0.7563,  0.8896,  0.8819,
         0.0024,  0.8955,  0.0739,  0.6591,  0.9147,  0.7431,  0.3716,
         0.8526,  0.9333,  0.5312,  0.0946,  0.0289,  0.2468,  0.8589,
         0.9733,  0.9385,  0.6305,  0.0120,  0.9507,  0.0125,  0.9057,
         0.7869,  0.3813,  0.5773,  0.9141,  0.2204,  0.9853,  0.5592,
         0.0051,  0.9505,  0.9650,  0.0475,  0.9234,  0.4958,  0.5477,
         0.9749,  0.1499,  0.9098,  0.8650,  0.9910,  0.9398,  0.0994,
         0.6936,  0.8815,  0.1622,  0.0207,  0.0542,  0.9646,  0.2864,
         0.8754,  0.8511,  0.5806,  0.0125,  0.9743,  0.2077,  0.9672,
         0.8180,  0.4746,  0.8561,  0.0400,  0.0246,  0.1846,  0.9320,
         0.0079,  0.8380,  0.7173,  0.8755,  0.3113,  0.8442,  0.1582,
         0.8385,  0.6825,  0.9723,  0.0644,  0.8492,  0.8911,  0.0282,
         0.0949,  0.6957,  0.4925,  0.5221,  0.9252,  0.1333,  0.5556,
         0.8499,  0.5387,  0.8744,  0.9513,  0.7034,  0.5053,  0.3909,
         0.1351,  0.3380,  0.0766,  0.9330,  0.9463,  0.7107,  0.0155,
         0.4067,  0.0754,  0.1120,  0.8852,  0.9531,  0.0100,  0.0654,
         0.9190,  0.2006,  0.0826,  0.9256,  0.9043,  0.5461,  0.0163,
         0.9536,  0.9389,  0.8444,  0.0580,  0.0231,  0.0342,  0.9516,
         0.8952,  0.9158,  0.9909,  0.3469,  0.2104,  0.6672,  0.0896,
         0.0099,  0.6960,  0.1946,  0.4217,  0.9520,  0.7452,  0.0029,
         0.8686,  0.1051,  0.0161,  0.6235,  0.0094,  0.1398,  0.0321,
         0.0434,  0.9466,  0.3386,  0.0121,  0.5736,  0.0269,  0.7297,
         0.2647,  0.0214,  0.6671,  0.0031,  0.2719,  0.4287,  0.2509,
         0.1797,  0.4673,  0.8362,  0.9082,  0.9775,  0.6763,  0.0260,
         0.8449,  0.9421,  0.5235,  0.0076,  0.1832,  0.8023,  0.9619,
         0.9262,  0.9311,  0.1296,  0.2890,  0.9213,  0.8043,  0.8506,
         0.0654,  0.8509,  0.9716,  0.0041,  0.0728,  0.0555,  0.9313,
         0.9797,  0.2988,  0.0340,  0.9730,  0.0770,  0.8830,  0.8838,
         0.8151,  0.9069,  0.0660,  0.0117,  0.9559,  0.8543,  0.0580,
         0.9768], device='cuda:0')
tensor(0.3315, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9747,  0.3525,  0.8842,  0.0186,  0.0259,  0.7013,  0.9287,
         0.0268,  0.9302,  0.7524,  0.1847,  0.5709,  0.7445,  0.9786,
         0.8977,  0.8007,  0.1416,  0.0796,  0.7784,  0.8008,  0.0011,
         0.1044,  0.9055,  0.9458,  0.8685,  0.8594,  0.0468,  0.4782,
         0.0430,  0.0323,  0.5783,  0.5334,  0.0073,  0.5840,  0.0054,
         0.0130,  0.9177,  0.5457,  0.8610,  0.8033,  0.8367,  0.2207,
         0.1991,  0.9365,  0.9569,  0.0293,  0.9830,  0.0128,  0.9465,
         0.2145,  0.1235,  0.9684,  0.6431,  0.9182,  0.0702,  0.1521,
         0.0317,  0.0284,  0.5137,  0.4887,  0.8955,  0.8755,  0.0044,
         0.9525,  0.9995,  0.8503,  0.6085,  0.0255,  0.0473,  0.9011,
         0.3994,  0.9375,  0.9898,  0.9495,  0.9582,  0.1854,  0.7955,
         0.9568,  0.3756,  0.4813,  0.1047,  0.9158,  0.0897,  0.9944,
         0.0015,  0.2579,  0.9102,  0.1408,  0.5503,  0.0087,  0.9639,
         0.7520,  0.0056,  0.1887,  0.8659,  0.4363,  0.0565,  0.0852,
         0.9525,  0.8064,  0.7529,  0.9646,  0.5993,  0.9658,  0.9990,
         0.4826,  0.9193,  0.9787,  0.9833,  0.0731,  0.2086,  0.0685,
         0.5319,  0.9601,  0.1413,  0.5695,  0.8873,  0.8028,  0.0194,
         0.9817,  0.0019,  0.9460,  0.0215,  0.0376,  0.0922,  0.0048,
         0.0091,  0.9468,  0.9571,  0.1134,  0.8626,  0.0149,  0.9776,
         0.8402,  0.0101,  0.1110,  0.1934,  0.0176,  0.1669,  0.9429,
         0.3124,  0.8119,  0.9783,  0.0409,  0.9838,  0.0976,  0.9585,
         0.8660,  0.0667,  0.0783,  0.9366,  0.1065,  0.8747,  0.8414,
         0.9546,  0.9830,  0.0584,  0.9881,  0.7954,  0.9100,  0.9240,
         0.0480,  0.0411,  0.0538,  0.9954,  0.2088,  0.8482,  0.1272,
         0.9927,  0.0016,  0.9148,  0.0672,  0.9152,  0.1210,  0.0243,
         0.9892,  0.0662,  0.8301,  0.9156,  0.0053,  0.1154,  0.8541,
         0.1351,  0.9751,  0.4931,  0.9468,  0.8684,  0.0158,  0.9704,
         0.8724,  0.8874,  0.9428,  0.3978,  0.6006,  0.3125,  0.0134,
         0.0217,  0.7514,  0.8692,  0.9725,  0.9113,  0.7473,  0.2455,
         0.9851,  0.0316,  0.8131,  0.0660,  0.1049,  0.9858,  0.0246,
         0.9657,  0.8473,  0.5622,  0.0727,  0.0218,  0.0232,  0.9096,
         0.9494,  0.7334,  0.1142,  0.9670,  0.2548,  0.6747,  0.9547,
         0.4132,  0.0305,  0.8277,  0.9696,  0.0716,  0.9427,  0.0067,
         0.7667,  0.9840,  0.9205,  0.1870,  0.0159,  0.9481,  0.9991,
         0.9835,  0.2495,  0.0193,  0.9137,  0.2530,  0.9739,  0.9355,
         0.3801,  0.1814,  0.9288,  0.0042,  0.0195,  0.8703,  0.1215,
         0.4645,  0.2314,  0.8142,  0.0994,  0.9700,  0.7449,  0.9637,
         0.7570,  0.6550,  0.9174,  0.5639,  0.9995,  0.6357,  0.9719,
         0.9818,  0.9328,  0.4197,  0.9853,  0.1290,  0.3345,  0.1929,
         0.9433,  0.0902,  0.8423,  0.9615,  0.0024,  0.9645,  0.6189,
         0.9861,  0.8827,  0.0171,  0.9146,  0.9470,  0.2056,  0.9288,
         0.2532,  0.6995,  0.0049,  0.1107,  0.3261,  0.1074,  0.1024,
         0.9583,  0.5161,  0.7042,  0.1478,  0.9182,  0.9999,  0.8929,
         0.9896,  0.9165,  0.0334,  0.9677,  0.0482,  0.2074,  0.9545,
         0.0157,  0.9540,  0.9774,  0.9410,  0.9707,  0.9348,  0.5665,
         0.8943,  0.9879,  0.9287,  0.8978,  0.8011,  0.8541,  0.9859,
         0.0402,  0.1013,  0.6663,  0.9298,  0.9853,  0.9583,  0.1946,
         0.9349,  0.5964,  0.0320,  0.2747,  0.4300,  0.8278,  0.6754,
         0.7221,  0.0275,  0.9608,  0.9593,  0.0264,  0.0368,  0.9993,
         0.9692,  0.0210,  0.8305,  0.2914,  0.0645,  0.3921,  0.9411,
         0.1837,  0.0750,  0.0139,  0.9633,  0.6201,  0.9619,  0.8003,
         0.8192,  0.5665,  0.5357,  0.8620,  0.9251,  0.1161,  0.2063,
         0.5340,  0.0181,  0.1934,  0.1149,  0.9918,  0.0131,  0.9797,
         0.9925,  0.0572,  0.9660,  0.2646,  0.1092,  0.9802,  0.8613,
         0.7619,  0.0922,  0.1719,  0.9798,  0.9957,  0.9996,  0.9837,
         0.0665,  0.9880,  0.0262,  0.2040,  0.8819,  0.0039,  0.9353,
         0.0203,  0.9703,  0.0203,  0.3057,  0.8596,  0.0173,  0.9881,
         0.9877,  0.1298,  0.8377,  0.0461,  0.9988,  0.5757,  0.9386,
         0.0093,  0.0018,  0.9050,  0.0161,  0.0114,  0.0202,  0.8949,
         0.8454,  0.9729,  0.3914,  0.8625,  0.9467,  0.8503,  0.9357,
         0.3372,  0.2112,  0.8803,  0.0663,  0.3843,  0.9480,  0.8062,
         0.9501,  0.7532,  0.9698,  0.0033,  0.1091,  0.7724,  0.9338,
         0.1672,  0.7262,  0.6152,  0.9643,  0.0595,  0.0925,  0.9764,
         0.1511,  0.9781,  0.9795,  0.0152,  0.2202,  0.8044,  0.0743,
         0.9924,  0.0127,  0.0176,  0.6492,  0.5097,  0.0561,  0.7073,
         0.0295,  0.4093,  0.5949,  0.9543,  0.0028,  0.0537,  0.9989,
         0.1322,  0.2214,  0.8255,  0.9205,  0.8356,  0.0727,  0.9039,
         0.7828,  0.0091,  0.9070,  0.0410,  0.1683,  0.0660,  0.1506,
         0.9127,  0.2945,  0.0178,  0.9577,  0.9746,  0.9677,  0.0818,
         0.1752,  0.9521,  0.8779,  0.0643,  0.0066,  0.0112,  0.8824,
         0.0160,  0.6859,  0.9829,  0.9692,  0.1125,  0.7800,  0.9812,
         0.0650,  0.0946,  0.8922,  0.9904,  0.0707,  0.9906,  0.0133,
         0.9261,  0.8709,  0.0245,  0.0886,  0.9808,  0.9963,  0.8829,
         0.0037], device='cuda:0')
tensor(0.2862, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8317,  0.8021,  0.9984,  0.9974,  0.9191,  0.9888,  0.5207,
         0.9897,  0.9473,  0.9679,  0.1064,  0.2953,  0.2516,  0.9476,
         0.6587,  0.8202,  0.9778,  0.0574,  0.8479,  0.4317,  0.9920,
         0.6945,  0.0015,  0.0076,  0.0739,  0.9929,  0.9691,  0.9238,
         0.7442,  0.3763,  0.8942,  0.1719,  0.8982,  0.3712,  0.9894,
         0.9878,  0.9727,  0.8538,  0.0219,  0.8811,  0.9993,  0.9365,
         0.8661,  0.0680,  0.9930,  0.9613,  0.9905,  0.9515,  0.9302,
         0.0033,  0.6483,  0.5695,  0.3280,  0.9806,  0.9831,  0.5600,
         0.6161,  0.0180,  0.4704,  0.9657,  0.8059,  0.0179,  0.9353,
         0.7112,  0.0174,  0.8505,  0.0071,  0.0208,  0.8424,  0.9655,
         0.0015,  0.0202,  0.0009,  0.9512,  0.1685,  0.4618,  0.0761,
         0.9802,  0.9890,  0.7373,  0.0039,  0.9468,  0.5919,  0.9798,
         0.0470,  0.0424,  0.9752,  0.5906,  0.8937,  0.9072,  0.2125,
         0.6591,  0.9150,  0.3203,  0.0014,  0.2386,  0.0190,  0.9007,
         0.0781,  0.9997,  0.0028,  0.9845,  0.7048,  0.0284,  0.6934,
         0.7610,  0.6456,  0.9689,  0.9411,  0.5589,  0.9413,  0.2621,
         0.2306,  0.9633,  0.0210,  0.7755,  0.9725,  0.3554,  0.8692,
         0.9834,  0.7744,  0.8646,  0.0444,  0.9824,  0.8689,  0.0179,
         0.9196,  0.2587,  0.9935,  0.1105,  0.2112,  0.9836,  0.5449,
         0.0244,  0.4251,  0.9307,  0.1408,  0.9202,  0.9905,  0.9075,
         0.2466,  0.2603,  0.7471,  0.8255,  0.6090,  0.9661,  0.0196,
         0.9644,  0.8779,  0.0975,  0.8687,  0.9740,  0.9982,  0.9899,
         0.0410,  0.7850,  0.4810,  0.9712,  0.9914,  0.2311,  0.0085,
         0.9808,  0.6328,  0.0915,  0.1436,  0.9972,  0.6581,  0.9433,
         0.5627,  0.9833,  0.6235,  0.9759,  0.8479,  0.8584,  0.9264,
         0.8854,  0.0773,  0.0786,  0.9735,  0.7958,  0.0111,  0.9376,
         0.1954,  0.0506,  0.9997,  0.9985,  0.0620,  0.8877,  0.9785,
         0.0097,  0.7913,  0.1461,  0.7029,  0.9126,  0.9502,  0.9600,
         0.9854,  0.8624,  0.9900,  0.9810,  0.0042,  0.9461,  0.9986,
         0.2565,  0.3240,  0.8714,  0.1014,  0.0066,  0.9779,  0.9833,
         0.3247,  0.9995,  0.9945,  0.0459,  0.1080,  0.0405,  0.0060,
         0.4609,  0.6605,  0.9175,  0.9606,  0.0069,  0.0150,  0.1072,
         0.9162,  0.7001,  0.1117,  0.0081,  0.0318,  0.9306,  0.0394,
         0.9439,  0.0442,  0.9826,  0.0742,  0.9645,  0.9274,  0.9756,
         0.4797,  0.0220,  0.0990,  0.7995,  0.9986,  0.1223,  0.9650,
         0.9115,  0.0474,  0.0431,  0.8076,  0.1867,  0.5937,  0.8728,
         0.5822,  0.2207,  0.3212,  0.0715,  0.1761,  0.0148,  0.3469,
         0.0827,  0.9963,  0.1141,  0.1984,  0.9444,  0.2286,  0.0150,
         0.0606,  0.1026,  0.7589,  0.0646,  0.0562,  0.8889,  0.7169,
         0.2272,  0.9305,  0.2124,  0.9872,  0.9765,  0.0195,  0.0410,
         0.6518,  0.7184,  0.9954,  0.0500,  0.1419,  0.0275,  0.6767,
         0.9932,  0.7227,  0.0419,  0.7321,  0.9060,  0.7635,  0.0043,
         0.9843,  0.9380,  0.8336,  0.9304,  0.8942,  0.9690,  0.9418,
         0.1464,  0.8851,  0.0134,  0.9313,  0.0294,  0.1259,  0.9891,
         0.1303,  0.8715,  0.0065,  0.9859,  0.1416,  0.9993,  0.2845,
         0.1584,  0.9760,  0.9626,  0.7129,  0.9758,  0.0399,  0.0488,
         0.1325,  0.9386,  0.6792,  0.0141,  0.7869,  0.4285,  0.3251,
         0.4883,  0.0791,  0.0240,  0.4687,  0.0611,  0.9500,  0.1329,
         0.9721,  0.5431,  0.8204,  0.1209,  0.2738,  0.9791,  0.8770,
         0.9594,  0.9160,  0.1821,  0.9161,  0.5393,  0.9339,  0.6907,
         0.9455,  0.5631,  0.6493,  0.8295,  0.1894,  0.2699,  0.8510,
         0.0504,  0.0151,  0.9959,  0.0044,  0.0156,  0.9294,  0.5369,
         0.9859,  0.9538,  0.0478,  0.6330,  0.9439,  0.9706,  0.0136,
         0.0687,  0.0355,  0.7509,  0.9525,  0.0267,  0.0354,  0.8864,
         0.0961,  0.9102,  0.9824,  0.1447,  0.7189,  0.1264,  0.4379,
         0.0242,  0.8264,  0.9466,  0.0264,  0.9783,  0.7562,  0.0397,
         0.0666,  0.0100,  0.9773,  0.9745,  0.3421,  0.0082,  0.3421,
         0.0801,  0.8552,  0.0046,  0.0827,  0.8538,  0.8220,  0.0154,
         0.9981,  0.9760,  0.8036,  0.0228,  0.0051,  0.8972,  0.9490,
         0.0642,  0.2858,  0.0190,  0.9623,  0.0179,  0.9222,  0.9664,
         0.0120,  0.7694,  0.7397,  0.1020,  0.0062,  0.1936,  0.3001,
         0.9697,  0.8185,  0.9805,  0.2346,  0.7024,  0.9243,  0.9266,
         0.9996,  0.9979,  0.2111,  0.0173,  0.8700,  0.9905,  0.1433,
         0.0320,  0.7805,  0.9997,  0.0306,  0.1330,  0.8755,  0.0398,
         0.9459,  0.8295,  0.0410,  0.1206,  0.0910,  0.9691,  0.0469,
         0.9126,  0.8017,  0.1823,  0.0370,  0.9858,  0.9938,  0.9794,
         0.9645,  0.9961,  0.0230,  0.0155,  0.9681,  0.1119,  0.2945,
         0.9997,  0.9415,  0.8511,  0.1057,  0.7678,  0.9633,  0.9420,
         0.0130,  0.0060,  0.9674,  0.7983,  0.9817,  0.9211,  0.9828,
         0.9629,  0.0616,  0.0337,  0.1368,  0.0157,  0.6524,  0.9725,
         0.0460,  0.4233,  0.9323,  0.0413,  0.2278,  0.0402,  0.0523,
         0.9368,  0.9966,  0.9676,  0.4116,  0.1525,  0.2955,  0.3251,
         0.9568,  0.9757,  0.9640,  0.0123,  0.9682,  0.9755,  0.9932,
         0.9245], device='cuda:0')
tensor(0.2939, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9543,  0.0167,  0.8010,  0.9939,  0.9816,  0.9393,  0.0100,
         0.8602,  0.9677,  0.8973,  0.7534,  0.1404,  0.1012,  0.9731,
         0.0260,  0.0691,  0.1247,  0.2771,  0.0060,  0.8765,  0.9320,
         0.0356,  0.9746,  0.9703,  0.1269,  0.7378,  0.9557,  0.9327,
         0.7728,  0.0297,  0.9786,  0.9808,  0.5633,  0.8589,  0.4300,
         0.6388,  0.3229,  0.9888,  0.9610,  0.2932,  0.0309,  0.1372,
         0.9965,  0.2252,  0.0433,  0.9582,  0.9367,  0.9525,  0.9545,
         0.9545,  0.9996,  0.4302,  0.0400,  0.9786,  0.0041,  0.9401,
         0.1044,  0.3687,  0.0743,  0.0137,  0.9280,  0.0333,  0.7785,
         0.9416,  0.3078,  0.0327,  0.8460,  0.9649,  0.8716,  0.1274,
         0.9668,  0.9666,  0.0359,  0.0555,  0.0180,  0.7380,  0.0774,
         0.8615,  0.5933,  0.9653,  0.1823,  0.8471,  0.9993,  0.0168,
         0.4444,  0.9993,  0.8150,  0.0226,  0.9597,  0.0465,  0.0659,
         0.0431,  0.0941,  0.8802,  0.9962,  0.0081,  0.5843,  0.8425,
         0.0556,  0.0605,  0.0475,  0.6622,  0.0118,  0.9991,  0.4317,
         0.9917,  0.0337,  0.3425,  0.6174,  0.9321,  0.0689,  0.9875,
         0.0196,  0.9746,  0.0402,  0.9989,  0.0316,  0.8242,  0.0028,
         0.9466,  0.9169,  0.9324,  0.0577,  0.9073,  0.3373,  0.8802,
         0.3331,  0.5950,  0.0593,  0.0120,  0.9736,  0.4549,  0.7329,
         0.0198,  0.9868,  0.7317,  0.9670,  0.0635,  0.9405,  0.9773,
         0.9756,  0.8011,  0.9934,  0.9993,  0.9518,  0.1547,  0.2525,
         0.0333,  0.3005,  0.9572,  0.0201,  0.9274,  0.8617,  0.0487,
         0.2500,  0.9927,  0.9818,  0.0441,  0.0160,  0.9717,  0.9581,
         0.3957,  0.4978,  0.9811,  0.0580,  0.0019,  0.0170,  0.3015,
         0.3190,  0.9767,  0.9699,  0.9793,  0.0611,  0.9850,  0.9562,
         0.9633,  0.0297,  0.0586,  0.8592,  0.9493,  0.9887,  0.7945,
         0.0160,  0.9886,  0.4395,  0.1575,  0.2605,  0.0450,  0.0618,
         0.5793,  0.9890,  0.0141,  0.2546,  0.2097,  0.0442,  0.1034,
         0.4347,  0.9743,  0.9936,  0.9383,  0.0035,  0.9815,  0.9719,
         0.1680,  0.0561,  0.9401,  0.7274,  0.0285,  0.2297,  0.9671,
         0.3437,  0.0878,  0.9774,  0.6798,  0.4157,  0.9064,  0.3462,
         0.9803,  0.9321,  0.8395,  0.2382,  0.8980,  0.9176,  0.3277,
         0.1107,  0.9770,  0.9508,  0.9186,  0.9233,  0.4196,  0.0551,
         0.3623,  0.9925,  0.6614,  0.9309,  0.4852,  0.9406,  0.1220,
         0.9676,  0.1754,  0.9552,  0.0961,  0.2867,  0.8019,  0.8219,
         0.9694,  0.9875,  0.9807,  0.9296,  0.0052,  0.9538,  0.9453,
         0.6595,  0.7279,  0.9882,  0.9963,  0.9857,  0.0090,  0.9364,
         0.0479,  0.9990,  0.0771,  0.9377,  0.9998,  0.1077,  0.9856,
         0.9666,  0.9823,  0.9885,  0.0588,  0.2425,  0.6315,  0.1296,
         0.0310,  0.0065,  0.9837,  0.9372,  0.9934,  0.9675,  0.8791,
         0.1019,  0.9028,  0.8239,  0.2246,  0.7273,  0.6610,  0.0543,
         0.0261,  0.0660,  0.7945,  0.0116,  0.1605,  0.2923,  0.9234,
         0.0435,  0.9161,  0.8918,  0.8645,  0.7688,  0.9758,  0.1524,
         0.0042,  0.9725,  0.9969,  0.3226,  0.2308,  0.9734,  0.5525,
         0.2135,  0.8019,  0.9036,  0.9523,  0.9009,  0.9591,  0.0349,
         0.0468,  0.1421,  0.5806,  0.9066,  0.9962,  0.9512,  0.9282,
         0.9410,  0.9289,  0.8678,  0.8361,  0.6449,  0.0174,  0.9585,
         0.9731,  0.9813,  0.0100,  0.0139,  0.9433,  0.5581,  0.0894,
         0.9931,  0.9825,  0.9367,  0.0123,  0.3628,  0.0036,  0.8992,
         0.9733,  0.9857,  0.6948,  0.9119,  0.5849,  0.1160,  0.0478,
         0.9862,  0.7254,  0.3705,  0.9634,  0.0010,  0.9534,  0.7702,
         0.1167,  0.9114,  0.1136,  0.9395,  0.0020,  0.8941,  0.1255,
         0.9120,  0.9491,  0.9975,  0.3594,  0.9876,  0.9346,  0.9352,
         0.8796,  0.4899,  0.1156,  0.0437,  0.0897,  0.9560,  0.8786,
         0.9955,  0.1121,  0.0080,  0.1963,  0.0795,  0.9945,  0.4410,
         0.0201,  0.3356,  0.3792,  0.9381,  0.9705,  0.9927,  0.9084,
         0.8734,  0.9735,  0.0537,  0.1449,  0.1340,  0.9404,  0.0865,
         0.1168,  0.9653,  0.0028,  0.9516,  0.3907,  0.8373,  0.2767,
         0.0109,  0.9897,  0.9961,  0.0590,  0.9770,  0.8771,  0.9601,
         0.9427,  0.6393,  0.9902,  0.5877,  0.5455,  0.0208,  0.9909,
         0.9318,  0.8859,  0.0692,  0.4903,  0.0767,  0.9738,  0.0041,
         0.9771,  0.1349,  0.9890,  0.0069,  0.4151,  0.9564,  0.1061,
         0.5821,  0.0275,  0.9858,  0.9907,  0.1322,  0.0160,  0.9593,
         0.9127,  0.9040,  0.6843,  0.0089,  0.1451,  0.0019,  0.9775,
         0.0492,  0.8305,  0.0785,  0.0570,  0.7682,  0.2554,  0.1380,
         0.9922,  0.0016,  0.9085,  0.0653,  0.9627,  0.9727,  0.9990,
         0.9454,  0.8302,  0.0299,  0.4604,  0.0433,  0.1563,  0.0235,
         0.1418,  0.2220,  0.0283,  0.5575,  0.0201,  0.9745,  0.9891,
         0.0014,  0.1000,  0.9475,  0.9907,  0.9513,  0.9036,  0.9672,
         0.9946,  0.8794,  0.3168,  0.9518,  0.9170,  0.0159,  0.9111,
         0.0789,  0.0352,  0.9900,  0.5900,  0.0245,  0.9991,  0.2856,
         0.9825,  0.0067,  0.0459,  0.0805,  0.0101,  0.9709,  0.0646,
         0.9562,  0.9993,  0.9659,  0.9374,  0.1665,  0.9396,  0.5205,
         0.0378], device='cuda:0')
tensor(0.3717, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8343,  0.1378,  0.9587,  0.9408,  0.0937,  0.2410,  0.8064,
         0.1225,  0.7888,  0.9745,  0.0858,  0.9444,  0.5276,  0.0388,
         0.9529,  0.0099,  0.1100,  0.7928,  0.9925,  0.0096,  0.9884,
         0.0145,  0.9694,  0.0138,  0.0317,  0.8836,  0.9904,  0.0161,
         0.9999,  0.9375,  0.0113,  0.8949,  0.3007,  0.1135,  0.9680,
         0.9860,  0.9845,  0.0036,  0.7455,  0.9871,  0.9072,  0.0731,
         0.0382,  0.9664,  0.9683,  0.9633,  0.9050,  0.8989,  0.0816,
         0.9961,  0.9705,  0.0264,  0.3338,  0.9727,  0.0674,  0.9491,
         0.9061,  0.2178,  0.0135,  0.1219,  0.0090,  0.9595,  0.0029,
         0.0686,  0.0477,  0.0072,  0.8776,  0.9994,  0.6931,  0.9643,
         0.9999,  0.0994,  0.4575,  0.0011,  0.9937,  0.1550,  0.9627,
         0.0217,  0.0912,  0.9141,  0.3663,  0.0225,  0.9829,  0.0005,
         0.9065,  1.0000,  0.0490,  0.9990,  0.4497,  0.0034,  0.0899,
         0.0424,  0.9082,  0.0188,  0.9796,  0.0338,  0.9519,  0.2385,
         0.9941,  0.9895,  0.6605,  0.0230,  0.3998,  0.0110,  0.0228,
         0.4120,  0.2408,  0.4839,  0.1853,  0.4895,  0.3381,  0.0970,
         0.9698,  0.8693,  0.0047,  0.9836,  0.2228,  0.2145,  0.9751,
         0.1147,  0.9985,  0.0394,  0.9929,  0.9235,  0.0429,  0.9067,
         0.0508,  0.0315,  0.7178,  0.0379,  0.9740,  0.9476,  0.0342,
         0.0826,  0.9418,  0.9664,  0.9732,  0.7806,  0.0443,  0.9839,
         0.9989,  0.8833,  0.0684,  0.0845,  0.8997,  0.0760,  0.1259,
         0.9575,  0.0251,  0.9849,  0.0074,  0.7696,  0.9767,  0.4088,
         0.0344,  0.0052,  0.0238,  0.8856,  0.6475,  0.5191,  0.1973,
         0.0624,  0.8728,  0.8865,  0.1221,  0.1392,  0.9860,  0.0435,
         0.9154,  0.0978,  0.1682,  0.0309,  0.9271,  0.9086,  0.6510,
         0.6457,  0.9811,  0.9722,  0.8147,  0.1379,  0.9196,  0.0679,
         0.1199,  0.0180,  0.9361,  0.7444,  0.0677,  0.0129,  0.0319,
         0.0194,  0.4503,  0.1697,  0.1364,  0.0172,  0.9744,  0.0140,
         0.9036,  0.8238,  0.0306,  0.4916,  0.1754,  0.0123,  0.0387,
         0.1823,  0.0403,  0.9998,  0.4612,  0.9424,  0.9887,  0.9200,
         0.0201,  0.9590,  0.2841,  0.0377,  0.0251,  0.0007,  0.9217,
         0.0382,  0.1832,  0.9843,  0.1379,  0.4994,  0.9773,  0.0341,
         0.0015,  0.9440,  0.0308,  0.9784,  0.1030,  0.9616,  0.9328,
         0.0593,  0.9757,  0.9807,  0.9514,  0.3920,  0.7737,  0.9440,
         0.0320,  0.4522,  0.9978,  0.1425,  0.9295,  0.9311,  0.0108,
         0.9110,  0.0040,  0.8398,  0.0107,  0.8300,  0.1621,  0.4878,
         0.0836,  0.8449,  0.1168,  0.9512,  0.7502,  0.0405,  0.0571,
         0.1529,  0.7518,  0.7962,  0.5183,  0.0200,  0.9845,  0.9931,
         0.8688,  0.8739,  0.9914,  0.0158,  0.1447,  0.0126,  0.0002,
         0.9956,  0.9898,  0.9526,  0.1323,  0.2243,  0.6481,  0.0407,
         0.0038,  0.3741,  0.0598,  0.5805,  0.0381,  0.8449,  0.7879,
         0.2857,  0.1590,  0.7897,  0.9301,  0.0043,  0.2178,  0.0073,
         0.9207,  0.0131,  0.4248,  0.2792,  0.8012,  0.8432,  0.5949,
         0.1095,  0.0738,  0.2131,  0.9283,  0.0062,  0.0021,  0.9683,
         0.0207,  0.0215,  0.3629,  0.1631,  0.8471,  0.0673,  0.9728,
         0.9881,  0.0704,  0.7978,  0.9231,  0.8629,  0.0186,  0.9973,
         0.2101,  0.9916,  0.6917,  0.9855,  0.9009,  0.8242,  0.9994,
         0.9952,  0.3982,  0.4524,  0.9696,  0.9714,  0.6488,  0.0752,
         0.0423,  0.8142,  0.9452,  0.0085,  0.0056,  0.1666,  0.9680,
         0.0482,  0.0160,  0.0042,  0.2574,  0.9345,  0.9844,  0.0041,
         0.3358,  0.9347,  0.7313,  0.0548,  0.0586,  0.0029,  0.9467,
         0.0254,  0.6435,  0.3260,  0.0922,  0.0225,  0.9709,  0.1500,
         0.8164,  0.0821,  0.8989,  0.7775,  0.9861,  0.0081,  0.0031,
         0.0092,  0.7264,  0.0264,  0.3017,  0.2202,  0.2434,  0.9718,
         0.4166,  0.0147,  0.9867,  0.1439,  0.9052,  0.0536,  0.9219,
         0.0135,  0.0256,  0.9532,  0.0769,  0.3967,  0.0347,  0.0095,
         0.1042,  0.9003,  0.8281,  0.9696,  0.1035,  0.9051,  0.9640,
         0.9545,  0.8589,  0.0827,  0.8507,  0.9333,  0.0097,  0.9989,
         0.9352,  0.0064,  0.9173,  0.0097,  0.7675,  0.9849,  0.1478,
         0.0367,  0.9896,  0.9746,  0.0852,  0.0550,  0.0301,  0.1676,
         0.6058,  0.7720,  0.1747,  0.9964,  0.0681,  0.0008,  0.4820,
         0.0139,  0.9008,  0.7456,  0.5043,  0.7566,  0.3680,  0.9736,
         0.9996,  0.0374,  0.9389,  0.0872,  0.0091,  0.1530,  0.0393,
         0.0161,  0.0183,  0.0848,  0.9862,  0.9615,  0.0391,  0.0102,
         0.0304,  0.4672,  0.9625,  0.0506,  0.0119,  0.0298,  0.9414,
         0.0144,  0.2792,  0.5050,  0.0147,  0.0271,  0.0355,  0.1990,
         0.8487,  0.0040,  0.9373,  0.0238,  0.6036,  0.0521,  0.0143,
         0.9264,  0.9961,  0.8552,  0.7062,  0.0218,  0.0064,  0.0129,
         0.9186,  0.9884,  0.0655,  0.9586,  0.0145,  0.6704,  0.0221,
         0.2051,  0.0129,  0.2504,  0.9503,  0.0337,  0.8534,  0.0282,
         0.1028,  0.9996,  0.1140,  0.9611,  0.0057,  0.9274,  0.1141,
         0.4453,  0.9880,  0.9148,  0.9722,  0.0546,  0.0030,  0.0748,
         0.9673,  0.0179,  0.5080,  0.9189,  0.2598,  0.8691,  0.8025,
         0.0982], device='cuda:0')
tensor(0.2513, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9445,  0.0320,  0.9957,  0.8951,  0.0090,  0.8412,  0.9513,
         0.7141,  0.9979,  0.0041,  0.8542,  0.0033,  0.2853,  0.9034,
         0.0210,  0.9471,  0.7023,  0.1149,  0.0313,  0.8401,  0.0087,
         0.9723,  0.7986,  0.0308,  0.4782,  0.1195,  0.0049,  0.9743,
         0.1120,  0.3157,  0.1061,  0.9864,  0.0117,  0.9772,  0.9918,
         0.2108,  0.0188,  0.9994,  0.0065,  0.0090,  0.0058,  0.1517,
         0.9691,  0.0394,  0.0002,  0.9991,  0.9541,  0.5146,  0.9665,
         0.9681,  0.6169,  0.0677,  0.4884,  0.1592,  0.0657,  0.4128,
         0.9299,  0.1000,  0.0372,  0.0332,  0.9435,  0.0533,  0.8290,
         0.8116,  0.0110,  0.0100,  0.9344,  0.0071,  0.0116,  0.9679,
         0.9687,  0.6266,  0.9489,  0.9751,  0.2541,  0.0262,  0.0038,
         0.0085,  0.2691,  0.0046,  0.9929,  0.0174,  0.9336,  0.0414,
         0.0035,  0.0622,  0.0047,  0.7697,  0.0050,  0.9551,  0.4117,
         0.0384,  0.9517,  0.8614,  0.9128,  0.0722,  0.0360,  0.3774,
         0.0142,  0.9035,  0.0164,  0.0983,  0.0929,  0.0050,  0.9827,
         0.1943,  0.0969,  0.0237,  0.7397,  0.8450,  0.1106,  0.1258,
         0.0851,  0.0021,  0.1076,  0.8458,  0.9808,  0.0489,  0.8021,
         0.1489,  0.7200,  0.9920,  0.9911,  0.0198,  0.0277,  0.0905,
         0.3073,  0.0016,  0.0179,  0.0227,  0.0935,  0.8482,  0.0334,
         0.8083,  0.9456,  0.9130,  0.1081,  0.0110,  0.9299,  0.7305,
         0.2853,  0.8623,  0.7776,  0.0258,  0.8566,  0.1271,  0.9111,
         0.9863,  0.9493,  0.9776,  0.4898,  0.6245,  0.2282,  0.3842,
         0.0243,  0.0240,  0.3130,  0.1889,  0.0200,  0.1225,  0.1094,
         0.2227,  0.9871,  0.0211,  0.0023,  0.9677,  0.8108,  0.0876,
         0.9368,  0.6557,  0.0114,  0.2003,  0.1087,  0.9109,  0.6427,
         0.9522,  0.3655,  0.0056,  0.1489,  0.0744,  0.4040,  0.3060,
         0.0004,  0.9583,  0.5070,  0.6041,  0.8744,  0.0026,  0.1652,
         0.9904,  0.0509,  0.0115,  0.4939,  0.0562,  0.0177,  0.0376,
         0.0433,  0.3223,  0.0423,  0.0392,  0.0194,  0.9986,  0.0684,
         0.1674,  0.4098,  0.3316,  0.4007,  0.0402,  0.7327,  0.9062,
         0.4419,  0.0433,  0.0140,  0.9845,  0.8834,  0.5769,  0.0115,
         0.8894,  0.7961,  0.4595,  0.0172,  0.0019,  0.8974,  0.0320,
         0.5316,  0.3383,  0.4779,  0.0298,  0.0710,  0.0063,  0.8222,
         0.2561,  0.9822,  0.8648,  0.0097,  0.1016,  0.7313,  0.9937,
         0.9839,  0.9637,  0.0166,  0.1770,  0.5573,  0.9160,  0.1253,
         0.0174,  0.0130,  0.0141,  0.9999,  0.0426,  0.0120,  0.9152,
         0.2787,  0.8903,  0.0071,  0.1697,  0.0923,  0.8295,  0.0216,
         0.1130,  0.9225,  0.0537,  0.8893,  0.9265,  0.0017,  0.9662,
         0.0689,  0.0828,  0.3922,  0.0032,  0.9702,  0.9472,  0.6422,
         0.3152,  0.0402,  0.9872,  0.0551,  0.5056,  0.0709,  0.0047,
         0.0234,  0.9865,  0.9491,  0.9008,  0.7874,  0.0995,  0.8524,
         0.9437,  0.1995,  0.8542,  0.0237,  0.0728,  0.0527,  0.5290,
         0.9613,  0.0045,  0.0103,  0.5842,  0.4119,  0.0143,  0.9700,
         0.0380,  0.0938,  0.0254,  0.0359,  0.6043,  0.0549,  0.9529,
         0.0180,  0.0857,  0.0213,  0.6622,  0.8576,  0.0524,  0.1790,
         0.7754,  0.0272,  0.0484,  0.9580,  0.1912,  0.8121,  0.0202,
         0.0103,  0.9831,  0.0106,  0.0385,  0.9528,  0.8904,  0.0010,
         0.9227,  0.0012,  0.9903,  0.0111,  0.0403,  0.1102,  0.3887,
         0.7496,  0.8245,  0.9240,  0.1818,  0.8263,  0.0566,  0.9332,
         0.9514,  0.0307,  0.9928,  0.8908,  0.5847,  0.0450,  0.0239,
         0.0220,  0.0619,  0.9610,  0.0526,  0.4598,  0.0714,  0.0286,
         0.3789,  0.9877,  0.7121,  0.2285,  0.0014,  0.0858,  0.0260,
         0.8811,  0.0012,  0.0062,  0.7989,  0.0106,  0.6523,  0.9154,
         0.0640,  0.2441,  0.5088,  0.9942,  0.0048,  0.5891,  0.9664,
         0.0146,  0.0268,  0.0077,  0.9477,  0.8116,  0.0014,  0.0031,
         0.9181,  0.0997,  0.0152,  0.1404,  0.0031,  0.3238,  0.7754,
         0.9880,  0.0042,  0.1918,  0.2807,  0.9836,  0.8848,  0.0286,
         0.0102,  0.9707,  0.0085,  0.7128,  0.0641,  0.9867,  0.9878,
         0.8456,  0.9849,  0.4621,  0.9840,  0.0240,  0.0088,  0.0435,
         0.0130,  0.8350,  0.7827,  0.6945,  0.0042,  0.8610,  0.0075,
         0.9849,  0.8996,  0.0028,  0.0013,  0.9939,  0.0039,  0.9808,
         0.0304,  0.0718,  0.4852,  0.9552,  0.9482,  0.9892,  0.0801,
         0.9775,  0.6489,  0.0708,  0.9928,  0.7908,  0.1220,  0.9351,
         0.0235,  0.0223,  0.0152,  0.0154,  0.0352,  0.9447,  0.7231,
         0.9530,  0.5379,  0.9771,  0.5085,  0.9311,  0.8624,  0.9085,
         0.7484,  0.1467,  0.5906,  0.0180,  0.0122,  0.9847,  0.9727,
         0.7259,  0.6674,  0.9679,  0.1751,  0.9980,  0.2158,  0.9411,
         0.0356,  0.9115,  0.5983,  0.0054,  0.0424,  0.0087,  0.0130,
         0.9463,  0.9986,  0.0060,  0.9900,  0.0671,  0.9792,  0.6042,
         0.9896,  0.0183,  0.0279,  0.0258,  0.7056,  0.0175,  0.0691,
         0.9998,  0.0469,  0.9615,  0.0096,  0.0072,  0.8519,  0.0662,
         0.1890,  0.9430,  0.0551,  0.9280,  0.8938,  0.0407,  0.9785,
         0.7395,  0.9573,  0.0200,  0.9505,  0.0336,  0.9369,  0.8252,
         0.7931], device='cuda:0')
tensor(0.2925, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2294,  0.9595,  0.9572,  0.0213,  0.0285,  0.0563,  0.0107,
         0.9898,  0.0531,  0.0342,  0.9656,  0.9725,  0.9942,  0.9489,
         0.0065,  0.9613,  0.8960,  0.0410,  0.3682,  0.1209,  0.2100,
         0.8158,  0.0111,  0.0642,  0.0081,  0.9906,  0.5722,  0.1449,
         0.9102,  0.5383,  0.6162,  0.4870,  0.9985,  0.0012,  0.5445,
         0.9942,  0.0011,  0.9310,  0.0291,  0.8711,  0.0777,  0.0430,
         0.0084,  0.8559,  0.0598,  0.0240,  0.0200,  0.0106,  0.0326,
         0.0626,  0.0017,  0.0430,  0.0574,  0.1545,  0.8804,  0.6463,
         0.8295,  0.7991,  0.9622,  0.5298,  0.9420,  0.7495,  0.4031,
         0.8777,  0.0800,  0.8914,  0.0047,  0.1121,  0.5627,  0.9949,
         0.1075,  0.0846,  0.1402,  0.0033,  0.0505,  0.7365,  0.8699,
         0.0088,  0.0346,  0.9666,  0.6876,  0.5041,  0.9877,  0.3307,
         0.1268,  0.9608,  0.0236,  0.4530,  0.0096,  0.9752,  0.0043,
         0.9365,  0.4867,  0.0061,  0.0941,  0.0027,  0.1241,  0.4016,
         0.8873,  0.9480,  0.9543,  0.0359,  0.0126,  0.6086,  0.0454,
         0.7945,  0.0203,  0.9336,  0.0373,  0.0379,  0.9719,  0.2690,
         0.0869,  0.8040,  0.0110,  0.9088,  0.0042,  0.3038,  0.9741,
         0.9866,  0.7051,  0.8165,  0.0119,  0.8774,  0.8945,  0.0047,
         0.6375,  0.9197,  0.9756,  0.9169,  0.2967,  0.0201,  0.0584,
         0.9764,  0.9110,  0.3818,  0.9791,  0.0214,  0.1957,  0.5670,
         0.0159,  0.6211,  0.8550,  0.0006,  0.9846,  0.0282,  0.8395,
         0.0565,  0.0892,  0.0205,  0.0573,  0.0013,  0.0156,  0.0442,
         0.6062,  0.9629,  0.7434,  0.0946,  0.8529,  0.9206,  0.0459,
         0.0834,  0.4406,  0.3633,  0.5784,  0.8054,  0.0773,  0.1118,
         0.0339,  0.0039,  0.1743,  0.0007,  0.9160,  0.7985,  0.0465,
         0.2199,  0.2526,  0.6891,  0.1433,  0.0013,  0.0402,  0.0861,
         0.0006,  0.0016,  0.0046,  0.0076,  0.0158,  0.0272,  0.6185,
         0.0071,  0.4691,  0.5202,  0.0143,  0.9314,  0.9425,  0.8919,
         0.0208,  0.0033,  0.1610,  0.0361,  0.0284,  0.7342,  0.9738,
         0.0326,  0.0370,  0.9797,  0.0090,  0.1154,  0.0148,  0.0062,
         0.0435,  0.0352,  0.0723,  0.0399,  0.0349,  0.0109,  0.8244,
         0.4354,  0.9414,  0.0441,  0.0303,  0.0697,  0.5171,  0.9334,
         0.0867,  0.9790,  0.0738,  0.9562,  0.0369,  0.6068,  0.7867,
         0.9073,  0.0191,  0.9754,  0.0545,  0.0674,  0.0401,  0.0237,
         0.0151,  0.0580,  0.0339,  0.1039,  0.1924,  0.0992,  0.9188,
         0.0066,  0.0155,  0.4624,  0.0027,  0.0304,  0.8351,  0.9448,
         0.9591,  0.9605,  0.9716,  0.1153,  0.6381,  0.0084,  0.2759,
         0.0361,  0.0030,  0.8924,  0.8883,  0.0270,  0.9552,  0.7945,
         0.0020,  0.2532,  0.0393,  0.0017,  0.0344,  0.9052,  0.0063,
         0.0198,  0.6665,  0.0219,  0.0031,  0.1162,  0.0741,  0.1238,
         0.4060,  0.0429,  0.9095,  0.0324,  0.8801,  0.0462,  0.0358,
         0.9439,  0.1378,  0.4423,  0.0079,  0.0715,  0.7390,  0.9615,
         0.8998,  0.0056,  0.3031,  0.7373,  0.8090,  0.0154,  0.1185,
         0.0638,  0.0752,  0.0385,  0.0900,  0.0237,  0.0224,  0.0060,
         0.9320,  0.0870,  0.0611,  0.2662,  0.0105,  0.3241,  0.0573,
         0.0033,  0.0021,  0.2513,  0.1168,  0.0118,  0.9316,  0.5458,
         0.0470,  0.9235,  0.0954,  0.2341,  0.0918,  0.9618,  0.0021,
         0.0334,  0.0128,  0.0108,  0.8260,  0.9876,  0.5171,  0.9639,
         0.0102,  0.0226,  0.8958,  0.0136,  0.2596,  0.7885,  0.1296,
         0.0500,  0.2171,  0.6210,  0.0284,  0.7782,  0.0586,  0.0046,
         0.3173,  0.5493,  0.9327,  0.9718,  0.9793,  0.7083,  0.9433,
         0.0188,  0.9432,  0.9992,  0.0678,  0.6553,  0.0004,  0.0349,
         0.0512,  0.0011,  0.0058,  0.9288,  0.9825,  0.3472,  0.9378,
         0.8201,  0.5023,  0.0133,  0.7899,  0.9284,  0.1415,  0.9945,
         0.0041,  0.0194,  0.9451,  0.9591,  0.8952,  0.9249,  0.0014,
         0.0036,  0.0953,  0.7856,  0.0474,  0.9171,  0.0442,  0.9695,
         0.0483,  0.0159,  0.0133,  0.9805,  0.9105,  0.3019,  0.9525,
         0.0150,  0.8847,  0.0042,  0.0510,  0.2298,  0.2682,  0.9043,
         0.4892,  0.6859,  0.0631,  0.4913,  0.0913,  0.9167,  0.9612,
         0.9075,  0.8965,  0.4448,  0.7431,  0.9718,  0.0297,  0.9974,
         0.0161,  0.0668,  0.7822,  0.5686,  0.0338,  0.9448,  0.8811,
         0.0029,  0.0218,  0.9094,  0.3002,  0.0231,  0.0071,  0.3588,
         0.0233,  0.0368,  0.0077,  0.8427,  0.0445,  0.8843,  0.0012,
         0.0767,  0.0467,  0.0159,  0.6583,  0.9830,  0.8995,  0.7890,
         0.9539,  0.1042,  0.8507,  0.1350,  0.0376,  0.0017,  0.1889,
         0.0189,  0.0423,  0.8184,  0.0542,  0.3101,  0.8752,  0.0557,
         0.0560,  0.8195,  0.0165,  0.0252,  0.9765,  0.5954,  0.0192,
         0.0878,  0.0472,  0.9729,  0.0062,  0.0188,  0.2602,  0.0026,
         0.4964,  0.7086,  0.0024,  0.1875,  0.0107,  0.0046,  0.0600,
         0.0427,  0.0239,  0.0101,  0.7909,  0.0400,  0.0986,  0.0023,
         0.0173,  0.2031,  0.7838,  0.9147,  0.9821,  0.1583,  0.9380,
         0.9812,  0.9520,  0.0254,  0.9999,  0.0346,  0.0395,  0.9925,
         0.0620,  0.6950,  0.0017,  0.8691,  0.4365,  0.1570,  0.0812,
         0.0251], device='cuda:0')
tensor(0.3745, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9735,  0.4567,  0.0359,  0.9260,  0.0005,  0.7904,  0.9621,
         0.1259,  0.1420,  0.0345,  0.1279,  0.0953,  0.4863,  0.0192,
         0.3991,  0.8670,  0.0416,  0.0690,  0.9478,  0.2719,  0.9440,
         0.1304,  0.0420,  0.8598,  0.0104,  0.6429,  0.0241,  0.0560,
         0.9629,  0.8269,  0.2218,  0.0079,  0.3703,  0.4179,  0.8552,
         0.6559,  0.0383,  0.1889,  0.0381,  0.1599,  0.8715,  0.5691,
         0.3830,  0.9683,  0.0314,  0.0481,  0.8179,  0.0284,  0.0301,
         0.0267,  0.0135,  0.4160,  0.3992,  0.0849,  0.6146,  0.8702,
         0.9446,  0.3143,  0.0372,  0.2014,  0.0096,  0.9611,  0.0475,
         0.9888,  0.0333,  0.5961,  0.0111,  0.9711,  0.2835,  0.9123,
         0.2854,  0.4741,  0.0221,  0.0036,  0.8518,  0.0962,  0.0055,
         0.9740,  0.0364,  0.5122,  0.5334,  0.9585,  0.8319,  0.1358,
         0.3795,  0.9763,  0.8867,  0.9333,  0.0006,  0.1787,  0.9893,
         0.9728,  0.5953,  0.0455,  0.0568,  0.8529,  0.9523,  0.4480,
         0.9899,  0.8653,  0.0553,  0.5578,  0.7200,  0.0602,  0.4636,
         0.0091,  0.3830,  0.0043,  0.0625,  0.3003,  0.0061,  0.9525,
         0.2170,  0.0677,  0.0027,  0.8326,  0.6443,  0.0226,  0.8775,
         0.6416,  0.8445,  0.8382,  0.9527,  0.0379,  0.0247,  0.9643,
         0.0058,  0.1888,  0.8684,  0.8449,  0.0062,  0.7723,  0.6404,
         0.0576,  0.7249,  0.4688,  0.0377,  0.0121,  0.0112,  0.9214,
         0.9062,  0.0444,  0.0062,  0.7030,  0.0316,  0.0195,  0.0512,
         0.0172,  0.0403,  0.0059,  0.9728,  0.0255,  0.0069,  0.2849,
         0.9991,  0.0233,  0.0539,  0.0063,  0.0110,  0.3977,  0.1807,
         0.0715,  0.0014,  0.7292,  0.1619,  0.7615,  0.0657,  0.9697,
         0.0708,  0.0611,  0.9847,  0.0142,  0.0052,  0.0069,  0.4871,
         0.0066,  0.0124,  0.0909,  0.9389,  0.9680,  0.1646,  0.8546,
         0.9689,  0.1739,  0.0678,  0.8713,  0.6517,  0.0707,  0.2881,
         0.7318,  0.9419,  0.9821,  0.4183,  0.4733,  0.5743,  0.0049,
         0.1604,  0.9482,  0.4364,  0.0148,  0.0267,  0.8623,  0.9948,
         0.1056,  0.8588,  0.1181,  0.9186,  0.0919,  0.8525,  0.9944,
         0.0066,  0.6378,  0.1700,  0.9484,  0.6437,  0.9626,  0.5567,
         0.0086,  0.0532,  0.1479,  0.2791,  0.9050,  0.0058,  0.0221,
         0.2362,  0.9088,  0.0341,  0.2609,  0.0763,  0.9999,  0.0028,
         0.0546,  0.5757,  0.9998,  0.0502,  0.3605,  0.0369,  0.0733,
         0.5840,  0.1231,  0.0178,  0.9989,  0.0199,  0.0287,  0.5810,
         0.1776,  0.1542,  0.1604,  0.6590,  0.8207,  0.1842,  0.0365,
         0.4363,  0.1032,  0.9979,  0.9614,  0.0667,  0.9362,  0.2434,
         0.0596,  0.7842,  0.9954,  0.5433,  0.4562,  0.9132,  0.0012,
         0.8111,  0.1891,  0.0124,  0.1461,  0.1568,  0.8436,  0.9521,
         0.0055,  0.9449,  0.2742,  0.0190,  0.4597,  0.0978,  0.9131,
         0.5841,  0.0293,  0.9572,  0.2194,  0.9703,  0.9230,  0.2450,
         0.5959,  0.0358,  0.9141,  0.0998,  0.3587,  0.0592,  0.0945,
         0.9731,  0.0821,  0.1304,  0.0972,  0.9638,  0.4438,  0.9670,
         0.0543,  0.0102,  0.9667,  0.0285,  0.2033,  0.0945,  0.1129,
         0.9732,  0.0443,  0.0641,  0.0100,  0.0078,  0.7285,  0.7228,
         0.9168,  0.1353,  0.9995,  0.9268,  0.7859,  0.0199,  0.0603,
         0.5579,  0.9468,  0.0052,  0.6674,  0.3322,  0.6998,  0.9568,
         0.0116,  0.9874,  0.0258,  0.0694,  0.6206,  0.2399,  0.0050,
         0.7994,  0.9587,  0.0108,  0.8215,  0.0021,  0.7790,  0.5039,
         0.0227,  0.3450,  0.9361,  0.9908,  0.0410,  0.9783,  0.2975,
         0.1906,  0.0604,  0.3520,  0.4447,  0.0349,  0.0148,  0.0497,
         0.8279,  0.9183,  0.0149,  0.1638,  0.0056,  0.0365,  0.0498,
         0.0040,  0.9081,  0.9728,  0.0365,  0.9916,  0.0826,  0.4756,
         0.1133,  0.0333,  0.5639,  0.0010,  0.1026,  0.0437,  0.0237,
         0.5062,  0.0016,  0.9108,  0.9968,  0.7966,  0.0416,  0.9909,
         0.9915,  0.8915,  0.0062,  0.2512,  0.7868,  0.8404,  0.4795,
         0.0248,  0.0022,  0.9516,  0.9562,  0.9939,  0.9305,  0.0093,
         0.4713,  0.2502,  0.2405,  0.6029,  0.8724,  0.8902,  0.6518,
         0.9242,  0.2448,  0.6555,  0.8399,  0.1108,  0.7837,  0.8671,
         0.9975,  0.9281,  0.0724,  0.9983,  0.5892,  0.9898,  0.0444,
         0.5372,  0.7078,  0.1235,  0.6209,  0.8549,  0.9203,  0.8724,
         0.9496,  0.0127,  0.0071,  0.0049,  0.4871,  0.0966,  0.0007,
         0.7555,  0.9494,  0.0095,  0.8751,  0.9553,  0.3579,  0.8134,
         0.1743,  0.8060,  0.7005,  0.9378,  0.0058,  0.4696,  0.9094,
         0.1499,  0.0081,  0.9260,  0.7844,  0.0019,  0.0385,  0.0168,
         0.9160,  0.9064,  0.0886,  0.0014,  0.0687,  0.0271,  0.8876,
         0.9732,  0.9597,  0.1161,  0.6878,  0.0191,  0.0098,  0.9114,
         0.9365,  0.8829,  0.7610,  0.0063,  0.0339,  0.0155,  0.6799,
         0.3714,  0.1791,  0.2073,  0.2641,  0.0057,  0.2043,  0.9743,
         0.8098,  0.6945,  0.7325,  0.0996,  0.9504,  0.0674,  0.0264,
         0.8804,  0.7425,  0.0151,  0.9989,  0.8964,  0.9648,  0.6322,
         0.0410,  0.1432,  0.0153,  0.0258,  0.0425,  0.0338,  0.8878,
         0.9544,  0.0510,  0.0013,  0.0207,  0.9539,  0.2279,  0.0735,
         0.5704], device='cuda:0')
tensor(0.2916, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1740,  0.2557,  0.9985,  0.3501,  0.5278,  0.9984,  0.9678,
         0.0028,  0.8668,  0.0575,  0.5287,  0.0063,  0.9844,  0.2579,
         0.9501,  0.0597,  0.1020,  0.1213,  0.6547,  0.1047,  0.9635,
         0.7477,  0.9646,  0.0285,  0.8166,  0.0051,  0.3418,  0.0295,
         0.1372,  0.6593,  0.0416,  0.1626,  0.4614,  0.9808,  0.0016,
         0.0393,  0.0500,  0.4907,  0.8534,  0.7834,  0.5408,  0.1383,
         0.2728,  0.3887,  0.6649,  0.0840,  0.0131,  0.0285,  0.1628,
         0.8907,  0.0415,  0.1980,  0.8461,  0.0530,  0.0198,  0.7417,
         0.0671,  0.6081,  0.0546,  0.7817,  0.1748,  0.8805,  0.9807,
         0.8246,  0.0419,  0.8049,  0.1019,  0.0977,  0.8478,  0.3334,
         0.0182,  0.1968,  0.9731,  0.0276,  0.9028,  0.9225,  0.1340,
         0.1193,  0.3200,  0.6357,  0.6537,  0.0836,  0.8750,  0.0237,
         0.2204,  0.1603,  0.0155,  0.8090,  0.8443,  0.9588,  0.8991,
         0.7567,  0.8779,  0.9995,  0.9965,  0.2986,  0.1468,  0.0936,
         0.1136,  0.9469,  0.0130,  0.0045,  0.9260,  0.0688,  0.0875,
         0.9819,  0.0073,  0.9555,  0.0179,  0.7214,  0.0268,  0.8935,
         0.0315,  0.9428,  0.5601,  0.1126,  0.1063,  0.4187,  0.7802,
         0.9232,  0.0702,  0.4283,  0.9781,  0.4900,  0.8834,  0.0404,
         0.4743,  0.0012,  0.6695,  0.7237,  0.7358,  0.0176,  0.1380,
         0.9430,  0.7226,  0.1283,  0.9807,  0.1908,  0.9473,  0.0286,
         0.1145,  0.0084,  0.7943,  0.8920,  0.1454,  0.5291,  0.1700,
         0.0064,  0.0645,  0.9837,  0.0199,  0.8997,  0.4030,  0.0150,
         0.0320,  0.3844,  0.9948,  0.9703,  0.1227,  0.1949,  0.9676,
         0.8568,  0.5951,  0.9470,  0.9266,  0.0440,  0.9969,  0.0561,
         0.8148,  0.1544,  0.9127,  0.7900,  0.6610,  0.3680,  0.8755,
         0.9127,  0.7284,  0.8926,  0.1281,  0.0551,  0.0030,  0.0962,
         0.6622,  0.7673,  0.9414,  0.8688,  0.9341,  0.9315,  0.9451,
         0.5583,  0.1501,  0.6182,  0.0490,  0.7144,  0.4250,  0.0298,
         0.0060,  0.4294,  0.0062,  0.1800,  0.9630,  0.3906,  0.5876,
         0.9827,  0.0707,  0.1078,  0.3349,  0.7409,  0.2843,  0.0556,
         0.8699,  0.2453,  0.8698,  0.0094,  0.0633,  0.9743,  0.8465,
         0.8381,  0.6767,  0.7848,  0.0289,  0.1600,  0.0266,  0.7945,
         0.8692,  0.8324,  0.0811,  0.9711,  0.9992,  0.9645,  0.9217,
         0.0950,  0.6042,  0.4640,  0.1208,  0.9164,  0.1300,  0.5949,
         0.4116,  0.9223,  0.3173,  0.8227,  0.9263,  0.4605,  0.8058,
         0.6934,  0.9667,  0.6307,  0.7735,  0.2315,  0.9920,  0.2012,
         0.0023,  0.3965,  0.0428,  0.9147,  0.1342,  0.8192,  0.0066,
         0.9618,  0.1994,  0.0357,  0.8856,  0.6709,  0.0400,  0.0394,
         0.9363,  0.0159,  0.9587,  0.2810,  0.1131,  0.1033,  0.0561,
         0.3334,  0.9769,  0.6909,  0.8820,  0.0361,  0.1369,  0.0889,
         0.5045,  0.9982,  0.5805,  0.8831,  0.8021,  0.8529,  0.0602,
         0.1287,  0.0803,  0.4845,  0.0065,  0.0406,  0.0873,  0.4812,
         0.8345,  0.8257,  0.9360,  0.1585,  0.9586,  0.4574,  0.9651,
         0.0191,  0.0774,  0.3007,  0.0487,  0.0083,  0.8472,  0.0379,
         0.9995,  0.5931,  0.6467,  0.9983,  0.8447,  0.2374,  0.1039,
         0.8326,  0.3356,  0.6265,  0.9852,  0.7135,  0.2601,  0.9063,
         0.0775,  0.9837,  0.8713,  0.1039,  0.3113,  0.0884,  0.1753,
         0.9758,  0.0053,  0.0464,  0.0710,  0.8327,  0.0372,  0.6470,
         0.0027,  0.0473,  0.6677,  0.0678,  0.8315,  0.2103,  0.9991,
         0.0294,  0.9993,  0.9458,  0.3146,  0.0146,  0.0615,  0.2218,
         0.0488,  0.3745,  0.0380,  0.0234,  0.7674,  0.1368,  0.9059,
         0.7947,  0.6295,  0.3174,  0.2755,  0.6801,  0.0462,  0.3367,
         0.7555,  0.0561,  0.5438,  0.8794,  0.0056,  0.1600,  0.0672,
         0.0929,  0.0326,  0.0273,  0.9851,  0.1050,  0.3271,  0.6817,
         0.9912,  0.6651,  0.0474,  0.2622,  0.9748,  0.5396,  0.0279,
         0.7872,  0.0981,  0.0152,  0.7012,  0.1431,  0.3016,  0.7736,
         0.7170,  0.6937,  0.9007,  0.0013,  0.3678,  0.0417,  0.9186,
         0.0817,  0.9426,  0.3271,  0.8523,  0.0382,  0.0159,  0.8647,
         0.0152,  0.4729,  0.0194,  0.0894,  0.5551,  0.9481,  0.9965,
         0.9198,  0.1388,  0.7788,  0.1543,  0.9587,  0.0096,  0.0232,
         0.9317,  0.6723,  0.0031,  0.9752,  0.8652,  0.0466,  0.9943,
         0.1956,  0.0452,  0.9527,  0.9688,  0.0977,  0.0331,  0.8669,
         0.6862,  0.4241,  0.9386,  0.0613,  0.5559,  0.1899,  0.2390,
         0.8434,  0.8902,  0.6247,  0.1890,  0.0172,  0.2213,  0.0292,
         0.0366,  0.9277,  0.1743,  0.9341,  0.0544,  0.9635,  0.1436,
         0.8630,  0.9020,  0.9297,  0.9902,  0.2033,  0.0034,  0.9338,
         0.0329,  0.6837,  0.5609,  0.6117,  0.1537,  0.8012,  0.9172,
         0.4997,  0.0032,  0.9741,  0.0055,  0.0885,  0.7016,  0.1428,
         0.0069,  0.9468,  0.6493,  0.0912,  0.9915,  0.6617,  0.1203,
         0.9360,  0.1736,  0.8226,  0.9382,  0.0018,  0.2459,  0.9868,
         0.9688,  0.9934,  0.7682,  0.0645,  0.8624,  0.8391,  0.9837,
         0.1595,  0.0460,  0.0607,  0.5989,  0.3025,  0.8863,  0.7824,
         0.9905,  0.6933,  0.8902,  0.9548,  0.9275,  0.0903,  0.9705,
         0.6918], device='cuda:0')
tensor(0.2654, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7064,  0.7155,  0.8601,  0.9866,  0.9051,  0.9103,  0.9967,
         0.1789,  0.9642,  0.9889,  0.9460,  0.8331,  0.2371,  0.9267,
         0.3146,  0.2064,  0.2286,  0.9999,  0.0767,  0.0663,  0.0011,
         0.2852,  0.0413,  0.1991,  0.3773,  0.1804,  0.4689,  0.6442,
         0.9786,  0.6740,  0.1821,  0.0859,  0.9096,  0.7688,  0.9656,
         0.9712,  0.2716,  0.1158,  0.0455,  0.1560,  0.9450,  0.0127,
         0.9118,  0.0748,  0.2019,  0.2002,  0.8556,  0.4722,  0.9990,
         0.2497,  0.9972,  0.9756,  0.0409,  0.1376,  0.0540,  0.9134,
         0.9610,  0.9666,  0.1083,  0.8505,  0.0290,  0.9175,  0.0110,
         0.9919,  0.5176,  0.6790,  0.0307,  0.9419,  0.9158,  0.3642,
         0.9470,  0.9997,  0.9779,  0.1281,  0.9248,  0.8831,  0.0831,
         0.1025,  0.8290,  0.8616,  0.9346,  0.4280,  0.9135,  0.9593,
         0.7948,  0.0402,  0.9740,  0.0261,  0.1463,  0.1455,  0.1505,
         0.0137,  0.9768,  0.0982,  0.9870,  0.4896,  0.9710,  0.7213,
         0.8806,  0.5058,  0.8230,  0.0809,  0.8841,  0.0261,  0.8848,
         0.9317,  0.7392,  0.7727,  0.3844,  0.8528,  0.3473,  0.9774,
         0.2195,  0.0596,  0.9409,  0.9297,  0.4488,  0.2534,  0.9623,
         0.0544,  0.9049,  0.3621,  0.9591,  0.0104,  0.0608,  0.9212,
         0.6492,  0.9204,  0.1801,  0.1708,  0.9965,  0.0858,  0.1588,
         0.6293,  0.9507,  0.2417,  0.8485,  0.9670,  0.9319,  0.9582,
         0.8652,  0.8814,  0.0342,  0.0856,  0.0224,  0.1753,  0.8976,
         0.9029,  0.7237,  0.0729,  0.9961,  0.9956,  0.9985,  0.8637,
         0.1068,  0.9613,  0.9852,  0.6515,  0.6288,  0.8391,  0.9433,
         0.5952,  0.1735,  0.9079,  0.0153,  0.3192,  0.1489,  0.0041,
         0.5308,  0.3294,  0.5181,  0.9647,  0.1887,  0.9502,  0.0375,
         0.0397,  0.0572,  0.9784,  0.2608,  0.9143,  0.9550,  0.1301,
         0.5357,  0.9753,  0.3827,  0.8606,  0.1129,  0.8031,  0.9480,
         0.1949,  0.0443,  0.9286,  0.0497,  0.6500,  0.9178,  0.9511,
         0.0419,  0.9500,  0.5377,  0.0142,  0.1388,  0.0481,  0.4713,
         0.8244,  0.9226,  0.9977,  0.6266,  0.2821,  0.7168,  0.0749,
         0.0361,  0.9977,  0.1010,  0.9066,  0.8056,  0.0042,  0.3569,
         0.7970,  0.9938,  0.4302,  0.2010,  0.0998,  0.9136,  0.0573,
         0.9933,  0.9235,  0.9877,  0.6457,  0.0151,  0.9235,  0.4113,
         0.9883,  0.9621,  0.9473,  0.4341,  0.9452,  0.1672,  0.0484,
         0.1259,  0.9710,  0.0710,  0.4342,  0.0062,  0.1970,  0.1500,
         0.9030,  0.0267,  0.1203,  0.9776,  0.9339,  0.1865,  0.1318,
         0.7738,  0.9992,  0.2694,  0.1016,  0.5107,  0.0059,  0.0806,
         0.2603,  0.4254,  0.0082,  0.3433,  0.8037,  0.0522,  0.9935,
         0.0062,  0.9646,  0.9217,  0.4303,  0.2589,  0.6828,  0.8296,
         0.9416,  0.1153,  0.9316,  0.9273,  0.8656,  0.9356,  0.0301,
         0.5561,  0.0014,  0.9491,  0.0385,  0.9016,  0.9598,  0.9942,
         0.0529,  0.9722,  0.0616,  0.5232,  0.0075,  0.8952,  0.3036,
         0.9184,  0.1781,  0.8501,  0.9619,  0.7962,  0.1566,  0.3523,
         0.7641,  0.2288,  0.9017,  0.3342,  0.9978,  0.0052,  0.2182,
         0.0120,  0.9484,  0.9045,  0.2555,  0.4013,  0.6772,  0.8448,
         0.2252,  0.9424,  0.4238,  0.1337,  0.7259,  0.6321,  0.1699,
         0.9717,  0.0409,  0.7926,  0.9435,  0.9835,  0.3953,  0.9307,
         0.9760,  0.8416,  0.2560,  0.1552,  0.9763,  0.0188,  0.2118,
         0.8414,  0.1720,  0.7178,  0.9258,  0.8365,  0.3927,  0.2244,
         0.0202,  0.3423,  0.5927,  0.9733,  0.0959,  0.9499,  0.5637,
         0.4661,  0.3898,  0.9015,  0.9406,  0.0046,  0.9859,  0.4420,
         0.0298,  0.9842,  0.0887,  0.0407,  0.9978,  0.1249,  0.8005,
         0.1583,  0.9561,  0.5214,  0.4045,  0.9375,  0.0453,  0.9658,
         0.7323,  0.0583,  0.4898,  0.0510,  0.8842,  0.1305,  0.5895,
         0.9562,  0.3524,  0.3758,  0.1963,  0.7851,  0.0978,  0.6397,
         0.7136,  0.4390,  0.9573,  0.0042,  0.3208,  0.9485,  0.0070,
         0.9667,  0.9668,  0.8242,  0.9763,  0.2860,  0.1635,  0.8740,
         0.0486,  0.8894,  0.3043,  0.0217,  0.3251,  0.1239,  0.9575,
         0.9949,  0.8280,  0.0443,  0.7870,  0.7485,  0.1979,  0.0050,
         0.9434,  0.8338,  0.8200,  0.2477,  0.9300,  0.1541,  0.9224,
         0.7639,  0.0553,  0.1161,  0.8127,  0.5516,  0.1201,  0.0077,
         0.2182,  0.9013,  0.6504,  0.9163,  0.3888,  0.0633,  0.1846,
         0.8012,  0.9970,  0.8877,  0.0043,  0.0101,  0.6165,  0.1589,
         0.1825,  0.9757,  0.1614,  0.6995,  0.2713,  0.4767,  0.1430,
         0.9596,  0.7908,  0.5720,  0.0241,  0.0021,  0.5272,  0.8914,
         0.5834,  0.0695,  0.9077,  0.8516,  0.0118,  0.9607,  0.0060,
         0.0011,  0.9638,  0.7934,  0.9726,  0.9296,  0.0850,  0.6748,
         0.2247,  0.3402,  0.7469,  0.3140,  0.5640,  0.9765,  0.6878,
         0.2133,  0.9405,  0.9431,  0.7448,  0.9122,  0.9577,  0.9476,
         0.9797,  0.9357,  0.1248,  0.9877,  0.1178,  0.1970,  0.8763,
         0.6649,  0.9645,  0.6570,  0.6863,  0.1029,  0.0968,  0.7990,
         0.9987,  0.8301,  0.5790,  0.9053,  0.4007,  0.5768,  0.8846,
         0.9015,  0.4101,  0.9900,  0.0671,  0.1146,  0.8236,  0.8964,
         0.1022], device='cuda:0')
tensor(0.2956, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9590,  0.8771,  0.1286,  0.9463,  0.9440,  0.2454,  0.2143,
         0.0222,  0.1504,  0.8782,  0.3734,  0.0534,  0.0617,  0.9260,
         0.9831,  0.9756,  0.9812,  0.2404,  0.5648,  0.8620,  0.4369,
         0.1322,  0.7171,  0.9463,  0.0698,  0.1818,  0.9383,  0.1753,
         0.9918,  0.7850,  0.8580,  0.5844,  0.9544,  0.9473,  0.6887,
         0.4006,  0.9185,  0.7005,  0.1193,  0.9684,  0.9536,  0.1788,
         0.9699,  0.1842,  0.8756,  0.1044,  0.1915,  0.9126,  0.5077,
         0.1674,  0.9105,  0.9283,  0.0931,  0.7085,  0.0007,  0.0633,
         0.9765,  0.9293,  0.0891,  0.0048,  0.9625,  0.9805,  0.4042,
         0.1298,  0.1874,  0.9576,  0.9044,  0.0505,  0.8506,  0.1209,
         0.7738,  0.9210,  0.5982,  0.0903,  0.9820,  0.2700,  0.7113,
         0.9807,  0.0451,  0.6830,  0.5872,  0.0537,  0.9496,  0.5948,
         0.0152,  0.8184,  0.9776,  0.1782,  0.7031,  0.9710,  0.9846,
         0.9473,  0.9953,  0.9159,  0.9203,  0.0304,  0.9565,  0.1304,
         0.9195,  0.1283,  0.0498,  0.3043,  0.7256,  0.8456,  0.6830,
         0.9732,  0.9357,  0.3707,  0.0884,  0.0144,  0.1112,  0.9935,
         0.0914,  0.9686,  0.9443,  0.9753,  0.6953,  0.0672,  0.6276,
         0.9111,  0.2730,  0.9724,  0.9139,  0.1521,  0.0926,  0.9998,
         0.1473,  0.7455,  0.6190,  0.0026,  0.9965,  0.9293,  0.7158,
         0.3507,  0.8670,  0.9787,  0.9103,  0.1763,  0.2927,  0.5160,
         0.9750,  0.9193,  0.2244,  0.4339,  0.9417,  0.9754,  0.7144,
         0.9681,  0.2786,  0.8805,  0.0551,  0.7700,  0.2668,  0.9623,
         0.9355,  0.8990,  0.0134,  0.9795,  0.9744,  0.1776,  0.5775,
         0.9721,  0.0258,  0.9808,  0.9936,  0.9625,  0.9843,  0.9417,
         0.1043,  0.9573,  0.5942,  0.6209,  0.9913,  0.9903,  0.8672,
         0.4765,  0.2441,  0.0769,  0.8738,  0.9778,  0.9345,  0.5219,
         0.9408,  0.5988,  0.2444,  0.8068,  0.4149,  0.8761,  0.0365,
         0.9390,  0.5484,  0.5209,  0.7959,  0.0281,  0.9844,  0.9590,
         0.0656,  0.0917,  0.3825,  0.9577,  0.8443,  0.8996,  0.7630,
         0.9432,  0.9980,  0.9407,  0.8903,  0.1297,  0.9392,  0.4547,
         0.9431,  0.9648,  0.8278,  0.0769,  0.9852,  0.9082,  0.3912,
         0.0787,  0.8419,  0.7804,  0.9731,  0.1796,  0.9364,  0.0349,
         0.8818,  0.0764,  0.7447,  0.1112,  0.9181,  0.4267,  0.8271,
         0.0263,  0.9452,  0.9995,  0.1703,  0.9932,  0.1514,  0.0226,
         0.9512,  0.4594,  0.9753,  0.9668,  0.9987,  0.9961,  0.3891,
         0.2628,  0.7790,  0.1258,  0.9338,  0.9998,  0.2855,  0.9754,
         0.0408,  0.9644,  0.4726,  0.7927,  0.0308,  0.8752,  0.9441,
         0.9448,  0.7079,  0.6040,  0.0307,  0.9313,  0.1319,  0.0176,
         0.9492,  0.0617,  0.0249,  0.1982,  0.1260,  0.2913,  0.0858,
         0.9829,  0.9086,  0.9524,  0.2299,  0.8517,  0.9761,  0.9437,
         0.7450,  0.6552,  0.0092,  0.8256,  0.9811,  0.9842,  0.8003,
         0.8109,  0.9534,  0.8352,  0.6217,  0.9294,  0.0862,  0.3518,
         0.3422,  0.1459,  0.1919,  0.7901,  0.9003,  0.1204,  0.0809,
         0.9324,  0.5802,  0.5592,  0.0286,  0.9691,  0.8715,  0.9679,
         0.9421,  0.9374,  0.9861,  0.9753,  0.9024,  0.1015,  0.9112,
         0.0016,  0.9701,  0.8825,  0.1082,  0.9611,  0.9768,  0.7170,
         0.1166,  0.0218,  0.9699,  0.5570,  0.0700,  0.9174,  0.0601,
         0.9643,  0.9908,  0.7596,  0.0062,  0.5373,  0.7897,  0.1368,
         0.0003,  0.2601,  0.9334,  0.1989,  0.9927,  0.3433,  0.7520,
         0.7417,  0.9783,  0.8825,  0.0834,  0.0325,  0.9658,  0.1213,
         0.9739,  0.9697,  0.9823,  0.8334,  0.3043,  0.0962,  0.2599,
         0.9643,  0.9911,  0.9304,  0.0077,  0.8805,  0.9852,  0.0008,
         0.1074,  0.9209,  0.9356,  0.0141,  0.8326,  0.9740,  0.8590,
         0.9194,  0.8730,  0.1104,  0.9879,  0.0385,  0.9191,  0.0735,
         0.4271,  0.9064,  0.5040,  0.0140,  0.6704,  0.9246,  0.1066,
         0.9401,  0.9984,  0.0056,  0.1807,  0.2237,  0.1855,  0.0246,
         0.0156,  0.1153,  0.9028,  0.9652,  0.2735,  0.2481,  0.1992,
         0.3690,  0.9870,  0.1891,  0.9461,  0.8281,  0.6182,  0.0403,
         0.6893,  0.8469,  0.9259,  0.8190,  0.9970,  0.0320,  0.1637,
         0.1484,  0.9544,  0.9195,  0.3258,  0.1005,  0.1101,  0.0022,
         0.3426,  0.0854,  0.3936,  0.2313,  0.9801,  0.4542,  0.7784,
         0.0352,  0.0930,  0.1354,  0.0041,  0.7179,  0.3190,  0.9062,
         0.6182,  0.5448,  0.9498,  0.0842,  0.9977,  0.8674,  0.9914,
         0.0614,  0.0294,  0.9559,  0.7769,  0.9144,  0.9023,  0.0489,
         0.9753,  0.6711,  0.9925,  0.0696,  0.0530,  0.9937,  0.9566,
         0.9981,  0.0223,  0.0218,  0.6403,  0.4400,  0.1160,  0.9341,
         0.0251,  0.1931,  0.1577,  0.8840,  0.9461,  0.7466,  0.9742,
         0.8466,  0.0373,  0.0397,  0.9498,  0.9404,  0.0431,  0.7808,
         0.3110,  0.9991,  0.9611,  0.5294,  0.0487,  0.4345,  0.5770,
         0.9476,  0.4678,  0.7904,  0.8316,  0.9692,  0.0610,  0.9873,
         0.9876,  0.9434,  0.0044,  0.9686,  0.3372,  0.6278,  0.9373,
         0.9840,  0.9896,  0.6311,  0.9870,  0.1570,  0.9945,  0.9822,
         0.1814,  0.0334,  0.0737,  0.0994,  0.9540,  0.0044,  0.0060,
         0.9198], device='cuda:0')
tensor(0.3239, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0069,  0.0134,  0.0648,  0.0756,  0.8914,  0.9783,  0.8212,
         0.9845,  0.9323,  0.1669,  0.0637,  0.2659,  0.8601,  0.0020,
         0.9507,  0.6236,  0.0308,  0.9432,  0.6110,  0.9404,  0.0232,
         0.1703,  0.9648,  0.0456,  0.9971,  0.9703,  0.1693,  0.8922,
         0.1659,  0.9230,  0.2427,  0.1272,  0.3448,  0.0376,  0.7300,
         0.9984,  0.9343,  0.7179,  0.0142,  0.9591,  0.9346,  0.0554,
         0.9510,  0.8943,  0.5289,  0.1238,  0.9730,  0.9976,  0.9024,
         0.0166,  0.0069,  0.0086,  0.5082,  0.9102,  0.9625,  0.0296,
         0.8167,  0.9343,  0.0014,  0.8842,  0.0207,  0.9290,  0.9338,
         0.0354,  0.0323,  0.6316,  0.9690,  0.0688,  0.9674,  0.0273,
         0.8126,  0.0027,  0.5675,  0.9944,  0.9796,  0.1049,  0.9331,
         0.9435,  0.7501,  0.8863,  0.9825,  0.9180,  0.9763,  0.8413,
         0.9477,  0.9940,  0.0231,  0.5893,  0.9453,  0.0163,  0.0391,
         0.3648,  0.9614,  0.8384,  0.2151,  0.1109,  0.1313,  0.9492,
         0.9536,  0.1637,  0.0060,  0.0158,  0.4555,  0.1198,  0.0610,
         0.9259,  0.9756,  0.8869,  0.3920,  0.9501,  0.9710,  0.2207,
         0.8359,  0.1023,  0.9463,  0.3500,  0.9329,  0.9635,  0.2591,
         0.3034,  0.9707,  0.7767,  0.9761,  0.9322,  0.0181,  0.7901,
         0.9294,  0.9592,  0.0011,  0.2095,  0.6991,  0.9441,  0.3740,
         0.2018,  0.9750,  0.9937,  0.1490,  0.5868,  0.9791,  0.7964,
         0.0992,  0.2039,  0.6642,  0.7289,  0.9515,  0.1425,  0.0226,
         0.0656,  0.9006,  0.3760,  0.6930,  0.0406,  0.7838,  0.9692,
         0.0078,  0.9932,  0.0017,  0.1653,  0.9989,  0.8999,  0.8704,
         0.2947,  0.9264,  0.9915,  0.9114,  0.8261,  0.0057,  0.0138,
         0.9344,  0.8196,  0.8802,  0.4288,  0.9656,  0.1304,  0.2121,
         0.9422,  0.9887,  0.1630,  0.9587,  0.7369,  0.5819,  0.9872,
         0.9677,  0.9318,  0.0686,  0.1348,  0.2191,  0.9855,  0.9671,
         0.8308,  0.0336,  0.8753,  0.1305,  0.4633,  0.9769,  0.5440,
         0.1292,  0.7530,  0.9351,  0.9982,  0.0847,  0.9938,  0.0094,
         0.1203,  0.7859,  0.8480,  0.9841,  0.0886,  0.1612,  0.0352,
         0.9767,  0.9729,  0.9788,  0.9747,  0.9227,  0.9767,  0.9635,
         0.9155,  0.6752,  0.0093,  0.9448,  0.8923,  0.9779,  0.0573,
         0.9693,  0.9285,  0.9857,  0.9802,  0.9354,  0.9992,  0.9985,
         0.9374,  0.0100,  0.9842,  0.3958,  0.9637,  0.9844,  0.0022,
         0.9708,  0.0788,  0.9982,  0.1380,  0.8692,  0.3711,  0.8894,
         0.8913,  0.0300,  0.8795,  0.6013,  0.0061,  0.6328,  0.0535,
         0.0488,  0.9721,  0.4136,  0.3668,  0.9719,  0.8937,  0.3757,
         0.9764,  0.0102,  0.9454,  0.9483,  0.8947,  0.9631,  0.9662,
         0.9604,  0.9686,  0.9575,  0.1344,  0.9621,  0.9811,  0.8871,
         0.7934,  0.0567,  0.9125,  0.1182,  0.0868,  0.0325,  0.8460,
         0.2017,  0.9587,  0.8990,  0.1604,  0.0189,  0.9566,  0.0844,
         0.0032,  0.0387,  0.2906,  0.9913,  0.0232,  0.4435,  0.9874,
         0.9162,  0.7723,  0.9475,  0.9776,  0.0690,  0.0153,  0.9754,
         0.0349,  0.8562,  0.9109,  0.8494,  0.9932,  0.4634,  0.0038,
         0.9780,  0.0412,  0.9639,  0.9525,  0.9644,  0.1337,  0.9282,
         0.9893,  0.9191,  0.0182,  0.9282,  0.5090,  0.0019,  0.8946,
         0.9994,  0.7535,  0.9594,  0.6866,  0.9808,  0.9928,  0.9792,
         0.0310,  0.0562,  0.9859,  0.7947,  0.9771,  0.9868,  0.3886,
         0.9949,  0.9350,  0.1621,  0.0459,  0.0862,  0.8359,  0.5793,
         0.9070,  0.7347,  0.3844,  0.8540,  0.9390,  0.9517,  0.8482,
         0.9491,  0.9191,  0.0310,  0.6654,  0.9712,  0.7379,  0.3008,
         0.3904,  0.1396,  0.0898,  0.8797,  0.7917,  0.9873,  0.8773,
         0.6096,  0.8693,  0.9765,  0.8924,  0.6276,  0.9461,  0.9814,
         0.9721,  0.0132,  0.9331,  0.3844,  0.3158,  0.5493,  0.7072,
         0.1119,  0.9056,  0.0055,  0.8472,  0.9859,  0.1348,  0.2111,
         0.9864,  0.1054,  0.9979,  0.1138,  0.0027,  0.9757,  0.2840,
         0.1188,  0.0358,  0.2952,  0.5601,  0.0093,  0.9876,  0.7278,
         0.0145,  0.9534,  0.1313,  0.0527,  0.0144,  0.2076,  0.2052,
         0.0128,  0.9771,  0.0315,  0.8179,  0.9737,  0.8214,  0.9704,
         0.0236,  0.9900,  0.6366,  0.2968,  0.9852,  0.3167,  0.0059,
         0.0674,  0.3871,  0.8550,  0.9893,  0.2773,  0.9722,  0.0107,
         0.9375,  0.9438,  0.9037,  0.1825,  0.9417,  0.9532,  0.0216,
         0.9635,  0.8697,  0.8788,  0.8763,  0.9747,  0.6843,  0.9567,
         0.0596,  0.6245,  0.1633,  0.7846,  0.9656,  0.2954,  0.9520,
         0.9741,  0.9516,  0.3382,  0.0101,  0.0895,  0.8995,  0.9960,
         0.9379,  0.9553,  0.7685,  0.0614,  0.7298,  0.4643,  0.9964,
         0.8918,  0.8726,  0.8950,  0.9548,  0.0902,  0.4637,  0.9449,
         0.0556,  0.7812,  0.0040,  0.9410,  0.9742,  0.6057,  0.8691,
         0.9800,  0.6361,  0.3247,  0.3002,  0.9606,  0.9286,  0.1495,
         0.9576,  0.0126,  0.6670,  0.3440,  0.2717,  0.5847,  0.1059,
         0.9785,  0.0222,  0.9694,  0.6297,  0.0454,  0.3475,  0.1941,
         0.0210,  0.9135,  0.0425,  0.0446,  0.5157,  0.1380,  0.2391,
         0.9168,  0.8214,  0.5584,  0.2677,  0.9541,  0.9920,  0.0184,
         0.7548], device='cuda:0')
tensor(0.3371, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0104,  0.9778,  0.9229,  0.4156,  0.0307,  0.0069,  0.0275,
         0.9632,  0.6990,  0.0111,  0.3948,  0.8346,  0.6109,  0.9348,
         0.1652,  0.0968,  0.0509,  0.0106,  0.1368,  0.0448,  0.7903,
         0.0134,  0.9982,  0.9784,  0.0262,  0.0583,  0.0388,  0.0944,
         0.9829,  0.0667,  0.2085,  0.0055,  0.0770,  0.0009,  0.2933,
         0.9578,  0.0103,  0.9531,  0.9197,  0.9833,  0.8154,  0.0552,
         0.8021,  0.0957,  0.9567,  0.6360,  0.1617,  0.7540,  0.8790,
         0.8550,  0.5111,  0.0505,  0.7793,  0.9027,  0.2118,  0.9761,
         0.8664,  0.6238,  0.9658,  0.0786,  0.1393,  0.1974,  0.4646,
         0.9403,  0.9307,  0.9221,  0.9971,  0.0200,  0.0113,  0.9894,
         0.0213,  0.0194,  0.8679,  0.0108,  0.0654,  0.6587,  0.9550,
         0.4817,  0.9736,  0.0019,  0.0035,  0.8670,  0.9614,  0.9174,
         0.9897,  0.4449,  0.9754,  0.9467,  0.1613,  0.9638,  0.5057,
         0.9546,  0.9122,  0.1886,  0.3054,  0.0899,  0.7873,  0.9611,
         0.2389,  0.9486,  0.2145,  0.2263,  0.2067,  0.7715,  0.1279,
         0.9699,  0.9854,  0.5376,  0.0431,  0.9566,  0.0040,  0.8476,
         0.2691,  0.9789,  0.0103,  0.9343,  0.9921,  0.5794,  0.0783,
         0.8565,  0.0124,  0.8945,  0.8490,  0.9994,  0.9957,  0.9417,
         0.8983,  0.0179,  0.0811,  0.9755,  0.9982,  0.9875,  0.1819,
         0.5958,  0.1100,  0.0428,  0.9536,  0.1566,  0.0300,  0.6411,
         0.0596,  0.8715,  0.3112,  0.0863,  0.9503,  0.3303,  0.5134,
         0.0910,  0.7076,  0.0034,  0.0129,  0.9884,  0.9362,  0.0195,
         0.9636,  0.9804,  0.1881,  0.3336,  0.0073,  0.0254,  0.0415,
         0.0573,  0.9579,  0.1516,  0.0046,  0.9637,  0.0454,  0.1006,
         0.0034,  0.0332,  0.0748,  0.9502,  0.8151,  0.3903,  0.4754,
         0.4565,  0.9312,  0.5082,  0.9432,  0.9524,  0.0089,  0.0137,
         0.5384,  0.0034,  0.8342,  0.9935,  0.3468,  0.0914,  0.8761,
         0.9863,  0.3867,  0.0028,  0.9450,  0.9312,  0.0146,  0.1130,
         0.8499,  0.8975,  0.8017,  0.5445,  0.9903,  0.7903,  0.9360,
         0.9704,  0.4720,  0.7842,  0.9995,  0.9091,  0.9712,  0.8739,
         0.9731,  0.9051,  0.0193,  0.9820,  0.0722,  0.9654,  0.5173,
         0.0725,  0.0665,  0.9965,  0.9994,  0.1179,  0.9870,  0.0263,
         0.9399,  0.9235,  0.9377,  0.7306,  0.9360,  0.0492,  0.9664,
         0.0067,  0.1568,  0.9509,  0.1208,  0.2435,  0.0025,  0.2974,
         0.9998,  0.9432,  0.3005,  0.9565,  0.8840,  0.5967,  0.5766,
         0.7222,  0.9415,  0.8627,  0.8679,  0.1063,  0.1572,  0.0893,
         0.8932,  0.0471,  0.0632,  0.9336,  0.4777,  0.9452,  0.7399,
         0.9580,  0.0580,  0.9444,  0.9762,  0.9806,  0.3027,  0.9724,
         0.9775,  0.9867,  0.0155,  0.9200,  0.0613,  0.9595,  0.9982,
         0.9670,  0.9939,  0.1736,  0.9293,  0.8974,  0.0181,  0.0311,
         0.2904,  0.0283,  0.0023,  0.8984,  0.4451,  0.9719,  0.0209,
         0.1639,  0.9881,  0.3390,  0.9320,  0.1478,  0.0625,  0.9102,
         0.9383,  0.0082,  0.1677,  0.0701,  0.0063,  0.1266,  0.0102,
         0.0143,  0.0269,  0.7667,  0.9408,  0.9148,  0.8754,  0.9177,
         0.8560,  0.8666,  0.9974,  0.2373,  0.5770,  0.9651,  0.7816,
         0.0490,  0.0030,  0.4162,  0.4995,  0.0782,  0.9743,  0.9142,
         0.9487,  0.4661,  0.9029,  0.9186,  0.9705,  0.0009,  0.5822,
         0.9262,  0.9998,  0.9457,  0.8868,  0.9688,  0.9465,  0.8490,
         0.9319,  0.8116,  0.8104,  0.0707,  0.1574,  0.0008,  0.0215,
         0.9714,  0.0988,  0.0030,  0.9727,  0.9913,  0.2749,  0.1357,
         0.3290,  0.0334,  0.0974,  0.9463,  0.9570,  0.8634,  0.8947,
         0.9306,  0.9722,  0.9886,  0.2331,  0.7677,  0.0622,  0.8749,
         0.0171,  0.1086,  0.9628,  0.7031,  0.8872,  0.3012,  0.9774,
         0.6730,  0.0137,  0.9319,  0.0932,  0.9902,  0.7182,  0.6372,
         0.0747,  0.9740,  0.5913,  0.9331,  0.8393,  0.4743,  0.9667,
         0.9729,  0.8906,  0.1722,  0.0098,  0.0250,  0.7060,  0.2622,
         0.9899,  0.0709,  0.0480,  0.8681,  0.9304,  0.4239,  0.9387,
         0.0850,  0.0070,  0.0906,  0.9452,  0.0568,  0.1533,  0.0167,
         0.9489,  0.9409,  0.0206,  0.9968,  0.0385,  0.9660,  0.0577,
         0.6527,  0.0195,  0.0241,  0.0435,  0.0048,  0.6063,  0.5186,
         0.0655,  0.1758,  0.9241,  0.9949], device='cuda:0')
tensor(0.2966, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 9, BCELoss: 0.3070929877612056
tensor([ 0.4827,  0.9916,  0.0942,  0.9601,  0.9209,  0.0707,  0.0087,
         0.9981,  0.5071,  0.8715,  0.0247,  0.7895,  0.4686,  0.1782,
         0.0103,  0.8954,  0.0566,  0.1334,  0.0338,  0.0128,  0.1636,
         0.9652,  0.0723,  0.9616,  0.0423,  0.3660,  0.9260,  0.9977,
         0.8802,  0.7685,  0.9741,  0.9919,  0.8773,  0.3994,  0.0377,
         0.0189,  0.9117,  0.9167,  0.0305,  0.0030,  0.3563,  0.8280,
         0.0004,  0.0017,  0.8790,  0.1386,  0.7315,  0.8627,  0.9154,
         0.0310,  0.0333,  0.0354,  0.8728,  0.9407,  0.0588,  0.1763,
         0.9951,  0.8537,  0.8398,  0.9863,  0.3735,  0.8276,  0.9513,
         0.0089,  0.5584,  0.1910,  0.9750,  0.7104,  0.9737,  0.5910,
         0.0337,  0.8755,  0.0209,  0.0064,  0.9996,  0.9968,  0.0338,
         0.0868,  0.0099,  0.0302,  0.1713,  0.9666,  0.9186,  0.0203,
         0.1096,  0.6423,  0.0082,  0.9397,  0.9633,  0.0338,  0.0814,
         0.0662,  0.3567,  0.0193,  0.8688,  0.9181,  0.9694,  0.9823,
         0.0355,  0.0142,  0.4254,  0.0153,  0.0984,  0.9865,  0.8549,
         0.9718,  0.1372,  0.0380,  0.0482,  0.0582,  0.9391,  0.6818,
         0.8670,  0.7924,  0.9561,  0.0327,  0.0201,  0.9984,  0.9263,
         0.8747,  0.7370,  0.9953,  0.3340,  0.0290,  0.0014,  0.2480,
         0.7011,  0.0215,  0.6473,  0.4960,  0.9114,  0.1807,  0.9271,
         0.0235,  0.0025,  0.9917,  0.0833,  0.2255,  0.9425,  0.4763,
         0.0284,  0.1017,  0.9143,  0.5866,  0.7886,  0.5001,  0.0157,
         0.8173,  0.0063,  0.0053,  0.8591,  0.0859,  0.3424,  0.2906,
         0.0365,  0.0273,  0.9880,  0.2159,  0.1144,  0.8836,  0.9925,
         0.9841,  0.6388,  0.6676,  0.8966,  0.0830,  0.2190,  0.9334,
         0.9465,  0.1013,  0.7575,  0.7352,  0.8700,  0.9408,  0.0083,
         0.7925,  0.6561,  0.9440,  0.7726,  0.0200,  0.0485,  0.4811,
         0.9971,  0.9922,  0.9725,  0.0101,  0.9832,  0.9985,  0.1414,
         0.0175,  0.6319,  0.4218,  0.3362,  0.9827,  0.0436,  0.5506,
         0.7301,  0.8347,  0.0125,  0.7850,  0.1515,  0.0277,  0.6679,
         0.9236,  0.0529,  0.9169,  0.7406,  0.0618,  0.9301,  0.9580,
         0.3661,  0.3335,  0.0039,  0.0728,  0.1735,  0.2591,  0.9995,
         0.0437,  0.7741,  0.3437,  0.0210,  0.9852,  0.9846,  0.6430,
         0.0016,  0.9758,  0.0455,  0.8824,  0.8633,  0.9224,  0.9978,
         0.9292,  0.7140,  0.8901,  0.0055,  0.1439,  0.9665,  0.5012,
         0.9216,  0.0320,  0.0859,  0.8604,  0.7544,  0.0255,  0.8745,
         0.9556,  0.0228,  0.0055,  0.9206,  0.9911,  0.1215,  0.9946,
         0.0298,  0.0471,  0.5421,  0.0092,  0.9003,  0.7926,  0.9095,
         0.9258,  0.0043,  0.9901,  0.9691,  0.9644,  0.3400,  0.0358,
         0.9912,  0.0225,  0.2285,  0.1269,  0.0651,  0.0482,  0.0112,
         0.1231,  0.9637,  0.9552,  0.3243,  0.3800,  0.4534,  0.9114,
         0.8803,  0.0315,  0.9504,  0.7637,  0.0848,  0.0100,  0.4980,
         0.1009,  0.1191,  0.9327,  0.1507,  0.1459,  0.9001,  0.0803,
         0.9692,  0.0123,  0.9990,  0.8934,  0.8745,  0.2049,  0.8098,
         0.7450,  0.8736,  0.9061,  0.8443,  0.9838,  0.0118,  0.0352,
         0.3359,  0.9628,  0.1898,  0.1423,  0.9821,  0.9509,  0.3710,
         0.0022,  0.9733,  0.9155,  0.0169,  0.9988,  0.0055,  0.8627,
         0.9546,  0.7533,  0.1138,  0.6181,  0.4482,  0.1070,  0.0220,
         0.9502,  0.6260,  0.0283,  0.0053,  0.1840,  0.0081,  0.6406,
         0.0227,  0.0161,  0.1074,  0.7759,  0.5663,  0.0347,  0.0991,
         0.0045,  0.9400,  0.9236,  0.9623,  0.0199,  0.9425,  0.3541,
         0.3733,  0.8141,  0.5458,  0.8358,  0.0182,  0.6203,  0.7870,
         0.9521,  0.0483,  0.8817,  0.6446,  0.8239,  0.0037,  0.0192,
         0.0006,  0.0503,  0.9977,  0.4703,  0.3872,  0.1553,  0.0124,
         0.1164,  0.0099,  0.4810,  0.0534,  0.0396,  0.1060,  0.8790,
         0.8570,  0.9701,  0.1682,  0.0739,  0.3050,  0.8187,  0.9972,
         0.0277,  0.3922,  0.9992,  0.1157,  0.8525,  0.8822,  0.7691,
         0.0334,  0.1093,  0.9232,  0.1040,  0.0858,  0.0037,  0.9442,
         0.3990,  0.9447,  0.0271,  0.9048,  0.2610,  0.0054,  0.9889,
         0.0619,  0.0252,  0.0752,  0.9422,  0.0197,  0.9859,  0.0203,
         0.7794,  0.6420,  0.6758,  0.9755,  0.0086,  0.0444,  0.2431,
         0.9715,  0.9733,  0.9240,  0.4820,  0.9928,  0.0849,  0.2340,
         0.0177,  0.9296,  0.1319,  0.9234,  0.0645,  0.2204,  0.0043,
         0.7818,  0.2636,  0.9533,  0.6812,  0.0816,  0.9048,  0.9672,
         0.1120,  0.9952,  0.9593,  0.7179,  0.1058,  0.9402,  0.0233,
         0.0371,  0.9180,  0.9119,  0.7597,  0.8932,  0.2947,  0.0188,
         0.4755,  0.9354,  0.9993,  0.9431,  0.0578,  0.7930,  0.8196,
         0.9545,  0.3451,  0.1067,  0.0157,  0.0765,  0.3273,  0.2909,
         0.7405,  0.7251,  0.0446,  0.0284,  0.0113,  0.0762,  0.1881,
         0.5874,  0.0546,  0.9555,  0.9870,  0.1803,  0.9000,  0.0146,
         0.0545,  0.9438,  0.0330,  0.9720,  0.7238,  0.0640,  0.1477,
         0.8889,  0.8980,  0.9078,  0.9188,  0.9194,  0.1701,  0.0165,
         0.0176,  0.4645,  0.0396,  0.3713,  0.0333,  0.4619,  0.0217,
         0.8889,  0.7695,  0.9253,  0.7656,  0.9606,  0.9766,  0.9506,
         0.0085], device='cuda:0')
tensor(0.2996, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0120,  0.0209,  0.0543,  0.6835,  0.0217,  0.8118,  0.9651,
         0.9452,  0.9912,  0.0060,  0.0653,  0.8364,  0.7826,  0.8385,
         0.7184,  0.0421,  0.4647,  0.5913,  0.0442,  0.0101,  0.2304,
         0.8606,  0.9142,  0.1832,  0.0154,  0.0903,  0.3572,  0.8597,
         0.4885,  0.6218,  0.8678,  0.0289,  0.9649,  0.8354,  0.0311,
         0.2069,  0.9700,  0.0014,  0.2788,  0.1871,  0.3999,  0.0152,
         0.0480,  0.3398,  0.0341,  0.0447,  0.1611,  0.0310,  0.9251,
         0.0211,  0.0287,  0.5838,  0.8510,  0.9739,  0.9203,  0.0497,
         0.1569,  0.0172,  0.7095,  0.9888,  0.0454,  0.9208,  0.9732,
         0.3880,  0.0079,  0.8038,  0.0169,  0.9950,  0.7758,  0.0085,
         0.0113,  0.7170,  0.0183,  0.9696,  0.3094,  0.0005,  0.4917,
         0.0122,  0.0517,  0.9789,  0.9085,  0.0213,  0.0371,  0.0045,
         0.4529,  0.0145,  0.0324,  0.1051,  0.9679,  0.9034,  0.0061,
         0.1176,  0.0695,  0.0654,  0.0130,  0.9662,  0.0054,  0.0980,
         0.6551,  0.0507,  0.9577,  0.3001,  0.0184,  0.9923,  0.0139,
         0.0118,  0.0224,  0.9215,  0.0363,  0.9067,  0.0105,  0.0505,
         0.1037,  0.9785,  0.5208,  0.9571,  0.8948,  0.7711,  0.6447,
         0.0817,  0.8114,  0.0034,  0.5443,  0.0581,  0.7337,  0.0816,
         0.8534,  0.0973,  0.3094,  0.0425,  0.0030,  0.6747,  0.9137,
         0.9830,  0.8779,  0.9207,  0.0104,  0.0216,  0.0607,  0.9808,
         0.0085,  0.0374,  0.1126,  0.0436,  0.6385,  0.0211,  0.0381,
         0.9698,  0.0004,  0.0521,  0.9537,  0.0298,  0.0286,  0.0654,
         0.0145,  0.9086,  0.6466,  0.0347,  0.8124,  0.8854,  0.1004,
         0.9564,  0.0381,  0.9034,  0.9337,  0.9744,  0.2547,  0.0255,
         0.4888,  0.9405,  0.8879,  0.0816,  0.0085,  0.0093,  0.6382,
         0.5869,  0.0024,  0.0170,  0.7961,  0.4913,  0.1202,  0.0192,
         0.1418,  0.8413,  0.0085,  0.6893,  0.1011,  0.8655,  0.1573,
         0.0286,  0.0010,  0.8955,  0.4362,  0.0008,  0.0311,  0.1188,
         0.8970,  0.9544,  0.0014,  0.0156,  0.0152,  0.2769,  0.1828,
         0.8555,  0.0141,  0.6199,  0.8690,  0.9655,  0.0024,  0.2788,
         0.9434,  0.8861,  0.9325,  0.0059,  0.2216,  0.9376,  0.0134,
         0.0105,  0.4680,  0.0124,  0.0066,  0.0219,  0.0532,  0.1264,
         0.0708,  0.9305,  0.0882,  0.8075,  0.4266,  0.0690,  0.0304,
         0.6293,  0.6105,  0.0287,  0.9760,  0.7877,  0.9987,  0.1811,
         0.9319,  0.0143,  0.0082,  0.9623,  0.0209,  0.7297,  0.0972,
         0.5296,  0.6080,  0.0037,  0.9699,  0.9424,  0.8831,  0.0747,
         0.0513,  0.0071,  0.1985,  0.9734,  0.9679,  0.9829,  0.0517,
         0.6668,  0.1020,  0.0113,  0.9355,  0.1103,  0.9883,  0.1067,
         0.3116,  0.3960,  0.7619,  0.7418,  0.0595,  0.8518,  0.3326,
         0.0686,  0.9240,  0.9483,  0.0744,  0.0255,  0.9337,  0.9418,
         0.9972,  0.0195,  0.0098,  0.0797,  0.1447,  0.0934,  0.0034,
         0.9401,  0.0045,  0.5442,  0.6366,  0.0192,  0.6598,  0.0247,
         0.0144,  0.0098,  0.0833,  0.9175,  0.0884,  0.6621,  0.0315,
         0.6545,  0.0040,  0.9959,  0.0045,  0.0397,  0.9572,  0.9714,
         0.0185,  0.0218,  0.8367,  0.7426,  0.4045,  0.0010,  0.6344,
         0.9446,  0.0075,  0.3167,  0.3633,  0.0675,  0.0105,  0.8976,
         0.0537,  0.1519,  0.0398,  0.0877,  0.9131,  0.2639,  0.9249,
         0.4706,  0.0292,  0.9973,  0.0049,  0.0019,  0.9024,  0.5416,
         0.9114,  0.0995,  0.9987,  0.0705,  0.5417,  0.0309,  0.8495,
         0.8589,  0.5771,  0.0125,  0.0146,  0.9787,  0.0121,  0.8822,
         0.0609,  0.9995,  0.3481,  0.0301,  0.0228,  0.0101,  0.9090,
         0.2114,  0.8631,  0.1224,  0.0071,  0.0002,  0.8097,  0.2052,
         0.0714,  0.0945,  0.0354,  0.1157,  0.0762,  0.7246,  0.9257,
         0.9937,  0.0637,  0.8882,  0.6013,  0.0808,  0.0103,  0.0312,
         0.8133,  0.9977,  0.0254,  0.8994,  0.9986,  0.9946,  0.0002,
         0.8234,  0.6124,  0.9171,  0.9361,  0.0289,  0.0169,  0.9981,
         0.8871,  0.0103,  0.0719,  0.6985,  0.3065,  0.5141,  0.0644,
         0.1110,  0.5493,  0.0499,  0.0232,  0.7093,  0.0887,  0.3650,
         0.6004,  0.6605,  0.0074,  0.9307,  0.0077,  0.3054,  0.0090,
         0.0124,  0.8640,  0.8827,  0.1858,  0.0243,  0.9839,  0.1688,
         0.9690,  0.0060,  0.0307,  0.7114,  0.0852,  0.9692,  0.9955,
         0.7850,  0.7793,  0.9933,  0.0922,  0.6477,  0.9287,  0.0068,
         0.9046,  0.0642,  0.0461,  0.0343,  0.8562,  0.2388,  0.9158,
         0.0653,  0.9548,  0.9391,  0.5168,  0.0861,  0.0397,  0.0177,
         0.0308,  0.3655,  0.9797,  0.9322,  0.9814,  0.8646,  0.7525,
         0.9403,  0.8740,  0.7481,  0.0903,  0.9827,  0.0101,  0.7998,
         0.9886,  0.1754,  0.0666,  0.0285,  0.0336,  0.2559,  0.3967,
         0.1367,  0.2950,  0.5388,  0.9134,  0.0331,  0.9947,  0.0063,
         0.2360,  0.8089,  0.8595,  0.0040,  0.1468,  0.9901,  0.1099,
         0.0032,  0.0104,  0.0007,  0.8628,  0.0949,  0.1623,  0.0247,
         0.0190,  0.1449,  0.0350,  0.0508,  0.9552,  0.0069,  0.9537,
         0.9779,  0.0334,  0.3298,  0.8738,  0.7652,  0.8827,  0.9887,
         0.5436,  0.9501,  0.0176,  0.9206,  0.5107,  0.1527,  0.8482,
         0.0033], device='cuda:0')
tensor(0.3095, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7595,  0.0897,  0.0503,  0.6354,  0.9703,  0.0293,  0.1061,
         0.4490,  0.0271,  0.2419,  0.9873,  0.9909,  0.8562,  0.9869,
         0.0248,  0.9682,  0.0927,  0.5833,  0.9495,  0.0895,  0.0153,
         0.3192,  0.8963,  0.9829,  0.1779,  0.3793,  0.0209,  0.8483,
         0.0018,  0.1290,  0.0278,  0.7881,  0.0060,  0.0147,  0.9994,
         0.8461,  0.0070,  0.4813,  0.1835,  0.5278,  0.0334,  0.3903,
         0.1435,  0.2888,  0.7357,  0.9917,  0.5604,  0.1864,  0.2571,
         0.9578,  0.7039,  0.5206,  0.0600,  0.0395,  0.0164,  0.9326,
         0.5695,  0.0724,  0.0114,  0.7776,  0.5805,  0.9095,  0.0628,
         0.0727,  0.1395,  0.8154,  0.8930,  0.0009,  0.9370,  0.0042,
         0.8989,  0.9050,  0.1152,  0.0638,  0.9753,  0.9856,  0.0613,
         0.0398,  0.5750,  0.0347,  0.9816,  0.0195,  0.7176,  0.8970,
         0.9408,  0.0629,  0.0214,  0.0370,  0.0962,  0.9801,  0.7930,
         0.9629,  0.0029,  0.0805,  0.6468,  0.5507,  0.0469,  0.6732,
         0.9688,  0.6851,  0.6949,  0.9851,  0.0020,  0.0050,  0.0060,
         0.8336,  0.9613,  0.4914,  0.9677,  0.5398,  0.0270,  0.0879,
         0.7142,  0.9487,  0.0148,  0.9830,  0.8243,  0.1501,  0.0544,
         0.0407,  0.8593,  0.3631,  0.4502,  0.9735,  0.7950,  0.9442,
         0.9413,  0.0941,  0.0470,  0.0251,  0.9675,  0.0212,  0.7379,
         0.1552,  0.8283,  0.8316,  0.0435,  0.0104,  0.9141,  0.1344,
         0.7845,  0.9477,  0.9489,  0.9084,  0.4596,  0.1011,  0.0281,
         0.5230,  0.0018,  0.0004,  0.9224,  0.0398,  0.0245,  0.3601,
         0.0146,  0.3892,  0.0044,  0.2222,  0.0607,  0.0182,  0.7996,
         0.0354,  0.0296,  0.7683,  0.4301,  0.4848,  0.8325,  0.5932,
         0.9819,  0.0022,  0.9380,  0.8016,  0.2075,  0.8965,  0.0585,
         0.2254,  0.0232,  0.9197,  0.0511,  0.9727,  0.9009,  0.8077,
         0.9098,  0.7827,  0.9993,  0.0585,  0.3684,  0.0260,  0.2479,
         0.9263,  0.9335,  0.0790,  0.8210,  0.0046,  0.9637,  0.9168,
         0.0712,  0.9329,  0.0205,  0.0114,  0.9702,  0.1094,  0.0069,
         0.0022,  0.6560,  0.0272,  0.7580,  0.0254,  0.1909,  0.0112,
         0.0092,  0.0398,  0.0148,  0.7549,  0.1602,  0.0291,  0.8386,
         0.3839,  0.0887,  0.0908,  0.2790,  0.9807,  0.0012,  0.8024,
         0.6803,  0.8130,  0.9491,  0.9316,  0.2548,  0.0401,  0.9995,
         0.9379,  0.9790,  0.1208,  0.0027,  0.8323,  0.1447,  0.0041,
         0.0618,  0.0091,  0.8722,  0.0019,  0.4201,  0.8083,  0.0169,
         0.9058,  0.8141,  0.0113,  0.5727,  0.8588,  0.9502,  0.0286,
         0.8148,  0.0148,  0.0562,  0.0914,  0.9686,  0.2005,  0.0074,
         0.5777,  0.0043,  0.7550,  0.9135,  0.9071,  0.9719,  0.7533,
         0.0153,  0.0682,  0.0204,  0.3143,  0.9631,  0.0250,  0.9715,
         0.9470,  0.2080,  0.0017,  0.8585,  0.2784,  0.1067,  0.0593,
         0.0494,  0.0020,  0.0053,  0.8017,  0.9659,  0.9738,  0.0979,
         0.1153,  0.0146,  0.0133,  0.0610,  0.8166,  0.6389,  0.0339,
         0.9612,  0.0617,  0.7187,  0.8289,  0.7879,  0.9507,  0.1142,
         0.0207,  0.7121,  0.9386,  0.5576,  0.9339,  0.4441,  0.9071,
         0.7712,  0.6141,  0.5195,  0.0219,  0.0883,  0.0245,  0.0328,
         0.2255,  0.9696,  0.0738,  0.0398,  0.0229,  0.0588,  0.7204,
         0.2390,  0.1027,  0.5658,  0.9638,  0.0488,  0.0094,  0.9707,
         0.0420,  0.9409,  0.7966,  0.8510,  0.0673,  0.9530,  0.6403,
         0.1012,  0.1272,  0.0235,  0.3228,  0.9140,  0.0181,  0.0244,
         0.1111,  0.9024,  0.0723,  0.1963,  0.0147,  0.0827,  0.0808,
         0.5020,  0.9305,  0.9649,  0.0222,  0.2361,  0.8720,  0.0745,
         0.0615,  0.1067,  0.0026,  0.9328,  0.0767,  0.0364,  0.9640,
         0.9574,  0.9957,  0.0436,  0.0378,  0.0953,  0.6816,  0.0883,
         0.7090,  0.9673,  0.0049,  0.8542,  0.0732,  0.0313,  0.8911,
         0.1193,  0.0230,  0.0149,  0.2946,  0.0286,  0.0656,  0.9806,
         0.9575,  0.9806,  0.0293,  0.9209,  0.4914,  0.1446,  0.9631,
         0.5212,  0.3234,  0.9684,  0.0210,  0.0194,  0.9496,  0.0434,
         0.9634,  0.0010,  0.0062,  0.6993,  0.0043,  0.8394,  0.4884,
         0.0114,  0.9679,  0.3145,  0.0166,  0.0056,  0.6262,  0.9421,
         0.8636,  0.0405,  0.7380,  0.9886,  0.2514,  0.6911,  0.0295,
         0.0053,  0.0391,  0.0189,  0.3097,  0.9748,  0.1729,  0.9663,
         0.8608,  0.0598,  0.3549,  0.0227,  0.9769,  0.9363,  0.5710,
         0.9619,  0.1812,  0.1085,  0.1619,  0.3201,  0.0718,  0.7794,
         0.7428,  0.0784,  0.0795,  0.2647,  0.0337,  0.6538,  0.0363,
         0.4296,  0.0091,  0.6808,  0.1543,  0.0205,  0.1648,  0.0088,
         0.9021,  0.4839,  0.0802,  0.0029,  0.1607,  0.0749,  0.0086,
         0.9949,  0.0627,  0.5580,  0.6470,  0.4603,  0.0172,  0.2018,
         0.0121,  0.7709,  0.0291,  0.0987,  0.9735,  0.1773,  0.0023,
         0.0083,  0.9249,  0.9690,  0.0474,  0.9109,  0.9503,  0.3466,
         0.7543,  0.0593,  0.1439,  0.0270,  0.0178,  0.9884,  0.8674,
         0.8907,  0.9658,  0.9700,  0.0364,  0.1000,  0.8151,  0.0128,
         0.0009,  0.0307,  0.6659,  0.7696,  0.0025,  0.0820,  0.5884,
         0.0814,  0.0401,  0.8228,  0.0196,  0.6086,  0.9780,  0.9860,
         0.0330], device='cuda:0')
tensor(0.2911, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0681,  0.0899,  0.0585,  0.9658,  0.0043,  0.0221,  0.9538,
         0.0125,  0.0825,  0.1053,  0.0087,  0.0946,  0.0846,  0.7692,
         0.0274,  0.0275,  0.6466,  0.0095,  0.6891,  0.0295,  0.5586,
         0.0132,  0.0322,  0.6613,  0.9402,  0.9764,  0.9731,  0.8842,
         0.9702,  0.0560,  0.9593,  0.0065,  0.7291,  0.0017,  0.9021,
         0.0314,  0.9375,  0.1037,  0.1013,  0.9424,  0.0283,  0.2911,
         0.8727,  0.0075,  0.0874,  0.0558,  0.1035,  0.7761,  0.0211,
         0.8727,  0.0547,  0.7204,  0.9684,  0.4948,  0.8812,  0.1817,
         0.1739,  0.0834,  0.4249,  0.0226,  0.0194,  0.9671,  0.9603,
         0.9448,  0.0936,  0.9634,  0.1481,  0.9539,  0.0006,  0.3686,
         0.9134,  0.0552,  0.9194,  0.7601,  0.0024,  0.6316,  0.0415,
         0.6378,  0.1985,  0.3647,  0.1062,  0.1116,  0.0124,  0.0769,
         0.0123,  0.4778,  0.9477,  0.9630,  0.0080,  0.6264,  0.5900,
         0.3586,  0.2747,  0.9535,  0.9031,  0.8902,  0.1847,  0.6324,
         0.1569,  0.6093,  0.8618,  0.9984,  0.1015,  0.8443,  0.4839,
         0.0014,  0.1963,  0.9079,  0.8176,  0.0273,  0.0475,  0.0430,
         0.0563,  0.1465,  0.0407,  0.9116,  0.0015,  0.9419,  0.0005,
         0.5751,  0.9981,  0.2446,  0.0315,  0.0351,  0.0572,  0.0301,
         0.0724,  0.9291,  0.8465,  0.0411,  0.1307,  0.9417,  0.8307,
         0.9443,  0.0568,  0.0003,  0.1712,  0.9852,  0.0341,  0.1292,
         0.9594,  0.0794,  0.0373,  0.0189,  0.8438,  0.4239,  0.1037,
         0.9842,  0.7961,  0.1089,  0.0054,  0.5439,  0.0262,  0.0088,
         0.4609,  0.0538,  0.8540,  0.0960,  0.6761,  0.0169,  0.1192,
         0.2277,  0.9933,  0.9382,  0.0234,  0.8719,  0.0094,  0.8604,
         0.0301,  0.9156,  0.8819,  0.5064,  0.4065,  0.3983,  0.0214,
         0.9119,  0.0607,  0.3855,  0.0010,  0.6483,  0.5362,  0.0071,
         0.6668,  0.9293,  0.9529,  0.9356,  0.0878,  0.1730,  0.2663,
         0.9442,  0.8744,  0.2079,  0.9575,  0.0080,  0.0026,  0.0578,
         0.8650,  0.9990,  0.7863,  0.4906,  0.3846,  0.9058,  0.7268,
         0.9802,  0.9759,  0.2544,  0.5642,  0.9333,  0.9573,  0.4020,
         0.4377,  0.9734,  0.0903,  0.9368,  0.8376,  0.8240,  0.9718,
         0.0775,  0.0101,  0.0709,  0.8518,  0.0028,  0.5708,  0.0229,
         0.4937,  0.0933,  0.0921,  0.8941,  0.0083,  0.1519,  0.0335,
         0.9695,  0.0068,  0.0403,  0.9752,  0.1250,  0.0056,  0.5564,
         0.0556,  0.0769,  0.0165,  0.3985,  0.9668,  0.8756,  0.0676,
         0.8120,  0.0349,  0.2143,  0.0021,  0.8864,  0.3515,  0.3185,
         0.9635,  0.8021,  0.9164,  0.0016,  0.3514,  0.9734,  0.4653,
         0.9385,  0.7574,  0.0029,  0.8361,  0.0061,  0.9082,  0.9022,
         0.0115,  0.3376,  0.0216,  0.0349,  0.5666,  0.9658,  0.7320,
         0.1369,  0.7717,  0.9860,  0.4459,  0.9413,  0.9792,  0.1028,
         0.0690,  0.9417,  0.0324,  0.8262,  0.4114,  0.9091,  0.6799,
         0.0362,  0.0299,  0.9805,  0.1293,  0.9770,  0.1285,  0.0139,
         0.1460,  0.9815,  0.4593,  0.9113,  0.0294,  0.9345,  0.0232,
         0.1101,  0.1347,  0.9810,  0.9764,  0.0290,  0.9717,  0.8096,
         0.0780,  0.9888,  0.9470,  0.8651,  0.0288,  0.9754,  0.8669,
         0.6707,  0.0379,  0.9502,  0.0084,  0.9460,  0.9905,  0.9349,
         0.3665,  0.0912,  0.2023,  0.0090,  0.6765,  0.2189,  0.0599,
         0.0277,  0.2394,  0.7725,  0.9297,  0.1702,  0.0090,  0.0770,
         0.0015,  0.9475,  0.0824,  0.1780,  0.0393,  0.0196,  0.5749,
         0.0071,  0.9643,  0.1359,  0.9997,  0.4060,  0.1672,  0.3155,
         0.5189,  0.4952,  0.7277,  0.8834,  0.1307,  0.8301,  0.8671,
         0.9245,  0.0830,  0.9076,  0.0935,  0.7826,  0.9669,  0.8685,
         0.8304,  0.0657,  0.0356,  0.5923,  0.2717,  0.2238,  0.9479,
         0.2403,  0.4093,  0.3573,  0.9972,  0.3642,  0.0023,  0.0385,
         0.9235,  0.2958,  0.0024,  0.9992,  0.2618,  0.3031,  0.4428,
         0.0608,  0.7392,  0.3798,  0.9528,  0.7131,  0.1776,  0.3601,
         0.1721,  0.5825,  0.6312,  0.4214,  0.5778,  0.0662,  0.0112,
         0.1509,  0.9268,  0.9913,  0.7085,  0.8866,  0.5240,  0.0291,
         0.1297,  0.3437,  0.4522,  0.9100,  0.0847,  0.3938,  0.0007,
         0.1848,  0.4834,  0.9655,  0.9636,  0.9638,  0.9759,  0.6353,
         0.1008,  0.1246,  0.9674,  0.9861,  0.0244,  0.0246,  0.3944,
         0.0358,  0.8948,  0.9709,  0.1350,  0.1389,  0.0065,  0.0053,
         0.9499,  0.0128,  0.9382,  0.0006,  0.2287,  0.5810,  0.1750,
         0.3929,  0.1035,  0.8805,  0.9885,  0.0954,  0.0355,  0.0069,
         0.9916,  0.8086,  0.7810,  0.0386,  0.0662,  0.9047,  0.5081,
         0.1021,  0.3210,  0.0322,  0.0414,  0.0626,  0.7919,  0.0041,
         0.7258,  0.8750,  0.1527,  0.5506,  0.0265,  0.1490,  0.9036,
         0.4126,  0.0167,  0.0716,  0.7197,  0.0189,  0.1342,  0.0071,
         0.0449,  0.8872,  0.0277,  0.1173,  0.0374,  0.9548,  0.9662,
         0.1266,  0.1479,  0.1434,  0.9283,  0.2532,  0.8673,  0.0208,
         0.8458,  0.8006,  0.9512,  0.0760,  0.2187,  0.9667,  0.8826,
         0.9365,  0.4948,  0.0402,  0.2133,  0.9845,  0.0455,  0.9661,
         0.0196,  0.7210,  0.4494,  0.1160,  0.0037,  0.0061,  0.8833,
         0.9375], device='cuda:0')
tensor(0.3169, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9636,  0.8791,  0.1644,  0.8506,  0.2830,  0.7014,  0.1038,
         0.2400,  0.0139,  0.2775,  0.9442,  0.9405,  0.7182,  0.0441,
         0.0198,  0.0735,  0.0450,  0.9636,  0.1488,  0.9224,  0.9558,
         0.0354,  0.0338,  0.9191,  0.1701,  0.9046,  0.6755,  0.7400,
         0.0529,  0.8528,  0.4779,  0.9749,  0.9732,  0.9620,  0.5885,
         0.8191,  0.7509,  0.9360,  0.5326,  0.2411,  0.9268,  0.6355,
         0.1610,  0.1563,  0.9141,  0.9917,  0.1371,  0.1289,  0.8621,
         0.8421,  0.9267,  0.0261,  0.0143,  0.8311,  0.1316,  0.0169,
         0.1624,  0.9478,  0.6461,  0.1360,  0.9362,  0.9210,  0.8784,
         0.8606,  0.0049,  0.5614,  0.6548,  0.8352,  0.0725,  0.2115,
         0.0200,  0.9371,  0.4734,  0.9968,  0.9843,  0.3506,  0.9988,
         0.9009,  0.9541,  0.0257,  0.9867,  0.9855,  0.6801,  0.0399,
         0.9816,  0.8476,  0.0077,  0.6222,  0.6162,  0.9199,  0.0297,
         0.1777,  0.9244,  0.0131,  0.1339,  0.2658,  0.3403,  0.1895,
         0.9771,  0.9267,  0.2481,  0.0630,  0.9947,  0.2492,  0.0278,
         0.9570,  0.1447,  0.6640,  0.8414,  0.5752,  0.8157,  0.9708,
         0.9818,  0.8426,  0.2336,  0.1725,  0.9574,  0.0179,  0.9222,
         0.0266,  0.7057,  0.0388,  0.9651,  0.9093,  0.5468,  0.3801,
         0.5002,  0.3062,  0.0102,  0.0101,  0.2612,  0.0725,  0.0126,
         0.0636,  0.2339,  0.1331,  0.0325,  0.0863,  0.8738,  0.0682,
         0.0083,  0.8146,  0.1179,  0.9358,  0.0069,  0.0072,  0.8244,
         0.6908,  0.2312,  0.1018,  0.0369,  0.8965,  0.8991,  0.7338,
         0.8294,  0.0818,  0.9682,  0.8146,  0.2276,  0.8950,  0.1688,
         0.5239,  0.9658,  0.0288,  0.0153,  0.1044,  0.7652,  0.0258,
         0.0056,  0.7699,  0.9696,  0.0229,  0.0473,  0.5522,  0.0591,
         0.7306,  0.8024,  0.9652,  0.0245,  0.0101,  0.9050,  0.4005,
         0.9717,  0.8414,  0.1361,  0.6850,  0.0142,  0.9429,  0.9691,
         0.0183,  0.9446,  0.0088,  0.5031,  0.3895,  0.6628,  0.2368,
         0.0539,  0.7652,  0.9941,  0.9500,  0.2018,  0.1212,  0.5111,
         0.8735,  0.7256,  0.0423,  0.9812,  0.1485,  0.8828,  0.0187,
         0.1217,  0.0259,  0.3053,  0.9479,  0.9439,  0.0629,  0.0994,
         0.1316,  0.4785,  0.2761,  0.0487,  0.0403,  0.0423,  0.4113,
         0.7458,  0.4789,  0.9241,  0.7765,  0.6236,  0.6528,  0.0388,
         0.9449,  0.1124,  0.3073,  0.7938,  0.0713,  0.0718,  0.0226,
         0.9522,  0.1569,  0.0710,  0.9734,  0.8697,  0.9569,  0.2181,
         0.0703,  0.7307,  0.0275,  0.0355,  0.8324,  0.9243,  0.8739,
         0.7863,  0.0055,  0.9559,  0.2607,  0.0973,  0.2063,  0.9520,
         0.9448,  0.0643,  0.9001,  0.8317,  0.8828,  0.8065,  0.9987,
         0.3419,  0.0132,  0.9228,  0.0227,  0.1229,  0.7167,  0.0032,
         0.0305,  0.7062,  0.3323,  0.0231,  0.9903,  0.0336,  0.8840,
         0.0790,  0.9751,  0.9771,  0.0494,  0.8115,  0.0520,  0.0488,
         0.0606,  0.0741,  0.9040,  0.8771,  0.8986,  0.0361,  0.3443,
         0.1941,  0.8949,  0.1041,  0.0206,  0.0233,  0.7896,  0.9119,
         0.0349,  0.9252,  0.9823,  0.9699,  0.0743,  0.9684,  0.1674,
         0.8849,  0.8353,  0.0118,  0.8924,  0.2461,  0.0510,  0.2520,
         0.6342,  0.0258,  0.8993,  0.2560,  0.0351,  0.3412,  0.9990,
         0.9222,  0.0214,  0.9521,  0.0040,  0.2297,  0.0913,  0.7230,
         0.9598,  0.6606,  0.6563,  0.6969,  0.4587,  0.6756,  0.4272,
         0.7981,  0.7558,  0.0366,  0.0322,  0.8267,  0.9970,  0.3726,
         0.9989,  0.0204,  0.7513,  0.1383,  0.9679,  0.1640,  0.9557,
         0.9995,  0.2263,  0.2746,  0.8906,  0.8610,  0.9374,  0.9590,
         0.8314,  0.9317,  0.4691,  0.0336,  0.9730,  0.8248,  0.1178,
         0.9838,  0.9889,  0.7159,  0.9030,  0.0503,  0.9793,  0.3813,
         0.1663,  0.0057,  0.9856,  0.1380,  0.2776,  0.2164,  0.0979,
         0.0218,  0.0760,  0.2491,  0.1712,  0.4094,  0.2541,  0.5438,
         0.9591,  0.9859,  0.9651,  0.0088,  0.6154,  0.9301,  0.3093,
         0.7844,  0.7242,  0.9234,  0.0991,  0.2817,  0.6163,  0.0472,
         0.9662,  0.0042,  0.1309,  0.9049,  0.0035,  0.7281,  0.0877,
         0.0203,  0.9282,  0.1618,  0.2299,  0.0435,  0.2880,  0.3886,
         0.0148,  0.9374,  0.8028,  0.0460,  0.3759,  0.0499,  0.2382,
         0.2452,  0.2415,  0.1121,  0.1411,  0.0255,  0.0075,  0.8448,
         0.0479,  0.0141,  0.0545,  0.8692,  0.1907,  0.9733,  0.0225,
         0.0610,  0.4573,  0.4687,  0.6911,  0.1129,  0.6184,  0.9918,
         0.1089,  0.1913,  0.2494,  0.0931,  0.8222,  0.8832,  0.9982,
         0.8836,  0.9507,  0.9601,  0.1592,  0.8632,  0.7791,  0.9261,
         0.5720,  0.5670,  0.0599,  0.9583,  0.1891,  0.4733,  0.7814,
         0.0523,  0.0984,  0.1778,  0.9500,  0.9635,  0.1394,  0.9132,
         0.2352,  0.8197,  0.5144,  0.7130,  0.1378,  0.9245,  0.3478,
         0.9100,  0.0515,  0.0177,  0.4153,  0.9224,  0.8635,  0.0160,
         0.4528,  0.0733,  0.2988,  0.8701,  0.8938,  0.8850,  0.8084,
         0.9312,  0.9818,  0.1230,  0.1665,  0.9205,  0.0667,  0.1744,
         0.1894,  0.9396,  0.0200,  0.1370,  0.9389,  0.5711,  0.9997,
         0.8711,  0.0143,  0.0715,  0.3178,  0.9350,  0.0106,  0.9811,
         0.1839], device='cuda:0')
tensor(0.2876, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0734,  0.7680,  0.0255,  0.8676,  0.9994,  0.9979,  0.0906,
         0.5866,  0.9541,  0.8445,  0.4140,  0.3147,  0.9233,  0.9063,
         0.9386,  0.9703,  0.7215,  0.9244,  0.9410,  0.9492,  0.0229,
         0.0106,  0.2658,  0.0334,  0.0013,  0.3044,  0.6126,  0.9181,
         0.9806,  0.9452,  0.7965,  0.9326,  0.2697,  0.0634,  0.1501,
         0.8885,  0.0266,  0.9463,  0.3261,  0.0799,  0.8575,  0.0756,
         0.5271,  0.9727,  0.1988,  0.9374,  0.8910,  0.9360,  0.5645,
         0.7263,  0.1287,  0.4220,  0.0193,  0.3036,  0.2158,  0.1831,
         0.0770,  0.8221,  0.4120,  0.9960,  0.9617,  0.9791,  0.9056,
         0.9264,  0.7998,  0.7248,  0.4363,  0.0256,  0.1788,  0.3687,
         0.8629,  0.6093,  0.7890,  0.8743,  0.1073,  0.8832,  0.8335,
         0.1064,  0.8521,  0.8980,  0.0704,  0.0130,  0.8928,  0.9722,
         0.0785,  0.0106,  0.1767,  0.9762,  0.8470,  0.0206,  0.4894,
         0.9946,  0.1828,  0.0951,  0.0863,  0.2022,  0.0191,  0.9856,
         0.4887,  0.8791,  0.0501,  0.0788,  0.1582,  0.9957,  0.0961,
         0.9739,  0.9394,  0.3096,  0.8877,  0.0253,  0.9175,  0.7484,
         0.1770,  0.9389,  0.0127,  0.9106,  0.2516,  0.4460,  0.3288,
         0.0357,  0.9968,  0.3198,  0.3371,  0.8498,  0.8936,  0.9990,
         0.2206,  0.9254,  0.0663,  0.9295,  0.9745,  0.2175,  0.9733,
         0.9883,  0.0234,  0.1187,  0.8993,  0.0609,  0.5668,  0.0941,
         0.1238,  0.9730,  0.0195,  0.9133,  0.0016,  0.9421,  0.3158,
         0.9490,  0.0342,  0.0236,  0.0509,  0.3939,  0.4779,  0.2494,
         0.2256,  0.9433,  0.1266,  0.5189,  0.9581,  0.9995,  0.8009,
         0.9562,  0.6229,  0.1817,  0.2503,  0.0636,  0.0502,  0.9375,
         0.1044,  0.0537,  0.4598,  0.9658,  0.9980,  0.6849,  0.1035,
         0.9197,  0.9546,  0.9386,  0.0387,  0.3462,  0.8135,  0.0159,
         0.6337,  0.9305,  0.6547,  0.9217,  0.9946,  0.9354,  0.6479,
         0.3583,  0.9866,  0.9644,  0.0791,  0.0626,  0.0367,  0.9634,
         0.9828,  0.9801,  0.1011,  0.9996,  0.0331,  0.6617,  0.8261,
         0.9933,  0.1647,  0.1609,  0.1996,  0.0272,  0.0414,  0.1391,
         0.9418,  0.0055,  0.0309,  0.0203,  0.4261,  0.1817,  0.9958,
         0.9570,  0.1423,  0.1862,  0.9738,  0.0025,  0.9662,  0.1000,
         0.0098,  0.0022,  0.3358,  0.7946,  0.2414,  0.8325,  0.0418,
         0.0172,  0.9699,  0.9347,  0.3840,  0.5479,  0.1359,  0.3821,
         0.8218,  0.0642,  0.0971,  0.0906,  0.9800,  0.2121,  0.1708,
         0.5698,  0.4430,  0.9841,  0.9892,  0.6753,  0.1424,  0.1021,
         0.1197,  0.9230,  0.9560,  0.6890,  0.9466,  0.2183,  0.1290,
         0.1227,  0.7619,  0.9387,  0.7290,  0.9126,  0.1224,  0.0027,
         0.8965,  0.7021,  0.2628,  0.4778,  0.0840,  0.0525,  0.4841,
         0.9807,  0.8854,  0.9668,  0.2157,  0.6983,  0.2140,  0.7715,
         0.2483,  0.0158,  0.9045,  0.0781,  0.9753,  0.9516,  0.9677,
         0.0804,  0.6800,  0.3265,  0.9340,  0.8002,  0.9742,  0.9479,
         0.1117,  0.9752,  0.9115,  0.6844,  0.9978,  0.0123,  0.1932,
         0.9920,  0.1084,  0.7450,  0.0696,  0.5518,  0.9229,  0.9895,
         0.0544,  0.9336,  0.8997,  0.6242,  0.1236,  0.9825,  0.2614,
         0.8909,  0.8516,  0.3687,  0.8543,  0.9183,  0.9561,  0.0299,
         0.8088,  0.5422,  0.2288,  0.9656,  0.9653,  0.8270,  0.5928,
         0.1712,  0.2488,  0.6114,  0.1099,  0.9423,  0.8405,  0.0008,
         0.9608,  0.8634,  0.0744,  0.9858,  0.9991,  0.9376,  0.0905,
         0.0923,  0.7716,  0.0155,  0.9053,  0.5105,  0.7720,  0.1614,
         0.7814,  0.8597,  0.9880,  0.8956,  0.8957,  0.8533,  0.3078,
         0.7956,  0.1281,  0.1705,  0.0009,  0.9794,  0.1281,  0.9304,
         0.9520,  0.1722,  0.0986,  0.1038,  0.9859,  0.9548,  0.8746,
         0.7483,  0.9621,  0.8097,  0.8063,  0.0463,  0.0091,  0.3266,
         0.1694,  0.8513,  0.9784,  0.2825,  0.0140,  0.2243,  0.9926,
         0.7398,  0.0676,  0.9061,  0.9849,  0.1765,  0.9905,  0.9253,
         0.0095,  0.1649,  0.9296,  0.7636,  0.8192,  0.0280,  0.0742,
         0.9876,  0.9524,  0.0325,  0.6480,  0.0334,  0.6620,  0.9534,
         0.0167,  0.9230,  0.5333,  0.8673,  0.8288,  0.9660,  0.0386,
         0.7149,  0.0081,  0.9436,  0.5526,  0.3362,  0.9390,  0.0597,
         0.2114,  0.0200,  0.0155,  0.2310,  0.9353,  0.0007,  0.9039,
         0.3710,  0.4770,  0.9491,  0.7555,  0.0121,  0.6861,  0.2663,
         0.9267,  0.0501,  0.5402,  0.9721,  0.9957,  0.9450,  0.0900,
         0.2125,  0.9847,  0.6733,  0.1219,  0.0983,  0.0191,  0.7671,
         0.9837,  0.4439,  0.0590,  0.0425,  0.3336,  0.8499,  0.2347,
         0.9580,  0.0142,  0.8434,  0.1270,  0.9875,  0.5709,  0.9971,
         0.1132,  0.8780,  0.9570,  0.6803,  0.9548,  0.9440,  0.3956,
         0.9764,  0.0546,  0.9715,  0.1661,  0.2031,  0.2535,  0.0353,
         0.9228,  0.9968,  0.9856,  0.0166,  0.9437,  0.6657,  0.3510,
         0.1351,  0.0037,  0.7261,  0.8655,  0.3851,  0.9738,  0.7439,
         0.0205,  0.8839,  0.2444,  0.0873,  0.2166,  0.7399,  0.3295,
         0.9295,  0.9134,  0.0163,  0.9488,  0.5569,  0.0073,  0.5696,
         0.9762,  0.7888,  0.2919,  0.0439,  0.9538,  0.0155,  0.8689,
         0.0781], device='cuda:0')
tensor(0.3100, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9813,  0.1072,  0.0765,  0.0187,  0.0583,  0.1511,  0.2333,
         0.9560,  0.9362,  0.0574,  0.7050,  0.9630,  0.4205,  0.1833,
         0.9679,  0.9416,  0.0419,  0.9164,  0.0673,  0.9994,  0.2323,
         0.8633,  0.9995,  0.0543,  0.5595,  0.0189,  0.9987,  0.9474,
         0.9248,  0.0459,  0.2474,  0.2282,  0.0753,  0.9606,  0.0814,
         0.7958,  0.2012,  0.0623,  0.9686,  0.5391,  0.0177,  0.0394,
         0.0333,  0.3760,  0.9970,  0.3899,  0.8986,  0.9727,  0.8995,
         0.4482,  0.2871,  0.9027,  0.1532,  0.8634,  0.0233,  0.4795,
         0.9663,  0.8615,  0.0215,  0.0316,  0.7110,  0.0663,  0.9447,
         0.0435,  0.5054,  0.7799,  0.9485,  0.0196,  0.9831,  0.9358,
         0.7995,  0.0024,  0.2036,  0.2708,  0.8459,  0.1702,  0.4158,
         0.9109,  0.9803,  0.0134,  0.9125,  0.9982,  0.3344,  0.9612,
         0.0059,  0.9973,  0.9569,  0.3989,  0.0075,  0.0521,  0.9599,
         0.9866,  0.8014,  0.9695,  0.1780,  0.9698,  0.9859,  0.2897,
         0.9510,  0.9116,  0.9988,  0.0342,  0.6942,  0.8309,  0.3274,
         0.9632,  0.9373,  0.9818,  0.9999,  0.5901,  0.9909,  0.9779,
         0.1161,  0.0782,  0.5000,  0.0945,  0.1415,  0.6611,  0.9828,
         0.9650,  0.9806,  0.9780,  0.0407,  0.9844,  0.8546,  0.9925,
         0.1034,  0.0372,  0.6296,  0.8785,  0.4178,  0.0731,  0.0632,
         0.9247,  0.6337,  0.0393,  0.8873,  0.8033,  0.7838,  0.4554,
         0.1803,  0.9979,  0.1028,  0.0236,  0.8888,  0.4927,  0.1370,
         0.4173,  0.0073,  0.7622,  0.1014,  0.6222,  0.0855,  0.9626,
         0.9525,  0.2812,  0.0534,  0.9771,  0.9731,  0.7189,  0.9681,
         0.9080,  0.9875,  0.3060,  0.1459,  0.0628,  0.5126,  0.9064,
         0.8946,  0.7396,  0.0931,  0.2840,  0.9533,  0.2482,  0.1084,
         0.5601,  0.0477,  0.4187,  0.1078,  0.1258,  0.9799,  0.0464,
         0.0022,  0.8735,  0.0440,  0.1088,  0.9131,  0.2846,  0.9890,
         0.0257,  0.1320,  0.7607,  0.7655,  0.1670,  0.6590,  0.9326,
         0.8620,  0.8959,  0.1209,  0.7355,  0.7453,  0.9599,  0.9756,
         0.0562,  0.0481,  0.7931,  0.9904,  0.0781,  0.5359,  0.9013,
         0.0307,  0.0448,  0.0249,  0.0204,  0.9282,  0.6801,  0.0846,
         0.0017,  0.8319,  0.9777,  0.3187,  0.8900,  0.9690,  0.8460,
         0.1163,  0.8443,  0.4286,  0.2829,  0.8657,  0.0283,  0.2238,
         0.0470,  0.1669,  0.9854,  0.9642,  0.8040,  0.1275,  0.8296,
         0.9081,  0.8405,  0.9972,  0.9976,  0.3812,  0.1495,  0.0760,
         0.0095,  0.0442,  0.5413,  0.7064,  0.9392,  0.0204,  0.9810,
         0.9513,  0.2220,  0.9653,  0.9381,  0.2898,  0.4481,  0.9500,
         0.9719,  0.9908,  0.7415,  0.6941,  0.9425,  0.2274,  0.9715,
         0.9451,  0.9867,  0.5715,  0.3888,  0.0882,  0.9087,  0.5927,
         0.7243,  0.1242,  0.9755,  0.8284,  0.6676,  0.0588,  0.9853,
         0.8889,  0.9664,  0.0453,  0.9582,  0.7671,  0.0461,  0.9327,
         0.0365,  0.9585,  0.0229,  0.6034,  0.9473,  0.9710,  0.9182,
         0.7718,  0.9609,  0.7816,  0.0478,  0.9993,  0.0369,  0.2159,
         0.9153,  0.9608,  0.9363,  0.8795,  0.0572,  0.0729,  0.0282,
         0.9776,  0.9485,  0.9338,  0.0025,  0.9981,  0.1189,  0.9204,
         0.0997,  0.0786,  0.9162,  0.0838,  0.7581,  0.0782,  0.3439,
         0.8414,  0.4491,  0.0247,  0.0470,  0.9571,  0.8636,  0.5759,
         0.0956,  0.9138,  0.9385,  0.4536,  0.0029,  0.9643,  0.7239,
         0.9782,  0.8318,  0.0550,  0.8025,  0.5167,  0.8133,  0.9906,
         0.1522,  0.5700,  0.6556,  0.0223,  0.1083,  0.1758,  0.9873,
         0.7943,  0.9700,  0.9706,  0.9415,  0.9540,  0.5392,  0.9919,
         0.0523,  0.0906,  0.8844,  0.9828,  0.4615,  0.9714,  0.9353,
         0.9864,  0.9531,  0.9430,  0.9171,  0.9447,  0.7256,  0.7163,
         0.8383,  0.0064,  0.9767,  0.0247,  0.9787,  0.0500,  0.8987,
         0.2966,  0.9997,  0.3024,  0.9824,  0.0846,  0.9919,  0.9994,
         0.9549,  0.9735,  0.7725,  0.5987,  0.1608,  0.3050,  0.0295,
         0.0489,  0.8648,  0.5992,  0.6981,  0.9947,  0.1702,  0.0573,
         0.7505,  0.9270,  0.2110,  0.8770,  0.9606,  0.9247,  0.9569,
         0.9753,  0.9227,  0.9653,  0.8876,  0.9164,  0.1709,  0.4942,
         0.9945,  0.9807,  0.9606,  0.9831,  0.1515,  0.9853,  0.9907,
         0.9819,  0.8277,  0.6847,  0.9668,  0.6682,  0.0186,  0.1748,
         0.8559,  0.8739,  0.0993,  0.9440,  0.9689,  0.9783,  0.9064,
         0.8574,  0.5623,  0.6475,  0.8782,  0.0924,  0.0554,  0.0391,
         0.2063,  0.2000,  0.9116,  0.2904,  0.9985,  0.8093,  0.1544,
         0.9983,  0.0174,  0.0627,  0.0289,  0.4424,  0.9762,  0.5647,
         0.9254,  0.9639,  0.9778,  0.1386,  0.9871,  0.9533,  0.9297,
         0.1963,  0.4637,  0.9836,  0.2334,  0.9843,  0.0574,  0.0103,
         0.9297,  0.9903,  0.9992,  0.8059,  0.3221,  0.0283,  0.1547,
         0.9907,  0.2788,  0.7325,  0.9871,  0.4668,  0.2416,  0.0187,
         0.4596,  0.1137,  0.3240,  0.3369,  0.4997,  0.9116,  0.9492,
         0.9086,  0.0127,  0.2770,  0.7364,  0.9730,  0.7483,  0.9451,
         0.9825,  0.0251,  0.9239,  0.0900,  0.3887,  0.8600,  0.2266,
         0.0125,  0.1204,  0.0027,  0.9059,  0.9110,  0.9984,  0.2208,
         0.9251], device='cuda:0')
tensor(0.3236, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9731,  0.9273,  0.9232,  0.8931,  0.9257,  0.5071,  0.9882,
         0.4660,  0.1177,  0.1543,  0.9920,  0.8369,  0.0697,  0.8079,
         0.4215,  0.4527,  0.9467,  0.6262,  0.9900,  0.6797,  0.9798,
         0.0020,  0.2499,  0.0275,  0.9917,  0.9935,  0.9414,  0.9421,
         0.9192,  0.1170,  0.1148,  0.9725,  0.0031,  0.9980,  0.1483,
         0.6558,  0.0179,  0.9553,  0.9203,  0.9834,  0.0256,  0.9838,
         0.9538,  0.9805,  0.7980,  0.2781,  0.5153,  0.9917,  0.4480,
         0.9854,  0.1044,  0.0985,  0.1446,  0.1110,  0.0999,  0.9797,
         0.9818,  0.0388,  0.9148,  0.9600,  0.9569,  0.5037,  0.0099,
         0.8617,  0.9390,  0.1986,  0.8773,  0.6636,  0.1064,  0.0450,
         0.0260,  0.8243,  0.1640,  0.1434,  0.0218,  0.7811,  0.9662,
         0.8642,  0.0055,  0.0847,  0.9674,  0.0909,  0.9930,  0.0081,
         0.8988,  0.0027,  0.9459,  0.0221,  0.8317,  0.9914,  0.0210,
         0.9093,  0.5174,  0.0689,  0.9815,  0.7021,  0.7598,  0.9839,
         0.0653,  0.6802,  0.7126,  0.0225,  0.0074,  0.8904,  0.1109,
         0.0178,  0.9888,  0.9798,  0.0378,  0.1032,  0.7778,  0.9884,
         0.3525,  0.0011,  0.0688,  0.2308,  0.9463,  0.1811,  0.9574,
         0.9998,  0.0870,  0.9517,  0.0227,  0.8234,  0.7003,  0.0378,
         0.0487,  0.9512,  0.0211,  0.0208,  0.9807,  0.8217,  0.0068,
         0.9910,  0.0510,  0.9690,  0.2784,  0.8341,  0.0118,  0.8966,
         0.9371,  0.6366,  0.0022,  0.9947,  0.1547,  0.1179,  0.9765,
         0.1213,  0.1499,  0.9683,  0.0567,  0.9353,  0.2979,  0.0653,
         0.7960,  0.8199,  0.0140,  0.1107,  0.4529,  0.9960,  0.9684,
         0.0577,  0.0115,  0.0011,  0.0467,  0.9995,  0.9965,  0.9523,
         0.0198,  0.6547,  0.9040,  0.9319,  0.0474,  0.0221,  0.9625,
         0.9752,  0.0271,  0.0358,  0.0096,  0.2682,  0.7082,  0.0037,
         0.0673,  0.0941,  0.8360,  0.2415,  0.8085,  0.9151,  0.0010,
         0.0006,  0.9233,  0.9841,  0.9682,  0.9465,  0.9574,  0.0290,
         0.9099,  0.6917,  0.4873,  0.6332,  0.0087,  0.8546,  0.9262,
         0.1213,  0.9988,  0.9289,  0.8179,  0.9898,  0.8806,  0.0782,
         0.9845,  0.9541,  0.9905,  0.9899,  0.9684,  0.0371,  0.6288,
         0.1480,  0.0066,  0.7143,  0.9540,  0.1089,  0.7433,  0.5827,
         0.4705,  0.9138,  0.0714,  0.9547,  0.9105,  0.0834,  0.9648,
         0.9468,  0.9895,  0.3025,  0.0150,  0.6220,  0.9718,  0.1292,
         0.0014,  0.7020,  0.9784,  0.8959,  0.0992,  0.9454,  0.8973,
         0.3939,  0.9593,  0.8949,  0.6245,  0.1103,  0.7934,  0.0193,
         0.5605,  0.4887,  0.9556,  0.8834,  0.5595,  0.3911,  0.0076,
         0.1340,  0.9171,  0.9900,  0.1130,  0.0874,  0.1333,  0.0661,
         0.0055,  0.8533,  0.9503,  0.1756,  0.0336,  0.9310,  0.0071,
         0.1546,  0.0153,  0.9641,  0.9257,  0.0031,  0.9647,  0.0648,
         0.0622,  0.3217,  0.6245,  0.9538,  0.9859,  0.5101,  0.9159,
         0.8662,  0.9741,  0.5100,  0.2130,  0.0162,  0.9135,  0.9387,
         0.9810,  0.1377,  0.9333,  0.9378,  0.0107,  0.9851,  0.0753,
         0.0334,  0.9660,  0.0223,  0.8173,  0.0191,  0.9854,  0.0015,
         0.0944,  0.9735,  0.1262,  0.0576,  0.1124,  0.0470,  0.9333,
         0.0237,  0.1240,  0.0100,  0.0033,  0.0393,  0.1177,  0.9673,
         0.8977,  0.0205,  0.9111,  0.0618,  0.9612,  0.9412,  0.3422,
         0.9423,  0.1370,  0.9992,  0.7087,  0.0382,  0.3413,  0.9638,
         0.3803,  0.0333,  0.9496,  0.9803,  0.0664,  0.0833,  0.9905,
         0.9557,  0.9564,  0.9990,  0.9960,  0.9347,  0.1885,  0.3472,
         0.1200,  0.1144,  0.9822,  0.0640,  0.0306,  0.8894,  0.0135,
         0.0618,  0.9823,  0.3643,  0.1117,  0.9120,  0.0211,  0.9863,
         0.0141,  0.0537,  0.9756,  0.9748,  0.0726,  0.9586,  0.0532,
         0.0007,  0.3463,  0.9688,  0.0029,  0.0611,  0.9746,  0.7614,
         0.1597,  0.9481,  0.9504,  0.9046,  0.9331,  0.9892,  0.1562,
         0.0526,  0.1530,  0.9876,  0.2095,  0.9777,  0.8621,  0.4420,
         0.9916,  0.8278,  0.0019,  0.1086,  0.0664,  0.9890,  0.9582,
         0.1328,  0.9275,  0.7595,  0.9613,  0.0234,  0.0995,  0.0072,
         0.6430,  0.0051,  0.8607,  0.0237,  0.0257,  0.5867,  0.7624,
         0.9907,  0.0923,  0.2181,  0.9997,  0.0036,  0.0497,  0.8724,
         0.0245,  0.2196,  0.8069,  0.0922,  0.6618,  0.4831,  0.0431,
         0.9734,  0.0076,  0.0623,  0.7992,  0.2550,  0.9680,  0.0142,
         0.9597,  0.0276,  0.8287,  0.9760,  0.9567,  0.9880,  0.0192,
         0.0144,  0.9418,  0.1622,  0.9302,  0.8555,  0.8571,  0.9911,
         0.1024,  0.9691,  0.8190,  0.8227,  0.9837,  0.9262,  0.7090,
         0.9839,  0.9818,  0.2665,  0.0390,  0.3950,  0.9536,  0.1099,
         0.0549,  0.3069,  0.0225,  0.1001,  0.2408,  0.8612,  0.8005,
         0.0293,  0.0620,  0.9644,  0.0086,  0.0532,  0.9932,  0.0254,
         0.9408,  0.0074,  0.1669,  0.6785,  0.9216,  0.1165,  0.6179,
         0.2572,  0.9554,  0.1272,  0.9728,  0.0353,  0.7688,  0.7586,
         0.3049,  0.6794,  0.9901,  0.1177,  0.9728,  0.9620,  0.1475,
         0.3400,  0.0290,  0.9613,  0.9227,  0.9843,  0.7465,  0.1255,
         0.2075,  0.9921,  0.9230,  0.9084,  0.9824,  0.9881,  0.9193,
         0.0153], device='cuda:0')
tensor(0.2602, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9911,  0.0334,  0.8610,  0.9576,  0.9519,  0.9417,  0.9203,
         0.3629,  0.0078,  0.9280,  0.0598,  0.9964,  0.9712,  0.1347,
         0.9805,  0.0462,  0.1860,  0.0995,  0.4117,  0.9150,  0.0346,
         0.9991,  0.0472,  0.1958,  0.5299,  0.3615,  0.1104,  0.0340,
         0.0455,  0.9878,  0.0446,  0.9652,  0.9148,  0.4224,  0.0173,
         0.0030,  0.0194,  0.0063,  0.0994,  0.9943,  0.0088,  0.0186,
         0.4791,  0.5546,  0.8801,  0.9925,  0.9781,  0.4553,  0.1249,
         0.0256,  0.9565,  0.0029,  0.3405,  0.1880,  0.9985,  0.7777,
         0.0280,  0.0586,  0.8493,  0.9822,  0.8971,  0.5101,  0.8071,
         0.1636,  0.9784,  0.9815,  0.0017,  0.9689,  0.8513,  0.6998,
         0.4330,  0.9577,  0.0046,  0.9581,  0.9968,  0.9886,  0.0363,
         0.9058,  0.2492,  0.1480,  0.9480,  0.9312,  0.8883,  0.0436,
         0.0937,  0.9528,  0.0038,  0.9001,  0.0727,  0.0511,  0.0135,
         0.2329,  0.9339,  0.8287,  0.0350,  0.9770,  0.0745,  0.7016,
         0.0583,  0.9676,  0.1095,  0.9877,  0.0008,  0.0051,  0.0871,
         0.9950,  0.0459,  0.5820,  0.6092,  0.3534,  0.3112,  0.8469,
         0.9071,  0.9721,  0.6922,  0.9348,  0.0227,  0.9312,  0.9762,
         0.4651,  0.9641,  0.9236,  0.0280,  0.9629,  0.9122,  0.1844,
         0.9874,  0.5948,  0.9992,  0.9389,  0.6548,  0.9713,  0.6885,
         0.0849,  0.0271,  0.9958,  0.9563,  0.9559,  0.7945,  0.0321,
         0.9304,  0.0501,  0.0830,  0.0374,  0.8971,  0.0067,  0.9819,
         0.9523,  0.9299,  0.8814,  0.9995,  0.9952,  0.9341,  0.7565,
         0.5374,  0.9795,  0.0177,  0.0888,  0.0028,  0.9435,  0.0015,
         0.0578,  0.8829,  0.1427,  0.0103,  0.9475,  0.6661,  0.0922,
         0.9865,  0.0048,  0.5456,  0.9057,  0.9843,  0.1128,  0.8879,
         0.8142,  0.9480,  0.3379,  0.9846,  0.9352,  0.0136,  0.0421,
         0.6995,  0.0528,  0.1500,  0.9412,  0.9358,  0.5454,  0.7101,
         0.9781,  0.8231,  0.9139,  0.0159,  0.9420,  0.1008,  0.8740,
         0.0299,  0.9314,  0.9437,  0.1183,  0.8104,  0.0012,  0.0024,
         0.0216,  0.1180,  0.5398,  0.1915,  0.9185,  0.9507,  0.7657,
         0.8773,  0.9620,  0.0036,  0.9162,  0.7066,  0.2085,  0.0362,
         0.9954,  0.3470,  0.7589,  0.9471,  0.0422,  0.9677,  0.8506,
         0.9841,  0.8885,  0.8711,  0.0093,  0.9902,  0.2235,  0.0120,
         0.9866,  0.9395,  0.9944,  0.0029,  0.2454,  0.4898,  0.1204,
         0.8671,  0.2886,  0.7927,  0.9879,  0.2241,  0.9848,  0.1561,
         0.9913,  0.0302,  0.0122,  0.0926,  0.9911,  0.9168,  0.1258,
         0.7540,  0.8063,  0.0205,  0.9518,  0.0219,  0.9123,  0.9864,
         0.8978,  0.0671,  0.3620,  0.1942,  0.0952,  0.9296,  0.1229,
         0.9210,  0.0177,  0.1142,  0.0177,  0.0153,  0.0015,  0.9819,
         0.9150,  0.8228,  0.0890,  0.0218,  0.0223,  0.1734,  0.0184,
         0.1493,  0.1632,  0.8409,  0.3742,  0.0213,  0.0074,  0.6553,
         0.3212,  0.8864,  0.2022,  0.0198,  0.5047,  0.6462,  0.0440,
         0.9726,  0.9594,  0.0326,  0.9393,  0.0659,  0.0049,  0.0186,
         0.6723,  0.0376,  0.9715,  0.9997,  0.0072,  0.1348,  0.0066,
         0.3911,  0.6280,  0.0165,  0.8157,  0.0908,  0.0131,  0.0121,
         0.9299,  0.7048,  0.0334,  0.9695,  0.9029,  0.1298,  0.5362,
         0.0244,  0.0374,  0.9661,  0.9637,  0.0063,  0.8916,  0.0047,
         0.0335,  0.0400,  0.0383,  0.3712,  0.1161,  0.7537,  0.0174,
         0.0296,  0.8863,  0.1487,  0.0320,  0.9948,  0.8628,  0.0382,
         0.9200,  0.0652,  0.9245,  0.5338,  0.9948,  0.0900,  0.8276,
         0.4759,  0.0531,  0.8263,  0.7977,  0.4322,  0.9800,  0.4990,
         0.9495,  0.9792,  0.9973,  0.9332,  0.9811,  0.9103,  0.9084,
         0.9193,  0.8967,  0.9342,  0.9606,  0.7933,  0.1058,  0.4531,
         0.0331,  0.2930,  0.9527,  0.0877,  0.9855,  0.8143,  0.4215,
         0.0347,  0.8433,  0.0668,  0.9967,  0.9866,  0.9146,  0.9421,
         0.9953,  0.3458,  0.9637,  0.0487,  0.9881,  0.0326,  0.7369,
         0.0760,  0.9976,  0.9362,  0.9529,  0.9807,  0.0012,  0.0424,
         0.8498,  0.9579,  0.3221,  0.9141,  0.8559,  0.9601,  0.4441,
         0.1419,  0.9463,  0.3616,  0.0227,  0.9693,  0.0036,  0.9678,
         0.0232,  0.8943,  0.9204,  0.8474,  0.0889,  0.0414,  0.8093,
         0.6876,  0.1482,  0.3829,  0.9441,  0.9637,  0.0076,  0.5942,
         0.0144,  0.7687,  0.1199,  0.0837,  0.4868,  0.9543,  0.9760,
         0.9131,  0.0833,  0.9709,  0.9748,  0.1808,  0.9783,  0.8239,
         0.3934,  0.0046,  0.1240,  0.9369,  0.0816,  0.8937,  0.9306,
         0.9101,  0.8845,  0.8752,  0.0266,  0.9518,  0.0273,  0.3979,
         0.6205,  0.1762,  0.9877,  0.9221,  0.4675,  0.9922,  0.9794,
         0.8920,  0.7900,  0.7498,  0.8673,  0.6676,  0.9935,  0.9600,
         0.8402,  0.0391,  0.1703,  0.8946,  0.2631,  0.9170,  0.0388,
         0.0070,  0.0997,  0.9091,  0.8937,  0.1895,  0.1919,  0.1643,
         0.9992,  0.8625,  0.2300,  0.0215,  0.0722,  0.2436,  0.9733,
         0.9982,  0.0869,  0.9663,  0.7317,  0.1013,  0.0898,  0.9971,
         0.0088,  0.1554,  0.0310,  0.2508,  0.0253,  0.0082,  0.1674,
         0.8677,  0.1768,  0.0153,  0.0754,  0.6540,  0.9663,  0.9757,
         0.9512], device='cuda:0')
tensor(0.2955, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8302,  0.0449,  0.9415,  0.9638,  0.5260,  0.8113,  0.0778,
         0.1227,  0.1242,  0.9987,  0.9996,  0.0292,  0.9711,  0.9726,
         0.9370,  0.0186,  0.0049,  0.3438,  0.0006,  0.2084,  0.0749,
         0.0083,  0.8779,  0.0516,  0.0819,  0.9763,  0.4701,  0.9360,
         0.9934,  0.0083,  0.5959,  0.2259,  0.0023,  0.1122,  0.4479,
         0.0168,  0.9779,  0.0144,  0.0178,  0.5765,  0.0072,  0.9943,
         0.0271,  0.0023,  0.9523,  0.9786,  0.9583,  0.5078,  0.9696,
         0.8336,  0.3234,  0.9200,  0.7438,  0.1489,  0.3248,  0.9241,
         0.7485,  0.0019,  0.5571,  0.8226,  0.0175,  0.9225,  0.0058,
         0.9293,  0.0199,  0.9161,  0.0416,  0.9382,  0.1268,  0.3091,
         0.8910,  0.3946,  0.0129,  0.9257,  0.9268,  0.0173,  0.9584,
         0.1176,  0.0029,  0.5953,  0.9211,  0.1229,  0.2401,  0.9311,
         0.8429,  0.0674,  0.0338,  0.1656,  0.9714,  0.9896,  0.9047,
         0.1538,  0.7857,  0.2027,  0.0251,  0.9573,  0.9452,  0.0200,
         0.9921,  0.9702,  0.0022,  0.0615,  0.9019,  0.3333,  0.6289,
         0.9752,  0.0776,  0.8248,  0.9545,  0.0141,  0.8719,  0.9647,
         0.8789,  0.9291,  0.5593,  0.9585,  0.7900,  0.9998,  0.0387,
         0.0393,  0.0468,  0.0643,  0.9543,  0.9993,  0.0164,  0.0372,
         0.2011,  0.9177,  0.0349,  0.0154,  0.8660,  0.1917,  0.9517,
         0.9926,  0.0537,  0.9677,  0.0544,  0.9995,  0.0101,  0.9978,
         0.8527,  0.9805,  0.8830,  0.2345,  0.0264,  0.9738,  0.5668,
         0.9562,  0.0122,  0.9213,  0.0420,  0.0981,  0.1381,  0.9948,
         0.0472,  0.0309,  0.8785,  0.0070,  0.9288,  0.9996,  0.2845,
         0.9829,  0.0030,  0.0270,  0.0163,  0.0470,  0.0409,  0.0028,
         0.9969,  0.9998,  0.8371,  0.0315,  0.2130,  0.9877,  0.0063,
         0.0867,  0.8054,  0.0523,  0.9449,  0.0180,  0.9855,  0.1299,
         0.9995,  0.0040,  0.0310,  0.9689,  0.0013,  0.9618,  0.9696,
         0.9768,  0.0324,  0.2228,  0.8559,  0.0238,  0.0009,  0.1544,
         0.9939,  0.0434,  0.9218,  0.0043,  0.1196,  0.9488,  0.0447,
         0.0253,  0.9915,  0.6426,  0.9555,  0.0051,  0.8885,  0.9884,
         0.9964,  0.1761,  0.2395,  0.0040,  0.9577,  0.4259,  0.0440,
         0.0561,  0.0573,  0.9860,  0.9732,  0.9276,  0.0214,  0.0099,
         0.0137,  0.5123,  0.0005,  0.4019,  0.3621,  0.8058,  0.0957,
         0.9249,  0.9788,  0.9503,  0.8920,  0.1342,  0.8754,  0.8512,
         0.9851,  0.9215,  0.3765,  0.0520,  0.8851,  0.0120,  0.0984,
         0.8995,  0.9997,  0.9042,  0.9066,  0.2293,  0.7107,  0.1173,
         0.0662,  0.0268,  0.1201,  0.9923,  0.0579,  0.9560,  0.5853,
         0.9747,  0.0083,  0.6874,  0.7661,  0.9512,  0.9947,  0.3157,
         0.9991,  0.8757,  0.0836,  0.0098,  0.8666,  0.9549,  0.0978,
         0.7676,  0.9651,  0.9927,  0.0349,  0.9816,  0.0134,  0.9767,
         0.9681,  0.0241,  0.9943,  0.9998,  0.9994,  0.9739,  0.0433,
         0.9436,  0.0215,  0.9933,  0.9545,  0.9468,  0.0414,  0.0244,
         0.8394,  0.0380,  0.0490,  0.3268,  0.8940,  0.8635,  0.0547,
         0.0078,  0.0137,  0.9995,  0.3659,  0.5634,  0.0039,  0.2242,
         0.9741,  0.2425,  0.3582,  0.9323,  0.0921,  0.0227,  0.6083,
         0.0657,  0.9782,  0.9338,  0.2159,  0.3092,  0.0290,  0.0055,
         0.8416,  0.0701,  0.0945,  0.0433,  0.0043,  0.1315,  0.4069,
         0.8876,  0.1284,  0.0066,  0.8793,  0.8098,  0.7474,  0.9216,
         0.9777,  0.8628,  0.0792,  0.7402,  0.9983,  0.0312,  0.0016,
         0.0056,  0.0056,  0.0242,  0.0501,  0.5304,  0.0013,  0.9032,
         0.8388,  0.7340,  0.9465,  0.9858,  0.9918,  0.7019,  0.9903,
         0.0032,  0.8585,  0.9516,  0.9744,  0.4667,  0.5968,  0.0019,
         0.0269,  0.8271,  0.0621,  0.7389,  0.1387,  0.0050,  0.0018,
         0.0059,  0.3640,  0.0478,  0.2735,  0.0114,  0.1325,  0.9425,
         0.9731,  0.0165,  0.1043,  0.9621,  0.9339,  0.9612,  0.3590,
         0.1292,  0.0026,  0.9810,  0.6069,  0.1912,  0.8465,  0.0123,
         0.9128,  0.0504,  0.8960,  0.9705,  0.0310,  0.9871,  0.8884,
         0.9904,  0.9240,  0.9678,  0.9858,  0.9311,  0.8306,  0.9465,
         0.0100,  0.8166,  0.0013,  0.2035,  0.3469,  0.4296,  0.8605,
         0.2063,  0.9901,  0.4191,  0.0032,  0.0915,  0.0542,  0.6418,
         0.9080,  0.1048,  0.1063,  0.0202,  0.8700,  0.0279,  0.8925,
         0.0028,  0.9960,  0.3074,  0.9778,  0.0049,  0.0090,  0.4955,
         0.4735,  0.9618,  0.8472,  0.9938,  0.8983,  0.9648,  0.0032,
         0.0352,  0.8845,  0.0477,  0.9737,  0.9966,  0.3304,  0.9056,
         0.4259,  0.9484,  0.0413,  0.1596,  0.9781,  0.5025,  0.9026,
         0.9689,  0.0094,  0.0548,  0.8965,  0.0276,  0.1507,  0.0120,
         0.0241,  0.9850,  0.9060,  0.0575,  0.9887,  0.9006,  0.8280,
         0.9325,  0.0032,  0.9532,  0.9582,  0.1836,  0.9746,  0.3702,
         0.4703,  0.0357,  0.0745,  0.9557,  0.9711,  0.6640,  0.2512,
         0.9799,  0.9677,  0.8173,  0.9940,  0.9792,  0.0188,  0.9645,
         0.9895,  0.9528,  0.9399,  0.9631,  0.2915,  0.9935,  0.0788,
         0.0004,  0.1156,  0.8936,  0.0092,  0.9774,  0.0249,  0.0109,
         0.9998,  0.0046,  0.2239,  0.8662,  0.9668,  0.0962,  0.9811,
         0.8594], device='cuda:0')
tensor(0.2837, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1428,  0.8770,  0.1215,  0.9373,  0.5912,  0.9489,  0.8660,
         0.0520,  0.0109,  0.9387,  0.3666,  0.0695,  0.9497,  0.0448,
         0.0115,  0.0439,  0.9992,  0.9786,  0.9968,  0.2882,  0.9615,
         0.9248,  0.9085,  0.3522,  0.0130,  0.9616,  0.0124,  0.7497,
         0.0213,  0.0512,  0.0060,  0.9464,  0.9131,  0.1622,  0.9674,
         0.0001,  0.9350,  0.5801,  0.1230,  0.8296,  0.9729,  0.0834,
         0.6876,  0.1309,  0.9381,  0.9287,  0.0149,  0.9791,  0.0012,
         0.0226,  0.0130,  0.9494,  0.7360,  0.1061,  0.0359,  0.0572,
         0.0285,  0.0148,  0.3464,  0.2030,  0.4565,  0.9824,  0.0540,
         0.0028,  0.9896,  0.2559,  0.9680,  0.8927,  0.9717,  0.0145,
         0.9903,  0.9654,  0.0117,  0.0604,  0.0027,  0.1105,  0.9820,
         0.9434,  0.0396,  0.9485,  0.0808,  0.6918,  0.0109,  0.0699,
         0.9524,  0.1019,  0.8665,  0.1023,  0.0133,  0.9932,  0.2605,
         0.9199,  0.8840,  0.2011,  0.0215,  0.0481,  0.9411,  0.0428,
         0.0214,  0.2532,  0.9852,  0.0752,  0.0054,  0.0662,  0.7629,
         0.9815,  0.0310,  0.0718,  0.5647,  0.1274,  0.0238,  0.1172,
         0.0612,  0.0012,  0.9806,  0.0827,  0.0056,  0.1124,  0.9454,
         0.9375,  0.9991,  0.0636,  0.9880,  0.6256,  0.0063,  0.0039,
         0.8530,  0.0191,  0.0059,  0.9770,  0.0284,  0.9451,  0.9308,
         0.4020,  0.9185,  0.9982,  0.8297,  0.7957,  0.9254,  0.9406,
         0.4410,  0.9859,  0.0004,  0.0218,  0.9562,  0.8681,  0.9024,
         0.9839,  0.2227,  0.2823,  0.0035,  0.9493,  0.9374,  0.0043,
         0.1662,  0.0084,  0.0678,  0.0144,  0.8630,  0.8328,  0.9675,
         0.8417,  0.8601,  0.9999,  0.0111,  0.5608,  0.0120,  0.5467,
         0.3388,  0.3771,  0.6296,  0.0332,  0.2347,  0.4499,  0.9818,
         0.8898,  0.1751,  0.9821,  0.7501,  0.0370,  0.0013,  0.9715,
         0.0167,  0.9132,  0.0034,  0.0869,  0.5284,  0.9572,  0.1752,
         0.5296,  0.0358,  0.9841,  0.9842,  0.8442,  0.0173,  0.9356,
         0.0090,  0.9992,  0.2387,  0.0306,  0.0388,  0.2004,  0.9494,
         0.9628,  0.9553,  0.8725,  0.0063,  0.9869,  0.8389,  0.9323,
         0.6819,  0.9415,  0.0441,  0.5366,  0.0446,  0.0043,  0.0059,
         0.0127,  0.0511,  0.8711,  0.0073,  0.9513,  0.9209,  0.0468,
         0.2869,  0.8515,  0.9534,  0.8652,  0.0138,  0.0782,  0.0059,
         0.0050,  0.8958,  0.9316,  0.1512,  0.0202,  0.6650,  0.0113,
         0.0261,  0.7733,  0.6158,  0.1961,  0.0137,  0.0497,  0.0277,
         0.0062,  0.8173,  0.4112,  0.0010,  0.0372,  0.9383,  0.8243,
         0.4472,  0.8844,  0.9648,  0.0083,  0.8899,  0.9885,  0.1875,
         0.0021,  0.0057,  0.8778,  0.0653,  0.0586,  0.9097,  0.0183,
         0.4181,  0.1185,  0.9798,  0.0244,  0.0119,  0.9831,  0.0585,
         0.7215,  0.9395,  0.9610,  0.0014,  0.0205,  0.0557,  0.0023,
         0.5994,  0.0712,  0.0085,  0.5424,  0.9148,  0.9912,  0.9683,
         0.0640,  0.0659,  0.0924,  0.0790,  0.9677,  0.8501,  0.9031,
         0.0625,  0.9764,  0.0521,  0.0538,  0.9760,  0.5515,  0.2372,
         0.7684,  0.0092,  0.0808,  0.9796,  0.9584,  0.9525,  0.1830,
         0.0184,  0.7700,  0.0276,  0.7298,  0.0199,  0.5910,  0.0599,
         0.9685,  0.9927,  0.9907,  0.1554,  0.9795,  0.0004,  0.0093,
         0.9730,  0.0041,  0.0005,  0.0323,  0.6884,  0.3634,  0.0187,
         0.6631,  0.0084,  0.2632,  0.0025,  0.1620,  0.9847,  0.0018,
         0.6493,  0.0101,  0.9981,  0.2991,  0.0518,  0.0010,  0.9322,
         0.0401,  0.0268,  0.9454,  0.9035,  0.9841,  0.0085,  0.8513,
         0.0262,  0.0760,  0.2915,  0.5461,  0.0535,  0.9853,  0.0296,
         0.9367,  0.0884,  0.0208,  0.8556,  0.0166,  0.0220,  0.0617,
         0.3439,  0.5668,  0.9551,  0.0086,  0.0240,  0.9790,  0.8517,
         0.0234,  0.4581,  0.9699,  0.9198,  0.9395,  0.0071,  0.8241,
         0.0309,  0.8914,  0.9026,  0.0685,  0.0092,  0.8643,  0.9299,
         0.0012,  0.7198,  0.0032,  0.0379,  0.0015,  0.6384,  0.9774,
         0.8864,  0.3809,  0.0095,  0.0631,  0.9997,  0.9505,  0.9905,
         0.8708,  0.9803,  0.9613,  0.0047,  0.0048,  0.9313,  0.4550,
         0.3377,  0.7707,  0.9898,  0.9642,  0.0410,  0.0180,  0.0114,
         0.1158,  0.0074,  0.0030,  0.0006,  0.0639,  0.0015,  0.9830,
         0.9970,  0.9357,  0.0212,  0.0271,  0.9801,  0.8243,  0.9465,
         0.9979,  0.9236,  0.0284,  0.8678,  0.0028,  0.6860,  0.0074,
         0.0105,  0.0118,  0.0398,  0.4646,  0.0045,  0.0097,  0.0995,
         0.9304,  0.0017,  0.0181,  0.0116,  0.7788,  0.0385,  0.8549,
         0.9468,  0.9420,  0.0704,  0.5450,  0.9856,  0.0312,  0.0207,
         0.9519,  0.0368,  0.0643,  0.9464,  0.8017,  0.0019,  0.9896,
         0.9057,  0.0089,  0.9184,  0.1806,  0.9101,  0.0016,  0.0040,
         0.0291,  0.0897,  0.9999,  0.0136,  0.9849,  0.0005,  0.0074,
         0.0304,  0.0036,  0.9627,  0.9735,  0.0917,  0.9042,  0.0219,
         0.0240,  0.0142,  0.4419,  0.8749,  0.0084,  0.9185,  0.5281,
         0.0465,  0.9875,  0.0031,  0.5620,  0.0217,  0.0602,  0.9399,
         0.4550,  0.0116,  0.9836,  0.0321,  0.8221,  0.8601,  0.0875,
         0.8896,  0.0567,  0.2570,  0.9979,  0.0949,  0.0033,  0.1077,
         0.8979], device='cuda:0')
tensor(0.2824, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8518,  0.3825,  0.0141,  0.1683,  0.9762,  0.9725,  0.0647,
         0.9547,  0.7431,  0.9943,  0.0274,  0.8022,  0.8266,  0.0281,
         0.3651,  0.9410,  0.0572,  0.0055,  0.0031,  0.1236,  0.9375,
         0.0502,  0.9683,  0.8599,  0.0198,  0.9977,  0.9304,  0.0461,
         0.1887,  0.9567,  0.0484,  0.9972,  0.0195,  0.0410,  0.9349,
         0.1391,  0.0115,  0.9310,  0.8303,  0.2182,  0.9958,  0.0091,
         0.0456,  0.0437,  0.9998,  0.7806,  0.4946,  0.0267,  0.0524,
         0.9531,  0.9927,  0.7538,  0.6688,  0.1353,  0.0249,  0.9623,
         0.8826,  0.0309,  0.9507,  0.0930,  0.0294,  0.2832,  0.0858,
         0.0516,  0.9141,  0.0186,  0.4214,  0.9650,  0.9902,  0.0095,
         0.9610,  0.9448,  0.0755,  0.9849,  0.0018,  0.9781,  0.4530,
         0.8765,  0.0416,  0.9979,  0.1179,  0.0054,  0.1444,  0.3090,
         0.0439,  0.0989,  0.0285,  0.0009,  0.1972,  0.8589,  0.9854,
         0.8898,  0.2626,  0.7860,  0.0138,  0.9917,  0.6073,  0.9805,
         0.7820,  0.0376,  0.9991,  0.8977,  0.5666,  0.0003,  0.9566,
         0.0259,  0.0005,  0.0041,  0.7844,  0.9482,  0.0122,  0.0042,
         0.9902,  0.0605,  0.0321,  0.0447,  0.9197,  0.9864,  0.1504,
         0.0290,  0.0323,  0.8026,  0.8066,  0.9355,  0.6173,  0.9267,
         0.9917,  0.0356,  0.8635,  0.0058,  0.9326,  0.0508,  0.0450,
         0.9437,  0.1155,  0.5458,  0.0390,  0.0164,  0.0433,  0.3320,
         0.9352,  0.9831,  0.0793,  0.0409,  0.2389,  0.9969,  0.0773,
         0.9903,  0.1242,  0.0325,  0.0198,  0.7030,  0.0242,  0.0196,
         0.9683,  0.9745,  0.8947,  0.0027,  0.9812,  0.0047,  0.0653,
         0.7221,  0.9606,  0.0011,  0.9505,  0.9066,  0.0089,  0.0197,
         0.0005,  0.9830,  0.9071,  0.9260,  0.1107,  0.2166,  0.9699,
         0.1917,  0.9995,  0.0419,  0.9997,  0.3878,  0.9725,  0.9636,
         0.9738,  0.0137,  0.9827,  0.0013,  0.9988,  0.9881,  0.8969,
         0.3053,  0.0569,  0.1098,  0.0644,  0.1184,  0.3739,  0.0193,
         0.8093,  0.7606,  0.9530,  0.7824,  0.0046,  0.1196,  0.1363,
         0.9010,  0.0283,  0.9086,  0.0105,  0.0260,  0.4445,  0.2599,
         0.9862,  0.8474,  0.0302,  0.7424,  0.0042,  0.0291,  0.0053,
         0.8696,  0.0207,  0.0026,  0.0221,  0.3986,  0.9183,  0.9045,
         0.9328,  0.4594,  0.0207,  0.9755,  0.9661,  0.4161,  0.0260,
         0.9992,  0.9858,  0.9803,  0.9754,  0.3988,  0.9565,  0.0368,
         0.9897,  0.1278,  0.0330,  0.0066,  0.0201,  0.9932,  0.8638,
         0.0036,  0.0506,  0.3747,  0.8956,  0.1677,  0.6200,  0.0736,
         0.9564,  0.8165,  0.8655,  0.0061,  0.0032,  0.9627,  0.0310,
         0.5257,  0.0036,  0.9912,  0.0397,  0.9170,  0.8104,  0.5335,
         0.7617,  0.9401,  0.8824,  0.0136,  0.4949,  0.1711,  0.0073,
         0.0068,  0.9294,  0.2040,  0.9610,  0.0414,  0.2074,  0.9567,
         0.0568,  0.0017,  0.0029,  0.8891,  0.0278,  0.9991,  0.6285,
         0.0479,  0.2920,  0.0320,  0.0103,  0.9829,  0.8447,  0.0283,
         0.7161,  0.0236,  0.9956,  0.5194,  0.7291,  0.8740,  0.0108,
         0.0546,  0.0751,  0.8679,  0.9189,  0.7884,  0.7561,  0.0057,
         0.0106,  0.0548,  0.9651,  0.8050,  0.0445,  0.1168,  0.9869,
         0.0166,  0.9952,  0.6465,  0.6396,  0.9624,  0.3199,  0.0695,
         0.0035,  0.0119,  0.7759,  0.8888,  0.0164,  0.0200,  0.0011,
         0.8441,  0.6439,  0.3338,  0.1361,  0.1350,  0.8984,  0.0047,
         0.1442,  0.7914,  0.6642,  0.3688,  0.9811,  0.8553,  0.0294,
         0.8932,  0.9871,  0.0030,  0.1375,  0.9843,  0.0703,  0.0007,
         0.6364,  0.9533,  0.1400,  0.9205,  0.8167,  0.7378,  0.7299,
         0.0299,  0.3195,  0.5564,  0.8701,  0.9848,  0.0136,  0.0039,
         0.0214,  0.0217,  0.2800,  0.9431,  0.8937,  0.0288,  0.0298,
         0.5884,  0.0077,  0.0017,  0.6708,  0.8795,  0.0089,  0.0915,
         0.8283,  0.0670,  0.9040,  0.9725,  0.0519,  0.1568,  0.4113,
         0.0023,  0.3050,  0.8204,  0.0432,  0.9560,  0.9357,  0.9092,
         0.9303,  0.9702,  0.7348,  0.7477,  0.0973,  0.8394,  0.0432,
         0.2023,  0.0461,  0.0096,  0.0934,  0.8842,  0.1717,  0.9186,
         0.9566,  0.1527,  0.2966,  0.0415,  0.9914,  0.7253,  0.0640,
         0.0015,  0.1818,  0.0246,  0.9782,  0.0101,  0.0530,  0.0021,
         0.8717,  0.0385,  0.6129,  0.0042,  0.9998,  0.9971,  0.9826,
         0.2876,  0.9907,  0.9418,  0.9617,  0.9592,  0.0545,  0.9023,
         0.0437,  0.0686,  0.9966,  0.4388,  0.9339,  0.8231,  0.0015,
         0.5352,  0.8756,  0.0007,  0.5755,  0.9777,  0.9786,  0.0140,
         0.8655,  0.0256,  0.1743,  0.9664,  0.0005,  0.9392,  0.0008,
         0.9797,  0.0143,  0.9387,  0.4188,  0.0026,  0.8709,  0.8463,
         0.0098,  0.0277,  0.1879,  0.7705,  0.1234,  0.0252,  0.0590,
         0.1022,  0.9672,  0.8974,  0.0391,  0.0053,  0.0155,  0.9526,
         0.0216,  0.3209,  0.9733,  0.0324,  0.9233,  0.9332,  0.9009,
         0.4393,  0.6011,  0.0459,  0.5648,  0.6685,  0.9066,  0.1080,
         0.9296,  0.0054,  0.9660,  0.0926,  0.2409,  0.5330,  0.8961,
         0.7670,  0.3898,  0.4589,  0.0864,  0.9477,  0.7141,  0.2158,
         0.0267,  0.0084,  0.0216,  0.5762,  0.0143,  0.9184,  0.0363,
         0.0670], device='cuda:0')
tensor(0.2828, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9748,  0.3059,  0.9664,  0.9751,  0.8468,  0.7844,  0.0274,
         0.5059,  0.0542,  0.0293,  0.0786,  0.7874,  0.9536,  0.0842,
         0.2425,  0.0416,  0.0350,  0.0111,  0.9780,  0.9971,  0.8255,
         0.9846,  0.0041,  0.0085,  0.3569,  0.9511,  0.7591,  0.9373,
         0.8737,  0.2953,  0.4457,  0.0752,  0.0145,  0.0251,  0.8415,
         0.1475,  0.9988,  0.6155,  0.1099,  0.9315,  0.9089,  0.9452,
         0.9877,  0.0221,  0.3918,  0.9119,  0.0559,  0.9302,  0.0339,
         0.1143,  0.0067,  0.9299,  0.9406,  0.7257,  0.2015,  0.8262,
         0.0280,  0.0238,  0.4394,  0.0299,  0.9777,  0.8325,  0.7963,
         0.0150,  0.7011,  0.0247,  0.9550,  0.1179,  0.0664,  0.9188,
         0.0810,  0.1234,  0.2020,  0.0266,  0.8568,  0.9156,  0.0056,
         0.6765,  0.5956,  0.1725,  0.3170,  0.5960,  0.8982,  0.9417,
         0.1250,  0.9328,  0.0829,  0.9704,  0.3439,  0.8146,  0.0149,
         0.2327,  0.0714,  0.0252,  0.0809,  0.9722,  0.0406,  0.9767,
         0.2617,  0.0265,  0.3372,  0.3208,  0.8463,  0.0046,  0.9654,
         0.9511,  0.5246,  0.0918,  0.4446,  0.0217,  0.1403,  0.9466,
         0.0310,  0.8476,  0.6139,  0.7327,  0.1734,  0.1334,  0.6594,
         0.0475,  0.9968,  0.4938,  0.7787,  0.9931,  0.9036,  0.0338,
         0.0279,  0.0770,  0.3273,  0.0562,  0.6514,  0.2005,  0.9037,
         0.0560,  0.7435,  0.9990,  0.9428,  0.0122,  0.0215,  0.9353,
         0.7263,  0.1315,  0.0117,  0.0139,  0.9852,  0.8435,  0.0418,
         0.0362,  0.0193,  0.7572,  0.2266,  0.0793,  0.9886,  0.8083,
         0.0112,  0.0719,  0.4747,  0.0285,  0.9587,  0.9943,  0.0042,
         0.0655,  0.1533,  0.0121,  0.0126,  0.9790,  0.0178,  0.9465,
         0.1242,  0.9358,  0.1456,  0.9889,  0.5423,  0.3985,  0.2933,
         0.0757,  0.5129,  0.3378,  0.9998,  0.7854,  0.2708,  0.0031,
         0.9718,  0.6674,  0.9841,  0.2292,  0.9822,  0.9405,  0.9634,
         0.0060,  0.9355,  0.1986,  0.2638,  0.8442,  0.9410,  0.6657,
         0.0229,  0.7815,  0.0427,  0.6360,  0.9898,  0.1155,  0.8173,
         0.8411,  0.3563,  0.4916,  0.6128,  0.0060,  0.9259,  0.9821,
         0.9371,  0.9981,  0.9197,  0.0553,  0.9176,  0.0284,  0.9154,
         0.2259,  0.0009,  0.2253,  0.5652,  0.9729,  0.1842,  0.3435,
         0.9569,  0.0353,  0.3762,  0.1437,  0.8313,  0.9984,  0.3922,
         0.0861,  0.0186,  0.0174,  0.4409,  0.4643,  0.7556,  0.9848,
         0.1113,  0.0262,  0.9809,  0.8945,  0.1693,  0.9131,  0.7974,
         0.0406,  0.0013,  0.9695,  0.9510,  0.9104,  0.8929,  0.0796,
         0.0144,  0.0667,  0.0742,  0.8863,  0.3455,  0.0089,  0.9810,
         0.5444,  0.2734,  0.8471,  0.7278,  0.2706,  0.0153,  0.9170,
         0.8566,  0.5517,  0.0607,  0.8868,  0.4047,  0.9651,  0.9900,
         0.0241,  0.6379,  0.7692,  0.7407,  0.2956,  0.0060,  0.9852,
         0.8451,  0.0126,  0.3737,  0.8960,  0.0282,  0.5854,  0.9562,
         0.0244,  0.7508,  0.0517,  0.8553,  0.9327,  0.1575,  0.9691,
         0.8737,  0.0073,  0.0598,  0.9719,  0.9897,  0.0146,  0.7637,
         0.2550,  0.0230,  0.1722,  0.1500,  0.2519,  0.5367,  0.4389,
         0.0146,  0.8808,  0.0175,  0.7135,  0.7547,  0.7096,  0.0261,
         0.6725,  0.8642,  0.0545,  0.1987,  0.5275,  0.8826,  0.2660,
         0.0592,  0.8854,  0.0140,  0.1053,  0.8855,  0.0594,  0.1277,
         0.8462,  0.8676,  0.0181,  0.9187,  0.4436,  0.7622,  0.9856,
         0.0050,  0.0242,  0.9069,  0.8501,  0.0806,  0.0721,  0.9186,
         0.9342,  0.5785,  0.0454,  0.0961,  0.5052,  0.0028,  0.0118,
         0.2396,  0.8259,  0.0967,  0.1818,  0.1671,  0.9912,  0.2282,
         0.9992,  0.1974,  0.4726,  0.0872,  0.0132,  0.9700,  0.0336,
         0.2743,  0.6187,  0.8209,  0.5108,  0.0031,  0.8896,  0.9543,
         0.9438,  0.0571,  0.2104,  0.0209,  0.9553,  0.0298,  0.9985,
         0.9815,  0.7924,  0.0552,  0.0258,  0.1131,  0.0080,  0.7689,
         0.9785,  0.9135,  0.0125,  0.2850,  0.6787,  0.3500,  0.9812,
         0.1834,  0.9032,  0.9195,  0.6561,  0.0302,  0.0078,  0.8321,
         0.0010,  0.2062,  0.9862,  0.9269,  0.9984,  0.0662,  0.0923,
         0.6425,  0.0471,  0.3823,  0.3881,  0.6098,  0.9877,  0.0183,
         0.9384,  0.8820,  0.8859,  0.0281,  0.2785,  0.9728,  0.7242,
         0.0049,  0.1387,  0.0159,  0.3316,  0.6303,  0.8505,  0.1748,
         0.9838,  0.9875,  0.9363,  0.3858,  0.2988,  0.1224,  0.1157,
         0.0485,  0.4220,  0.0036,  0.3053,  0.0728,  0.0244,  0.7640,
         0.9019,  0.0709,  0.2707,  0.8673,  0.9870,  0.0157,  0.1948,
         0.1166,  0.9998,  0.1956,  0.7461,  0.1696,  0.0392,  0.1854,
         0.1106,  0.8816,  0.8799,  0.0285,  0.0333,  0.0012,  0.6762,
         0.9739,  0.1191,  0.9851,  0.9875,  0.8703,  0.9928,  0.1533,
         0.8647,  0.0311,  0.0334,  0.5378,  0.9953,  0.5673,  0.6934,
         0.9281,  0.9606,  0.1253,  0.0077,  0.9906,  0.9958,  0.9387,
         0.1043,  0.4965,  0.0344,  0.8916,  0.6593,  0.6281,  0.9958,
         0.0005,  0.9886,  0.0014,  0.0046,  0.0394,  0.9863,  0.8514,
         0.0758,  0.0413,  0.9705,  0.8807,  0.2061,  0.8578,  0.1306,
         0.5993,  0.3222,  0.9466,  0.9964,  0.0129,  0.2678,  0.8567,
         0.0556], device='cuda:0')
tensor(0.2955, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1109,  0.0137,  0.0830,  0.5254,  0.3455,  0.0453,  0.9537,
         0.0055,  0.9088,  0.9675,  0.8181,  0.5143,  0.0476,  0.6205,
         0.0905,  0.0404,  0.3604,  0.2539,  0.9729,  0.2320,  0.8594,
         0.0333,  0.1459,  0.0200,  0.0003,  0.7752,  0.0923,  0.9099,
         0.0347,  0.0141,  0.0551,  0.6914,  0.8620,  0.9239,  0.7220,
         0.0172,  0.8968,  0.6242,  0.0430,  0.1741,  0.8438,  0.9996,
         0.8432,  0.6426,  0.1074,  0.6583,  0.8930,  0.4597,  0.0227,
         0.9340,  0.1589,  0.0171,  0.0312,  0.0364,  0.1901,  0.6614,
         0.9583,  0.6518,  0.6895,  0.9818,  0.1226,  0.0488,  0.0105,
         0.9179,  0.8856,  0.9672,  0.9674,  0.7226,  0.9943,  0.9269,
         0.0152,  0.0438,  0.0126,  0.5889,  0.0221,  0.5016,  0.6323,
         0.0024,  0.1558,  0.1713,  0.0027,  0.0176,  0.9588,  0.0033,
         0.8985,  0.8759,  0.1359,  0.8951,  0.9858,  0.9340,  0.9315,
         0.2178,  0.2555,  0.2669,  0.0138,  0.6214,  0.1683,  0.9872,
         0.9410,  0.0545,  0.0742,  0.2543,  0.9858,  0.0024,  0.5835,
         0.9366,  0.0257,  0.0163,  0.9067,  0.0133,  0.9917,  0.2478,
         0.1657,  0.0120,  0.8642,  0.2064,  0.3569,  0.0134,  0.1483,
         0.1681,  0.9827,  0.0013,  0.8898,  0.0152,  0.0208,  0.1585,
         0.9558,  0.4174,  0.9563,  0.0579,  0.5920,  0.9438,  0.7342,
         0.1324,  0.9624,  0.0900,  0.7253,  0.9399,  0.0289,  0.9784,
         0.3241,  0.0523,  0.8908,  0.9087,  0.0283,  0.2208,  0.8815,
         0.3793,  0.2646,  0.3553,  0.8595,  0.0411,  0.0388,  0.9965,
         0.0422,  0.8081,  0.9977,  0.1142,  0.0834,  0.0055,  0.0495,
         0.8609,  0.4638,  0.5744,  0.8653,  0.0103,  0.1621,  0.1476,
         0.9791,  0.4355,  0.6202,  0.8922,  0.9122,  0.2289,  0.0898,
         0.2676,  0.8276,  0.0338,  0.0349,  0.9277,  0.3958,  0.1610,
         0.1857,  0.1160,  0.9655,  0.9298,  0.8760,  0.2559,  0.2824,
         0.9930,  0.0019,  0.7315,  0.7944,  0.0163,  0.9409,  0.9876,
         0.3987,  0.0532,  0.6215,  0.0745,  0.8791,  0.9892,  0.1767,
         0.0266,  0.0114,  0.8506,  0.0565,  0.1056,  0.6831,  0.9906,
         0.9876,  0.3711,  0.9005,  0.8901,  0.7342,  0.9403,  0.0444,
         0.9603,  0.2509,  0.0604,  0.2061,  0.0005,  0.1600,  0.0501,
         0.0796,  0.7736,  0.2308,  0.9765,  0.2345,  0.9242,  0.9472,
         0.9401,  0.0119,  0.8830,  0.0204,  0.9705,  0.2708,  0.9575,
         0.9043,  0.0809,  0.9090,  0.1425,  0.0039,  0.9031,  0.1281,
         0.9101,  0.1095,  0.7066,  0.9185,  0.8764,  0.0413,  0.6469,
         0.0768,  0.7474,  0.9655,  0.8602,  0.1087,  0.9496,  0.9617,
         0.0224,  0.5622,  0.9300,  0.0620,  0.0241,  0.5292,  0.2119,
         0.7530,  0.8626,  0.9527,  0.1717,  0.9585,  0.0652,  0.0415,
         0.0344,  0.2835,  0.0780,  0.9355,  0.0847,  0.0340,  0.9809,
         0.6946,  0.8677,  0.8732,  0.9662,  0.0024,  0.0659,  0.8817,
         0.4380,  0.9904,  0.7897,  0.8020,  0.0062,  0.9193,  0.0154,
         0.7913,  0.0554,  0.9917,  0.0089,  0.0521,  0.2440,  0.8240,
         0.9812,  0.8381,  0.7617,  0.9362,  0.2040,  0.0351,  0.1581,
         0.7777,  0.8217,  0.0820,  0.1708,  0.1484,  0.9614,  0.0017,
         0.9899,  0.0446,  0.9785,  0.3548,  0.0292,  0.0095,  0.8882,
         0.5402,  0.4044,  0.2563,  0.8033,  0.1230,  0.0074,  0.5677,
         0.1983,  0.9914,  0.0675,  0.9995,  0.9988,  0.8640,  0.9992,
         0.9610,  0.9256,  0.0242,  0.9652,  0.9949,  0.9576,  0.9109,
         0.7937,  0.8376,  0.0018,  0.9318,  0.1697,  0.5003,  0.9178,
         0.7894,  0.2452,  0.8209,  0.9925,  0.1682,  0.6029,  0.5977,
         0.4502,  0.0169,  0.9886,  0.0847,  0.1156,  0.0602,  0.9615,
         0.9034,  0.0634,  0.2723,  0.9759,  0.9915,  0.9124,  0.6859,
         0.9550,  0.8648,  0.8796,  0.8283,  0.2398,  0.1417,  0.9072,
         0.3860,  0.0050,  0.0916,  0.8817,  0.4065,  0.0032,  0.9172,
         0.0062,  0.0302,  0.9823,  0.2075,  0.6450,  0.0579,  0.7899,
         0.0258,  0.0138,  0.4335,  0.0958,  0.0881,  0.0028,  0.9339,
         0.7844,  0.1427,  0.9695,  0.0671,  0.2805,  0.7504,  0.9893,
         0.0164,  0.5841,  0.9451,  0.4857,  0.0038,  0.0219,  0.9131,
         0.9487,  0.8362,  0.0686,  0.0240,  0.9863,  0.1231,  0.0175,
         0.0670,  0.0065,  0.9575,  0.8585,  0.9700,  0.9613,  0.0005,
         0.0171,  0.8263,  0.0300,  0.2189,  0.1777,  0.0043,  0.0092,
         0.9251,  0.2317,  0.9725,  0.8120,  0.2026,  0.0932,  0.1522,
         0.0075,  0.1763,  0.0112,  0.1251,  0.9173,  0.9888,  0.5616,
         0.9172,  0.9029,  0.0082,  0.0255,  0.8236,  0.0320,  0.1316,
         0.0255,  0.5377,  0.9878,  0.9757,  0.0071,  0.9627,  0.8961,
         0.0110,  0.8144,  0.9973,  0.1572,  0.9948,  0.9710,  0.9599,
         0.0012,  0.9058,  0.3845,  0.9296,  0.9460,  0.8520,  0.9021,
         0.0011,  0.9975,  0.0071,  0.9082,  0.9204,  0.8095,  0.0836,
         0.3995,  0.9521,  0.4768,  0.9731,  0.9950,  0.4100,  0.8853,
         0.0018,  0.9656,  0.7982,  0.2410,  0.9686,  0.0702,  0.0351,
         0.3299,  0.9773,  0.0584,  0.4151,  0.1360,  0.0061,  0.0522,
         0.0175,  0.7855,  0.0085,  0.0027,  0.7989,  0.3955,  0.1736,
         0.9747], device='cuda:0')
tensor(0.2414, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0372,  0.9692,  0.8026,  0.0128,  0.9864,  0.0117,  0.0139,
         0.0050,  0.9991,  0.0818,  0.7305,  0.0333,  0.2897,  0.9863,
         0.8581,  0.2736,  0.9753,  0.9754,  0.1044,  0.0924,  0.7085,
         0.7357,  0.0949,  0.8937,  0.0081,  0.0105,  0.8679,  0.0659,
         0.4654,  0.8966,  0.7525,  0.9684,  0.9785,  0.8946,  0.0132,
         0.0826,  0.7476,  0.1227,  0.0703,  0.9516,  0.0830,  0.0208,
         0.7609,  0.2112,  0.9926,  0.0389,  0.8246,  0.0410,  0.9726,
         0.2016,  0.9888,  0.8193,  0.8767,  0.0463,  0.4572,  0.0290,
         0.9779,  0.0995,  0.9535,  0.8607,  0.8960,  0.9612,  0.9226,
         0.9827,  0.9834,  0.9792,  0.4915,  0.7530,  0.9462,  0.9831,
         0.0076,  0.9803,  0.8726,  0.3344,  0.9409,  0.0993,  0.0128,
         0.0391,  0.4393,  0.9216,  0.1533,  0.0372,  0.9670,  0.2511,
         0.2092,  0.8899,  0.9524,  0.1439,  0.9700,  0.9515,  0.0127,
         0.7010,  0.0689,  0.6807,  0.0458,  0.8768,  0.4873,  0.7724,
         0.8585,  0.8965,  0.9793,  0.9903,  0.9836,  0.9170,  0.9884,
         0.9829,  0.9562,  0.1788,  0.9738,  0.0263,  0.8043,  0.0120,
         0.1027,  0.9499,  0.2355,  0.0259,  0.8578,  0.6965,  0.0797,
         0.2573,  0.9931,  0.9731,  0.5108,  0.1755,  0.9306,  0.5937,
         0.9267,  0.0046,  0.9517,  0.0364,  0.6572,  0.0667,  0.0680,
         0.0625,  0.9643,  0.9460,  0.0208,  0.9609,  0.1064,  0.9073,
         0.1934,  0.9226,  0.3538,  0.6515,  0.8603,  0.1763,  0.9060,
         0.9764,  0.0927,  0.6141,  0.4451,  0.9583,  0.0801,  0.8565,
         0.9436,  0.1034,  0.0386,  0.0085,  0.9792,  0.9079,  0.0018,
         0.0515,  0.0263,  0.8330,  0.0261,  0.0181,  0.9694,  0.0886,
         0.9990,  0.8930,  0.1116,  0.4738,  0.8422,  0.0345,  0.6408,
         0.9991,  0.8843,  0.9837,  0.7317,  0.4656,  0.2489,  0.9577,
         0.9713,  0.9648,  0.8263,  0.3205,  0.0137,  0.0475,  0.0137,
         0.9311,  0.9692,  0.0029,  0.4916,  0.9872,  0.0086,  0.8542,
         0.1158,  0.4588,  0.0114,  0.8849,  0.2797,  0.9407,  0.0549,
         0.9962,  0.9673,  0.0032,  0.9833,  0.0936,  0.9853,  0.2569,
         0.6683,  0.2981,  0.2498,  0.1266,  0.0395,  0.6406,  0.9268,
         0.2400,  0.4034,  0.9784,  0.4037,  0.9386,  0.9363,  0.9061,
         0.0433,  0.9847,  0.9450,  0.0223,  0.0419,  0.9222,  0.9991,
         0.9269,  0.0187,  0.9614,  0.9373,  0.9521,  0.8578,  0.0530,
         0.8885,  0.7701,  0.9639,  0.9634,  0.9568,  0.9996,  0.0157,
         0.1675,  0.1563,  0.9986,  0.9498,  0.9992,  0.8882,  0.3337,
         0.0542,  0.9137,  0.8795,  0.9720,  0.9468,  0.2344,  0.9668,
         0.9701,  0.9847,  0.3734,  0.1802,  0.7682,  0.9774,  0.0192,
         0.0217,  0.9878,  0.9011,  0.9894,  0.8155,  0.9312,  0.1422,
         0.8993,  0.9411,  0.9669,  0.9430,  0.5887,  0.4120,  0.7784,
         0.0514,  0.8690,  0.9991,  0.9114,  0.1562,  0.9661,  0.9931,
         0.9859,  0.9268,  0.9532,  0.0886,  0.2320,  0.0762,  0.0404,
         0.9919,  0.9791,  0.0580,  0.1909,  0.7970,  0.2565,  0.0598,
         0.0679,  0.9850,  0.0132,  0.0169,  0.9258,  0.1586,  0.9980,
         0.0421,  0.9429,  0.8194,  0.7075,  0.0136,  0.0554,  0.0710,
         0.0604,  0.6202,  0.8512,  0.8981,  0.9254,  0.3300,  0.9511,
         0.9008,  0.8771,  0.3482,  0.2714,  0.0158,  0.0013,  0.5300,
         0.0621,  0.4441,  0.9513,  0.5133,  0.2413,  0.9661,  0.3273,
         0.1369,  0.1300,  0.0061,  0.0088,  0.4658,  0.1670,  0.0466,
         0.5452,  0.9199,  0.9818,  0.0631,  0.0305,  0.6580,  0.8628,
         0.1702,  0.0066,  0.2355,  0.0481,  0.0649,  0.8443,  0.0930,
         0.9736,  0.0677,  0.0375,  0.3087,  0.9700,  0.7688,  0.8175,
         0.9462,  0.2819,  0.0331,  0.7990,  0.3687,  0.9563,  0.7469,
         0.0156,  0.1277,  0.0145,  0.9793,  0.7513,  0.6323,  0.9721,
         0.9099,  0.0408,  0.1689,  0.0006,  0.0107,  0.7142,  0.0238,
         0.2108,  0.9145,  0.6668,  0.0778,  0.1440,  0.7815,  0.0676,
         0.1192,  0.9011,  0.9337,  0.0739,  0.0289,  0.0423,  0.0069,
         0.9749,  0.9015,  0.3527,  0.9872,  0.0317,  0.0084,  0.9075,
         0.9331,  0.3340,  0.8784,  0.0360,  0.0526,  0.4103,  0.9365,
         0.1479,  0.2025,  0.3726,  0.0479,  0.9937,  0.1122,  0.9901,
         0.9726,  0.9840,  0.0548,  0.9652,  0.9903,  0.6846,  0.9778,
         0.9197,  0.0217,  0.0659,  0.0987,  0.0688,  0.0213,  0.9772,
         0.9326,  0.7759,  0.2066,  0.9292,  0.6484,  0.9815,  0.0800,
         0.8581,  0.7333,  0.9446,  0.3642,  0.9732,  0.0099,  0.9580,
         0.4791,  0.0714,  0.8576,  0.6569,  0.9773,  0.0286,  0.0776,
         0.0874,  0.8745,  0.9514,  0.0173,  0.9716,  0.2265,  0.0968,
         0.4353,  0.0018,  0.9610,  0.0089,  0.9766,  0.8458,  0.9344,
         0.0176,  0.5676,  0.3646,  0.5268,  0.7889,  0.9994,  0.0310,
         0.0873,  0.0524,  0.1215,  0.9986,  0.0676,  0.0512,  0.9574,
         0.2329,  0.7434,  0.7385,  0.4267,  0.0018,  0.0025,  0.9986,
         0.0314,  0.0026,  0.2357,  0.6635,  0.9912,  0.9747,  0.9108,
         0.0544,  0.6859,  0.0791,  0.9305,  0.9554,  0.8730,  0.8671,
         0.8419,  0.5223,  0.9712,  0.5496,  0.9960,  0.0081,  0.2819,
         0.9979], device='cuda:0')
tensor(0.2764, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0628,  0.9828,  0.9807,  0.2147,  0.0438,  0.9401,  0.9965,
         0.1286,  0.9824,  0.8978,  0.9378,  0.0379,  0.0355,  0.2276,
         0.1285,  0.0417,  0.9854,  0.9824,  0.1190,  0.1609,  0.0147,
         0.9987,  0.9997,  0.1435,  0.0220,  0.0082,  0.0334,  0.8582,
         0.9412,  0.9702,  0.0178,  0.1565,  0.0570,  0.9751,  0.7453,
         0.1443,  0.0623,  0.1785,  0.6478,  0.9367,  0.6179,  0.2471,
         0.2537,  0.3928,  0.0714,  0.9346,  0.9606,  0.9988,  0.9767,
         0.0125,  0.4261,  0.1713,  0.8982,  0.0128,  0.0692,  0.0606,
         0.5655,  0.7084,  0.0653,  0.3743,  0.0264,  0.1407,  0.0019,
         0.6673,  0.9961,  0.9782,  0.9348,  0.6030,  0.0081,  0.0032,
         0.7959,  0.9411,  0.0119,  0.0572,  0.9720,  0.0094,  0.4451,
         0.2287,  0.0264,  0.9150,  0.9684,  0.4812,  0.9543,  0.2279,
         0.0057,  0.9862,  0.0034,  0.9472,  0.0078,  0.8962,  0.9744,
         0.9992,  0.3138,  0.4126,  0.0148,  0.7060,  0.8268,  0.7702,
         0.9675,  0.0215,  0.0002,  0.9146,  0.9590,  0.8020,  0.1740,
         0.0234,  0.3761,  0.3113,  0.2550,  0.4393,  0.9813,  0.1238,
         0.0132,  0.1796,  0.5672,  0.0391,  0.9333,  0.1139,  0.2455,
         0.5942,  0.6406,  0.0757,  0.9941,  0.9344,  0.7125,  0.7899,
         0.9242,  0.0070,  0.7688,  0.8318,  0.2223,  0.2703,  0.1696,
         0.0218,  0.7584,  0.0351,  0.8766,  0.9470,  0.1572,  0.0374,
         0.9366,  0.9415,  0.5896,  0.2088,  0.6563,  0.4208,  0.9427,
         0.7365,  0.0018,  0.5410,  0.9955,  0.7227,  0.4221,  0.9059,
         0.0181,  0.8613,  0.0004,  0.8191,  0.6756,  0.9772,  0.0533,
         0.9729,  0.7203,  0.9966,  0.0383,  0.0054,  0.0447,  0.4780,
         0.3937,  0.9994,  0.8849,  0.8377,  0.9565,  0.0920,  0.8411,
         0.0032,  0.1005,  0.6507,  0.0459,  0.8111,  0.0044,  0.7545,
         0.9999,  0.5737,  0.6240,  0.9491,  0.9174,  0.6560,  0.9394,
         0.6859,  0.8772,  0.3174,  0.0643,  0.9534,  0.6823,  0.9995,
         0.0283,  0.3912,  0.2659,  0.9066,  0.9882,  0.1266,  0.9963,
         0.0614,  0.0163,  0.9437,  0.0176,  0.2180,  0.2395,  0.0173,
         0.3754,  0.9357,  0.0064,  0.9667,  0.9741,  0.1652,  0.8749,
         0.1632,  0.0132,  0.9435,  0.9588,  0.1924,  0.9292,  0.9778,
         0.9844,  0.0110,  0.9555,  0.9721,  0.9648,  0.9053,  0.9354,
         0.0133,  0.0263,  0.0110,  0.0112,  0.2010,  0.0036,  0.0195,
         0.8791,  0.4158,  0.0476,  0.0883,  0.9759,  0.0036,  0.8718,
         0.5656,  0.9919,  0.0757,  0.1683,  0.9881,  0.1821,  0.9847,
         0.4418,  0.9085,  0.9971,  0.7271,  0.5445,  0.0100,  0.2337,
         0.9680,  0.9284,  0.6494,  0.1309,  0.0797,  0.9479,  0.0106,
         0.8993,  0.8640,  0.9875,  0.9101,  0.9507,  0.1539,  0.3109,
         0.9906,  0.9493,  0.0037,  0.0362,  0.1163,  0.8760,  0.1944,
         0.0060,  0.8438,  0.8398,  0.3107,  0.9881,  0.9443,  0.3555,
         0.0044,  0.1902,  0.0202,  0.0457,  0.1513,  0.0253,  0.9770,
         0.0832,  0.0786,  0.9880,  0.9517,  0.9421,  0.9793,  0.7569,
         0.8525,  0.0614,  0.9509,  0.9775,  0.9503,  0.9893,  0.7646,
         0.9496,  0.0019,  0.2954,  0.2504,  0.9903,  0.6675,  0.9748,
         0.1671,  0.8752,  0.0610,  0.5974,  0.7256,  0.9750,  0.0332,
         0.8994,  0.1166,  0.1484,  0.0178,  0.1207,  0.0635,  0.9493,
         0.9710,  0.7758,  0.6299,  0.9118,  0.0521,  0.0484,  0.0073,
         0.0893,  0.0027,  0.9420,  0.9465,  0.9992,  0.0300,  0.8892,
         0.9906,  0.6649,  0.9439,  0.9231,  0.7426,  0.4487,  0.1410,
         0.9715,  0.3306,  0.9674,  0.9843,  0.0061,  0.9164,  0.7713,
         0.2439,  0.8990,  0.0820,  0.2454,  0.4707,  0.8726,  0.0030,
         0.0448,  0.0656,  0.3744,  0.6888,  0.9138,  0.2333,  0.0104,
         0.1712,  0.0581,  0.1237,  0.9508,  0.9569,  0.9355,  0.0041,
         0.8648,  0.9999,  0.0440,  0.0267,  0.5387,  0.7161,  0.9903,
         0.3245,  0.9521,  0.0966,  0.6446,  0.7243,  0.9548,  0.9810,
         0.3286,  0.9009,  0.1423,  0.5738,  0.0142,  0.3056,  0.9291,
         0.9829,  0.9640,  0.2126,  0.7779,  0.0076,  0.5435,  0.0130,
         0.9744,  0.7050,  0.9838,  0.9335,  0.1946,  0.2018,  0.8956,
         0.0271,  0.9611,  0.9887,  0.3503,  0.5010,  0.9870,  0.0165,
         0.3841,  0.6211,  0.9974,  0.0099,  0.7056,  0.0194,  0.6321,
         0.0182,  0.9103,  0.0604,  0.9265,  0.0893,  0.0424,  0.0207,
         0.1981,  0.5350,  0.5355,  0.9844,  0.9144,  0.3740,  0.9211,
         0.9883,  0.0006,  0.9697,  0.1189,  0.9878,  0.9720,  0.7933,
         0.0118,  0.9705,  0.0877,  0.5087,  0.0464,  0.9356,  0.9505,
         0.9576,  0.8948,  0.6638,  0.0341,  0.0083,  0.9801,  0.7544,
         0.6510,  0.0431,  0.2839,  0.0330,  0.0079,  0.9118,  0.9095,
         0.0387,  0.0506,  0.0753,  0.9541,  0.9954,  0.0139,  0.0642,
         0.0011,  0.9882,  0.3189,  0.8186,  0.2052,  0.0027,  0.0205,
         0.0431,  0.0297,  0.0085,  0.0098,  0.0512,  0.1130,  0.2214,
         0.9942,  0.9996,  0.9412,  0.0300,  0.4495,  0.0033,  0.0009,
         0.0014,  0.0201,  0.8491,  0.0734,  0.7014,  0.2178,  0.0014,
         0.0345,  0.8904,  0.9513,  0.8040,  0.7833,  0.9668,  0.9409,
         0.0155], device='cuda:0')
tensor(0.2502, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9576,  0.9646,  0.9742,  0.9768,  0.0907,  0.7636,  0.0022,
         0.0276,  0.3694,  0.9957,  0.4635,  0.0725,  0.9320,  0.0025,
         0.3636,  0.9194,  0.8370,  0.9554,  0.8861,  0.7642,  0.9210,
         0.0796,  0.9636,  0.0222,  0.4839,  0.8591,  0.9639,  0.5454,
         0.0214,  0.6918,  0.9930,  0.7982,  0.4662,  0.9598,  0.9438,
         0.8719,  0.0247,  0.0268,  0.3935,  0.2384,  0.6828,  0.0375,
         0.0138,  0.9142,  0.0129,  0.3865,  0.5308,  0.9804,  0.9947,
         0.0009,  0.8752,  0.0271,  0.8459,  0.9927,  0.0217,  0.0068,
         0.5400,  0.9258,  0.0482,  0.0284,  0.0133,  0.9578,  0.1791,
         0.7095,  0.7775,  0.9962,  0.9981,  0.9705,  0.0203,  0.6827,
         0.0645,  0.0007,  0.9635,  0.9754,  0.9864,  0.9665,  0.7728,
         0.0097,  0.0726,  0.0083,  0.9879,  0.9707,  0.0404,  0.0279,
         0.0771,  0.9046,  0.0024,  0.9884,  0.8543,  0.8859,  0.9371,
         0.9288,  0.3965,  0.9575,  0.7644,  0.0054,  0.0331,  0.9764,
         0.9826,  0.4045,  0.9852,  0.0017,  0.0985,  0.9760,  0.8962,
         0.9959,  0.8791,  0.0245,  0.9604,  0.7289,  0.9573,  0.0194,
         0.0196,  0.0633,  0.7643,  0.1920,  0.8955,  0.3616,  0.9608,
         0.3413,  0.9454,  0.9916,  0.0233,  0.0635,  0.0072,  0.2921,
         0.9229,  0.8128,  0.8678,  0.9104,  0.9296,  0.9512,  0.6635,
         0.3622,  0.9741,  0.9649,  0.9035,  0.0459,  0.0061,  0.9887,
         0.2063,  0.0067,  0.0641,  0.9754,  0.1126,  0.6537,  0.0531,
         0.9220,  0.9045,  0.0451,  0.1188,  0.0861,  0.9270,  0.2109,
         0.0062,  0.9285,  0.9471,  0.0984,  0.9488,  0.9409,  0.0441,
         0.8504,  0.9991,  0.9807,  0.0121,  0.1524,  0.1005,  0.0004,
         0.3454,  0.9756,  0.5368,  0.9504,  0.0350,  0.0888,  0.2088,
         0.0003,  0.0661,  0.0257,  0.2396,  0.6781,  0.9507,  0.0370,
         0.0071,  0.7719,  0.3281,  0.9616,  0.9580,  0.0112,  0.9486,
         0.7873,  0.9849,  0.6003,  0.9851,  0.9946,  0.0017,  0.9890,
         0.0332,  0.0540,  0.0189,  0.0190,  0.0037,  0.8759,  0.9858,
         0.0120,  0.9139,  0.6149,  0.9859,  0.5960,  0.0007,  0.9476,
         0.9346,  0.4097,  0.0266,  0.9848,  0.9011,  0.9050,  0.6497,
         0.0634,  0.9170,  0.1178,  0.0136,  0.9877,  0.9286,  0.9520,
         0.1263,  0.8297,  0.9857,  0.1150,  0.0017,  0.4606,  0.6401,
         0.0946,  0.1466,  0.6723,  0.9176,  0.1728,  0.3299,  0.9930,
         0.0615,  0.5139,  0.8923,  0.9041,  0.9876,  0.8554,  0.9590,
         0.8951,  0.9404,  0.0805,  0.1922,  0.9566,  0.9599,  0.0144,
         0.9143,  0.9905,  0.1308,  0.0315,  0.0085,  0.9067,  0.4051,
         0.8505,  0.9850,  0.2415,  0.0435,  0.9543,  0.0071,  0.0607,
         0.0045,  0.9342,  0.9715,  0.9692,  0.9961,  0.3127,  0.9992,
         0.9827,  0.0840,  0.0185,  0.9268,  0.8230,  0.9687,  0.9917,
         0.1213,  0.9976,  0.1282,  0.2633,  0.9003,  0.9776,  0.6341,
         0.0222,  0.9987,  0.1401,  0.1020,  0.0172,  0.3055,  0.0168,
         0.9645,  0.2206,  0.9954,  0.2429,  0.0013,  0.9440,  0.5577,
         0.8855,  0.9832,  0.0132,  0.0041,  0.7175,  0.9889,  0.9845,
         0.6657,  0.7081,  0.9668,  0.9491,  0.9685,  0.1184,  0.9925,
         0.7105,  0.7228,  0.6839,  0.8491,  0.9750,  0.7718,  0.9891,
         0.7318,  0.3233,  0.0156,  0.7822,  0.0072,  0.9731,  0.9783,
         0.9835,  0.9556,  0.0249,  0.9369,  0.0312,  0.0046,  0.1619,
         0.0279,  0.0293,  0.1175,  0.0145,  0.9537,  0.8226,  0.0248,
         0.5225,  0.9941,  0.0497,  0.0399,  0.1334,  0.5760,  0.9973,
         0.6420,  0.8480,  0.4982,  0.9990,  0.8551,  0.8233,  0.9823,
         0.0149,  0.0341,  0.2503,  0.1258,  0.4642,  0.0293,  0.1039,
         0.0007,  0.8629,  0.3099,  0.9873,  0.7883,  0.0659,  0.0338,
         0.9087,  0.0302,  0.6302,  0.9662,  0.9181,  0.9790,  0.5343,
         0.0260,  0.6500,  0.9786,  0.2547,  0.0094,  0.9905,  0.8374,
         0.9790,  0.0187,  0.0098,  0.7486,  0.0846,  0.1939,  0.9639,
         0.7080,  0.6875,  0.8782,  0.6179,  0.0015,  0.0337,  0.9588,
         0.0517,  0.7107,  0.7889,  0.1325,  0.9650,  0.0042,  0.1140,
         0.9826,  0.0056,  0.0562,  0.8466,  0.0823,  0.8282,  0.8654,
         0.9998,  0.9358,  0.8738,  0.2558,  0.2474,  0.0079,  0.0577,
         0.9839,  0.1278,  0.0118,  0.9397,  0.8407,  0.9825,  0.0343,
         0.8258,  0.0548,  0.0034,  0.7918,  0.0152,  0.9804,  0.0306,
         0.0207,  0.9626,  0.9993,  0.0059,  0.9923,  0.6099,  0.9532,
         0.9791,  0.0036,  0.9242,  0.8581,  0.0934,  0.9616,  0.9347,
         0.9146,  0.0164,  0.8661,  0.2416,  0.0665,  0.2459,  0.9088,
         0.8942,  0.2679,  0.9875,  0.8681,  0.0106,  0.0106,  0.9376,
         0.0563,  0.8993,  0.0145,  0.8280,  0.9536,  0.8584,  0.0021,
         0.9224,  0.0745,  0.6403,  0.8853,  0.1773,  0.0898,  0.7711,
         0.9874,  0.0034,  0.9686,  0.5031,  0.9065,  0.8466,  0.9860,
         0.9673,  0.9896,  0.9234,  0.3043,  0.5118,  0.4241,  0.0304,
         0.9739,  0.0459,  0.6082,  0.0797,  0.4708,  0.9999,  0.9972,
         0.9811,  0.8028,  0.2036,  0.0126,  0.2276,  0.9710,  0.0511,
         0.3781,  0.8449,  0.9320,  0.9730,  0.9042,  0.9668,  0.8971,
         0.7991], device='cuda:0')
tensor(0.3174, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0711,  0.9931,  0.0479,  0.8646,  0.2111,  0.0471,  0.9719,
         0.0024,  0.9831,  0.0341,  0.4433,  0.9601,  0.0042,  0.0189,
         0.9289,  0.8772,  0.0511,  0.9734,  0.9385,  0.9647,  0.1237,
         0.0165,  0.0054,  0.9774,  0.5617,  0.9865,  0.0986,  0.7865,
         0.0123,  0.0214,  0.0081,  0.0271,  0.0062,  0.1087,  0.9011,
         0.0007,  0.0031,  0.0306,  0.1796,  0.0008,  0.9939,  0.0013,
         0.1359,  0.0455,  0.8949,  0.9593,  0.0283,  0.9745,  0.0606,
         0.4315,  0.0016,  0.9748,  0.7087,  0.3607,  0.0085,  0.0046,
         0.0981,  0.1133,  0.8366,  0.9932,  0.0287,  0.0256,  0.7136,
         0.0342,  0.4729,  0.0113,  0.9819,  0.9768,  0.9469,  0.9330,
         0.9863,  0.0008,  0.6112,  0.0017,  0.1246,  0.1633,  0.9599,
         0.0061,  0.1205,  0.0105,  0.4133,  0.9489,  0.0010,  0.8320,
         0.8677,  0.0108,  0.9692,  0.9466,  0.9940,  0.9658,  0.0118,
         0.3644,  0.0138,  0.0005,  0.9640,  0.8247,  0.7624,  0.0264,
         0.1500,  0.9056,  0.0003,  0.0171,  0.3328,  0.9522,  0.0667,
         0.8105,  0.0022,  0.0069,  0.0211,  0.0338,  0.9471,  0.5681,
         0.0974,  0.2190,  0.6367,  0.8760,  0.3084,  0.9192,  0.0792,
         0.8975,  0.0550,  0.0038,  0.8716,  0.0028,  0.8832,  0.0026,
         0.3396,  0.1888,  0.9403,  0.9631,  0.0292,  0.9753,  0.0860,
         0.9515,  0.0226,  0.9464,  0.0130,  0.0564,  0.9680,  0.0008,
         0.6394,  0.0354,  0.6748,  0.0841,  0.9915,  0.0780,  0.0047,
         0.0354,  0.0444,  0.9929,  0.5620,  0.9772,  0.5367,  0.0641,
         0.9012,  0.0378,  0.7561,  0.0245,  0.0413,  0.0083,  0.9647,
         0.0577,  0.9182,  0.0331,  0.0152,  0.8786,  0.0998,  0.0485,
         0.0381,  0.9928,  0.0098,  0.1119,  0.5369,  0.0182,  0.0025,
         0.9954,  0.9564,  0.1222,  0.9716,  0.0217,  0.8341,  0.8930,
         0.0490,  0.0065,  0.7124,  0.0567,  0.0007,  0.4657,  0.2708,
         0.9954,  0.9993,  0.0429,  0.0000,  0.7248,  0.0100,  0.7989,
         0.9510,  0.0013,  0.0408,  0.3104,  0.0116,  0.0261,  0.9295,
         0.1687,  0.9994,  0.8808,  0.9634,  0.0061,  0.0077,  0.0910,
         0.8266,  0.0013,  0.9909,  0.8625,  0.9347,  0.5786,  0.0003,
         0.9982,  0.9736,  0.1771,  0.0133,  0.0477,  0.0061,  0.0412,
         0.2199,  0.9937,  0.8587,  0.9038,  0.9878,  0.9995,  0.0421,
         0.0023,  0.7841,  0.0609,  0.8218,  0.7221,  0.9744,  0.0006,
         0.5986,  0.9572,  0.2420,  0.1859,  0.5529,  0.4618,  0.0284,
         0.0053,  0.0504,  0.7946,  0.0767,  0.0062,  0.7727,  0.2751,
         0.0073,  0.0410,  0.9856,  0.0040,  0.8527,  0.0005,  0.9917,
         0.9714,  0.9189,  0.0545,  0.3321,  0.9756,  0.4636,  0.9415,
         0.0062,  0.0239,  0.3237,  0.0418,  0.9448,  0.1985,  0.0064,
         0.0788,  0.0185,  0.0101,  0.0329,  0.0029,  0.2142,  0.9839,
         0.8729,  0.0643,  0.5929,  0.1795,  0.8874,  0.6914,  0.5922,
         0.9928,  0.0144,  0.8886,  0.5633,  0.9708,  0.0421,  0.0854,
         0.0217,  0.0041,  0.1402,  0.9935,  0.0401,  0.0245,  0.9092,
         0.0270,  0.9683,  0.1013,  0.0199,  0.0115,  0.0279,  0.5361,
         0.0007,  0.9809,  0.4084,  0.9512,  0.9635,  0.0115,  0.6266,
         0.0266,  0.9203,  0.9449,  0.0037,  0.4898,  0.9618,  0.0233,
         0.9609,  0.9622,  0.0302,  0.9382,  0.9398,  0.9806,  0.9247,
         0.9627,  0.9998,  0.9069,  0.9059,  0.9996,  0.8658,  0.9249,
         0.9483,  0.2316,  0.0473,  0.9360,  0.0006,  0.9978,  0.8785,
         0.0402,  0.0165,  0.9143,  0.9986,  0.9667,  0.9767,  0.0002,
         0.6462,  0.0006,  0.8766,  0.9673,  0.9790,  0.8897,  0.0594,
         0.0083,  0.6134,  0.0083,  0.8785,  0.4476,  0.0103,  0.0005,
         0.0221,  0.1752,  0.1652,  0.9577,  0.0821,  0.8890,  0.0127,
         0.9509,  0.9747,  0.0207,  0.0009,  0.5762,  0.0341,  0.9751,
         0.8597,  0.9189,  0.9380,  0.0057,  0.3318,  0.0314,  0.0157,
         0.9877,  0.0161,  0.5716,  0.8533,  0.0287,  0.0080,  0.7113,
         0.9684,  0.9974,  0.0645,  0.9811,  0.9189,  0.9994,  0.4541,
         0.0040,  0.9518,  0.9610,  0.9483,  0.9513,  0.0203,  0.0012,
         0.9244,  0.0655,  0.9397,  0.0308,  0.8108,  0.0216,  0.0273,
         0.9866,  0.9314,  0.1605,  0.0335,  0.0285,  0.9460,  0.0259,
         0.1633,  0.8722,  0.0005,  0.9366,  0.9998,  0.0873,  0.9724,
         0.9678,  0.9835,  0.0023,  0.9998,  0.9598,  0.9606,  0.0810,
         0.0025,  0.0022,  0.9241,  0.0398,  0.9422,  0.0717,  0.0448,
         0.7913,  0.9789,  0.8645,  0.0063,  0.0029,  0.0200,  0.9915,
         0.8748,  0.8984,  0.0016,  0.0170,  0.0175,  0.9217,  0.4364,
         0.0619,  0.9885,  0.9752,  0.9762,  0.0176,  0.9725,  0.8881,
         0.9471,  0.0593,  0.9990,  0.0689,  0.0068,  0.9491,  0.7395,
         0.0190,  0.8403,  0.7573,  0.8535,  0.8743,  0.0290,  0.9396,
         0.9329,  0.1497,  0.9283,  0.0377,  0.0209,  0.8665,  0.9343,
         0.1019,  0.9054,  0.9568,  0.9350,  0.3421,  0.0414,  0.5478,
         0.3416,  0.0439,  0.3208,  0.1568,  0.9922,  0.0008,  0.9062,
         0.4998,  0.9940,  0.9646,  0.1660,  0.5142,  0.0011,  0.0206,
         0.0144,  0.9944,  0.9498,  0.0629,  0.9933,  0.0425,  0.5522,
         0.7124], device='cuda:0')
tensor(0.2578, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0048,  0.7722,  0.9090,  0.4977,  0.0908,  0.9883,  0.9050,
         0.0684,  0.0194,  0.1335,  0.9461,  0.9006,  0.8213,  0.7854,
         0.8078,  0.9787,  0.9862,  0.0034,  0.7734,  0.6459,  0.0030,
         0.9805,  0.9471,  0.7506,  0.0104,  0.0371,  0.0043,  0.8774,
         0.4175,  0.9449,  0.0069,  0.9698,  0.9530,  0.0946,  0.9180,
         0.9752,  0.9909,  0.0184,  0.0038,  0.0082,  0.0119,  0.2193,
         0.1835,  0.0027,  0.9803,  0.9068,  0.9223,  0.5603,  0.9993,
         0.6970,  0.9004,  0.1050,  0.9026,  0.9030,  0.0198,  0.9176,
         0.8997,  0.7431,  0.9898,  0.0061,  0.9666,  0.0171,  0.0946,
         0.0020,  0.7319,  0.8634,  0.0087,  0.2111,  0.8929,  0.0216,
         0.8801,  0.0248,  0.0046,  0.0063,  0.0700,  0.0320,  0.0048,
         0.8342,  0.6467,  0.0620,  0.9810,  0.4561,  0.9776,  0.0032,
         0.7586,  0.9595,  0.5640,  0.0161,  0.0726,  0.9550,  0.0003,
         0.0002,  0.0741,  0.9366,  0.0224,  0.1119,  0.9228,  0.8590,
         0.7300,  0.0206,  0.0268,  0.9716,  0.9408,  0.0097,  0.6603,
         0.0031,  0.1938,  0.8937,  0.0049,  0.9710,  0.9952,  0.9539,
         0.0354,  0.0168,  0.0303,  0.9561,  0.9499,  0.9993,  0.9620,
         0.0007,  0.0640,  0.9429,  0.1045,  0.0201,  0.9575,  0.0081,
         0.7450,  0.9433,  0.9915,  0.1480,  0.9986,  0.9728,  0.4154,
         0.9792,  0.4175,  0.0005,  0.2593,  0.0493,  0.9784,  0.0021,
         0.0122,  0.0311,  0.0701,  0.0416,  0.6355,  0.0080,  0.0135,
         0.1530,  0.6778,  0.0522,  0.7463,  0.9788,  0.9667,  0.4417,
         0.9666,  0.4272,  0.0223,  0.9550,  0.9292,  0.1019,  0.9998,
         0.9060,  0.0053,  0.0100,  0.4275,  0.2658,  0.9570,  0.8812,
         0.8417,  0.0015,  0.9724,  0.0522,  0.9457,  0.0582,  0.4814,
         0.2672,  0.1266,  0.0003,  0.9822,  0.9411,  0.0038,  0.0221,
         0.9537,  0.0637,  0.2570,  0.9861,  0.0466,  0.9775,  0.0220,
         0.0003,  0.0133,  0.1599,  0.9566,  0.9095,  0.8093,  0.8133,
         0.0016,  0.0084,  0.4645,  0.0758,  0.0154,  0.0341,  0.8475,
         0.0027,  0.7660,  0.7896,  0.0704,  0.8160,  0.0316,  0.0647,
         0.9186,  0.0032,  0.0128,  0.2692,  0.9773,  0.7928,  0.0181,
         0.0852,  0.0032,  0.0521,  0.8897,  0.0222,  0.0107,  0.0135,
         0.7542,  0.0024,  0.9039,  0.0123,  0.0601,  0.6242,  0.9439,
         0.0017,  0.0178,  0.0666,  0.9955,  0.0227,  0.7153,  0.9820,
         0.9402,  0.0179,  0.7628,  0.0061,  0.8210,  0.3159,  0.9189,
         0.0285,  0.0146,  0.5778,  0.0166,  0.0944,  0.0270,  0.9882,
         0.9864,  0.1103,  0.1363,  0.0030,  0.8421,  0.7477,  0.1707,
         0.3166,  0.2790,  0.9679,  0.3968,  0.0101,  0.7335,  0.7591,
         0.4249,  0.9927,  0.7749,  0.0599,  0.0092,  0.0080,  0.0028,
         0.0215,  0.0056,  0.2131,  0.0030,  0.0271,  0.0768,  0.0020,
         0.9653,  0.9602,  0.0117,  0.2298,  0.7982,  0.0304,  0.2708,
         0.9647,  0.0155,  0.0447,  0.1429,  0.9974,  0.9386,  0.9410,
         0.2636,  0.5327,  0.1587,  0.0230,  0.9530,  0.0118,  0.2622,
         0.0722,  0.9394,  0.0035,  0.0131,  0.0034,  0.3647,  0.5115,
         0.0579,  0.0027,  0.8775,  0.7135,  0.8028,  0.0102,  0.7442,
         0.8524,  0.1854,  0.1250,  0.0365,  0.9996,  0.9496,  0.9470,
         0.8513,  0.0193,  0.9003,  0.0105,  0.9633,  0.0017,  0.0481,
         0.9822,  0.1729,  0.9411,  0.9211,  0.0067,  0.5197,  0.0166,
         0.0153,  0.7458,  0.0084,  0.9824,  0.1815,  0.1029,  0.9499,
         0.8220,  0.2708,  0.9849,  0.0579,  0.8245,  0.2815,  0.0428,
         0.9039,  0.0576,  0.0695,  0.9972,  0.8511,  0.2337,  0.0753,
         0.9705,  0.8710,  0.0327,  0.9802,  0.9106,  0.0961,  0.6914,
         0.8757,  0.0140,  0.9316,  0.8901,  0.0003,  0.0010,  0.0070,
         0.0132,  0.6725,  0.8734,  0.9598,  0.9621,  0.9709,  0.8935,
         0.0516,  0.9487,  0.8888,  0.1440,  0.2727,  0.0168,  0.0244,
         0.0029,  0.4461,  0.9404,  0.0293,  0.0033,  0.8848,  0.9459,
         0.0148,  0.4755,  0.9350,  0.9731,  0.9912,  0.8458,  0.0272,
         0.0498,  0.9120,  0.0435,  0.0508,  0.0125,  0.9540,  0.0006,
         0.9588,  0.0088,  0.0250,  0.9824,  0.0218,  0.0150,  0.0042,
         0.9648,  0.0042,  0.2678,  0.0102,  0.0727,  0.9978,  0.0456,
         0.0098,  0.9412,  0.0287,  0.0020,  0.2569,  0.0266,  0.9486,
         0.0106,  0.9306,  0.0117,  0.0087,  0.2967,  0.9457,  0.0568,
         0.9725,  0.9367,  0.0010,  0.0218,  0.8436,  0.0158,  0.1360,
         0.0701,  0.0027,  0.9799,  0.9994,  0.3011,  0.1457,  0.0825,
         0.9542,  0.0013,  0.9919,  0.0216,  0.9730,  0.9852,  0.9442,
         0.9756,  0.9497,  0.0142,  0.8215,  0.9921,  0.0100,  0.9505,
         0.9210,  0.2531,  0.5231,  0.9921,  0.8958,  0.0355,  0.9457,
         0.0307,  0.0101,  0.9607,  0.9901,  0.5401,  0.0496,  0.0034,
         0.0371,  0.9997,  0.9302,  0.0058,  0.8660,  0.0581,  0.9826,
         0.1267,  0.9669,  0.2953,  0.8751,  0.9864,  0.9996,  0.8514,
         0.0014,  0.9884,  0.9794,  0.0204,  0.0177,  0.1692,  0.0105,
         0.0005,  0.0739,  0.0382,  0.0178,  0.5084,  0.0136,  0.9091,
         0.9214,  0.0253,  0.0521,  0.0074,  0.3446,  0.0460,  0.0020,
         0.0035], device='cuda:0')
tensor(0.2700, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0685,  0.0107,  0.1009,  0.8544,  0.4605,  0.0007,  0.0083,
         0.0397,  0.0127,  0.0129,  0.8970,  0.9000,  0.7582,  0.0142,
         0.9965,  0.9755,  0.9743,  0.0069,  0.9438,  0.1045,  0.9453,
         0.1226,  0.9761,  0.8819,  0.3063,  0.2409,  0.9990,  0.6129,
         0.3568,  0.9359,  0.3293,  0.4110,  0.8370,  0.9089,  0.4925,
         0.0504,  0.8444,  0.9802,  0.0098,  0.0030,  0.0866,  0.0394,
         0.7445,  0.8977,  0.5042,  0.0805,  0.8725,  0.0468,  0.9336,
         0.0123,  0.9879,  0.9060,  0.9887,  0.9004,  0.9971,  0.0060,
         0.8891,  0.0351,  0.9996,  0.0466,  0.9919,  0.0247,  0.7714,
         0.0488,  0.9701,  0.9912,  0.6136,  0.9812,  0.1366,  0.0398,
         0.0403,  0.8773,  0.0734,  0.1496,  0.6086,  0.1973,  0.9512,
         0.1886,  0.9545,  0.0178,  0.0047,  0.0112,  0.0083,  0.0607,
         0.0264,  0.4972,  0.9444,  0.1567,  0.3210,  0.8374,  0.5572,
         0.0396,  0.1106,  0.0137,  0.0482,  0.9469,  0.9716,  0.7869,
         0.0855,  0.9680,  0.8583,  0.0780,  0.0199,  0.9984,  0.8112,
         0.6469,  0.8751,  0.3086,  0.9259,  0.0059,  0.9246,  0.2123,
         0.1217,  0.9888,  0.7889,  0.6584,  0.1892,  0.0495,  0.2124,
         0.0131,  0.0601,  0.9699,  0.2244,  0.6720,  0.9172,  0.9177,
         0.9954,  0.0212,  0.8256,  0.9502,  0.9958,  0.0572,  0.0401,
         0.0243,  0.6902,  0.9641,  0.0819,  0.0301,  0.5389,  0.0110,
         0.0533,  0.9757,  0.0143,  0.4503,  0.9883,  0.0579,  0.0040,
         0.0601,  0.3810,  0.0043,  0.0403,  0.8075,  0.3230,  0.9055,
         0.8631,  0.9551,  0.9764,  0.8730,  0.5905,  0.0080,  0.6194,
         0.0417,  0.6747,  0.1397,  0.0095,  0.9229,  0.0566,  0.9716,
         0.9558,  0.8363,  0.9613,  0.0087,  0.0128,  0.3032,  0.9112,
         0.9350,  0.9649,  0.9729,  0.8387,  0.0619,  0.9081,  0.4108,
         0.4913,  0.0145,  0.9010,  0.0135,  0.9319,  0.0169,  0.1182,
         0.1357,  0.2971,  0.0189,  0.8392,  0.2052,  0.9396,  0.9742,
         0.0326,  0.0095,  0.9449,  0.9217,  0.8762,  0.9260,  0.9307,
         0.8671,  0.0485,  0.9738,  0.0193,  0.9580,  0.4056,  0.7955,
         0.1039,  0.0319,  0.7450,  0.8472,  0.4038,  0.0384,  0.2349,
         0.8947,  0.7644,  0.9156,  0.4900,  0.0053,  0.8562,  0.7216,
         0.7605,  0.0112,  0.0025,  0.0469,  0.7845,  0.0055,  0.9505,
         0.0422,  0.0012,  0.7861,  0.0770,  0.9532,  0.7609,  0.0888,
         0.9459,  0.0232,  0.3627,  0.9350,  0.8543,  0.9941,  0.9403,
         0.9203,  0.9407,  0.9471,  0.2014,  0.7983,  0.9983,  0.0072,
         0.9846,  0.9733,  0.8777,  0.0034,  0.9970,  0.0319,  0.0586,
         0.1754,  0.0142,  0.9365,  0.9994,  0.0155,  0.9889,  0.9039,
         0.9760,  0.9767,  0.7628,  0.9673,  0.1138,  0.3693,  0.9822,
         0.9881,  0.0844,  0.0458,  0.9981,  0.9712,  0.4686,  0.9547,
         0.9538,  0.0612,  0.9210,  0.9397,  0.9947,  0.0425,  0.9911,
         0.9929,  0.0123,  0.0288,  0.9620,  0.9789,  0.2343,  0.9392,
         0.9965,  0.9440,  0.9966,  0.9346,  0.0185,  0.7765,  0.9645,
         0.8990,  0.6266,  0.0065,  0.0502,  0.9843,  0.9647,  0.2032,
         0.0132,  0.0110,  0.9658,  0.0247,  0.7918,  0.9754,  0.9774,
         0.7329,  0.8676,  0.9750,  0.1114,  0.1562,  0.8153,  0.0331,
         0.7697,  0.9176,  0.9924,  0.3427,  0.3304,  0.4954,  0.0185,
         0.9429,  0.9146,  0.1829,  0.0139,  0.1080,  0.9481,  0.6320,
         0.0075,  0.0454,  0.9962,  0.8845,  0.9472,  0.1805,  0.0062,
         0.0057,  0.9833,  0.9534,  0.0014,  0.3123,  0.0756,  0.9156,
         0.9409,  0.0593,  0.9444,  0.1758,  0.0203,  0.3641,  0.9730,
         0.0856,  0.0033,  0.0232,  0.7644,  0.7690,  0.4644,  0.0044,
         0.0207,  0.0001,  0.2329,  0.0629,  0.0713,  0.9765,  0.8818,
         0.0218,  0.9889,  0.0285,  0.9679,  0.1137,  0.9997,  0.1058,
         0.0029,  0.0138,  0.0321,  0.9699,  0.6754,  0.0403,  0.9125,
         0.9333,  0.8698,  0.0080,  0.9721,  0.8391,  0.0002,  0.2010,
         0.9737,  0.9827,  0.2039,  0.1785,  0.9924,  0.3939,  0.8147,
         0.9557,  0.9869,  0.9993,  0.7736,  0.6943,  0.9717,  0.0183,
         0.9225,  0.8706,  0.8839,  0.4957,  0.1708,  0.3643,  0.9902,
         0.2572,  0.7595,  0.0623,  0.9084,  0.0468,  0.0438,  0.9724,
         0.0085,  0.8964,  0.1655,  0.9190,  0.0195,  0.4317,  0.8100,
         0.0043,  0.5475,  0.7311,  0.0241,  0.9460,  0.0591,  0.9968,
         0.0217,  0.6338,  0.4063,  0.9664,  0.6092,  0.9402,  0.1429,
         0.9862,  0.1512,  0.1418,  0.9340,  0.0014,  0.0913,  0.3902,
         0.0423,  0.9812,  0.1286,  0.0756,  0.5042,  0.0207,  0.0317,
         0.8986,  0.8980,  0.9857,  0.0252,  0.0010,  0.3219,  0.0599,
         0.0275,  0.0031,  0.0253,  0.0129,  0.8108,  0.8524,  0.0180,
         0.0760,  0.2982,  0.0589,  0.9218,  0.4400,  0.0188,  0.9120,
         0.9891,  0.0351,  0.0100,  0.0220,  0.5180,  0.7492,  0.0054,
         0.9679,  0.7198,  0.2487,  0.8305,  0.9887,  0.0071,  0.0187,
         0.0214,  0.0255,  0.0015,  0.0475,  0.9285,  0.9795,  0.8981,
         0.7855,  0.0165,  0.0037,  0.8068,  0.0256,  0.1432,  0.9900,
         0.9863,  0.9331,  0.6331,  0.9523,  0.0662,  0.3537,  0.0359,
         0.9609], device='cuda:0')
tensor(0.2668, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.2507,  0.0647,  0.6469,  0.0445,  0.0217,  0.0051,  0.0005,
         0.3239,  0.9377,  0.0857,  0.1848,  0.9937,  0.0163,  0.9571,
         0.1691,  0.1243,  0.9107,  0.0157,  0.9995,  0.0724,  0.0257,
         0.9905,  0.2710,  0.0021,  0.0147,  0.8780,  0.0177,  0.6479,
         0.3866,  0.9528,  0.0496,  0.2411,  0.9587,  0.9236,  0.0728,
         0.1047,  0.0080,  0.0699,  0.9172,  0.9572,  0.9349,  0.9616,
         0.9544,  0.0022,  0.0565,  0.7937,  0.9865,  0.7342,  0.9699,
         0.9290,  0.4150,  0.9993,  0.7778,  0.0336,  0.9492,  0.8811,
         0.9971,  0.9485,  0.9106,  0.9905,  0.0230,  0.5881,  0.9742,
         0.0399,  0.9568,  0.9860,  0.0030,  0.8463,  0.9975,  0.2227,
         0.9105,  0.9819,  0.9018,  0.9702,  0.9382,  0.7698,  0.9175,
         0.0605,  0.9470,  0.9936,  0.9892,  0.0656,  0.0480,  0.9535,
         0.1173,  0.0607,  0.0030,  0.0415,  0.0875,  0.1328,  0.8037,
         0.0342,  0.9933,  0.1644,  0.1492,  0.5722,  0.9194,  0.1439,
         0.1837,  0.0359,  0.6430,  0.9907,  0.5261,  0.1693,  0.0608,
         0.8312,  0.0047,  0.0842,  0.6516,  0.8752,  0.9777,  0.9823,
         0.9698,  0.0159,  0.9597,  0.9684,  0.9815,  0.0881,  0.0715,
         0.9400,  0.0521,  0.4609,  0.2070,  0.9950,  0.7149,  0.9864,
         0.9898,  0.6920,  0.8769,  0.0577,  0.6427,  0.9941,  0.9952,
         0.1269,  0.9011,  0.3169,  0.0297,  0.0234,  0.9640,  0.8062,
         0.9846,  0.5538,  0.8006,  0.9599,  0.5229,  0.9259,  0.1167,
         0.4039,  0.0554,  0.9026,  0.8131,  0.8872,  0.1981,  0.9840,
         0.7515,  0.9997,  0.0059,  0.6986,  0.1106,  0.9468,  0.9732,
         0.6691,  0.9262,  0.9645,  0.4755,  0.0787,  0.1557,  0.9324,
         0.0085,  0.0295,  0.9638,  0.9817,  0.1045,  0.0532,  0.3625,
         0.0456,  0.0445,  0.9496,  0.7622,  0.0091,  0.9246,  0.9016,
         0.0399,  0.1002,  0.7772,  0.9414,  0.0379,  0.8845,  0.9593,
         0.0162,  0.9782,  0.4757,  0.3992,  0.0101,  0.7318,  0.0050,
         0.9860,  0.8713,  0.0135,  0.0546,  0.8138,  0.2008,  0.0708,
         0.2610,  0.8924,  0.0026,  0.0070,  0.5377,  0.8515,  0.9121,
         0.1847,  0.0158,  0.9534,  0.2137,  0.2153,  0.5078,  0.9086,
         0.0028,  0.9349,  0.2802,  0.9904,  0.0233,  0.0151,  0.5977,
         0.5996,  0.9415,  0.5624,  0.9487,  0.9774,  0.1219,  0.1066,
         0.2580,  0.9305,  0.8465,  0.6465,  0.3939,  0.9563,  0.1731,
         0.0106,  0.7055,  0.9828,  0.0503,  0.0426,  0.9621,  0.3976,
         0.9249,  0.9984,  0.9209,  0.0678,  0.6993,  0.0077,  0.9367,
         0.0282,  0.0556,  0.0295,  0.2696,  0.9520,  0.9200,  0.9546,
         0.0181,  0.0296,  0.1196,  0.0707,  0.3670,  0.8861,  0.9697,
         0.6260,  0.1088,  0.9074,  0.8094,  0.0071,  0.4329,  0.5203,
         0.1277,  0.0656,  0.9948,  0.9522,  0.9129,  0.0834,  0.0420,
         0.8066,  0.9291,  0.9483,  0.9604,  0.3075,  0.0034,  0.6868,
         0.0259,  0.7421,  0.8428,  0.9630,  0.9413,  0.0775,  0.9154,
         0.9884,  0.0216,  0.7948,  0.0291,  0.0208,  0.9681,  0.8870,
         0.9437,  0.9791,  0.1001,  0.9924,  0.4214,  0.1604,  0.9878,
         0.0024,  0.0574,  0.6733,  0.9735,  0.0004,  0.9635,  0.0017,
         0.2432,  0.9408,  0.0346,  0.9289,  0.0156,  0.0893,  0.8835,
         0.8421,  0.9429,  0.0649,  0.0057,  0.6296,  0.5243,  0.0112,
         0.0777,  0.8314,  0.0107,  0.9848,  0.9841,  0.9201,  0.9309,
         0.0569,  0.2622,  0.0071,  0.6323,  0.7793,  0.3001,  0.3021,
         0.9359,  0.9568,  0.2244,  0.9347,  0.8686,  0.1420,  0.9857,
         0.0673,  0.9752,  0.9775,  0.9628,  0.9884,  0.3117,  0.8865,
         0.9531,  0.1034,  0.4584,  0.9453,  0.9485,  0.9941,  0.0011,
         0.9601,  0.6524,  0.0105,  0.9850,  0.2823,  0.1201,  0.9430,
         0.9423,  0.9869,  0.9930,  0.9226,  0.9921,  0.2856,  0.2132,
         0.9606,  0.9627,  0.0150,  0.1786,  0.9989,  0.9961,  0.0256,
         0.3667,  0.9644,  0.9702,  0.3440,  0.9754,  0.9368,  0.9761,
         0.4108,  0.1712,  0.2528,  0.1888,  0.0418,  0.1418,  0.9314,
         0.9738,  0.2288,  0.0578,  0.9665,  0.7300,  0.7554,  0.9776,
         0.0884,  0.0525,  0.9864,  0.7240,  0.9806,  0.9635,  0.0354,
         0.5409,  0.0636,  0.9995,  0.1992,  0.9787,  0.9371,  0.1195,
         0.9975,  0.0041,  0.0281,  0.9787,  0.0031,  0.9964,  0.9806,
         0.1610,  0.3574,  0.9819,  0.7997,  0.0647,  0.5048,  0.3002,
         0.0273,  0.1184,  0.0256,  0.2358,  0.9426,  0.4505,  0.9700,
         0.0238,  0.9109,  0.0258,  0.9342,  0.9644,  0.7990,  0.0875,
         0.1273,  0.2588,  0.6906,  0.9935,  0.9523,  0.0491,  0.9310,
         0.9475,  0.1190,  0.9166,  0.1609,  0.1426,  0.9941,  0.0099,
         0.1624,  0.9977,  0.4316,  0.9552,  0.1490,  0.0013,  0.9709,
         0.9738,  0.8706,  0.9786,  0.5456,  0.8042,  0.9990,  0.0273,
         0.0059,  0.3445,  0.0796,  0.9698,  0.0033,  0.4809,  0.0488,
         0.3441,  0.8815,  0.8601,  0.9916,  0.6971,  0.7842,  0.0314,
         0.0289,  0.0176,  0.2334,  0.0422,  0.0150,  0.9536,  0.9664,
         0.0101,  0.9868,  0.9812,  0.0519,  0.2754,  0.9558,  0.0288,
         0.0262,  0.8203,  0.9493,  0.9789,  0.9469,  0.0261,  0.8497,
         0.1570], device='cuda:0')
tensor(0.2703, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9603,  0.0889,  0.1162,  0.2462,  0.0330,  0.9572,  0.6995,
         0.9553,  0.0223,  0.2230,  0.1547,  0.9056,  0.9191,  0.9588,
         0.0881,  0.1624,  0.1640,  0.3240,  0.1577,  0.9947,  0.9308,
         0.9759,  0.6717,  0.9746,  0.0031,  0.7246,  0.0964,  0.7691,
         0.9366,  0.8516,  0.8414,  0.1657,  0.0759,  0.6593,  0.0215,
         0.8975,  0.9493,  0.1112,  0.9972,  0.7365,  0.0827,  0.8917,
         0.1072,  0.0115,  0.9918,  0.0436,  0.8870,  0.2666,  0.9318,
         0.0348,  0.9848,  0.0388,  0.1790,  0.2188,  0.9994,  0.9813,
         0.0945,  0.1757,  0.9705,  0.1281,  0.9457,  0.1687,  0.9645,
         0.9469,  0.8537,  0.0337,  0.0738,  0.1649,  0.9189,  0.0041,
         0.7085,  0.0218,  0.4437,  0.0442,  0.9539,  0.0634,  0.1720,
         0.7960,  0.0315,  0.6236,  0.0497,  0.9773,  0.9467,  0.0032,
         0.3657,  0.6294,  0.9292,  0.0147,  0.6569,  0.3144,  0.2575,
         0.9777,  0.0068,  0.0620,  0.7207,  0.0078,  0.9157,  0.0762,
         0.8487,  0.4913,  0.8989,  0.1967,  0.1310,  0.9874,  0.9717,
         0.0373,  0.1200,  0.9047,  0.3420,  0.8218,  0.9842,  0.9994,
         0.9313,  0.1213,  0.0427,  0.0441,  0.9636,  0.8764,  0.0043,
         0.9419,  0.9165,  0.4982,  0.2037,  0.9769,  0.0083,  0.2963,
         0.0672,  0.9617,  0.8664,  0.9299,  0.9161,  0.9674,  0.0380,
         0.9004,  0.9128,  0.9754,  0.9294,  0.8013,  0.9555,  0.0603,
         0.0428,  0.9283,  0.0009,  0.3178,  0.0188,  0.9906,  0.9794,
         0.0064,  0.9733,  0.0168,  0.9948,  0.9543,  0.8605,  0.5024,
         0.9799,  0.9941,  0.2722,  0.0102,  0.9911,  0.2264,  0.9548,
         0.0568,  0.3141,  0.7742,  0.9485,  0.0594,  0.5025,  0.1893,
         0.9721,  0.9822,  0.1242,  0.9389,  0.5769,  0.1592,  0.9699,
         0.9650,  0.3405,  0.0824,  0.9260,  0.0625,  0.9494,  0.9318,
         0.6144,  0.8416,  0.9676,  0.6215,  0.9983,  0.8826,  0.0539,
         0.1061,  0.0157,  0.9532,  0.9656,  0.2150,  0.9989,  0.8910,
         0.2169,  0.9503,  0.9357,  0.6984,  0.9960,  0.9409,  0.2045,
         0.1774,  0.0058,  0.9434,  0.3326,  0.0755,  0.9836,  0.9554,
         0.0250,  0.9684,  0.0482,  0.0336,  0.1558,  0.5508,  0.4727,
         0.4627,  0.1111,  0.0769,  0.0164,  0.9623,  0.9308,  0.0981,
         0.0066,  0.0049,  0.9998,  0.0533,  0.1078,  0.9446,  0.9849,
         0.0695,  0.2395,  0.9366,  0.9730,  0.5074,  0.9736,  0.6432,
         0.9351,  0.9271,  0.0015,  0.8331,  0.0664,  0.9894,  0.8415,
         0.1054,  0.0480,  0.9974,  0.0774,  0.9773,  0.0254,  0.9991,
         0.1566,  0.5115,  0.9838,  0.8325,  0.9460,  0.2054,  0.4103,
         0.9529,  0.9224,  0.9995,  0.0555,  0.3538,  0.0014,  0.1364,
         0.9879,  0.5946,  0.0303,  0.5527,  0.9831,  0.5426,  0.9870,
         0.8359,  0.6568,  0.1025,  0.9284,  0.9600,  0.9687,  0.9504,
         0.9933,  0.0907,  0.9119,  0.9950,  0.9727,  0.1983,  0.2872,
         0.9274,  0.2120,  0.8354,  0.9834,  0.5568,  0.0513,  0.5142,
         0.0050,  0.9011,  0.3604,  0.3582,  0.4009,  0.9831,  0.7760,
         0.7933,  0.9076,  0.6482,  0.2686,  0.8247,  0.7170,  0.9808,
         0.9903,  0.9699,  0.4638,  0.0015,  0.0312,  0.9840,  0.1836,
         0.2324,  0.8981,  0.9940,  0.1970,  0.4181,  0.9766,  0.0181,
         0.0305,  0.3873,  0.4711,  0.8063,  0.9877,  0.8733,  0.9764,
         0.9935,  0.9739,  0.9318,  0.0013,  0.9718,  0.7267,  0.6380,
         0.0428,  0.3417,  0.9801,  0.9985,  0.1312,  0.0940,  0.0641,
         0.2199,  0.9764,  0.5828,  0.4245,  0.3222,  0.6419,  0.1899,
         0.9429,  0.9866,  0.9464,  0.0113,  0.0238,  0.7892,  0.9090,
         0.4125,  0.6310,  0.2688,  0.8926,  0.9522,  0.7905,  0.9176,
         0.2022,  0.0351,  0.7473,  0.0852,  0.8610,  0.9859,  0.0298,
         0.7177,  0.0183,  0.9405,  0.9995,  0.9640,  0.8790,  0.6672,
         0.9777,  0.1289,  0.0087,  0.0775,  0.9689,  0.0103,  0.7342,
         0.9917,  0.9809,  0.9695,  0.9707,  0.0825,  0.8588,  0.0114,
         0.7241,  0.6385,  0.0810,  0.9245,  0.9896,  0.8501,  0.0449,
         0.9654,  0.7898,  0.9523,  0.9671,  0.8840,  0.0134,  0.3555,
         0.0317,  0.0600,  0.9806,  0.3147,  0.9929,  0.8956,  0.9577,
         0.0144,  0.9963,  0.0459,  0.8264,  0.9312,  0.9688,  0.7827,
         0.0494,  0.9740,  0.1882,  0.9026,  0.9966,  0.0173,  0.0338,
         0.1957,  0.0131,  0.0523,  0.1381,  0.0451,  0.9987,  0.0402,
         0.1004,  0.8349,  0.3479,  0.0334,  0.3491,  0.9253,  0.0211,
         0.0221,  0.9972,  0.2957,  0.5668,  0.9604,  0.9709,  0.5810,
         0.0283,  0.2672,  0.9476,  0.0403,  0.9496,  0.6552,  0.0031,
         0.0213,  0.0563,  0.9819,  0.1248,  0.9751,  0.2593,  0.0062,
         0.9832,  0.2164,  0.9925,  0.0434,  0.4399,  0.9106,  0.7397,
         0.9713,  0.6573,  0.0665,  0.9923,  0.8696,  0.0201,  0.0945,
         0.1439,  0.5233,  0.9334,  0.9760,  0.4539,  0.9231,  0.8291,
         0.9998,  0.9655,  0.9968,  0.9284,  0.0592,  0.0149,  0.4236,
         0.9429,  0.9812,  0.9639,  0.9370,  0.5941,  0.9831,  0.0060,
         0.7461,  0.1027,  0.9388,  0.0292,  0.0420,  0.8677,  0.1008,
         0.4537,  0.9498,  0.4017,  0.9624,  0.8782,  0.0109,  0.0184,
         0.8810], device='cuda:0')
tensor(0.2873, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0575,  0.8986,  0.2719,  0.9985,  0.1151,  0.0151,  0.0881,
         0.3535,  0.9988,  0.0831,  0.9302,  0.2743,  0.0822,  0.8190,
         0.3206,  0.5135,  0.3450,  0.9999,  0.9134,  0.2625,  0.9219,
         0.3249,  0.0329,  0.9711,  0.9350,  0.0375,  0.1452,  0.2703,
         0.0443,  0.8839,  0.8057,  0.9616,  0.1511,  0.7223,  0.1684,
         0.9958,  0.8379,  0.8601,  0.3137,  0.0172,  0.3064,  0.9796,
         0.7184,  0.9732,  0.0063,  0.8990,  0.9955,  0.1125,  0.9939,
         0.5803,  0.9034,  0.5638,  0.6309,  0.0423,  0.0098,  0.1974,
         0.9988,  0.0208,  0.9559,  0.0406,  0.0725,  0.5869,  0.5065,
         0.1194,  0.5132,  0.5685,  0.9711,  0.5133,  0.2095,  0.3657,
         0.1067,  0.8837,  0.0872,  0.0711,  0.7232,  0.2599,  0.2274,
         0.0192,  0.5109,  0.8956,  0.1927,  0.8006,  0.0404,  0.1542,
         0.0462,  0.2051,  0.8690,  0.2418,  0.3949,  0.0552,  0.9892,
         0.1395,  0.9692,  0.0271,  0.0982,  0.9188,  0.0471,  0.9673,
         0.3097,  0.9887,  0.7688,  0.8999,  0.9917,  0.0706,  0.0494,
         0.0124,  0.0376,  0.9481,  0.0035,  0.0508,  0.8291,  0.8694,
         0.5826,  0.1355,  0.9783,  0.9254,  0.9696,  0.4955,  0.7350,
         0.9618,  0.7233,  0.1579,  0.8464,  0.2226,  0.4325,  0.1018,
         0.7749,  0.0357,  0.8929,  0.8171,  0.9862,  0.2143,  0.2814,
         0.0333,  0.0308,  0.9442,  0.9461,  0.0327,  0.9959,  0.0099,
         0.0142,  0.0609,  0.7913,  0.9880,  0.9233,  0.9435,  0.9621,
         0.9757,  0.9482,  0.0761,  0.9815,  0.9381,  0.2214,  0.5715,
         0.7863,  0.1181,  0.0371,  0.3489,  0.4341,  0.0650,  0.8263,
         0.9103,  0.0351,  0.4647,  0.3831,  0.9818,  0.5074,  0.9795,
         0.4068,  0.9908,  0.8923,  0.9824,  0.2504,  0.0316,  0.9738,
         0.9724,  0.9996,  0.8478,  0.1855,  0.1558,  0.9383,  0.7429,
         0.7086,  0.8567,  0.0851,  0.9516,  0.6854,  0.0354,  0.9648,
         0.0467,  0.9457,  0.1109,  0.0272,  0.9903,  0.0085,  0.1764,
         0.9659,  0.9499,  0.8553,  0.9488,  0.7206,  0.0663,  0.0231,
         0.0133,  0.2074,  0.0474,  0.1520,  0.9628,  0.1172,  0.8581,
         0.9727,  0.2605,  0.8892,  0.8436,  0.7958,  0.0192,  0.9504,
         0.0187,  0.5880,  0.9604,  0.9821,  0.0456,  0.1094,  0.8079,
         0.8025,  0.7751,  0.7627,  0.9996,  0.2256,  0.0745,  0.9713,
         0.1855,  0.2634,  0.0113,  0.1065,  0.7839,  0.0452,  0.6681,
         0.0320,  0.3298,  0.1681,  0.3666,  0.6487,  0.0939,  0.9550,
         0.9186,  0.4950,  0.2119,  0.7016,  0.9409,  0.9847,  0.1024,
         0.0221,  0.5721,  0.1074,  0.0096,  0.4181,  0.9522,  0.0179,
         0.6455,  0.1328,  0.8675,  0.5128,  0.9283,  0.2261,  0.0255,
         0.0387,  0.0412,  0.2269,  0.2093,  0.8894,  0.4358,  0.4940,
         0.2362,  0.7856,  0.8921,  0.7955,  0.9310,  0.4824,  0.0007,
         0.9732,  0.9679,  0.9451,  0.9640,  0.6336,  0.1355,  0.0506,
         0.8902,  0.0120,  0.7615,  0.9967,  0.9870,  0.3309,  0.0095,
         0.1381,  0.9482,  0.0551,  0.3108,  0.5338,  0.9841,  0.9855,
         0.5882,  0.8921,  0.2663,  0.7341,  0.0787,  0.7357,  0.6221,
         0.9062,  0.5011,  0.7929,  0.9570,  0.0753,  0.9214,  0.2838,
         0.9021,  0.5798,  0.0019,  0.9995,  0.1654,  0.7377,  0.2434,
         0.9837,  0.0009,  0.9887,  0.2900,  0.0047,  0.6395,  0.7130,
         0.8968,  0.8964,  0.6180,  0.7370,  0.9664,  0.9232,  0.0939,
         0.1105,  0.3314,  0.0126,  0.9479,  0.8860,  0.7331,  0.2775,
         0.2291,  0.3099,  0.2459,  0.1758,  0.8613,  0.9678,  0.1912,
         0.0508,  0.8691,  0.9843,  0.0852,  0.8952,  0.0611,  0.9977,
         0.6451,  0.1218,  0.9159,  0.9237,  0.0220,  0.2968,  0.9580,
         0.2976,  0.9944,  0.9239,  0.8365,  0.0046,  0.9760,  0.3958,
         0.9643,  0.4056,  0.1860,  0.0623,  0.9258,  0.6721,  0.9562,
         0.1850,  0.0155,  0.1656,  0.3441,  0.9368,  0.7481,  0.9864,
         0.9814,  0.9999,  0.0136,  0.5186,  0.9446,  0.0388,  0.0183,
         0.7570,  0.1667,  0.0816,  0.5249,  0.9708,  0.9870,  0.9848,
         0.2278,  0.9280,  0.0426,  0.9887,  0.6159,  0.9935,  0.0307,
         0.2306,  0.8923,  0.9604,  0.9847,  0.7993,  0.0184,  0.1324,
         0.7576,  0.9013,  0.1680,  0.3690,  0.3614,  0.0036,  0.1199,
         0.9048,  0.0103,  0.4885,  0.9079,  0.8033,  0.0353,  0.6285,
         0.2013,  0.9987,  0.0681,  0.1729,  0.0946,  0.2367,  0.8143,
         0.0315,  0.1042,  0.9297,  0.0448,  0.8550,  0.0031,  0.9818,
         0.9808,  0.7126,  0.8434,  0.9691,  0.3457,  0.9827,  0.9675,
         0.9350,  0.9229,  0.9763,  0.3703,  0.4298,  0.0079,  0.9382,
         0.9926,  0.0741,  0.9347,  0.6514,  0.9720,  0.9858,  0.7985,
         0.1201,  0.8231,  0.7847,  0.9664,  0.9943,  0.9403,  0.8332,
         0.0488,  0.8237,  0.9568,  0.8495,  0.0512,  0.4533,  0.2413,
         0.9790,  0.6114,  0.4892,  0.3543,  0.1720,  0.2333,  0.6513,
         0.1128,  0.4112,  0.0216,  0.9941,  0.0199,  0.0109,  0.2873,
         0.8582,  0.0461,  0.9696,  0.9906,  0.2552,  0.2052,  0.9281,
         0.9586,  0.9878,  0.1080,  0.3070,  0.2513,  0.9735,  0.9473,
         0.7832,  0.9977,  0.6745,  0.9676,  0.0828,  0.9859,  0.9288,
         0.8833], device='cuda:0')
tensor(0.2875, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1992,  0.4399,  0.9709,  0.7196,  0.2454,  0.0311,  0.8949,
         0.8624,  0.9972,  0.8296,  0.1438,  0.4798,  0.0334,  0.9882,
         0.7160,  0.9469,  0.5735,  0.0094,  0.7517,  0.3664,  0.0036,
         0.1197,  0.9612,  0.0182,  0.0350,  0.2590,  0.0122,  0.9737,
         0.0394,  0.0189,  0.0969,  0.9731,  0.1040,  0.9776,  0.0578,
         0.9805,  0.9970,  0.9234,  0.9943,  0.9576,  0.3926,  0.0072,
         0.9869,  0.3524,  0.8713,  0.5147,  0.1300,  0.0053,  0.7569,
         0.0589,  0.3698,  0.3193,  0.1474,  0.9046,  0.1588,  0.7626,
         0.9906,  0.2534,  0.7673,  0.9043,  0.0836,  0.0597,  0.1993,
         0.8431,  0.0035,  0.3732,  0.9988,  0.0176,  0.0241,  0.9332,
         0.9653,  0.8954,  0.3309,  0.7585,  0.2980,  0.9634,  0.9582,
         0.7489,  0.9502,  0.2481,  0.3284,  0.9463,  0.1934,  0.0618,
         0.2522,  0.8464,  0.9599,  0.0112,  0.2689,  0.7486,  0.9522,
         0.4384,  0.9429,  0.8979,  0.7757,  0.9675,  0.6789,  0.1415,
         0.9307,  0.3248,  0.0860,  0.6242,  0.9812,  0.0065,  0.0873,
         0.0229,  0.0015,  0.4591,  0.9260,  0.0408,  0.8860,  0.8777,
         0.2473,  0.7919,  0.8837,  0.5646,  0.9655,  0.2002,  0.6846,
         0.9917,  0.0848,  0.9552,  0.9262,  0.8369,  0.8650,  0.2162,
         0.6789,  0.9525,  0.0160,  0.9802,  0.5645,  0.9917,  0.9833,
         0.4537,  0.0626,  0.8077,  0.2547,  0.5359,  0.9886,  0.0800,
         0.0472,  0.0061,  0.9959,  0.6047,  0.1248,  0.7765,  0.0229,
         0.4097,  0.6891,  0.2315,  0.1024,  0.0245,  0.4952,  0.9992,
         0.0740,  0.0700,  0.2875,  0.6172,  0.0238,  0.9962,  0.9508,
         0.7306,  0.0738,  0.8453,  0.9984,  0.0453,  0.9579,  0.1694,
         0.6833,  0.9779,  0.4483,  0.9889,  0.6357,  0.2936,  0.8536,
         0.9868,  0.1086,  0.9858,  0.3510,  0.3628,  0.9123,  0.9770,
         0.1866,  0.0057,  0.9070,  0.0056,  0.4464,  0.9933,  0.8237,
         0.6340,  0.8099,  0.6468,  0.8094,  0.0866,  0.5125,  0.0576,
         0.9397,  0.8975,  0.1894,  0.1731,  0.9672,  0.8498,  0.5110,
         0.4351,  0.3603,  0.9065,  0.3127,  0.9669,  0.0072,  0.0794,
         0.0951,  0.0106,  0.9697,  0.0048,  0.7228,  0.9802,  0.1149,
         0.9606,  0.9757,  0.0488,  0.9401,  0.0116,  0.9410,  0.9548,
         0.7547,  0.1311,  0.0758,  0.0988,  0.6171,  0.9293,  0.3610,
         0.6136,  0.0644,  0.6647,  0.0971,  0.0684,  0.3204,  0.8655,
         0.9123,  0.9847,  0.5945,  0.2281,  0.9920,  0.9539,  0.1041,
         0.9461,  0.0028,  0.2872,  0.9255,  0.2118,  0.3993,  0.0538,
         0.9109,  0.0701,  0.1953,  0.9302,  0.3860,  0.1267,  0.8932,
         0.7037,  0.3859,  0.0900,  0.6566,  0.8959,  0.9650,  0.4903,
         0.1312,  0.8064,  0.9302,  0.9540,  0.9520,  0.9774,  0.9514,
         0.0863,  0.1373,  0.5527,  0.3234,  0.0318,  0.0413,  0.8529,
         0.1049,  0.9413,  0.7505,  0.1323,  0.9090,  0.2642,  0.9869,
         0.0594,  0.7849,  0.0406,  0.9393,  0.7494,  0.8047,  0.0348,
         0.1989,  0.6660,  0.9118,  0.1820,  0.9962,  0.1249,  0.8490,
         0.9513,  0.9867,  0.9969,  0.0113,  0.3443,  0.9556,  0.9956,
         0.3963,  0.8782,  0.8687,  0.9914,  0.2595,  0.2783,  0.1505,
         0.7961,  0.9404,  0.0913,  0.0623,  0.9558,  0.9160,  0.0412,
         0.0217,  0.6155,  0.1557,  0.8206,  0.2376,  0.9752,  0.0034,
         0.0861,  0.8226,  0.2309,  0.1479,  0.9247,  0.5950,  0.2342,
         0.4926,  0.0811,  0.0544,  0.0858,  0.2709,  0.8862,  0.0295,
         0.0645,  0.8317,  0.2544,  0.8458,  0.5975,  0.9387,  0.1631,
         0.7308,  0.9462,  0.9828,  0.9184,  0.0435,  0.9414,  0.9270,
         0.8905,  0.9531,  0.9478,  0.1017,  0.9653,  0.1188,  0.9708,
         0.9687,  0.6929,  0.2626,  0.3340,  0.9442,  0.1643,  0.0697,
         0.0482,  0.0277,  0.8159,  0.9091,  0.0698,  0.0110,  0.9935,
         0.0066,  0.0615,  0.7127,  0.9030,  0.7526,  0.6784,  0.2908,
         0.8201,  0.4470,  0.0841,  0.5307,  0.2606,  0.8719,  0.9904,
         0.3353,  0.0063,  0.9710,  0.9994,  0.0878,  0.4751,  0.8204,
         0.7839,  0.7893,  0.9679,  0.0007,  0.7086,  0.0360,  0.9510,
         0.4037,  0.0900,  0.0922,  0.9930,  0.1013,  0.9786,  0.8791,
         0.1467,  0.8470,  0.5607,  0.9620,  0.1289,  0.9573,  0.0255,
         0.1329,  0.8739,  0.0379,  0.9881,  0.1173,  0.2057,  0.1115,
         0.7105,  0.0529,  0.7444,  0.0268,  0.0134,  0.9277,  0.0225,
         0.9789,  0.9372,  0.9555,  0.6708,  0.9804,  0.0227,  0.8603,
         0.9512,  0.6086,  0.0649,  0.9870,  0.9907,  0.1102,  0.5273,
         0.7781,  0.9498,  0.8466,  0.0425,  0.0044,  0.0595,  0.8457,
         0.1776,  0.9009,  0.0370,  0.7785,  0.3308,  0.5609,  0.2666,
         0.8726,  0.9751,  0.9802,  0.3205,  0.8858,  0.9729,  0.3899,
         0.1596,  0.8977,  0.7563,  0.1027,  0.0691,  0.9388,  0.2151,
         0.8118,  0.1933,  0.8517,  0.0666,  0.9096,  0.0251,  0.2455,
         0.8747,  0.9530,  0.0467,  0.9666,  0.9259,  0.9304,  0.5645,
         0.0812,  0.9846,  0.8995,  0.9743,  0.0901,  0.2940,  0.0733,
         0.9754,  0.1415,  0.0100,  0.9967,  0.4612,  0.1620,  0.0410,
         0.0326,  0.9099,  0.1297,  0.0178,  0.0195,  0.9206,  0.0423,
         0.9861], device='cuda:0')
tensor(0.2549, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1937,  0.3027,  0.8322,  0.5003,  0.9423,  0.1087,  0.0251,
         0.9275,  0.0063,  0.0292,  0.3668,  0.1543,  0.6175,  0.2680,
         0.0531,  0.1452,  0.8837,  0.1028,  0.3752,  0.7079,  0.6344,
         0.0008,  0.8637,  0.8280,  0.3426,  0.9704,  0.9188,  0.9555,
         0.1106,  0.4212,  0.1191,  0.8959,  0.2641,  0.1195,  0.9132,
         0.9614,  0.1961,  0.7244,  0.6265,  0.1427,  0.1387,  0.2028,
         0.8997,  0.1075,  0.0035,  0.0018,  0.5298,  0.7929,  0.9369,
         0.1039,  0.0011,  0.6968,  0.4378,  0.9173,  0.0379,  0.2890,
         0.9504,  0.9585,  0.9237,  0.1160,  0.0624,  0.9568,  0.8413,
         0.8748,  0.1041,  0.7460,  0.3155,  0.8042,  0.1688,  0.6169,
         0.9527,  0.9388,  0.6559,  0.1109,  0.0221,  0.8391,  0.4738,
         0.7884,  0.9270,  0.0648,  0.9666,  0.6601,  0.1055,  0.1859,
         0.0049,  0.1654,  0.1750,  0.0563,  0.2215,  0.6863,  0.9918,
         0.2362,  0.9572,  0.2783,  0.3703,  0.0270,  0.9429,  0.0063,
         0.0594,  0.0606,  0.3837,  0.8514,  0.0197,  0.9638,  0.1849,
         0.9523,  0.9712,  0.9954,  0.8263,  0.1971,  0.2578,  0.9961,
         0.0033,  0.9207,  0.9620,  0.4873,  0.1169,  0.0952,  0.8409,
         0.9479,  0.9623,  0.0501,  0.9496,  0.0344,  0.0153,  0.0283,
         0.9602,  0.9660,  0.4269,  0.0344,  0.8419,  0.9411,  0.3084,
         0.0009,  0.9964,  0.0544,  0.1955,  0.0021,  0.2287,  0.1660,
         0.8353,  0.0798,  0.4553,  0.5657,  0.0011,  0.0936,  0.6959,
         0.9616,  0.1713,  0.8303,  0.9395,  0.0006,  0.8903,  0.9275,
         0.8807,  0.3778,  0.2977,  0.0886,  0.7845,  0.9528,  0.1960,
         0.7345,  0.5214,  0.0352,  0.3823,  0.8706,  0.9225,  0.1631,
         0.0111,  0.0208,  0.0018,  0.9539,  0.9003,  0.9415,  0.0022,
         0.0287,  0.0086,  0.9046,  0.4953,  0.0519,  0.1735,  0.0041,
         0.2221,  0.8764,  0.9678,  0.8501,  0.5265,  0.3881,  0.9984,
         0.1988,  0.8247,  0.8277,  0.0274,  0.0159,  0.0061,  0.9622,
         0.4721,  0.7374,  0.9396,  0.1522,  0.5269,  0.1865,  0.1567,
         0.8190,  0.0473,  0.6738,  0.7978,  0.8988,  0.9866,  0.0432,
         0.0099,  0.0061,  0.3470,  0.1295,  0.1922,  0.0050,  0.1729,
         0.8311,  0.9820,  0.0035,  0.9857,  0.9213,  0.9484,  0.0743,
         0.0231,  0.9892,  0.6701,  0.1078,  0.9124,  0.9835,  0.2902,
         0.9613,  0.5180,  0.1573,  0.5569,  0.3054,  0.1943,  0.9679,
         0.5705,  0.9697,  0.0850,  0.0154,  0.0134,  0.9230,  0.1426,
         0.9992,  0.0662,  0.1255,  0.0272,  0.0009,  0.0898,  0.9441,
         0.3758,  0.0793,  0.9471,  0.1357,  0.6495,  0.9396,  0.7722,
         0.9771,  0.6851,  0.9413,  0.9206,  0.6512,  0.0010,  0.9415,
         0.0164,  0.3776,  0.9994,  0.9750,  0.7165,  0.5002,  0.9967,
         0.0998,  0.9733,  0.8559,  0.9659,  0.2951,  0.2687,  0.3543,
         0.0058,  0.1325,  0.3377,  0.0396,  0.8097,  0.2054,  0.2580,
         0.5140,  0.0862,  0.5862,  0.0276,  0.4040,  0.9848,  0.1685,
         0.1573,  0.3825,  0.0168,  0.4705,  0.0880,  0.0485,  0.7933,
         0.0510,  0.9718,  0.0555,  0.0266,  0.0665,  0.9387,  0.0033,
         0.0462,  0.9692,  0.6873,  0.9353,  0.9651,  0.0160,  0.0227,
         0.3005,  0.2479,  0.8211,  0.0039,  0.6284,  0.9246,  0.9985,
         0.8935,  0.2758,  0.1331,  0.6787,  0.1210,  0.0239,  0.0069,
         0.9369,  0.1362,  0.9218,  0.9867,  0.9796,  0.8713,  0.0030,
         0.9537,  0.0632,  0.0834,  0.2578,  0.8398,  0.9582,  0.0898,
         0.1468,  0.9919,  0.2664,  0.8729,  0.0047,  0.9138,  0.0749,
         0.0811,  0.0125,  0.9459,  0.2344,  0.8968,  0.0790,  0.7959,
         0.5495,  0.0964,  0.8177,  0.0172,  0.7075,  0.7602,  0.2267,
         0.8470,  0.3910,  0.9041,  0.0642,  0.9956,  0.1876,  0.9990,
         0.0524,  0.9835,  0.0427,  0.9930,  0.0798,  0.0178,  0.8058,
         0.1560,  0.9130,  0.9051,  0.2534,  0.4742,  0.2044,  0.0058,
         0.0592,  0.0243,  0.9648,  0.0528,  0.9898,  0.2816,  0.0526,
         0.1465,  0.6866,  0.1413,  0.9359,  0.8177,  0.9929,  0.0130,
         0.7785,  0.1795,  0.9504,  0.0873,  0.9819,  0.9609,  0.0341,
         0.4982,  0.8965,  0.0404,  0.2324,  0.0788,  0.0521,  0.2073,
         0.0728,  0.9928,  0.9653,  0.9026,  0.1692,  0.9864,  0.5920,
         0.3844,  0.5354,  0.0147,  0.0568,  0.0412,  0.9736,  0.8114,
         0.9512,  0.9246,  0.7679,  0.0097,  0.0130,  0.0021,  0.3841,
         0.0146,  0.9526,  0.7166,  0.0295,  0.8841,  0.9365,  0.4371,
         0.7806,  0.7677,  0.3742,  0.0454,  0.0779,  0.8833,  0.0952,
         0.9969,  0.5403,  0.7911,  0.2172,  0.0068,  0.9034,  0.3213,
         0.1309,  0.9601,  0.4199,  0.8925,  0.9758,  0.1003,  0.9613,
         0.6959,  0.2249,  0.0241,  0.8754,  0.9796,  0.1640,  0.8644,
         0.7538,  0.2000,  0.9990,  0.3097,  0.1798,  0.5989,  0.1749,
         0.0862,  0.0320,  0.0789,  0.4515,  0.0476,  0.1968,  0.7239,
         0.0440,  0.1636,  0.1514,  0.8467,  0.8881,  0.0052,  0.0397,
         0.7924,  0.8994,  0.9633,  0.0935,  0.2445,  0.9294,  0.9537,
         0.0193,  0.8321,  0.1224,  0.9751,  0.0369,  0.0347,  0.8048,
         0.3133,  0.9428,  0.9257,  0.8470,  0.0325,  0.9904,  0.3760,
         0.1013], device='cuda:0')
tensor(0.2695, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1386,  0.3708,  0.0805,  0.9898,  0.0265,  0.9529,  0.9052,
         0.9151,  0.4701,  0.0751,  0.0159,  0.0086,  0.9809,  0.6072,
         0.1034,  0.7729,  0.0751,  0.0008,  0.8303,  0.2836,  0.0683,
         0.2156,  0.0015,  0.0030,  0.2718,  0.8043,  0.9789,  0.2772,
         0.0119,  0.7193,  0.2106,  0.2480,  0.1415,  0.1538,  0.0057,
         0.9737,  0.5576,  0.8313,  0.8429,  0.0619,  0.2700,  0.3791,
         0.9757,  0.0603,  0.5012,  0.8991,  0.0632,  0.0016,  0.0533,
         0.5695,  0.7787,  0.8392,  0.0022,  0.0018,  0.9787,  0.2693,
         0.8947,  0.9251,  0.0112,  0.9823,  0.9865,  0.1640,  0.9960,
         0.0766,  0.0077,  0.8831,  0.0016,  0.4966,  0.0033,  0.2723,
         0.1600,  0.0365,  0.9997,  0.5109,  0.8966,  0.0160,  0.9257,
         0.3021,  0.9992,  0.9560,  0.3099,  0.0133,  0.2944,  0.1447,
         0.9267,  0.0861,  0.0935,  0.9916,  0.7964,  0.0592,  0.5367,
         0.0174,  0.2704,  0.1020,  0.9061,  0.0034,  0.4114,  0.8706,
         0.9583,  0.1038,  0.1198,  0.5476,  0.7216,  0.9680,  0.9810,
         0.2742,  0.7908,  0.9162,  0.0253,  0.7752,  0.1432,  0.0023,
         0.0275,  0.0359,  0.1309,  0.9517,  0.6597,  0.9592,  0.0318,
         0.9699,  0.9229,  0.1702,  0.7430,  0.9778,  0.6531,  0.0642,
         0.5076,  0.8970,  0.0706,  0.6448,  0.1989,  0.9866,  0.9591,
         0.2421,  0.0011,  0.0341,  0.8117,  0.9818,  0.9933,  0.8072,
         0.9801,  0.1796,  0.9975,  0.7162,  0.3604,  0.9192,  0.0529,
         0.0073,  0.0994,  0.1092,  0.1713,  0.1447,  0.8629,  0.8701,
         0.2906,  0.0542,  0.0165,  0.8764,  0.8930,  0.0368,  0.8462,
         0.8632,  0.9788,  0.1753,  0.5813,  0.0457,  0.9991,  0.0153,
         0.8775,  0.0068,  0.0472,  0.0023,  0.8476,  0.9709,  0.0536,
         0.0308,  0.9737,  0.9941,  0.9241,  0.8645,  0.9550,  0.9215,
         0.9971,  0.0782,  0.2530,  0.8373,  0.4845,  0.9589,  0.0507,
         0.7575,  0.9267,  0.2121,  0.9670,  0.9769,  0.9234,  0.9475,
         0.1741,  0.0548,  0.2351,  0.0281,  0.0445,  0.0101,  0.2627,
         0.0273,  0.9922,  0.1502,  0.7503,  0.2111,  0.7395,  0.0087,
         0.0043,  0.7248,  0.9006,  0.6912,  0.9850,  0.7003,  0.9595,
         0.9766,  0.0081,  0.0097,  0.4123,  0.9292,  0.8202,  0.9651,
         0.9653,  0.9517,  0.2915,  0.1125,  0.0147,  0.9483,  0.0634,
         0.1426,  0.0157,  0.4393,  0.4820,  0.0055,  0.1298,  0.1025,
         0.6492,  0.8670,  0.9807,  0.9177,  0.9512,  0.0640,  0.9451,
         0.4335,  0.0022,  0.0040,  0.5824,  0.0219,  0.3447,  0.3937,
         0.0163,  0.2865,  0.3157,  0.4035,  0.0615,  0.6283,  0.0041,
         0.0425,  0.1347,  0.5074,  0.0318,  0.1811,  0.1119,  0.0078,
         0.0046,  0.5713,  0.0345,  0.0896,  0.9824,  0.1524,  0.9857,
         0.0556,  0.0549,  0.9070,  0.0737,  0.0650,  0.1412,  0.1707,
         0.9717,  0.9047,  0.8969,  0.8559,  0.4429,  0.5469,  0.9539,
         0.2083,  0.0548,  0.9472,  0.0208,  0.9994,  0.2782,  0.4581,
         0.9507,  0.0415,  0.9836,  0.9870,  0.0028,  0.8892,  0.9055,
         0.8810,  0.9550,  0.0076,  0.0432,  0.0093,  0.1340,  0.3370,
         0.9578,  0.1203,  0.0261,  0.3889,  0.0736,  0.5509,  0.9771,
         0.9749,  0.0740,  0.9994,  0.7343,  0.7592,  0.9992,  0.0274,
         0.1370,  0.9638,  0.7129,  0.8930,  0.6504,  0.9459,  0.7035,
         0.0300,  0.0460,  0.0459,  0.0112,  0.7384,  0.2663,  0.9003,
         0.2944,  0.1261,  0.0037,  0.9714,  0.6447,  0.0616,  0.9269,
         0.2151,  0.0758,  0.9023,  0.8786,  0.9493,  0.0329,  0.0029,
         0.9928,  0.0049,  0.9081,  0.0122,  0.7409,  0.6602,  0.0666,
         0.0817,  0.9347,  0.0457,  0.6775,  0.9918,  0.0241,  0.0855,
         0.7806,  0.9705,  0.8973,  0.1261,  0.3344,  0.0031,  0.1500,
         0.9808,  0.0401,  0.7870,  0.0970,  0.9447,  0.8281,  0.0284,
         0.0563,  0.0139,  0.0133,  0.0518,  0.0515,  0.0030,  0.8312,
         0.4293,  0.2218,  0.2216,  0.2656,  0.9758,  0.0196,  0.8835,
         0.9465,  0.7965,  0.0009,  0.0683,  0.9538,  0.1423,  0.9716,
         0.1177,  0.5270,  0.8948,  0.9778,  0.9627,  0.1915,  0.0259,
         0.9806,  0.0513,  0.7616,  0.0701,  0.9835,  0.9414,  0.9835,
         0.8669,  0.9718,  0.0487,  0.6466,  0.0226,  0.0170,  0.0155,
         0.0714,  0.0947,  0.1160,  0.9313,  0.1100,  0.4030,  0.8743,
         0.9967,  0.0078,  0.0333,  0.0152,  0.0158,  0.9759,  0.0287,
         0.2724,  0.9962,  0.3959,  0.8375,  0.0524,  0.2284,  0.9864,
         0.0120,  0.0084,  0.4165,  0.0105,  0.1506,  0.8312,  0.0387,
         0.1433,  0.0514,  0.0296,  0.4742,  0.3468,  0.3376,  0.0336,
         0.6409,  0.9522,  0.0105,  0.0473,  0.1794,  0.9937,  0.4227,
         0.9200,  0.0485,  0.1624,  0.9608,  0.9828,  0.9793,  0.1776,
         0.1609,  0.8380,  0.0363,  0.0090,  0.0284,  0.0036,  0.9206,
         0.8066,  0.9262,  0.9981,  0.0235,  0.0065,  0.9900,  0.9969,
         0.9960,  0.0218,  0.1314,  0.3061,  0.7675,  0.8621,  0.9763,
         0.9457,  0.9949,  0.4210,  0.2808,  0.0411,  0.3594,  0.6114,
         0.3200,  0.8937,  0.9908,  0.8795,  0.0393,  0.9998,  0.1426,
         0.2634,  0.1292,  0.9238,  0.9111,  0.0157,  0.8907,  0.1292,
         0.3636], device='cuda:0')

2020-06-28 06:05:19 Uploading - Uploading generated training modeltensor(0.2547, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0347,  0.1815,  0.1287,  0.0086,  0.9899,  0.0390,  0.9373,
         0.6961,  0.9687,  0.9772,  0.8765,  0.0294,  0.1027,  0.9573,
         0.0567,  0.1271,  0.0269,  0.0950,  0.9839,  0.9903,  0.3190,
         0.0682,  0.0158,  0.6593,  0.6177,  0.7120,  0.6836,  0.0013,
         0.4565,  0.9832,  0.1791,  0.0240,  0.9315,  0.9469,  0.0007,
         0.0964,  0.7177,  0.0083,  0.9860,  0.9947,  0.0332,  0.0081,
         0.9586,  0.1418,  0.9821,  0.6707,  0.9914,  0.2416,  0.8541,
         0.9998,  0.9951,  0.9870,  0.9462,  0.0388,  0.0007,  0.9693,
         0.8705,  0.9952,  0.7070,  0.1732,  0.1627,  0.9827,  0.0035,
         0.0634,  0.1213,  0.8528,  0.2727,  0.1261,  0.2342,  0.0172,
         0.0332,  0.8976,  0.0427,  0.0185,  0.0145,  0.1915,  0.7598,
         0.9861,  0.0329,  0.0058,  0.1943,  0.9128,  0.6956,  0.0149,
         0.5133,  0.0007,  0.9745,  0.0175,  0.9271,  0.2080,  0.9643,
         0.1559,  0.0516,  0.8194,  0.0141,  0.1960,  0.3505,  0.9842,
         0.6871,  0.0406,  0.0117,  0.9133,  0.0809,  0.9671,  0.3662,
         0.9806,  0.3176,  0.1260,  0.8982,  0.0036,  0.9997,  0.9857,
         0.4985,  0.1969,  0.2244,  0.0632,  0.3819,  0.9585,  0.1867,
         0.0878,  0.9768,  0.5205,  0.7470,  0.1848,  0.9468,  0.8681,
         0.0422,  0.0030,  0.6040,  0.0167,  0.9161,  0.9689,  0.9518,
         0.9861,  0.9614,  0.8317,  0.9999,  0.9690,  0.8549,  0.4306,
         0.9800,  0.7077,  0.0405,  0.9498,  0.9630,  0.0503,  0.0690,
         0.2537,  0.2358,  0.9287,  0.1375,  0.9626,  0.0606,  0.9696,
         0.3178,  0.8029,  0.9959,  0.0459,  0.9821,  0.0076,  0.9672,
         0.0155,  0.9982,  0.0571,  0.8604,  0.0517,  0.0015,  0.0074,
         0.0595,  0.0399,  0.9810,  0.1645,  0.0228,  0.1175,  0.0358,
         0.5334,  0.9825,  0.9148,  0.9755,  0.2909,  0.0021,  0.9869,
         0.9442,  0.0009,  0.9666,  0.0358,  0.9636,  0.0424,  0.9083,
         0.0699,  0.0081,  0.7914,  0.1047,  0.9326,  0.1089,  0.0382,
         0.7319,  0.9653,  0.9161,  0.9447,  0.2150,  0.9814,  0.9453,
         0.0821,  0.9929,  0.9979,  0.0380,  0.7797,  0.7448,  0.7860,
         0.0112,  0.8120,  0.0583,  0.8853,  0.9329,  0.8648,  0.1554,
         0.3418,  0.9382,  0.1158,  0.2508,  0.0679,  0.1932,  0.9410,
         0.9350,  0.0918,  0.2586,  0.8689,  0.0247,  0.8510,  0.0174,
         0.0511,  0.9845,  0.0049,  0.9320,  0.1687,  0.9746,  0.0664,
         0.0816,  0.9681,  0.0693,  0.9921,  0.7931,  0.0188,  0.4823,
         0.0295,  0.0917,  0.0264,  0.9248,  0.0545,  0.7293,  0.2350,
         0.0018,  0.0198,  0.9345,  0.1001,  0.0011,  0.0113,  0.5220,
         0.0565,  0.9942,  0.9700,  0.9691,  0.0384,  0.9429,  0.1643,
         0.9691,  0.9850,  0.6150,  0.9911,  0.3319,  0.6895,  0.3940,
         0.1542,  0.0601,  0.0292,  0.9728,  0.0211,  0.0125,  0.9593,
         0.0103,  0.0331,  0.0665,  0.9980,  0.8188,  0.9600,  0.3170,
         0.6135,  0.9834,  0.0083,  0.0028,  0.0380,  0.9740,  0.9108,
         0.8808,  0.8873,  0.9187,  0.0628,  0.0353,  0.9684,  0.0843,
         0.6820,  0.9198,  0.5824,  0.0011,  0.0443,  0.0041,  0.8589,
         0.0042,  0.6440,  0.2108,  0.0303,  0.9083,  0.1360,  0.1629,
         0.1746,  0.9199,  0.1611,  0.2554,  0.9052,  0.0173,  0.1882,
         0.7848,  0.4170,  0.8865,  0.9132,  0.0996,  0.2317,  0.0774,
         0.9132,  0.0093,  0.9575,  0.9803,  0.0558,  0.0073,  0.8768,
         0.9911,  0.8334,  0.9999,  0.8483,  0.0336,  0.0092,  0.9944,
         0.4124,  0.0728,  0.8374,  0.9462,  0.4289,  0.0063,  0.2449,
         0.9525,  0.9684,  0.0150,  0.0799,  0.0036,  0.0066,  0.0652,
         0.0173,  0.8183,  0.3843,  0.1013,  0.1480,  0.9785,  0.6823,
         0.0051,  0.9294,  0.9495,  0.0392,  0.8899,  0.2958,  0.0591,
         0.0626,  0.5436,  0.0083,  0.9328,  0.0147,  0.9771,  0.9821,
         0.9111,  0.9991,  0.0106,  0.0569,  0.0633,  0.0259,  0.0471,
         0.0005,  0.1242,  0.2911,  0.9944,  0.9933,  0.9382,  0.0192,
         0.2008,  0.9145,  0.0900,  0.0149,  0.0679,  0.7367,  0.9650,
         0.0146,  0.1536,  0.0035,  0.2646,  0.9831,  0.9927,  0.0104,
         0.7480,  0.0441,  0.1738,  0.0364,  0.0072,  0.1447,  0.4135,
         0.3772,  0.9667,  0.9856,  0.9510,  0.3669,  0.0671,  0.9960,
         0.0394,  0.9420,  0.0784,  0.9582,  0.0411,  0.0121,  0.9899,
         0.5745,  0.0913,  0.3011,  0.9718,  0.0109,  0.9509,  0.5773,
         0.9275,  0.9955,  0.9249,  0.9277,  0.1265,  0.2713,  0.9936,
         0.0898,  0.0179,  0.9749,  0.0101,  0.1577,  0.0023,  0.4553,
         0.2066,  0.9419,  0.7278,  0.1388,  0.1480,  0.9977,  0.9712,
         0.9582,  0.0285,  0.0146,  0.0451,  0.8781,  0.2190,  0.9718,
         0.2105,  0.9966,  0.9646,  0.5902,  0.5155,  0.9759,  0.9305,
         0.8835,  0.0634,  0.2269,  0.9943,  0.9383,  0.8814,  0.0501,
         0.3608,  0.0673,  0.9993,  0.9649,  0.0121,  0.9273,  0.0137,
         0.0843,  0.0171,  0.9997,  0.8836,  0.0411,  0.9032,  0.9691,
         0.3845,  0.6961,  0.0416,  0.1408,  0.0263,  0.1233,  0.9018,
         0.6640,  0.1611,  0.0275,  0.0994,  0.1899,  0.0155,  0.0264,
         0.0133,  0.9968,  0.8700,  0.9689,  0.9534,  0.0668,  0.1530,
         0.5735], device='cuda:0')
tensor(0.2829, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8005,  0.9923,  0.0058,  0.8523,  0.9890,  0.9637,  0.9814,
         0.0010,  0.0380,  0.2109,  0.9946,  0.0268,  0.9786,  0.0384,
         0.9780,  0.1647,  0.9918,  0.9906,  0.8749,  0.0233,  0.9733,
         0.9994,  0.1477,  0.0325,  0.0791,  0.0216,  0.4973,  0.9997,
         0.9892,  0.8565,  0.9706,  0.0067,  0.8985,  0.0017,  0.0071,
         0.9856,  0.0698,  0.5518,  0.3082,  0.9167,  0.9665,  0.0478,
         0.2610,  0.0792,  0.8390,  0.0071,  0.0987,  0.8366,  0.8978,
         0.1725,  0.0051,  0.0207,  0.9567,  0.9661,  0.9395,  0.9904,
         0.0680,  0.0823,  0.7874,  0.0016,  0.9582,  0.9765,  0.0311,
         0.1046,  0.2356,  0.9908,  0.9795,  0.0969,  0.0077,  0.1151,
         0.5148,  0.1548,  0.0282,  0.1382,  0.2158,  0.8985,  0.5184,
         0.4291,  0.9938,  0.0462,  0.1546,  0.0161,  0.2061,  0.5709,
         0.1631,  0.0047,  0.9840,  0.7136,  0.0328,  0.0312,  0.4113,
         0.9999,  0.2237,  0.9653,  0.0355,  0.1679,  0.9061,  0.0047,
         0.9962,  0.9482,  0.0017,  0.9704,  0.0251,  0.0344,  0.9921,
         0.9984,  0.0220,  0.9560,  0.9820,  0.3632,  0.9870,  0.0839,
         0.9986,  0.9744,  0.1091,  0.0024,  0.9868,  0.9677,  0.0377,
         0.0584,  0.2634,  0.9995,  0.7227,  0.3463,  0.9281,  0.0955,
         0.1062,  0.0370,  0.8778,  0.0098,  0.3186,  0.9679,  0.9909,
         0.7314,  0.1122,  0.7225,  0.1819,  0.0495,  0.7209,  0.1378,
         0.0538,  0.0513,  0.9551,  0.8113,  0.9841,  0.7140,  0.1001,
         0.9988,  0.0176,  0.0048,  0.1144,  0.8318,  0.8898,  0.3023,
         0.5934,  0.3775,  0.9894,  0.9976,  0.7056,  0.9900,  0.0671,
         0.9986,  0.1519,  0.9845,  0.9152,  0.0607,  0.8334,  0.9938,
         0.7605,  0.9728,  0.9882,  0.9522,  0.0011,  0.9999,  0.0099,
         0.0244,  0.9409,  0.9674,  0.2124,  0.0228,  0.3067,  0.8657,
         0.9998,  0.8479,  0.0158,  0.9761,  0.8919,  0.9963,  0.9633,
         0.9761,  0.9562,  0.9017,  0.4344,  0.9985,  0.9589,  0.9696,
         0.9900,  0.0278,  0.1011,  0.0482,  0.0336,  0.0375,  0.0024,
         0.0634,  0.6927,  0.4068,  0.0354,  0.9481,  0.9957,  0.9986,
         0.5150,  0.3786,  0.9585,  0.0774,  0.9793,  0.0639,  0.0224,
         0.8270,  0.2748,  0.9869,  0.1520,  0.0544,  0.0244,  0.1564,
         0.8123,  0.9888,  0.9685,  0.0715,  0.0068,  0.1333,  0.9963,
         0.9960,  0.9548,  0.6917,  0.6797,  0.0714,  0.0628,  0.9998,
         0.4017,  0.9811,  0.0030,  0.0064,  0.9864,  0.9476,  0.1235,
         0.0142,  0.9627,  0.0656,  0.9930,  0.0498,  0.0332,  0.9982,
         0.0135,  0.9999,  0.9983,  0.9848,  0.0731,  0.6436,  0.8349,
         0.0841,  0.2625,  0.9754,  0.0190,  0.3225,  0.9878,  0.6646,
         0.0491,  0.1312,  0.9894,  0.9970,  0.8991,  0.9930,  0.8977,
         0.9883,  0.9839,  0.1270,  0.1857,  0.8038,  0.9860,  0.9736,
         0.5493,  0.0071,  0.0586,  0.8858,  0.0697,  0.7011,  0.9599,
         0.0101,  0.7432,  0.0703,  0.9867,  0.0541,  0.9914,  0.2933,
         0.9864,  0.9839,  0.9985,  0.1694,  0.7845,  0.0255,  0.2449,
         0.5840,  0.2272,  0.9617,  0.1188,  0.0237,  0.9748,  0.9204,
         0.3408,  0.9851,  0.0230,  0.3811,  0.1682,  0.1284,  0.7833,
         0.1346,  0.9874,  0.0072,  0.0442,  0.0029,  0.9822,  0.9847,
         0.9685,  0.0369,  0.0137,  0.9450,  0.0815,  0.3468,  0.9945,
         0.2113,  0.1334,  0.9589,  0.8276,  0.9677,  0.9753,  0.9103,
         0.8263,  0.0280,  0.9446,  0.9918,  0.9768,  0.2644,  0.2724,
         0.0011,  0.9796,  0.1438,  0.1194,  0.0567,  0.9462,  0.9840,
         0.9380,  0.3821,  0.5263,  0.0320,  0.8900,  0.0507,  0.8911,
         0.1116,  0.9815,  0.0067,  0.9984,  0.9523,  0.9843,  0.9737,
         0.9881,  0.0589,  0.9178,  0.0157,  0.0047,  0.1278,  0.9844,
         0.9932,  0.9352,  0.1194,  0.9878,  0.9601,  0.9831,  0.0066,
         0.0367,  0.9932,  0.0006,  0.0315,  0.9658,  0.9167,  0.9219,
         0.9971,  0.9607,  0.9882,  0.0534,  0.9908,  0.2236,  0.9608,
         0.0195,  0.0294,  0.1287,  0.9472,  0.5765,  0.0430,  0.9765,
         0.9958,  0.9227,  0.5337,  0.4046,  0.0324,  0.9388,  0.0005,
         0.9464,  0.9989,  0.7731,  0.0015,  0.0036,  0.0673,  0.0103,
         0.9761,  0.9823,  0.0150,  0.0240,  0.9843,  1.0000,  0.2589,
         0.2996,  0.1430,  0.9983,  0.1670,  0.0184,  0.9880,  0.9749,
         0.9881,  0.9822,  0.0341,  0.8940,  0.0245,  0.9907,  0.9391,
         0.9865,  0.9456,  0.0169,  0.9259,  0.0285,  0.9850,  0.9891,
         0.9892,  0.1775,  0.3167,  0.0031,  0.9925,  0.9638,  0.1020,
         0.9774,  0.0201,  0.9973,  0.9942,  0.9998,  0.0135,  0.0333,
         0.0106,  0.9858,  0.0032,  0.0204,  0.0551,  0.1338,  0.3721,
         0.1038,  0.3306,  0.9977,  0.0235,  0.0159,  0.4895,  0.9438,
         0.7662,  0.7556,  0.8011,  0.0088,  0.8486,  0.8360,  0.9825,
         0.9242,  0.9733,  0.9903,  0.0044,  0.9845,  0.0259,  0.9903,
         0.0643,  0.0433,  0.0237,  0.1140,  0.0548,  0.0059,  0.9906,
         0.1364,  0.7800,  0.8829,  0.9263,  0.0010,  0.0132,  0.0112,
         0.0892,  0.0011,  0.1475,  0.0137,  0.0057,  0.9876,  0.9965,
         0.9842,  0.4876,  0.3726,  0.6177,  0.9888,  0.0148,  0.9601,
         0.9069], device='cuda:0')
tensor(0.3584, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9602,  0.4226,  0.9784,  0.0366,  0.9851,  0.0106,  0.6176,
         0.1743,  0.0231,  0.2162,  0.8470,  0.0404,  0.9491,  0.9739,
         0.2932,  0.9474,  0.0309,  0.0693,  0.3936,  0.6094,  0.9864,
         0.9972,  0.9855,  0.0812,  0.8154,  0.9875,  0.9306,  0.9314,
         0.0530,  0.9988,  0.2252,  0.9884,  0.3362,  0.9786,  0.7111,
         0.5395,  0.9818,  0.0145,  0.9628,  0.6640,  0.9998,  0.8734,
         0.9776,  0.8108,  0.0214,  0.4330,  0.3278,  0.0727,  0.6617,
         0.0419,  0.0227,  0.0264,  0.0261,  0.8777,  0.0299,  0.2618,
         0.0228,  0.9991,  0.9114,  0.0605,  0.9924,  0.4581,  0.4149,
         0.9998,  0.9951,  0.9622,  0.9929,  0.4231,  0.9006,  0.9763,
         0.1418,  0.9995,  0.0506,  0.9506,  0.8554,  0.9396,  0.1307,
         0.1107,  0.9868,  0.2998,  0.9623,  0.0098,  0.0050,  0.5447,
         0.0005,  0.9799,  0.1236,  0.8848,  0.9877,  0.0960,  0.2918,
         0.7272,  0.9687,  0.9877,  0.2869,  0.9947,  0.9858,  0.9882,
         0.9281,  0.9523,  0.4172,  0.9929,  0.0015,  0.9999,  0.0344,
         0.9883,  0.9782,  0.0203,  0.0041,  0.9641,  0.5951,  0.9920,
         0.0213,  0.0036,  0.9999,  0.9762,  0.6524,  0.9309,  0.0406,
         0.4739,  0.0487,  0.0452,  0.9991,  0.9760,  0.9816,  0.9947,
         0.0213,  0.9857,  0.9302,  0.9667,  0.1187,  0.0200,  0.2919,
         0.0362,  0.0148,  0.0112,  0.0234,  0.2474,  0.1810,  0.0531,
         0.1765,  0.0208,  0.7887,  0.9992,  0.1311,  0.9640,  0.9320,
         0.9178,  0.3021,  0.7596,  0.2552,  0.9942,  0.3249,  0.0509,
         0.1911,  0.2109,  0.9494,  0.0032,  0.9922,  0.9881,  0.8572,
         0.8061,  0.0234,  0.0613,  0.9349,  0.0070,  0.7376,  0.0073,
         0.0813,  0.5259,  0.3016,  0.9849,  0.0614,  0.0069,  0.0399,
         0.9876,  0.1841,  0.0035,  0.9117,  0.0331,  0.0527,  0.0245,
         0.1583,  0.0048,  0.9967,  0.9920,  0.9959,  0.9814,  0.1700,
         0.9865,  0.9928,  0.9542,  0.0491,  0.9664,  0.4132,  0.0342,
         0.9989,  0.0129,  0.9675,  0.9508,  0.9692,  0.7120,  0.9916,
         0.9898,  0.6925,  0.9980,  0.1014,  0.1571,  0.0167,  0.9274,
         0.0104,  0.1148,  0.9657,  0.6583,  0.0172,  0.0116,  0.2692,
         0.3540,  0.8125,  0.0429,  0.0778,  0.1461,  0.9841,  0.1088,
         0.0021,  0.9962,  0.3877,  0.0718,  0.0557,  0.0435,  0.0553,
         0.1151,  0.3779,  0.0104,  0.9652,  0.6405,  0.9286,  0.9647,
         0.9545,  0.7314,  0.9059,  0.4567,  0.9743,  0.9896,  0.9889,
         0.8690,  0.0118,  0.9683,  0.9498,  0.1144,  0.9961,  0.8599,
         0.9699,  0.8138,  0.9989,  0.9757,  0.0085,  0.1343,  0.9568,
         0.9825,  0.0993,  0.4908,  0.9972,  0.9879,  0.1169,  0.0844,
         0.9876,  0.2582,  0.0199,  0.4973,  0.0251,  0.2463,  0.5408,
         0.9841,  0.1963,  0.9574,  0.0370,  0.9066,  0.9855,  0.2161,
         0.0323,  0.9945,  0.9548,  0.0090,  0.9214,  0.0787,  0.0037,
         0.0038,  0.7439,  0.0657,  0.9981,  0.9695,  0.2697,  0.1648,
         0.9824,  0.0188,  0.9502,  0.8158,  0.9893,  0.0364,  0.9324,
         0.0158,  0.7123,  0.1209,  0.9839,  0.7833,  0.7599,  0.8443,
         0.9203,  0.7979,  0.7148,  0.0219,  0.9999,  0.1320,  0.0997,
         0.9871,  0.9196,  0.9999,  0.9205,  0.0007,  0.0162,  0.0384,
         0.9721,  0.0335,  0.9484,  0.5435,  0.0490,  0.9821,  0.0101,
         0.9607,  0.9747,  0.1239,  0.2577,  0.9952,  0.9858,  0.9638,
         0.0758,  0.0075,  0.0993,  0.0008,  0.9766,  0.4765,  0.9781,
         0.1111,  0.7847,  0.1513,  0.9475,  0.8106,  0.9965,  0.0301,
         0.9965,  0.9296,  0.9935,  0.9828,  0.9277,  0.9823,  0.9580,
         0.9599,  0.0154,  0.0837,  0.9936,  0.0315,  0.1252,  0.0226,
         0.0124,  0.1360,  0.9777,  0.9819,  0.8309,  0.9961,  0.9848,
         0.9903,  0.0010,  0.9853,  0.9912,  0.9599,  0.6130,  0.0889,
         0.1658,  0.9765,  0.9196,  0.9685,  0.9952,  0.0869,  0.9936,
         0.9934,  0.0705,  0.7931,  0.1354,  0.9554,  0.9963,  0.0589,
         0.7918,  0.9894,  0.0499,  0.0549,  0.0766,  0.1887,  0.0689,
         0.9534,  0.3024,  0.8459,  0.0037,  0.6378,  0.9928,  0.0364,
         0.0344,  0.0037,  0.9964,  0.1912,  0.0894,  0.1447,  0.9625,
         0.9925,  0.2349,  0.0003,  0.9777,  0.9840,  0.0539,  0.9872,
         0.9953,  0.9927,  0.0278,  0.9337,  0.9561,  0.9906,  0.7580,
         0.0371,  0.9301,  0.9364,  0.9706,  0.1548,  0.9309,  0.5568,
         0.6565,  0.0318,  0.6756,  0.9927,  0.6489,  0.7629,  0.9791,
         0.0350,  0.9994,  0.9612,  0.8474,  0.9938,  0.0571,  0.1366,
         0.2605,  0.9227,  0.9993,  0.0251,  0.9982,  0.0530,  0.9989,
         0.0530,  0.9924,  0.0132,  0.9635,  0.9144,  0.3112,  0.9892,
         0.0339,  0.0854,  0.9840,  0.8246,  0.3199,  0.9993,  0.6153,
         0.0902,  0.8760,  0.2018,  0.2414,  0.7265,  0.9999,  0.9757,
         0.0428,  0.9019,  0.9718,  0.9480,  0.8699,  0.3117,  0.9898,
         0.9887,  0.9347,  0.9472,  0.9665,  0.0018,  0.0123,  0.0668,
         0.0004,  0.0078,  0.8788,  0.3239,  0.9832,  0.9283,  0.4693,
         0.0277,  0.1443,  0.1515,  0.4734,  0.8637,  0.9741,  0.8201,
         0.0191,  0.9882,  0.2019,  0.0856,  0.2707,  0.1135,  0.0628,
         0.0262], device='cuda:0')
tensor(0.2892, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8806,  0.3487,  0.9688,  0.9474,  0.9808,  0.9844,  0.9698,
         0.7896,  0.0597,  0.0665,  0.2827,  0.0561,  0.9805,  0.9865,
         0.9951,  0.0560,  0.9697,  0.0013,  0.1293,  0.9788,  0.9322,
         0.2443,  0.1999,  0.9503,  0.1184,  0.5934,  0.0805,  0.9758,
         0.9797,  0.8156,  0.1822,  0.9964,  0.1565,  0.8977,  0.0033,
         0.0569,  0.1454,  0.7629,  0.0805,  0.9993,  0.9273,  0.0433,
         0.9999,  0.0015,  0.9705,  0.9240,  0.9350,  0.0339,  0.3126,
         0.1787,  0.4577,  0.0323,  0.0076,  0.9274,  0.0040,  0.3424,
         0.6839,  0.9719,  0.0097,  0.0563,  0.0196,  0.2007,  0.9801,
         0.0294,  0.0250,  0.5757,  0.7963,  0.0011,  0.8948,  0.0402,
         0.9699,  0.7459,  0.0261,  0.9995,  0.9914,  0.1049,  0.9913,
         0.0866,  0.9712,  0.0433,  0.9476,  0.9923,  0.9760,  0.0055,
         0.9995,  0.9408,  0.0446,  0.0014,  0.3972,  0.5518,  0.9810,
         0.9365,  0.9556,  0.1331,  0.9910,  0.8775,  0.4729,  0.5799,
         0.0034,  0.9720,  0.3220,  0.9996,  0.0890,  0.9914,  0.9661,
         0.0151,  0.9799,  0.9926,  0.9854,  0.0488,  0.0336,  0.8904,
         0.8378,  0.0197,  0.7972,  0.0079,  0.7167,  0.9541,  0.9954,
         0.9657,  0.9725,  0.7689,  0.9719,  0.9914,  0.8035,  0.9985,
         0.9475,  0.8995,  0.0235,  0.0900,  0.6019,  0.2641,  0.9972,
         0.9541,  0.1464,  0.9587,  0.0112,  0.9869,  0.9519,  0.7645,
         0.9965,  0.1225,  0.1134,  0.0732,  0.9560,  0.9849,  0.1735,
         0.0844,  0.0191,  0.4015,  0.0792,  0.1053,  0.9312,  0.9261,
         0.0400,  0.0253,  0.0531,  0.9813,  0.2431,  0.0497,  0.0176,
         0.9666,  0.8713,  0.5091,  0.2020,  0.4642,  0.0987,  0.9980,
         0.9788,  0.1983,  0.0053,  0.0652,  0.0862,  0.1589,  0.0041,
         0.8505,  0.8217,  0.9851,  0.5289,  0.7721,  0.9794,  0.2476,
         0.9317,  0.9939,  0.1231,  0.2342,  0.2748,  0.9853,  0.0205,
         0.9268,  0.9885,  0.9860,  0.9925,  0.9868,  0.9855,  0.0184,
         0.0050,  0.7080,  0.8705,  0.9724,  0.0468,  0.0256,  0.8513,
         0.9978,  0.3568,  0.1111,  0.9628,  0.9931,  0.8560,  0.4336,
         0.9700,  0.8931,  0.9466,  0.0323,  0.7805,  0.7932,  0.9336,
         0.9782,  0.2858,  0.9971,  0.0659,  0.0077,  0.0297,  0.0268,
         0.9571,  0.0054,  0.1222,  0.9690,  0.0233,  0.9949,  0.1072,
         0.7472,  0.5253,  0.6842,  0.7428,  0.9736,  0.2715,  0.0017,
         0.0570,  0.2066,  0.8636,  0.8536,  0.8538,  0.9723,  0.0285,
         0.1224,  0.0279,  0.9408,  0.8361,  0.9899,  0.9923,  0.1383,
         0.9283,  0.9927,  0.9846,  0.9741,  0.9712,  0.1510,  0.9986,
         0.0137,  0.9056,  0.0048,  0.9968,  0.0730,  0.9635,  0.9808,
         0.9813,  0.7130,  0.9840,  0.1077,  0.0123,  0.0340,  0.5005,
         0.9470,  0.2101,  0.9881,  0.9940,  0.9952,  0.2659,  0.0856,
         0.2897,  0.9261,  0.9231,  0.9406,  0.1779,  0.9302,  0.9763,
         0.0129,  0.8941,  0.9949,  0.3763,  0.9990,  0.0094,  0.0045,
         0.0042,  0.1343,  0.1526,  0.0513,  0.9821,  0.0478,  0.9284,
         0.7028,  0.0646,  0.0456,  0.9693,  0.9929,  0.0201,  0.9439,
         0.9888,  0.9724,  0.0245,  0.9793,  0.7555,  0.9818,  0.9984,
         0.1552,  0.1900,  0.0433,  0.9941,  0.8147,  0.0786,  0.9357,
         0.9580,  0.9417,  0.0053,  0.9968,  0.8801,  0.0372,  0.9189,
         0.2204,  0.0834,  0.9097,  0.8542,  0.8298,  0.0577,  0.0149,
         0.1643,  0.2309,  0.0231,  0.0521,  0.1028,  0.0680,  0.0562,
         0.9203,  0.0141,  0.1529,  0.3406,  0.0326,  0.9895,  0.7892,
         0.0142,  0.0100,  0.8956,  0.1572,  0.0475,  0.0297,  0.9790,
         0.0393,  0.7574,  0.8605,  0.9903,  0.9205,  0.1553,  0.1430,
         0.0621,  0.9645,  0.9690,  0.6851,  0.5441,  0.2461,  0.0086,
         0.7494,  0.9894,  0.1644,  0.8647,  0.9833,  0.3710,  0.8011,
         0.9531,  0.1604,  0.9562,  0.0256,  0.0117,  0.0325,  0.9933,
         0.9840,  0.9962,  0.8172,  0.9648,  0.1205,  0.9868,  0.8409,
         0.1520,  0.9158,  0.3293,  0.0139,  0.2232,  0.4247,  0.9473,
         0.8979,  0.0813,  0.8915,  0.9957,  0.8880,  0.0106,  0.8105,
         0.9807,  0.0320,  0.0727,  0.9770,  0.9455,  0.0179,  0.2716,
         0.9757,  0.9359,  0.9078,  0.9989,  0.9122,  0.9697,  0.9738,
         0.0469,  0.9680,  0.9891,  0.9271,  0.9478,  0.9222,  0.0337,
         0.0474,  0.8922,  0.8220,  0.9584,  0.0442,  0.8449,  0.8594,
         0.9951,  0.9058,  0.9842,  0.8922,  0.9948,  0.0985,  0.7824,
         0.0139,  0.9440,  0.6205,  0.8198,  0.8489,  0.0140,  0.4938,
         0.0398,  0.0716,  0.0160,  0.1124,  0.0015,  0.9725,  0.0239,
         0.9435,  0.0028,  0.9734,  0.9235,  0.0676,  0.0219,  0.2209,
         0.6360,  0.9931,  0.9872,  0.0068,  0.9012,  0.0638,  0.6917,
         0.9005,  0.4172,  0.5417,  0.0587,  0.9998,  0.0703,  0.9178,
         0.9746,  0.9999,  0.9381,  0.9693,  0.9885,  0.0650,  0.4979,
         0.9720,  0.0232,  0.9903,  0.8676,  0.2464,  0.9978,  0.8110,
         0.1145,  0.1738,  0.0590,  0.0989,  0.9768,  0.0053,  0.4786,
         0.9260,  0.9762,  0.9828,  0.9827,  0.4627,  0.0536,  0.0034,
         0.9853,  0.1060,  0.0732,  0.9813,  0.0111,  0.9525,  0.9774,
         0.9677], device='cuda:0')
tensor(0.2355, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.4803,  0.8137,  0.0254,  0.9925,  0.8737,  0.6838,  0.9573,
         0.5857,  0.9931,  0.0254,  0.0409,  0.7974,  0.7745,  0.1248,
         0.8685,  0.0449,  0.9866,  0.9837,  0.0461,  0.9859,  0.0097,
         0.0031,  0.0298,  0.0089,  0.3289,  0.9277,  0.8025,  0.3077,
         0.7717,  0.9520,  0.9289,  0.2260,  0.0022,  0.3183,  0.9528,
         0.2625,  0.1646,  0.3659,  0.9096,  0.1980,  0.5327,  0.3223,
         0.0316,  0.2001,  0.9750,  0.1151,  0.9121,  0.8998,  0.2092,
         0.6732,  0.9158,  0.8948,  0.9857,  0.0605,  0.2284,  0.1630,
         0.1177,  0.0795,  0.7282,  0.8956,  0.9601,  0.9389,  0.1276,
         0.7611,  0.9196,  0.9404,  0.8829,  0.9352,  0.4185,  0.4678,
         0.9364,  0.9645,  0.2647,  0.0504,  0.2809,  0.8659,  0.9856,
         0.3695,  0.9585,  0.9596,  0.0089,  0.9861,  0.1573,  0.0248,
         0.8652,  0.0495,  0.0564,  0.1204,  0.0578,  0.9490,  0.1654,
         0.0083,  0.0475,  0.9920,  0.8876,  0.0418,  0.3384,  0.1175,
         0.0438,  0.1966,  0.0393,  0.5927,  0.9277,  0.6299,  0.9103,
         0.2781,  0.0030,  0.9248,  0.0467,  0.0146,  0.9660,  0.8895,
         0.8381,  0.4129,  0.8788,  0.0737,  0.9207,  0.0015,  0.0628,
         0.1526,  0.8153,  0.8674,  0.1838,  0.9672,  0.9454,  0.0264,
         0.0985,  0.9545,  0.0092,  0.0430,  0.3028,  0.1324,  0.0180,
         0.5700,  0.9495,  0.0334,  0.9168,  0.1644,  0.1438,  0.2198,
         0.3723,  0.1975,  0.4335,  0.0670,  0.0144,  0.0140,  0.8290,
         0.8046,  0.0458,  0.0050,  0.1017,  0.9451,  0.9039,  0.0029,
         0.0017,  0.9676,  0.0680,  0.1051,  0.0607,  0.9892,  0.7663,
         0.8748,  0.0551,  0.9733,  0.8646,  0.4498,  0.0221,  0.9797,
         0.7261,  0.9456,  0.9633,  0.0056,  0.7563,  0.7314,  0.8903,
         0.9504,  0.9549,  0.8713,  0.0002,  0.0553,  0.2710,  0.1890,
         0.1479,  0.6594,  0.8040,  0.7853,  0.9934,  0.9678,  0.0575,
         0.9575,  0.3340,  0.0784,  0.1227,  0.7773,  0.9524,  0.7817,
         0.1410,  0.8324,  0.7857,  0.0183,  0.0086,  0.9147,  0.1578,
         0.1956,  0.9781,  0.7458,  0.9213,  0.9580,  0.0651,  0.0918,
         0.0711,  0.9984,  0.0129,  0.0752,  0.4302,  0.9163,  0.1068,
         0.8129,  0.0459,  0.2320,  0.9572,  0.0187,  0.1342,  0.7072,
         0.6527,  0.0162,  0.4648,  0.0540,  0.7522,  0.0809,  0.1579,
         0.1306,  0.1929,  0.3503,  0.0818,  0.1008,  0.0049,  0.3496,
         0.6948,  0.0336,  0.9278,  0.1618,  0.4568,  0.1741,  0.3465,
         0.2533,  0.1911,  0.1370,  0.7199,  0.8619,  0.2414,  0.1570,
         0.1668,  0.0902,  0.0957,  0.9684,  0.9487,  0.9313,  0.0236,
         0.4709,  0.0564,  0.8327,  0.8528,  0.5170,  0.2237,  0.1052,
         0.8591,  0.3780,  0.0622,  0.0394,  0.1649,  0.0568,  0.0642,
         0.5552,  0.0718,  0.3640,  0.9000,  0.0480,  0.9911,  0.0225,
         0.5952,  0.9451,  0.7588,  0.9003,  0.5609,  0.0144,  0.8162,
         0.0769,  0.0723,  0.9627,  0.5412,  0.5663,  0.4943,  0.0003,
         0.0087,  0.8186,  0.9763,  0.2281,  0.0084,  0.9250,  0.9436,
         0.4728,  0.0320,  0.3985,  0.0428,  0.2924,  0.0301,  0.9422,
         0.2109,  0.8636,  0.9403,  0.0172,  0.0900,  0.9341,  0.0170,
         0.1789,  0.9592,  0.1082,  0.0049,  0.6519,  0.9974,  0.2348,
         0.9574,  0.5530,  0.0676,  0.0025,  0.2552,  0.0207,  0.0232,
         0.1978,  0.8660,  0.9655,  0.3929,  0.8785,  0.1203,  0.0942,
         0.0645,  0.0571,  0.8213,  0.6318,  0.9978,  0.2417,  0.9597,
         0.0053,  0.1948,  0.5315,  0.0778,  0.9731,  0.0670,  0.4743,
         0.0300,  0.3626,  0.9684,  0.9557,  0.8899,  0.0899,  0.8341,
         0.7932,  0.0621,  0.1213,  0.1948,  0.7642,  0.9086,  0.4995,
         0.9985,  0.9992,  0.0029,  0.7130,  0.0203,  0.0290,  0.9954,
         0.8698,  0.6575,  0.7461,  0.5336,  0.9306,  0.1990,  0.3841,
         0.1157,  0.0163,  0.7065,  0.0869,  0.9836,  0.1141,  0.0151,
         0.8614,  0.7405,  0.0783,  0.4760,  0.5570,  0.4968,  0.0672,
         0.9573,  0.1559,  0.0447,  0.0075,  0.7033,  0.8678,  0.8285,
         0.9407,  0.9360,  0.0228,  0.0242,  0.0006,  0.9754,  0.0805,
         0.3277,  0.0082,  0.1153,  0.0212,  0.0119,  0.9836,  0.0957,
         0.7649,  0.0042,  0.9949,  0.1384,  0.2395,  0.6460,  0.6863,
         0.5966,  0.0210,  0.0552,  0.9376,  0.1568,  0.9173,  0.9492,
         0.0255,  0.9927,  0.9074,  0.7751,  0.7953,  0.0047,  0.3314,
         0.9536,  0.8825,  0.9314,  0.6579,  0.1572,  0.6445,  0.5377,
         0.9647,  0.0666,  0.9692,  0.9296,  0.0718,  0.3530,  0.4074,
         0.0915,  0.9870,  0.0121,  0.3601,  0.0195,  0.0071,  0.0288,
         0.6158,  0.8045,  0.0004,  0.8616,  0.9668,  0.0245,  0.2245,
         0.9932,  0.0980,  0.9530,  0.1106,  0.9035,  0.9370,  0.0442,
         0.9927,  0.1573,  0.5364,  0.2863,  0.9257,  0.0095,  0.0469,
         0.8102,  0.7161,  0.1100,  0.9847,  0.0107,  0.0899,  0.2041,
         0.9669,  0.1920,  0.9991,  0.9742,  0.7339,  0.3782,  0.9326,
         0.0342,  0.9972,  0.1186,  0.0278,  0.0299,  0.9660,  0.1235,
         0.6524,  0.7688,  0.5736,  0.6347,  0.0418,  0.2919,  0.1315,
         0.9359,  0.5938,  0.0046,  0.4528,  0.3527,  0.9188,  0.0484,
         0.8484], device='cuda:0')
tensor(0.2540, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7828,  0.0953,  0.1491,  0.0790,  0.0066,  0.8794,  0.0753,
         0.0508,  0.0044,  0.9323,  0.0887,  0.9611,  0.9757,  0.9407,
         0.2454,  0.1152,  0.2839,  0.1939,  0.9449,  0.0878,  0.9495,
         0.2808,  0.0536,  0.0115,  0.7342,  0.3932,  0.9440,  0.9690,
         0.9326,  0.3722,  0.1447,  0.8639,  0.9645,  0.4021,  0.0327,
         0.9355,  0.2385,  0.1636,  0.5466,  0.1147,  0.9565,  0.0061,
         0.0148,  0.9852,  0.7826,  0.0057,  0.3648,  0.1758,  0.0795,
         0.8878,  0.9695,  0.8736,  0.1786,  0.3516,  0.7814,  0.8656,
         0.0344,  0.9183,  0.9790,  0.9642,  0.0165,  0.0681,  0.7166,
         0.0240,  0.3786,  0.0363,  0.8086,  0.4831,  0.9151,  0.5204,
         0.8858,  0.8707,  0.9578,  0.4500,  0.6789,  0.1171,  0.7357,
         0.0442,  0.0102,  0.9038,  0.5083,  0.0012,  0.9944,  0.9334,
         0.0034,  0.8411,  0.0453,  0.5264,  0.2740,  0.1470,  0.1075,
         0.6182,  0.2543,  0.9765,  0.9547,  0.0386,  0.5876,  0.9231,
         0.9880,  0.9999,  0.0789,  0.0083,  0.2910,  0.1825,  0.0133,
         0.8810,  0.8402,  0.5974,  0.9702,  0.9039,  0.0242,  0.1000,
         0.8756,  0.3254,  0.8713,  0.7153,  0.9733,  0.7564,  0.5197,
         0.1874,  0.1228,  0.0377,  0.9992,  0.7654,  0.5409,  0.9169,
         0.8618,  0.4363,  0.9172,  0.5111,  0.0028,  0.2706,  0.0368,
         0.2411,  0.9682,  0.0523,  0.6571,  0.9075,  0.6357,  0.0224,
         0.2511,  0.6799,  0.9458,  0.5314,  0.2499,  0.1019,  0.8837,
         0.0165,  0.9785,  0.0943,  0.0289,  0.8676,  0.9210,  0.0525,
         0.5709,  0.0324,  0.8809,  0.6566,  0.1099,  0.2827,  0.8146,
         0.1508,  0.0575,  0.9546,  0.7464,  0.7401,  0.5452,  0.8343,
         0.1302,  0.0851,  0.8812,  0.0233,  0.6073,  0.8275,  0.1466,
         0.1238,  0.0416,  0.8211,  0.1641,  0.1100,  0.1533,  0.0282,
         0.8007,  0.0142,  0.9130,  0.9778,  0.0230,  0.0344,  0.1675,
         0.2478,  0.0027,  0.8006,  0.2243,  0.0890,  0.6950,  0.7698,
         0.3184,  0.7931,  0.4094,  0.0015,  0.6028,  0.9356,  0.9641,
         0.9687,  0.3060,  0.8876,  0.0339,  0.0037,  0.8583,  0.3523,
         0.0053,  0.1404,  0.8733,  0.1339,  0.2528,  0.0076,  0.9629,
         0.4676,  0.9285,  0.0106,  0.6991,  0.0468,  0.6961,  0.8661,
         0.9723,  0.0224,  0.0527,  0.0751,  0.0033,  0.1335,  0.8734,
         0.9364,  0.9403,  0.2512,  0.0177,  0.0430,  0.3547,  0.0492,
         0.0049,  0.0808,  0.1068,  0.1980,  0.6957,  0.0297,  0.2002,
         0.8980,  0.5839,  0.8559,  0.9266,  0.0771,  0.1387,  0.9772,
         0.0423,  0.9535,  0.0371,  0.0734,  0.0271,  0.8855,  0.7580,
         0.1272,  0.6488,  0.9299,  0.1143,  0.1199,  0.0501,  0.3012,
         0.9234,  0.1816,  0.2686,  0.0124,  0.9687,  0.8220,  0.0748,
         0.6979,  0.3059,  0.3939,  0.4311,  0.0264,  0.7945,  0.0179,
         0.0085,  0.9767,  0.8869,  0.1083,  0.0107,  0.0011,  0.1487,
         0.9127,  0.8858,  0.0038,  0.7601,  0.7763,  0.9095,  0.9077,
         0.9460,  0.0036,  0.4454,  0.6273,  0.8734,  0.0412,  0.0304,
         0.2616,  0.0383,  0.7524,  0.8971,  0.0369,  0.6280,  0.6886,
         0.0299,  0.1151,  0.3383,  0.9639,  0.1221,  0.7099,  0.6077,
         0.8894,  0.9119,  0.9669,  0.9885,  0.2039,  0.8899,  0.0061,
         0.5840,  0.1077,  0.2247,  0.9344,  0.1577,  0.9092,  0.6025,
         0.0504,  0.1910,  0.9677,  0.0022,  0.0186,  0.0404,  0.0237,
         0.8108,  0.0177,  0.0256,  0.0728,  0.9106,  0.5900,  0.8198,
         0.9627,  0.4711,  0.1130,  0.3547,  0.9373,  0.1986,  0.7326,
         0.2818,  0.0857,  0.0090,  0.4985,  0.9529,  0.7717,  0.0741,
         0.5853,  0.9064,  0.8191,  0.9694,  0.1451,  0.7576,  0.0462,
         0.0108,  0.7212,  0.0680,  0.2954,  0.4185,  0.8404,  0.9964,
         0.0134,  0.1126,  0.0396,  0.1841,  0.7711,  0.8152,  0.8590,
         0.9982,  0.2370,  0.6438,  0.8616,  0.7948,  0.0203,  0.0977,
         0.0965,  0.7133,  0.1089,  0.1909,  0.0497,  0.2032,  0.8004,
         0.3379,  0.4602,  0.0697,  0.1336,  0.1537,  0.0210,  0.0172,
         0.5950,  0.9095,  0.8953,  0.9540,  0.0335,  0.9243,  0.8570,
         0.0357,  0.8943,  0.9776,  0.1040,  0.9591,  0.0241,  0.0473,
         0.1229,  0.8703,  0.6542,  0.0991,  0.9974,  0.8745,  0.2781,
         0.3847,  0.7548,  0.0074,  0.1989,  0.0972,  0.0694,  0.9360,
         0.1057,  0.0699,  0.0175,  0.1797,  0.0417,  0.0046,  0.9447,
         0.8789,  0.5151,  0.9527,  0.0068,  0.0166,  0.9124,  0.0010,
         0.3694,  0.0212,  0.5018,  0.4364,  0.9020,  0.6612,  0.9343,
         0.9775,  0.0254,  0.9764,  0.3464,  0.2954,  0.3411,  0.9211,
         0.9539,  0.0058,  0.1445,  0.7283,  0.3226,  0.7960,  0.8898,
         0.0818,  0.8812,  0.2201,  0.6912,  0.0544,  0.2583,  0.2090,
         0.8954,  0.5868,  0.1262,  0.9332,  0.3355,  0.9421,  0.7527,
         0.1959,  0.7678,  0.7964,  0.0279,  0.0016,  0.9775,  0.0012,
         0.1015,  0.8053,  0.9863,  0.9642,  0.0869,  0.2200,  0.4414,
         0.7568,  0.0103,  0.9900,  0.3554,  0.6865,  0.1422,  0.1259,
         0.5654,  0.5161,  0.8987,  0.9004,  0.0134,  0.0144,  0.6257,
         0.0007,  0.6031,  0.2248,  0.9986,  0.0312,  0.2159,  0.0366,
         0.5466], device='cuda:0')
tensor(0.2770, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8121,  0.8828,  0.3107,  0.2173,  0.2184,  0.9724,  0.2334,
         0.9997,  0.7303,  0.1193,  0.6406,  0.5697,  0.0030,  0.0205,
         0.7987,  0.1347,  0.0620,  0.0052,  0.3598,  0.3683,  0.0602,
         0.0119,  0.1000,  0.8531,  0.0143,  0.1338,  0.9997,  0.5463,
         0.0259,  0.0769,  0.0154,  0.0192,  0.0015,  0.9643,  0.0301,
         0.2666,  0.7377,  0.1941,  0.6888,  0.0244,  0.1030,  0.0293,
         0.1755,  0.0957,  0.9577,  0.0991,  0.9115,  0.4243,  0.2935,
         0.8073,  0.7368,  0.9862,  0.8602,  0.7902,  0.1615,  0.4489,
         0.2353,  0.8626,  0.0374,  0.9297,  0.0312,  0.1122,  0.0431,
         0.3876,  0.6494,  0.6509,  0.8797,  0.3335,  0.7393,  0.9344,
         0.9766,  0.8291,  0.1728,  0.0113,  0.3609,  0.5919,  0.6735,
         0.1315,  0.9938,  0.9924,  0.8017,  0.0033,  0.1060,  0.3854,
         0.0020,  0.0301,  0.0974,  0.7845,  0.8700,  0.0057,  0.8891,
         0.0358,  0.4872,  0.0100,  0.3843,  0.8595,  0.0122,  0.0545,
         0.2848,  0.3709,  0.3840,  0.0267,  0.3966,  0.5720,  0.1865,
         0.5792,  0.0402,  0.8048,  0.0168,  0.4006,  0.6232,  0.6192,
         0.8310,  0.4467,  0.9977,  0.1947,  0.3892,  0.0646,  0.0184,
         0.1066,  0.0558,  0.5155,  0.9006,  0.9494,  0.9947,  0.9933,
         0.0725,  0.2370,  0.0006,  0.6295,  0.0028,  0.5457,  0.9890,
         0.2702,  0.0290,  0.7579,  0.0019,  0.0891,  0.9541,  0.1565,
         0.8801,  0.0408,  0.1948,  0.0004,  0.9850,  0.0027,  0.9171,
         0.8879,  0.0121,  0.6516,  0.8167,  0.9814,  0.8737,  0.9511,
         0.0115,  0.0098,  0.9015,  0.8250,  0.9627,  0.9994,  0.1347,
         0.8478,  0.2603,  0.0268,  0.1744,  0.0804,  0.0485,  0.8852,
         0.0003,  0.0524,  0.9468,  0.6630,  0.9186,  0.8139,  0.0736,
         0.0022,  0.9263,  0.0175,  0.9454,  0.9540,  0.4835,  0.0908,
         0.9839,  0.2799,  0.4520,  0.5661,  0.9346,  0.1829,  0.0846,
         0.6059,  0.0795,  0.0294,  0.1695,  0.0120,  0.3196,  0.1337,
         0.0057,  0.0178,  0.7059,  0.4976,  0.0151,  0.0594,  0.0246,
         0.0014,  0.0122,  0.5327,  0.9441,  0.7335,  0.0698,  0.9989,
         0.9759,  0.9700,  0.0366,  0.0450,  0.0089,  0.2791,  0.9192,
         0.1939,  0.9410,  0.9603,  0.8607,  0.8533,  0.0308,  0.8906,
         0.5580,  0.8033,  0.9564,  0.7600,  0.0590,  0.8070,  0.1421,
         0.5185,  0.0424,  0.1822,  0.4172,  0.7075,  0.0156,  0.0763,
         0.1144,  0.1217,  0.8165,  0.1106,  0.0182,  0.2987,  0.2761,
         0.1159,  0.7998,  0.0096,  0.0357,  0.0163,  0.0016,  0.9177,
         0.0312,  0.0155,  0.7612,  0.1174,  0.3274,  0.6944,  0.6939,
         0.9083,  0.7772,  0.9350,  0.1862,  0.0221,  0.0057,  0.9191,
         0.0018,  0.1508,  0.0159,  0.3354,  0.1036,  0.0173,  0.0159,
         0.9021,  0.1415,  0.0057,  0.9586,  0.8065,  0.0284,  0.8492,
         0.7850,  0.9960,  0.4063,  0.0166,  0.0244,  0.8705,  0.8303,
         0.0604,  0.7497,  0.7779,  0.7040,  0.9506,  0.8104,  0.9814,
         0.8427,  0.0158,  0.2398,  0.6274,  0.0214,  0.1241,  0.8803,
         0.9612,  0.0556,  0.9567,  0.9099,  0.3373,  0.3092,  0.0881,
         0.9273,  0.0148,  0.9869,  0.4283,  0.0012,  0.0396,  0.6947,
         0.2440,  0.5317,  0.0002,  0.0016,  0.6384,  0.2319,  0.3551,
         0.1073,  0.9867,  0.0114,  0.8869,  0.9825,  0.8770,  0.1470,
         0.9215,  0.1464,  0.0511,  0.9202,  0.0369,  0.3714,  0.0052,
         0.5043,  0.6750,  0.0149,  0.4122,  0.2220,  0.7586,  0.0665,
         0.1778,  0.0446,  0.0151,  0.3569,  0.3935,  0.8843,  0.0400,
         0.9875,  0.9992,  0.6093,  0.0005,  0.0100,  0.6164,  0.0006,
         0.3670,  0.7896,  0.9192,  0.9695,  0.0067,  0.8777,  0.7631,
         0.7370,  0.8002,  0.9718,  0.2693,  0.1717,  0.6920,  0.9980,
         0.4611,  0.0056,  0.5213,  0.0060,  0.2975,  0.9655,  0.0250,
         0.1359,  0.8924,  0.8776,  0.4778,  0.9391,  0.0378,  0.9829,
         0.9226,  0.0251,  0.0784,  0.3100,  0.4276,  0.0005,  0.9626,
         0.7556,  0.0080,  0.0015,  0.0302,  0.5290,  0.3525,  0.0168,
         0.8790,  0.5131,  0.9985,  0.9483,  0.1477,  0.4478,  0.0371,
         0.0239,  0.9807,  0.0162,  0.0542,  0.1199,  0.9601,  0.5588,
         0.3073,  0.8864,  0.6257,  0.7424,  0.1617,  0.8427,  0.0875,
         0.7024,  0.0016,  0.3817,  0.3493,  0.3386,  0.8965,  0.5379,
         0.6153,  0.0232,  0.0765,  0.0062,  0.6690,  0.8483,  0.0020,
         0.5149,  0.0349,  0.0042,  0.1486,  0.7503,  0.0005,  0.5809,
         0.9151,  0.9645,  0.9702,  0.0056,  0.9773,  0.0373,  0.9819,
         0.0061,  0.9368,  0.0539,  0.3568,  0.0309,  0.6468,  0.9476,
         0.0196,  0.0220,  0.0325,  0.0007,  0.7821,  0.8795,  0.2701,
         0.1036,  0.4892,  0.9981,  0.0359,  0.2717,  0.0619,  0.0554,
         0.2005,  0.2124,  0.8724,  0.0561,  0.9048,  0.7288,  0.3668,
         0.9352,  0.5377,  0.5682,  0.9869,  0.7507,  0.9702,  0.1266,
         0.9398,  0.0051,  0.0050,  0.8958,  0.6171,  0.7087,  0.0084,
         0.0536,  0.0185,  0.9360,  0.2776,  0.9481,  0.9552,  0.6202,
         0.2142,  0.9160,  0.7542,  0.4538,  0.9261,  0.6905,  0.0061,
         0.7418,  0.0021,  0.8491,  0.9373,  0.0086,  0.0220,  0.8888,
         0.1152], device='cuda:0')
tensor(0.3093, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0259,  0.1741,  0.0062,  0.0640,  0.0357,  0.2208,  0.5290,
         0.4927,  0.9810,  0.5589,  0.0064,  0.0073,  0.0135,  0.0063,
         0.0114,  0.8659,  0.9742,  0.3704,  0.0147,  0.0132,  0.1198,
         0.9281,  0.0771,  0.2826,  0.9306,  0.0150,  0.6748,  0.0168,
         0.2133,  0.5335,  0.7639,  0.9857,  0.9816,  0.5820,  0.7590,
         0.0348,  0.9097,  0.0189,  0.0259,  0.8763,  0.7245,  0.0810,
         0.7837,  0.5721,  0.0046,  0.9773,  0.9209,  0.0002,  0.0102,
         0.5657,  0.0163,  0.9397,  0.0089,  0.7776,  0.7953,  0.7943,
         0.6026,  0.9909,  0.4582,  0.0430,  0.9913,  0.0068,  0.6934,
         0.0999,  0.1105,  0.0029,  0.4504,  0.0523,  0.0163,  0.1316,
         0.8602,  0.0524,  0.1012,  0.2879,  0.0256,  0.9531,  0.8752,
         0.0069,  0.4491,  0.2577,  0.7580,  0.0325,  0.8735,  0.0072,
         0.0980,  0.0561,  0.0238,  0.6724,  0.7264,  0.9509,  0.5169,
         0.3928,  0.0219,  0.9755,  0.3762,  0.9576,  0.2082,  0.0579,
         0.0380,  0.9724,  0.0145,  0.8373,  0.2783,  0.0070,  0.2863,
         0.8316,  0.1676,  0.0106,  0.0381,  0.8156,  0.4019,  0.2020,
         0.0070,  0.0257,  0.1308,  0.7749,  0.0151,  0.1429,  0.2807,
         0.3443,  0.3279,  0.7848,  0.2525,  0.8548,  0.3110,  0.1299,
         0.0678,  0.9228,  0.0244,  0.0719,  0.6867,  0.8427,  0.0075,
         0.9434,  0.9393,  0.0274,  0.0540,  0.0086,  0.9742,  0.4437,
         0.2090,  0.0180,  0.8658,  0.7372,  0.9547,  0.9577,  0.6155,
         0.1705,  0.7708,  0.8201,  0.9749,  0.0105,  0.0007,  0.9721,
         0.9908,  0.9813,  0.2538,  0.1092,  0.1726,  0.8915,  0.9891,
         0.8516,  0.6151,  0.3138,  0.0036,  0.0570,  0.8251,  0.6351,
         0.2804,  0.8779,  0.0200,  0.0148,  0.5708,  0.0104,  0.7561,
         0.0903,  0.5723,  0.7369,  0.9706,  0.0111,  0.9654,  0.4369,
         0.9438,  0.9915,  0.7014,  0.1611,  0.0837,  0.1684,  0.1655,
         0.4409,  0.9859,  0.2133,  0.6445,  0.0525,  0.0233,  0.4382,
         0.0587,  0.9893,  0.0079,  0.5517,  0.0113,  0.3781,  0.8917,
         0.8809,  0.9831,  0.0062,  0.0041,  0.2779,  0.0157,  0.9438,
         0.3815,  0.0266,  0.0303,  0.2162,  0.7761,  0.9989,  0.9654,
         0.9416,  0.9938,  0.4966,  0.1792,  0.0795,  0.8734,  0.1103,
         0.0039,  0.8824,  0.9156,  0.2581,  0.2243,  0.6532,  0.8654,
         0.0072,  0.8775,  0.8084,  0.0835,  0.0130,  0.9773,  0.0003,
         0.6046,  0.0013,  0.3569,  0.7288,  0.9988,  0.8543,  0.0967,
         0.0192,  0.2602,  0.4993,  0.0620,  0.7093,  0.7780,  0.0106,
         0.7812,  0.9740,  0.9419,  0.8969,  0.0572,  0.8836,  0.6727,
         0.0094,  0.1026,  0.9910,  0.1036,  0.9431,  0.6384,  0.6805,
         0.0231,  0.3346,  0.9043,  0.4974,  0.0305,  0.0123,  0.1966,
         0.9882,  0.5040,  0.8639,  0.2693,  0.2161,  0.9647,  0.0643,
         0.0146,  0.0417,  0.8457,  0.0326,  0.9892,  0.7416,  0.0052,
         0.0016,  0.0478,  0.9999,  0.0084,  0.0359,  0.1571,  0.9905,
         0.1101,  0.2372,  0.0021,  0.0024,  0.9758,  0.0139,  0.0624,
         0.0077,  0.4434,  0.1200,  0.5557,  0.9724,  0.9233,  0.0079,
         0.9277,  0.8529,  0.3341,  0.5991,  0.0098,  0.0178,  0.0406,
         0.8406,  0.4246,  0.9588,  0.0398,  0.0111,  0.7329,  0.0026,
         0.1360,  0.0664,  0.8889,  0.4687,  0.1494,  0.0103,  0.8918,
         0.0746,  0.2467,  0.0916,  0.9782,  0.0671,  0.0322,  0.0134,
         0.0049,  0.0114,  0.0674,  0.0140,  0.1707,  0.3624,  0.9239,
         0.9480,  0.0115,  0.0087,  0.8450,  0.8920,  0.9783,  0.5366,
         0.0307,  0.0123,  0.4108,  0.0795,  0.8883,  0.8624,  0.4728,
         0.1033,  0.9431,  0.1697,  0.9302,  0.0226,  0.8648,  0.2816,
         0.1291,  0.0474,  0.9284,  0.8766,  0.6181,  0.0020,  0.9919,
         0.9241,  0.1279,  0.9659,  0.1469,  0.0337,  0.8711,  0.9531,
         0.0043,  0.7156,  0.0375,  0.9735,  0.0984,  0.9189,  0.0008,
         0.0404,  0.8379,  0.9204,  0.8339,  0.2402,  0.0683,  0.0708,
         0.5492,  0.9134,  0.2344,  0.2324,  0.0239,  0.8988,  0.0354,
         0.9836,  0.8923,  0.0235,  0.8819,  0.0599,  0.3365,  0.9123,
         0.0105,  0.6946,  0.0437,  0.0009,  0.8652,  0.7310,  0.0352,
         0.8383,  0.9955,  0.5219,  0.0122,  0.0029,  0.0115,  0.7927,
         0.0068,  0.1386,  0.0282,  0.1910,  0.6619,  0.0047,  0.0253,
         0.9861,  0.7875,  0.8218,  0.7622,  0.8310,  0.6886,  0.2758,
         0.4386,  0.3495,  0.0836,  0.9381,  0.6198,  0.0034,  0.9253,
         0.0040,  0.0120,  0.1214,  0.9903,  0.9004,  0.3597,  0.9888,
         0.1316,  0.0768,  0.0049,  0.4250,  0.9993,  0.2135,  0.2612,
         0.3199,  0.0006,  0.9902,  0.6834,  0.4047,  0.8737,  0.2409,
         0.0435,  0.0004,  0.0106,  0.5978,  0.7852,  0.9446,  0.9262,
         0.4721,  0.9194,  0.0125,  0.1199,  0.0020,  0.9224,  0.8351,
         0.8796,  0.9422,  0.0927,  0.0137,  0.7138,  0.1263,  0.0075,
         0.3354,  0.8155,  0.9700,  0.0349,  0.4372,  0.9192,  0.0601,
         0.0564,  0.7902,  0.9719,  0.0671,  0.1003,  0.9342,  0.9449,
         0.6109,  0.0823,  0.7867,  0.9800,  0.9491,  0.7331,  0.2570,
         0.9933,  0.9645,  0.8843,  0.0438,  0.0761,  0.6696,  0.5102,
         0.1563], device='cuda:0')
tensor(0.2978, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0036,  0.9321,  0.0073,  0.5360,  0.6132,  0.8476,  0.0016,
         0.1506,  0.6701,  0.9378,  0.8508,  0.0124,  0.0060,  0.9050,
         0.0051,  0.1577,  0.1251,  0.9423,  0.0043,  0.0976,  0.9645,
         0.4594,  0.0596,  0.0416,  0.9844,  0.9938,  0.9230,  0.3041,
         0.9653,  0.0008,  0.0209,  0.9068,  0.9166,  0.2387,  0.2144,
         0.1157,  0.1667,  0.9393,  0.0327,  0.0468,  0.9570,  0.9700,
         0.1971,  0.3381,  0.0115,  0.0092,  0.2189,  0.0211,  0.3767,
         0.0399,  0.9732,  0.0305,  0.0360,  0.0084,  0.0029,  0.0163,
         0.0938,  0.0267,  0.9990,  0.0106,  0.7798,  0.9976,  0.9859,
         0.9368,  0.4623,  0.0169,  0.0265,  0.8419,  0.0011,  0.8881,
         0.3505,  0.0097,  0.6629,  0.3766,  0.8947,  0.9555,  0.5902,
         0.0145,  0.7214,  0.9811,  0.7055,  0.5591,  0.9589,  0.2263,
         0.0673,  0.0384,  0.6564,  0.7012,  0.4750,  0.9666,  0.0228,
         0.9890,  0.0196,  0.7639,  0.0368,  0.0629,  0.8398,  0.9302,
         0.0732,  0.1563,  0.0478,  0.0082,  0.0095,  0.0675,  0.0367,
         0.9920,  0.9691,  0.0157,  0.9617,  0.9521,  0.8946,  0.8255,
         0.9646,  0.0096,  0.8811,  0.0213,  0.9741,  0.9229,  0.9861,
         0.0906,  0.0462,  0.6428,  0.0033,  0.7838,  0.0238,  0.0349,
         0.8952,  0.9225,  0.0215,  0.0214,  0.0052,  0.9997,  0.0085,
         0.4787,  0.9666,  0.0188,  0.9577,  0.1555,  0.9561,  0.9892,
         0.0524,  0.9435,  0.2231,  0.9029,  0.7864,  0.0270,  0.0222,
         0.2658,  0.8641,  0.0157,  0.7892,  0.1903,  0.7588,  0.9953,
         0.1750,  0.9047,  0.8560,  0.0006,  0.9932,  0.6819,  0.8965,
         0.0689,  0.6865,  0.0264,  0.0032,  0.6021,  0.0324,  0.0070,
         0.6081,  0.9519,  0.0475,  0.0186,  0.1804,  0.5495,  0.1831,
         0.4651,  0.1523,  0.8182,  0.0100,  0.0605,  0.0042,  0.8208,
         0.9990,  0.9279,  0.0965,  0.9448,  0.0557,  0.9407,  0.9681,
         0.5686,  0.1005,  0.5007,  0.0099,  0.2073,  0.0060,  0.0275,
         0.1859,  0.0335,  0.0237,  0.0071,  0.0970,  0.9718,  0.9126,
         0.9987,  0.0636,  0.4175,  0.8928,  0.8075,  0.9265,  0.0410,
         0.9843,  0.7971,  0.8854,  0.1262,  0.0236,  0.9612,  0.8017,
         0.0025,  0.0015,  0.0326,  0.0412,  0.9427,  0.0016,  0.0139,
         0.0388,  0.2999,  0.9931,  0.7804,  0.8503,  0.8580,  0.0018,
         0.7434,  0.0001,  0.0150,  0.9763,  0.5598,  0.9547,  0.8545,
         0.5680,  0.0159,  0.8511,  0.0013,  0.1241,  0.0252,  0.0186,
         0.5379,  0.9968,  0.0698,  0.9128,  0.0028,  0.3586,  0.0250,
         0.7655,  0.1227,  0.0112,  0.9117,  0.5863,  0.9669,  0.9448,
         0.9326,  0.0104,  0.4073,  0.0285,  0.3818,  0.0045,  0.9638,
         0.0033,  0.0043,  0.5591,  0.9649,  0.0072,  0.0511,  0.9431,
         0.0044,  0.9992,  0.0622,  0.4836,  0.0071,  0.9970,  0.0013,
         0.0056,  0.0413,  0.5069,  0.9566,  0.0020,  0.0775,  0.9326,
         0.8852,  0.9421,  0.0151,  0.8597,  0.0039,  0.0371,  0.6853,
         0.1780,  0.0145,  0.0155,  0.0016,  0.8766,  0.9940,  0.0025,
         0.7613,  0.9640,  0.9395,  0.9338,  0.0417,  0.7078,  0.7984,
         0.0683,  0.0072,  0.0031,  0.4279,  0.8764,  0.9324,  0.8757,
         0.2358,  0.8249,  0.9776,  0.9826,  0.9761,  0.0290,  0.9359,
         0.0581,  0.9366,  0.0159,  0.0669,  0.0160,  0.0642,  0.7719,
         0.0748,  0.1154,  0.9179,  0.0002,  0.8148,  0.9288,  0.9988,
         0.9554,  0.0279,  0.3264,  0.0173,  0.9969,  0.0823,  0.0184,
         0.7893,  0.9784,  0.0554,  0.0377,  0.9992,  0.9129,  0.0781,
         0.0037,  0.0203,  0.6579,  0.8053,  0.5864,  0.0486,  0.1426,
         0.0922,  0.4367,  0.7216,  0.0046,  0.9060,  0.0492,  0.6752,
         0.0006,  0.9679,  0.9687,  0.8952,  0.9503,  0.0301,  0.0344,
         0.0850,  0.9113,  0.9140,  0.6572,  0.7507,  0.9725,  0.6992,
         0.0155,  0.8556,  0.7177,  0.0408,  0.2406,  0.8349,  0.0181,
         0.1307,  0.7893,  0.7717,  0.6624,  0.0047,  0.9760,  0.1436,
         0.1920,  0.0774,  0.9882,  0.0927,  0.0235,  0.9145,  0.9504,
         0.0815,  0.9611,  0.0388,  0.0395,  0.9934,  0.8717,  0.6770,
         0.4409,  0.9512,  0.0008,  0.1485,  0.0140,  0.1736,  0.1174,
         0.6245,  0.0108,  0.8835,  0.0139,  0.9513,  0.2735,  0.0766,
         0.1502,  0.3385,  0.9944,  0.6865,  0.8533,  0.9181,  0.9550,
         0.1136,  0.9542,  0.0567,  0.5852,  0.5188,  0.8341,  0.0058,
         0.1709,  0.8760,  0.9448,  0.1961,  0.0348,  0.9810,  0.0082,
         0.1057,  0.6157,  0.9822,  0.9998,  0.3564,  0.9737,  0.5410,
         0.0367,  0.7357,  0.0006,  0.0358,  0.9618,  0.7816,  0.0098,
         0.6862,  0.0199,  0.8568,  0.1066,  0.8941,  0.0461,  0.0611,
         0.9936,  0.0353,  0.8346,  0.0583,  0.0770,  0.1972,  0.7266,
         0.2241,  0.1286,  0.7534,  0.4848,  0.9743,  0.9096,  0.9349,
         0.2310,  0.8224,  0.0379,  0.5611,  0.0617,  0.0555,  0.0123,
         0.9679,  0.0993,  0.0401,  0.0024,  0.7028,  0.2206,  0.0162,
         0.0480,  0.9513,  0.6419,  0.9715,  0.0317,  0.0064,  0.0073,
         0.0362,  0.4640,  0.7754,  0.0403,  0.7892,  0.8123,  0.6194,
         0.4140,  0.0065,  0.1049,  0.0275,  0.3146,  0.9446,  0.8702,
         0.9111], device='cuda:0')
tensor(0.2447, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7034,  0.0208,  0.0939,  0.0450,  0.9928,  0.0359,  0.9419,
         0.9550,  0.9987,  0.7408,  0.0578,  0.9994,  0.9926,  0.0200,
         0.0125,  0.0016,  0.9084,  0.0026,  0.9415,  0.0507,  0.9989,
         0.0356,  0.7166,  0.1204,  0.9989,  0.9318,  0.0252,  0.0045,
         0.9987,  0.1214,  0.8111,  0.1364,  0.7391,  0.7609,  0.4579,
         0.0274,  0.6150,  0.9867,  0.9677,  0.9479,  0.9427,  0.0782,
         0.8288,  0.6124,  0.4067,  0.0124,  0.0018,  0.0183,  0.0022,
         0.0007,  0.0111,  0.9839,  0.7006,  0.8778,  0.0054,  0.0721,
         0.9913,  0.8360,  0.9047,  0.0639,  0.1166,  0.9024,  0.0045,
         0.2175,  0.7999,  0.9577,  0.0191,  0.0051,  0.0012,  0.0009,
         0.2299,  0.0049,  0.7420,  0.5718,  0.0472,  0.1252,  0.4669,
         0.9134,  0.0544,  0.1033,  0.9541,  0.0376,  0.0305,  0.9610,
         0.9955,  0.0612,  0.0451,  0.0781,  0.9437,  0.0583,  0.6291,
         0.6140,  0.1990,  0.0140,  0.9965,  0.9108,  0.0069,  0.0040,
         0.0126,  0.0419,  0.9698,  0.8063,  0.0474,  0.9189,  0.9816,
         0.5051,  0.7540,  0.9954,  0.9665,  0.0685,  0.8250,  0.9901,
         0.0003,  0.9649,  0.0933,  0.1808,  0.2759,  0.5769,  0.5945,
         0.6986,  0.0728,  0.9419,  0.8790,  0.6499,  0.9631,  0.9598,
         0.4510,  0.9668,  0.0003,  0.7741,  0.9278,  0.9344,  0.9563,
         0.8311,  0.7892,  0.9965,  0.7070,  0.1065,  0.0323,  0.9995,
         0.9242,  0.4258,  0.8740,  0.8829,  0.9341,  0.1342,  0.9872,
         0.4578,  0.8043,  0.8654,  0.1218,  0.0119,  0.9947,  0.0329,
         0.9350,  0.9380,  0.0512,  0.9682,  0.8873,  0.8377,  0.0629,
         0.3434,  0.0075,  0.9393,  0.2844,  0.7975,  0.9988,  0.0910,
         0.3183,  0.0916,  0.6500,  0.0378,  0.1111,  0.0018,  0.0017,
         0.9440,  0.7300,  0.9449,  0.9845,  0.9937,  0.0050,  0.7819,
         0.8692,  0.0180,  0.2087,  0.8819,  0.8282,  0.0377,  0.2532,
         0.8142,  0.0004,  0.9973,  0.0017,  0.8755,  0.0001,  0.2580,
         0.0066,  0.9332,  0.0254,  0.0075,  0.0814,  0.0152,  0.7366,
         0.9985,  0.9252,  0.0196,  0.9672,  0.0488,  0.0040,  0.1797,
         0.0776,  0.9978,  0.0570,  0.1015,  0.8298,  0.8837,  0.1712,
         0.9128,  0.2134,  0.8700,  0.6331,  0.8633,  0.9568,  0.0101,
         0.7436,  0.8463,  0.9120,  0.8737,  0.9989,  0.0005,  0.0335,
         0.9300,  0.9516,  0.2957,  0.5538,  0.9307,  0.0009,  0.4485,
         0.0336,  0.8387,  0.6920,  0.0354,  0.9677,  0.0590,  0.9982,
         0.9822,  0.0075,  0.9122,  0.1486,  0.6984,  0.3228,  0.9514,
         0.7332,  0.9856,  0.0074,  0.9959,  0.0077,  0.9666,  0.9850,
         0.9986,  0.9679,  0.2591,  0.0378,  0.0245,  0.8992,  0.0589,
         0.8893,  0.9691,  0.8850,  0.9446,  0.9146,  0.2529,  0.0388,
         0.9815,  0.9542,  0.0439,  0.9847,  0.9426,  0.5622,  0.9799,
         0.9102,  0.0090,  0.0153,  0.7750,  0.0783,  0.9535,  0.9680,
         0.1572,  0.3755,  0.7517,  0.0036,  0.8123,  0.0544,  0.7644,
         0.9043,  0.0363,  0.9070,  0.1953,  0.8749,  0.1630,  0.0022,
         0.0082,  0.8132,  0.1052,  0.2667,  0.9726,  0.2418,  0.7596,
         0.0365,  0.9770,  0.9602,  0.9947,  0.2303,  0.0441,  0.0472,
         0.9412,  0.9783,  0.2584,  0.1824,  0.9895,  0.9726,  0.1399,
         0.9911,  0.9632,  0.9179,  0.7551,  0.4044,  0.3073,  0.9998,
         0.8469,  0.8691,  0.9874,  0.0052,  0.0083,  0.9848,  0.0470,
         0.8614,  0.8292,  0.7054,  0.9727,  0.9774,  0.0495,  0.8866,
         0.0681,  0.9978,  0.6770,  0.8325,  0.9191,  0.6886,  0.0010,
         0.1728,  0.0061,  0.1645,  0.9352,  0.1212,  0.8062,  0.2106,
         0.8810,  0.5818,  0.8883,  0.9672,  0.0446,  0.8450,  0.6916,
         0.7461,  0.6450,  0.0615,  0.9869,  0.9786,  0.0037,  0.9721,
         0.7678,  0.9643,  0.5687,  0.0212,  0.3693,  0.9548,  0.9998,
         0.0063,  0.9540,  0.0380,  0.0782,  0.0704,  0.8784,  0.9976,
         0.0926,  0.9180,  0.0294,  0.0168,  0.5288,  0.5093,  0.9108,
         0.0007,  0.6582,  0.0094,  0.8215,  0.7221,  0.0260,  0.9851,
         0.0027,  0.2780,  0.0319,  0.6613,  0.0371,  0.3856,  0.8151,
         0.0010,  0.7911,  0.0004,  0.4942,  0.9713,  0.9848,  0.9726,
         0.0026,  0.1682,  0.0390,  0.9882,  0.8950,  0.9449,  0.0307,
         0.0393,  0.9254,  0.8705,  0.0344,  0.9848,  0.9997,  0.0087,
         0.8615,  0.9605,  0.8728,  0.0864,  0.9280,  0.8357,  0.0826,
         0.9856,  0.2732,  0.1285,  0.8698,  0.0004,  0.9145,  0.9841,
         0.6358,  0.1177,  0.0098,  0.9777,  0.9833,  0.9175,  0.7483,
         0.7735,  0.9958,  0.9998,  0.3250,  0.9608,  0.1242,  0.9534,
         0.4094,  0.0083,  0.0035,  0.9642,  0.6585,  0.9778,  0.0981,
         0.0321,  0.8934,  0.0300,  0.1630,  0.0017,  0.6347,  0.9308,
         0.9446,  0.0008,  0.0439,  0.2470,  0.0253,  0.1860,  0.0349,
         0.0387,  0.5271,  0.9645,  0.8913,  0.5592,  0.1087,  0.9670,
         0.0236,  0.1876,  0.9456,  0.0662,  0.3544,  0.0020,  0.9552,
         0.9874,  0.3855,  0.0235,  0.0049,  0.0770,  0.0014,  0.0166,
         0.0172,  0.4382,  0.7478,  0.8058,  0.9408,  0.0259,  0.0419,
         0.2247,  0.9735,  0.9752,  0.9626,  0.2371,  0.8387,  0.0068,
         0.0446], device='cuda:0')
tensor(0.2928, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0553,  0.9799,  0.9872,  0.9574,  0.0007,  0.0038,  0.0290,
         0.9824,  0.9364,  0.9739,  0.6221,  0.9399,  0.9702,  0.7993,
         0.9693,  0.0468,  0.8668,  0.6959,  0.0098,  0.8379,  0.9242,
         0.9759,  0.0737,  0.8685,  0.9881,  0.9519,  0.0895,  0.8231,
         0.9771,  0.9521,  0.1401,  0.0017,  0.9605,  0.9548,  0.1172,
         0.0267,  0.0080,  0.1179,  0.0634,  0.9722,  0.0022,  0.0123,
         0.5186,  0.9702,  0.9326,  0.9888,  0.0641,  0.1000,  0.0855,
         0.9589,  0.0891,  0.9997,  0.5367,  0.0035,  0.0421,  0.0959,
         0.9878,  0.7832,  0.1331,  0.2167,  0.9689,  0.9988,  0.2020,
         0.0688,  0.0688,  0.0263,  0.4960,  0.6397,  0.9956,  0.9997,
         0.6847,  0.0037,  0.1328,  0.9997,  0.9033,  0.9656,  0.0163,
         0.0078,  0.0816,  0.0968,  0.0033,  0.9387,  0.9334,  0.1372,
         0.8854,  0.2977,  0.0415,  0.9740,  0.0180,  0.0121,  0.9842,
         0.9254,  0.9928,  0.5945,  0.1175,  0.0566,  0.9243,  0.9368,
         0.6404,  0.3786,  0.0203,  0.7096,  0.9258,  0.8082,  0.9945,
         0.5264,  0.7074,  0.0780,  0.9118,  0.2059,  0.0249,  0.5829,
         0.9083,  0.0158,  0.9197,  0.2976,  0.4547,  0.9141,  0.7606,
         0.2527,  0.8793,  0.8467,  0.0106,  0.9475,  0.9422,  0.0799,
         0.7751,  0.0805,  0.9575,  0.4103,  0.5305,  0.0425,  0.9544,
         0.4164,  0.9749,  0.8902,  0.9137,  0.2235,  0.8144,  0.0543,
         0.9833,  0.9775,  0.9881,  0.7635,  0.9317,  0.0083,  0.0219,
         0.9389,  0.0279,  0.7733,  0.9615,  0.9778,  0.9732,  0.0449,
         0.9336,  0.9684,  0.1766,  0.7829,  0.9835,  0.9514,  0.0278,
         0.0299,  0.6521,  0.9603,  0.0049,  0.9889,  0.0813,  0.9147,
         0.5445,  0.9949,  0.8216,  0.0113,  0.0122,  0.9847,  0.0286,
         0.0472,  0.7539,  0.7848,  0.9637,  0.5995,  0.9229,  0.0755,
         0.0839,  0.9996,  0.7756,  0.7149,  0.8045,  0.7859,  0.9758,
         0.0079,  0.9360,  0.8806,  0.9845,  0.0165,  0.1952,  0.8761,
         0.0044,  0.0023,  0.9023,  0.8858,  0.0175,  0.9827,  0.9421,
         0.9008,  0.8537,  0.9742,  0.0349,  0.0613,  0.0005,  0.0134,
         0.0339,  0.7903,  0.9596,  0.3203,  0.1058,  0.9885,  0.8982,
         0.0658,  0.9162,  0.9734,  0.8908,  0.0090,  0.9653,  0.8474,
         0.5149,  0.9595,  0.1025,  0.2369,  0.0226,  0.9872,  0.0161,
         0.9504,  0.9565,  0.5463,  0.9668,  0.9179,  0.2700,  0.8615,
         0.4584,  0.0959,  0.9361,  0.9732,  0.9934,  0.9316,  0.9816,
         0.9888,  0.0189,  0.3443,  0.0733,  0.9689,  0.9600,  0.3479,
         0.0429,  0.9442,  0.0408,  0.3825,  0.9278,  0.1180,  0.2039,
         0.4371,  0.9837,  0.0117,  0.0079,  0.9588,  0.9363,  0.9792,
         0.9745,  0.8798,  0.9443,  0.1424,  0.0084,  0.0076,  0.9352,
         0.9775,  0.7633,  0.0064,  0.1378,  0.9998,  0.9152,  0.0568,
         0.2838,  0.0251,  0.9742,  0.0046,  0.9603,  0.9662,  0.0734,
         0.3039,  0.9276,  0.1398,  0.9536,  0.8572,  0.1342,  0.0340,
         0.0469,  0.8599,  0.1820,  0.8454,  0.9863,  0.0032,  0.7484,
         0.7282,  0.3301,  0.0218,  0.9260,  0.7990,  0.1105,  0.7570,
         0.9514,  0.6104,  0.5159,  0.9461,  0.8183,  0.8881,  0.9550,
         0.0005,  0.9645,  0.0196,  0.6945,  0.9552,  0.8426,  0.2269,
         0.8824,  0.9572,  0.6188,  0.0453,  0.0162,  0.3050,  0.9167,
         0.9913,  0.9496,  0.8290,  0.0037,  0.9750,  0.0439,  0.9667,
         0.9290,  0.3436,  0.8086,  0.9743,  0.1142,  0.9911,  0.1921,
         0.0014,  0.9828,  0.9842,  0.0172,  0.9404,  0.5345,  0.6853,
         0.9858,  0.0513,  0.9361,  0.9163,  0.9969,  0.9601,  0.1464,
         0.7671,  0.9415,  0.0649,  0.0074,  0.0276,  0.9895,  0.1866,
         0.9332,  0.9276,  0.6963,  0.0035,  0.9873,  0.1086,  0.9806,
         0.9056,  0.6935,  0.9147,  0.0282,  0.0113,  0.0704,  0.9608,
         0.0033,  0.8364,  0.7240,  0.9521,  0.7736,  0.8813,  0.0615,
         0.9627,  0.8510,  0.9874,  0.1275,  0.8868,  0.9526,  0.0116,
         0.0414,  0.9283,  0.5701,  0.5306,  0.9661,  0.0693,  0.2130,
         0.9336,  0.6538,  0.8789,  0.9605,  0.8047,  0.2138,  0.8046,
         0.1473,  0.4038,  0.0813,  0.9588,  0.9738,  0.7957,  0.0039,
         0.2159,  0.0603,  0.0522,  0.8983,  0.9814,  0.0026,  0.0280,
         0.9576,  0.9164,  0.0422,  0.9602,  0.9560,  0.6322,  0.0057,
         0.9825,  0.9592,  0.8716,  0.0211,  0.0092,  0.0091,  0.9705,
         0.9493,  0.9553,  0.9961,  0.2344,  0.1601,  0.8053,  0.0769,
         0.0500,  0.6142,  0.1170,  0.9289,  0.9687,  0.8445,  0.0005,
         0.9470,  0.0739,  0.0064,  0.8136,  0.0022,  0.2139,  0.0367,
         0.0293,  0.9680,  0.6238,  0.0030,  0.6127,  0.0090,  0.6882,
         0.3575,  0.0068,  0.5204,  0.0009,  0.2568,  0.3056,  0.1387,
         0.0996,  0.5661,  0.9257,  0.9618,  0.9926,  0.9729,  0.0096,
         0.8929,  0.9697,  0.3568,  0.0015,  0.4434,  0.9441,  0.9804,
         0.9643,  0.9651,  0.2347,  0.4449,  0.9644,  0.9081,  0.8812,
         0.0168,  0.8343,  0.9861,  0.0007,  0.0596,  0.0734,  0.9462,
         0.9898,  0.8099,  0.0146,  0.9863,  0.0487,  0.9629,  0.9241,
         0.7722,  0.9522,  0.1267,  0.0040,  0.9754,  0.9321,  0.0582,
         0.9283], device='cuda:0')
tensor(0.3138, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9834,  0.8808,  0.9141,  0.0124,  0.0104,  0.7513,  0.9518,
         0.0056,  0.9271,  0.7783,  0.2768,  0.6115,  0.8641,  0.9846,
         0.9514,  0.9248,  0.4439,  0.1354,  0.8876,  0.8946,  0.0004,
         0.0416,  0.8914,  0.9517,  0.9091,  0.8917,  0.0442,  0.8930,
         0.0211,  0.0238,  0.8848,  0.7004,  0.0020,  0.6712,  0.0018,
         0.0024,  0.9029,  0.4997,  0.8861,  0.8540,  0.8466,  0.1178,
         0.1423,  0.9508,  0.9254,  0.0097,  0.9919,  0.0043,  0.9605,
         0.0981,  0.0493,  0.9766,  0.7933,  0.9660,  0.0150,  0.0559,
         0.0067,  0.0116,  0.8195,  0.7160,  0.8902,  0.8792,  0.0011,
         0.9720,  0.9999,  0.8988,  0.6877,  0.0093,  0.0243,  0.9269,
         0.8465,  0.9262,  0.9952,  0.9597,  0.9817,  0.1077,  0.8414,
         0.9634,  0.3983,  0.5839,  0.1413,  0.9315,  0.0206,  0.9981,
         0.0005,  0.4369,  0.9552,  0.0353,  0.4744,  0.0030,  0.9745,
         0.8535,  0.0013,  0.1317,  0.9282,  0.3051,  0.0228,  0.0463,
         0.9637,  0.8234,  0.7339,  0.9849,  0.8032,  0.9945,  0.9995,
         0.4322,  0.9456,  0.9814,  0.9891,  0.0689,  0.8773,  0.0256,
         0.6758,  0.9614,  0.2762,  0.7478,  0.9112,  0.8414,  0.0085,
         0.9916,  0.0005,  0.9667,  0.0110,  0.0133,  0.0395,  0.0018,
         0.0026,  0.9423,  0.9662,  0.0832,  0.9348,  0.0051,  0.9824,
         0.8631,  0.0053,  0.0436,  0.4080,  0.0039,  0.0456,  0.9502,
         0.2812,  0.7718,  0.9895,  0.0140,  0.9899,  0.0581,  0.9644,
         0.8909,  0.0219,  0.0431,  0.9503,  0.0383,  0.8999,  0.9140,
         0.9628,  0.9832,  0.0324,  0.9965,  0.8385,  0.9307,  0.9043,
         0.0627,  0.0190,  0.2735,  0.9985,  0.4078,  0.9138,  0.2642,
         0.9948,  0.0007,  0.8765,  0.0140,  0.9475,  0.0517,  0.0100,
         0.9912,  0.1033,  0.8387,  0.9605,  0.0029,  0.0913,  0.8758,
         0.1717,  0.9792,  0.8502,  0.9585,  0.8897,  0.0036,  0.9793,
         0.9180,  0.9396,  0.9310,  0.5199,  0.6933,  0.6013,  0.0023,
         0.0059,  0.9056,  0.9308,  0.9827,  0.9544,  0.7628,  0.4002,
         0.9914,  0.0176,  0.8683,  0.0185,  0.1865,  0.9897,  0.0083,
         0.9894,  0.8597,  0.8639,  0.2987,  0.0405,  0.0331,  0.9361,
         0.9693,  0.8562,  0.0510,  0.9925,  0.2296,  0.6012,  0.9592,
         0.9305,  0.0363,  0.8995,  0.9826,  0.0565,  0.9464,  0.0200,
         0.8846,  0.9878,  0.9319,  0.2491,  0.0053,  0.9510,  0.9997,
         0.9896,  0.1844,  0.0039,  0.9326,  0.1749,  0.9821,  0.9649,
         0.4395,  0.5661,  0.9532,  0.0011,  0.0068,  0.9283,  0.0716,
         0.5707,  0.0956,  0.7348,  0.0644,  0.9750,  0.9096,  0.9659,
         0.7725,  0.5328,  0.9426,  0.5131,  0.9999,  0.6882,  0.9870,
         0.9887,  0.9386,  0.7216,  0.9961,  0.1690,  0.8055,  0.4588,
         0.9623,  0.0656,  0.8853,  0.9802,  0.0006,  0.9776,  0.6163,
         0.9930,  0.9517,  0.0047,  0.9765,  0.9593,  0.3393,  0.9380,
         0.4694,  0.5641,  0.0097,  0.0922,  0.4470,  0.0733,  0.2215,
         0.9546,  0.8691,  0.8966,  0.0940,  0.9742,  1.0000,  0.9167,
         0.9930,  0.9012,  0.0068,  0.9734,  0.0224,  0.3736,  0.9680,
         0.0048,  0.9710,  0.9868,  0.9667,  0.9819,  0.9270,  0.7582,
         0.9216,  0.9983,  0.9179,  0.9168,  0.8286,  0.9583,  0.9918,
         0.0365,  0.0139,  0.6967,  0.9642,  0.9904,  0.9716,  0.2867,
         0.9531,  0.8190,  0.0108,  0.1918,  0.2521,  0.8182,  0.7583,
         0.8404,  0.0169,  0.9822,  0.9622,  0.0138,  0.0168,  0.9998,
         0.9767,  0.0072,  0.8995,  0.2146,  0.0202,  0.5551,  0.9620,
         0.4299,  0.0354,  0.0035,  0.9725,  0.6803,  0.9720,  0.8265,
         0.8216,  0.5707,  0.6738,  0.8932,  0.9584,  0.2592,  0.4981,
         0.4913,  0.0082,  0.5841,  0.0667,  0.9972,  0.0090,  0.9861,
         0.9976,  0.0188,  0.9666,  0.1226,  0.0550,  0.9947,  0.9144,
         0.8117,  0.4454,  0.1121,  0.9941,  0.9978,  0.9999,  0.9907,
         0.0304,  0.9943,  0.0108,  0.0939,  0.9011,  0.0013,  0.9674,
         0.0123,  0.9721,  0.0259,  0.3687,  0.7535,  0.0058,  0.9950,
         0.9949,  0.2245,  0.9155,  0.0114,  0.9996,  0.7544,  0.9745,
         0.0017,  0.0006,  0.9269,  0.0044,  0.0051,  0.0081,  0.9388,
         0.8841,  0.9796,  0.2909,  0.9190,  0.9608,  0.9137,  0.9450,
         0.2897,  0.4272,  0.9369,  0.0146,  0.4412,  0.9692,  0.8356,
         0.9784,  0.8636,  0.9802,  0.0032,  0.0746,  0.8192,  0.9715,
         0.1307,  0.7740,  0.5658,  0.9857,  0.0409,  0.0550,  0.9862,
         0.0851,  0.9856,  0.9882,  0.0139,  0.8076,  0.9019,  0.0193,
         0.9952,  0.0044,  0.0056,  0.5848,  0.7824,  0.0290,  0.7580,
         0.0248,  0.7361,  0.5508,  0.9676,  0.0005,  0.0318,  0.9996,
         0.1649,  0.2449,  0.8393,  0.9731,  0.9298,  0.0397,  0.9324,
         0.7952,  0.0075,  0.9286,  0.0174,  0.1110,  0.0238,  0.0952,
         0.9395,  0.2501,  0.0105,  0.9780,  0.9799,  0.9747,  0.0188,
         0.0972,  0.9584,  0.9078,  0.0301,  0.0046,  0.0037,  0.8709,
         0.0090,  0.7662,  0.9906,  0.9867,  0.0920,  0.9239,  0.9855,
         0.0746,  0.0483,  0.9848,  0.9928,  0.0331,  0.9980,  0.0067,
         0.9381,  0.9090,  0.0092,  0.0959,  0.9938,  0.9975,  0.9116,
         0.0013], device='cuda:0')
tensor(0.2891, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.8263,  0.7246,  0.9993,  0.9986,  0.8658,  0.9884,  0.7949,
         0.9928,  0.9579,  0.9465,  0.1186,  0.2729,  0.1673,  0.9396,
         0.4716,  0.7864,  0.9780,  0.0465,  0.8429,  0.8724,  0.9928,
         0.6234,  0.0004,  0.0016,  0.0428,  0.9973,  0.9625,  0.9281,
         0.6089,  0.4237,  0.8786,  0.1675,  0.8680,  0.6118,  0.9903,
         0.9895,  0.9761,  0.8844,  0.0098,  0.7985,  0.9995,  0.9298,
         0.7708,  0.0383,  0.9939,  0.9693,  0.9906,  0.8881,  0.9114,
         0.0012,  0.5005,  0.5253,  0.1686,  0.9797,  0.9808,  0.6723,
         0.4216,  0.0072,  0.7036,  0.9472,  0.7743,  0.0083,  0.9081,
         0.9445,  0.0068,  0.7932,  0.0031,  0.0161,  0.7948,  0.9758,
         0.0004,  0.0059,  0.0005,  0.9505,  0.1365,  0.4840,  0.0584,
         0.9794,  0.9872,  0.7024,  0.0018,  0.9284,  0.7971,  0.9824,
         0.0356,  0.0357,  0.9743,  0.3162,  0.8731,  0.9380,  0.1990,
         0.7164,  0.9301,  0.2379,  0.0007,  0.6277,  0.0074,  0.9941,
         0.0289,  0.9998,  0.0014,  0.9789,  0.2951,  0.0179,  0.4573,
         0.8575,  0.4059,  0.9769,  0.9308,  0.6339,  0.9209,  0.1701,
         0.2690,  0.9793,  0.0109,  0.6837,  0.9820,  0.3420,  0.8244,
         0.9758,  0.7221,  0.8407,  0.0119,  0.9784,  0.8096,  0.0088,
         0.9123,  0.1526,  0.9945,  0.0569,  0.1841,  0.9838,  0.4428,
         0.0155,  0.7962,  0.9095,  0.0724,  0.9045,  0.9935,  0.8098,
         0.4056,  0.3363,  0.6622,  0.7291,  0.4865,  0.9638,  0.0083,
         0.9549,  0.8646,  0.0557,  0.7012,  0.9746,  0.9988,  0.9895,
         0.0262,  0.7350,  0.3461,  0.9661,  0.9925,  0.3001,  0.0025,
         0.9817,  0.3832,  0.0692,  0.0970,  0.9956,  0.5036,  0.9394,
         0.4034,  0.9815,  0.5824,  0.9746,  0.7191,  0.8325,  0.8984,
         0.8918,  0.0443,  0.0350,  0.9768,  0.8421,  0.0031,  0.9318,
         0.3458,  0.0284,  0.9999,  0.9993,  0.0653,  0.8525,  0.9871,
         0.0075,  0.7099,  0.1416,  0.6911,  0.9075,  0.9271,  0.9512,
         0.9880,  0.8143,  0.9903,  0.9816,  0.0062,  0.9169,  0.9997,
         0.2406,  0.3377,  0.8486,  0.0606,  0.0025,  0.9692,  0.9758,
         0.4547,  0.9997,  0.9963,  0.0216,  0.1869,  0.0340,  0.0019,
         0.5309,  0.6931,  0.8942,  0.9735,  0.0060,  0.0147,  0.0841,
         0.8131,  0.7050,  0.0358,  0.0037,  0.0108,  0.9240,  0.0176,
         0.9295,  0.0219,  0.9860,  0.0416,  0.9505,  0.9048,  0.9838,
         0.4523,  0.0487,  0.0258,  0.9471,  0.9995,  0.0629,  0.9540,
         0.9002,  0.0135,  0.0226,  0.8192,  0.1386,  0.7568,  0.9360,
         0.4824,  0.2490,  0.4521,  0.0936,  0.1175,  0.0043,  0.3021,
         0.0437,  0.9991,  0.2050,  0.3565,  0.9268,  0.2170,  0.0063,
         0.0689,  0.0557,  0.8251,  0.0271,  0.0382,  0.8407,  0.8000,
         0.3228,  0.9103,  0.1189,  0.9924,  0.9663,  0.0654,  0.0251,
         0.7799,  0.7400,  0.9919,  0.0543,  0.0623,  0.0121,  0.5790,
         0.9975,  0.5959,  0.0333,  0.7878,  0.7974,  0.7881,  0.0019,
         0.9805,  0.8585,  0.7503,  0.8769,  0.9460,  0.9520,  0.9404,
         0.1113,  0.7735,  0.0052,  0.9537,  0.0228,  0.0541,  0.9903,
         0.0852,  0.8693,  0.0014,  0.9835,  0.0895,  0.9995,  0.3641,
         0.1238,  0.9663,  0.9744,  0.6383,  0.9665,  0.0229,  0.0096,
         0.1213,  0.9343,  0.7791,  0.0076,  0.8355,  0.5642,  0.2696,
         0.5334,  0.0566,  0.0162,  0.4460,  0.0533,  0.9379,  0.1624,
         0.9668,  0.0242,  0.7526,  0.0632,  0.1939,  0.9674,  0.9055,
         0.9641,  0.8798,  0.1387,  0.9128,  0.5041,  0.9259,  0.7624,
         0.9518,  0.5836,  0.6037,  0.8433,  0.0961,  0.7943,  0.9342,
         0.0240,  0.0052,  0.9963,  0.0082,  0.0066,  0.8999,  0.8398,
         0.9900,  0.9328,  0.0293,  0.6363,  0.8561,  0.9682,  0.0045,
         0.0283,  0.0177,  0.5005,  0.9360,  0.0155,  0.0122,  0.7629,
         0.0823,  0.9045,  0.9725,  0.0857,  0.7929,  0.1179,  0.3858,
         0.0082,  0.6787,  0.9525,  0.0339,  0.9826,  0.7077,  0.0242,
         0.0427,  0.0054,  0.9763,  0.9724,  0.1956,  0.0030,  0.2134,
         0.1831,  0.8282,  0.0015,  0.0391,  0.8739,  0.7819,  0.0056,
         0.9990,  0.9760,  0.6653,  0.0489,  0.0016,  0.8630,  0.9449,
         0.0278,  0.7661,  0.0091,  0.9562,  0.0086,  0.9410,  0.9654,
         0.0049,  0.8908,  0.6310,  0.1491,  0.0017,  0.0961,  0.1372,
         0.9639,  0.6646,  0.9760,  0.3280,  0.7732,  0.9099,  0.8812,
         0.9998,  0.9990,  0.1240,  0.0086,  0.9033,  0.9904,  0.1140,
         0.0216,  0.9208,  0.9998,  0.0127,  0.1215,  0.8655,  0.0250,
         0.9266,  0.8178,  0.0294,  0.0945,  0.0663,  0.9497,  0.0253,
         0.7937,  0.8011,  0.2394,  0.0466,  0.9861,  0.9922,  0.9594,
         0.9359,  0.9975,  0.0122,  0.0052,  0.9679,  0.0999,  0.2022,
         0.9998,  0.9257,  0.7858,  0.0790,  0.8271,  0.9656,  0.8928,
         0.0058,  0.0018,  0.9672,  0.7879,  0.9622,  0.9219,  0.9769,
         0.9466,  0.0315,  0.0196,  0.2801,  0.0061,  0.6549,  0.9829,
         0.0462,  0.4402,  0.9330,  0.0370,  0.1304,  0.0121,  0.0195,
         0.9501,  0.9964,  0.9740,  0.7021,  0.1575,  0.2060,  0.3616,
         0.9786,  0.9658,  0.9817,  0.0093,  0.9918,  0.9715,  0.9949,
         0.9076], device='cuda:0')
tensor(0.2636, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9529,  0.0092,  0.4099,  0.9934,  0.9758,  0.9073,  0.0046,
         0.7562,  0.9420,  0.8090,  0.5593,  0.0656,  0.0405,  0.9688,
         0.0207,  0.0436,  0.0645,  0.2666,  0.0018,  0.8497,  0.8243,
         0.0118,  0.9601,  0.9611,  0.0868,  0.5967,  0.9735,  0.8488,
         0.5292,  0.0070,  0.9741,  0.9704,  0.4245,  0.6129,  0.2769,
         0.4375,  0.6362,  0.9900,  0.9536,  0.3034,  0.0173,  0.1526,
         0.9981,  0.3038,  0.0178,  0.9224,  0.7121,  0.9219,  0.9415,
         0.8608,  0.9998,  0.4258,  0.0162,  0.9719,  0.0011,  0.9154,
         0.0910,  0.3768,  0.0325,  0.0072,  0.8939,  0.0329,  0.6908,
         0.9363,  0.2697,  0.0188,  0.6295,  0.9551,  0.4930,  0.1269,
         0.9333,  0.9622,  0.0268,  0.0378,  0.0094,  0.7635,  0.0935,
         0.7896,  0.2559,  0.9554,  0.1221,  0.7724,  0.9996,  0.0047,
         0.5485,  0.9993,  0.7971,  0.0101,  0.9260,  0.0488,  0.0704,
         0.0284,  0.0691,  0.7811,  0.9960,  0.0026,  0.4115,  0.6106,
         0.0214,  0.0290,  0.0285,  0.4447,  0.0082,  0.9988,  0.2193,
         0.9869,  0.0153,  0.4696,  0.3797,  0.8903,  0.0364,  0.9779,
         0.0170,  0.9739,  0.0233,  0.9995,  0.0218,  0.6606,  0.0014,
         0.9032,  0.8943,  0.9070,  0.0192,  0.8577,  0.3910,  0.7665,
         0.1907,  0.6629,  0.0455,  0.0044,  0.9575,  0.3692,  0.6284,
         0.0096,  0.9887,  0.7445,  0.9082,  0.0322,  0.9233,  0.9694,
         0.9693,  0.8681,  0.9923,  0.9995,  0.9228,  0.1028,  0.1962,
         0.0035,  0.1140,  0.9453,  0.0113,  0.9382,  0.8916,  0.0397,
         0.2471,  0.9918,  0.9707,  0.0629,  0.0106,  0.9621,  0.8873,
         0.7331,  0.5119,  0.9770,  0.0266,  0.0007,  0.0084,  0.2317,
         0.3093,  0.9635,  0.9545,  0.9738,  0.0377,  0.9810,  0.9254,
         0.9482,  0.0109,  0.0379,  0.7582,  0.9363,  0.9889,  0.7580,
         0.0044,  0.9919,  0.2643,  0.0713,  0.1939,  0.0471,  0.0283,
         0.3346,  0.9834,  0.0055,  0.3088,  0.3484,  0.0173,  0.0252,
         0.0812,  0.9604,  0.9943,  0.8917,  0.0016,  0.9633,  0.9510,
         0.1351,  0.0339,  0.8668,  0.5872,  0.0133,  0.1513,  0.9635,
         0.3145,  0.0821,  0.9668,  0.5138,  0.1628,  0.7983,  0.3190,
         0.9732,  0.8874,  0.7222,  0.1439,  0.8579,  0.8395,  0.3265,
         0.1435,  0.9721,  0.8915,  0.7572,  0.8640,  0.3860,  0.0320,
         0.2716,  0.9939,  0.4712,  0.8854,  0.4737,  0.9185,  0.1018,
         0.9656,  0.0556,  0.9213,  0.0528,  0.3166,  0.6163,  0.8316,
         0.9458,  0.9814,  0.9733,  0.8577,  0.0020,  0.3943,  0.8934,
         0.6790,  0.5329,  0.9851,  0.9964,  0.9827,  0.0088,  0.8943,
         0.0213,  0.9994,  0.0619,  0.9170,  0.9999,  0.0762,  0.9780,
         0.9527,  0.9419,  0.9924,  0.0351,  0.1704,  0.5862,  0.0852,
         0.0296,  0.0037,  0.9726,  0.8867,  0.9930,  0.9532,  0.8105,
         0.0766,  0.9467,  0.8464,  0.0806,  0.5174,  0.5299,  0.0181,
         0.0093,  0.0508,  0.6026,  0.0082,  0.0970,  0.2733,  0.8857,
         0.0236,  0.8348,  0.7953,  0.6992,  0.7266,  0.9587,  0.1212,
         0.0021,  0.9586,  0.9973,  0.1846,  0.3204,  0.9439,  0.3372,
         0.3998,  0.5838,  0.7789,  0.9367,  0.8241,  0.9196,  0.0229,
         0.0355,  0.0764,  0.6222,  0.9002,  0.9969,  0.9338,  0.8976,
         0.9284,  0.8612,  0.8581,  0.6969,  0.5976,  0.0049,  0.9152,
         0.9558,  0.9784,  0.0040,  0.0072,  0.8902,  0.4400,  0.0960,
         0.9921,  0.9681,  0.4928,  0.0049,  0.2340,  0.0025,  0.8002,
         0.9519,  0.9798,  0.3216,  0.8602,  0.3816,  0.0829,  0.0237,
         0.9856,  0.6845,  0.2058,  0.9429,  0.0005,  0.9077,  0.9048,
         0.0973,  0.7615,  0.0855,  0.9151,  0.0015,  0.8608,  0.1356,
         0.9670,  0.8724,  0.9978,  0.1822,  0.9852,  0.8791,  0.9254,
         0.7710,  0.3683,  0.0939,  0.0256,  0.0592,  0.9068,  0.7083,
         0.9962,  0.0452,  0.0023,  0.2172,  0.0746,  0.9967,  0.3116,
         0.0092,  0.3545,  0.3377,  0.9088,  0.9525,  0.9917,  0.9127,
         0.8158,  0.9615,  0.0307,  0.2036,  0.2465,  0.9021,  0.1449,
         0.1240,  0.9381,  0.0009,  0.9556,  0.2806,  0.6124,  0.1576,
         0.0110,  0.9843,  0.9979,  0.0713,  0.9684,  0.8961,  0.9431,
         0.9314,  0.6478,  0.9826,  0.1586,  0.5814,  0.0106,  0.9888,
         0.8731,  0.8049,  0.1036,  0.2889,  0.0431,  0.9601,  0.0017,
         0.9835,  0.1230,  0.9868,  0.0035,  0.4572,  0.9355,  0.0798,
         0.6760,  0.0180,  0.9782,  0.9887,  0.1824,  0.0051,  0.9283,
         0.8484,  0.8623,  0.5217,  0.0040,  0.0766,  0.0008,  0.9683,
         0.0247,  0.7820,  0.0500,  0.0350,  0.6374,  0.2834,  0.1025,
         0.9950,  0.0005,  0.8322,  0.0380,  0.9509,  0.9459,  0.9993,
         0.9380,  0.7051,  0.0067,  0.1248,  0.0288,  0.1045,  0.0077,
         0.0816,  0.1873,  0.0106,  0.5173,  0.0088,  0.9634,  0.9913,
         0.0009,  0.2110,  0.9362,  0.9927,  0.9225,  0.6154,  0.9392,
         0.9942,  0.7773,  0.1977,  0.9504,  0.8965,  0.0079,  0.9302,
         0.0450,  0.0291,  0.9906,  0.5005,  0.0201,  0.9992,  0.4745,
         0.9731,  0.0024,  0.0211,  0.1332,  0.0060,  0.9651,  0.0346,
         0.8935,  0.9989,  0.9308,  0.8854,  0.1356,  0.8669,  0.4970,
         0.0251], device='cuda:0')
tensor(0.3393, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.7798,  0.2614,  0.9058,  0.8803,  0.0759,  0.1652,  0.7232,
         0.0940,  0.7235,  0.9536,  0.0655,  0.9339,  0.4003,  0.0206,
         0.8940,  0.0074,  0.0764,  0.6377,  0.9916,  0.0056,  0.9854,
         0.0084,  0.9671,  0.0085,  0.0124,  0.8808,  0.9884,  0.0086,
         0.9999,  0.9346,  0.0045,  0.6738,  0.3842,  0.0586,  0.9719,
         0.9889,  0.9815,  0.0020,  0.5865,  0.9850,  0.8892,  0.0350,
         0.0265,  0.9515,  0.9627,  0.9196,  0.8518,  0.8179,  0.0501,
         0.9967,  0.9594,  0.0147,  0.3597,  0.9561,  0.0434,  0.9189,
         0.7392,  0.1085,  0.0104,  0.0750,  0.0041,  0.9422,  0.0014,
         0.0408,  0.0232,  0.0030,  0.7751,  0.9995,  0.6077,  0.9626,
         1.0000,  0.0795,  0.4095,  0.0005,  0.9934,  0.1549,  0.9796,
         0.0250,  0.0728,  0.8587,  0.4869,  0.0298,  0.9777,  0.0002,
         0.8799,  1.0000,  0.0345,  0.9994,  0.6423,  0.0014,  0.0466,
         0.0159,  0.8853,  0.0142,  0.9720,  0.0142,  0.9233,  0.1941,
         0.9929,  0.9833,  0.6283,  0.0091,  0.2320,  0.0045,  0.0136,
         0.5543,  0.2398,  0.2104,  0.1680,  0.1740,  0.4168,  0.0422,
         0.9678,  0.8207,  0.0023,  0.9828,  0.1857,  0.1990,  0.9790,
         0.1203,  0.9990,  0.0264,  0.9944,  0.8744,  0.0199,  0.8262,
         0.0246,  0.0179,  0.6687,  0.0330,  0.9680,  0.9134,  0.0225,
         0.0794,  0.8942,  0.9696,  0.9499,  0.6123,  0.0257,  0.9790,
         0.9993,  0.7680,  0.0327,  0.0704,  0.8713,  0.1008,  0.0557,
         0.9569,  0.0120,  0.9807,  0.0051,  0.5722,  0.9777,  0.3227,
         0.0211,  0.0033,  0.0129,  0.8582,  0.6182,  0.3685,  0.0886,
         0.0815,  0.9060,  0.8553,  0.0911,  0.0878,  0.9752,  0.0199,
         0.8211,  0.0566,  0.1686,  0.0359,  0.8077,  0.8498,  0.6536,
         0.5559,  0.9881,  0.9524,  0.7435,  0.2312,  0.6239,  0.0876,
         0.0777,  0.0112,  0.8885,  0.5699,  0.0310,  0.0062,  0.0195,
         0.0099,  0.4937,  0.0639,  0.1059,  0.0069,  0.9737,  0.0064,
         0.8320,  0.7945,  0.0346,  0.6543,  0.3204,  0.0065,  0.0414,
         0.1221,  0.0285,  0.9999,  0.2760,  0.9004,  0.9903,  0.8951,
         0.0127,  0.9388,  0.2146,  0.0285,  0.0155,  0.0003,  0.8880,
         0.0230,  0.0854,  0.9787,  0.2235,  0.2458,  0.9849,  0.0254,
         0.0007,  0.9112,  0.0178,  0.9816,  0.0588,  0.9126,  0.8992,
         0.0348,  0.9629,  0.9780,  0.9075,  0.3460,  0.6716,  0.9234,
         0.0223,  0.3702,  0.9964,  0.0992,  0.8700,  0.8885,  0.0411,
         0.7980,  0.0036,  0.7916,  0.0057,  0.8191,  0.2386,  0.3814,
         0.0699,  0.7836,  0.1071,  0.9254,  0.5878,  0.0246,  0.0785,
         0.1318,  0.6997,  0.7260,  0.3638,  0.0099,  0.9759,  0.9928,
         0.9039,  0.7876,  0.9942,  0.0112,  0.1729,  0.0060,  0.0001,
         0.9953,  0.9943,  0.9328,  0.0684,  0.1277,  0.6558,  0.0321,
         0.0019,  0.3622,  0.0861,  0.6587,  0.0190,  0.7676,  0.7912,
         0.0909,  0.0467,  0.6278,  0.9184,  0.0028,  0.3276,  0.0021,
         0.8578,  0.0137,  0.1900,  0.2127,  0.7463,  0.7761,  0.6664,
         0.1342,  0.0328,  0.2201,  0.8746,  0.0069,  0.0011,  0.9544,
         0.0217,  0.0102,  0.2493,  0.1408,  0.5876,  0.0507,  0.9678,
         0.9863,  0.0680,  0.5740,  0.8589,  0.7556,  0.0143,  0.9978,
         0.0835,  0.9881,  0.3459,  0.9847,  0.8756,  0.7082,  0.9995,
         0.9983,  0.3531,  0.4273,  0.9494,  0.9585,  0.6996,  0.0388,
         0.0187,  0.7288,  0.9005,  0.0031,  0.0017,  0.1661,  0.9480,
         0.0299,  0.0090,  0.0020,  0.1709,  0.9036,  0.9739,  0.0023,
         0.2489,  0.8978,  0.6735,  0.0350,  0.0427,  0.0011,  0.9453,
         0.0152,  0.2250,  0.4341,  0.0821,  0.0110,  0.9510,  0.1188,
         0.5802,  0.0759,  0.7913,  0.6316,  0.9848,  0.0066,  0.0019,
         0.0035,  0.7167,  0.0616,  0.1473,  0.1742,  0.2804,  0.9663,
         0.3203,  0.0087,  0.9820,  0.1374,  0.8865,  0.0412,  0.9077,
         0.0080,  0.0220,  0.9210,  0.0425,  0.2783,  0.0160,  0.0051,
         0.0645,  0.8989,  0.7786,  0.9651,  0.1492,  0.8825,  0.9580,
         0.9156,  0.6828,  0.0468,  0.7203,  0.8549,  0.0104,  0.9971,
         0.9045,  0.0027,  0.8847,  0.0035,  0.6236,  0.9817,  0.2517,
         0.0210,  0.9776,  0.9601,  0.3012,  0.0258,  0.0280,  0.1869,
         0.3921,  0.7048,  0.1788,  0.9976,  0.0450,  0.0005,  0.4473,
         0.0055,  0.8304,  0.7910,  0.2535,  0.4087,  0.4891,  0.9467,
         0.9997,  0.0257,  0.9124,  0.0552,  0.0077,  0.0767,  0.0482,
         0.0066,  0.0070,  0.0463,  0.9821,  0.9225,  0.0212,  0.0053,
         0.0151,  0.2379,  0.9346,  0.0228,  0.0048,  0.0127,  0.9253,
         0.0059,  0.2171,  0.5074,  0.0196,  0.0109,  0.0163,  0.1644,
         0.7546,  0.0015,  0.8888,  0.0107,  0.3315,  0.0320,  0.0063,
         0.8224,  0.9969,  0.7420,  0.6657,  0.0120,  0.0042,  0.0047,
         0.8815,  0.9853,  0.0334,  0.9201,  0.0134,  0.5390,  0.0089,
         0.3022,  0.0071,  0.1322,  0.9147,  0.0268,  0.7292,  0.0184,
         0.1040,  0.9997,  0.0887,  0.9300,  0.0025,  0.8604,  0.1837,
         0.3145,  0.9795,  0.8234,  0.9610,  0.0573,  0.0012,  0.0449,
         0.9435,  0.0097,  0.4247,  0.8950,  0.2088,  0.7483,  0.6267,
         0.1057], device='cuda:0')
tensor(0.2360, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9087,  0.0469,  0.9967,  0.8899,  0.0065,  0.7857,  0.9279,
         0.6741,  0.9991,  0.0019,  0.8547,  0.0011,  0.4294,  0.8429,
         0.0157,  0.9243,  0.7998,  0.0860,  0.0244,  0.8113,  0.0070,
         0.9681,  0.7714,  0.0187,  0.5255,  0.1052,  0.0032,  0.9687,
         0.0684,  0.3840,  0.1336,  0.9904,  0.0036,  0.9784,  0.9951,
         0.1817,  0.0103,  0.9995,  0.0045,  0.0056,  0.0025,  0.1389,
         0.9601,  0.0305,  0.0001,  0.9998,  0.9486,  0.7720,  0.9605,
         0.9404,  0.4817,  0.0716,  0.4755,  0.1063,  0.0389,  0.6255,
         0.9039,  0.0635,  0.0701,  0.0166,  0.9247,  0.0322,  0.6302,
         0.7133,  0.0142,  0.0060,  0.9327,  0.0032,  0.0053,  0.9698,
         0.9902,  0.9171,  0.9272,  0.9768,  0.1272,  0.0145,  0.0059,
         0.0042,  0.3909,  0.0061,  0.9946,  0.0089,  0.9024,  0.0200,
         0.0017,  0.0544,  0.0032,  0.7069,  0.0027,  0.9555,  0.2568,
         0.0264,  0.9430,  0.7361,  0.8811,  0.0325,  0.0241,  0.0215,
         0.0079,  0.8867,  0.0073,  0.0612,  0.2546,  0.0020,  0.9886,
         0.1171,  0.0700,  0.0152,  0.6495,  0.8495,  0.1115,  0.1231,
         0.0208,  0.0013,  0.1598,  0.7944,  0.9737,  0.0558,  0.7437,
         0.2147,  0.7586,  0.9931,  0.9882,  0.0159,  0.0180,  0.0851,
         0.4235,  0.0007,  0.0107,  0.0105,  0.0459,  0.8987,  0.0305,
         0.7628,  0.9414,  0.8603,  0.1347,  0.0068,  0.9129,  0.6993,
         0.4671,  0.8943,  0.7071,  0.0132,  0.8209,  0.0976,  0.8440,
         0.9950,  0.9322,  0.9833,  0.5274,  0.4304,  0.1973,  0.6458,
         0.0147,  0.0162,  0.2138,  0.1451,  0.0186,  0.0765,  0.1307,
         0.5136,  0.9844,  0.0222,  0.0013,  0.9700,  0.7249,  0.1051,
         0.9226,  0.1816,  0.0049,  0.3320,  0.0636,  0.9011,  0.6292,
         0.9401,  0.2343,  0.0026,  0.6232,  0.0368,  0.3106,  0.4339,
         0.0002,  0.9745,  0.5900,  0.4115,  0.8513,  0.0014,  0.1113,
         0.9913,  0.0293,  0.0094,  0.4237,  0.0528,  0.0556,  0.0248,
         0.0265,  0.6926,  0.0344,  0.0150,  0.0121,  0.9989,  0.0565,
         0.1459,  0.2288,  0.1954,  0.3558,  0.0318,  0.7417,  0.9187,
         0.2912,  0.0234,  0.0132,  0.9839,  0.8602,  0.6123,  0.0049,
         0.8696,  0.7874,  0.3670,  0.0097,  0.0008,  0.8707,  0.0185,
         0.4297,  0.2375,  0.4318,  0.0232,  0.1978,  0.0050,  0.8392,
         0.5411,  0.9820,  0.8724,  0.0059,  0.0954,  0.6625,  0.9935,
         0.9788,  0.9612,  0.0113,  0.2172,  0.6637,  0.9442,  0.0967,
         0.0089,  0.0081,  0.0148,  1.0000,  0.0342,  0.0068,  0.8785,
         0.2985,  0.8296,  0.0040,  0.1388,  0.0700,  0.7953,  0.0104,
         0.1556,  0.9086,  0.0405,  0.8798,  0.9202,  0.0006,  0.9639,
         0.0229,  0.0437,  0.3488,  0.0014,  0.9629,  0.9235,  0.7535,
         0.4034,  0.0204,  0.9849,  0.1289,  0.5578,  0.0479,  0.0023,
         0.0199,  0.9864,  0.9209,  0.8834,  0.7011,  0.0415,  0.8283,
         0.9294,  0.3495,  0.7986,  0.0108,  0.0381,  0.0389,  0.0808,
         0.9699,  0.0025,  0.0043,  0.5658,  0.5769,  0.0074,  0.9532,
         0.0184,  0.0935,  0.0091,  0.0176,  0.6389,  0.0310,  0.9655,
         0.0083,  0.0680,  0.0109,  0.5212,  0.7159,  0.0189,  0.1274,
         0.7232,  0.0136,  0.0244,  0.9470,  0.1078,  0.8050,  0.0128,
         0.0077,  0.9735,  0.0175,  0.0269,  0.9371,  0.9198,  0.0004,
         0.8673,  0.0006,  0.9892,  0.0062,  0.0230,  0.0701,  0.3197,
         0.6997,  0.8909,  0.8794,  0.0822,  0.7510,  0.0484,  0.9222,
         0.9431,  0.0185,  0.9933,  0.8554,  0.6544,  0.0281,  0.0184,
         0.0190,  0.0349,  0.9578,  0.0469,  0.3988,  0.0413,  0.0159,
         0.3492,  0.9871,  0.6149,  0.1759,  0.0010,  0.0748,  0.0497,
         0.8828,  0.0008,  0.0039,  0.9030,  0.0066,  0.5452,  0.9427,
         0.0452,  0.2443,  0.4094,  0.9961,  0.0023,  0.6299,  0.9561,
         0.0079,  0.0110,  0.0042,  0.9388,  0.7516,  0.0006,  0.0015,
         0.9001,  0.1257,  0.0082,  0.1574,  0.0016,  0.2814,  0.7861,
         0.9884,  0.0020,  0.1064,  0.3197,  0.9813,  0.7636,  0.0190,
         0.0050,  0.9785,  0.0035,  0.6942,  0.0367,  0.9870,  0.9870,
         0.6908,  0.9828,  0.4816,  0.9843,  0.0106,  0.0051,  0.0240,
         0.0105,  0.8223,  0.6568,  0.6016,  0.0026,  0.8128,  0.0052,
         0.9790,  0.8657,  0.0024,  0.0008,  0.9921,  0.0026,  0.9703,
         0.0326,  0.0832,  0.3249,  0.9335,  0.9438,  0.9898,  0.0725,
         0.9716,  0.6241,  0.0608,  0.9970,  0.8132,  0.0651,  0.9104,
         0.0121,  0.0170,  0.0061,  0.0073,  0.0311,  0.9312,  0.7237,
         0.9189,  0.5521,  0.9804,  0.5979,  0.9054,  0.7170,  0.8740,
         0.5661,  0.0845,  0.6000,  0.0141,  0.0065,  0.9843,  0.9754,
         0.5454,  0.5909,  0.9413,  0.1053,  0.9979,  0.2469,  0.9238,
         0.0211,  0.8263,  0.2405,  0.0025,  0.0220,  0.0037,  0.0070,
         0.9319,  0.9992,  0.0025,  0.9895,  0.0640,  0.9768,  0.4362,
         0.9913,  0.0114,  0.0172,  0.0123,  0.6652,  0.0077,  0.0425,
         0.9999,  0.0848,  0.9543,  0.0066,  0.0072,  0.8964,  0.0660,
         0.1923,  0.9272,  0.0399,  0.9069,  0.8873,  0.0296,  0.9722,
         0.7058,  0.9564,  0.0162,  0.9362,  0.0152,  0.9319,  0.7960,
         0.6927], device='cuda:0')
tensor(0.2734, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.3001,  0.9538,  0.9692,  0.0080,  0.0123,  0.0869,  0.0046,
         0.9916,  0.0354,  0.0264,  0.9634,  0.9719,  0.9965,  0.9389,
         0.0045,  0.9852,  0.9250,  0.0226,  0.5298,  0.0822,  0.4774,
         0.8325,  0.0053,  0.0392,  0.0039,  0.9930,  0.5621,  0.2569,
         0.8927,  0.5170,  0.6895,  0.6146,  0.9993,  0.0008,  0.5384,
         0.9963,  0.0007,  0.9397,  0.0279,  0.8890,  0.0670,  0.0455,
         0.0049,  0.8550,  0.0503,  0.0242,  0.0191,  0.0080,  0.0165,
         0.0584,  0.0013,  0.0371,  0.0726,  0.3143,  0.8777,  0.7179,
         0.8527,  0.7893,  0.9652,  0.7192,  0.9345,  0.8083,  0.2742,
         0.8648,  0.0560,  0.8966,  0.0026,  0.0862,  0.5460,  0.9976,
         0.1088,  0.0913,  0.1842,  0.0026,  0.0437,  0.7443,  0.9164,
         0.0060,  0.0191,  0.9623,  0.8232,  0.5606,  0.9899,  0.3331,
         0.0921,  0.9567,  0.0247,  0.2947,  0.0051,  0.9785,  0.0025,
         0.9470,  0.8915,  0.0044,  0.1222,  0.0024,  0.1038,  0.3120,
         0.8505,  0.9587,  0.9670,  0.0215,  0.0066,  0.6844,  0.0238,
         0.9886,  0.0131,  0.9724,  0.0188,  0.0297,  0.9718,  0.2883,
         0.0680,  0.8116,  0.0061,  0.9133,  0.0026,  0.5313,  0.9763,
         0.9880,  0.7084,  0.9022,  0.0054,  0.8763,  0.9067,  0.0023,
         0.6381,  0.9181,  0.9829,  0.9361,  0.2966,  0.0259,  0.0314,
         0.9834,  0.8992,  0.4496,  0.9811,  0.0119,  0.1391,  0.5222,
         0.0098,  0.5941,  0.8111,  0.0004,  0.9842,  0.0153,  0.8490,
         0.0651,  0.1083,  0.0300,  0.0456,  0.0007,  0.0072,  0.0263,
         0.7786,  0.9673,  0.7451,  0.1806,  0.8531,  0.8952,  0.0337,
         0.0501,  0.4710,  0.4025,  0.5688,  0.7565,  0.1036,  0.1245,
         0.0752,  0.0056,  0.1347,  0.0005,  0.9120,  0.8068,  0.0341,
         0.2919,  0.1921,  0.7925,  0.1132,  0.0014,  0.0221,  0.0447,
         0.0004,  0.0018,  0.0029,  0.0064,  0.0092,  0.0212,  0.6865,
         0.0045,  0.5024,  0.3875,  0.0084,  0.9472,  0.9425,  0.8673,
         0.0238,  0.0026,  0.1508,  0.0211,  0.0185,  0.7155,  0.9745,
         0.0230,  0.0185,  0.9844,  0.0073,  0.6017,  0.0115,  0.0056,
         0.0345,  0.0218,  0.0555,  0.0424,  0.0273,  0.0082,  0.7795,
         0.2631,  0.9732,  0.0304,  0.0173,  0.0482,  0.7892,  0.9708,
         0.3348,  0.9810,  0.0447,  0.9594,  0.0363,  0.7195,  0.8306,
         0.9109,  0.0114,  0.9739,  0.0625,  0.0246,  0.0325,  0.0249,
         0.0169,  0.0399,  0.0236,  0.0760,  0.2252,  0.1143,  0.9095,
         0.0040,  0.0078,  0.5110,  0.0019,  0.0129,  0.8223,  0.9407,
         0.9589,  0.9563,  0.9784,  0.0968,  0.8949,  0.0047,  0.5088,
         0.0226,  0.0026,  0.8849,  0.8742,  0.0245,  0.9582,  0.8407,
         0.0013,  0.3055,  0.0267,  0.0011,  0.0336,  0.8943,  0.0080,
         0.0162,  0.8620,  0.0130,  0.0029,  0.1126,  0.0917,  0.0702,
         0.2299,  0.0226,  0.9312,  0.0230,  0.9760,  0.0345,  0.0299,
         0.9452,  0.3765,  0.3535,  0.0045,  0.1530,  0.7788,  0.9564,
         0.8859,  0.0029,  0.2603,  0.7543,  0.8915,  0.0066,  0.1377,
         0.0533,  0.1239,  0.0230,  0.1514,  0.0155,  0.0145,  0.0034,
         0.9358,  0.0537,  0.0373,  0.2749,  0.0054,  0.3478,  0.0333,
         0.0019,  0.0013,  0.3886,  0.0565,  0.0073,  0.9770,  0.6183,
         0.0701,  0.9487,  0.0664,  0.2215,  0.0730,  0.9794,  0.0014,
         0.0283,  0.0073,  0.0066,  0.7764,  0.9856,  0.5908,  0.9615,
         0.0125,  0.0108,  0.8793,  0.0065,  0.2290,  0.7721,  0.1099,
         0.0425,  0.4446,  0.5082,  0.0292,  0.7947,  0.0238,  0.0036,
         0.2939,  0.5543,  0.9421,  0.9741,  0.9808,  0.6222,  0.9449,
         0.0114,  0.9565,  0.9996,  0.0414,  0.5909,  0.0002,  0.0675,
         0.0803,  0.0008,  0.0047,  0.9266,  0.9846,  0.4914,  0.9081,
         0.8517,  0.7428,  0.0153,  0.8369,  0.9279,  0.2634,  0.9991,
         0.0038,  0.0185,  0.9389,  0.9635,  0.9125,  0.9282,  0.0008,
         0.0022,  0.0941,  0.7464,  0.0302,  0.9105,  0.0381,  0.9848,
         0.0692,  0.0068,  0.0095,  0.9851,  0.9125,  0.3419,  0.9563,
         0.0084,  0.8931,  0.0042,  0.0329,  0.4673,  0.2937,  0.8689,
         0.6744,  0.7267,  0.0420,  0.3653,  0.1983,  0.9276,  0.9547,
         0.9000,  0.8925,  0.3701,  0.7817,  0.9951,  0.0146,  0.9983,
         0.0085,  0.0270,  0.7965,  0.5285,  0.1461,  0.9407,  0.9091,
         0.0031,  0.0123,  0.8932,  0.4080,  0.0151,  0.0034,  0.5128,
         0.0518,  0.0395,  0.0052,  0.9789,  0.0468,  0.9059,  0.0009,
         0.0650,  0.0259,  0.0179,  0.5691,  0.9930,  0.8707,  0.6942,
         0.9564,  0.1390,  0.7834,  0.1366,  0.0289,  0.0009,  0.2129,
         0.0156,  0.0349,  0.8881,  0.0358,  0.3557,  0.8837,  0.0862,
         0.0261,  0.9107,  0.0079,  0.0142,  0.9784,  0.5761,  0.0147,
         0.0722,  0.0830,  0.9845,  0.0059,  0.0197,  0.2930,  0.0016,
         0.5034,  0.8500,  0.0012,  0.1067,  0.0072,  0.0025,  0.1381,
         0.0451,  0.0190,  0.0104,  0.7782,  0.0317,  0.0916,  0.0017,
         0.0120,  0.6327,  0.7314,  0.9220,  0.9877,  0.1872,  0.9404,
         0.9825,  0.9464,  0.0143,  1.0000,  0.0239,  0.0380,  0.9964,
         0.0488,  0.6660,  0.0013,  0.9195,  0.3042,  0.4096,  0.0699,
         0.0197], device='cuda:0')
tensor(0.3518, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9805,  0.4454,  0.0443,  0.9283,  0.0003,  0.8120,  0.9672,
         0.1286,  0.1130,  0.0236,  0.0949,  0.3346,  0.6313,  0.0136,
         0.4037,  0.8774,  0.0398,  0.0543,  0.9594,  0.2404,  0.9612,
         0.0814,  0.0235,  0.8934,  0.0081,  0.8186,  0.0213,  0.0636,
         0.9715,  0.8810,  0.5147,  0.0072,  0.4600,  0.4875,  0.8530,
         0.6453,  0.0240,  0.3955,  0.0183,  0.1928,  0.8738,  0.7471,
         0.4501,  0.9800,  0.0255,  0.0315,  0.8586,  0.0296,  0.0314,
         0.0329,  0.0092,  0.4836,  0.7386,  0.0424,  0.7011,  0.9196,
         0.9452,  0.6592,  0.0594,  0.2550,  0.0060,  0.9679,  0.0298,
         0.9934,  0.0273,  0.8264,  0.0060,  0.9771,  0.4390,  0.9481,
         0.3849,  0.3760,  0.0175,  0.0024,  0.8752,  0.2047,  0.0042,
         0.9963,  0.0211,  0.7111,  0.7998,  0.9684,  0.8560,  0.2179,
         0.3272,  0.9844,  0.9796,  0.9417,  0.0005,  0.2437,  0.9955,
         0.9803,  0.7215,  0.0542,  0.0842,  0.9039,  0.9743,  0.6257,
         0.9944,  0.8787,  0.0307,  0.6143,  0.7908,  0.0588,  0.7096,
         0.0047,  0.4594,  0.0045,  0.0375,  0.5175,  0.0076,  0.9656,
         0.3241,  0.0710,  0.0022,  0.8925,  0.8913,  0.0162,  0.9151,
         0.8608,  0.8864,  0.8686,  0.9659,  0.0343,  0.0182,  0.9774,
         0.0038,  0.2938,  0.8856,  0.8818,  0.0052,  0.8341,  0.7868,
         0.0414,  0.7884,  0.3802,  0.0199,  0.0138,  0.0061,  0.9653,
         0.9370,  0.0242,  0.0115,  0.8964,  0.0338,  0.0193,  0.0367,
         0.0127,  0.0251,  0.0044,  0.9737,  0.0234,  0.0070,  0.1947,
         0.9996,  0.0154,  0.0606,  0.0061,  0.0065,  0.5482,  0.2451,
         0.0813,  0.0008,  0.8148,  0.1238,  0.7827,  0.0475,  0.9810,
         0.0392,  0.0575,  0.9896,  0.0109,  0.0070,  0.0058,  0.7494,
         0.0046,  0.0140,  0.1195,  0.9474,  0.9730,  0.0806,  0.8715,
         0.9875,  0.1396,  0.1490,  0.8937,  0.7005,  0.0875,  0.4017,
         0.7559,  0.9574,  0.9901,  0.7843,  0.6059,  0.8578,  0.0032,
         0.1599,  0.9617,  0.6013,  0.0120,  0.0234,  0.9080,  0.9982,
         0.1033,  0.9254,  0.2354,  0.9335,  0.0533,  0.8666,  0.9975,
         0.0072,  0.6408,  0.1010,  0.9582,  0.7113,  0.9742,  0.7045,
         0.0067,  0.0768,  0.1520,  0.4626,  0.8982,  0.0031,  0.0157,
         0.2737,  0.9209,  0.0248,  0.3089,  0.0824,  1.0000,  0.0022,
         0.0681,  0.7210,  0.9999,  0.0335,  0.3972,  0.0209,  0.0494,
         0.6480,  0.1863,  0.0103,  0.9994,  0.0279,  0.0185,  0.6382,
         0.1456,  0.3506,  0.0922,  0.7382,  0.8615,  0.1126,  0.0284,
         0.5188,  0.0797,  0.9989,  0.9682,  0.1156,  0.9592,  0.2469,
         0.0581,  0.8065,  0.9983,  0.8772,  0.5131,  0.9208,  0.0009,
         0.8747,  0.3193,  0.0084,  0.1333,  0.0738,  0.7974,  0.9585,
         0.0044,  0.9591,  0.3646,  0.0175,  0.5710,  0.0939,  0.9412,
         0.6564,  0.0340,  0.9704,  0.3454,  0.9858,  0.9522,  0.3369,
         0.8339,  0.0389,  0.9333,  0.3440,  0.3950,  0.0425,  0.1073,
         0.9899,  0.1281,  0.1227,  0.1984,  0.9679,  0.6886,  0.9719,
         0.0305,  0.0085,  0.9919,  0.0173,  0.2623,  0.1356,  0.1747,
         0.9796,  0.0686,  0.0626,  0.0059,  0.0044,  0.7406,  0.7043,
         0.9096,  0.1568,  0.9998,  0.9602,  0.8340,  0.0172,  0.0384,
         0.6960,  0.9545,  0.0038,  0.6490,  0.3165,  0.7469,  0.9677,
         0.0100,  0.9893,  0.0225,  0.0888,  0.8406,  0.2480,  0.0055,
         0.8380,  0.9694,  0.0137,  0.9230,  0.0014,  0.8015,  0.6408,
         0.0163,  0.3919,  0.9553,  0.9968,  0.0590,  0.9809,  0.5348,
         0.1331,  0.0855,  0.1586,  0.5979,  0.0243,  0.0146,  0.0678,
         0.8372,  0.9084,  0.0113,  0.1352,  0.0035,  0.0364,  0.0475,
         0.0028,  0.9350,  0.9770,  0.0316,  0.9950,  0.0740,  0.6849,
         0.2465,  0.0356,  0.6729,  0.0010,  0.0968,  0.0353,  0.0155,
         0.5029,  0.0013,  0.9066,  0.9983,  0.8019,  0.0255,  0.9949,
         0.9974,  0.9154,  0.0046,  0.5094,  0.9098,  0.9057,  0.5890,
         0.0181,  0.0012,  0.9780,  0.9643,  0.9984,  0.9444,  0.0063,
         0.5365,  0.2745,  0.2062,  0.7801,  0.8923,  0.9257,  0.8447,
         0.9486,  0.2394,  0.7727,  0.9040,  0.0810,  0.8754,  0.9310,
         0.9991,  0.9406,  0.1065,  0.9995,  0.6234,  0.9948,  0.0492,
         0.8754,  0.7964,  0.1249,  0.6609,  0.9323,  0.9307,  0.9106,
         0.9534,  0.0069,  0.0054,  0.0040,  0.5834,  0.0662,  0.0006,
         0.8755,  0.9742,  0.0071,  0.8970,  0.9597,  0.4042,  0.8998,
         0.1446,  0.8820,  0.6942,  0.9497,  0.0043,  0.7214,  0.9340,
         0.3118,  0.0055,  0.9332,  0.8739,  0.0019,  0.0198,  0.0139,
         0.9261,  0.8981,  0.0462,  0.0011,  0.3240,  0.0280,  0.9190,
         0.9849,  0.9717,  0.0954,  0.8148,  0.0120,  0.0076,  0.9268,
         0.9544,  0.8962,  0.7964,  0.0043,  0.0410,  0.0116,  0.7194,
         0.3899,  0.1891,  0.2676,  0.5854,  0.0036,  0.1879,  0.9774,
         0.9003,  0.7970,  0.8255,  0.0784,  0.9488,  0.0590,  0.0202,
         0.9255,  0.8494,  0.0087,  0.9996,  0.9085,  0.9710,  0.6576,
         0.0277,  0.1003,  0.0109,  0.0278,  0.0384,  0.0419,  0.9273,
         0.9656,  0.0698,  0.0013,  0.0186,  0.9668,  0.2420,  0.0670,
         0.6234], device='cuda:0')
tensor(0.2503, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.1706,  0.1991,  0.9992,  0.2984,  0.4030,  0.9997,  0.9785,
         0.0015,  0.9251,  0.0409,  0.7942,  0.0058,  0.9982,  0.1601,
         0.9614,  0.0850,  0.0738,  0.1319,  0.7601,  0.1346,  0.9756,
         0.8032,  0.9809,  0.0229,  0.8946,  0.0027,  0.3920,  0.0286,
         0.1769,  0.6922,  0.0341,  0.2027,  0.6154,  0.9913,  0.0014,
         0.0317,  0.0920,  0.6767,  0.8928,  0.8163,  0.6837,  0.2028,
         0.5520,  0.4420,  0.7983,  0.0591,  0.0121,  0.0246,  0.1157,
         0.9273,  0.0506,  0.1343,  0.8928,  0.0415,  0.0173,  0.8373,
         0.1030,  0.7546,  0.0457,  0.8488,  0.1648,  0.8898,  0.9881,
         0.8459,  0.0350,  0.8237,  0.0895,  0.0961,  0.9312,  0.3264,
         0.0149,  0.2628,  0.9794,  0.0223,  0.9415,  0.9552,  0.0858,
         0.1016,  0.2754,  0.8803,  0.7154,  0.1048,  0.9264,  0.0142,
         0.2265,  0.5281,  0.0071,  0.8607,  0.9284,  0.9766,  0.9221,
         0.7988,  0.9134,  0.9999,  0.9990,  0.2782,  0.1098,  0.0630,
         0.1074,  0.9551,  0.0089,  0.0027,  0.9350,  0.0789,  0.0467,
         0.9962,  0.0048,  0.9645,  0.0111,  0.9154,  0.0159,  0.9273,
         0.0648,  0.9594,  0.5670,  0.1011,  0.1188,  0.4084,  0.8794,
         0.9489,  0.0541,  0.5927,  0.9815,  0.5390,  0.9753,  0.0238,
         0.8237,  0.0010,  0.7600,  0.7916,  0.7261,  0.0111,  0.0858,
         0.9701,  0.7733,  0.1717,  0.9894,  0.1120,  0.9677,  0.0248,
         0.1149,  0.0058,  0.8394,  0.9239,  0.2555,  0.5229,  0.1449,
         0.0073,  0.1076,  0.9905,  0.0159,  0.9205,  0.3216,  0.0090,
         0.0207,  0.2855,  0.9981,  0.9797,  0.0870,  0.1517,  0.9805,
         0.9267,  0.6999,  0.9730,  0.9434,  0.0603,  0.9985,  0.0429,
         0.9060,  0.2750,  0.9331,  0.8464,  0.6497,  0.5025,  0.9448,
         0.9248,  0.8477,  0.8990,  0.1433,  0.0453,  0.0033,  0.0905,
         0.7497,  0.8494,  0.9578,  0.8982,  0.9522,  0.9650,  0.9744,
         0.5878,  0.0936,  0.6822,  0.0263,  0.8008,  0.5383,  0.0250,
         0.0065,  0.5001,  0.0030,  0.1551,  0.9883,  0.5156,  0.4942,
         0.9899,  0.0680,  0.0658,  0.6008,  0.7479,  0.3570,  0.0321,
         0.9294,  0.2995,  0.9152,  0.0074,  0.0701,  0.9827,  0.8948,
         0.8679,  0.7305,  0.9051,  0.0223,  0.1022,  0.0208,  0.8455,
         0.9102,  0.8830,  0.0896,  0.9824,  0.9997,  0.9828,  0.9455,
         0.0899,  0.7246,  0.5459,  0.0809,  0.9272,  0.1776,  0.8129,
         0.4455,  0.9598,  0.2478,  0.8873,  0.9516,  0.4174,  0.8965,
         0.7678,  0.9707,  0.7131,  0.8387,  0.1573,  0.9964,  0.2449,
         0.0018,  0.4196,  0.0290,  0.9851,  0.1235,  0.8699,  0.0073,
         0.9675,  0.2984,  0.0467,  0.9279,  0.7997,  0.0592,  0.0282,
         0.9704,  0.0103,  0.9691,  0.4323,  0.1462,  0.1248,  0.0557,
         0.4730,  0.9871,  0.7732,  0.9095,  0.0267,  0.0806,  0.0793,
         0.5940,  0.9994,  0.6939,  0.9576,  0.9078,  0.9281,  0.0748,
         0.1082,  0.0534,  0.4524,  0.0049,  0.0235,  0.0690,  0.4729,
         0.8419,  0.9365,  0.9494,  0.1624,  0.9763,  0.5618,  0.9831,
         0.0154,  0.0569,  0.1876,  0.0404,  0.0053,  0.9362,  0.0338,
         0.9998,  0.6465,  0.7004,  0.9995,  0.9358,  0.2261,  0.0743,
         0.9079,  0.4091,  0.7118,  0.9911,  0.8068,  0.2235,  0.9345,
         0.0456,  0.9881,  0.9172,  0.1093,  0.5301,  0.0617,  0.2907,
         0.9931,  0.0046,  0.0282,  0.0678,  0.9197,  0.0192,  0.7777,
         0.0017,  0.0411,  0.6756,  0.0894,  0.8317,  0.1207,  0.9997,
         0.0177,  0.9997,  0.9675,  0.4873,  0.0197,  0.0393,  0.4990,
         0.0280,  0.2965,  0.0250,  0.0222,  0.8213,  0.1331,  0.9320,
         0.8278,  0.7340,  0.4171,  0.2160,  0.7420,  0.0277,  0.5128,
         0.8110,  0.0294,  0.6228,  0.8963,  0.0045,  0.1580,  0.0500,
         0.0604,  0.0878,  0.0145,  0.9913,  0.0719,  0.2487,  0.6258,
         0.9961,  0.7288,  0.0313,  0.1896,  0.9923,  0.5530,  0.0346,
         0.8405,  0.0723,  0.0191,  0.8084,  0.1451,  0.6092,  0.8196,
         0.7579,  0.7607,  0.9315,  0.0010,  0.3223,  0.0276,  0.9824,
         0.0691,  0.9590,  0.1973,  0.9294,  0.0343,  0.0112,  0.8750,
         0.0125,  0.5411,  0.0121,  0.0979,  0.6603,  0.9534,  0.9982,
         0.9514,  0.1528,  0.8136,  0.1101,  0.9736,  0.0100,  0.0256,
         0.9510,  0.8143,  0.0024,  0.9877,  0.8925,  0.0699,  0.9975,
         0.1688,  0.0688,  0.9704,  0.9790,  0.0742,  0.0213,  0.8931,
         0.7738,  0.5840,  0.9518,  0.0386,  0.6388,  0.2724,  0.2956,
         0.8455,  0.9270,  0.7793,  0.2129,  0.0119,  0.3498,  0.0190,
         0.0356,  0.9559,  0.3741,  0.9522,  0.0411,  0.9746,  0.1260,
         0.8855,  0.9406,  0.9471,  0.9954,  0.2748,  0.0024,  0.9610,
         0.0252,  0.8793,  0.6870,  0.6680,  0.3107,  0.8896,  0.9412,
         0.6325,  0.0026,  0.9896,  0.0040,  0.0598,  0.7874,  0.1597,
         0.0042,  0.9715,  0.7242,  0.1369,  0.9945,  0.8359,  0.1009,
         0.9566,  0.1519,  0.8971,  0.9618,  0.0015,  0.4361,  0.9914,
         0.9761,  0.9978,  0.8611,  0.0545,  0.8894,  0.9091,  0.9898,
         0.1458,  0.0278,  0.0563,  0.5871,  0.2319,  0.9209,  0.8792,
         0.9956,  0.7829,  0.9217,  0.9683,  0.9598,  0.0643,  0.9760,
         0.6958], device='cuda:0')
tensor(0.2349, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.6492,  0.7359,  0.8639,  0.9927,  0.9394,  0.9182,  0.9991,
         0.1714,  0.9816,  0.9961,  0.9674,  0.8879,  0.3234,  0.9671,
         0.2930,  0.1183,  0.1479,  1.0000,  0.0370,  0.0464,  0.0006,
         0.3670,  0.0246,  0.1212,  0.4947,  0.1835,  0.6610,  0.7446,
         0.9874,  0.7804,  0.1161,  0.2359,  0.9336,  0.8559,  0.9763,
         0.9802,  0.3760,  0.0871,  0.0377,  0.1222,  0.9701,  0.0082,
         0.9511,  0.0539,  0.1254,  0.2610,  0.8954,  0.5928,  0.9995,
         0.2876,  0.9989,  0.9866,  0.0297,  0.1546,  0.0346,  0.9285,
         0.9733,  0.9808,  0.0799,  0.8886,  0.0217,  0.9333,  0.0077,
         0.9964,  0.7412,  0.7406,  0.0214,  0.9497,  0.9582,  0.2582,
         0.9815,  0.9999,  0.9915,  0.0861,  0.9545,  0.9207,  0.0558,
         0.0520,  0.8618,  0.9514,  0.9635,  0.3508,  0.9340,  0.9762,
         0.8372,  0.0363,  0.9837,  0.0194,  0.1901,  0.0583,  0.2872,
         0.0084,  0.9838,  0.0734,  0.9980,  0.3428,  0.9797,  0.7759,
         0.9304,  0.4715,  0.8808,  0.0356,  0.9096,  0.0174,  0.9128,
         0.9639,  0.8302,  0.8915,  0.5333,  0.8240,  0.2818,  0.9879,
         0.1967,  0.0545,  0.9702,  0.9599,  0.4120,  0.2147,  0.9710,
         0.0278,  0.9359,  0.2209,  0.9783,  0.0066,  0.0444,  0.9247,
         0.4167,  0.9190,  0.1112,  0.3754,  0.9986,  0.1136,  0.1576,
         0.7265,  0.9700,  0.1863,  0.9016,  0.9793,  0.9802,  0.9656,
         0.8826,  0.9169,  0.0249,  0.0736,  0.0134,  0.0963,  0.9437,
         0.9199,  0.7634,  0.0428,  0.9980,  0.9990,  0.9994,  0.9529,
         0.0666,  0.9808,  0.9889,  0.7111,  0.7439,  0.8729,  0.9619,
         0.8205,  0.1369,  0.9670,  0.0120,  0.3984,  0.2118,  0.0030,
         0.4614,  0.1902,  0.5679,  0.9805,  0.1472,  0.9784,  0.0348,
         0.0276,  0.0431,  0.9878,  0.1781,  0.9404,  0.9845,  0.1267,
         0.8657,  0.9841,  0.2855,  0.8873,  0.0593,  0.9131,  0.9680,
         0.1703,  0.0320,  0.9510,  0.0550,  0.6341,  0.9369,  0.9731,
         0.0447,  0.9660,  0.4036,  0.0098,  0.0556,  0.0428,  0.6760,
         0.8690,  0.9690,  0.9995,  0.6999,  0.3746,  0.8578,  0.0535,
         0.0180,  0.9993,  0.0445,  0.9284,  0.8246,  0.0035,  0.4783,
         0.8687,  0.9965,  0.4785,  0.1239,  0.0993,  0.9528,  0.0500,
         0.9961,  0.9482,  0.9934,  0.7820,  0.0082,  0.9529,  0.3242,
         0.9969,  0.9782,  0.9667,  0.5365,  0.9575,  0.1182,  0.0351,
         0.1850,  0.9848,  0.0383,  0.3498,  0.0043,  0.4571,  0.0890,
         0.9242,  0.0222,  0.0744,  0.9893,  0.9569,  0.1417,  0.0810,
         0.7735,  0.9997,  0.2210,  0.0766,  0.5115,  0.0031,  0.0562,
         0.2202,  0.6482,  0.0084,  0.2888,  0.9094,  0.0751,  0.9969,
         0.0042,  0.9802,  0.9618,  0.4700,  0.2489,  0.7674,  0.8973,
         0.9526,  0.0803,  0.9514,  0.9516,  0.9459,  0.9435,  0.0277,
         0.7228,  0.0012,  0.9668,  0.0262,  0.9282,  0.9744,  0.9962,
         0.0350,  0.9833,  0.0537,  0.6109,  0.0031,  0.9401,  0.1863,
         0.9263,  0.2540,  0.9028,  0.9728,  0.9337,  0.1305,  0.2744,
         0.8454,  0.1942,  0.9442,  0.4562,  0.9989,  0.0032,  0.1387,
         0.0082,  0.9663,  0.9280,  0.1275,  0.4207,  0.8425,  0.9008,
         0.3867,  0.9569,  0.1825,  0.0906,  0.9011,  0.3383,  0.0684,
         0.9837,  0.0291,  0.8401,  0.9613,  0.9885,  0.3446,  0.9756,
         0.9837,  0.9081,  0.2558,  0.1175,  0.9908,  0.0078,  0.2212,
         0.9157,  0.1130,  0.9323,  0.9570,  0.8932,  0.4301,  0.3266,
         0.0214,  0.3361,  0.4751,  0.9819,  0.0554,  0.9721,  0.5644,
         0.5115,  0.6009,  0.9211,  0.9750,  0.0031,  0.9899,  0.3531,
         0.0187,  0.9934,  0.0376,  0.0239,  0.9992,  0.0869,  0.8687,
         0.1073,  0.9684,  0.5660,  0.4736,  0.9621,  0.0485,  0.9736,
         0.8302,  0.0544,  0.6280,  0.0299,  0.9266,  0.0911,  0.5516,
         0.9736,  0.1644,  0.2054,  0.1949,  0.8262,  0.0888,  0.7258,
         0.6730,  0.4258,  0.9715,  0.0032,  0.1744,  0.9682,  0.0058,
         0.9821,  0.9762,  0.8632,  0.9826,  0.5629,  0.1269,  0.9228,
         0.0327,  0.9336,  0.3442,  0.0175,  0.2342,  0.0632,  0.9741,
         0.9988,  0.9188,  0.0319,  0.8414,  0.8169,  0.1528,  0.0030,
         0.9716,  0.8888,  0.8973,  0.1687,  0.9674,  0.3244,  0.9709,
         0.8708,  0.0402,  0.0746,  0.8620,  0.5163,  0.0604,  0.0049,
         0.1296,  0.9377,  0.5659,  0.9417,  0.4856,  0.0378,  0.0837,
         0.9457,  0.9986,  0.9126,  0.0036,  0.0062,  0.7576,  0.0914,
         0.0844,  0.9840,  0.0943,  0.7888,  0.2468,  0.3747,  0.1469,
         0.9779,  0.9134,  0.6946,  0.0133,  0.0011,  0.6954,  0.9454,
         0.5995,  0.0423,  0.9936,  0.8958,  0.0085,  0.9841,  0.0043,
         0.0010,  0.9774,  0.8253,  0.9842,  0.9586,  0.0570,  0.7470,
         0.2538,  0.5629,  0.8178,  0.6717,  0.6142,  0.9811,  0.7049,
         0.2372,  0.9627,  0.9713,  0.8361,  0.9288,  0.9764,  0.9857,
         0.9877,  0.9514,  0.0933,  0.9926,  0.0947,  0.1893,  0.9131,
         0.5314,  0.9826,  0.7143,  0.6608,  0.0681,  0.1091,  0.9026,
         0.9993,  0.8936,  0.7198,  0.9532,  0.4558,  0.7468,  0.9064,
         0.9449,  0.3082,  0.9955,  0.0399,  0.0811,  0.8654,  0.7662,
         0.0533], device='cuda:0')
tensor(0.2627, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.9772,  0.9108,  0.1026,  0.9571,  0.9528,  0.1221,  0.0607,
         0.0146,  0.0766,  0.9368,  0.4091,  0.0264,  0.0332,  0.9572,
         0.9922,  0.9840,  0.9875,  0.1218,  0.7380,  0.7607,  0.4318,
         0.0513,  0.8128,  0.9699,  0.0729,  0.0431,  0.9558,  0.1263,
         0.9948,  0.8996,  0.9182,  0.7686,  0.9697,  0.9741,  0.8279,
         0.2498,  0.9410,  0.3004,  0.0295,  0.9798,  0.9684,  0.0814,
         0.9789,  0.0623,  0.9350,  0.0603,  0.1557,  0.9433,  0.5894,
         0.0924,  0.9415,  0.9437,  0.0564,  0.6369,  0.0004,  0.0477,
         0.9903,  0.9310,  0.0439,  0.0044,  0.9787,  0.9902,  0.2920,
         0.0774,  0.0910,  0.9657,  0.9307,  0.0325,  0.9511,  0.0661,
         0.8435,  0.9496,  0.5058,  0.0445,  0.9903,  0.1911,  0.6891,
         0.9898,  0.0298,  0.6782,  0.2143,  0.0244,  0.9663,  0.6459,
         0.0110,  0.8484,  0.9855,  0.0955,  0.8159,  0.9885,  0.9870,
         0.9752,  0.9974,  0.9400,  0.9492,  0.0247,  0.9684,  0.0906,
         0.9598,  0.0532,  0.0246,  0.1894,  0.7414,  0.8758,  0.7277,
         0.9854,  0.9575,  0.4563,  0.0478,  0.0092,  0.0551,  0.9952,
         0.0471,  0.9762,  0.9503,  0.9842,  0.6212,  0.0406,  0.6239,
         0.9262,  0.3123,  0.9839,  0.9491,  0.0521,  0.0580,  0.9999,
         0.0610,  0.8730,  0.1642,  0.0022,  0.9988,  0.9653,  0.7604,
         0.3194,  0.8782,  0.9875,  0.9405,  0.1211,  0.1349,  0.3259,
         0.9886,  0.9379,  0.1163,  0.4396,  0.9353,  0.9780,  0.7312,
         0.9774,  0.1606,  0.8895,  0.0396,  0.8264,  0.1713,  0.9738,
         0.9619,  0.9314,  0.0061,  0.9909,  0.9884,  0.0414,  0.5113,
         0.9842,  0.0150,  0.9898,  0.9966,  0.9751,  0.9675,  0.9514,
         0.0470,  0.9670,  0.3009,  0.7121,  0.9942,  0.9970,  0.9297,
         0.2799,  0.2222,  0.0366,  0.8967,  0.9838,  0.9502,  0.3593,
         0.9585,  0.5613,  0.1710,  0.8268,  0.3472,  0.8970,  0.0254,
         0.9563,  0.4828,  0.6900,  0.8141,  0.0123,  0.9889,  0.9723,
         0.0455,  0.0421,  0.3792,  0.9766,  0.8616,  0.9566,  0.8007,
         0.9499,  0.9992,  0.9593,  0.9357,  0.0817,  0.9573,  0.2887,
         0.9228,  0.9756,  0.8543,  0.0325,  0.9902,  0.9266,  0.2726,
         0.0478,  0.9041,  0.9131,  0.9832,  0.2814,  0.9472,  0.0154,
         0.8940,  0.0821,  0.7926,  0.0953,  0.9541,  0.2723,  0.8458,
         0.0161,  0.9604,  0.9998,  0.1504,  0.9968,  0.1318,  0.0211,
         0.9708,  0.3960,  0.9789,  0.9723,  0.9993,  0.9985,  0.4596,
         0.1403,  0.7791,  0.1604,  0.9591,  0.9999,  0.2444,  0.9857,
         0.0159,  0.9746,  0.4026,  0.8264,  0.0261,  0.7967,  0.9573,
         0.9642,  0.8357,  0.5953,  0.0211,  0.9580,  0.0873,  0.0143,
         0.9636,  0.0332,  0.0126,  0.1303,  0.0705,  0.3047,  0.0400,
         0.9888,  0.9231,  0.9679,  0.1258,  0.9134,  0.9859,  0.9941,
         0.9496,  0.7514,  0.0073,  0.7503,  0.9885,  0.9908,  0.8442,
         0.8534,  0.9657,  0.8904,  0.5697,  0.9614,  0.0438,  0.3280,
         0.2436,  0.0879,  0.1874,  0.8257,  0.9111,  0.0861,  0.0396,
         0.9539,  0.3886,  0.5234,  0.0222,  0.9727,  0.6339,  0.9815,
         0.9608,  0.9554,  0.9916,  0.9893,  0.9615,  0.0774,  0.9389,
         0.0012,  0.9844,  0.9298,  0.1056,  0.9666,  0.9849,  0.8130,
         0.0661,  0.0147,  0.9837,  0.4085,  0.0632,  0.9033,  0.0623,
         0.9799,  0.9935,  0.8210,  0.0031,  0.5323,  0.6843,  0.0637,
         0.0002,  0.3634,  0.9458,  0.0861,  0.9952,  0.1194,  0.8338,
         0.8007,  0.9826,  0.9123,  0.0422,  0.0255,  0.9784,  0.2276,
         0.9858,  0.9876,  0.9888,  0.8284,  0.4070,  0.1179,  0.0730,
         0.9701,  0.9961,  0.9681,  0.0054,  0.8492,  0.9917,  0.0008,
         0.0520,  0.9385,  0.9593,  0.0058,  0.6498,  0.9810,  0.8964,
         0.9446,  0.9260,  0.0939,  0.9956,  0.0245,  0.9394,  0.0546,
         0.2951,  0.9172,  0.4372,  0.0118,  0.5573,  0.9545,  0.2617,
         0.9547,  0.9993,  0.0039,  0.2211,  0.0931,  0.1154,  0.0094,
         0.0102,  0.0711,  0.9470,  0.9771,  0.1915,  0.3348,  0.1177,
         0.3368,  0.9931,  0.0982,  0.9588,  0.9112,  0.4763,  0.0194,
         0.8142,  0.9538,  0.9469,  0.7893,  0.9988,  0.0258,  0.1067,
         0.0801,  0.9750,  0.9450,  0.2352,  0.1340,  0.0463,  0.0010,
         0.1855,  0.0331,  0.3546,  0.1016,  0.9685,  0.1626,  0.6640,
         0.0254,  0.0305,  0.1390,  0.0015,  0.7634,  0.2118,  0.9208,
         0.4247,  0.4698,  0.9549,  0.0907,  0.9990,  0.8502,  0.9948,
         0.0262,  0.0188,  0.9601,  0.8138,  0.9266,  0.9371,  0.0262,
         0.9802,  0.2256,  0.9964,  0.0294,  0.0732,  0.9968,  0.9720,
         0.9990,  0.0126,  0.0136,  0.7897,  0.1053,  0.0733,  0.9643,
         0.0160,  0.2318,  0.1105,  0.9014,  0.9618,  0.7971,  0.9820,
         0.8304,  0.0208,  0.0242,  0.9712,  0.9694,  0.0472,  0.7862,
         0.1093,  0.9996,  0.9715,  0.5798,  0.0287,  0.3485,  0.5996,
         0.9410,  0.4026,  0.8635,  0.8385,  0.9757,  0.0827,  0.9920,
         0.9957,  0.9581,  0.0033,  0.9770,  0.3653,  0.5636,  0.9502,
         0.9944,  0.9932,  0.7389,  0.9940,  0.1262,  0.9969,  0.9902,
         0.0791,  0.0257,  0.0352,  0.0467,  0.9652,  0.0030,  0.0041,
         0.9534], device='cuda:0')
tensor(0.3032, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0054,  0.0081,  0.0372,  0.0662,  0.8451,  0.9710,  0.4695,
         0.9875,  0.9580,  0.0561,  0.0324,  0.0948,  0.8303,  0.0028,
         0.9472,  0.4760,  0.0230,  0.9659,  0.2661,  0.9553,  0.0162,
         0.1674,  0.9696,  0.0367,  0.9989,  0.9576,  0.0807,  0.8864,
         0.1007,  0.9310,  0.0978,  0.0808,  0.2830,  0.0182,  0.3101,
         0.9991,  0.9117,  0.8335,  0.0090,  0.9684,  0.9057,  0.0449,
         0.9787,  0.9040,  0.4086,  0.0494,  0.9801,  0.9989,  0.9195,
         0.0108,  0.0049,  0.0098,  0.2462,  0.9023,  0.9664,  0.0176,
         0.8207,  0.9564,  0.0015,  0.9187,  0.0128,  0.9347,  0.9388,
         0.0224,  0.0125,  0.7132,  0.9774,  0.0394,  0.9800,  0.0179,
         0.8218,  0.0025,  0.1784,  0.9966,  0.9773,  0.0571,  0.9518,
         0.9557,  0.5576,  0.9031,  0.9853,  0.9100,  0.9818,  0.8638,
         0.9474,  0.9958,  0.0199,  0.5079,  0.9533,  0.0121,  0.0267,
         0.1192,  0.9629,  0.7978,  0.1594,  0.0836,  0.0515,  0.9490,
         0.9564,  0.1225,  0.0025,  0.0104,  0.6278,  0.0582,  0.0373,
         0.9266,  0.9800,  0.8825,  0.2238,  0.9514,  0.9634,  0.0343,
         0.8309,  0.0421,  0.6297,  0.2349,  0.9372,  0.9723,  0.1168,
         0.2556,  0.9808,  0.8186,  0.9824,  0.9276,  0.0126,  0.3407,
         0.7097,  0.9518,  0.0007,  0.0845,  0.6552,  0.9490,  0.0857,
         0.1817,  0.9867,  0.9948,  0.0589,  0.5640,  0.9853,  0.2807,
         0.0385,  0.0933,  0.6738,  0.7150,  0.8992,  0.0838,  0.0119,
         0.0304,  0.8849,  0.4286,  0.2045,  0.0279,  0.2156,  0.9651,
         0.0051,  0.9960,  0.0107,  0.1174,  0.9994,  0.9128,  0.8982,
         0.2015,  0.9299,  0.9941,  0.8953,  0.8693,  0.0033,  0.0102,
         0.8802,  0.6373,  0.8878,  0.1971,  0.9711,  0.0675,  0.1656,
         0.9625,  0.9918,  0.1143,  0.9582,  0.6665,  0.4456,  0.9918,
         0.9653,  0.9422,  0.0475,  0.1053,  0.0888,  0.9883,  0.9650,
         0.8341,  0.0238,  0.8919,  0.0494,  0.3513,  0.9856,  0.4761,
         0.0706,  0.6676,  0.9451,  0.9988,  0.0581,  0.9973,  0.0086,
         0.0770,  0.7480,  0.8533,  0.9853,  0.0537,  0.1344,  0.0295,
         0.9820,  0.9772,  0.9841,  0.9702,  0.9216,  0.9784,  0.9735,
         0.9251,  0.5978,  0.0054,  0.9641,  0.8700,  0.9837,  0.0244,
         0.9759,  0.9551,  0.9901,  0.9686,  0.9460,  0.9995,  0.9992,
         0.9479,  0.0061,  0.9834,  0.2881,  0.9693,  0.9813,  0.0015,
         0.9860,  0.0758,  0.9993,  0.0553,  0.8817,  0.3683,  0.8354,
         0.8853,  0.0519,  0.5688,  0.5841,  0.0046,  0.4414,  0.0343,
         0.0309,  0.9824,  0.2708,  0.3300,  0.9702,  0.8505,  0.3366,
         0.9814,  0.0038,  0.9616,  0.9488,  0.8870,  0.9498,  0.9709,
         0.8717,  0.9765,  0.9594,  0.0889,  0.9715,  0.9815,  0.8609,
         0.8255,  0.0382,  0.8523,  0.1124,  0.0467,  0.0210,  0.8726,
         0.0759,  0.9625,  0.8976,  0.1072,  0.0041,  0.9694,  0.0428,
         0.0026,  0.0186,  0.1577,  0.9941,  0.0261,  0.1697,  0.9926,
         0.9135,  0.7679,  0.9410,  0.9808,  0.0411,  0.0096,  0.9783,
         0.0220,  0.9349,  0.8841,  0.8522,  0.9973,  0.4066,  0.0019,
         0.9853,  0.0343,  0.9693,  0.9495,  0.9744,  0.0697,  0.9240,
         0.9930,  0.9303,  0.0128,  0.9510,  0.3996,  0.0010,  0.8896,
         0.9996,  0.7398,  0.9779,  0.6653,  0.9861,  0.9962,  0.9833,
         0.0232,  0.0351,  0.9882,  0.4505,  0.9873,  0.9896,  0.2771,
         0.9872,  0.9392,  0.0593,  0.0442,  0.0649,  0.5516,  0.4198,
         0.9097,  0.5293,  0.3475,  0.8664,  0.9394,  0.9587,  0.8439,
         0.9594,  0.9251,  0.0209,  0.4947,  0.9885,  0.6762,  0.2400,
         0.1917,  0.2372,  0.0464,  0.8707,  0.7317,  0.9882,  0.8735,
         0.4575,  0.8834,  0.9836,  0.9265,  0.4744,  0.9492,  0.9852,
         0.9884,  0.0127,  0.9619,  0.3425,  0.3651,  0.6347,  0.5180,
         0.0575,  0.9021,  0.0059,  0.8589,  0.9939,  0.0853,  0.0646,
         0.9871,  0.0593,  0.9985,  0.0447,  0.0019,  0.9786,  0.0707,
         0.0707,  0.0172,  0.2519,  0.6438,  0.0073,  0.9867,  0.7203,
         0.0091,  0.9448,  0.1054,  0.0367,  0.0090,  0.0765,  0.1604,
         0.0084,  0.9931,  0.0156,  0.8725,  0.9797,  0.4930,  0.9742,
         0.0170,  0.9932,  0.2149,  0.1718,  0.9904,  0.2581,  0.0034,
         0.0593,  0.1766,  0.8687,  0.9930,  0.0923,  0.9827,  0.0080,
         0.9246,  0.9834,  0.9160,  0.0648,  0.9443,  0.9511,  0.0141,
         0.9609,  0.8845,  0.8614,  0.8804,  0.9749,  0.6962,  0.9705,
         0.0601,  0.1492,  0.0852,  0.6701,  0.9614,  0.1672,  0.9491,
         0.9769,  0.9568,  0.0234,  0.0065,  0.0749,  0.8999,  0.9978,
         0.9370,  0.9497,  0.7820,  0.0470,  0.5207,  0.2235,  0.9969,
         0.9275,  0.8743,  0.8690,  0.9663,  0.0427,  0.4247,  0.9508,
         0.0465,  0.7866,  0.0037,  0.9587,  0.9745,  0.6160,  0.8975,
         0.9816,  0.6087,  0.4380,  0.1703,  0.9682,  0.9331,  0.1277,
         0.9803,  0.0085,  0.5313,  0.4744,  0.3190,  0.4861,  0.0542,
         0.9828,  0.0121,  0.9685,  0.6288,  0.0267,  0.4091,  0.1056,
         0.0141,  0.9114,  0.0250,  0.0207,  0.1587,  0.0476,  0.1779,
         0.9437,  0.8043,  0.2537,  0.1382,  0.9650,  0.9920,  0.0093,
         0.6849], device='cuda:0')
tensor(0.2831, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
tensor([ 0.0068,  0.9790,  0.9220,  0.1094,  0.0207,  0.0057,  0.0188,
         0.9651,  0.3194,  0.0072,  0.3354,  0.6519,  0.5855,  0.9132,
         0.0430,  0.0696,  0.0476,  0.0085,  0.0873,  0.0249,  0.7570,
         0.0100,  0.9984,  0.9598,  0.0169,  0.0368,  0.0386,  0.0665,
         0.9845,  0.0527,  0.0998,  0.0047,  0.0322,  0.0009,  0.1530,
         0.9478,  0.0049,  0.9432,  0.8852,  0.9847,  0.8193,  0.0308,
         0.6857,  0.0585,  0.9556,  0.1598,  0.1451,  0.6643,  0.5701,
         0.9166,  0.2969,  0.0353,  0.7081,  0.7949,  0.0756,  0.9756,
         0.8464,  0.5029,  0.9667,  0.0385,  0.0871,  0.0859,  0.4507,
         0.9305,  0.9283,  0.7003,  0.9983,  0.0156,  0.0084,  0.9905,
         0.0124,  0.0119,  0.8433,  0.0095,  0.0364,  0.5930,  0.9522,
         0.4402,  0.9784,  0.0015,  0.0023,  0.7695,  0.9590,  0.1648,
         0.9905,  0.1586,  0.9785,  0.9464,  0.0938,  0.9604,  0.2394,
         0.9509,  0.8840,  0.1102,  0.2020,  0.0424,  0.5807,  0.9679,
         0.1605,  0.9188,  0.1017,  0.1008,  0.1459,  0.4204,  0.1357,
         0.9630,  0.9887,  0.3158,  0.0450,  0.9597,  0.0026,  0.7488,
         0.1038,  0.9835,  0.0093,  0.9406,  0.9940,  0.4558,  0.0430,
         0.8723,  0.0108,  0.8796,  0.8420,  0.9995,  0.9970,  0.9506,
         0.8310,  0.0127,  0.0783,  0.7808,  0.9989,  0.9911,  0.1323,
         0.6278,  0.0462,  0.0257,  0.9650,  0.0575,  0.0307,  0.4480,
         0.0643,  0.8842,  0.4405,  0.0608,  0.8133,  0.2177,  0.5858,
         0.0378,  0.7012,  0.0020,  0.0104,  0.9916,  0.7464,  0.0150,
         0.9715,  0.9829,  0.0865,  0.2640,  0.0057,  0.0461,  0.0283,
         0.0354,  0.9598,  0.0767,  0.0052,  0.9570,  0.0289,  0.1225,
         0.0035,  0.0170,  0.0625,  0.9516,  0.7705,  0.2018,  0.3158,
         0.4761,  0.9334,  0.4749,  0.9485,  0.9491,  0.0050,  0.0114,
         0.3456,  0.0026,  0.8419,  0.9949,  0.1904,  0.0513,  0.8651,
         0.9905,  0.1855,  0.0019,  0.9173,  0.9323,  0.0101,  0.0755,
         0.7605,  0.8526,  0.8316,  0.3402,  0.9929,  0.8418,  0.9514,
         0.9748,  0.2842,  0.6505,  0.9998,  0.8864,  0.9692,  0.8552,
         0.9739,  0.9203,  0.0122,  0.9856,  0.0684,  0.9702,  0.5057,
         0.0411,  0.0280,  0.9972,  0.9992,  0.1045,  0.9828,  0.0158,
         0.9281,  0.6509,  0.9330,  0.6656,  0.9381,  0.0352,  0.9769,
         0.0035,  0.0778,  0.9365,  0.0563,  0.0871,  0.0024,  0.1498,
         0.9999,  0.9510,  0.0685,  0.9551,  0.8227,  0.8381,  0.7455,
         0.8787,  0.9471,  0.8031,  0.6268,  0.0545,  0.1063,  0.0752,
         0.9122,  0.0247,  0.0491,  0.9084,  0.5448,  0.9411,  0.4174,
         0.9537,  0.0466,  0.9658,  0.9896,  0.9809,  0.1747,  0.9671,
         0.9804,  0.9894,  0.0105,  0.8652,  0.0342,  0.9220,  0.9996,
         0.9664,  0.9952,  0.1042,  0.9208,  0.8733,  0.0126,  0.0224,
         0.1988,  0.0201,  0.0020,  0.8494,  0.3440,  0.9744,  0.0247,
         0.0662,  0.9904,  0.1270,  0.9370,  0.1737,  0.0264,  0.8880,
         0.6468,  0.0061,  0.0797,  0.0577,  0.0033,  0.0614,  0.0124,
         0.0221,  0.0167,  0.7629,  0.9230,  0.9173,  0.8597,  0.9265,
         0.8330,  0.8691,  0.9978,  0.1651,  0.3608,  0.9731,  0.6021,
         0.0248,  0.0026,  0.1405,  0.2798,  0.0506,  0.9750,  0.9115,
         0.9449,  0.2287,  0.8616,  0.8965,  0.9723,  0.0009,  0.1448,
         0.8923,  0.9999,  0.9479,  0.8743,  0.9618,  0.9366,  0.8021,
         0.9258,  0.3319,  0.6914,  0.0436,  0.1429,  0.0007,  0.0298,
         0.9804,  0.0911,  0.0028,  0.9776,  0.9947,  0.2351,  0.0744,
         0.1758,  0.0266,  0.0599,  0.9301,  0.9512,  0.7688,  0.8725,
         0.9324,  0.9738,  0.9904,  0.0795,  0.5841,  0.0350,  0.4520,
         0.0115,  0.0554,  0.9666,  0.2333,  0.8512,  0.1216,  0.9710,
         0.6213,  0.0183,  0.9345,  0.0397,  0.9925,  0.7516,  0.3233,
         0.0381,  0.9710,  0.3120,  0.9384,  0.8344,  0.3227,  0.9684,
         0.9739,  0.8967,  0.0826,  0.0086,  0.0164,  0.7702,  0.2357,
         0.9928,  0.0442,  0.0257,  0.8624,  0.9342,  0.3576,  0.9571,
         0.0689,  0.0087,  0.0380,  0.8967,  0.0440,  0.1009,  0.0093,
         0.9292,  0.9476,  0.0138,  0.9975,  0.0236,  0.9577,  0.0607,
         0.6336,  0.0131,  0.0152,  0.0294,  0.0038,  0.5209,  0.3967,
         0.0384,  0.2149,  0.9267,  0.9945], device='cuda:0')
tensor(0.2536, device='cuda:0')
Adam (
Parameter Group 0
    amsgrad: False
    betas: (0.9, 0.999)
    eps: 1e-08
    lr: 0.001
    weight_decay: 0
)
Epoch: 10, BCELoss: 0.28242454023993746
2020-06-28 06:05:14,512 sagemaker-containers INFO     Reporting training SUCCESS

2020-06-28 06:05:25 Completed - Training job completed
Training seconds: 291
Billable seconds: 291

Step 5: Testing the model

As mentioned at the top of this notebook, we will be testing this model by first deploying it and then sending the testing data to the deployed endpoint. We will do this so that we can make sure that the deployed model is working correctly.

Step 6: Deploy the model for testing

Now that we have trained our model, we would like to test it to see how it performs. Currently our model takes input of the form review_length, review[500] where review[500] is a sequence of 500 integers which describe the words present in the review, encoded using word_dict. Fortunately for us, SageMaker provides built-in inference code for models with simple inputs such as this.

There is one thing that we need to provide, however, and that is a function which loads the saved model. This function must be called model_fn() and takes as its only parameter a path to the directory where the model artifacts are stored. This function must also be present in the python file which we specified as the entry point. In our case the model loading function has been provided and so no changes need to be made.

NOTE: When the built-in inference code is run it must import the model_fn() method from the train.py file. This is why the training code is wrapped in a main guard ( ie, if __name__ == '__main__': )

Since we don't need to change anything in the code that was uploaded during training, we can simply deploy the current model as-is.

NOTE: When deploying a model you are asking SageMaker to launch an compute instance that will wait for data to be sent to it. As a result, this compute instance will continue to run until you shut it down. This is important to know since the cost of a deployed endpoint depends on how long it has been running for.

In other words If you are no longer using a deployed endpoint, shut it down!

TODO: Deploy the trained model.

predictor  =  estimator.deploy(initial_instance_count =1 , instance_type = 'ml.m4.xlarge')

-------------!

#estimator.delete_endpoint()

Step 7 - Use the model for testing

Once deployed, we can read in the test data and send it off to our deployed model to get some results. Once we collect all of the results we can determine how accurate our model is.

#estimator.delete_endpoint()
test_X = pd.concat([pd.DataFrame(test_X_len), pd.DataFrame(test_X)], axis=1)

print(test_X)

       0     0     1     2     3     4     5     6     7     8    ...  490  \
0      209    96    24     2   393    17     2   141   739   721  ...    0   
1       59   487   786   342  4003  1116    69   557    80     1  ...    0   
2       70   244     1     1   277   320     2  2943   144     2  ...    0   
3       18   210    83   241   801     4    53   571     3  4640  ...    0   
4       72   182  1487     1    25  1032  1506   135  1487   877  ...    0   
5      138  1852   292    40  1091    99     2   148   601     1  ...    0   
6       68    28    30    73    32   222   204    13   392    13  ...    0   
7      242     2   287   335   467   154     1   143   216    13  ...    0   
8       79     3   300   174     3    56    47   161   272   404  ...    0   
9       99   908   960  1009     1   156    39     5    79     1  ...    0   
10     115  1934   286    50     1     1  1066     4  1066   736  ...    0   
11     106    17    38  1045  1918    16    21    38    16    31  ...    0   
12      73    96    37    23  1769     3   105     6  1936   670  ...    0   
13      99   147   425     2  1483     1   172    21   176  3961  ...    0   
14      60   224   224     6  3991     1    34   168     2    96  ...    0   
15      69     1   391     1   332     4  3480   836   260  1158  ...    0   
16     164  2067   527   172    26    67     1     1   106   172  ...    0   
17     170   444   195    10  3188   533    55   435   459   267  ...    0   
18      65   885   164   587   107  2430   229   160    44    72  ...    0   
19      34  4961     1  1656     2    17    98   208  2760    62  ...    0   
20      59   254  2792     2     1  4808   183   736  2262   421  ...    0   
21      64     2   447    58  1678  1113  1322   760   764   358  ...    0   
22      71    28    12     3    44   536   423  1799  1413    29  ...    0   
23      65    93   236   171   151    39   240  3900    86  1631  ...    0   
24      96   667   108  3501   105   737  2267  3356   923  4722  ...    0   
25      19   184     3   124  1099   202   362   124    21  2981  ...    0   
26      69     3   392   288    48    72  2170  1373     1    10  ...    0   
27      58  1018    41    39     5   258   674   770     1     3  ...    0   
28     202     7     2    24     2     1  1317     3  1164    24  ...    0   
29     238    47  3214     2   363    47     1  4287   113   231  ...    0   
...    ...   ...   ...   ...   ...   ...   ...   ...   ...   ...  ...  ...   
24970  391   309     3    39    96  1575   303  2818   177     9  ...    0   
24971   46    11     2   798  1203   776   270   443     1     1  ...    0   
24972   75  1375     3   402   823   610   607   195   314   636  ...    0   
24973   39  2474    84   401    11     2   111   271    38  1022  ...    0   
24974   15  1767   181   135     5   428  1028     7    41    27  ...    0   
24975  150   209   198   241    13  1270  3570    47   947    95  ...    0   
24976   79     1    24   104     3    38  3452   849   186     1  ...    0   
24977   70   354     1   478   132    25  3004  1687     4   132  ...    0   
24978   30     2    12    64  4605   333   188   240    28    63  ...    0   
24979  114     2    21   791   499   172   195  1413    31   260  ...    0   
24980   74    26     2   130    16     5    93   661  1989   257  ...    0   
24981  123   950  1704    22   877   182   211   101  2343   571  ...    0   
24982   81     3   443   309   247     1   564   149     1   102  ...    0   
24983   76     5     3   312  2456  1016   385   498   300     4  ...    0   
24984   62     5   198     1  3042  2219   198   476    52    89  ...    0   
24985   65   195     3  4605   390    64   516   619     6    11  ...    0   
24986  251     5     1     1     5   594   282  3571  2410   187  ...    0   
24987   88    38     3    57     1  2852    11    52    41   468  ...    0   
24988  112  1035   123   703    42   127   395    74     1     1  ...    0   
24989   26   634   323    82     2   456   443  1960   259    73  ...    0   
24990   68    28   506    26     7   741   193   334   132   271  ...    0   
24991   44  1806    11    90  1325   239  4960  1489  4136  2187  ...    0   
24992   78  2569  2267  2888  1357     1     1    51    10  1153  ...    0   
24993  105    29     2   116     1   123    47   542     1     3  ...    0   
24994   49   100    63     5    70    69   437   245    47    62  ...    0   
24995  105   304     1     2   303   321    44  1301     6    28  ...    0   
24996   79    21  2437   197     1  1497  1058  1119   761  2969  ...    0   
24997   70   397   977   516  4177    15   442   324  1133   380  ...    0   
24998   84   366   130  2799  1078     1   202   949   125     4  ...    0   
24999   89  2246  3910   799   508     1   659  4647  1039   716  ...    0   

       491  492  493  494  495  496  497  498  499  
0        0    0    0    0    0    0    0    0    0  
1        0    0    0    0    0    0    0    0    0  
2        0    0    0    0    0    0    0    0    0  
3        0    0    0    0    0    0    0    0    0  
4        0    0    0    0    0    0    0    0    0  
5        0    0    0    0    0    0    0    0    0  
6        0    0    0    0    0    0    0    0    0  
7        0    0    0    0    0    0    0    0    0  
8        0    0    0    0    0    0    0    0    0  
9        0    0    0    0    0    0    0    0    0  
10       0    0    0    0    0    0    0    0    0  
11       0    0    0    0    0    0    0    0    0  
12       0    0    0    0    0    0    0    0    0  
13       0    0    0    0    0    0    0    0    0  
14       0    0    0    0    0    0    0    0    0  
15       0    0    0    0    0    0    0    0    0  
16       0    0    0    0    0    0    0    0    0  
17       0    0    0    0    0    0    0    0    0  
18       0    0    0    0    0    0    0    0    0  
19       0    0    0    0    0    0    0    0    0  
20       0    0    0    0    0    0    0    0    0  
21       0    0    0    0    0    0    0    0    0  
22       0    0    0    0    0    0    0    0    0  
23       0    0    0    0    0    0    0    0    0  
24       0    0    0    0    0    0    0    0    0  
25       0    0    0    0    0    0    0    0    0  
26       0    0    0    0    0    0    0    0    0  
27       0    0    0    0    0    0    0    0    0  
28       0    0    0    0    0    0    0    0    0  
29       0    0    0    0    0    0    0    0    0  
...    ...  ...  ...  ...  ...  ...  ...  ...  ...  
24970    0    0    0    0    0    0    0    0    0  
24971    0    0    0    0    0    0    0    0    0  
24972    0    0    0    0    0    0    0    0    0  
24973    0    0    0    0    0    0    0    0    0  
24974    0    0    0    0    0    0    0    0    0  
24975    0    0    0    0    0    0    0    0    0  
24976    0    0    0    0    0    0    0    0    0  
24977    0    0    0    0    0    0    0    0    0  
24978    0    0    0    0    0    0    0    0    0  
24979    0    0    0    0    0    0    0    0    0  
24980    0    0    0    0    0    0    0    0    0  
24981    0    0    0    0    0    0    0    0    0  
24982    0    0    0    0    0    0    0    0    0  
24983    0    0    0    0    0    0    0    0    0  
24984    0    0    0    0    0    0    0    0    0  
24985    0    0    0    0    0    0    0    0    0  
24986    0    0    0    0    0    0    0    0    0  
24987    0    0    0    0    0    0    0    0    0  
24988    0    0    0    0    0    0    0    0    0  
24989    0    0    0    0    0    0    0    0    0  
24990    0    0    0    0    0    0    0    0    0  
24991    0    0    0    0    0    0    0    0    0  
24992    0    0    0    0    0    0    0    0    0  
24993    0    0    0    0    0    0    0    0    0  
24994    0    0    0    0    0    0    0    0    0  
24995    0    0    0    0    0    0    0    0    0  
24996    0    0    0    0    0    0    0    0    0  
24997    0    0    0    0    0    0    0    0    0  
24998    0    0    0    0    0    0    0    0    0  
24999    0    0    0    0    0    0    0    0    0  

[25000 rows x 501 columns]

# We split the data into chunks and send each chunk seperately, accumulating the results.

def predict(data, rows=512):
    split_array = np.array_split(data, int(data.shape[0] / float(rows) + 1))
    predictions = np.array([])
    for array in split_array:
        predictions = np.append(predictions, predictor.predict(array))
    
    return predictions

predictions = predict(test_X.values)
predictions = [round(num) for num in predictions]

from sklearn.metrics import accuracy_score
accuracy_score(test_y, predictions)

0.8488

Question: How does this model compare to the XGBoost model you created earlier? Why might these two models perform differently on this dataset? Which do you think is better for sentiment analysis?

Answer: Going by the results, XGBoost model performed better visibly

(TODO) More testing

We now have a trained model which has been deployed and which we can send processed reviews to and which returns the predicted sentiment. However, ultimately we would like to be able to send our model an unprocessed review. That is, we would like to send the review itself as a string. For example, suppose we wish to send the following review to our model.

test_review = 'The simplest pleasures in life are the best, and this film is one of them. Combining a rather basic storyline of love and adventure this movie transcends the usual weekend fair with wit and unmitigated charm.'

The question we now need to answer is, how do we send this review to our model?

Recall in the first section of this notebook we did a bunch of data processing to the IMDb dataset. In particular, we did two specific things to the provided reviews.

• Removed any html tags and stemmed the input
• Encoded the review as a sequence of integers using word_dict

In order process the review we will need to repeat these two steps.

TODO: Using the review_to_words and convert_and_pad methods from section one, convert test_review into a numpy array test_data suitable to send to our model. Remember that our model expects input of the form review_length, review[500].

# TODO: Convert test_review into a form usable by the model and save the results in test_data
test_review_into_words = review_to_words(test_review)

test_sent, test_data_len  =  convert_and_pad(word_dict,test_review_into_words)

pack= np.hstack((test_data_len, test_sent))
test_data = pack.reshape(1, -1)

Now that we have processed the review, we can send the resulting array to our model to predict the sentiment of the review.

predictor.predict(test_data)

array(0.9411435, dtype=float32)

Since the return value of our model is close to 1, we can be certain that the review we submitted is positive.

Delete the endpoint

Of course, just like in the XGBoost notebook, once we've deployed an endpoint it continues to run until we tell it to shut down. Since we are done using our endpoint for now, we can delete it.

estimator.delete_endpoint()

Step 6 (again) - Deploy the model for the web app

Now that we know that our model is working, it's time to create some custom inference code so that we can send the model a review which has not been processed and have it determine the sentiment of the review.

As we saw above, by default the estimator which we created, when deployed, will use the entry script and directory which we provided when creating the model. However, since we now wish to accept a string as input and our model expects a processed review, we need to write some custom inference code.

We will store the code that we write in the serve directory. Provided in this directory is the model.py file that we used to construct our model, a utils.py file which contains the review_to_words and convert_and_pad pre-processing functions which we used during the initial data processing, and predict.py, the file which will contain our custom inference code. Note also that requirements.txt is present which will tell SageMaker what Python libraries are required by our custom inference code.

When deploying a PyTorch model in SageMaker, you are expected to provide four functions which the SageMaker inference container will use.

• model_fn: This function is the same function that we used in the training script and it tells SageMaker how to load our model.
• input_fn: This function receives the raw serialized input that has been sent to the model's endpoint and its job is to de-serialize and make the input available for the inference code.
• output_fn: This function takes the output of the inference code and its job is to serialize this output and return it to the caller of the model's endpoint.
• predict_fn: The heart of the inference script, this is where the actual prediction is done and is the function which you will need to complete.

For the simple website that we are constructing during this project, the input_fn and output_fn methods are relatively straightforward. We only require being able to accept a string as input and we expect to return a single value as output. You might imagine though that in a more complex application the input or output may be image data or some other binary data which would require some effort to serialize.

(TODO) Writing inference code

Before writing our custom inference code, we will begin by taking a look at the code which has been provided.

!pygmentize serve/predict.py

import argparse
import json
import os
import pickle
import sys
import sagemaker_containers
import pandas as pd
import numpy as np
import torch
import torch.nn as nn
import torch.optim as optim
import torch.utils.data

from model import LSTMClassifier

from utils import review_to_words, convert_and_pad

def model_fn(model_dir):
    """Load the PyTorch model from the `model_dir` directory."""
    print("Loading model.")

    # First, load the parameters used to create the model.
    model_info = {}
    model_info_path = os.path.join(model_dir, 'model_info.pth')
    with open(model_info_path, 'rb') as f:
        model_info = torch.load(f)

    print("model_info: {}".format(model_info))

    # Determine the device and construct the model.
    device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
    model = LSTMClassifier(model_info['embedding_dim'], model_info['hidden_dim'], model_info['vocab_size'])

    # Load the store model parameters.
    model_path = os.path.join(model_dir, 'model.pth')
    with open(model_path, 'rb') as f:
        model.load_state_dict(torch.load(f))

    # Load the saved word_dict.
    word_dict_path = os.path.join(model_dir, 'word_dict.pkl')
    with open(word_dict_path, 'rb') as f:
        model.word_dict = pickle.load(f)

    model.to(device).eval()

    print("Done loading model.")
    return model

def input_fn(serialized_input_data, content_type):
    print('Deserializing the input data.')
    if content_type == 'text/plain':
        data = serialized_input_data.decode('utf-8')
        return data
    raise Exception('Requested unsupported ContentType in content_type: ' + content_type)

def output_fn(prediction_output, accept):
    print('Serializing the generated output.')
    return str(prediction_output)

def predict_fn(input_data, model):
    print('Inferring sentiment of input data.')

    device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
    
    if model.word_dict is None:
        raise Exception('Model has not been loaded properly, no word_dict.')
    
    # TODO: Process input_data so that it is ready to be sent to our model.
    #       You should produce two variables:
    #         data_X   - A sequence of length 500 which represents the converted review
    #         data_len - The length of the review
    
    tokens = review_to_words(input_data)
    
    data_X, data_len = convert_and_pad(model.word_dict, tokens)

    print(tokens)
    #print
    #reshape function
    data_pack = np.hstack((data_len, data_X))
    
    data_pack = data_pack.reshape(1, -1)
    
    data = torch.from_numpy(data_pack)
    data = data.to(device)
    print(data)

    #final
    model.eval()
    #model.eval()

    with torch.no_grad():
        
        #print
        print(data)
        result = model(data).detach().numpy()
        
        print(result)

        return result

As mentioned earlier, the model_fn method is the same as the one provided in the training code and the input_fn and output_fn methods are very simple and your task will be to complete the predict_fn method. Make sure that you save the completed file as predict.py in the serve directory.

TODO: Complete the predict_fn() method in the serve/predict.py file.

Deploying the model

Now that the custom inference code has been written, we will create and deploy our model. To begin with, we need to construct a new PyTorchModel object which points to the model artifacts created during training and also points to the inference code that we wish to use. Then we can call the deploy method to launch the deployment container.

NOTE: The default behaviour for a deployed PyTorch model is to assume that any input passed to the predictor is a numpy array. In our case we want to send a string so we need to construct a simple wrapper around the RealTimePredictor class to accomodate simple strings. In a more complicated situation you may want to provide a serialization object, for example if you wanted to sent image data.

from sagemaker.predictor import RealTimePredictor
from sagemaker.pytorch import PyTorchModel

class StringPredictor(RealTimePredictor):
    def __init__(self, endpoint_name, sagemaker_session):
        super(StringPredictor, self).__init__(endpoint_name, sagemaker_session, content_type='text/plain')

model = PyTorchModel(model_data=estimator.model_data,
                     role = role,
                     framework_version='0.4.0',
                     entry_point='predict.py',
                     source_dir='serve',
                     predictor_cls=StringPredictor)
predictor = model.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge')

-------------!

Testing the model

Now that we have deployed our model with the custom inference code, we should test to see if everything is working. Here we test our model by loading the first 250 positive and negative reviews and send them to the endpoint, then collect the results. The reason for only sending some of the data is that the amount of time it takes for our model to process the input and then perform inference is quite long and so testing the entire data set would be prohibitive.

import glob

def test_reviews(data_dir='../data/aclImdb', stop=250):
    
    results = []
    truth = []
    
    #Both the +ve and -ve reviews    
    for sentiment in ['pos', 'neg']:
        
        path = os.path.join(data_dir, 'test', sentiment, '*.txt')
        files = glob.glob(path)
        
        files_read = 0
        
        print('Starting ', sentiment, ' files')
        
        # File iteration and sending them back
        for f in files:
            with open(f) as review:
                # Storing the ground truth
                if sentiment == 'pos':
                    truth.append(1)
                else:
                    truth.append(0)
                # Review reader and conversion to UTF-8
                review_input = review.read().encode('utf-8')
                
                result = float(predictor.predict(review_input))
                results.append(round(result))
                
            
            files_read += 1
            
            if files_read == stop:
                break
            
    return truth, results

truth, results = test_reviews()

Starting  pos  files
Starting  neg  files

from sklearn.metrics import accuracy_score
accuracy_score(truth, results)

0.854

As an additional test, we can try sending the test_review that we looked at earlier.

predictor.predict(test_review)

b'0.9411435'

Now that we know our endpoint is working as expected, we can set up the web page that will interact with it. If you don't have time to finish the project now, make sure to skip down to the end of this notebook and shut down your endpoint. You can deploy it again when you come back.

Step 7 (again): Use the model for the web app

TODO: This entire section and the next contain tasks for you to complete, mostly using the AWS console.

So far we have been accessing our model endpoint by constructing a predictor object which uses the endpoint and then just using the predictor object to perform inference. What if we wanted to create a web app which accessed our model? The way things are set up currently makes that not possible since in order to access a SageMaker endpoint the app would first have to authenticate with AWS using an IAM role which included access to SageMaker endpoints. However, there is an easier way! We just need to use some additional AWS services.

The diagram above gives an overview of how the various services will work together. On the far right is the model which we trained above and which is deployed using SageMaker. On the far left is our web app that collects a user's movie review, sends it off and expects a positive or negative sentiment in return.

In the middle is where some of the magic happens. We will construct a Lambda function, which you can think of as a straightforward Python function that can be executed whenever a specified event occurs. We will give this function permission to send and recieve data from a SageMaker endpoint.

Lastly, the method we will use to execute the Lambda function is a new endpoint that we will create using API Gateway. This endpoint will be a url that listens for data to be sent to it. Once it gets some data it will pass that data on to the Lambda function and then return whatever the Lambda function returns. Essentially it will act as an interface that lets our web app communicate with the Lambda function.

Setting up a Lambda function

The first thing we are going to do is set up a Lambda function. This Lambda function will be executed whenever our public API has data sent to it. When it is executed it will receive the data, perform any sort of processing that is required, send the data (the review) to the SageMaker endpoint we've created and then return the result.

Part A: Create an IAM Role for the Lambda function

Since we want the Lambda function to call a SageMaker endpoint, we need to make sure that it has permission to do so. To do this, we will construct a role that we can later give the Lambda function.

Using the AWS Console, navigate to the IAM page and click on Roles. Then, click on Create role. Make sure that the AWS service is the type of trusted entity selected and choose Lambda as the service that will use this role, then click Next: Permissions.

In the search box type sagemaker and select the check box next to the AmazonSageMakerFullAccess policy. Then, click on Next: Review.

Lastly, give this role a name. Make sure you use a name that you will remember later on, for example LambdaSageMakerRole. Then, click on Create role.

Part B: Create a Lambda function

Now it is time to actually create the Lambda function.

Using the AWS Console, navigate to the AWS Lambda page and click on Create a function. When you get to the next page, make sure that Author from scratch is selected. Now, name your Lambda function, using a name that you will remember later on, for example sentiment_analysis_func. Make sure that the Python 3.6 runtime is selected and then choose the role that you created in the previous part. Then, click on Create Function.

On the next page you will see some information about the Lambda function you've just created. If you scroll down you should see an editor in which you can write the code that will be executed when your Lambda function is triggered. In our example, we will use the code below.

# We need to use the low-level library to interact with SageMaker since the SageMaker API
# is not available natively through Lambda.
import boto3

def lambda_handler(event, context):

    # The SageMaker runtime is what allows us to invoke the endpoint that we've created.
    runtime = boto3.Session().client('sagemaker-runtime')

    # Now we use the SageMaker runtime to invoke our endpoint, sending the review we were given
    response = runtime.invoke_endpoint(EndpointName = '**ENDPOINT NAME HERE**',    # The name of the endpoint we created
                                       ContentType = 'text/plain',                 # The data format that is expected
                                       Body = event['body'])                       # The actual review

    # The response is an HTTP response whose body contains the result of our inference
    result = response['Body'].read().decode('utf-8')

    return {
        'statusCode' : 200,
        'headers' : { 'Content-Type' : 'text/plain', 'Access-Control-Allow-Origin' : '*' },
        'body' : result
    }

Once you have copy and pasted the code above into the Lambda code editor, replace the **ENDPOINT NAME HERE** portion with the name of the endpoint that we deployed earlier. You can determine the name of the endpoint using the code cell below.

predictor.endpoint

'sagemaker-pytorch-2020-06-28-06-28-28-176'

Once you have added the endpoint name to the Lambda function, click on Save. Your Lambda function is now up and running. Next we need to create a way for our web app to execute the Lambda function.

Setting up API Gateway

Now that our Lambda function is set up, it is time to create a new API using API Gateway that will trigger the Lambda function we have just created.

Using AWS Console, navigate to Amazon API Gateway and then click on Get started.

On the next page, make sure that New API is selected and give the new api a name, for example, sentiment_analysis_api. Then, click on Create API.

Now we have created an API, however it doesn't currently do anything. What we want it to do is to trigger the Lambda function that we created earlier.

Select the Actions dropdown menu and click Create Method. A new blank method will be created, select its dropdown menu and select POST, then click on the check mark beside it.

For the integration point, make sure that Lambda Function is selected and click on the Use Lambda Proxy integration. This option makes sure that the data that is sent to the API is then sent directly to the Lambda function with no processing. It also means that the return value must be a proper response object as it will also not be processed by API Gateway.

Type the name of the Lambda function you created earlier into the Lambda Function text entry box and then click on Save. Click on OK in the pop-up box that then appears, giving permission to API Gateway to invoke the Lambda function you created.

The last step in creating the API Gateway is to select the Actions dropdown and click on Deploy API. You will need to create a new Deployment stage and name it anything you like, for example prod.

You have now successfully set up a public API to access your SageMaker model. Make sure to copy or write down the URL provided to invoke your newly created public API as this will be needed in the next step. This URL can be found at the top of the page, highlighted in blue next to the text Invoke URL.

Step 4: Deploying our web app

Now that we have a publicly available API, we can start using it in a web app. For our purposes, we have provided a simple static html file which can make use of the public api you created earlier.

In the website folder there should be a file called index.html. Download the file to your computer and open that file up in a text editor of your choice. There should be a line which contains **REPLACE WITH PUBLIC API URL**. Replace this string with the url that you wrote down in the last step and then save the file.

Now, if you open index.html on your local computer, your browser will behave as a local web server and you can use the provided site to interact with your SageMaker model.

If you'd like to go further, you can host this html file anywhere you'd like, for example using github or hosting a static site on Amazon's S3. Once you have done this you can share the link with anyone you'd like and have them play with it too!

Important Note In order for the web app to communicate with the SageMaker endpoint, the endpoint has to actually be deployed and running. This means that you are paying for it. Make sure that the endpoint is running when you want to use the web app but that you shut it down when you don't need it, otherwise you will end up with a surprisingly large AWS bill.

TODO: Make sure that you include the edited index.html file in your project submission.

Now that your web app is working, trying playing around with it and see how well it works.

Question: Give an example of a review that you entered into your web app. What was the predicted sentiment of your example review?

Answer: A dazzling story of love, loss, anger, tender choices and emotional feelings...

Review: POSITIVE

Delete the endpoint

Remember to always shut down your endpoint if you are no longer using it. You are charged for the length of time that the endpoint is running so if you forget and leave it on you could end up with an unexpectedly large bill.

predictor.delete_endpoint()